Simple, Transparent, and Flexible Automated Quality Assessment Procedures for Ambulatory Electrodermal Activity Data

Associations between social anxiety, physiological reactivity, and speech disfluencies in autistic young adults and controls

INTRODUCTION

The aim of this study was to examine possible associations of social anxiety (SA) and speaking-related physiological reactivity with the frequencies of a) total disfluencies, b) typical disfluencies, and c) stuttering-like disfluencies, as well as d) stuttering-severity in autistic young adults and controls.

METHODS

Thirty-two autistic young adults and 35 controls participated in this study. Participants were presented with video clips (viewing condition) and were then asked to talk about the videos (narrating condition). SA was measured by the self-report Social Phobia and Anxiety Inventory (SPAI). Speaking-related physiological reactivity was measured by the electrodermal activity (EDA), an index of emotional arousal. The speech samples from the narrating condition were analyzed for type and frequency of speech disfluencies and used for determining the stuttering severity. SA and speaking-related physiological reactivity were compared between the groups. Correlation between SA, physiological reactivity, disfluency frequencies, and stuttering severity were tested separately for both groups.

RESULTS

No between-group differences were found in the overall SA, yet differences were found in SPAI subscales of social interaction, group interaction, and avoidance, as well as in agoraphobia. Both groups had higher physiological arousal in narrating condition in comparison to the video viewing condition, yet there was no between-group difference in the reactivity. No associations were found between SPAI measures, physiological reactivity, disfluency frequencies, and stuttering severity in the autistic group. In the control group, a negative association was found between physiological reactivity and total and typical disfluency frequencies.

CONCLUSIONS

SA or speaking-related physiological reactivity were not associated with disfluency frequencies or stuttering severity in autistic persons. Negative association between physiological reactivity and disfluency frequencies found in the control group may indicate that the physiological arousal may impact the speech production process by reducing the overt disfluencies.

Automated mood disorder symptoms monitoring from multivariate time-series sensory data: getting the full picture beyond a single number

Mood disorders (MDs) are among the leading causes of disease burden worldwide. Limited specialized care availability remains a major bottleneck thus hindering pre-emptive interventions. MDs manifest with changes in mood, sleep, and motor activity, observable in ecological physiological recordings thanks to recent advances in wearable technology. Therefore, near-continuous and passive collection of physiological data from wearables in daily life, analyzable with machine learning (ML), could mitigate this problem, bringing MDs monitoring outside the clinician's office. Previous works predict a single label, either the disease state or a psychometric scale total score. However, clinical practice suggests that the same label may underlie different symptom profiles, requiring specific treatments. Here we bridge this gap by proposing a new task: inferring all items in HDRS and YMRS, the two most widely used standardized scales for assessing MDs symptoms, using physiological data from wearables. To that end, we develop a deep learning pipeline to score the symptoms of a large cohort of MD patients and show that agreement between predictions and assessments by an expert clinician is clinically significant (quadratic Cohen's κ and macro-average F1 score both of 0.609). While doing so, we investigate several solutions to the ML challenges associated with this task, including multi-task learning, class imbalance, ordinal target variables, and subject-invariant representations. Lastly, we illustrate the importance of testing on out-of-distribution samples.

From lab to life: Evaluating the reliability and validity of psychophysiological data from wearable devices in laboratory and ambulatory settings

Despite the increasing popularity of ambulatory assessment, the reliability and validity of psychophysiological signals from wearable devices is unproven in daily life settings. We evaluated the reliability and validity of physiological signals (electrocardiogram, ECG; photoplethysmography, PPG; electrodermal activity, EDA) collected from two wearable devices (Movisens EcgMove4 and Empatica E4) in the lab (N = 67) and daily life (N = 20) among adults aged 18-64 with Mindware as the laboratory gold standard. Results revealed that both wearable devices' valid data rates in daily life were lower than in the laboratory (Movisens ECG 82.94 vs. 93.10%, Empatica PPG 8.79 vs. 26.14%, and Empatica EDA 41.16 vs. 42.67%, respectively). The poor valid data rates of Empatica PPG signals in the laboratory could be partially attributed to participants' hand movements (r = - .27, p = .03). In laboratory settings, heart rate (HR) derived from both wearable devices exhibited higher concurrent validity than heart rate variability (HRV) metrics (ICCs 0.98-1.00 vs. 0.75-0.97). The number of skin conductance responses (SCRs) derived from Empatica showed higher concurrent validity than skin conductance level (SCL, ICCs 0.38 vs. 0.09). Movisens EcgMove4 provided more reliable and valid HRV measurements than Empatica E4 in both laboratory (split-half reliability: 0.95-0.99 vs. 0.85-0.98; concurrent validity: 0.95-1.00 vs. 0.75-0.98; valid data rate: 93.10 vs. 26.14%) and ambulatory settings (split-half reliability: 0.99-1.00 vs. 0.89-0.98; valid data rate: 82.94 vs. 8.79%). Although the reliability and validity of wearable devices are improving, findings suggest researchers should select devices that yield consistently robust and valid data for their measures of interest.

Fear-related psychophysiological patterns are situation and individual dependent: A Bayesian model comparison approach

Is there a universal mapping of physiology to emotion, or do these mappings vary substantially by person or situation? Psychologists, philosophers, and neuroscientists have debated this question for decades. Most previous studies have focused on differentiating emotions on the basis of accompanying autonomic responses using analytical approaches that often assume within-category homogeneity. In the present study, we took an alternative approach to this question. We determined the extent to which the relationship between subjective experience and autonomic reactivity generalizes across, or depends upon, the individual and situation for instances of a single emotion category, specifically, fear. Electrodermal activity and cardiac activity-two autonomic measures that are often assumed to show robust relationships with instances of fear-were recorded while participants reported fear experience in response to dozens of fear-evoking videos related to three distinct situations: spiders, heights, and social encounters. We formally translated assumptions from diverse theoretical models into a common framework for model comparison analyses. Results exceedingly favored a model that assumed situation-dependency in the relationship between fear experience and autonomic reactivity, with subject variance also significant but constrained by situation. Models that assumed generalization across situations and/or individuals performed much worse by comparison. These results call into question the assumption of generalizability of autonomic-subjective mappings across instances of fear, as required in translational research from nonhuman animals to humans, and advance a situated approach to understanding the autonomic correlates of fear experience. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Detection of dynamic changes of electrodermal activity to predict the classroom performance of college students

It is emphasized in the Self-regulated learning (SRL) framework that self-monitoring of learning state is vital for students to keep effective in studying. However, it's still challenging to get an accurate and timely understanding of their learning states during classes. In this study, we propose to use electrodermal activity (EDA) signals which are deemed to be associated with physiological arousal state to predict the college student's classroom performance. Twenty college students were recruited to attend eight lectures in the classroom, during which their EDA signals were recorded simultaneously. For each lecture, the students should complete pre- and after-class tests, and a self-reported scale (SRS) on their learning experience. EDA indices were extracted from both time and frequency domains, and they were furtherly mapped to the student's learning efficiency. As a result, the indices relevant to the dynamic changes of EDA had significant positive correlations with the learning efficiency. Furthermore, compared with only using SRS, a combination with EDA indices had significantly higher accuracy in predicting the learning efficiency. In conclusion, our findings demonstrate that the EDA dynamics are sensitive to the changes in learning efficiency, suggesting a promising approach to predicting the classroom performance of college students.

Adaptive thresholding increases sensitivity to detect changes in the rate of skin conductance responses to psychologically arousing stimuli in both laboratory and ambulatory settings

Psychophysiologists recording electrodermal activity (EDA) often derive measures of slow, tonic activity-skin conductance level (SCL)-and faster, more punctate changes-skin conductance responses (SCRs). A SCR is conventionally considered to have occurred when the local amplitude of the EDA signal exceeds a researcher-determined threshold (e.g., 0.05 μS), typically fixed across study participants and conditions. However, fixed SCR thresholds can preferentially exclude data from individuals with low SCL because their SCRs are smaller on average, thereby reducing statistical power for group-level analyses. Thus, we developed a fixed plus adaptive (FA) thresholding method that adjusts identification of SCRs based on an individual's SC at the onset of the SCR to increase statistical power and include data from more participants. We assess the utility of applying FA thresholding across two independent samples and explore age and race-related associations with EDA outcomes. Study 1 uses wired EDA measurements from 254 healthy adults responding to evocative images and sounds in a laboratory setting. Study 2 uses wireless EDA measurements from 20 children with autism in a clinical environment while they completed behavioral tasks. Compared to a 0.01, 0.03, and 0.05 μS fixed threshold, FA thresholding at 1.9% modestly increases statistical power to detect a difference in SCR rate between tasks with higher vs. lower subjective arousal and reduces exclusion of participants by up to 5% across both samples. This novel method expands the EDA analytical toolbox and may be useful in populations with highly variable basal SCL or when comparing groups with different basal SCL. Future research should test for reproducibility and generalizability in other tasks, samples, and contexts. IMPACT STATEMENTS: This article is important because it introduces a novel method to enhance sensitivity and statistical power in analyses of skin conductance responses from electrodermal data.

Comparative analysis of electrodermal activity metrics and their association with child behavior in autism spectrum disorder

Researchers are increasingly utilizing physiological data like electrodermal activity (EDA) to understand how stress "gets under the skin." Results of EDA studies in autistic children are mixed, with some suggesting autistic hyperarousal, others finding hypoarousal, and yet others detecting no difference compared to non-autistics. Some of this variability likely stems from the different techniques used to assess EDA. Therefore, the purpose of this study is to investigate and compare commonly used metrics of EDA (frequency of peaks, average amplitude of peaks, and standard deviation of skin conductance level) using two data processing programs (NeuroKit2 and Ledalab) and their link to observed child behavior. EDA data were collected using Empatica E4 wristbands from 60 autistic children and adolescents (5-18 years old) during a 7-min play interaction with their primary caregiver. The play interaction was coded for a range of child behaviors including mood, social responsiveness, dysregulation, and cooperation. Results indicate a strong correlation between NeuroKit2 and Ledalab and a weak correlation between metrics within each program. Furthermore, the frequency of peaks was associated with more positive child social behaviors, and the magnitude of peaks was associated with less adaptive child behaviors. Recommendations for replication and the need for generalizability of this research are given.

Can peripheral psychophysiological markers predict response to exposure-based cognitive behavioral therapy in youth with severely impairing irritability? A study protocol

BACKGROUND

Irritability, an increased proneness to anger, is a primary reason youth present for psychiatric care. While initial evidence supports the efficacy of exposure-based cognitive behavioral therapy (CBT) for youth with clinically impairing irritability, treatment mechanisms remain unclear. Here, we propose to measure peripheral psychophysiological indicators of arousal-heart rate (HR)/electrodermal activity (EDA)-and regulation-heart rate variability (HRV)-during exposures to anger-inducing stimuli as potential predictors of treatment efficacy. The objective of this study is to evaluate whether in-situ biosensing data provides peripheral physiological indicators of in-session response to exposures.

METHODS

Blood volume pulse (BVP; from which HR and HRV canl be derived) and EDA will be collected ambulatorily using the Empatica EmbracePlus from 40 youth (all genders; ages 8-17) undergoing six in-person exposure treatment sessions, as part of a multiple-baseline trial of exposure-based CBT for clinically impairing irritability. Clinical ratings of irritability will be conducted at baseline, weekly throughout treatment, and at 3-month and 6-month follow-ups via the Clinical Global Impressions Scale (CGI) and the Affective Reactivity Index (ARI; clinician-, parent-, and child-report). Multilevel modeling will be used to assess within- and between-person changes in physiological arousal and regulation throughout exposure-based CBT and to determine whether individual differences are predictive of treatment response.

DISCUSSION

This study protocol leverages a wearable biosensor (Empatica) to continuously record HR/HRV (derived from BVP) and EDA during in-person exposure sessions for youth with clinically impairing irritability. Here, the goal is to identify changes in physiological arousal (EDA, HR) and regulation (HRV) over the course of treatment in tandem with changes in clinical symptoms.

TRIAL REGISTRATION

The participants in this study come from an overarching clinical trial (trial registration numbers: NCT02531893 first registered on 8/25/2015; last updated on 8/25/2023). The research project and all related materials were submitted and approved by the appropriate Institutional Review Board of the National Institute of Mental Health (NIMH).

Simulation of ambulatory electrodermal activity and the handling of low-quality segments

BACKGROUND AND OBJECTIVES

Monitoring electrodermal activity (EDA) in daily life requires effective handling of low-quality segments, which are common in ambulatory EDA data. Although several low-quality handling methods have been implemented, systematic comparison of these methods, which requires a large annotated dataset, is lacking.

METHODS

Therefore, we proposed the simulation of realistic ambulatory EDA data starting from high-quality EDA signals, which were subsequently contaminated with varying concentrations of artifacts. Subsequently, three approaches for handling low-quality data were evaluated regarding the preservation of several EDA-derived features: removing all artifacts, interpolating over removed artifacts, and retaining all artifacts. Specifically, multiple EDA features were assessed, derived from response detection (evaluated using F1, precision, recall) as well as EDA, phasic, and tonic features (assessed using absolute error), by comparing the simulated EDA data with and without the inserted artifacts, using the latter as ground truth.

RESULTS

For response detection, retaining artifacts resulted in the highest F1-scores, while interpolating over removed artifacts achieved the highest F1-scores for the phasic signal. The approaches did significantly differ in the mean error for the phasic but not for the tonic component and raw EDA.

CONCLUSION

This work generated ambulatory EDA datasets of 200 h, containing 0.125 to 3 artifacts per minute, and showed that interpolation over removed artifacts was an effective approach to reconstruct phasic-derived features up to 2 artifacts per minute. The proposed simulation and evaluation methodology, which are easily customizable, offer opportunities for future research to develop and systematically compare signal quality indicators, decomposition methods, and response detectors for processing ambulatory EDA.

Transcutaneous auricular Vagus Nerve Stimulation and Median Nerve Stimulation reduce acute stress in young healthy adults: a single-blind sham-controlled crossover study

Stress is a major determinant of health and wellbeing. Conventional stress management approaches do not account for the daily-living acute changes in stress that affect quality of life. The combination of physiological monitoring and non-invasive Peripheral Nerve Stimulation (PNS) represents a promising technological approach to quantify stress-induced physiological manifestations and reduce stress during everyday life. This study aimed to evaluate the effectiveness of three well-established transcutaneous PNS modalities in reducing physiological manifestations of stress compared to a sham: auricular and cervical Vagus Nerve Stimulation (taVNS and tcVNS), and Median Nerve Stimulation (tMNS). Using a single-blind sham-controlled crossover study with four visits, we compared the stress mitigation effectiveness of taVNS, tcVNS, and tMNS, quantified through physiological markers derived from five physiological signals peripherally measured on 19 young healthy volunteers. Participants underwent three acute mental and physiological stressors while receiving stimulation. Blinding effectiveness was assessed via subjective survey. taVNS and tMNS relative to sham resulted in significant changes that suggest a reduction in sympathetic outflow following the acute stressors: Left Ventricular Ejection Time Index (LVETI) shortening (tMNS: p = 0.007, taVNS: p = 0.015) and Pre-Ejection Period (PEP)-to-LVET ratio (PEP/LVET) increase (tMNS: p = 0.044, taVNS: p = 0.029). tMNS relative to sham also reduced Pulse Pressure (PP; p = 0.032) and tonic EDA activity (tonicMean; p = 0.025). The nonsignificant blinding survey results suggest these effects were not influenced by placebo. taVNS and tMNS effectively reduced stress-induced sympathetic arousal in wearable-compatible physiological signals, motivating their future use in novel personalized stress therapies to improve quality of life.

From Coaching to Neurocoaching: A Neuroscientific Approach during a Coaching Session to Assess the Relational Dynamics between Coach and Coachee-A Pilot Study

Life transitions represent moments characterized by changes that can profoundly influence individual life trajectories and subjective well-being. Recently, career coaching has become an important method of helping people expand their self-awareness, facilitate personal development, and increase their performance in the school-to-work transition. Although previous studies have confirmed that one of the most important keys to the success of a coaching program is the quality of the relationship between coach and coachee, there is a lack of knowledge regarding how to objectively measure it. In this pilot study, we adopted a neuroscientific approach to introduce objective measures of the relationship between coach and coachee through the phases of a coaching session. A sample of 14 university students and a professional coach participated in career-coaching sessions while their affective states were measured by recording brain (EEG) and physiological (Skin conductance) activity. Electroencephalographic indicators of valence, arousal, and engagement showed differences between session phases, highlighting the possibility of a neurophysiological measurement of relational dynamics. Our results provide initial evidence that neurophysiological activity can be considered a way to understand differences in the coach-coachee relationship, thereby providing information on the effectiveness of coaching interventions and facilitating a better life transition from school to work.

Driver Drowsiness Detection: A Machine Learning Approach on Skin Conductance

The majority of car accidents worldwide are caused by drowsy drivers. Therefore, it is important to be able to detect when a driver is starting to feel drowsy in order to warn them before a serious accident occurs. Sometimes, drivers are not aware of their own drowsiness, but changes in their body signals can indicate that they are getting tired. Previous studies have used large and intrusive sensor systems that can be worn by the driver or placed in the vehicle to collect information about the driver's physical status from a variety of signals that are either physiological or vehicle-related. This study focuses on the use of a single wrist device that is comfortable for the driver to wear and appropriate signal processing to detect drowsiness by analyzing only the physiological skin conductance (SC) signal. To determine whether the driver is drowsy, the study tests three ensemble algorithms and finds that the Boosting algorithm is the most effective in detecting drowsiness with an accuracy of 89.4%. The results of this study show that it is possible to identify when a driver is drowsy using only signals from the skin on the wrist, and this encourages further research to develop a real-time warning system for early detection of drowsiness.

Exploring digital biomarkers of illness activity in mood episodes: hypotheses generating and model development study

BACKGROUND

Depressive and manic episodes within bipolar disorder (BD) and major depressive disorder (MDD) involve altered mood, sleep, and activity alongside physiological alterations that wearables can capture.

OBJECTIVE

We explored whether physiological wearable data could predict: (aim 1) the severity of an acute affective episode at the intra-individual level, (aim 2) the polarity of an acute affective episode and euthymia among different individuals. Secondarily, we explored which physiological data were related to the prior predictions, generalization across patients, and associations between affective symptoms and physiological data.

METHODS

We conducted a prospective exploratory observational study including patients with BD and MDD on acute affective episodes (manic, depressed, and mixed) whose physiological data were recorded with a research-grade wearable (Empatica E4) across three consecutive timepoints (acute, response, and remission of episode). Euthymic patients and healthy controls (HC) were recorded during a single session (∼48 hours). Manic and depressive symptoms were assessed with standardized psychometric scales. Physiological wearable data included the following channels: acceleration (ACC), temperature (TEMP), blood volume pulse (BVP), heart rate (HR), and electrodermal activity (EDA). For data pre-processing, invalid physiological data were removed using a rule-based filter, channels were time-aligned at 1 second time units and then segmented window lengths of 32 seconds, since those parameters showed the best performances. We developed deep learning predictive models, assessed channels' individual contribution using permutation feature importance analysis, and computed physiological data to psychometric scales' items normalized mutual information (NMI). We present a novel fully automated method for analysis of physiological data from a research-grade wearable device, including a rule-based filter for invalid data and a viable supervised learning pipeline for time-series analyses.

RESULTS

35 sessions (1,512 hours) from 12 patients (manic, depressed, mixed, and euthymic) and 7 HC (age 39.7±12.6; 31.6% female) were analyzed. (aim 1) The severity of mood episodes was predicted with moderate (62%-85%) accuracies. (aim 2) The polarity of episodes was predicted with moderate (70%) accuracy. The most relevant features for the former tasks were ACC, EDA, and HR. Kendall W showed fair agreement (0.383) in feature importance across classification tasks. Generalization of the former models were of overall low accuracy, with better results for the intra-individual models. "Increased motor activity" was associated with ACC (NMI>0.55), "aggressive behavior" with EDA (NMI=1.0), "insomnia" with ACC (NMI∼0.6), "motor inhibition" with ACC (NMI∼0.75), and "psychic anxiety" with EDA (NMI=0.52).

CONCLUSIONS

Physiological data from wearables show potential to identify mood episodes and specific symptoms of mania and depression quantitatively, both in BD and MDD. Motor activity and stress-related physiological data (EDA and HR) stand out as potential digital biomarkers for predicting mania and depression respectively. These findings represent a promising pathway towards personalized psychiatry, in which physiological wearable data could allow early identification and intervention of mood episodes.

CLINICALTRIAL

Data quality evaluation in wearable monitoring

Wearable recordings of neurophysiological signals captured from the wrist offer enormous potential for seizure monitoring. Yet, data quality remains one of the most challenging factors that impact data reliability. We suggest a combined data quality assessment tool for the evaluation of multimodal wearable data. We analyzed data from patients with epilepsy from four epilepsy centers. Patients wore wristbands recording accelerometry, electrodermal activity, blood volume pulse, and skin temperature. We calculated data completeness and assessed the time the device was worn (on-body), and modality-specific signal quality scores. We included 37,166 h from 632 patients in the inpatient and 90,776 h from 39 patients in the outpatient setting. All modalities were affected by artifacts. Data loss was higher when using data streaming (up to 49% among inpatient cohorts, averaged across respective recordings) as compared to onboard device recording and storage (up to 9%). On-body scores, estimating the percentage of time a device was worn on the body, were consistently high across cohorts (more than 80%). Signal quality of some modalities, based on established indices, was higher at night than during the day. A uniformly reported data quality and multimodal signal quality index is feasible, makes study results more comparable, and contributes to the development of devices and evaluation routines necessary for seizure monitoring.

Machine Learning Techniques for Arousal Classification from Electrodermal Activity: A Systematic Review

This article introduces a systematic review on arousal classification based on electrodermal activity (EDA) and machine learning (ML). From a first set of 284 articles searched for in six scientific databases, fifty-nine were finally selected according to various criteria established. The systematic review has made it possible to analyse all the steps to which the EDA signals are subjected: acquisition, pre-processing, processing and feature extraction. Finally, all ML techniques applied to the features of these signals for arousal classification have been studied. It has been found that support vector machines and artificial neural networks stand out within the supervised learning methods given their high-performance values. In contrast, it has been shown that unsupervised learning is not present in the detection of arousal through EDA. This systematic review concludes that the use of EDA for the detection of arousal is widely spread, with particularly good results in classification with the ML methods found.

Effects of Cognitive Behavioral Stress Management Delivered by a Virtual Human, Teletherapy, and an E-Manual on Psychological and Physiological Outcomes in Adult Women: An Experimental Test

Technology may expand the reach of stress management to broader populations. However, issues with engagement can reduce intervention effectiveness. Technologies with highly social interfaces, such as virtual humans (VH), may offer advantages in this space. However, it is unclear how VH compare to telehealth and e-manuals at delivering psychological interventions. This experiment compared the effects of single laboratory session of Cognitive Behavioral Stress Management (CBSM) delivered by a VH (VH-CBSM), human telehealth (T-CBSM), and an e-manual (E-CBSM) on psychological and physiological outcomes in a community sample of stressed adult women. A pilot randomized controlled trial (RCT) with a parallel, mixed design was conducted. Adult women (M age =43.21, SD = 10.70) who self-identified as stressed were randomly allocated to VH-CBSM, T-CBSM, or E-CBSM involving one 90 min session and homework. Perceived stress, stress management skills, negative affect, optimism, relaxation, and physiological stress were measured. Mixed factorial ANOVAs and pairwise comparisons with Bonferroni correction investigated main and interaction effects of time and condition. Participants’ data (N = 38) were analysed (12 = VH-CBSM; 12 = T-CBSM; 14 = E-CBSM). Each condition significantly improved stress, negative affect, optimism, relaxation, and physiological stress over time with large effect sizes. No significant differences were found between conditions on outcomes. Overall, all three technologies showed promise for remotely delivering CBSM in a controlled setting. The findings suggest feasibility of the VH-CBSM delivery approach and support conducting a fully powered RCT to examine its effectiveness when delivering a full 10-week CBSM intervention.

An unsupervised automated paradigm for artifact removal from electrodermal activity in an uncontrolled clinical setting

Objective. Electrodermal activity (EDA) reflects sympathetic nervous system activity through sweating-related changes in skin conductance and could be used in clinical settings in which patients cannot self-report pain, such as during surgery or when in a coma. To enable EDA data to be used robustly in clinical settings, we need to develop artifact detection and removal frameworks that can handle the types of interference experienced in clinical settings while salvaging as much useful information as possible.Approach. In this study, we collected EDA data from 70 subjects while they were undergoing surgery in the operating room. We then built a fully automated artifact removal framework to remove the heavy artifacts that resulted from the use of surgical electrocautery during the surgery and compared it to two existing state-of-the-art methods for artifact removal from EDA data. This automated framework consisted of first utilizing three unsupervised machine learning methods for anomaly detection, and then customizing the threshold to separate artifact for each data instance by taking advantage of the statistical properties of the artifact in that data instance. We also created simulated surgical data by introducing artifacts into cleaned surgical data and measured the performance of all three methods in removing it.Main results. Our method achieved the highest overall accuracy and precision and lowest overall error on simulated data. One of the other methods prioritized high sensitivity while sacrificing specificity and precision, while the other had low sensitivity, high error, and left behind several artifacts. These results were qualitatively similar between the simulated data instances and operating room data instances.Significance. Our framework allows for robust removal of heavy artifact from EDA data in clinical settings such as surgery, which is the first step to enable clinical integration of EDA as part of standard monitoring.

The Role of the Emotional Sequence in the Communication of the Territorial Cheeses: A Neuromarketing Approach

Over the past few years, many studies have shown how territoriality can be considered a driver for purchasing agri-food products. Products with certification of origin are perceived as more sustainable, safer and of better quality. At the same time, producers of traditional products often belong to small entities that struggle to compete with large multinational food corporations, having less budget to allocate to product promotion. In this study, we propose a neuromarketing approach, showing how the use of these techniques can help in choosing the most effective commercial in terms of likeability and ability to activate mnemonic processes. Two commercials were filmed for the purpose of this study. They differed from each other in terms of emotional sequence. The first aimed primarily at eliciting positive emotions derived from the product description. The second aimed to generate negative emotions during the early stages, highlighting the negative consequences of humans' loss of contact with nature and tradition and then eliciting positive emotions by presenting cheese production using traditional techniques as a solution to the problem. Based on the literature on the emotional sequences in social advertising, we hypothesised that the second commercial would generate an overall better emotional reaction and activate mnemonic processes to a greater extent. Our results partially support the research hypotheses, providing useful insights both to marketers and for future research on the topic.

Wearables: An R Package With Accompanying Shiny Application for Signal Analysis of a Wearable Device Targeted at Clinicians and Researchers

Physiological signals (e.g., heart rate, skin conductance) that were traditionally studied in neuroscientific laboratory research are currently being used in numerous real-life studies using wearable technology. Physiological signals obtained with wearables seem to offer great potential for continuous monitoring and providing biofeedback in clinical practice and healthcare research. The physiological data obtained from these signals has utility for both clinicians and researchers. Clinicians are typically interested in the day-to-day and moment-to-moment physiological reactivity of patients to real-life stressors, events, and situations or interested in the physiological reactivity to stimuli in therapy. Researchers typically apply signal analysis methods to the data by pre-processing the physiological signals, detecting artifacts, and extracting features, which can be a challenge considering the amount of data that needs to be processed. This paper describes the creation of a “Wearables” R package and a Shiny “E4 dashboard” application for an often-studied wearable, the Empatica E4. The package and Shiny application can be used to visualize the relationship between physiological signals and real-life stressors or stimuli, but can also be used to pre-process physiological data, detect artifacts, and extract relevant features for further analysis. In addition, the application has a batch process option to analyze large amounts of physiological data into ready-to-use data files. The software accommodates users with a downloadable report that provides opportunities for a careful investigation of physiological reactions in daily life. The application is freely available, thought to be easy to use, and thought to be easily extendible to other wearable devices. Future research should focus on the usability of the application and the validation of the algorithms.

Current trends and opportunities in the methodology of electrodermal activity measurement

Electrodermal activity (EDA) has been measured in the laboratory since the late 1800s. Although the influence of sudomotor nerve activity and the sympathetic nervous system on EDA is well established, the mechanisms underlying EDA signal generation are not completely understood. Owing to simplicity of instrumentation and modern electronics, these measurements have recently seen a transfer from the laboratory to wearable devices, sparking numerous novel applications while bringing along both challenges and new opportunities. In addition to developments in electronics and miniaturization, current trends in material technology and manufacturing have sparked innovations in electrode technologies, and trends in data science such as machine learning and sensor fusion are expanding the ways that measurement data can be processed and utilized. Although challenges remain for the quality of wearable EDA measurement, ongoing research and developments may shorten the quality gap between wearable EDA and standardized recordings in the laboratory. In this topical review, we provide an overview of the basics of EDA measurement, discuss the challenges and opportunities of wearable EDA, and review recent developments in instrumentation, material technology, signal processing, modeling and data science tools that may advance the field of EDA research and applications over the coming years.

Seizures Caused by Exposure to Hyperbaric Oxygen in Rats Can Be Predicted by Early Changes in Electrodermal Activity

Hyperbaric oxygen (HBO₂) is breathed during undersea operations and in hyperbaric medicine. However, breathing HBO₂ by divers and patients increases the risk of central nervous system oxygen toxicity (CNS-OT), which ultimately manifests as sympathetic stimulation producing tachycardia and hypertension, hyperventilation, and ultimately generalized seizures and cardiogenic pulmonary edema. In this study, we have tested the hypothesis that changes in electrodermal activity (EDA), a measure of sympathetic nervous system activation, precedes seizures in rats breathing 5 atmospheres absolute (ATA) HBO₂. Radio telemetry and a rodent tether apparatus were adapted for use inside a sealed hyperbaric chamber. The tethered rat was free to move inside a ventilated animal chamber that was flushed with air or 100% O₂. The animal chamber and hyperbaric chamber (air) were pressurized in parallel at ~1 atmosphere/min. EDA activity was recorded simultaneously with cortical electroencephalogram (EEG) activity, core body temperature, and ambient pressure. We have captured the dynamics of EDA using time-varying spectral analysis of raw EDA (TVSymp), previously developed as a tool for sympathetic tone assessment in humans, adjusted to detect the dynamic changes of EDA in rats that occur prior to onset of CNS-OT seizures. The results show that a significant increase in the amplitude of TVSymp values derived from EDA recordings occurs on average (±SD) 1.9 ± 1.6 min before HBO₂-induced seizures. These results, if corroborated in humans, support the use of changes in TVSymp activity as an early "physio-marker" of impending and potentially fatal seizures in divers and patients.

Time-varying Spectral Index of Electrodermal Activity to Predict Central Nervous System Oxygen Toxicity Symptoms in Divers: Preliminary results

The most effective method to mitigate decompression sickness in divers is hyperbaric oxygen (HBO₂) pre-breathing. However, divers breathing HBO₂ are at risk for developing central nervous system oxygen toxicity (CNS-OT), which can manifest as symptoms that might impair a diver's performance, or cause more serious symptoms like seizures. In this study, we have collected electrodermal activity (EDA) signals in fifteen subjects at elevated oxygen partial pressures (2.06 ATA, 35 FSW) in the "foxtrot" chamber pool at the Duke University Hyperbaric Center, while performing a cognitive stress test for up to 120 minutes. Specifically, we have computed the time-varying spectral analysis of EDA (TVSymp) as a tool for sympathetic tone assessment and evaluated its feasibility for the prediction of symptoms of CNS-OT in divers. The preliminary results show large increase in the amplitude TVSymp values derived from EDA recordings ~2 minutes prior to expert human adjudication of symptoms related to oxygen toxicity. An early detection based on TVSymp might allow the diver to take countermeasures against the dire consequences of CNS-OT which can lead to drowning.Clinical Relevance-This study provides a sensitive analysis method which indicates a significant increase in the electrodermal activity prior to human expert adjudication of symptoms related to CNS-OT.

A Preliminary Study on Automatic Motion Artifact Detection in Electrodermal Activity Data Using Machine Learning

The electrodermal activity (EDA) signal is a sensitive and non-invasive surrogate measure of sympathetic function. Use of EDA has increased in popularity in recent years for such applications as emotion and stress recognition; assessment of pain, fatigue, and sleepiness; diagnosis of depression and epilepsy; and other uses. Recently, there have been several studies using ambulatory EDA recordings, which are often quite useful for analysis of many physiological conditions. Because ambulatory monitoring uses wearable devices, EDA signals are often affected by noise and motion artifacts. An automated noise and motion artifact detection algorithm is therefore of utmost importance for accurate analysis and evaluation of EDA signals. In this paper, we present machine learning-based algorithms for motion artifact detection in EDA signals. With ten subjects, we collected two simultaneous EDA signals from the right and left hands, while instructing the subjects to move only the right hand. Using these data, we proposed a cross-correlation-based approach for non-biased labeling of EDA data segments. A set of statistical, spectral and model-based features were calculated which were then subjected to a feature selection algorithm. Finally, we trained and validated several machine learning methods using a leave-one-subject-out approach. The classification accuracy of the developed model was 83.85% with a standard deviation of 4.91%, which was better than a recent standard method that we considered for comparison to our algorithm.

FLIRT: A feature generation toolkit for wearable data

BACKGROUND AND OBJECTIVE

Researchers use wearable sensing data and machine learning (ML) models to predict various health and behavioral outcomes. However, sensor data from commercial wearables are prone to noise, missing, or artifacts. Even with the recent interest in deploying commercial wearables for long-term studies, there does not exist a standardized way to process the raw sensor data and researchers often use highly specific functions to preprocess, clean, normalize, and compute features. This leads to a lack of uniformity and reproducibility across different studies, making it difficult to compare results. To overcome these issues, we present FLIRT: A Feature Generation Toolkit for Wearable Data; it is an open-source Python package that focuses on processing physiological data specifically from commercial wearables with all its challenges from data cleaning to feature extraction.

METHODS

FLIRT leverages a variety of state-of-the-art algorithms (e.g., particle filters, ML-based artifact detection) to ensure a robust preprocessing of physiological data from wearables. In a subsequent step, FLIRT utilizes a sliding-window approach and calculates a feature vector of more than 100 dimensions - a basis for a wide variety of ML algorithms.

RESULTS

We evaluated FLIRT on the publicly available WESAD dataset, which focuses on stress detection with an Empatica E4 wearable. Preprocessing the data with FLIRT ensures that unintended noise and artifacts are appropriately filtered. In the classification task, FLIRT outperforms the preprocessing baseline of the original WESAD paper.

CONCLUSION

FLIRT provides functionalities beyond existing packages that can address unmet needs in physiological data processing and feature generation: (a) integrated handling of common wearable file formats (e.g., Empatica E4 archives), (b) robust preprocessing, and (c) standardized feature generation that ensures reproducibility of results. Nevertheless, while FLIRT comes with a default configuration to accommodate most situations, it offers a highly configurable interface for all of its implemented algorithms to account for specific needs.

Yellow (Lens) Better: Bioelectrical and Biometrical Measures to Assess Arousing and Focusing Effects

Colours can induce several psychological effects, conditioning perceptions, cognitive/emotional states and human performances. In this exploratory study we investigated the effect of a yellow light exposure, obtained filtering the ambient light with coloured glasses, on the human's psychological functioning. In particular we wanted to assess if people are more able to focus when exposed to a yellow light. We recorded EEG, SC, HR and gaze-related data from 16 subjects (50% split in experimental and control group) during the execution of a reactivity test (the Hazard Perception Test, HPT). Compared with the control group, the experimental group showed increases in concentration, focus, visual attention and arousal, as measured by increases of first fixation duration and Beta over-Alpha ratio (BAR) as well as by decreases of distraction, workload, and number of gaze revisits.

Automated Pain Assessment in Children using Electrodermal Activity and Video Data Fusion via Machine Learning

Pain assessment in children continues to challenge clinicians and researchers, as subjective experiences of pain require inference through observable behaviors, both involuntary and deliberate. The presented approach supplements the subjective self-report-based method by fusing electrodermal activity (EDA) recordings with video facial expressions to develop an objective pain assessment metric. Such an approach is specifically important for assessing pain in children who are not capable of providing accurate self-pain reports, requiring nonverbal pain assessment. We demonstrate the performance of our approach using data recorded from children in post-operative recovery following laparoscopic appendectomy. We examined separately and combined the usefulness of EDA and video facial expression data as predictors of childrens self-reports of pain following surgery through recovery. Findings indicate that EDA and facial expression data independently provide above chance sensitivities and specificities, but their fusion for classifying clinically significant pain vs. clinically nonsignificant pain achieved substantial improvement, yielding 90.91% accuracy, with 100% sensitivity and 81.82% specificity. The multimodal measures capitalize upon different features of the complex pain response. Thus, this paper presents both evidence for the utility of a weighted maximum likelihood algorithm as a novel feature selection method for EDA and video facial expression data and an accurate and objective automated classification algorithm capable of discriminating clinically significant pain from clinically nonsignificant pain in children.

Presleep Arousal and Sleep in Early Childhood

Research suggests that arousal during the transition to sleep-presleep arousal-is associated with sleep disturbances. Although a robust literature has examined the role of presleep arousal in conferring risk for sleep disturbances in adults, substantially less research has examined the developmental origins of presleep arousal in early childhood. The authors examined presleep arousal using parent report and psychophysiological measures in a sample of preschoolers to explore the association between different measures of presleep arousal, and to examine how nightly presleep arousal is associated with sleep. Participants included 29 children assessed at 54 months of age. Presleep arousal was measured using parent reports of child arousal each night at bedtime and using a wearable device that took minute-by-minute recordings of heart rate, peripheral skin temperature, and electrodermal activity each night during the child's bedtime routine. This yielded a dataset with 4,550 min of ambulatory recordings across an average of 3.52 nights per child (SD = 1.84 nights per child; range = 1-8 nights). Sleep was estimated using actigraphy. Findings demonstrated an association between parent-reported and psychophysiological arousal, including heart rate, peripheral skin temperature, and skin conductance responses during the child's bedtime routine. Both the parent report and psychophysiological measures of presleep arousal showed some associations with poorer sleep, with the most robust associations occurring between presleep arousal and sleep onset latency. Behavioral and biological measures of hyperarousal at bedtime are associated with poorer sleep in young children. Findings provide early evidence of the utility of wearable devices for assessing individual differences in presleep arousal in early childhood.

Sleep Dysregulation and Daytime Electrodermal Patterns in Children With Autism: A Descriptive Study

Sleep deficiency influences emotion and behavior regulation but the mechanisms of influence are poorly understood. Emotion, behavioral, and sleep theories highlight differences in autonomic function as a potential pathway of influence and research in typical populations draw links between sleep deficiency and autonomic dysregulation (e.g., elevated reactivity within the sympathetic nervous system). In populations at elevated risk for sleep deficiency/problems (i.e., individuals with autism), greater variability in sleep and autonomic/arousal profiles may be particularly informative. Using electrodermal activity (EDA) as an indicator of sympathetic nervous system activation, this descriptive pilot study aimed to document daytime EDA patterns in children with autism and to explore their relations with sleep dysregulation/deficiency. EDA and sleep were measured using ankle and wrist worn sensors in 13 children (Mean_age 6.11 years). EDA indices included nonspecific skin conductance responses (NSSCR) and tonic skin conductance levels (SCL). Descriptively, children in the dysregulated sleep group had fewer NSSCRs and lower SCL in the afternoon. This blunted physiological arousal profile/pattern is consistent with previous research, but this is the first study to explore how sleep may be linked. Notably, this pattern may not reflect sleep but an overall dysregulation profile which in this sample included: dysregulated sleep, a blunted afternoon arousal profile, and elevated ASD symptom severity. Replication with larger, more diverse samples is needed to disentangle the complex relations among sleep, arousal, and ASD behavioral features. However, this study represents an important first step in documenting extended daytime arousal patterns.

Potential Applications of Mobile and Wearable Devices for Psychological Support During the COVID-19 Pandemic: A Review

The coronavirus disease 19 (COVID-19) pandemic that has been raging in 2020 does affect not only the physical state but also the mental health of the general population, particularly, that of the healthcare workers. Given the unprecedented large-scale impacts of the COVID-19 pandemic, digital technology has gained momentum as invaluable social interaction and health tracking tools in this time of great turmoil, in part due to the imposed state-wide mobilization limitations to mitigate the risk of infection that might arise from in-person socialization or hospitalization. Over the last five years, there has been a notable increase in the demand and usage of mobile and wearable devices as well as their adoption in studies of mental fitness. The purposes of this scoping review are to summarize evidence on the sweeping impact of COVID-19 on mental health as well as to evaluate the merits of the devices for remote psychological support. We conclude that the COVID-19 pandemic has inflicted a significant toll on the mental health of the population, leading to an upsurge in reports of pathological stress, depression, anxiety, and insomnia. It is also clear that mobile and wearable devices (e.g., smartwatches and fitness trackers) are well placed for identifying and targeting individuals with these psychological burdens in need of intervention. However, we found that most of the previous studies used research-grade wearable devices that are difficult to afford for the normal consumer due to their high cost. Thus, the possibility of replacing the research-grade wearable devices with the current smartwatch is also discussed.

Review and Challenges of Technologies for Real-Time Human Behavior Monitoring

A person's behavior significantly influences their health and well-being. It also contributes to the social environment in which humans interact, with cascading impacts to the health and behaviors of others. During social interactions, our understanding and awareness of vital nonverbal messages expressing beliefs, emotions, and intentions can be obstructed by a variety of factors including greatly flawed self-awareness. For these reasons, human behavior is a very important topic to study using the most advanced technology. Moreover, technology offers a breakthrough opportunity to improve people's social awareness and self-awareness through machine-enhanced recognition and interpretation of human behaviors. This paper reviews (1) the social psychology theories that have established the framework to study human behaviors and their manifestations during social interactions and (2) the technologies that have contributed to the monitoring of human behaviors. State-of-the-art in sensors, signal features, and computational models are categorized, summarized, and evaluated from a comprehensive transdisciplinary perspective. This review focuses on assessing technologies most suitable for real-time monitoring while highlighting their challenges and opportunities in near-future applications. Although social behavior monitoring has been highly reported in psychology and engineering literature, this paper uniquely aims to serve as a disciplinary convergence bridge and a guide for engineers capable of bringing new technologies to bear against the current challenges in real-time human behavior monitoring.

Comparison of Wearable and Clinical Devices for Acquisition of Peripheral Nervous System Signals

A key access point to the functioning of the autonomic nervous system is the investigation of peripheral signals. Wearable devices (WDs) enable the acquisition and quantification of peripheral signals in a wide range of contexts, from personal uses to scientific research. WDs have lower costs and higher portability than medical-grade devices. However, the achievable data quality can be lower, and data are subject to artifacts due to body movements and data losses. It is therefore crucial to evaluate the reliability and validity of WDs before their use in research. In this study, we introduce a data analysis procedure for the assessment of WDs for multivariate physiological signals. The quality of cardiac and electrodermal activity signals is validated with a standard set of signal quality indicators. The pipeline is available as a collection of open source Python scripts based on the pyphysio package. We apply the indicators for the analysis of signal quality on data simultaneously recorded from a clinical-grade device and two WDs. The dataset provides signals of six different physiological measures collected from 18 subjects with WDs. This study indicates the need to validate the use of WDs in experimental settings for research and the importance of both technological and signal processing aspects to obtain reliable signals and reproducible results.

Emotion assessment using Machine Learning and low-cost wearable devices

The advancement in bioelectrical measurement technologies and the push towards a higher impact of the Brain Computer Interfaces and Affective Computing in the daily life have made non-invasive and low-priced devices available to the large population to record physiological states. The aim of this study is the assessment of the abilities of the MUSE headband, together with the Shimmer GSR+ device, to assess the emotional state of people during stimuli exposure. Twenty-four pictures from the IAPS database were showed to 54 subjects and were evaluated in their emotional values by means of the Self-Assessment Manikin (SAM). Using a Machine Learning approach, fifty-two scalar features were extracted from the signals and used to train 6 binary classifiers to predict the valence and arousal elicited by each stimulus. In all classifiers we obtained accuracies ranging from 53.6% to 69.9%, confirming that these devices are able to give information about the emotional state.

A Usability Study of Physiological Measurement in School Using Wearable Sensors

Measuring psychophysiological signals of adolescents using unobtrusive wearable sensors may contribute to understanding the development of emotional disorders. This study investigated the feasibility of measuring high quality physiological data and examined the validity of signal processing in a school setting. Among 86 adolescents, a total of more than 410 h of electrodermal activity (EDA) data were recorded using a wrist-worn sensor with gelled electrodes and over 370 h of heart rate data were recorded using a chest-strap sensor. The results support the feasibility of monitoring physiological signals at school. We describe specific challenges and provide recommendations for signal analysis, including dealing with invalid signals due to loose sensors, and quantization noise that can be caused by limitations in analog-to-digital conversion in wearable devices and be mistaken as physiological responses. Importantly, our results show that using toolboxes for automatic signal preprocessing, decomposition, and artifact detection with default parameters while neglecting differences between devices and measurement contexts yield misleading results. Time courses of students' physiological signals throughout the course of a class were found to be clearer after applying our proposed preprocessing steps.

Looking through blue glasses: bioelectrical measures to assess the awakening after a calm situation

Colors can elicit cognitive and emotional states. In particular, blue colour is associated to "refresh" and "restart" effects and is suggested to enhance a wake-up after a calm situation. In this exploratory study, these claims are investigated using Electroencephalographic (EEG), Skin Conductance (SC) and pupil diameter data. The results confirmed the "wake-up effect" for subjects wearing the lenses, as measured by Global Field Power (GFP) in Theta Band, Skin Conductance Response (SCR) and pupil diameter data.

Innovations in Electrodermal Activity Data Collection and Signal Processing: A Systematic Review

The electrodermal activity (EDA) signal is an electrical manifestation of the sympathetic innervation of the sweat glands. EDA has a history in psychophysiological (including emotional or cognitive stress) research since 1879, but it was not until recent years that researchers began using EDA for pathophysiological applications like the assessment of fatigue, pain, sleepiness, exercise recovery, diagnosis of epilepsy, neuropathies, depression, and so forth. The advent of new devices and applications for EDA has increased the development of novel signal processing techniques, creating a growing pool of measures derived mathematically from the EDA. For many years, simply computing the mean of EDA values over a period was used to assess arousal. Much later, researchers found that EDA contains information not only in the slow changes (tonic component) that the mean value represents, but also in the rapid or phasic changes of the signal. The techniques that have ensued have intended to provide a more sophisticated analysis of EDA, beyond the traditional tonic/phasic decomposition of the signal. With many researchers from the social sciences, engineering, medicine, and other areas recently working with EDA, it is timely to summarize and review the recent developments and provide an updated and synthesized framework for all researchers interested in incorporating EDA into their research.

Challenges and Opportunities in Collecting and Modeling Ambulatory Electrodermal Activity Data

Background:

Ambulatory assessment of electrodermal activity (EDA) is an emerging technique for capturing individuals’ autonomic responses to real-life events. There is currently little guidance available for processing and analyzing such data in an ambulatory setting.

Objective:

This study aimed to describe and implement several methods for preprocessing and constructing features for use in modeling ambulatory EDA data, particularly for measuring stress.

Methods:

We used data from a study examining the effects of stressful tasks on EDA of adolescent mothers (AMs). A biosensor band recorded EDA 4 times per second and was worn during an approximately 2-hour assessment that included a 10-min mother-child videotaped interaction. The initial processing included filtering noise and motion artifacts.

Results:

We constructed the features of the EDA data, including the number of peaks and their amplitude as well as EDA reactivity, quantified as the rate at which AMs returned to baseline EDA following an EDA peak. Although the pattern of EDA varied substantially across individuals, various features of EDA may be computed for all individuals enabling within- and between-individual analyses and comparisons.

Conclusions:

The algorithms we developed can be used to construct features for dry-electrode ambulatory EDA, which can be used by other researchers to study stress and anxiety.

Effectiveness of Noise-Attenuating Headphones on Physiological Responses for Children With Autism Spectrum Disorders

Objective: The purpose of this study was to evaluate the proof of concept of an intervention to decrease sympathetic activation as measured by skin conductivity (electrodermal activity, EDA) in children with an autism spectrum disorder (ASD) and auditory hypersensitivity (hyperacusis). In addition, researchers examined if the intervention provided protection against the negative effects of decibel level of environmental noises on electrodermal measures between interventions. The feasibility of implementation and outcome measures within natural environments were evaluated.

Method: A single-subject multi-treatment design was used with six children, aged 8–16 years, with a form of Autism (i.e., Autism, PDD-NOS). Participants used in-ear (IE) and over-ear (OE) headphones for two randomly sequenced treatment phases. Each child completed four phases: (1) a week of baseline data collection; (2) a week of an intervention; (3) a week of no intervention; and (4) a week of the other intervention. Empatica E4 wristbands collected EDA data. Data was collected on 16–20 occasions per participant, with five measurements per phase.

Results: Separated tests for paired study phases suggested that regardless of intervention type, noise attenuating headphones led to a significance difference in both skin conductance levels (SCL) and frequency of non-specific conductance responses (NS-SCRs) between the baseline measurement and subsequent phases. Overall, SCL and NS-SCR frequency significantly decreased between baseline and the first intervention phase. A protective effect of the intervention was tested by collapsing intervention results into three phases. Slope correlation suggested constant SCL and NS-SCR frequency after initial use of the headphones regardless of the increase in environmental noises. A subsequent analysis of the quality of EDA data identified that later phases of data collection were associated with better data quality.

Conclusion: Many children with ASD have hypersensitivities to sound resulting in high levels of sympathetic nervous system reactivity, which is associated with problematic behaviors and distress. The findings of this study suggest that the use of noise attenuating headphones for individuals with ASD and hyperacusis may reduce sympathetic activation. Additionally, results suggest that the use of wearable sensors to collect physiological data in natural environments is feasible with established protocols and training procedures.

Moving beyond self-report data collection in the natural environment: A review of the past and future directions for ambulatory assessment in eating disorders

OBJECTIVE

In recent years, ecological momentary assessment (EMA) has been used to repeatedly assess eating disorder (ED) symptoms in naturalistic settings, which has allowed for increased understanding of temporal processes that potentiate ED behaviors. However, there remain notable limitations of self-report EMA, and with the rapid proliferation of technology there are ever-increasing possibilities to improve ambulatory assessment methods to further the understanding and treatment of EDs. Therefore, the purpose of this review was to (a) systematically review the studies in EDs that have utilized ambulatory assessment methods other than self-report, and (b) provide directions for future research and clinical applications.

METHOD

A systematic literature search of electronic databases was conducted, and data regarding study characteristics and methodological quality were extracted.

RESULTS

The search identified 17 studies that used ambulatory assessment methods to gather objective data, and focused primarily on autonomic functioning, physical activity, and cognitive processes in ED and control groups.

DISCUSSION

Together the literature demonstrates the promise of using a range of ecologically valid ambulatory assessment approaches in EDs, though there remains limited research that has utilized methods other than self-report (e.g., wearable sensors), particularly in recent years. Going forward, there are several technology-enhanced momentary assessment methods that have potential to improve the understanding and treatment of EDs.

Changes in heart rate and skin conductance in the 30 min preceding aggressive behavior

Aggressive behavior of inpatients threatens the safety and well-being of both mental health staff members and fellow patients. It was investigated whether heart rate and electrodermal activity can be used to signal imminent aggression. A naturalistic study was conducted in which 100 inpatients wore sensor wristbands during 5 days to monitor their heart rate and electrodermal activity while staff members recorded patients' aggressive incidents on the ward. Of the 100 patients, 36 displayed at least one aggressive incident. Longitudinal multilevel models indicated that heart rate, skin conductance level, and the number of nonspecific skin conductance responses per minute rose significantly in the 20 min preceding aggressive incidents. Although psychopathy was modestly correlated with displaying aggression, it was not a significant predictor of heart rate and skin conductance preceding aggression. The current findings may provide opportunities for the development of individual prediction models to aid acute risk assessment and to predict aggressive incidents in an earlier stage. The current results on the physiological indicators of aggression are promising for reducing aggression and improving both staff as well as patient safety in psychiatric mental health institutions.

An Observational Study With the Janssen Autism Knowledge Engine (JAKE®) in Individuals With Autism Spectrum Disorder

Objective: The Janssen Autism Knowledge Engine (JAKE®) is a clinical research outcomes assessment system developed to more sensitively measure treatment outcomes and identify subpopulations in autism spectrum disorder (ASD). Here we describe JAKE and present results from its digital phenotyping (My JAKE) and biosensor (JAKE Sense) components. Methods: An observational, non-interventional, prospective study of JAKE in children and adults with ASD was conducted at nine sites in the United States. Feedback on JAKE usability was obtained from caregivers. JAKE Sense included electroencephalography, eye tracking, electrocardiography, electrodermal activity, facial affect analysis, and actigraphy. Caregivers of individuals with ASD reported behaviors using My JAKE. Results from My JAKE and JAKE Sense were compared to traditional ASD symptom measures. Results: Individuals with ASD (N = 144) and a cohort of typically developing (TD) individuals (N = 41) participated in JAKE Sense. Most caregivers reported that overall use and utility of My JAKE was "easy" (69%, 74/108) or "very easy" (74%, 80/108). My JAKE could detect differences in ASD symptoms as measured by traditional methods. The majority of biosensors included in JAKE Sense captured sizable amounts of quality data (i.e., 93-100% of eye tracker, facial affect analysis, and electrocardiogram data was of good quality), demonstrated differences between TD and ASD individuals, and correlated with ASD symptom scales. No significant safety events were reported. Conclusions: My JAKE was viewed as easy or very easy to use by caregivers participating in research outside of a clinical study. My JAKE sensitively measured a broad range of ASD symptoms. JAKE Sense biosensors were well-tolerated. JAKE functioned well when used at clinical sites previously inexperienced with some of the technologies. Lessons from the study will optimize JAKE for use in clinical trials to assess ASD interventions. Additionally, because biosensors were able to detect features differentiating TD and ASD individuals, and also were correlated with standardized symptom scales, these measures could be explored as potential biomarkers for ASD and as endpoints in future clinical studies. Clinical Trial Registration: https://clinicaltrials.gov/ct2/show/NCT02668991 identifier: NCT02668991.

An Open-Source Feature Extraction Tool for the Analysis of Peripheral Physiological Data

Electrocardiogram, electrodermal activity, electromyogram, continuous blood pressure, and impedance cardiography are among the most commonly used peripheral physiological signals (biosignals) in psychological studies and healthcare applications, including health tracking, sleep quality assessment, disease early-detection/diagnosis, and understanding human emotional and affective phenomena. This paper presents the development of a biosignal-specific processing toolbox (Bio-SP tool) for preprocessing and feature extraction of these physiological signals according to the state-of-the-art studies reported in the scientific literature and feedback received from the field experts. Our open-source Bio-SP tool is intended to assist researchers in affective computing, digital and mobile health, and telemedicine to extract relevant physiological patterns (i.e., features) from these biosignals semi-automatically and reliably. In this paper, we describe the successful algorithms used for signal-specific quality checking, artifact/noise filtering, and segmentation along with introducing features shown to be highly relevant to category discrimination in several healthcare applications (e.g., discriminating patterns associated with disease versus non-disease). Further, the Bio-SP tool is a publicly-available software written in MATLAB with a user-friendly graphical user interface (GUI), enabling future crowd-sourced modification to these tools. The GUI is compatible with MathWorks Classification Learner app for inference model development, such as model training, cross-validation scheme farming, and classification result computation.