rConverse: Moment by Moment Conversation Detection Using a Mobile Respiration Sensor

Automated Detection of Stressful Conversations Using Wearable Physiological and Inertial Sensors

Stressful conversation is a frequently occurring stressor in our daily life. Stressors not only adversely affect our physical and mental health but also our relationships with family, friends, and coworkers. In this paper, we present a model to automatically detect stressful conversations using wearable physiological and inertial sensors. We conducted a lab and a field study with cohabiting couples to collect ecologically valid sensor data with temporally-precise labels of stressors. We introduce the concept of stress cycles, i.e., the physiological arousal and recovery, within a stress event. We identify several novel features from stress cycles and show that they exhibit distinguishing patterns during stressful conversations when compared to physiological response due to other stressors. We observe that hand gestures also show a distinct pattern when stress occurs due to stressful conversations. We train and test our model using field data collected from 38 participants. Our model can determine whether a detected stress event is due to a stressful conversation with an F1-score of 0.83, using features obtained from only one stress cycle, facilitating intervention delivery within 3.9 minutes since the start of a stressful conversation.

Respiration Rate Estimation Based on Independent Component Analysis of Accelerometer Data: Pilot Single-Arm Intervention Study

Background

As the mobile environment has developed recently, there have been studies on continuous respiration monitoring. However, it is not easy for general users to access the sensors typically used to measure respiration. There is also random noise caused by various environmental variables when respiration is measured using noncontact methods in a mobile environment.

Objective

In this study, we aimed to estimate the respiration rate using an accelerometer sensor in a smartphone.

Methods

First, data were acquired from an accelerometer sensor by a smartphone, which can easily be accessed by the general public. Second, an independent component was extracted to calibrate the three-axis accelerometer. Lastly, the respiration rate was estimated using quefrency selection reflecting the harmonic component because respiration has regular patterns.

Results

From April 2018, we enrolled 30 male participants. When the independent component and quefrency selection were used to estimate the respiration rate, the correlation with respiration acquired from a chest belt was 0.7. The statistical results of the Wilcoxon signed-rank test were used to determine whether the differences in the respiration counts acquired from the chest belt and from the accelerometer sensor were significant. The P value of the difference in the respiration counts acquired from the two sensors was .27, which was not significant. This indicates that the number of respiration counts measured using the accelerometer sensor was not different from that measured using the chest belt. The Bland-Altman results indicated that the mean difference was 0.43, with less than one breath per minute, and that the respiration rate was at the 95% limits of agreement.

Conclusions

There was no relevant difference in the respiration rate measured using a chest belt and that measured using an accelerometer sensor. The accelerometer sensor approach could solve the problems related to the inconvenience of chest belt attachment and the settings. It could be used to detect sleep apnea through constant respiration rate estimation in an internet-of-things environment.

Detection of Talking in Respiratory Signals: A Feasibility Study Using Machine Learning and Wearable Textile-Based Sensors

Social isolation and loneliness are major health concerns in young and older people. Traditional approaches to monitor the level of social interaction rely on self-reports. The goal of this study was to investigate if wearable textile-based sensors can be used to accurately detect if the user is talking as a future indicator of social interaction. In a laboratory study, fifteen healthy young participants were asked to talk while performing daily activities such as sitting, standing and walking. It is known that the breathing pattern differs significantly between normal and speech breathing (i.e., talking). We integrated resistive stretch sensors into wearable elastic bands, with a future integration into clothing in mind, to record the expansion and contraction of the chest and abdomen while breathing. We developed an algorithm incorporating machine learning and evaluated its performance in distinguishing between periods of talking and non-talking. In an intra-subject analysis, our algorithm detected talking with an average accuracy of 85%. The highest accuracy of 88% was achieved during sitting and the lowest accuracy of 80.6% during walking. Complete segments of talking were correctly identified with 96% accuracy. From the evaluated machine learning algorithms, the random forest classifier performed best on our dataset. We demonstrate that wearable textile-based sensors in combination with machine learning can be used to detect when the user is talking. In the future, this approach may be used as an indicator of social interaction to prevent social isolation and loneliness.