Systematic review of ecological momentary assessment (EMA) studies of five public health-related behaviours: review protocol

Comparisons of Self-Report With Objective Measurements Suggest Faster Responding but Little Change in Response Quality Over Time in Ecological Momentary Assessment Studies

Response times (RTs) to ecological momentary assessment (EMA) items often decrease after repeated EMA administration, but whether this is accompanied by lower response quality requires investigation. We examined the relationship between EMA item RTs and EMA response quality. In one data set, declining response quality was operationalized as decreasing correspondence over time between subjective and objective measures of blood glucose taken at the same time. In a second EMA study data set, declining response quality was operationalized as decreasing correspondence between subjective ratings of memory test performance and objective memory test scores. We assumed that measurement error in the objective measures did not increase across time, meaning that decreasing correspondence across days within a person could be attributed to lower response quality. RTs to EMA items decreased across study days, while no decrements in the mean response quality were observed. Decreasing EMA item RTs across study days did not appear problematic overall.

A stochastic model for affect dynamics: methodological insights from heart rate variability in an illustrative case of Anorexia Nervosa

Background

Affect dynamics, or variations in emotional experiences over time, are linked to psychological health and well-being, with moderate emotional variations indicating good psychophysical health. Given the impact of emotional state on cardiac variability, our objective was to develop a quantitative method to measure affect dynamics for better understanding emotion temporal management in Anorexia Nervosa (AN).

Methods

The study proposed an experimental and methodological approach to evaluate physiological affect dynamics in clinical settings. It tested affective transitions and temporal changes using emotional images from the International Affective Picture System (IAPS), examining physiological characteristics of a patient with AN. The methodology involved calculating a heart rate variability index, e.g., RMSSD, and using it in a Discrete Time and Discrete Space Markov chain to define, quantify, and predict emotional fluctuations over time.

Results

The patient with Anorexia Nervosa showed a high likelihood of transitioning from positive to negative emotional states, particularly at lower arousal levels. The steady state matrix indicated a tendency to remain in highly activated pleasant states, reflecting difficulties in maintaining emotional balance.

Conclusions

Employing Markov chains provided a quantitative and insightful approach for examining affect dynamics in a patient with AN. This methodology accurately measures emotional transitions and provides a clear and interpretable framework for clinicians and patients. By leveraging Markovian indexes, mental health professionals may gain a comprehensive understanding of emotional fluctuations' patterns. Moreover, graphical representations of emotional transitions may enhance the clinician-patient dialogue, facilitating a clearer emotional and physiological profile for the implementation of personalized treatment procedures.

Naturalistic assessments across the lifespan: Systematic review of inhibition measures in ecological settings

Inhibitory control is essential for our everyday lives. Despite this, it is commonly assessed using non-naturalistic assessments. In this systematic review, we argue for the importance of taking an ecological approach to assess cognition. The aims are to present the state-of-knowledge in naturalistic assessments of inhibitory control, focusing on their methodological characteristics, including psychometric properties and user experience. PubMed, PsycINFO and Web of Science were searched until September 2024. Studies were included if they used at least one naturalistic method of assessing inhibition. The included studies (N=64) were grouped into three methodological categories: gamification, virtual reality, and brief, repeated assessments in participants' usual environment in the form of ecological momentary assessments. Sample sizes spanned three orders of magnitude (N=12-22,098). We report considerable heterogeneity in the types of tasks used, and the psychometric details reported. Nonetheless, naturalistic tasks were generally comparable with standardised equivalents, although some tasks assessed mixed-domain constructs. Tasks were feasible and acceptable for participants, with generally high completion rates and engagement. Recommendations for future research are discussed.

Digital Technologies Tracking Active and Passive Data Collection in Depressive Disorders: Lessons Learned From a Case Series

In this case series, we present several examples from participants (2 patients and 1 healthy control) of a 12-week pilot feasibility study to create a digital phenotype of depression (unipolar or bipolar) through active and passive data collection from a smartphone and a wearable device combined with routine clinical care for mood disorders. The selected cases represent real clinical examples that highlight the intrinsic challenges that should be expected when conducting similar studies, including appropriate health data privacy protection, clinical standardization, and interindividual differences in levels of engagement and acceptability of active and passive data collection (ie, self-reported, behavioral, cognitive, and physiological data), particularly with patient-generated data in mobile apps, digital proficiency habituation, and consistent use of wearable devices. In the context of the rapidly growing use of digital technologies in psychiatry, anticipating challenges for the integration of personal mobile devices and smartphone mental health apps as aides to track specific aspects of depressive disorders is critical for a clinically meaningful digital transformation of mood disorders care.

Social mobile sensing and problematic alcohol consumption: Insights from smartphone metadata

BACKGROUND

Alcohol is often consumed in a social context. We aim to investigate whether social mobile sensing is associated with real-world social interactions and alcohol consumption. In addition, we investigate how social restriction policies implemented during the COVID-19 pandemic have influenced these associations.

METHODS

We conducted a smartphone-based ecological momentary assessment (EMA) study for 7 days over a 213-day period from 8 August 2020 to 9 March 2021 in Germany, including both no-lockdown and lockdown stages. Participants used a smartphone application which passively collects data on social behavior (e.g., app usage, phone calls, SMS). Moreover, we assessed real-world social interactions and alcohol consumption via daily questionnaires.

RESULTS

We found that each one-hour increase in social media usage was associated with a 40.2% decrease in the average number of drinks consumed. Mediation analysis suggested that social media usage decreases alcohol intake through decreased real-world social interactions. Notably, we did not find that any significant influence of the lockdown stage on the association between social mobile sensing and alcohol intake.

CONCLUSIONS

Our study suggests that people who use more social media drink less, likely due to reduced face-to-face social interactions. This highlights the potential of social mobile sensing as an objective measure of social activity and its implications for understanding alcohol consumption behavior.

Reliability and Validity of Ecological Momentary Assessment Response Time-Based Measures of Emotional Clarity: Secondary Data Analysis

BACKGROUND

Emotional clarity has often been assessed with self-report measures, but efforts have also been made to measure it passively, which has advantages such as avoiding potential inaccuracy in responses stemming from social desirability bias or poor insight into emotional clarity. Response times (RTs) to emotion items administered in ecological momentary assessments (EMAs) may be an indirect indicator of emotional clarity. Another proposed indicator is the drift rate parameter, which assumes that, aside from how fast a person responds to emotion items, the measurement of emotional clarity also requires the consideration of how careful participants were in providing responses.

OBJECTIVE

This paper aims to examine the reliability and validity of RTs and drift rate parameters from EMA emotion items as indicators of individual differences in emotional clarity.

METHODS

Secondary data analysis was conducted on data from 196 adults with type 1 diabetes who completed a 2-week EMA study involving the completion of 5 to 6 surveys daily. If lower RTs and higher drift rates (from EMA emotion items) were indicators of emotional clarity, we hypothesized that greater levels (ie, higher clarity) should be associated with greater life satisfaction; lower levels of neuroticism, depression, anxiety, and diabetes distress; and fewer difficulties with emotion regulation. Because prior literature suggested emotional clarity could be valence specific, EMA items for negative affect (NA) and positive affect were examined separately.

RESULTS

Reliability of the proposed indicators of emotional clarity was acceptable with a small number of EMA prompts (ie, 4 to 7 prompts in total or 1 to 2 days of EMA surveys). Consistent with expectations, the average drift rate of NA items across multiple EMAs had expected associations with other measures, such as correlations of r=-0.27 (P<.001) with depression symptoms, r=-0.27 (P=.001) with anxiety symptoms, r=-0.15 (P=.03) with emotion regulation difficulties, and r=0.63 (P<.001) with RTs to NA items. People with a higher NA drift rate responded faster to NA emotion items, had greater subjective well-being (eg, fewer depression symptoms), and had fewer difficulties with overall emotion regulation, which are all aligned with the expectation for an emotional clarity measure. Contrary to expectations, the validities of average RTs to NA items, the drift rate of positive affect items, and RTs to positive affect items were not strongly supported by our results.

CONCLUSIONS

Study findings provided initial support for the validity of NA drift rate as an indicator of emotional clarity but not for that of other RT-based clarity measures. Evidence was preliminary because the sample size was not sufficient to detect small but potentially meaningful correlations, as the sample size of the diabetes EMA study was chosen for other more primary research questions. Further research on passive emotional clarity measures is needed.

Ecological momentary assessment of physical activity and sedentary behaviour in shift workers and non-shift workers: Validation study

This study examined the criterion validity of an ecological momentary assessment (EMA)-reported physical activity and sedentary time compared with accelerometry in shift workers and non-shift workers. Australian workers (n = 102) received prompts through a mobile EMA app and wore the Actigraph accelerometer on the right hip for 7-10 days. Participants received five EMA prompts per day at 3-hour intervals on their mobile phones. EMA prompts sent to shift workers (SW-T) were tailored according to their work schedule. Non-shift workers (NSW-S) received prompts at standardised times. To assess criterion validity, the association of EMA-reported activities and the Actigraph accelerometer activity counts and number of steps were used. Participants were 36 ± 11 years and 58% were female. On occasions where participants reported physical activity, acceleration counts per minute (CPM) and steps were significantly higher (β = 1184 CPM, CI 95%: 1034, 1334; β = 20.9 steps, CI 95%: 18.2, 23.6) than each of the other EMA activities. Acceleration counts and steps were lower when sitting was reported than when no sitting was reported by EMA. Our study showed that EMA-reported physical activity and sedentary time was significantly associated with accelerometer-derived data. Therefore, EMA can be considered to assess shift workers' movement-related behaviours with accelerometers to provide rich contextual data.

Digital Phenotyping for Mood Disorders: Methodology-Oriented Pilot Feasibility Study

BACKGROUND

In the burgeoning area of clinical digital phenotyping research, there is a dearth of literature that details methodology, including the key challenges and dilemmas in developing and implementing a successful architecture for technological infrastructure, patient engagement, longitudinal study participation, and successful reporting and analysis of diverse passive and active digital data streams.

OBJECTIVE

This article provides a narrative rationale for our study design in the context of the current evidence base and best practices, with an emphasis on our initial lessons learned from the implementation challenges and successes of this digital phenotyping study.

METHODS

We describe the design and implementation approach for a digital phenotyping pilot feasibility study with attention to synthesizing key literature and the reasoning for pragmatic adaptations in implementing a multisite study encompassing distinct geographic and population settings. This methodology was used to recruit patients as study participants with a clinician-validated diagnostic history of unipolar depression, bipolar I disorder, or bipolar II disorder, or healthy controls in 2 geographically distinct health care systems for a longitudinal digital phenotyping study of mood disorders.

RESULTS

We describe the feasibility of a multisite digital phenotyping pilot study for patients with mood disorders in terms of passively and actively collected phenotyping data quality and enrollment of patients. Overall data quality (assessed as the amount of sensor data obtained vs expected) was high compared to that in related studies. Results were reported on the relevant demographic features of study participants, revealing recruitment properties of age (mean subgroup age ranged from 31 years in the healthy control subgroup to 38 years in the bipolar I disorder subgroup), sex (predominance of female participants, with 7/11, 64% females in the bipolar II disorder subgroup), and smartphone operating system (iOS vs Android; iOS ranged from 7/11, 64% in the bipolar II disorder subgroup to 29/32, 91% in the healthy control subgroup). We also described implementation considerations around digital phenotyping research for mood disorders and other psychiatric conditions.

CONCLUSIONS

Digital phenotyping in affective disorders is feasible on both Android and iOS smartphones, and the resulting data quality using an open-source platform is higher than that in comparable studies. While the digital phenotyping data quality was independent of gender and race, the reported demographic features of study participants revealed important information on possible selection biases that may result from naturalistic research in this domain. We believe that the methodology described will be readily reproducible and generalizable to other study settings and patient populations given our data on deployment at 2 unique sites.

Differential alterations of amygdala nuclei volumes in acutely ill patients with anorexia nervosa and their associations with leptin levels

BACKGROUND

The amygdala is a subcortical limbic structure consisting of histologically and functionally distinct subregions. New automated structural magnetic resonance imaging (MRI) segmentation tools facilitate the in vivo study of individual amygdala nuclei in clinical populations such as patients with anorexia nervosa (AN) who show symptoms indicative of limbic dysregulation. This study is the first to investigate amygdala nuclei volumes in AN, their relationships with leptin, a key indicator of AN-related neuroendocrine alterations, and further clinical measures.

METHODS

T1-weighted MRI scans were subsegmented and multi-stage quality controlled using FreeSurfer. Left/right hemispheric amygdala nuclei volumes were cross-sectionally compared between females with AN (n = 168, 12-29 years) and age-matched healthy females (n = 168) applying general linear models. Associations with plasma leptin, body mass index (BMI), illness duration, and psychiatric symptoms were analyzed via robust linear regression.

RESULTS

Globally, most amygdala nuclei volumes in both hemispheres were reduced in AN v. healthy control participants. Importantly, four specific nuclei (accessory basal, cortical, medial nuclei, corticoamygdaloid transition in the rostral-medial amygdala) showed greater volumetric reduction even relative to reductions of whole amygdala and total subcortical gray matter volumes, whereas basal, lateral, and paralaminar nuclei were less reduced. All rostral-medially clustered nuclei were positively associated with leptin in AN independent of BMI. Amygdala nuclei volumes were not associated with illness duration or psychiatric symptom severity in AN.

CONCLUSIONS

In AN, amygdala nuclei are altered to different degrees. Severe volume loss in rostral-medially clustered nuclei, collectively involved in olfactory/food-related reward processing, may represent a structural correlate of AN-related symptoms. Hypoleptinemia might be linked to rostral-medial amygdala alterations.

Predicting Participation Willingness in Ecological Momentary Assessment of General Population Health and Behavior: Machine Learning Study

BACKGROUND

Ecological momentary assessment (EMA) is widely used in health research to capture individuals' experiences in the flow of daily life. The majority of EMA studies, however, rely on nonprobability sampling approaches, leaving open the possibility of nonrandom participation concerning the individual characteristics of interest in EMA research. Knowledge of the factors that predict participation in EMA research is required to evaluate this possibility and can also inform optimal recruitment strategies.

OBJECTIVE

This study aimed to examine the extent to which being willing to participate in EMA research is related to respondent characteristics and to identify the most critical predictors of participation.

METHODS

We leveraged the availability of comprehensive data on a general young adult population pool of potential EMA participants and used and compared logistic regression, classification and regression trees, and random forest approaches to evaluate respondents' characteristic predictors of willingness to participate in the Decades-to-Minutes EMA study.

RESULTS

In unadjusted logistic regression models, gender, migration background, anxiety, attention deficit hyperactivity disorder symptoms, stress, and prosociality were significant predictors of participation willingness; in logistic regression models, mutually adjusting for all predictors, migration background, tobacco use, and social exclusion were significant predictors. Tree-based approaches also identified migration status, tobacco use, and prosociality as prominent predictors. However, overall, willingness to participate in the Decades-to-Minutes EMA study was only weakly predictable from respondent characteristics. Cross-validation areas under the curve for the best models were only in the range of 0.56 to 0.57.

CONCLUSIONS

Results suggest that migration background is the single most promising target for improving EMA participation and sample representativeness; however, more research is needed to improve prediction of participation in EMA studies in health.

A scoping review of intensive longitudinal methods in informal caregivers of people with dementia

BACKGROUND

The daily life of informal caregivers assisting individuals with dementia widely varies throughout the day and week. As an answer, an increasing number of researchers have used intensive longitudinal methods (ILMs) such as diary studies, experience sampling methods, or ecological momentary assessment.

OBJECTIVES AND METHODS

The present scoping review aims at synthesizing the use of ILMs in informal dementia caregivers to clarify what is currently done and how, as well as what remains unaddressed.

RESULTS

The screening process identified 48 studies from 22 different datasets. Synthesis of these studies showed the diversity of devices and uses of ILMs in informal care, including the exploration of associations between variables or accompanying an intervention. ILMs showed the important variability of caregiving phenomena, as well as the important association of momentary stress and well-being. Gaps were nevertheless identified, such as transparency in the construction of the tool or the absence of focus on emotions and dyads.

CONCLUSIONS

For now, this field of research remains in its infancy and does not seem to have reached its full potential as it has in other fields. Nevertheless, it appears that ILMs are promising tools for informal dementia caregivers as they contribute to understanding the complexity of their daily life, with changing resources and challenges. Future directions include focusing more on (emotion) regulation, temporal lags, and the use of ILMs in interventional designs.

TRIAL REGISTRATION

The present review was registered on OSF (osf.io/b2qr4).

Within-person associations between psychological and contextual factors and lapse incidence in smokers attempting to quit: A systematic review and meta-analysis of ecological momentary assessment studies

AIMS

When attempting to stop smoking, discrete smoking events ('lapses') are strongly associated with a return to regular smoking ('relapse'). No study has yet pooled the psychological and contextual antecedents of lapse incidence, captured in ecological momentary assessment (EMA) studies. This systematic review and meta-analysis aimed to synthesize within-person psychological and contextual predictor-lapse associations in smokers attempting to quit.

METHODS

We searched Ovid MEDLINE, Embase, PsycINFO and Web of Science. A narrative synthesis and multi-level, random-effects meta-analyses were conducted, focusing on studies of adult, non-clinical populations attempting to stop smoking, with no restrictions on setting. Outcomes were the association between a psychological (e.g. stress, cravings) or contextual (e.g. cigarette availability) antecedent and smoking lapse incidence; definitions of 'lapse' and 'relapse'; the theoretical underpinning of EMA study designs; and the proportion of studies with pre-registered study protocols/analysis plans and open data.

RESULTS

We included 61 studies, with 19 studies contributing ≥ 1 effect size(s) to the meta-analyses. We found positive relationships between lapse incidence and 'environmental and social cues' [k = 12, odds ratio (OR) = 4.53, 95% confidence interval (CI) = 2.02, 10.16, P = 0.001] and 'cravings' (k = 10, OR = 1.71, 95% CI = 1.34, 2.18, P < 0.001). 'Negative feeling states' was not significantly associated with lapse incidence (k = 16, OR = 1.10, 95% CI = 0.98, 1.24, P = 0.12). In the narrative synthesis, negative relationships with lapse incidence were found for 'behavioural regulation', 'motivation not to smoke' and 'beliefs about capabilities'; positive relationships with lapse incidence were found for 'positive feeling states' and 'positive outcome expectancies'. Although lapse definitions were comparable, relapse definitions varied widely across studies. Few studies explicitly drew upon psychological theory to inform EMA study designs. One of the included studies drew upon Open Science principles.

CONCLUSIONS

In smokers attempting to stop, environmental and social cues and cravings appear to be key within-person antecedents of smoking lapse incidence. Due to low study quality, the confidence in these estimates is reduced.

How Notifications Affect Engagement With a Behavior Change App: Results From a Micro-Randomized Trial

BACKGROUND

Drink Less is a behavior change app to help higher-risk drinkers in the United Kingdom reduce their alcohol consumption. The app includes a daily notification asking users to "Please complete your drinks and mood diary," yet we did not understand the causal effect of the notification on engagement nor how to improve this component of Drink Less. We developed a new bank of 30 new messages to increase users' reflective motivation to engage with Drink Less. This study aimed to determine how standard and new notifications affect engagement.

OBJECTIVE

Our objective was to estimate the causal effect of the notification on near-term engagement, to explore whether this effect changed over time, and to create an evidence base to further inform the optimization of the notification policy.

METHODS

We conducted a micro-randomized trial (MRT) with 2 additional parallel arms. Inclusion criteria were Drink Less users who consented to participate in the trial, self-reported a baseline Alcohol Use Disorders Identification Test score of ≥8, resided in the United Kingdom, were aged ≥18 years, and reported interest in drinking less alcohol. Our MRT randomized 350 new users to test whether receiving a notification, compared with receiving no notification, increased the probability of opening the app in the subsequent hour, over the first 30 days since downloading Drink Less. Each day at 8 PM, users were randomized with a 30% probability of receiving the standard message, a 30% probability of receiving a new message, or a 40% probability of receiving no message. We additionally explored time to disengagement, with the allocation of 60% of eligible users randomized to the MRT (n=350) and 40% of eligible users randomized in equal number to the 2 parallel arms, either receiving the no notification policy (n=98) or the standard notification policy (n=121). Ancillary analyses explored effect moderation by recent states of habituation and engagement.

RESULTS

Receiving a notification, compared with not receiving a notification, increased the probability of opening the app in the next hour by 3.5-fold (95% CI 2.91-4.25). Both types of messages were similarly effective. The effect of the notification did not change significantly over time. A user being in a state of already engaged lowered the new notification effect by 0.80 (95% CI 0.55-1.16), although not significantly. Across the 3 arms, time to disengagement was not significantly different.

CONCLUSIONS

We found a strong near-term effect of engagement on the notification, but no overall difference in time to disengagement between users receiving the standard fixed notification, no notification at all, or the random sequence of notifications within the MRT. The strong near-term effect of the notification presents an opportunity to target notifications to increase "in-the-moment" engagement. Further optimization is required to improve the long-term engagement.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.2196/18690.

Understanding health behaviours in context: A systematic review and meta-analysis of ecological momentary assessment studies of five key health behaviours

Ecological Momentary Assessment (EMA) involves repeated, real-time sampling of health behaviours in context. We present the state-of-knowledge in EMA research focused on five key health behaviours (physical activity and sedentary behaviour, dietary behaviour, alcohol consumption, tobacco smoking, sexual health), summarising theoretical (e.g., psychological and contextual predictors) and methodological aspects (e.g., study characteristics, EMA adherence). We searched Ovid MEDLINE, Embase, PsycINFO and Web of Science until February 2021. We included studies focused on any of the aforementioned health behaviours in adult, non-clinical populations that assessed ≥1 psychological/contextual predictor and reported a predictor-behaviour association. A narrative synthesis and random-effects meta-analyses of EMA adherence were conducted. We included 633 studies. The median study duration was 14 days. The most frequently assessed predictors were 'negative feeling states' (21%) and 'motivation and goals' (16.5%). The pooled percentage of EMA adherence was high at 81.4% (95% CI = 80.0%, 82.8%, k = 348) and did not differ by target behaviour but was somewhat higher in student (vs. general population) samples, when EMAs were delivered via mobile phones/smartphones (vs. handheld devices), and when event contingent (vs. fixed) sampling was used. This review showcases how the EMA method has been applied to improve understanding and prediction of health behaviours in context.

An Ecological Momentary Assessment Study of Pain Intensity Variability: Ascertaining Extent, Predictors, and Associations With Quality of Life, Interference and Health Care Utilization Among Individuals Living With Chronic Low Back Pain

This ecological momentary assessment (EMA) study examined the extent of pain intensity variability among 140 individuals with chronic low back pain and explored predictors of such variability and psychosocial and health care utilization outcomes. Individuals completed momentary pain intensity reports (0-10 numeric rating scale) several times daily for two periods of seven consecutive days, one month apart. Participants also completed online questionnaires at baseline which tapped into pain characteristics, pain-related catastrophization, kinesiophobia, activity patterns, and depression and anxiety symptoms. Questionnaires assessing quality of life and health care utilization were administered online one month after completion of the last EMA report. Data were analyzed using linear hierarchical location-scale models. Results showed that pain intensity fluctuated over the course of a week as shown by an average standard deviation of 1.2. The extent of variability in pain intensity scores was heterogeneous across participants but stable over assessment periods. Patients' baseline characteristics along with psychosocial and health care utilization outcomes were not significantly associated with pain intensity variability. We conclude that pain intensity variability differs across patients yet correlates remain elusive. There is an important gap in our knowledge of what affects this variability. Future EMA studies should replicate and extend current findings. PERSPECTIVE: This study provides evidence indicating that there is substantial variability in momentary reports of pain intensity among individuals living with chronic low back pain. However, risk and protective factors for greater lability of pain are elusive as is evidence that greater pain intensity variability results in differential health care utilization.