Reward and punishment learning in daily life: A replication study

Don't Give-Up: Why some intervention schemes encourage suboptimal behavior

Many social challenges stem from individuals' tendency to prefer immediately rewarding but suboptimal behaviors ("Give-Up" options) over more costly endeavors that yield much better outcomes in the long run ("Try" options). For example, many people forgo the long-term benefits of formal education, healthy diets, learning new technologies, and even finding true love. This paper examines various incentivization programs that combine external rewards and punishments to discourage such counterproductive behaviors, which often result in only temporary behavioral change. Our findings suggest that some interventions' limited impact may be due to their focus on only shifting behaviors from "Give-Up" (e.g., dropping out of college, avoiding the gym) to "Try" (e.g., attending college, exercising regularly), without promoting sufficient exploration of these "Try" options. Yet exploration of the long-term benefits of "Trying" may be crucial to increase the chances of long-term learning and commitment. Using a simplified abstraction of this dilemma, our results show a high tendency to choose "Give-Up" options prior to intervention. Examination of four different incentivization strategies suggests that only rewarding exploration of new "Try" options is a straightforward strategy to increase exploration and optimal choice. Punishing both the selection of "Give-Up" options and the choice to exploit suboptimal "Try" options produced similar results. Other common guidance strategies were less effective, as these strategies simply tended to replace one suboptimal behavior with another. Surprisingly, punishments seemed to be a relatively more successful incentive than rewards. We discuss how these insights can help guide policy aiming to improve long-term outcomes through incentivization.

General psychopathology and its social correlates in the daily lives of youth

BACKGROUND

Adolescence is a period of both great social change, and of vulnerability to psychiatric distress. However, little is known about the associations between early psychopathology and social interactions at the fundamental level of daily life. To better understand the social correlates of subclinical psychopathology in adolescence, we assessed associations between general psychopathology and the quantity and quality of daily-life social interactions.

METHODS

During a six-day experience sampling period, adolescent and young adult participants in Study 1 (n = 663) and Study 2 (n = 1027) reported the quantity and quality of their everyday social interactions. General psychopathology was assessed using the Symptom Checklist-90 and Brief Symptom Inventory-53. The relationship between psychopathology and each outcome variable was tested in separate multilevel linear and logistic regression models.

RESULTS

General psychopathology was associated with social interaction quality. Associations between psychopathology and the number of social interactions were less apparent: In Study 1, participants with more psychopathology were not more alone, whereas Study 2 participants with higher levels of psychopathology were alone more.

LIMITATIONS

Limitations include no separate investigation of distinct types of psychopathology, and relatively low compliance to the experience sampling in Study 2.

CONCLUSIONS

Consistent associations between subclinical psychopathology and the quality of social interactions support the fundamentally social nature of early psychopathology. Moreover, negative experiences of social interactions may be more valuable markers of early psychopathology than a reduced quantity of social behaviors. Conceptualizations of daily-life social functioning, and prevention/intervention efforts would benefit from a greater consideration of the quality of everyday social experiences.

Affect fluctuations examined with ecological momentary assessment in patients with current or remitted depression and anxiety disorders

BACKGROUND

There is increasing interest in day-to-day affect fluctuations of patients with depressive and anxiety disorders. Few studies have compared repeated assessments of positive affect (PA) and negative affect (NA) across diagnostic groups, and fluctuation patterns were not uniformly defined. The aim of this study is to compare affect fluctuations in patients with a current episode of depressive or anxiety disorder, in remitted patients and in controls, using affect instability as a core concept but also describing other measures of variability and adjusting for possible confounders.

METHODS

Ecological momentary assessment (EMA) data were obtained from 365 participants of the Netherlands Study of Depression and Anxiety with current (n = 95), remitted (n = 178) or no (n = 92) DSM-IV defined depression/anxiety disorder. For 2 weeks, five times per day, participants filled-out items on PA and NA. Affect instability was calculated as the root mean square of successive differences (RMSSD). Tests on group differences in RMSSD, within-person variance, and autocorrelation were performed, controlling for mean affect levels.

RESULTS

Current depression/anxiety patients had the highest affect instability in both PA and NA, followed by remitters and then controls. Instability differences between groups remained significant when controlling for mean affect levels, but differences between current and remitted were no longer significant.

CONCLUSIONS

Patients with a current disorder have higher instability of NA and PA than remitted patients and controls. Especially with regard to NA, this could be interpreted as patients with a current disorder being more sensitive to internal and external stressors and having suboptimal affect regulation.

Discipline vs guidance: comparison of visual engagement approaches in immersive virtual environments

Immersive virtual environments (IVEs) have been extensively investigated for applications in education and man-power training because of the benefits of immersion-driven experiences as immersion becomes a factor that can both accelerate and hamper learning depending on the user's area of focus, which supports the importance of engagement. In this paper, two fundamental approaches to visual engagement in IVE are compared: discipline and guidance. The approaches aim to foster the learner's engagement to predefined area to be focused by either subtracting visual stimuli (discipline) or appending visual indicators pointing to the area (guidance). The experimental results showed no significant improvement in memory recall accuracy and time. However, the guidance group showed superior performances in usability metrics. Interestingly, a significant difference was found in the objective measure of the participants' gaze pattern revealing that the discipline makes the user's gaze consistent and stable.

mHealth technology for ecological momentary assessment in physical activity research: a systematic review

OBJECTIVE

To systematically review the publications on ecological momentary assessment (EMA) relating to physical activity (PA) behavior in order to classify the methodologies, and to identify the main mHealth technology-based tools and procedures that have been applied during the first 10 years since the emergence of smartphones. As a result of this review, we want to ask if there is enough evidence to propose the use of the term "mEMA" (mobile-based EMA).

DESIGN

A systematic review according to PRISMA Statement (PROSPERO registration: CRD42018088136).

METHOD

Four databases (PsycINFO, CINALH, Medline and Web of Science Core Collection) were searched electronically from 2008 to February 2018.

RESULTS

A total of 76 studies from 297 potential articles on the use of EMA and PA were included in this review. It was found that 71% of studies specifically used "EMA" for assessing PA behaviors but the rest used other terminology that also adjusted to the inclusion criteria. Just over half (51.3%) of studies (39) used mHealth technology, mainly smartphones, for collecting EMA data. The majority (79.5%) of these studies (31 out of 39) were published during the last 4 years. On the other hand, 58.8% of studies that only used paper-and-pencil were published during the first 3 years of the 10-year period analyzed. An accelerometer was the main built-in sensor used for collecting PA behavior by means of mHealth (69%). Most of the studies were carried out on young-adult samples, with only three studies in older adults. Women were included in 60% of studies, and healthy people in 82%. The studies lasted between 1 and 7 days in 57.9%, and between three and seven assessments per day were carried out in 37%. The most popular topics evaluated together with PA were psychological state and social and environmental context.

CONCLUSIONS

We have classified the EMA methodologies used for assessing PA behaviors. A total of 71% of studies used the term "EMA" and 51.3% used mHealth technology. Accelerometers have been the main built-in sensor used for collecting PA. The change of trend in the use of tools for EMA in PA coincides with the technological advances of the last decade due to the emergence of smartphones and mHealth technology. There is enough evidence to use the term mEMA when mHealth technology is being used for monitoring real-time lifestyle behaviors in natural situations. We define mEMA as the use of mobile computing and communication technologies for the EMA of health and lifestyle behaviors. It is clear that the use of mHealth is increasing, but there is still a lot to be gained from taking advantage of all the capabilities of this technology in order to apply EMA to PA behavior. Thus, mEMA methodology can help in the monitoring of healthy lifestyles under both subjective and objective perspectives. The tendency for future research should be the automatic recognition of the PA of the user without interrupting their behavior. The ecological information could be completed with voice messages, image captures or brief text selections on the touch screen made in real time, all managed through smartphone apps. This methodology could be extended when EMA combined with mHealth are used to evaluate other lifestyle behaviors.

Experience sampling methodology in mental health research: new insights and technical developments

In the mental health field, there is a growing awareness that the study of psychiatric symptoms in the context of everyday life, using experience sampling methodology (ESM), may provide a powerful and necessary addition to more conventional research approaches. ESM, a structured self-report diary technique, allows the investigation of experiences within, and in interaction with, the real-world context. This paper provides an overview of how zooming in on the micro-level of experience and behaviour using ESM adds new insights and additional perspectives to standard approaches. More specifically, it discusses how ESM: a) contributes to a deeper understanding of psychopathological phenomena, b) allows to capture variability over time, c) aids in identifying internal and situational determinants of variability in symptomatology, and d) enables a thorough investigation of the interaction between the person and his/her environment and of real-life social interactions. Next to improving assessment of psychopathology and its underlying mechanisms, ESM contributes to advancing and changing clinical practice by allowing a more fine-grained evaluation of treatment effects as well as by providing the opportunity for extending treatment beyond the clinical setting into real life with the development of ecological momentary interventions. Furthermore, this paper provides an overview of the technical details of setting up an ESM study in terms of design, questionnaire development and statistical approaches. Overall, although a number of considerations and challenges remain, ESM offers one of the best opportunities for personalized medicine in psychiatry, from both a research and a clinical perspective.