The particular case of conducting addiction intervention research on Mechanical Turk

Understanding data quality: Instructional comprehension as a practical metric in crowdsourced investigations of behavioral economic cigarette demand

Crowdsourcing platforms allow researchers to quickly recruit and collect behavioral economic measures in substance-using populations, such as cigarette smokers. Despite the broad utility and flexibility, data quality issues have been an object of concern. In two separate studies recruiting cigarette smokers, we sought to investigate the association between a practical quality control measure (accuracy on an instruction quiz), on internal consistency of number of cigarettes smoked per day and purchasing patterns of tobacco products in an experimental tobacco marketplace (ETM; Study 1), and in a cigarette purchase task (CPT; Study 2). Participants (N = 312 in Study 1; N = 119 in Study 2) were recruited from Amazon mechanical turk. Both studies included task instructions, a quiz, a purchase task, cigarette usage and dependence questions, and demographics. The results show that participants who answered all instruction items correctly: (a) reported the number of cigarettes per day more consistently (partial η² = 0.11, p < .001, Study 1; partial η² = 0.09, p = .016, Study 2), (b) demonstrated increased model fit among the cigarette demand curves (partial η² = 0.23, p < .001, Study 1; partial η² = 0.08, p = .002, Study 2), and purchased tobacco products in the ETM more consistently with their current usage. We conclude that instruction quizzes before purchase tasks may be useful for researchers evaluating demand data. Instruction quizzes with multiple items may allow researchers to choose the level of data quality appropriate for their studies. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

The effectiveness of a web-based intervention for Japanese adults with problem drinking: An online randomized controlled trial

•

We conducted an online randomized controlled trial for a web-based intervention.

•

The intervention comprised normative comparison, psychoeducation, and a short quiz.

•

Participants were Japanese adults aged 20 years or older and scored AUDIT ≥ 8.

•

The weekly drinking quantity at the two- and six-month follow-ups decreased.

Aims

This study aimed (1) to delineate how a web-based intervention affects the problem drinking behaviors of Japanese adults and (2) to examine the moderating effects of disorder levels and alcohol outcome expectancies on intervention outcomes.

Methods

We implemented an online two-armed parallel-group randomized controlled trial with 546 Japanese adults. Adults aged 20 years or older and who scored eight or higher on the Alcohol Use Disorder Identification Test were included in this study. Participants were randomly allocated to the intervention group or the waitlist/control group. The intervention comprised assessment of drinking behavior, personalized normative feedback, psychoeducation about the consequences of problem drinking, and a short quiz. The outcomes were weekly drinking quantity and abstinent days, largest drinking quantity in one day, and alcohol-related consequences reported at baseline and at one-, two-, and six-month follow-ups. A mixed-effects model regression was conducted to compare the intervention and control groups.

Results

The attrition rates at each follow-up were 52.93%, 49.45%, and 32.60%, respectively. The time × condition interaction effect on weekly drinking quantity was significant at the two- and six-month follow-ups, d = 0.28, 95% CI [0.04, 0.51], d = 0.34, 95% CI [0.05, 0.63], respectively. Moderations related to the intervention effect were not statistically significant.

Conclusion

A web-based intervention was found to be effective for two and six months only on drinking quantity measures of Japanese adults with problem drinking. Limitations including high drop-out rates in are discussed.

Assessing open science and citizen science in addictions and substance use research: A scoping review

BACKGROUND

The EU promotes 'Open Science' as a public good. Complementary to its implementation is Citizen Science, which redefines the relationship between the scientific community, civic society and the individual. Open Science and Citizen Science poses challenges for the substance use and addictions research community but may provide positive opportunities for future European addiction research. This paper explores both current barriers and potential facilitators for the implementation of Open Science and Citizen Science in substance use and addictions research.

METHODOLOGY

A scoping review was used to examine barriers and facilitators identified in the substance use and addiction research literature for the adoption of Open Science and Citizen Science.

RESULTS

'Technical' facilitators included the pre-registration of study protocols; publication of open-source datasets; open peer review and online tools. 'Motivational' facilitators included enhanced reputation; embracing co-creation; engaged citizenship and gamification. 'Economic' facilitators included the use of free tools and balanced remuneration of crowdworkers. 'Political' facilitators included better informed debates through the 'triple helix' approach and trust-generating transparency. 'Legal' facilitators included epidemiologically informed law enforcement; better policy surveillance and the validation of other datasets. 'Ethical' facilitators included the 'democratisation of science' and opportunities to explore new concepts of ethics in addiction research.

CONCLUSION

Open Science and Citizen Science in substance use and addictions research may provide a range of benefits in relation to the democratisation of science; transparency; efficiency and the reliability/validity of data. However, its implementation raises a range of research integrity and ethical issues that need be considered. These include issues related to participant recruitment; privacy; confidentiality; security; cost and industry involvement. Progressive journal policies to support Open Science practices; a shift in researcher norms; the use of free tools and the greater availability of methodological and ethical standards are likely to increase adoption in the field.