Assessing and overcoming participant dishonesty in online data collection

Rationale and Study Checklist for Ethical Rejection of Participants on Crowdsourcing Research Platforms

Online participant recruitment ("crowdsourcing") platforms are increasingly being used for research studies. While such platforms can rapidly provide access to large samples, there are concomitant concerns around data quality. Researchers have studied and demonstrated means to reduce the prevalence of low-quality data from crowdsourcing platforms, but approaches to doing so often involve rejecting work and/or denying payment to participants, which can pose ethical dilemmas. We write this essay as an associate professor and two institutional review board (IRB) directors to provide a perspective on the competing interests of participants/workers and researchers and to propose a checklist of steps that we believe may support workers' agency on the platform and lessen instances of unfair consequences to them while enabling researchers to definitively reject lower-quality work that might otherwise reduce the likelihood of their studies producing true results. We encourage further, explicit discussion of these issues among academics and among IRBs.

ENIGMA: A Web Application for Running Online Artificial Grammar Learning Experiments

Artificial grammar learning (AGL) is an experimental paradigm frequently adopted to investigate the unconscious and conscious learning and application of linguistic knowledge. This paper will introduce ENIGMA ( https://enigma-lang.org ) as a free, flexible, and lightweight Web-based tool for running online AGL experiments. The application is optimized for desktop and mobile devices with a user-friendly interface, which can present visual and aural stimuli and elicit judgment responses with RT measures. Without limits in time and space, ENIGMA could help collect more data from participants with diverse personal and language backgrounds and variable cognitive skills. Such data are essential to explain complex factors influencing learners' performance in AGL experiments and answer various research questions regarding L1/L2 acquisition. The introduction of the core features in ENIGMA is followed by an example study that partially replicated Chen (Lang Acquis 27(3):331-361, 2020) to illustrate possible experimental designs and examine the quality of the collected data.

The Burden for High-Quality Online Data Collection Lies With Researchers, Not Recruitment Platforms

A recent article in Perspectives on Psychological Science (Webb & Tangney, 2022) reported a study in which just 2.6% of participants recruited on Amazon's Mechanical Turk (MTurk) were deemed "valid." The authors highlighted some well-established limitations of MTurk, but their central claims-that MTurk is "too good to be true" and that it captured "only 14 human beings . . . [out of] N = 529"-are radically misleading, yet have been repeated widely. This commentary aims to (a) correct the record (i.e., by showing that Webb and Tangney's approach to data collection led to unusually low data quality) and (b) offer a shift in perspective for running high-quality studies online. Negative attitudes toward MTurk sometimes reflect a fundamental misunderstanding of what the platform offers and how it should be used in research. Beyond pointing to research that details strategies for effective design and recruitment on MTurk, we stress that MTurk is not suitable for every study. Effective use requires specific expertise and design considerations. Like all tools used in research-from advanced hardware to specialist software-the tool itself places constraints on what one should use it for. Ultimately, high-quality data is the responsibility of the researcher, not the crowdsourcing platform.

Beyond the challenge to research integrity: imposter participation in incentivised qualitative research and its impact on community engagement

Participant recruitment for qualitative research often offers incentives (honoraria; financial compensation) to increase participation and to recognise lived expertise and time involved in research. While not necessarily a new concern for survey and other quantitative based research, 'spam', 'bot', and other inauthentic forms of research participation has rarely been an apparent issue for qualitative research, given it often involves levels of interaction with potential participants prior to the conduct of in-depth interviews and other methods of data generation. This is no longer the case. A troubling new occurrence has meant that recruitment calls for qualitative research with incentives on public-facing social media have attracted 'imposter' expressions of interest and research participation. In this commentary, we explore this challenge that goes beyond research integrity. In particular, we consider the risks of employing strategies to screen for legitimate participants and the importance of building trust and maintaining community engagement.

Mindfulness-Based App to Reduce Stress in Caregivers of Persons With Alzheimer Disease and Related Dementias: Protocol for a Single-Blind Feasibility Proof-of-Concept Randomized Controlled Trial

BACKGROUND

Informal caregivers (ie, individuals who provide assistance to a known person with health or functional needs, often unpaid) experience high levels of stress. Caregiver stress is associated with negative outcomes for both caregivers and care recipients. Mindfulness-based interventions (MBIs) show promise for improving stress, emotional distress, and sleep disturbance in caregivers of persons with Alzheimer disease and related dementias (ADRD). Commercially available mobile mindfulness apps can deliver MBIs to caregivers of persons with ADRD in a feasible and cost-effective manner.

OBJECTIVE

We are conducting a single-blind feasibility proof-of-concept randomized controlled trial (RCT; National Institutes of Health [NIH] stage 1B) comparing 2 free mobile apps: the active intervention Healthy Minds Program (HMP) with within-app text tailored for addressing stress among caregivers of persons with ADRD, versus Wellness App (WA), a time- and dose-matched educational control also tailored for caregivers of persons with ADRD.

METHODS

We aim to recruit 80 geographically diverse and stressed caregivers of persons with ADRD. Interested caregivers use a link or QR code on a recruitment flyer to complete a web-based eligibility screener. Research assistants conduct enrollment phone calls, during which participants provide informed consent digitally. After participants complete baseline surveys, we randomize them to the mindfulness-based intervention (HMP) or educational control podcast app (WA) and instruct them to listen to prescribed content for 10 minutes per day (70 minutes per week) for 12 weeks. Caregivers are blinded to intervention versus control. The study team checks adherence weekly and contacts participants to promote adherence as needed. Participants complete web-based self-report measures at baseline, posttest, and follow-up; weekly process measures are also completed. Primary outcomes are a priori set feasibility benchmarks. Secondary outcomes are stress, emotional distress, sleep disturbance, caregiver burden, mindfulness, awareness, connection, insight, and purpose. We will calculate 1-sided 95% CI to assess feasibility benchmarks. Effect sizes of change in outcomes will be used to examine the proof of concept.

RESULTS

Recruitment started on February 20, 2023. We have enrolled 27 caregivers (HMP: n=14; WA: n=13) as of June 2023. Funding began in August 2022, and we plan to finish enrollment by December 2023. Data analysis is expected to begin in May 2024 when all follow-ups are complete; publication of findings will follow.

CONCLUSIONS

Through this trial, we aim to establish feasibility benchmarks for HMP and WA, as well as establish a proof of concept that HMP improves stress (primary quantitative outcome), emotional distress, sleep, and mindfulness more than WA. Results will inform a future efficacy trial (NIH stage II). HMP has the potential to be a cost-effective solution to reduce stress in caregivers of persons with ADRD, benefiting caregiver health and quality of care as well as patient care.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05732038; https://clinicaltrials.gov/study/NCT05732038.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/50108.

Benzodiazepine Use and Dependence in Relation to Chronic Pain Intensity and Pain Catastrophizing

Benzodiazepines (BZDs), a class of sedative-hypnotic medications, generated concern as their popularity grew, with particular alarm regarding elevated rates of BZD use among chronic pain populations. Consistent with negative reinforcement/motivational models of substance use, desire for pain alleviation may motivate BZD use. Yet, little is known about relations between pain and addiction-relevant BZD use processes. This cross-sectional survey study aimed to: a) test associations between pain intensity and clinically relevant BZD use patterns, and b) examine the role of pain catastrophizing in hypothesized pain-BZD relations. Participants included 306 adults with chronic musculoskeletal pain and a current BZD prescription who completed an online survey study (Mage = 38.7, 38.9% female). Results indicated that pain intensity was positively associated with past-month BZD use frequency, BZD dependence severity, and likelihood of endorsing BZD misuse behaviors (ps < .05). Pain catastrophizing was positively associated with BZD dependence/likelihood of BZD misuse, covarying for pain intensity (P < .05). These findings build upon an emerging literature by highlighting positive covariation of pain intensity and pain catastrophizing with addiction-relevant BZD use behaviors. Results underscore the need to further investigate high-risk BZD use among individuals with chronic pain, with and without concurrent opioid use, to inform prevention/intervention efforts. PERSPECTIVE: This article presents findings on cross-sectional associations of pain intensity and pain catastrophizing with clinically relevant benzodiazepine (BZD) use outcomes, including dependence and misuse, among individuals with chronic pain. Findings help elucidate the higher burden of BZD misuse/dependence in chronic pain populations and suggest that pain relief may be a common, yet under recognized, self-reported motivation for taking BZDs.

Taking a Shot: The Impact of Information Frames and Channels on Vaccination Willingness in a Pandemic

The reluctance of people to receive safe and recommended available vaccines is a well-documented public health challenge. As information and communication technologies evolve, this challenge gets more complex and even harder to manage during complex public health situations. In this experimental study, we examine the relationship between vaccine information frames (with scientific information vs. without scientific information) and channels (through government vs. religious organizations) and vaccination willingness in the U.S. in the context of a pandemic. Additionally, we evaluate the interaction between vaccine skepticism, vaccine information frames, and vaccine information channels on vaccination willingness. This experimental study uses data from Amazon Mechanical Turk (MTURK) to evaluate the relationships between vaccine skepticism, vaccine information frames, and channels on vaccination willingness. We find that contrary to our hypothesis, a vaccine advisory framed with scientific information decreases people's vaccination willingness compared to one framed without scientific information. Additionally, the impact of framing on vaccination willingness is conditioned on participants' skepticism-participants who hold skepticism toward the vaccine but received information framed with scientific information score significantly higher in vaccination willingness compared to participants who do not hold skepticism toward a vaccine. The results suggest that the factors impacting vaccination willingness are complex and nuanced. Thus, policymakers should be more strategic with the delivery of vaccination information, especially during complex health crises.

Perception of Resource Allocations to Address the Opioid Epidemic

OBJECTIVES

Despite billions of dollars spent on opioid policy initiatives, public knowledge of evidence-based policies to reduce opioid-related morbidity remain low. Consequences of this knowledge gap for support of initiatives remains understudied. Our objective was to evaluate how participants with and without lived experience allocate funding for initiatives to address the opioid epidemic. A secondary objective was to collect proof-of-concept data of an informational intervention designed to improve support for evidence-based policies.

METHODS

Participants (N = 284; 57.2% female) without lifetime nonmedical opioid use (n = 98) and those with lifetime use (past year [n = 81] or nonpast year [n = 105]) of nonmedical opioids were recruited. All participants reported how they would allocate funds to demand reduction, supply reduction, harm reduction, and treatment policies. Half of all participants were then randomized to a brief informational intervention designed to emphasize evidence-based harm reduction and treatment programs.

RESULTS

Funding allocations were highest for policies related to community services and treatment and lowest for those related to harm reduction. Participants with lived experience allocated less to supply reduction policies. Participants (12%) who reallocated funds after information exposure increased funding to supervised consumption sites, dz = 0.77, naloxone distribution, dz = 0.85, syringe exchange programs, dz = 0.63, and medications for opioid use disorder access, dz = 0.70.

CONCLUSIONS

This study illustrates how people with and without lived experience prioritize various policies to address the opioid epidemic and emphasize comparably low support for harm reduction policies. Proof-of-concept data suggest that brief informational interventions may increase funding support for harm reduction strategies, at least in a subset of people.

Stop the Bleed Training for High School Students: Guardian Attitudes and Their Association with Prior Trauma

BACKGROUND

Uncontrolled bleeding is the leading preventable cause of death after injury. Stop the Bleed (STB) is a bleeding control training with proposed expansion into schools. However, the attitudes of guardians, specifically those with past trauma/injury, towards expanding STB into schools are unknown.

METHODS

A cross-sectional survey evaluated guardian attitudes towards STB training in high schools, and compared responses between guardians based on the experience of prior trauma. Logistic regression models evaluated the association between prior trauma and guardian-reported acceptability of STB training.

RESULTS

Of 750 guardians who received the survey, 484 (64.5%) responded. Most guardians (95.3%) wanted their child trained. Few (4.2%) felt this training would be harmful; 44.9% felt their child might be held responsible if something went wrong, and 28.4% reported it might be too scary for their child. In adjusted models, guardians with prior trauma were more likely to want their child trained (odds ratio [OR] = 3.50, 95% confidence interval [CI] 1.11-15.50), and identify STB as important to them (OR = 4.07, 95% CI 1.66-12.26).

CONCLUSION

Our results support STB training in high schools, and guardians with a trauma history may be more likely to want their child trained. Further work to understand the perceived potential harm, and work to design trauma-informed first-response trainings is warranted.

Behavioral economic methods to inform infectious disease response: Prevention, testing, and vaccination in the COVID-19 pandemic

The role of human behavior to thwart transmission of infectious diseases like COVID-19 is evident. Psychological and behavioral science are key areas to understand decision-making processes underlying engagement in preventive health behaviors. Here we adapt well validated methods from behavioral economic discounting and demand frameworks to evaluate variables (e.g., delay, cost, probability) known to impact health behavior engagement. We examine the contribution of these mechanisms within a broader response class of behaviors reflecting adherence to public health recommendations made during the COVID-19 pandemic. Four crowdsourced samples (total N = 1,366) completed individual experiments probing a response class including social (physical) distancing, facemask wearing, COVID-19 testing, and COVID-19 vaccination. We also measure the extent to which choice architecture manipulations (e.g., framing, opt-in/opt-out) may promote (or discourage) behavior engagement. We find that people are more likely to socially distance when specified activities are framed as high risk, that facemask use during social interaction decreases systematically with greater social relationship, that describing delay until testing (rather than delay until results) increases testing likelihood, and that framing vaccine safety in a positive valence improves vaccine acceptance. These findings collectively emphasize the flexibility of methods from diverse areas of behavioral science for informing public health crisis management.

Using Crowdsourcing for Alcohol and Nicotine Use Research: Prevalence, Data Quality, and Attrition on Amazon Mechanical Turk

BackgroundGauging the feasibility of using Amazon Mechanical Turk ® (MTurk) for various types of substance use research is precluded by a lack of information pertaining to the recruitment process in published studies utilizing it and concurrent information on data quality. ObjectiveThe present report addressed this gap by documenting the prevalence of alcohol and nicotine use, self-reported major health conditions, and information on data quality and retention on MTurk. Individuals 21 to 90 years old (N = 1101, Mdn age = 30) with United States-based MTurk accounts completed a stand-alone screening survey. The screening consisted of basic demographic, substance use, and physical/mental health questions, as well as items to gauge language proficiency/attention (i.e., data quality). ResultsPoor quality data was infrequent (6.5% of participants) and associated with self-reported non-United States residence, affirmative responding (e.g., currently pregnant, using both alcohol and nicotine), and other response characteristics (e.g., not disclosing health conditions). Among those passing quality checks, alcohol and nicotine use were relatively common (71.5% and 24.8%). Major physical (6.3%) and mental health conditions (14.8%) were less common. Despite not sending direct invitations, most eligible participants returned to and completed the main study (81.7%). Conclusions/Importance: Alcohol and nicotine use were relatively common among MTurk workers and retention rates were high. Together with the low prevalence of poor quality data, MTurk appears to remain a fruitful platform for substance use research; although researchers must be diligent in using appropriate screening tools, as substance use was sometimes associated with poor data quality and MTurk account information may not be reliable.

Reducing Internalized Homonegativity: Refinement and Replication of an Online Intervention for Gay Men

We refined and replicated an efficacious brief intervention to reduce internalized homonegativity (IH) with a sample of gay and exclusively same-sex attracted men recruited from outside of LGBT community networks using Amazon Mechanical Turk. We sought to 1) determine if levels of IH differed between the original study's community-based sample and our non-community-based sample, 2) examine the efficacy of the replicated intervention, and 3) assess for longitudinal effects of the intervention at a 30-day follow-up. Four hundred eighty-four participants completed either the intervention or a stress management control condition. Mean levels of IH were higher in the current sample compared with the earlier study's community sample. The intervention was efficacious at reducing global IH, reducing personal homonegativity, and increasing gay affirmation. Ninety-six participants completed the follow-up; follow-up results were not significant and may have been affected by high rates of attrition. Implications for research and practice are discussed.

Comparing the Recruitment of Research Participants With Chronic Low Back Pain Using Amazon Mechanical Turk With the Recruitment of Patients From Chiropractic Clinics: A Quasi-Experimental Study

OBJECTIVE

The purpose of this study was to compare the crowdsourcing platform Amazon Mechanical Turk (MTurk) with in-person recruitment and web-based surveys as a method to (1) recruit study participants and (2) obtain low-cost data quickly from chiropractic patients with chronic low back pain in the United States.

METHODS

In this 2-arm quasi-experimental study, we used in-person clinical sampling and web-based surveys from a separate study (RAND sample, n = 1677, data collected October 2016 to January 2017) compared with MTurk (n = 310, data collected November 2016) as a sampling and data collection tool. We gathered patient-reported health outcomes and other characteristics of adults with chronic low back pain receiving chiropractic care. Parametric and nonparametric tests were run. We assessed statistical and practical differences based on P values and effect sizes, respectively.

RESULTS

Compared with the RAND sample, the MTurk sample was statistically significantly younger (mean age 35.4 years, SD 9.7 vs 48.9, SD 14.8), made less money (24% vs 17% reported less than $30,000 annual income), and reported worst mental health than the RAND sample. Other differences were that the MTurk sample had more men (37% vs 29%), fewer White patients (87% vs 92%), more Hispanic patients (9% vs 5%), fewer people with a college degree (59% vs 68%), and patients were more likely to be working full time (62% vs 58%). The MTurk sample was more likely to have chronic low back pain (78% vs 66%) that differed in pain frequency and duration. The MTurk sample had less disability and better global health scores. In terms of efficiency, the surveys cost $2.50 per participant in incentives for the MTurk sample. Survey development took 2 weeks and data collection took 1 month.

CONCLUSION

Our results suggest that there may be differences between crowdsourcing and a clinic-based sample. These differences range from small to medium on demographics and self-reported health. The low incentive costs and rapid data collection of MTurk makes it an economically viable method of collecting data from chiropractic patients with low back pain. Further research is needed to explore the utility of MTurk for recruiting clinical samples, such as comparisons to nationally representative samples.

Quality control questions on Amazon's Mechanical Turk (MTurk): A randomized trial of impact on the USAUDIT, PHQ-9, and GAD-7

Crowdsourced psychological and other biobehavioral research using platforms like Amazon's Mechanical Turk (MTurk) is increasingly common - but has proliferated more rapidly than studies to establish data quality best practices. Thus, this study investigated whether outcome scores for three common screening tools would be significantly different among MTurk workers who were subject to different sets of quality control checks. We conducted a single-stage, randomized controlled trial with equal allocation to each of four study arms: Arm 1 (Control Arm), Arm 2 (Bot/VPN Check), Arm 3 (Truthfulness/Attention Check), and Arm 4 (Stringent Arm - All Checks). Data collection was completed in Qualtrics, to which participants were referred from MTurk. Subjects (n = 1100) were recruited on November 20-21, 2020. Eligible workers were required to claim U.S. residency, have a successful task completion rate > 95%, have completed a minimum of 100 tasks, and have completed a maximum of 10,000 tasks. Participants completed the US-Alcohol Use Disorders Identification Test (USAUDIT), the Patient Health Questionnaire (PHQ-9), and a screener for Generalized Anxiety Disorder (GAD-7). We found that differing quality control approaches significantly, meaningfully, and directionally affected outcome scores on each of the screening tools. Most notably, workers in Arm 1 (Control) reported higher scores than those in Arms 3 and 4 for all tools, and a higher score than workers in Arm 2 for the PHQ-9. These data suggest that the use, or lack thereof, of quality control questions in crowdsourced research may substantively affect findings, as might the types of quality control items.

Gendered Perceptions of Odd and Even Numbers: An Implicit Association Study From Arabic Culture

Previous studies conducted in the United States indicate that people associate numbers with gender, such that odd numbers are more likely to be considered male and even numbers considered female. It has been argued that this number gendering phenomenon is acquired through social learning and conditioning, and that male-odd/female-even associations reflect a general, cross-cultural human consensus on gender roles relating to agency and communion. However, the incidence and pattern of number gendering in cultures outside the United States remains to be established. Against this background, the purpose of this study was to determine whether people from a culture and country very different from the United States (specifically, native Arabic citizens living in the Arabic culture of the United Arab Emirates) also associate numbers with gender, and, if they do, whether the pattern of these associations is the male-odd/female-even associations previously observed. To investigate this issue, we adopted the Implicit Association Test used frequently in previous research, where associations between numbers (odd and even) and gender (male and female faces) were examined using male and female Arabic participants native to, and resident in, the United Arab Emirates. The findings indicated that the association of numbers with gender does occur in Arabic culture. But while Arabic females associated odd numbers with male faces and even numbers with female faces (the pattern of previous findings in the United States), Arabic males showed the reversed pattern of gender associations, associating even numbers with male faces and odd numbers with female faces. These findings support the view that number gendering is indeed a cross-cultural phenomenon and show that the phenomenon occurs across very different countries and cultures. But the findings also suggest that the pattern with which numbers are associated with gender is not universal and, instead, reflects culture-specific views on gender roles which may change across cultures and gender. Further implications for understanding the association of numbers with gender across human societies are discussed.

Integrating Operant and Cognitive Behavioral Economics to Inform Infectious Disease Response: Prevention, Testing, and Vaccination in the COVID-19 Pandemic

The role of human behavior to thwart transmission of infectious diseases like COVID-19 is evident. Yet, many areas of psychological and behavioral science are limited in the ability to mobilize to address exponential spread or provide easily translatable findings for policymakers. Here we describe how integrating methods from operant and cognitive approaches to behavioral economics can provide robust policy relevant data. Adapting well validated methods from behavioral economic discounting and demand frameworks, we evaluate in four crowdsourced samples (total N = 1,366) behavioral mechanisms underlying engagement in preventive health behaviors. We find that people are more likely to social distance when specified activities are framed as high risk, that describing delay until testing (rather than delay until results) increases testing likelihood, and that framing vaccine safety in a positive valence improves vaccine acceptance. These findings collectively emphasize the flexibility of methods from diverse areas of behavioral science for informing public health crisis management.

Further investigation of the effects of wearing the hijab: Perception of female facial attractiveness by Emirati Muslim men living in their native Muslim country

The hijab is central to the lives of Muslim women across the world but little is known about the actual effects exerted by this garment on perceptions of the wearer. Indeed, while previous research has suggested that wearing the hijab may affect the physical attractiveness of women, the actual effect of wearing the hijab on perceptions of female facial attractiveness by Muslim men in a Muslim country is largely unknown. Accordingly, this study investigated the effects of the hijab on female facial attractiveness perceived by practising Muslim men living in their native Muslim country (the United Arab Emirates). Participants were presented with frontal-head images of women shown in three conditions: in the fully covered condition, heads were completely covered by the hijab except for the face; in the partially covered condition, heads were completely covered by the hijab except for the face and areas around the forehead and each side of the face and head; in the uncovered condition, heads had no covering at all. The findings revealed that faces where heads were uncovered or partially covered were rated as equally attractive, and both were rated as substantially more attractive than faces where heads were fully covered. Thus, while wearing the hijab can suppress female facial attractiveness to men, these findings suggest that not all hijab wearing has this effect, and female facial attractiveness for practising Muslim men living in their native Muslim country may not be reduced simply by wearing this garment. Indeed, from the findings we report, slight changes to the positioning of the hijab (the partially covered condition) produce perceptions of facial attractiveness that are no lower than when no hijab is worn, and this may have important implications for wearing the hijab in Muslim societies. Finally, we argue that the pattern of effects we observed is not explained by anti-Islamic feeling or cultural endogamy, and that a major contributory factor is that being fully covered by the hijab occludes external features, especially the hair and lateral parts of the head and face, which, when normally visible, provide a substantial perceptual contribution to human facial attractiveness.

Contribution of alcohol- and cigarette-related cues to concurrent reinforcer choice in humans

Drug-related cues have been extensively studied for their contributions to decision-making processes involving drug consumption. Less studied is how drug-related stimuli may impact decisions involving outcomes not directly related to substance use. Studies using concurrent choice tasks have demonstrated that cocaine and cannabis cues result in robust and selective biases for monetary reinforcers contiguous with those cues. The purpose of this study was to provide a conceptual replication of these findings with alcohol and cigarettes. Participants recruited using crowdsourcing completed a cued concurrent choice task involving presentation of two cues (one drug and one neutral) followed by concurrent monetary offers below each image. Alcohol (Experiment 1; N = 103) and cigarette (Experiment 2; N = 256) visual cues were evaluated. Participants with hazardous alcohol use and current cigarette use showed greater-than-indifference selection for the alcohol- (p = .004) and cigarette-cued (p = .02) monetary choices, respectively. Qualitative responses indicated that the most popular rationale for responding was "image quality" despite images having no explicit impact on the reinforcer received. Low alcohol use (p = .03) and non-cigarette using controls (p < .001) showed an avoidance bias with lower-than-indifference selection for drug-cued choices. These findings replicate and extend observations that spatially contiguous drug-related cues can bias decisions involving concurrently presented non-drug reinforcers.

Assessment of anxiety in older adults: psychometric properties and relationships with self-reported functional impairment

OBJECTIVE

The current study aimed to examine the psychometric properties of two geriatric anxiety measures: the Geriatric Anxiety Inventory (GAI) and the Geriatric Anxiety Scale (GAS). This study also aimed to determine the relationships of these measures with two measures of functional ability and impairment: the Barkley Functional Impairment Scale (BFIS) and the Everyday Cognition Scale (E-Cog).

DESIGN

Confirmatory factor analyses (CFA) were used to analyze the factor structures of the GAI and GAS in older adults. Tests for dependent correlations were used to examine the relationship between anxiety scales and functioning.

SETTING

Amazon's Mechanical Turk.

PARTICIPANTS

348 participants (aged 55-85, M= 62.75 (4.8), 66.5% female) with no history of psychosis or traumatic brain injury.

RESULTS

CFAs supported the previously demonstrated bifactor solution for the GAI. For the GAS, the previously demonstrated three-factor model demonstrated a good-to-excellent fit. Given the high correlation between the cognitive and affective factors (r =.89), a bifactor solution was also tested. The bifactor model of the GAS was found to be primarily unidimensional. Tests for dependent correlations revealed that the GAS demonstrated stronger relationships with measures of self-reported functional impairment than the GAI.

CONCLUSIONS

The current study provides further psychometric validation of the factor structure of two geriatric anxiety measures in an older adult sample. The results support previous work completed on the GAI and the GAS. The GAS was more strongly correlated with self-reported functional impairment than the GAI, which may reflect differences in content in the two measures.

Are Aspects of Twitter Use Associated with Reduced Depressive Symptoms? The Moderating Role of In-Person Social Support

In a two-wave, 4-month longitudinal study of 308 adults, two hypotheses were tested regarding the relation of Twitter-based measures of online social media use and in-person social support with depressive thoughts and symptoms. For four of five measures, Twitter use by in-person social support interactions predicted residualized change in depression-related outcomes over time; these results supported a corollary of the social compensation hypothesis that social media use is associated with greater benefits for people with lower in-person social support. In particular, having a larger Twitter social network (i.e., following and being followed by more people) and being more active in that network (i.e., sending and receiving more tweets) are especially helpful to people who have lower levels of in-person social support. For the fifth measure (the sentiment of Tweets), no interaction emerged; however, a beneficial main effect offset the adverse main effect of low in-person social support.

Leveraging crowdsourcing methods to collect qualitative data in addiction science: Narratives of non-medical prescription opioid, heroin, and fentanyl use

BACKGROUND

Online crowdsourcing methods have proved useful for studies of diverse designs in the behavioral and addiction sciences. The remote and online setting of crowdsourcing research may provide easier access to unique participant populations and improved comfort for these participants in sharing sensitive health or behavioral information. To date, few studies have evaluated the use of qualitative research methods on crowdsourcing platforms and even fewer have evaluated the quality of data gathered. The purpose of the present analysis was to document the feasibility and validity of using crowdsourcing techniques for collecting qualitative data among people who use drugs.

METHODS

Participants (N = 60) with a history of non-medical prescription opioid use with transition to heroin or fentanyl use were recruited using Amazon Mechanical Turk (mTurk). A battery of qualitative questions was included indexing beliefs and behaviors surrounding opioid use, transition pathways to heroin and/or fentanyl use, and drug-related contacts with structural institutions (e.g., health care, criminal justice).

RESULTS

Qualitative data recruitment was feasible as evidenced by the rapid sampling of a relatively large number of participants from diverse geographic regions. Computerized text analysis indicated high ratings of authenticity for the provided narratives. These authenticity percentiles were higher than the average of general normative writing samples as well as than those collected in experimental settings.

CONCLUSIONS

These findings support the feasibility and quality of qualitative data collected in online settings, broadly, and crowdsourced settings, specifically. Future work among people who use drugs may leverage crowdsourcing methods and the access to hard-to-sample populations to complement existing studies in the human laboratory and clinic as well as those using other digital technology methods.

Utilizing content-knowledge questionnaires to assess study eligibility and detect deceptive responding

Background: Deceptive responding during eligibility screening presents a significant concern for assessing inclusion/exclusion criteria. This problem is compounded in settings for which biomarkers or other objective verification (e.g., urinalysis) are not feasible.Objectives: Introduce and describe content-knowledge questionnaires as an objective method for collaterally assessing study eligibility.Methods: Participants (N = 3772; 66.1% female) recruited using the crowdsourcing resource Amazon Mechanical Turk (mTurk) completed a Cannabis Knowledge Questionnaire (CKQ). The CKQ contained four-items indexing knowledge of typical cannabis costs, weights, and terminology. Self-reported cannabis use history was collected and compared to individual item and total scale scores. A separate in-laboratory assessment evaluated participants during in-person screening for cannabis, alcohol, and cocaine research protocols (N = 43).Results: Good internal consistency (α = .74) was observed. The most common correctly answered question was about dabbing (41.4%) followed by cannabis cost (37.6%), hybrid strains (36.6%), and estimated weight (29.7%). Current cannabis use was associated with large effect size increases in the rate of correct responses (RR = 3.64) as well as odds of a correct response on individual items (OR = 5.88-21.48). In the laboratory study, participants with a positive urine drug test for cannabis or those reporting lifetime regular cannabis use scored higher than those without this history (RR = 1.89-2.61).Conclusion: These findings highlight the efficiency and efficacy of including content-knowledge questionnaires for collateral assessment of study eligibility, especially when biomarkers are not possible. Future studies will be useful for extending this initial demonstration to alternative settings and substances.

Investigating the effect of wearing the hijab: Perception of facial attractiveness by Emirati Muslim women living in their native Muslim country

The Hijab and other forms of Islamic veiling are important social, cultural, and religious symbols that are central to the identity of millions of Muslim women across the world. However, despite the large body of literature that exists on the political and socio-cultural aspects of Islamic veiling, little is known about how the appearance of women wearing the hijab is perceived by other Muslim women within their native Muslim country. To throw light on this important issue, the current study focussed on the effects of the hijab on female facial attractiveness perceived by practising Muslim Emirati women living in their native Muslim country (the United Arab Emirates) who themselves wore the hijab as everyday attire. Participants were shown frontal-head images of women in three different conditions: covered (heads fully covered by the hijab except for the face), partially covered (heads fully covered by the hijab except for the face and the hair around the forehead) and uncovered (heads with no covering). The findings showed that faces in images where heads were covered and partially covered by the hijab were rated as equally attractive but both were rated as significantly less attractive than faces in images where heads were uncovered. These findings suggest that, even for practising Muslim Emirati females living in their native Muslim country for whom wearing the hijab is a normal aspect of everyday life, perception of facial attractiveness is compromised by wearing this garment. We argue that this effect of wearing the hijab is not consistent with a preference for one's own cultural group (cultural endogamy) and may, instead, occur because wearing a hijab occludes external features, such as hair and ears, which normally contribute to the perception of human facial attractiveness. In sum, while wearing the hijab may be dominated by male attitudes towards suppressing female attractiveness towards males, the findings from this study suggest that female Muslims too perceive the negative influence of wearing the hijab on female facial attractiveness.