Misogynistic Extremism: A Scoping Review

In recent years, the concept of "misogynistic extremism" has emerged as a subject of interest among scholars, governments, law enforcement personnel, and the media. Yet a consistent understanding of how misogynistic extremism is defined and conceptualized has not yet emerged. Varying epistemological orientations may contribute to the current conceptual muddle of this topic, reflecting long-standing and on-going challenges with the conceptualization of its individual components. To address the potential impact of misogynistic extremism (i.e., violent attacks), a more precise understanding of what this phenomenon entails is needed. To summarize the existing knowledge base on the nature of misogynistic extremism, this scoping review analyzed publications within English-language peer-reviewed and gray literature sources. Seven electronic databases and citation indexes were systematically searched using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for scoping reviews (PRISMA-ScR) checklist and charted using the 2020 PRISMA flow diagram. Inclusion criteria included English peer-reviewed articles and relevant gray literature publications, which contained the term "misogynistic extremism" and other closely related terms. No date restrictions were imposed. The search strategy initially yielded 475 publications. After exclusion of ineligible articles, 40 publications remained for synthesis. We found that misogynistic extremism is most frequently conceptualized in the context of misogynistic incels, male supremacism, far-right extremism, terrorism, and the black pill ideology. Policy recommendations include increased education among law enforcement and Countering and Preventing Violent Extremism experts on male supremacist violence and encouraging legal and educational mechanisms to bolster gender equality. Violence stemming from misogynistic worldviews must be addressed by directly acknowledging and challenging socially embedded systems of oppression such as white supremacy and cisheteropatriarchy.

Social network structure as a suicide prevention target

PURPOSE

The structure of relationships in a social network affects the suicide risk of the people embedded within it. Although current interventions often modify the social perceptions (e.g., perceived support and sense of belonging) for people at elevated risk, few seek to directly modify the structure of their surrounding social networks. We show social network structure is a worthwhile intervention target in its own right.

METHODS

A simple model illustrates the potential of interventions to modify social structure. The effect of these basic structural interventions on suicide risk is simulated and evaluated. Its results are briefly compared to emerging empirical findings for real network interventions.

RESULTS

Even an intentionally simplified intervention on social network structure (i.e., random addition of social connections) is likely to be both effective and safe. Specifically, this illustrative intervention had a high probability of reducing the overall suicide risk, without increasing the risk of those who were healthy at baseline. It also frequently resolved stable, high-risk clusters of people at elevated risk. These illustrative results are generally consistent with emerging evidence from real social network interventions for suicide.

CONCLUSION

Social network structure is a neglected, but valuable intervention target for suicide prevention.

Identification of Myths and Misinformation About Treatment for Opioid Use Disorder on Social Media: Infodemiology Study

BACKGROUND

Health misinformation and myths about treatment for opioid use disorder (OUD) are present on social media and contribute to challenges in preventing drug overdose deaths. However, no systematic, quantitative methodology exists to identify what types of misinformation are being shared and discussed.

OBJECTIVE

We developed a multistage analytic pipeline to assess social media posts from Twitter (subsequently rebranded as X), YouTube, Reddit, and Drugs-Forum for the presence of health misinformation about treatment for OUD.

METHODS

Our approach first used document embeddings to identify potential new statements of misinformation from known myths. These statements were grouped into themes using hierarchical agglomerative clustering, and public health experts then reviewed the results for misinformation.

RESULTS

We collected a total of 19,953,599 posts discussing opioid-related content across the aforementioned platforms. Our multistage analytic pipeline identified 7 main clusters or discussion themes. Among a high-yield data set of posts (n=303) for further public health expert review, these included discussion about potential treatments for OUD (90/303, 29.8%), the nature of addiction (68/303, 22.5%), pharmacologic properties of substances (52/303, 16.9%), injection drug use (36/303, 11.9%), pain and opioids (28/303, 9.3%), physical dependence of medications (22/303, 7.2%), and tramadol use (7/303, 2.3%). A public health expert review of the content within each cluster identified the presence of misinformation and myths beyond those used as seed myths to initialize the algorithm.

CONCLUSIONS

Identifying and addressing misinformation through appropriate communication strategies could be an increasingly important component of preventing overdose deaths. To further this goal, we developed and tested an approach to aid in the identification of myths and misinformation about OUD from large-scale social media content.

Predicting state level suicide fatalities in the united states with realtime data and machine learning

Digital trace data and machine learning techniques are increasingly being adopted to predict suicide-related outcomes at the individual level; however, there is also considerable public health need for timely data about suicide trends at the population level. Although significant geographic variation in suicide rates exist by state within the United States, national systems for reporting state suicide trends typically lag by one or more years. We developed and validated a deep learning based approach to utilize real-time, state-level online (Mental Health America web-based depression screenings; Google and YouTube Search Trends), social media (Twitter), and health administrative data (National Syndromic Surveillance Program emergency department visits) to estimate weekly suicide counts in four participating states. Specifically, per state, we built a long short-term memory (LSTM) neural network model to combine signals from the real-time data sources and compared predicted values of suicide deaths from our model to observed values in the same state. Our LSTM model produced accurate estimates of state-specific suicide rates in all four states (percentage error in suicide rate of -2.768% for Utah, -2.823% for Louisiana, -3.449% for New York, and -5.323% for Colorado). Furthermore, our deep learning based approach outperformed current gold-standard baseline autoregressive models that use historical death data alone. We demonstrate an approach to incorporate signals from multiple proxy real-time data sources that can potentially provide more timely estimates of suicide trends at the state level. Timely suicide data at the state level has the potential to improve suicide prevention planning and response tailored to the needs of specific geographic communities.

Models of Gender Dysphoria Using Social Media Data for Use in Technology-Delivered Interventions: Machine Learning and Natural Language Processing Validation Study

BACKGROUND

The optimal treatment for gender dysphoria is medical intervention, but many transgender and nonbinary people face significant treatment barriers when seeking help for gender dysphoria. When untreated, gender dysphoria is associated with depression, anxiety, suicidality, and substance misuse. Technology-delivered interventions for transgender and nonbinary people can be used discretely, safely, and flexibly, thereby reducing treatment barriers and increasing access to psychological interventions to manage distress that accompanies gender dysphoria. Technology-delivered interventions are beginning to incorporate machine learning (ML) and natural language processing (NLP) to automate intervention components and tailor intervention content. A critical step in using ML and NLP in technology-delivered interventions is demonstrating how accurately these methods model clinical constructs.

OBJECTIVE

This study aimed to determine the preliminary effectiveness of modeling gender dysphoria with ML and NLP, using transgender and nonbinary people's social media data.

METHODS

Overall, 6 ML models and 949 NLP-generated independent variables were used to model gender dysphoria from the text data of 1573 Reddit (Reddit Inc) posts created on transgender- and nonbinary-specific web-based forums. After developing a codebook grounded in clinical science, a research team of clinicians and students experienced in working with transgender and nonbinary clients used qualitative content analysis to determine whether gender dysphoria was present in each Reddit post (ie, the dependent variable). NLP (eg, n-grams, Linguistic Inquiry and Word Count, word embedding, sentiment, and transfer learning) was used to transform the linguistic content of each post into predictors for ML algorithms. A k-fold cross-validation was performed. Hyperparameters were tuned with random search. Feature selection was performed to demonstrate the relative importance of each NLP-generated independent variable in predicting gender dysphoria. Misclassified posts were analyzed to improve future modeling of gender dysphoria.

RESULTS

Results indicated that a supervised ML algorithm (ie, optimized extreme gradient boosting [XGBoost]) modeled gender dysphoria with a high degree of accuracy (0.84), precision (0.83), and speed (1.23 seconds). Of the NLP-generated independent variables, Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5) clinical keywords (eg, dysphoria and disorder) were most predictive of gender dysphoria. Misclassifications of gender dysphoria were common in posts that expressed uncertainty, featured a stressful experience unrelated to gender dysphoria, were incorrectly coded, expressed insufficient linguistic markers of gender dysphoria, described past experiences of gender dysphoria, showed evidence of identity exploration, expressed aspects of human sexuality unrelated to gender dysphoria, described socially based gender dysphoria, expressed strong affective or cognitive reactions unrelated to gender dysphoria, or discussed body image.

CONCLUSIONS

Findings suggest that ML- and NLP-based models of gender dysphoria have significant potential to be integrated into technology-delivered interventions. The results contribute to the growing evidence on the importance of incorporating ML and NLP designs in clinical science, especially when studying marginalized populations.

Empirical networks for localized COVID-19 interventions using WiFi infrastructure at university campuses

Infectious diseases, like COVID-19, pose serious challenges to university campuses, which typically adopt closure as a non-pharmaceutical intervention to control spread and ensure a gradual return to normalcy. Intervention policies, such as remote instruction (RI) where large classes are offered online, reduce potential contact but also have broad side-effects on campus by hampering the local economy, students' learning outcomes, and community wellbeing. In this paper, we demonstrate that university policymakers can mitigate these tradeoffs by leveraging anonymized data from their WiFi infrastructure to learn community mobility-a methodology we refer to as WiFi mobility models (WiMob). This approach enables policymakers to explore more granular policies like localized closures (LC). WiMob can construct contact networks that capture behavior in various spaces, highlighting new potential transmission pathways and temporal variation in contact behavior. Additionally, WiMob enables us to design LC policies that close super-spreader locations on campus. By simulating disease spread with contact networks from WiMob, we find that LC maintains the same reduction in cumulative infections as RI while showing greater reduction in peak infections and internal transmission. Moreover, LC reduces campus burden by closing fewer locations, forcing fewer students into completely online schedules, and requiring no additional isolation. WiMob can empower universities to conceive and assess a variety of closure policies to prevent future outbreaks.

Using Social Media to Examine Themes Surrounding Fentanyl Misuse and Risk Indicators

Background: Opioid misuse is a crisis in the United States, and synthetic opioids such as fentanyl pose risks for overdose and mortality. Individuals who misuse substances commonly seek information and support online due to stigma and legal concerns, and this online networking may provide insight for substance misuse prevention and treatment. We aimed to characterize topics in substance-misuse related discourse among members of an online fentanyl community. Method: We investigated posts on a fentanyl-specific forum on the platform Reddit to identify emergent substance misuse-related themes potentially indicative of heightened risk for overdose and other adverse health outcomes. We analyzed 27 posts and 338 comments with a qualitative codebook established using a subset of user posts via inductive and deductive methods. Posts and comments were independently reviewed by two coders with a third coder resolving discrepancies. The top 200 subreddits with the most activity by r/fentanyl members were also inductively analyzed to understand interests of r/fentanyl users. Results: Functional/quality of life impairments due to substance misuse (29%) was the most commonly occurring theme, followed by polysubstance use (27%) and tolerance/dependence/withdrawal (20%). Additional themes included drug identification with photos, substances cut with other drugs, injection drugs, and past overdoses. Media-focused subreddits and other drug focused communities were among the communities most often followed by r/fentanyl users. Conclusion: Themes closely align with DSM-V substance use disorder symptoms for fentanyl and other substances. High involvement in media-focused subreddits and other substance-misuse-related communities suggests digital platforms as acceptable for overdose prevention and recovery support interventions.

Leveraging Symptom Search Data to Understand Disparities in US Mental Health Care: Demographic Analysis of Search Engine Trace Data

BACKGROUND

In the United States, 1 out of every 3 people lives in a mental health professional shortage area. Shortage areas tend to be rural, have higher levels of poverty, and have poor mental health outcomes. Previous work has demonstrated that these poor outcomes may arise from interactions between a lack of resources and lack of recognition of mental illness by medical professionals.

OBJECTIVE

We aimed to understand the differences in how people in shortage and nonshortage areas search for information about mental health on the web.

METHODS

We analyzed search engine log data related to health from 2017-2021 and examined the differences in mental health search behavior between shortage and nonshortage areas. We analyzed several axes of difference, including shortage versus nonshortage comparisons, urban versus rural comparisons, and temporal comparisons.

RESULTS

We found specific differences in search behavior between shortage and nonshortage areas. In shortage areas, broader and more general mental health symptom categories, namely anxiety (mean 2.03%, SD 0.44%), depression (mean 1.15%, SD 0.27%), fatigue (mean 1.21%, SD 0.28%), and headache (mean 1.03%, SD 0.23%), were searched significantly more often (Q<.0003). In contrast, specific symptom categories and mental health disorders such as binge eating (mean 0.02%, SD 0.02%), psychosis (mean 0.37%, SD 0.06%), and attention-deficit/hyperactivity disorder (mean 0.77%, SD 0.10%) were searched significantly more often (Q<.0009) in nonshortage areas. Although suicide rates are consistently known to be higher in shortage and rural areas, we see that the rates of suicide-related searching are lower in shortage areas (mean 0.05%, SD 0.04%) than in nonshortage areas (mean 0.10%, SD 0.03%; Q<.0003), more so when a shortage area is rural (mean 0.024%, SD 0.029%; Q<2 × 10^-12).

CONCLUSIONS

This study demonstrates differences in how people from geographically marginalized groups search on the web for mental health. One main implication of this work is the influence that search engine ranking algorithms and interface design might have on the kinds of resources that individuals use when in distress. Our results support the idea that search engine algorithm designers should be conscientious of the role that structural factors play in expressions of distress and they should attempt to design search engine algorithms and interfaces to close gaps in care.

Cross-Platform Detection of Psychiatric Hospitalization via Social Media Data: Comparison Study

BACKGROUND

Previous research has shown the feasibility of using machine learning models trained on social media data from a single platform (eg, Facebook or Twitter) to distinguish individuals either with a diagnosis of mental illness or experiencing an adverse outcome from healthy controls. However, the performance of such models on data from novel social media platforms unseen in the training data (eg, Instagram and TikTok) has not been investigated in previous literature.

OBJECTIVE

Our study examined the feasibility of building machine learning classifiers that can effectively predict an upcoming psychiatric hospitalization given social media data from platforms unseen in the classifiers' training data despite the preliminary evidence on identity fragmentation on the investigated social media platforms.

METHODS

Windowed timeline data of patients with a diagnosis of schizophrenia spectrum disorder before a known hospitalization event and healthy controls were gathered from 3 platforms: Facebook (254/268, 94.8% of participants), Twitter (51/268, 19% of participants), and Instagram (134/268, 50% of participants). We then used a 3 × 3 combinatorial binary classification design to train machine learning classifiers and evaluate their performance on testing data from all available platforms. We further compared results from models in intraplatform experiments (ie, training and testing data belonging to the same platform) to those from models in interplatform experiments (ie, training and testing data belonging to different platforms). Finally, we used Shapley Additive Explanation values to extract the top predictive features to explain and compare the underlying constructs that predict hospitalization on each platform.

RESULTS

We found that models in intraplatform experiments on average achieved an F₁-score of 0.72 (SD 0.07) in predicting a psychiatric hospitalization because of schizophrenia spectrum disorder, which is 68% higher than the average of models in interplatform experiments at an F₁-score of 0.428 (SD 0.11). When investigating the key drivers for divergence in construct validities between models, an analysis of top features for the intraplatform models showed both low predictive feature overlap between the platforms and low pairwise rank correlation (<0.1) between the platforms' top feature rankings. Furthermore, low average cosine similarity of data between platforms within participants in comparison with the same measurement on data within platforms between participants points to evidence of identity fragmentation of participants between platforms.

CONCLUSIONS

We demonstrated that models built on one platform's data to predict critical mental health treatment outcomes such as hospitalization do not generalize to another platform. In our case, this is because different social media platforms consistently reflect different segments of participants' identities. With the changing ecosystem of social media use among different demographic groups and as web-based identities continue to become fragmented across platforms, further research on holistic approaches to harnessing these diverse data sources is required.

Social media-based interventions for adolescent and young adult mental health: A scoping review

Background

Mental health conditions are common among adolescents and young adults, yet few receive adequate mental health treatment. Many young people seek support and information online through social media, and report preferences for digital interventions. Thus, digital interventions deployed through social media have promise to reach a population not yet engaged in treatment, and at risk of worsening symptoms.

Objective

In this scoping review, we aimed to identify and review empirical research on social media-based interventions aimed at improving adolescent and young adult mental health. A secondary objective was to identify the features and functionalities of platforms described as social media.

Methods

Adhering to the PRISMA-ScR guidelines for scoping reviews, the search was conducted in PubMed MEDLINE; Embase Central Register of Controlled Trials (Wiley); PsycINFO (Ebsco); Scopus; Web of Science; IEEE Xplore; ACM Digital Library; and ClinicalTrials.gov from inception until November 2021. Studies were included if they involved adolescents or young adults (10-26 years of age) that meet clinical, or subclinical, levels of a mental health condition and include a pre- and post-assessment of mental health outcomes.

Results

Among the 18,380 references identified, 15 met full inclusion criteria and were published between 2017 and 2021-this included four randomized controlled trials, seven non-randomized pre-post trials, and four were experimental or quasi-experimental designs. Just five studies were delivered through an existing social media site (Facebook or Pixtori), with the remainder focused on purpose-built networks. Three studies involved adolescents or young adults who self-reported a mental health condition, seven involved young people diagnosed with a mental health condition by a clinician or who scored above a clinical threshold on valid clinical measure, three involved college students without a mental health inclusion criterion, and two studies focused on young people with a cancer diagnosis.

Conclusions

The review highlights innovations in the delivery of mental health interventions, provides preliminary evidence of the ability of social media interventions to improve mental health outcomes, and underscores the need for, and merit of, future work in this area. We discuss opportunities and challenges for future research, including the potential to leveragei existing peer networks, the use of just-in-time interventions, and scaling interventions to meet need.

Interventions to mitigate vaping misinformation: protocol for a scoping review

BACKGROUND

The impact of misinformation about vapes' relative harms compared with smoking may lead to increased tobacco-related burden of disease. To date, no systematic efforts have been made to chart interventions that mitigate vaping-related misinformation. We plan to conduct a scoping review that seeks to fill gaps in the current knowledge of interventions that mitigate vaping-related misinformation.

METHODS

A scoping review focusing on interventions that mitigate vaping-related misinformation will be conducted. We will search (no date restrictions) MEDLINE, Scopus, EMBASE, CINAHL, PsycINFO, Web of Science Core Collection, Global Health, ERIC, and Sociological Abstracts. Gray literature will be identified using Disaster Lit, Google Scholar, Open Science Framework, governmental websites, and preprint servers (e.g., EuropePMC, PsyArXiv, MedRxiv, JMIR Preprints). Study selection will conform to Joanna Briggs Institute Reviewers' Manual 2020 Methodology for JBI Scoping Reviews. Only English language, original studies will be considered for inclusion. Two reviewers will independently screen all citations, full-text articles, and abstract data. A narrative summary of findings will be conducted. Data analysis will involve quantitative (e.g., frequencies) and qualitative (e.g., content and thematic analysis) methods. Where possible, a single effect size of exposure to the mitigation of vaping-related misinformation will be calculated per sample. Similarly, where possible, each study will be coded for moderating characteristics to find and account for systematic differences in the size of the effect or outcome that is being analyzed. Quality will be appraised with the study quality assessment tools utilized by the National Heart, Lung, and Blood Institute. Findings will be subjected to several different publication bias tests: Egger's regression test, Begg and Mazumdar's ran correlation test, and generation of a funnel plot with effect sizes plotted against a corresponding standard error.

DISCUSSION

Original research is urgently needed to design interventions to mitigate vaping-related misinformation. The planned scoping review will help to address this gap.

SYSTEMATIC REVIEW REGISTRATION

Open Science Framework osf/io/hy3tk.

Classifying Minority Stress Disclosure on Social Media with Bidirectional Long Short-Term Memory

Because of their stigmatized social status, sexual and gender minority (SGM; e.g., gay, transgender) people experience minority stress (i.e., identity-based stress arising from adverse social conditions). Given that minority stress is the leading framework for understanding health inequity among SGM people, researchers and clinicians need accurate methods to detect minority stress. Since social media fulfills important developmental, affiliative, and coping functions for SGM people, social media may be an ecologically valid channel for detecting minority stress. In this paper, we propose a bidirectional long short-term memory (BI-LSTM) network for classifying minority stress disclosed on Reddit. Our experiments on a dataset of 12,645 Reddit posts resulted in an average accuracy of 65%.

Interventions to mitigate COVID-19 misinformation: protocol for a scoping review

BACKGROUND

The duration and impact of the COVID-19 pandemic depends in a large part on individual and societal actions which is influenced by the quality and salience of the information to which they are exposed. Unfortunately, COVID-19 misinformation has proliferated. To date, no systematic efforts have been made to evaluate interventions that mitigate COVID-19-related misinformation. We plan to conduct a scoping review that seeks to fill several of the gaps in the current knowledge of interventions that mitigate COVID-19-related misinformation.

METHODS

A scoping review focusing on interventions that mitigate COVID-19 misinformation will be conducted. We will search (from January 2020 onwards) MEDLINE, EMBASE, CINAHL, PsycINFO, Web of Science Core Collection, Africa-Wide Information, Global Health, WHO Global Literature on Coronavirus Disease Database, WHO Global Index Medicus, and Sociological Abstracts. Gray literature will be identified using Disaster Lit, Google Scholar, Open Science Framework, governmental websites, and preprint servers (e.g., EuropePMC, PsyArXiv, MedRxiv, JMIR Preprints). Study selection will conform to Joanna Briggs Institute Reviewers' Manual 2020 Methodology for JBI Scoping Reviews. Only English language, original studies will be considered for inclusion. Two reviewers will independently screen all citations, full-text articles, and abstract data. A narrative summary of findings will be conducted. Data analysis will involve quantitative (e.g., frequencies) and qualitative (e.g., content and thematic analysis) methods.

DISCUSSION

Original research is urgently needed to design interventions to mitigate COVID-19 misinformation. The planned scoping review will help to address this gap.

SYSTEMATIC REVIEW REGISTRATIONS

Systematic Review Registration: Open Science Framework (osf/io/etw9d).

Examining the impact of sharing COVID-19 misinformation online on mental health

Misinformation about the COVID-19 pandemic proliferated widely on social media platforms during the course of the health crisis. Experts have speculated that consuming misinformation online can potentially worsen the mental health of individuals, by causing heightened anxiety, stress, and even suicidal ideation. The present study aims to quantify the causal relationship between sharing misinformation, a strong indicator of consuming misinformation, and experiencing exacerbated anxiety. We conduct a large-scale observational study spanning over 80 million Twitter posts made by 76,985 Twitter users during an 18.5 month period. The results from this study demonstrate that users who shared COVID-19 misinformation experienced approximately two times additional increase in anxiety when compared to similar users who did not share misinformation. Socio-demographic analysis reveals that women, racial minorities, and individuals with lower levels of education in the United States experienced a disproportionately higher increase in anxiety when compared to the other users. These findings shed light on the mental health costs of consuming online misinformation. The work bears practical implications for social media platforms in curbing the adverse psychological impacts of misinformation, while also upholding the ethos of an online public sphere.

COVID-19 vaccine perceptions in the initial phases of US vaccine roll-out: an observational study on reddit

Background

Open online forums like Reddit provide an opportunity to quantitatively examine COVID-19 vaccine perceptions early in the vaccine timeline. We examine COVID-19 misinformation on Reddit following vaccine scientific announcements, in the initial phases of the vaccine timeline.

Methods

We collected all posts on Reddit (reddit.com) from January 1 2020 - December 14 2020 (n=266,840) that contained both COVID-19 and vaccine-related keywords. We used topic modeling to understand changes in word prevalence within topics after the release of vaccine trial data. Social network analysis was also conducted to determine the relationship between Reddit communities (subreddits) that shared COVID-19 vaccine posts, and the movement of posts between subreddits.

Results

There was an association between a Pfizer press release reporting 90% efficacy and increased discussion on vaccine misinformation. We observed an association between Johnson and Johnson temporarily halting its vaccine trials and reduced misinformation. We found that information skeptical of vaccination was first posted in a subreddit (r/Coronavirus) which favored accurate information and then reposted in subreddits associated with antivaccine beliefs and conspiracy theories (e.g. conspiracy, NoNewNormal).

Conclusions

Our findings can inform the development of interventions where individuals determine the accuracy of vaccine information, and communications campaigns to improve COVID-19 vaccine perceptions, early in the vaccine timeline. Such efforts can increase individual- and population-level awareness of accurate and scientifically sound information regarding vaccines and thereby improve attitudes about vaccines, especially in the early phases of vaccine roll-out. Further research is needed to understand how social media can contribute to COVID-19 vaccination services.

Interventions to Mitigate Vaping Misinformation: A Meta-Analysis

The impact of misinformation about vapes' relative harms compared with smoking may lead to increased tobacco-related burden of disease and youth vaping. Unfortunately, vaping misinformation has proliferated. Despite growing attempts to mitigate vaping misinformation, there is still considerable ambiguity regarding the ability to effectively curb the negative impact of misinformation. To address this gap, we use a meta-analysis to evaluate the relative impact of interventions designed to mitigate vaping-related misinformation. We searched (from January 2020 till August 2021) various databases and gray literature. Only English language, original studies that employed experimental designs where participants were randomly assigned either to receive mitigating information or to a no-mitigation condition (either misinformation-only or neutral control) were included. Meta-analysis was conducted for the four eligible studies. The mean effect size of attempts to mitigate vaping misinformation was positive but not statistically significant (d = 0.383, 95% CI [-0.029, 0.796], p = .061, k = 5) with lack of evidence for publication bias. Given limited studies included, we were unable to determine factors affecting the efficacy of interventions. The limited focus on non-US studies and youth populations is concerning given the popularity of vaping in low- to middle-income countries (LMICs) and among youth. The findings of this meta-analysis describe the current state of the literature and prescribe specific recommendations to better address the proliferation of vaping misinformation, providing insights helpful in limiting the tobacco mortality burden and curtailing youth vaping.

Social Media Discussions Predict Mental Health Consultations on College Campuses

The mental health of college students is a growing concern, and gauging the mental health needs of college students is difficult to assess in real-time and in scale. To address this gap, researchers and practitioners have encouraged the use of passive technologies. Social media is one such "passive sensor" that has shown potential as a viable "passive sensor" of mental health. However, the construct validity and in-practice reliability of computational assessments of mental health constructs with social media data remain largely unexplored. Towards this goal, we study how assessing the mental health of college students using social media data correspond with ground-truth data of on-campus mental health consultations. For a large U.S. public university, we obtained ground-truth data of on-campus mental health consultations between 2011–2016, and collected 66,000 posts from the university’s Reddit community. We adopted machine learning and natural language methodologies to measure symptomatic mental health expressions of depression, anxiety, stress, suicidal ideation, and psychosis on the social media data. Seasonal auto-regressive integrated moving average (SARIMA) models of forecasting on-campus mental health consultations showed that incorporating social media data led to predictions with r = 0.86 and SMAPE = 13.30, outperforming models without social media data by 41%. Our language analyses revealed that social media discussions during high mental health consultations months consisted of discussions on academics and career, whereas months of low mental health consultations saliently show expressions of positive affect, collective identity, and socialization. This study reveals that social media data can improve our understanding of college students’ mental health, particularly their mental health treatment needs.

Characterizing and Identifying the Prevalence of Web-Based Misinformation Relating to Medication for Opioid Use Disorder: Machine Learning Approach

Background

Expanding access to and use of medication for opioid use disorder (MOUD) is a key component of overdose prevention. An important barrier to the uptake of MOUD is exposure to inaccurate and potentially harmful health misinformation on social media or web-based forums where individuals commonly seek information. There is a significant need to devise computational techniques to describe the prevalence of web-based health misinformation related to MOUD to facilitate mitigation efforts.

Objective

By adopting a multidisciplinary, mixed methods strategy, this paper aims to present machine learning and natural language analysis approaches to identify the characteristics and prevalence of web-based misinformation related to MOUD to inform future prevention, treatment, and response efforts.

Methods

The team harnessed public social media posts and comments in the English language from Twitter (6,365,245 posts), YouTube (99,386 posts), Reddit (13,483,419 posts), and Drugs-Forum (5549 posts). Leveraging public health expert annotations on a sample of 2400 of these social media posts that were found to be semantically most similar to a variety of prevailing opioid use disorder–related myths based on representational learning, the team developed a supervised machine learning classifier. This classifier identified whether a post’s language promoted one of the leading myths challenging addiction treatment: that the use of agonist therapy for MOUD is simply replacing one drug with another. Platform-level prevalence was calculated thereafter by machine labeling all unannotated posts with the classifier and noting the proportion of myth-indicative posts over all posts.

Results

Our results demonstrate promise in identifying social media postings that center on treatment myths about opioid use disorder with an accuracy of 91% and an area under the curve of 0.9, including how these discussions vary across platforms in terms of prevalence and linguistic characteristics, with the lowest prevalence on web-based health communities such as Reddit and Drugs-Forum and the highest on Twitter. Specifically, the prevalence of the stated MOUD myth ranged from 0.4% on web-based health communities to 0.9% on Twitter.

Conclusions

This work provides one of the first large-scale assessments of a key MOUD-related myth across multiple social media platforms and highlights the feasibility and importance of ongoing assessment of health misinformation related to addiction treatment.

Interventions to Mitigate COVID-19 Misinformation: A Systematic Review and Meta-Analysis

The duration and impact of the COVID-19 pandemic depends largely on individual and societal actions which are influenced by the quality and salience of the information to which they are exposed. Unfortunately, COVID-19 misinformation has proliferated. Despite growing attempts to mitigate COVID-19 misinformation, there is still uncertainty regarding the best way to ameliorate the impact of COVID-19 misinformation. To address this gap, the current study uses a meta-analysis to evaluate the relative impact of interventions designed to mitigate COVID-19-related misinformation. We searched multiple databases and gray literature from January 2020 to September 2021. The primary outcome was COVID-19 misinformation belief. We examined study quality and meta-analysis was used to pool data with similar interventions and outcomes. 16 studies were analyzed in the meta-analysis, including data from 33378 individuals. The mean effect size of interventions to mitigate COVID-19 misinformation was positive, but not statistically significant [d = 2.018, 95% CI (-0.14, 4.18), p = .065, k = 16]. We found evidence of publication bias. Interventions were more effective in cases where participants were involved with the topic, and where text-only mitigation was used. The limited focus on non-U.S. studies and marginalized populations is concerning given the greater COVID-19 mortality burden on vulnerable communities globally. The findings of this meta-analysis describe the current state of the literature and prescribe specific recommendations to better address the proliferation of COVID-19 misinformation, providing insights helpful to mitigating pandemic outcomes.

Detecting risk level in individuals misusing fentanyl utilizing posts from an online community on Reddit

INTRODUCTION

Opioid misuse is a public health crisis in the US, and misuse of synthetic opioids such as fentanyl have driven the most recent waves of opioid-related deaths. Because those who misuse fentanyl are often a hidden and high-risk group, innovative methods for identifying individuals at risk for fentanyl misuse are needed. Machine learning has been used in the past to investigate discussions surrounding substance use on Reddit, and this study leverages similar techniques to identify risky content from discussions of fentanyl on this platform.

METHODS

A codebook was developed by clinical domain experts with 12 categories indicative of fentanyl misuse risk, and this was used to manually label 391 Reddit posts and comments. Using this data, we built machine learning classification models to identify fentanyl risk.

RESULTS

Our machine learning risk model was able to detect posts or comments labeled as risky by our clinical experts with 76% accuracy and 76% sensitivity. Furthermore, we provide a vocabulary of community-specific, colloquial words for fentanyl and its analogues.

DISCUSSION

This study uses an interdisciplinary approach leveraging machine learning techniques and clinical domain expertise to automatically detect risky discourse, which may elicit and benefit from timely intervention. Moreover, our vocabulary of online terms for fentanyl and its analogues expands our understanding of online "street" nomenclature for opiates. Through an improved understanding of substance misuse risk factors, these findings allow for identification of risk concepts among those misusing fentanyl to inform outreach and intervention strategies tailored to this at-risk group.

Clinician Perspectives on Using Computational Mental Health Insights From Patients' Social Media Activities: Design and Qualitative Evaluation of a Prototype

BACKGROUND

Previous studies have suggested that social media data, along with machine learning algorithms, can be used to generate computational mental health insights. These computational insights have the potential to support clinician-patient communication during psychotherapy consultations. However, how clinicians perceive and envision using computational insights during consultations has been underexplored.

OBJECTIVE

The aim of this study is to understand clinician perspectives regarding computational mental health insights from patients' social media activities. We focus on the opportunities and challenges of using these insights during psychotherapy consultations.

METHODS

We developed a prototype that can analyze consented patients' Facebook data and visually represent these computational insights. We incorporated the insights into existing clinician-facing assessment tools, the Hamilton Depression Rating Scale and Global Functioning: Social Scale. The design intent is that a clinician will verbally interview a patient (eg, How was your mood in the past week?) while they reviewed relevant insights from the patient's social media activities (eg, number of depression-indicative posts). Using the prototype, we conducted interviews (n=15) and 3 focus groups (n=13) with mental health clinicians: psychiatrists, clinical psychologists, and licensed clinical social workers. The transcribed qualitative data were analyzed using thematic analysis.

RESULTS

Clinicians reported that the prototype can support clinician-patient collaboration in agenda-setting, communicating symptoms, and navigating patients' verbal reports. They suggested potential use scenarios, such as reviewing the prototype before consultations and using the prototype when patients missed their consultations. They also speculated potential negative consequences: patients may feel like they are being monitored, which may yield negative effects, and the use of the prototype may increase the workload of clinicians, which is already difficult to manage. Finally, our participants expressed concerns regarding the prototype: they were unsure whether patients' social media accounts represented their actual behaviors; they wanted to learn how and when the machine learning algorithm can fail to meet their expectations of trust; and they were worried about situations where they could not properly respond to the insights, especially emergency situations outside of clinical settings.

CONCLUSIONS

Our findings support the touted potential of computational mental health insights from patients' social media account data, especially in the context of psychotherapy consultations. However, sociotechnical issues, such as transparent algorithmic information and institutional support, should be addressed in future endeavors to design implementable and sustainable technology.

Predicting Participant Compliance With Fitness Tracker Wearing and Ecological Momentary Assessment Protocols in Information Workers: Observational Study

Background

Studies that use ecological momentary assessments (EMAs) or wearable sensors to track numerous attributes, such as physical activity, sleep, and heart rate, can benefit from reductions in missing data. Maximizing compliance is one method of reducing missing data to increase the return on the heavy investment of time and money into large-scale studies.

Objective

This paper aims to identify the extent to which compliance can be prospectively predicted from individual attributes and initial compliance.

Methods

We instrumented 757 information workers with fitness trackers for 1 year and conducted EMAs in the first 56 days of study participation as part of an observational study. Their compliance with the EMA and fitness tracker wearing protocols was analyzed. Overall, 31 individual characteristics (eg, demographics and personalities) and behavioral variables (eg, early compliance and study portal use) were considered, and 14 variables were selected to create beta regression models for predicting compliance with EMAs 56 days out and wearable compliance 1 year out. We surveyed study participation and correlated the results with compliance.

Results

Our modeling indicates that 16% and 25% of the variance in EMA compliance and wearable compliance, respectively, could be explained through a survey of demographics and personality in a held-out sample. The likelihood of higher EMA and wearable compliance was associated with being older (EMA: odds ratio [OR] 1.02, 95% CI 1.00-1.03; wearable: OR 1.02, 95% CI 1.01-1.04), speaking English as a first language (EMA: OR 1.38, 95% CI 1.05-1.80; wearable: OR 1.39, 95% CI 1.05-1.85), having had a wearable before joining the study (EMA: OR 1.25, 95% CI 1.04-1.51; wearable: OR 1.50, 95% CI 1.23-1.83), and exhibiting conscientiousness (EMA: OR 1.25, 95% CI 1.04-1.51; wearable: OR 1.34, 95% CI 1.14-1.58). Compliance was negatively associated with exhibiting extraversion (EMA: OR 0.74, 95% CI 0.64-0.85; wearable: OR 0.67, 95% CI 0.57-0.78) and having a supervisory role (EMA: OR 0.65, 95% CI 0.54-0.79; wearable: OR 0.66, 95% CI 0.54-0.81). Furthermore, higher wearable compliance was negatively associated with agreeableness (OR 0.68, 95% CI 0.56-0.83) and neuroticism (OR 0.85, 95% CI 0.73-0.98). Compliance in the second week of the study could help explain more variance; 62% and 66% of the variance in EMA compliance and wearable compliance, respectively, was explained. Finally, compliance correlated with participants’ self-reflection on the ease of participation, usefulness of our compliance portal, timely resolution of issues, and compensation adequacy, suggesting that these are avenues for improving compliance.

Conclusions

We recommend conducting an initial 2-week pilot to measure trait-like compliance and identify participants at risk of long-term noncompliance, performing oversampling based on participants’ individual characteristics to avoid introducing bias in the sample when excluding data based on noncompliance, using an issue tracking portal, and providing special care in troubleshooting to help participants maintain compliance.

Suicide Risk and Protective Factors in Online Support Forum Posts: Annotation Scheme Development and Validation Study

BACKGROUND

Online communities provide support for individuals looking for help with suicidal ideation and crisis. As community data are increasingly used to devise machine learning models to infer who might be at risk, there have been limited efforts to identify both risk and protective factors in web-based posts. These annotations can enrich and augment computational assessment approaches to identify appropriate intervention points, which are useful to public health professionals and suicide prevention researchers.

OBJECTIVE

This qualitative study aims to develop a valid and reliable annotation scheme for evaluating risk and protective factors for suicidal ideation in posts in suicide crisis forums.

METHODS

We designed a valid, reliable, and clinically grounded process for identifying risk and protective markers in social media data. This scheme draws on prior work on construct validity and the social sciences of measurement. We then applied the scheme to annotate 200 posts from r/SuicideWatch-a Reddit community focused on suicide crisis.

RESULTS

We documented our results on producing an annotation scheme that is consistent with leading public health information coding schemes for suicide and advances attention to protective factors. Our study showed high internal validity, and we have presented results that indicate that our approach is consistent with findings from prior work.

CONCLUSIONS

Our work formalizes a framework that incorporates construct validity into the development of annotation schemes for suicide risk on social media. This study furthers the understanding of risk and protective factors expressed in social media data. This may help public health programming to prevent suicide and computational social science research and investigations that rely on the quality of labels for downstream machine learning tasks.

Utilizing Instagram Data to Identify Usage Patterns Associated With Schizophrenia Spectrum Disorders

Background and Objectives: Prior research has successfully identified linguistic and behavioral patterns associated with schizophrenia spectrum disorders (SSD) from user generated social media activity. Few studies, however, have explored the potential for image analysis to inform psychiatric care for individuals with SSD. Given the popularity of image-based platforms, such as Instagram, investigating user generated image data could further strengthen associations between social media activity and behavioral health. Methods: We collected 11,947 Instagram posts across 68 participants (mean age = 23.6; 59% male) with schizophrenia spectrum disorders (SSD; n = 34) and healthy volunteers (HV; n = 34). We extracted image features including color composition, aspect ratio, and number of faces depicted. Additionally, we considered social connections and behavioral features. We explored differences in usage patterns between SSD and HV participants. Results: Individuals with SSD posted images with lower saturation (p = 0.033) and lower colorfulness (p = 0.005) compared to HVs, as well as images showing fewer faces on average (SSD = 1.5, HV = 2.4, p < 0.001). Further, individuals with SSD demonstrated a lower ratio of followers to following compared to HV participants (p = 0.025). Conclusion: Differences in uploaded images and user activity on Instagram were identified in individuals with SSD. These differences highlight potential digital biomarkers of SSD from Instagram data.

Understanding the Role of Social Media-Based Mental Health Support Among College Students: Survey and Semistructured Interviews

BACKGROUND

Mental illness is a growing concern within many college campuses. Limited access to therapy resources, along with the fear of stigma, often prevents students from seeking help. Introducing supportive interventions, coping strategies, and mitigation programs might decrease the negative effects of mental illness among college students.

OBJECTIVE

Many college students find social support for a variety of needs through social media platforms. With the pervasive adoption of social media sites in college populations, in this study, we examine whether and how these platforms may help meet college students' mental health needs.

METHODS

We first conducted a survey among 101 students, followed by semistructured interviews (n=11), of a large public university in the southeast region of the United States to understand whether, to what extent, and how students appropriate social media platforms to suit their struggle with mental health concerns. The interviews were intended to provide comprehensive information on students' attitudes and their perceived benefits and limitations of social media as platforms for mental health support.

RESULTS

Our survey revealed that a large number of participating students (71/101, 70.3%) had recently experienced some form of stress, anxiety, or other mental health challenges related to college life. Half of them (52/101, 51.5%) also reported having appropriated some social media platforms for self-disclosure or help, indicating the pervasiveness of this practice. Through our interviews, we obtained deeper insights into these initial observations. We identified specific academic, personal, and social life stressors; motivations behind social media use for mental health needs; and specific platform affordances that helped or hindered this use.

CONCLUSIONS

Students recognized the benefits of social media in helping connect with peers on campus and promoting informal and candid disclosures. However, they argued against complete anonymity in platforms for mental health help and advocated the need for privacy and boundary regulation mechanisms in social media platforms supporting this use. Our findings bear implications for informing campus counseling efforts and in designing social media-based mental health support tools for college students.

"Can I Not Be Suicidal on a Sunday?": Understanding Technology-Mediated Pathways to Mental Health Support

Individuals in distress adopt varied pathways in pursuit of care that aligns with their individual needs. Prior work has established that the first resource an individual leverages can influence later care and recovery, but less is understood about how the design of a point of care might interact with subsequent pathways to care. We investigate how the design of the Indian mental health helpline system interacts with complex sociocultural factors to marginalize caller needs. We draw on interviews with 18 helpline stakeholders, including individuals who have engaged with helplines in the past, shedding light on how they navigate both technological and structural barriers in pursuit of relief. Finally, we use a design justice framework rooted in Amartya Sen's conceptualization of realization-focused justice to discuss implications and present recommendations towards the design of technology-mediated points of mental health support.

A Review on Strategies for Data Collection, Reflection, and Communication in Eating Disorder Apps

Eating disorders (EDs) constitute a mental illness with the highest mortality. Today, mobile health apps provide promising means to ED patients for managing their condition. Apps enable users to monitor their eating habits, thoughts, and feelings, and offer analytic insights for behavior change. However, not only have scholars critiqued the clinical validity of these apps, their underlying design principles are not well understood. Through a review of 34 ED apps, we uncovered 11 different data types ED apps collect, and 9 strategies they employ to support collection and reflection. Drawing upon personal health informatics and visualization frameworks, we found that most apps did not adhere to best practices on what and how data should be collected from and reflected to users, or how data-driven insights should be communicated. Our review offers suggestions for improving the design of ED apps such that they can be useful and meaningful in ED recovery.

Understanding Side Effects of Antidepressants: Large-scale Longitudinal Study on Social Media Data

BACKGROUND

Antidepressants are known to show heterogeneous effects across individuals and conditions, posing challenges to understanding their efficacy in mental health treatment. Social media platforms enable individuals to share their day-to-day concerns with others and thereby can function as unobtrusive, large-scale, and naturalistic data sources to study the longitudinal behavior of individuals taking antidepressants.

OBJECTIVE

We aim to understand the side effects of antidepressants from naturalistic expressions of individuals on social media.

METHODS

On a large-scale Twitter data set of individuals who self-reported using antidepressants, a quasi-experimental study using unsupervised language analysis was conducted to extract keywords that distinguish individuals who improved and who did not improve following the use of antidepressants. The net data set consists of over 8 million Twitter posts made by over 300,000 users in a 4-year period between January 1, 2014, and February 15, 2018.

RESULTS

Five major side effects of antidepressants were studied: sleep, weight, eating, pain, and sexual issues. Social media language revealed keywords related to these side effects. In particular, antidepressants were found to show a spectrum of effects from decrease to increase in each of these side effects.

CONCLUSIONS

This work enhances the understanding of the side effects of antidepressants by identifying distinct linguistic markers in the longitudinal social media data of individuals showing the most and least improvement following the self-reported intake of antidepressants. One implication of this work concerns the potential of social media data as an effective means to support digital pharmacovigilance and digital therapeutics. These results can inform clinicians in tailoring their discussion and assessment of side effects and inform patients about what to potentially expect and what may or may not be within the realm of normal aftereffects of antidepressants.

Artificial Intelligence for Mental Health Care: Clinical Applications, Barriers, Facilitators, and Artificial Wisdom

Artificial intelligence (AI) is increasingly employed in health care fields such as oncology, radiology, and dermatology. However, the use of AI in mental health care and neurobiological research has been modest. Given the high morbidity and mortality in people with psychiatric disorders, coupled with a worsening shortage of mental health care providers, there is an urgent need for AI to help identify high-risk individuals and provide interventions to prevent and treat mental illnesses. While published research on AI in neuropsychiatry is rather limited, there is a growing number of successful examples of AI's use with electronic health records, brain imaging, sensor-based monitoring systems, and social media platforms to predict, classify, or subgroup mental illnesses as well as problems such as suicidality. This article is the product of a study group held at the American College of Neuropsychopharmacology conference in 2019. It provides an overview of AI approaches in mental health care, seeking to help with clinical diagnosis, prognosis, and treatment, as well as clinical and technological challenges, focusing on multiple illustrative publications. Although AI could help redefine mental illnesses more objectively, identify them at a prodromal stage, personalize treatments, and empower patients in their own care, it must address issues of bias, privacy, transparency, and other ethical concerns. These aspirations reflect human wisdom, which is more strongly associated than intelligence with individual and societal well-being. Thus, the future AI or artificial wisdom could provide technology that enables more compassionate and ethically sound care to diverse groups of people.

A Real-Time Eating Detection System for Capturing Eating Moments and Triggering Ecological Momentary Assessments to Obtain Further Context: System Development and Validation Study

BACKGROUND

Eating behavior has a high impact on the well-being of an individual. Such behavior involves not only when an individual is eating, but also various contextual factors such as with whom and where an individual is eating and what kind of food the individual is eating. Despite the relevance of such factors, most automated eating detection systems are not designed to capture contextual factors.

OBJECTIVE

The aims of this study were to (1) design and build a smartwatch-based eating detection system that can detect meal episodes based on dominant hand movements, (2) design ecological momentary assessment (EMA) questions to capture meal contexts upon detection of a meal by the eating detection system, and (3) validate the meal detection system that triggers EMA questions upon passive detection of meal episodes.

METHODS

The meal detection system was deployed among 28 college students at a US institution over a period of 3 weeks. The participants reported various contextual data through EMAs triggered when the eating detection system correctly detected a meal episode. The EMA questions were designed after conducting a survey study with 162 students from the same campus. Responses from EMAs were used to define exclusion criteria.

RESULTS

Among the total consumed meals, 89.8% (264/294) of breakfast, 99.0% (406/410) of lunch, and 98.0% (589/601) of dinner episodes were detected by our novel meal detection system. The eating detection system showed a high accuracy by capturing 96.48% (1259/1305) of the meals consumed by the participants. The meal detection classifier showed a precision of 80%, recall of 96%, and F1 of 87.3%. We found that over 99% (1248/1259) of the detected meals were consumed with distractions. Such eating behavior is considered "unhealthy" and can lead to overeating and uncontrolled weight gain. A high proportion of meals was consumed alone (680/1259, 54.01%). Our participants self-reported 62.98% (793/1259) of their meals as healthy. Together, these results have implications for designing technologies to encourage healthy eating behavior.

CONCLUSIONS

The presented eating detection system is the first of its kind to leverage EMAs to capture the eating context, which has strong implications for well-being research. We reflected on the contextual data gathered by our system and discussed how these insights can be used to design individual-specific interventions.

Development of a Machine Learning Model Using Multiple, Heterogeneous Data Sources to Estimate Weekly US Suicide Fatalities

Importance

Suicide is a leading cause of death in the US. However, official national statistics on suicide rates are delayed by 1 to 2 years, hampering evidence-based public health planning and decision-making.

Objective

To estimate weekly suicide fatalities in the US in near real time.

Design, Setting, and Participants

This cross-sectional national study used a machine learning pipeline to combine signals from several streams of real-time information to estimate weekly suicide fatalities in the US in near real time. This 2-phase approach first fits optimal machine learning models to each individual data stream and subsequently combines predictions made from each data stream via an artificial neural network. National-level US administrative data on suicide deaths, health services, and economic, meteorological, and online data were variously obtained from 2014 to 2017. Data were analyzed from January 1, 2014, to December 31, 2017.

Exposures

Longitudinal data on suicide-related exposures were obtained from multiple, heterogeneous streams: emergency department visits for suicide ideation and attempts collected via the National Syndromic Surveillance Program (2015-2017); calls to the National Suicide Prevention Lifeline (2014-2017); calls to US poison control centers for intentional self-harm (2014-2017); consumer price index and seasonality-adjusted unemployment rate, hourly earnings, home price index, and 3-month and 10-year yield curves from the Federal Reserve Economic Data (2014-2017); weekly daylight hours (2014-2017); Google and YouTube search trends related to suicide (2014-2017); and public posts on suicide on Reddit (2 314 533 posts), Twitter (9 327 472 tweets; 2015-2017), and Tumblr (1 670 378 posts; 2014-2017).

Main Outcomes and Measures

Weekly estimates of suicide fatalities in the US were obtained through a machine learning pipeline that integrated the above data sources. Estimates were compared statistically with actual fatalities recorded by the National Vital Statistics System.

Results

Combining information from multiple data streams, the machine learning method yielded estimates of weekly suicide deaths with high correlation to actual counts and trends (Pearson correlation, 0.811; P < .001), while estimating annual suicide rates with low error (0.55%).

Conclusions and Relevance

The proposed ensemble machine learning framework reduces the error for annual suicide rate estimation to less than one-tenth of that of current forecasting approaches that use only historical information on suicide deaths. These findings establish a novel approach for tracking suicide fatalities in near real time and provide the potential for an effective public health response such as supporting budgetary decisions or deploying interventions.

Psychosocial Effects of the COVID-19 Pandemic: Large-scale Quasi-Experimental Study on Social Media

BACKGROUND

The COVID-19 pandemic has caused several disruptions in personal and collective lives worldwide. The uncertainties surrounding the pandemic have also led to multifaceted mental health concerns, which can be exacerbated with precautionary measures such as social distancing and self-quarantining, as well as societal impacts such as economic downturn and job loss. Despite noting this as a "mental health tsunami", the psychological effects of the COVID-19 crisis remain unexplored at scale. Consequently, public health stakeholders are currently limited in identifying ways to provide timely and tailored support during these circumstances.

OBJECTIVE

Our study aims to provide insights regarding people's psychosocial concerns during the COVID-19 pandemic by leveraging social media data. We aim to study the temporal and linguistic changes in symptomatic mental health and support expressions in the pandemic context.

METHODS

We obtained about 60 million Twitter streaming posts originating from the United States from March 24 to May 24, 2020, and compared these with about 40 million posts from a comparable period in 2019 to attribute the effect of COVID-19 on people's social media self-disclosure. Using these data sets, we studied people's self-disclosure on social media in terms of symptomatic mental health concerns and expressions of support. We employed transfer learning classifiers that identified the social media language indicative of mental health outcomes (anxiety, depression, stress, and suicidal ideation) and support (emotional and informational support). We then examined the changes in psychosocial expressions over time and language, comparing the 2020 and 2019 data sets.

RESULTS

We found that all of the examined psychosocial expressions have significantly increased during the COVID-19 crisis-mental health symptomatic expressions have increased by about 14%, and support expressions have increased by about 5%, both thematically related to COVID-19. We also observed a steady decline and eventual plateauing in these expressions during the COVID-19 pandemic, which may have been due to habituation or due to supportive policy measures enacted during this period. Our language analyses highlighted that people express concerns that are specific to and contextually related to the COVID-19 crisis.

CONCLUSIONS

We studied the psychosocial effects of the COVID-19 crisis by using social media data from 2020, finding that people's mental health symptomatic and support expressions significantly increased during the COVID-19 period as compared to similar data from 2019. However, this effect gradually lessened over time, suggesting that people adapted to the circumstances and their "new normal." Our linguistic analyses revealed that people expressed mental health concerns regarding personal and professional challenges, health care and precautionary measures, and pandemic-related awareness. This study shows the potential to provide insights to mental health care and stakeholders and policy makers in planning and implementing measures to mitigate mental health risks amid the health crisis.

Identifying emerging mental illness utilizing search engine activity: A feasibility study

Mental illness often emerges during the formative years of adolescence and young adult development and interferes with the establishment of healthy educational, vocational, and social foundations. Despite the severity of symptoms and decline in functioning, the time between illness onset and receiving appropriate care can be lengthy. A method by which to objectively identify early signs of emerging psychiatric symptoms could improve early intervention strategies. We analyzed a total of 405,523 search queries from 105 individuals with schizophrenia spectrum disorders (SSD, N = 36), non-psychotic mood disorders (MD, N = 38) and healthy volunteers (HV, N = 31) utilizing one year's worth of data prior to the first psychiatric hospitalization. Across 52 weeks, we found significant differences in the timing (p<0.05) and frequency (p<0.001) of searches between individuals with SSD and MD compared to HV up to a year in advance of the first psychiatric hospitalization. We additionally identified significant linguistic differences in search content among the three groups including use of words related to sadness and perception, use of first and second person pronouns, and use of punctuation (all p<0.05). In the weeks before hospitalization, both participants with SSD and MD displayed significant shifts in search timing (p<0.05), and participants with SSD displayed significant shifts in search content (p<0.05). Our findings demonstrate promise for utilizing personal patterns of online search activity to inform clinical care.

Utilizing Machine Learning on Internet Search Activity to Support the Diagnostic Process and Relapse Detection in Young Individuals With Early Psychosis: Feasibility Study

BACKGROUND

Psychiatry is nearly entirely reliant on patient self-reporting, and there are few objective and reliable tests or sources of collateral information available to help diagnostic and assessment procedures. Technology offers opportunities to collect objective digital data to complement patient experience and facilitate more informed treatment decisions.

OBJECTIVE

We aimed to develop computational algorithms based on internet search activity designed to support diagnostic procedures and relapse identification in individuals with schizophrenia spectrum disorders.

METHODS

We extracted 32,733 time-stamped search queries across 42 participants with schizophrenia spectrum disorders and 74 healthy volunteers between the ages of 15 and 35 (mean 24.4 years, 44.0% male), and built machine-learning diagnostic and relapse classifiers utilizing the timing, frequency, and content of online search activity.

RESULTS

Classifiers predicted a diagnosis of schizophrenia spectrum disorders with an area under the curve value of 0.74 and predicted a psychotic relapse in individuals with schizophrenia spectrum disorders with an area under the curve of 0.71. Compared with healthy participants, those with schizophrenia spectrum disorders made fewer searches and their searches consisted of fewer words. Prior to a relapse hospitalization, participants with schizophrenia spectrum disorders were more likely to use words related to hearing, perception, and anger, and were less likely to use words related to health.

CONCLUSIONS

Online search activity holds promise for gathering objective and easily accessed indicators of psychiatric symptoms. Utilizing search activity as collateral behavioral health information would represent a major advancement in efforts to capitalize on objective digital data to improve mental health monitoring.

Designing a Clinician-Facing Tool for Using Insights From Patients' Social Media Activity: Iterative Co-Design Approach

BACKGROUND

Recent research has emphasized the need for accessing information about patients to augment mental health patients' verbal reports in clinical settings. Although it has not been introduced in clinical settings, computational linguistic analysis on social media has proved it can infer mental health attributes, implying a potential use as collateral information at the point of care. To realize this potential and make social media insights actionable to clinical decision making, the gaps between computational linguistic analysis on social media and the current work practices of mental health clinicians must be bridged.

OBJECTIVE

This study aimed to identify information derived from patients' social media data that can benefit clinicians and to develop a set of design implications, via a series of low-fidelity (lo-fi) prototypes, on how to deliver the information at the point of care.

METHODS

A team of clinical researchers and human-computer interaction (HCI) researchers conducted a long-term co-design activity for over 6 months. The needs-affordances analysis framework was used to refine the clinicians' potential needs, which can be supported by patients' social media data. On the basis of those identified needs, the HCI researchers iteratively created 3 different lo-fi prototypes. The prototypes were shared with both groups of researchers via a videoconferencing software for discussion and feedback. During the remote meetings, potential clinical utility, potential use of the different prototypes in a treatment setting, and areas of improvement were discussed.

RESULTS

Our first prototype was a card-type interface that supported treatment goal tracking. Each card included attribute levels: depression, anxiety, social activities, alcohol, and drug use. This version confirmed what types of information are helpful but revealed the need for a glanceable dashboard that highlights the trends of these information. As a result, we then developed the second prototype, an interface that shows the clinical state and trend. We found that focusing more on the changes since the last visit without visual representation can be more compatible with clinicians' work practices. In addition, the second phase of needs-affordances analysis identified 3 categories of information relevant to patients with schizophrenia: symptoms related to psychosis, symptoms related to mood and anxiety, and social functioning. Finally, we developed the third prototype, a clinical summary dashboard that showed changes from the last visit in plain texts and contrasting colors.

CONCLUSIONS

This exploratory co-design research confirmed that mental health attributes inferred from patients' social media data can be useful for clinicians, although it also revealed a gap between computational social media analyses and clinicians' expectations and conceptualizations of patients' mental health states. In summary, the iterative co-design process crystallized design directions for the future interface, including how we can organize and provide symptom-related information in a way that minimizes the clinicians' workloads.

Measuring Self-Esteem with Passive Sensing

Self-esteem encompasses how individuals evaluate themselves and is an important contributor to their success. Self-esteem has been traditionally measured using survey-based methodologies. However, surveys suffer from limitations such as retrospective recall and reporting biases, leading to a need for proactive measurement approaches. Our work uses smartphone sensors to predict self-esteem and is situated in a multimodal sensing study on college students for five weeks. We use theory-driven features, such as phone communications and physical activity to predict three dimensions, performance, social, and appearance self-esteem. We conduct statistical modeling including linear, ensemble, and neural network regression to measure self-esteem. Our best model predicts self-esteem with a high correlation (r) of 0.60 and low SMAPE of 7.26% indicating high predictive accuracy. We inspect the top features finding theoretical alignment; for example, social interaction significantly contributes to performance and appearance-based self-esteem, whereas, and physical activity is the most significant contributor towards social self-esteem. Our work reveals the efficacy of passive sensors for predicting self-esteem, and we situate our observations with literature and discuss the implications of our work for tailored interventions and improving wellbeing.

Methods in predictive techniques for mental health status on social media: a critical review

Social media is now being used to model mental well-being, and for understanding health outcomes. Computer scientists are now using quantitative techniques to predict the presence of specific mental disorders and symptomatology, such as depression, suicidality, and anxiety. This research promises great benefits to monitoring efforts, diagnostics, and intervention design for these mental health statuses. Yet, there is no standardized process for evaluating the validity of this research and the methods adopted in the design of these studies. We conduct a systematic literature review of the state-of-the-art in predicting mental health status using social media data, focusing on characteristics of the study design, methods, and research design. We find 75 studies in this area published between 2013 and 2018. Our results outline the methods of data annotation for mental health status, data collection and quality management, pre-processing and feature selection, and model selection and verification. Despite growing interest in this field, we identify concerning trends around construct validity, and a lack of reflection in the methods used to operationalize and identify mental health status. We provide some recommendations to address these challenges, including a list of proposed reporting standards for publications and collaboration opportunities in this interdisciplinary space.

A computational study of mental health awareness campaigns on social media

As public discourse continues to progress online, it is important for mental health advocates, public health officials, and other curious parties and stakeholders, ranging from researchers, to those affected by the issue, to be aware of the advancing new mediums in which the public can share content ranging from useful resources and self-help tips to personal struggles with respect to both illness and its stigmatization. A better understanding of this new public discourse on mental health, often framed as social media campaigns, can help perpetuate the allocation of sparse mental health resources, the need for educational awareness, and the usefulness of community, with an opportunity to reach those seeking help at the right moment. The objective of this study was to understand the nature of and engagement around mental health content shared on mental health campaigns, specifically #MyTipsForMentalHealth on Twitter around World Mental Health Awareness Day in 2017. We collected 14,217 Twitter posts from 10,805 unique users between September and October 2017 that contained the hashtag #MyTipsForMentalHealth. With the involvement of domain experts, we hand-labeled 700 posts and categorized them as (a) Fact, (b) Stigmatizing, (c) Inspirational, (d) Medical/Clinical Tip, (e) Resource Related, (f) Lifestyle or Social Tip or Personal View, and (g) Off Topic. After creating a "seed" machine learning classifier, we used both unsupervised and semi supervised methods to classify posts into the various expert identified topical categories. We also performed a content analysis to understand how information on different topics spread through social networks. Our support vector machine classification algorithm achieved a mean cross-validation accuracy of 0.81 and accuracy of 0.64 on unseen data. We found that inspirational Twitter posts were the most spread with a mean of 4.17 retweets, and stigmatizing content was second with a mean of 3.66 retweets. Classification of social media-related mental health interactions offers valuable insights on public sentiment as well as a window into the evolving world of online self-help and the varied resources within. Our results suggest an important role for social media-based peer support to not only guide information seekers to useful content and local resources but also illuminate the socially-insular aspects of stigmatization. However, our results also reflect the challenges of quantifying the heterogeneity of mental health content on social media and the need for novel machine learning methods customized to the challenges of the field.

A Social Media Study on the Effects of Psychiatric Medication Use

Understanding the effects of psychiatric medications during mental health treatment constitutes an active area of inquiry. While clinical trials help evaluate the effects of these medications, many trials suffer from a lack of generalizability to broader populations. We leverage social media data to examine psychopathological effects subject to self-reported usage of psychiatric medication. Using a list of common approved and regulated psychiatric drugs and a Twitter dataset of 300M posts from 30K individuals, we develop machine learning models to first assess effects relating to mood, cognition, depression, anxiety, psychosis, and suicidal ideation. Then, based on a stratified propensity score based causal analysis, we observe that use of specific drugs are associated with characteristic changes in an individual's psychopathology. We situate these observations in the psychiatry literature, with a deeper analysis of pre-treatment cues that predict treatment outcomes. Our work bears potential to inspire novel clinical investigations and to build tools for digital therapeutics.

Prevalence and Psychological Effects of Hateful Speech in Online College Communities

Background

Hateful speech bears negative repercussions and is particularly damaging in college communities. The efforts to regulate hateful speech on college campuses pose vexing socio-political problems, and the interventions to mitigate the effects require evaluating the pervasiveness of the phenomenon on campuses as well the impacts on students' psychological state.

Data and Methods

Given the growing use of social media among college students, we target the above issues by studying the online aspect of hateful speech in a dataset of 6 million Reddit comments shared in 174 college communities. To quantify the prevelence of hateful speech in an online college community, we devise College Hate Index (CHX). Next, we examine its distribution across the categories of hateful speech, behavior, class, disability, ethnicity, gender, physical appearance, race, religion, and sexual orientation. We then employ a causal-inference framework to study the psychological effects of hateful speech, particularly in the form of individuals' online stress expression. Finally, we characterize their psychological endurance to hateful speech by analyzing their language- their discriminatory keyword use, and their personality traits.

Results

We find that hateful speech is prevalent in college subreddits, and 25% of them show greater hateful speech than non-college subreddits. We also find that the exposure to hate leads to greater stress expression. However, everybody exposed is not equally affected; some show lower psychological endurance than others. Low endurance individuals are more vulnerable to emotional outbursts, and are more neurotic than those with higher endurance.

Discussion

Our work bears implications for policy-making and intervention efforts to tackle the damaging effects of online hateful speech in colleges. From technological perspective, our work caters to mental health support provisions on college campuses, and to moderation efforts in online college communities. In addition, given the charged aspect of speech dilemma, we highlight the ethical implications of our work. Our work lays the foundation for studying the psychological impacts of hateful speech in online communities in general, and situated communities in particular (the ones that have both an offline and an online analog).

Integrating Artificial and Human Intelligence in Complex, Sensitive Problem Domains: Experiences from Mental Health

This article presents a position highlighting the importance of combining artificial intelligence (AI) approaches with natural intelligence, in other words, involvement of humans. To do so, we specifically focus on problems of societal significance, stemming from complex, sensitive domains. We first discuss our prior work across a series of projects surrounding social media and mental health, and identify major themes wherein augmentation of AI systems and techniques with human feedback has been and can be fruitful and meaningful. We then conclude by noting the implications, in terms of opportunities as well as challenges, that can be drawn from our position, both relating to the specific domain of mental health, and those for AI researchers and practitioners.

A Social Media Based Examination of the Effects of Counseling Recommendations After Student Deaths on College Campuses

Student deaths on college campuses, whether brought about by a suicide or an uncontrollable incident, have serious repercussions for the mental wellbeing of students. Consequently, many campus administrators implement post-crisis intervention measures to promote student-centric mental health support. Information about these measures, which we refer to as "counseling recommendations", are often shared via electronic channels, including social media. However, the current ability to assess the effects of these recommendations on post-crisis psychological states is limited. We propose a causal analysis framework to examine the effects of these counseling recommendations after student deaths. We leverage a dataset from 174 Reddit campus communities and ~400M posts of ~350K users. Then we employ statistical modeling and natural language analysis to quantify the psychosocial shifts in behavioral, cognitive, and affective expression of grief in individuals who are "exposed" to (comment on) the counseling recommendations, compared to that in a matched control cohort. Drawing on crisis and psychology research, we find that the exposed individuals show greater grief, psycholinguistic, and social expressiveness, providing evidence of a healing response to crisis and thereby positive psychological effects of the counseling recommendations. We discuss the implications of our work in supporting post-crisis rehabilitation and intervention efforts on college campuses.

Summary of Key Issues Raised in the Technology for Early Awareness of Addiction and Mental Illness (TEAAM-I) Meeting

Technology provides an unparalleled opportunity to remove barriers to earlier identification and engagement in services for mental and addictive disorders by reaching people earlier in the course of illness and providing links to just-in-time, cost-effective interventions. Achieving this opportunity, however, requires stakeholders to challenge underlying assumptions about traditional pathways to mental health care. In this Open Forum, the authors highlight key issues discussed in the Technology for Early Awareness of Addiction and Mental Illness (TEAAM-I) meeting-held October 13-14, 2016, in New York City-that are related to three identified areas in which technology provides important and unique opportunities to advance early identification, increase service engagement, and decrease the duration of untreated mental and addictive disorders.

A Collaborative Approach to Identifying Social Media Markers of Schizophrenia by Employing Machine Learning and Clinical Appraisals

Background

Linguistic analysis of publicly available Twitter feeds have achieved success in differentiating individuals who self-disclose online as having schizophrenia from healthy controls. To date, limited efforts have included expert input to evaluate the authenticity of diagnostic self-disclosures.

Objective

This study aims to move from noisy self-reports of schizophrenia on social media to more accurate identification of diagnoses by exploring a human-machine partnered approach, wherein computational linguistic analysis of shared content is combined with clinical appraisals.

Methods

Twitter timeline data, extracted from 671 users with self-disclosed diagnoses of schizophrenia, was appraised for authenticity by expert clinicians. Data from disclosures deemed true were used to build a classifier aiming to distinguish users with schizophrenia from healthy controls. Results from the classifier were compared to expert appraisals on new, unseen Twitter users.

Results

Significant linguistic differences were identified in the schizophrenia group including greater use of interpersonal pronouns (P<.001), decreased emphasis on friendship (P<.001), and greater emphasis on biological processes (P<.001). The resulting classifier distinguished users with disclosures of schizophrenia deemed genuine from control users with a mean accuracy of 88% using linguistic data alone. Compared to clinicians on new, unseen users, the classifier’s precision, recall, and accuracy measures were 0.27, 0.77, and 0.59, respectively.

Conclusions

These data reinforce the need for ongoing collaborations integrating expertise from multiple fields to strengthen our ability to accurately identify and effectively engage individuals with mental illness online. These collaborations are crucial to overcome some of mental illnesses’ biggest challenges by using digital technology.

Characterizing Awareness of Schizophrenia Among Facebook Users by Leveraging Facebook Advertisement Estimates

Background

Schizophrenia is a rare but devastating condition, affecting about 1% of the world’s population and resulting in about 2% of the US health care expenditure. Major impediments to appropriate and timely care include misconceptions, high levels of stigma, and lack of public awareness. Facebook offers novel opportunities to understand public awareness and information access related to schizophrenia, and thus can complement survey-based approaches to assessing awareness that are limited in scale, robustness, and temporal and demographic granularity.

Objective

The aims of this study were to (1) construct an index that measured the awareness of different demographic groups around schizophrenia-related information on Facebook; (2) study how this index differed across demographic groups and how it correlated with complementary Web-based (Google Trends) and non–Web-based variables about population well-being (mental health indicators and infrastructure), and (3) examine the relationship of Facebook derived schizophrenia index with other types of online activity as well as offline health and mental health outcomes and indicators.

Methods

Data from Facebook’s advertising platform was programmatically collected to compute the proportion of users in a target demographic group with an interest related to schizophrenia. On consultation with a clinical expert, several topics were combined to obtain a single index measuring schizophrenia awareness. This index was then analyzed for differences across US states, gender, age, ethnic affinity, and education level. A statistical approach was developed to model a group’s awareness index based on the group’s characteristics.

Results

Overall, 1.03% of Facebook users in the United States have a schizophrenia-related interest. The schizophrenia awareness index (SAI) is higher for females than for males (1.06 vs 0.97, P<.001), and it is highest for the people who are aged 25-44 years (1.35 vs 1.03 for all ages, P<.001). The awareness index drops for higher education levels (0.68 for MA or PhD vs 1.92 for no high school degree, P<.001), and Hispanics have the highest level of interest (1.57 vs 1.03 for all ethnic affinities, P<.001). A regression model fit to predict a group’s interest level achieves an adjusted R²=0.55. We also observe a positive association between our SAI and mental health services (or institutions) per 100,000 residents in a US state (Pearson r=.238, P<.001), but a negative association with the state-level human development index (HDI) in United States (Pearson r=−.145, P<.001) and state-level volume of mental health issues in United States (Pearson r=−.145, P<.001).

Conclusions

Facebook’s advertising platform can be used to construct a plausible index of population-scale schizophrenia awareness. However, only estimates of awareness can be obtained, and the index provides no information on the quality of the information users receive online.

A Social Media Based Index of Mental Well-Being in College Campuses

Psychological distress in the form of depression, anxiety and other mental health challenges among college students is a growing health concern. Dearth of accurate, continuous, and multi-campus data on mental well-being presents significant challenges to intervention and mitigation efforts in college campuses. We examine the potential of social media as a new "barometer" for quantifying the mental well-being of college populations. Utilizing student-contributed data in Reddit communities of over 100 universities, we first build and evaluate a transfer learning based classification approach that can detect mental health expressions with 97% accuracy. Thereafter, we propose a robust campus-specific Mental Well-being Index: MWI. We find that MWI is able to reveal meaningful temporal patterns of mental well-being in campuses, and to assess how their expressions relate to university attributes like size, academic prestige, and student demographics. We discuss the implications of our work for improving counselor efforts, and in the design of tools that can enable better assessment of the mental health climate of college campuses.

The Language of Social Support in Social Media and its Effect on Suicidal Ideation Risk

Online social support is known to play a significant role in mental well-being. However, current research is limited in its ability to quantify this link. Challenges exist due to the paucity of longitudinal, pre- and post mental illness risk data, and reliable methods that can examine causality between past availability of support and future risk. In this paper, we propose a method to measure how the language of comments in Reddit mental health communities influences risk to suicidal ideation in the future. Incorporating human assessments in a stratified propensity score analysis based framework, we identify comparable subpopulations of individuals and measure the effect of online social support language. We interpret these linguistic cues with an established theoretical model of social support, and find that esteem and network support play a more prominent role in reducing forthcoming risk. We discuss the implications of our work for designing tools that can improve support provisions in online communities.