PREDOSE: a semantic web platform for drug abuse epidemiology using social media

"Pressed OXY M30 Pills, Great Press, Potent, Fast Shipping!!!": Availability of Counterfeit and Pharmaceutical Oxycodone Pills on One Major Cryptomarket

From 2018 to 2021, seizures of counterfeit oxycodone pills containing non-pharmaceutical fentanyl or other novel synthetic opioids increased significantly contributing to continuing increases in overdose mortality in Northern America. Evidence suggests that counterfeit pills are distributed through cryptomarkets. This article presents data regarding the availability and characteristics of oxycodone pills advertised on one major cryptomarket between January and March 2022. Collected data were processed using a dedicated Named Entity Recognition algorithm to identify oxycodone listings and categorized them as either counterfeit or pharmaceutical. Frequency of listings, average number of pills advertised, average prices per milligram, number of sales, and geographic indicators of shipment origin and destination were analyzed. In total, 2,665 listings were identified as oxycodone. 48.2% (1,285/2,665) of these listings were categorized as counterfeit oxycodone, advertising a total of 652,699 pills (93,242.7 pills per datapoint) offered at a lower price than pharmaceutical pills. Our data indicate the presence of a large volume of counterfeit oxycodone pills both in retail- and wholesale-level amounts mostly targeting US and Canadian customers. These exploratory findings call for more research to develop epidemiological surveillance systems to track counterfeit pill and other drug availability on the Dark web environment.

Identifying drivers of COVID-19 vaccine sentiments for effective vaccination policy

The COVID-19 pandemic has had far-reaching consequences globally, including a significant loss of lives, escalating unemployment rates, economic instability, deteriorating mental well-being, social conflicts, and even political discord. Vaccination, recognized as a pivotal measure in mitigating the adverse effects of COVID-19, has evoked a diverse range of sentiments worldwide. In particular, numerous users on social media platforms have expressed concerns regarding vaccine availability and potential side effects. Therefore, it is imperative for governmental authorities and senior health policy strategists to gain insights into the public's perspectives on vaccine mandates in order to effectively implement their vaccination initiatives. Despite the critical importance of comprehending the underlying factors influencing COVID-19 vaccine sentiment, the existing literature offers limited research studies on this subject matter. This paper presents an innovative methodology that harnesses Twitter data to extract sentiment pertaining to COVID-19 vaccination through the utilization of Artificial Intelligence techniques such as sentiment analysis, entity detection, linear regression, and logistic regression. The proposed methodology was applied and tested on live Twitter feeds containing COVID-19 vaccine-related tweets, spanning from February 14, 2021, to April 2, 2023. Notably, this approach successfully processed tweets in 45 languages originating from over 100 countries, enabling users to select from an extensive scenario space of approximately 3.55 × 10249 possible scenarios. By selecting specific scenarios, the proposed methodology effectively identified numerous determinants contributing to vaccine sentiment across iOS, Android, and Windows platforms. In comparison to previous studies documented in the existing literature, the presented solution emerges as the most robust in detecting the fundamental drivers of vaccine sentiment and demonstrates the vaccination sentiments over a substantially longer period exceeding 24 months.

Methods for Analyzing the Contents of Social Media for Health Care: Scoping Review

BACKGROUND

Given the rapid development of social media, effective extraction and analysis of the contents of social media for health care have attracted widespread attention from health care providers. As far as we know, most of the reviews focus on the application of social media, and there is a lack of reviews that integrate the methods for analyzing social media information for health care.

OBJECTIVE

This scoping review aims to answer the following 4 questions: (1) What types of research have been used to investigate social media for health care, (2) what methods have been used to analyze the existing health information on social media, (3) what indicators should be applied to collect and evaluate the characteristics of methods for analyzing the contents of social media for health care, and (4) what are the current problems and development directions of methods used to analyze the contents of social media for health care?

METHODS

A scoping review following Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines was conducted. We searched PubMed, the Web of Science, EMBASE, the Cumulative Index to Nursing and Allied Health Literature, and the Cochrane Library for the period from 2010 to May 2023 for primary studies focusing on social media and health care. Two independent reviewers screened eligible studies against inclusion criteria. A narrative synthesis of the included studies was conducted.

RESULTS

Of 16,161 identified citations, 134 (0.8%) studies were included in this review. These included 67 (50.0%) qualitative designs, 43 (32.1%) quantitative designs, and 24 (17.9%) mixed methods designs. The applied research methods were classified based on the following aspects: (1) manual analysis methods (content analysis methodology, grounded theory, ethnography, classification analysis, thematic analysis, and scoring tables) and computer-aided analysis methods (latent Dirichlet allocation, support vector machine, probabilistic clustering, image analysis, topic modeling, sentiment analysis, and other natural language processing technologies), (2) categories of research contents, and (3) health care areas (health practice, health services, and health education).

CONCLUSIONS

Based on an extensive literature review, we investigated the methods for analyzing the contents of social media for health care to determine the main applications, differences, trends, and existing problems. We also discussed the implications for the future. Traditional content analysis is still the mainstream method for analyzing social media content, and future research may be combined with big data research. With the progress of computers, mobile phones, smartwatches, and other smart devices, social media information sources will become more diversified. Future research can combine new sources, such as pictures, videos, and physiological signals, with online social networking to adapt to the development trend of the internet. More medical information talents need to be trained in the future to better solve the problem of network information analysis. Overall, this scoping review can be useful for a large audience that includes researchers entering the field.

Comparison of relative areas of interest between major depression disorder and postpartum depression

INTRODUCTION

Postpartum depression (PPD) is defined as a major depressive disorder (MDD) beginning after childbirth. Wide debates aim to better understand PPD's specificities compared with MDD. One of the keys in differentiating PPD from MDD is to systematically study scientific "Areas Of Interest" (AOIs) of these disorders.

METHODS

In November 2021, we performed an extraction and textual computational analysis of associated terms for PPD and MDD, using the biomedical database PubMed. We performed an undirected lexical network analysis to map the 150 first terms in space. Then, we used an unsupervised machine learning technique to detect word patterns and automatically cluster AOIs with a topic-modeling analysis.

RESULTS

We identified 30,000 articles of the 554,724 articles for MDD and 15,642 articles for PPD. Four AOIs were detected in the MDD network: mood disorders and their treatments, risk factors, consequences and quality of life, and mental health and comorbidities. Five AOIs were detected in the PPD network: mood disorders and treatments, risk factors, consequences and child health, patient's background, and the challenges of screening.

DISCUSSION AND CONCLUSION

Limitations are both methodological, in particular due to the qualitative interpretation of AOIs, and are also related to the difficult transferability of these research results to the clinical practice. The partial overlap between AOIs for MDD and for PPD suggest that the latter is a particular form of the former.

Precision information extraction for rare disease epidemiology at scale

BACKGROUND

The United Nations recently made a call to address the challenges of an estimated 300 million persons worldwide living with a rare disease through the collection, analysis, and dissemination of disaggregated data. Epidemiologic Information (EI) regarding prevalence and incidence data of rare diseases is sparse and current paradigms of identifying, extracting, and curating EI rely upon time-intensive, error-prone manual processes. With these limitations, a clear understanding of the variation in epidemiology and outcomes for rare disease patients is hampered. This challenges the public health of rare diseases patients through a lack of information necessary to prioritize research, policy decisions, therapeutic development, and health system allocations.

METHODS

In this study, we developed a newly curated epidemiology corpus for Named Entity Recognition (NER), a deep learning framework, and a novel rare disease epidemiologic information pipeline named EpiPipeline4RD consisting of a web interface and Restful API. For the corpus creation, we programmatically gathered a representative sample of rare disease epidemiologic abstracts, utilized weakly-supervised machine learning techniques to label the dataset, and manually validated the labeled dataset. For the deep learning framework development, we fine-tuned our dataset and adapted the BioBERT model for NER. We measured the performance of our BioBERT model for epidemiology entity recognition quantitatively with precision, recall, and F1 and qualitatively through a comparison with Orphanet. We demonstrated the ability for our pipeline to gather, identify, and extract epidemiology information from rare disease abstracts through three case studies.

RESULTS

We developed a deep learning model to extract EI with overall F1 scores of 0.817 and 0.878, evaluated at the entity-level and token-level respectively, and which achieved comparable qualitative results to Orphanet's collection paradigm. Additionally, case studies of the rare diseases Classic homocystinuria, GRACILE syndrome, Phenylketonuria demonstrated the adequate recall of abstracts with epidemiology information, high precision of epidemiology information extraction through our deep learning model, and the increased efficiency of EpiPipeline4RD compared to a manual curation paradigm.

CONCLUSIONS

EpiPipeline4RD demonstrated high performance of EI extraction from rare disease literature to augment manual curation processes. This automated information curation paradigm will not only effectively empower development of the NIH Genetic and Rare Diseases Information Center (GARD), but also support the public health of the rare disease community.

Informatics Research on Mental Health Functioning: Decision Support for the Social Security Administration Disability Program

The disability determination process of the Social Security Administration's (SSA's) disability program requires assessing work-related functioning for individual claimants alleging disability due to mental impairment. This task is particularly challenging because the determination process involves the review of a large file of information, including objective medical evidence and self-reports from claimants, families, and former employers. To improve this decision-making process, SSA entered an interagency agreement with the Rehabilitation Medicine Department, Epidemiology and Biostatistics Section, in the Clinical Center of the National Institutes of Health, intending to use data science and informatics to develop decision support tools. This collaborative effort over the past decade has led to the development of the Work Disability-Functional Assessment Battery and has initiated an approach to applying natural language processing to the review of claimants' files for information on mental health functioning. This informatics research collaboration holds promise for improving the process of disability determination for individuals with mental impairments who make claims at the SSA.

Automating Global Threat-Maps Generation via Advancements of News Sensors and AI

Negative events are prevalent all over the globe round the clock. People demonstrate psychological affinity to negative events, and they incline to stay away from troubled locations. This paper proposes an automated geospatial imagery application that would allow a user to remotely extract knowledge of troubled locations. The autonomous application uses thousands of connected news sensors to obtain real-time news pertaining to all global troubles. From the captured news, the proposed application uses artificial intelligence-based services and algorithms like sentiment analysis, entity detection, geolocation decoder, news fidelity analysis, and decomposition tree analysis to reconstruct global threat maps representing troubled locations interactively. The fully deployed system was evaluated for full three months of summer 2021, during which the autonomous system processed above 22 k news from 2397 connected news sources involving BBC, CNN, NY Times, Government websites of 192 countries, and all possible major social media sites. The study revealed 11,668 troubled locations classified successfully with outstanding precision, recall, and F1-score, all evaluated in ubiquitous environment covering mobile, tablet, desktop, and cloud platforms. The system generated interesting global threat maps for robust scenario set of $$3.71 \times {10}^{29}$$ 3.71 × 10 29 , to be reported as original fully autonomous remote sensing application of this kind. The research discloses attractive news and global threat-maps with trusted overall classification accuracy.

Methods to Generate Innovative Research Ideas and Improve Patient and Public Involvement in Modern Epidemiological Research: Review, Patient Viewpoint, and Guidelines for Implementation of a Digital Cohort Study

Background

Patient and public involvement (PPI) in research aims to increase the quality and relevance of research by incorporating the perspective of those ultimately affected by the research. Despite these potential benefits, PPI is rarely included in epidemiology protocols.

Objective

The aim of this study is to provide an overview of methods used for PPI and offer practical recommendations for its efficient implementation in epidemiological research.

Methods

We conducted a review on PPI methods. We mirrored it with a patient advocate’s viewpoint about PPI. We then identified key steps to optimize PPI in epidemiological research based on our review and the viewpoint of the patient advocate, taking into account the identification of barriers to, and facilitators of, PPI. From these, we provided practical recommendations to launch a patient-centered cohort study. We used the implementation of a new digital cohort study as an exemplary use case.

Results

We analyzed data from 97 studies, of which 58 (60%) were performed in the United Kingdom. The most common methods were workshops (47/97, 48%); surveys (33/97, 34%); meetings, events, or conferences (28/97, 29%); focus groups (25/97, 26%); interviews (23/97, 24%); consensus techniques (8/97, 8%); James Lind Alliance consensus technique (7/97, 7%); social media analysis (6/97, 6%); and experience-based co-design (3/97, 3%). The viewpoint of a patient advocate showed a strong interest in participating in research. The most usual PPI modalities were research ideas (60/97, 62%), co-design (42/97, 43%), defining priorities (31/97, 32%), and participation in data analysis (25/97, 26%). We identified 9 general recommendations and 32 key PPI-related steps that can serve as guidelines to increase the relevance of epidemiological studies.

Conclusions

PPI is a project within a project that contributes to improving knowledge and increasing the relevance of research. PPI methods are mainly used for idea generation. On the basis of our review and case study, we recommend that PPI be included at an early stage and throughout the research cycle and that methods be combined for generation of new ideas. For e-cohorts, the use of digital tools is essential to scale up PPI. We encourage investigators to rely on our practical recommendations to extend PPI in future epidemiological studies.

Full-Abstract Biomedical Relation Extraction with Keyword-Attentive Domain Knowledge Infusion

Relation extraction (RE) is an essential task in natural language processing. Given a context, RE aims to classify an entity-mention pair into a set of pre-defined relations. In the biomedical field, building an efficient and accurate RE system is critical for the construction of a domain knowledge base to support upper-level applications. Recent advances have witnessed a focus shift from sentence to document-level RE problems, which are more challenging due to the need for inter- and intra-sentence semantic reasoning. This type of distant dependency is difficult to understand and capture for a learning algorithm. To address the challenge, prior efforts either attempted to improve the cross sentence text representation or infuse domain or local knowledge into the model. Both strategies demonstrated efficacy on various datasets. In this paper, a keyword-attentive knowledge infusion strategy is proposed and integrated into BioBERT. A domain keyword collection mechanism is developed to discover the most relation-suggestive word tokens for bio-entities in a given context. By manipulating the attention masks, the model can be guided to focus on the semantic interaction between bio-entities linked by the keywords. We validated the proposed method on the Biocreative V Chemical Disease Relation dataset with an F1 of 75.6%, outperforming the state-of-the-art by 5.6%.

What About Drug Checking? Systematic Review and Netnographic Analysis of Social Media

Drug checking services have been operating worldwide as a harm reduction tool in places like festivals and night clubs. A systematic review and netnographic analysis were conducted to explore the public’s perception of drug checking. Although public perceptions of drug checking had not previously been evaluated in the literature, some positive and negative perceptions were captured. From twitter, a total of 1316 tweets were initially identified. Following the removal of irrelevant tweets, 235 relevant tweets were identified, of which about 95% (n = 223) tweets were in favour, and about 5% (n = 12) were not in favour of drug checking as a harm reduction intervention. Tweets perceived the service as part of effective law reform, public health intervention that serves in raising awareness and countering the role of the internet, initiative to reduce drug related harms and/ or potentially deaths, help in identifying Novel drug trends related to drugs, enabling a scientific basis to capture data, reducing harm from risky drugs or risky consumption, reducing the economic and social burden on society and preventing young people from having criminal records and punitive fines. Drug checking was perceived to support engagement with treatment services and support individuals in making more informed decisions. Tweets against drug checking focussed on the concerns over the quality of drug checking, particularly with false-positive results, which may lead to punitive outcomes, discrimination, and prejudice. The present study showed that twitter can be a useful platform to capture people’s perceptions of drug checking.

COVID-19 Pandemic Impact on Substance Misuse: A Social Media Listening, Mixed Method Analysis

The restrictive measures adopted during the COVID-19 pandemic modified some previously consolidated drug use patterns. A focus on social networks allowed drug users to discuss, share opinions and provide advice during a worldwide emergency context. In order to explore COVID-19-related implications on drug trends/behaviour and on most popular psychotropic substances debated, the focus here was on the constantly updated, very popular, Reddit social platform’s posts and comments. A quantitative and qualitative analysis of r/Drugs and related subreddits, using a social media listening netnographic approach, was carried out. The post/comments analysed covered the time-frame December 2019–May 2020. Between December 2019 and May 2020, the number of whole r/Drugs subreddit members increased from 619,563 to 676,581 members, respectively, thus increasing by 9.2% by the end of the data collection. Both the top-level r/Drugs subreddit and 92 related subreddits were quantitatively analysed, with posts/comments related to 12 drug categories. The drugs most frequently commented on included cannabinoids, psychedelics, opiates/opioids, alcohol, stimulants and prescribed medications. The qualitative analysis was carried out focussing on four subreddits, relating to some 1685 posts and 3263 comments. Four main themes of discussion (e.g., lockdown-associated immunity and drug intake issues; drug-related behaviour/after-quarantine plans’ issues; lockdown-related psychopathological issues; and peer-to-peer advice at the time of COVID-19) and four categories of Redditors (e.g., those continuing the use of drugs despite the pandemic; the “couch epidemiologists”; the conspirationists/pseudo-science influencers; and the recovery-focused users) were tentatively identified here. A mixed-methods, social network-based analysis provided a range of valuable information on Redditors’ drug use/behaviour during the first phase of the COVID-19 pandemic. Further studies should be carried out focusing on other social networks as well as later phases of the pandemic.

Characterization of time-variant and time-invariant assessment of suicidality on Reddit using C-SSRS

Suicide is the 10th leading cause of death in the U.S (1999-2019). However, predicting when someone will attempt suicide has been nearly impossible. In the modern world, many individuals suffering from mental illness seek emotional support and advice on well-known and easily-accessible social media platforms such as Reddit. While prior artificial intelligence research has demonstrated the ability to extract valuable information from social media on suicidal thoughts and behaviors, these efforts have not considered both severity and temporality of risk. The insights made possible by access to such data have enormous clinical potential-most dramatically envisioned as a trigger to employ timely and targeted interventions (i.e., voluntary and involuntary psychiatric hospitalization) to save lives. In this work, we address this knowledge gap by developing deep learning algorithms to assess suicide risk in terms of severity and temporality from Reddit data based on the Columbia Suicide Severity Rating Scale (C-SSRS). In particular, we employ two deep learning approaches: time-variant and time-invariant modeling, for user-level suicide risk assessment, and evaluate their performance against a clinician-adjudicated gold standard Reddit corpus annotated based on the C-SSRS. Our results suggest that the time-variant approach outperforms the time-invariant method in the assessment of suicide-related ideations and supportive behaviors (AUC:0.78), while the time-invariant model performed better in predicting suicide-related behaviors and suicide attempt (AUC:0.64). The proposed approach can be integrated with clinical diagnostic interviews for improving suicide risk assessments.

Monitoring drug trends in the digital environment-New methods, challenges and the opportunities provided by automated approaches

Developments in information technology have impacted on all areas of modern life and in particular facilitated the growth of globalisation in commerce and communication. Within the drugs area this means that both drugs discourse and drug markets have become increasingly digitally enabled. In response to this, new methods are being developed that attempt to research and monitor the digital environment. In this commentary we present three case studies of innovative approaches and related challenges to software-automated data mining of the digital environment: (i) an e-shop finder to detect e-shops offering new psychoactive substances, (ii) scraping of forum data from online discussion boards, (iii) automated sentiment analysis of discussions in online discussion boards. We conclude that the work presented brings opportunities in terms of leveraging data for developing a more timely and granular understanding of the various aspects of drug-use phenomena in the digital environment. In particular, combining the number of e-shops, discussion posts, and sentiments regarding particular substances could be used for ad hoc risk assessments as well as longitudinal drug monitoring and indicate "online popularity". The main challenges of digital data mining involve data representativity and ethical considerations.

"When they say weed causes depression, but it's your fav antidepressant": Knowledge-aware attention framework for relationship extraction

With the increasing legalization of medical and recreational use of cannabis, more research is needed to understand the association between depression and consumer behavior related to cannabis consumption. Big social media data has potential to provide deeper insights about these associations to public health analysts. In this interdisciplinary study, we demonstrate the value of incorporating domain-specific knowledge in the learning process to identify the relationships between cannabis use and depression. We develop an end-to-end knowledge infused deep learning framework (Gated-K-BERT) that leverages the pre-trained BERT language representation model and domain-specific declarative knowledge source (Drug Abuse Ontology) to jointly extract entities and their relationship using gated fusion sharing mechanism. Our model is further tailored to provide more focus to the entities mention in the sentence through entity-position aware attention layer, where ontology is used to locate the target entities position. Experimental results show that inclusion of the knowledge-aware attentive representation in association with BERT can extract the cannabis-depression relationship with better coverage in comparison to the state-of-the-art relation extractor.

Exploring the Association Between the "Big Five" Personality Traits and Fatal Opioid Overdose: County-Level Empirical Analysis

BACKGROUND

Opioid-related deaths constitute a problem of pandemic proportions in the United States, with no clear solution in sight. Although addressing addiction-the heart of this problem-ought to remain a priority for health practitioners, examining the community-level psychological factors with a known impact on health behaviors may provide valuable insights for attenuating this health crisis by curbing risky behaviors before they evolve into addiction.

OBJECTIVE

The goal of this study is twofold: to demonstrate the relationship between community-level psychological traits and fatal opioid overdose both theoretically and empirically, and to provide a blueprint for using social media data to glean these psychological factors in a real-time, reliable, and scalable manner.

METHODS

We collected annual panel data from Twitter for 2891 counties in the United States between 2014-2016 and used a novel data mining technique to obtain average county-level "Big Five" psychological trait scores. We then performed interval regression, using a control function to alleviate omitted variable bias, to empirically test the relationship between county-level psychological traits and the prevalence of fatal opioid overdoses in each county.

RESULTS

After controlling for a wide range of community-level biopsychosocial factors related to health outcomes, we found that three of the operationalizations of the five psychological traits examined at the community level in the study were significantly associated with fatal opioid overdoses: extraversion (β=.308, P<.001), neuroticism (β=.248, P<.001), and conscientiousness (β=.229, P<.001).

CONCLUSIONS

Analyzing the psychological characteristics of a community can be a valuable tool in the local, state, and national fight against the opioid pandemic. Health providers and community health organizations can benefit from this research by evaluating the psychological profile of the communities they serve and assessing the projected risk of fatal opioid overdose based on the relationships our study predict when making decisions for the allocation of overdose-reversal medication and other vital resources.

Mining social media for prescription medication abuse monitoring: a review and proposal for a data-centric framework

Objective

Prescription medication (PM) misuse and abuse is a major health problem globally, and a number of recent studies have focused on exploring social media as a resource for monitoring nonmedical PM use. Our objectives are to present a methodological review of social media–based PM abuse or misuse monitoring studies, and to propose a potential generalizable, data-centric processing pipeline for the curation of data from this resource.

Materials and Methods

We identified studies involving social media, PMs, and misuse or abuse (inclusion criteria) from Medline, Embase, Scopus, Web of Science, and Google Scholar. We categorized studies based on multiple characteristics including but not limited to data size; social media source(s); medications studied; and primary objectives, methods, and findings.

Results

A total of 39 studies met our inclusion criteria, with 31 (∼79.5%) published since 2015. Twitter has been the most popular resource, with Reddit and Instagram gaining popularity recently. Early studies focused mostly on manual, qualitative analyses, with a growing trend toward the use of data-centric methods involving natural language processing and machine learning.

Discussion

There is a paucity of standardized, data-centric frameworks for curating social media data for task-specific analyses and near real-time surveillance of nonmedical PM use. Many existing studies do not quantify human agreements for manual annotation tasks or take into account the presence of noise in data.

Conclusion

The development of reproducible and standardized data-centric frameworks that build on the current state-of-the-art methods in data and text mining may enable effective utilization of social media data for understanding and monitoring nonmedical PM use.

Utilizing deep learning and graph mining to identify drug use on Twitter data

Background

The collection and examination of social media has become a useful mechanism for studying the mental activity and behavior tendencies of users. Through the analysis of a collected set of Twitter data, a model will be developed for predicting positively referenced, drug-related tweets. From this, trends and correlations can be determined.

Methods

Social media data (tweets and attributes) were collected and processed using topic pertaining keywords, such as drug slang and use-conditions (methods of drug consumption). Potential candidates were preprocessed resulting in a dataset of 3,696,150 rows. The predictive classification power of multiple methods was compared including SVM, XGBoost, BERT and CNN-based classifiers. For the latter, a deep learning approach was implemented to screen and analyze the semantic meaning of the tweets.

Results

To test the predictive capability of the model, SVM and XGBoost were first employed. The results calculated from the models respectively displayed an accuracy of 59.33% and 54.90%, with AUC’s of 0.87 and 0.71. The values show a low predictive capability with little discrimination. Conversely, the CNN-based classifiers presented a significant improvement, between the two models tested. The first was trained with 2661 manually labeled samples, while the other included synthetically generated tweets culminating in 12,142 samples. The accuracy scores were 76.35% and 82.31%, with an AUC of 0.90 and 0.91. Using association rule mining in conjunction with the CNN-based classifier showed a high likelihood for keywords such as “smoke”, “cocaine”, and “marijuana” triggering a drug-positive classification.

Conclusion

Predictive analysis with a CNN is promising, whereas attribute-based models presented little predictive capability and were not suitable for analyzing text of data. This research found that the commonly mentioned drugs had a level of correspondence with frequently used illicit substances, proving the practical usefulness of this system. Lastly, the synthetically generated set provided increased accuracy scores and improves the predictive capability.

Social Media Text Mining Framework for Drug Abuse: Development and Validation Study With an Opioid Crisis Case Analysis

Background

Social media are considered promising and viable sources of data for gaining insights into various disease conditions and patients’ attitudes, behaviors, and medications. They can be used to recognize communication and behavioral themes of problematic use of prescription drugs. However, mining and analyzing social media data have challenges and limitations related to topic deduction and data quality. As a result, we need a structured approach to analyze social media content related to drug abuse in a manner that can mitigate the challenges and limitations surrounding the use of such data.

Objective

This study aimed to develop and evaluate a framework for mining and analyzing social media content related to drug abuse. The framework is designed to mitigate challenges and limitations related to topic deduction and data quality in social media data analytics for drug abuse.

Methods

The proposed framework started with defining different terms related to the keywords, categories, and characteristics of the topic of interest. We then used the Crimson Hexagon platform to collect data based on a search query informed by a drug abuse ontology developed using the identified terms. We subsequently preprocessed the data and examined the quality using an evaluation matrix. Finally, a suitable data analysis approach could be used to analyze the collected data.

Results

The framework was evaluated using the opioid epidemic as a drug abuse case analysis. We demonstrated the applicability of the proposed framework to identify public concerns toward the opioid epidemic and the most discussed topics on social media related to opioids. The results from the case analysis showed that the framework could improve the discovery and identification of topics in social media domains characterized by a plethora of highly diverse terms and lack of a commonly available dictionary or language by the community, such as in the case of opioid and drug abuse.

Conclusions

The proposed framework addressed the challenges related to topic detection and data quality. We demonstrated the applicability of the proposed framework to identify the common concerns toward the opioid epidemic and the most discussed topics on social media related to opioids.

Online Conversation Monitoring to Understand the Opioid Epidemic: Epidemiological Surveillance Study

BACKGROUND

Between 2016 and 2017, the national mortality rate involving opioids continued its escalation; opioid deaths rose from 42,249 to 47,600, bringing the public health crisis to a new height. Considering that 69% of adults in the United States use online social media sites, a resource that builds a more complete understanding of prescription drug misuse and abuse could supplement traditional surveillance instruments. The Food and Drug Administration has identified 5 key risks and consequences of opioid drugs-misuse, abuse, addiction, overdose, and death. Identifying posts that discuss these key risks could lead to novel information that is not typically captured by traditional surveillance systems.

OBJECTIVE

The goal of this study was to describe the trends of online posts (frequency over time) involving abuse, misuse, addiction, overdose, and death in the United States and to describe the types of websites that host these discussions. Internet posts that mentioned fentanyl, hydrocodone, oxycodone, or oxymorphone were examined.

METHODS

Posts that did not refer to personal experiences were removed, after which 3.1 million posts remained. A stratified sample of 61,000 was selected. Unstructured data were classified into 5 key risks by manually coding for key outcomes of misuse, abuse, addiction, overdose, and death. Sampling probabilities of the coded posts were used to estimate the total post volume for each key risk.

RESULTS

Addiction and misuse were the two most commonly discussed key risks for hydrocodone, oxycodone, and oxymorphone. For fentanyl, overdose and death were the most discussed key risks. Fentanyl had the highest estimated number of misuse-, overdose-, and death-related mentions (41,808, 42,659, and 94,169, respectively). Oxycodone had the highest estimated number of abuse- and addiction-related mentions (3548 and 12,679, respectively). The estimated volume of online posts for fentanyl increased by more than 10-fold in late 2017 and 2018. The odds of discussing fentanyl overdose (odds ratios [OR] 4.32, 95% CI 2.43-7.66) and death (OR 5.05, 95% CI 3.10-8.21) were higher for social media, while the odds of discussing fentanyl abuse (OR 0.10, 95% CI 0.04-0.22) and addiction (OR 0.24, 95% CI 0.15-0.38) were higher for blogs and forums.

CONCLUSIONS

Of the 5 FDA-defined key risks, fentanyl overdose and death has dominated discussion in recent years, while discussion of oxycodone, hydrocodone, and oxymorphone has decreased. As drug-related deaths continue to increase, an understanding of the motivations, circumstances, and consequences of drug abuse would assist in developing policy responses. Furthermore, content was notably different based on media origin, and studies that exclusively use either social media sites (such as Twitter) or blogs and forums could miss important content. This study sets out sustainable, ongoing methodology for surveilling internet postings regarding these drugs.

Use of Social Media for Pharmacovigilance Activities: Key Findings and Recommendations from the Vigi4Med Project

The large-scale use of social media by the population has gained the attention of stakeholders and researchers in various fields. In the domain of pharmacovigilance, this new resource was initially considered as an opportunity to overcome underreporting and monitor the safety of drugs in real time in close connection with patients. Research is still required to overcome technical challenges related to data extraction, annotation, and filtering, and there is not yet a clear consensus concerning the systematic exploration and use of social media in pharmacovigilance. Although the literature has mainly considered signal detection, the potential value of social media to support other pharmacovigilance activities should also be explored. The objective of this paper is to present the main findings and subsequent recommendations from the French research project Vigi4Med, which evaluated the use of social media, mainly web forums, for pharmacovigilance activities. This project included an analysis of the existing literature, which contributed to the recommendations presented herein. The recommendations are categorized into three categories: ethical (related to privacy, confidentiality, and follow-up), qualitative (related to the quality of the information), and quantitative (related to statistical analysis). We argue that the progress in information technology and the societal need to consider patients' experiences should motivate future research on social media surveillance for the reinforcement of classical pharmacovigilance.

Listed for sale: Analyzing data on fentanyl, fentanyl analogs and other novel synthetic opioids on one cryptomarket

BACKGROUND

The United States is facing a "triple wave" epidemic fueled by novel synthetic opioids. Cryptomarkets, anonymous marketplaces located on the deep web, play an increasingly important role in the distribution of illicit substances. This article presents the data collected and processed by the eDarkTrends platform concerning the availability trends of novel synthetic opioids listed on one cryptomarket.

METHODS

Listings from the DreamMarket cryptomarket "Opioids" and "Research Chemicals" sections were collected between March 2018 and January 2019. Collected data were processed using eDarkTrends Named Entity Recognition algorithm to identify opioid drugs, and to analyze their availability trends in terms of frequency of listings, available average weights, average prices, and geographic indicators of shipment origin and destination information.

RESULTS

95,011 opioid-related listings were collected through 26 crawling sessions. 33 novel synthetic opioids were identified in 3.3 % of the collected listings. 44.7 % of these listings advertised fentanyl (pharmaceutical and non-pharmaceutical) or fentanyl analogs for an average of 2.8 kgs per crawl. "Synthetic heroin" accounted for 33.2 % of novel synthetic opioid listings for an average 1.1 kgs per crawl with 97.7 % of listings advertised as shipped from Canada. Other novel synthetic opioids (e.g., U-47,700, AP-237) represented 22 % of these listings for an average of 6.1 kgs per crawl with 97.2 % of listings advertised as shipped from China.

CONCLUSIONS

Our data indicate consistent availability of a wide variety of novel synthetic opioids both in retail and wholesale-level amounts. Identification of new substances highlights the value of cryptomarket data for early warning systems of emerging substance use trends.

Machine Learning-Based Data Mining Method for Sentiment Analysis of the Sewol Ferry Disaster's Effect on Social Stress

The Sewol Ferry Disaster which took place in 16th of April, 2014, was a national level disaster in South Korea that caused severe social distress nation-wide. No research at the domestic level thus far has examined the influence of the disaster on social stress through a sentiment analysis of social media data. Data extracted from YouTube, Twitter, and Facebook were used in this study. The population was users who were randomly selected from the aforementioned social media platforms who had posted texts related to the disaster from April 2014 to March 2015. ANOVA was used for statistical comparison between negative, neutral, and positive sentiments under a 95% confidence level. For NLP-based data mining results, bar graph and word cloud analysis as well as analyses of phrases, entities, and queries were implemented. Research results showed a significantly negative sentiment on all social media platforms. This was mainly related to fundamental agents such as ex-president Park and her related political parties and politicians. YouTube, Twitter, and Facebook results showed negative sentiment in phrases (63.5, 69.4, and 58.9%, respectively), entity (81.1, 69.9, and 76.0%, respectively), and query topic (75.0, 85.4, and 75.0%, respectively). All results were statistically significant (p < 0.001). This research provides scientific evidence of the negative psychological impact of the disaster on the Korean population. This study is significant because it is the first research to conduct sentiment analysis of data extracted from the three largest existing social media platforms regarding the issue of the disaster.

Machine Learning and Natural Language Processing for Geolocation-Centric Monitoring and Characterization of Opioid-Related Social Media Chatter

IMPORTANCE

Automatic curation of consumer-generated, opioid-related social media big data may enable real-time monitoring of the opioid epidemic in the United States.

OBJECTIVE

To develop and validate an automatic text-processing pipeline for geospatial and temporal analysis of opioid-mentioning social media chatter.

DESIGN, SETTING, AND PARTICIPANTS

This cross-sectional, population-based study was conducted from December 1, 2017, to August 31, 2019, and used more than 3 years of publicly available social media posts on Twitter, dated from January 1, 2012, to October 31, 2015, that were geolocated in Pennsylvania. Opioid-mentioning tweets were extracted using prescription and illicit opioid names, including street names and misspellings. Social media posts (tweets) (n = 9006) were manually categorized into 4 classes, and training and evaluation of several machine learning algorithms were performed. Temporal and geospatial patterns were analyzed with the best-performing classifier on unlabeled data.

MAIN OUTCOMES AND MEASURES

Pearson and Spearman correlations of county- and substate-level abuse-indicating tweet rates with opioid overdose death rates from the Centers for Disease Control and Prevention WONDER database and with 4 metrics from the National Survey on Drug Use and Health for 3 years were calculated. Classifier performances were measured through microaveraged F1 scores (harmonic mean of precision and recall) or accuracies and 95% CIs.

RESULTS

A total of 9006 social media posts were annotated, of which 1748 (19.4%) were related to abuse, 2001 (22.2%) were related to information, 4830 (53.6%) were unrelated, and 427 (4.7%) were not in the English language. Yearly rates of abuse-indicating social media post showed statistically significant correlation with county-level opioid-related overdose death rates (n = 75) for 3 years (Pearson r = 0.451, P < .001; Spearman r = 0.331, P = .004). Abuse-indicating tweet rates showed consistent correlations with 4 NSDUH metrics (n = 13) associated with nonmedical prescription opioid use (Pearson r = 0.683, P = .01; Spearman r = 0.346, P = .25), illicit drug use (Pearson r = 0.850, P < .001; Spearman r = 0.341, P = .25), illicit drug dependence (Pearson r = 0.937, P < .001; Spearman r = 0.495, P = .09), and illicit drug dependence or abuse (Pearson r = 0.935, P < .001; Spearman r = 0.401, P = .17) over the same 3-year period, although the tests lacked power to demonstrate statistical significance. A classification approach involving an ensemble of classifiers produced the best performance in accuracy or microaveraged F1 score (0.726; 95% CI, 0.708-0.743).

CONCLUSIONS AND RELEVANCE

The correlations obtained in this study suggest that a social media-based approach reliant on supervised machine learning may be suitable for geolocation-centric monitoring of the US opioid epidemic in near real time.

Towards Automating Location-Specific Opioid Toxicosurveillance from Twitter via Data Science Methods

Social media may serve as an important platform for the monitoring of population-level opioid abuse in near real-time. Our objectives for this study were to (i) manually characterize a sample of opioid-mentioning Twitter posts, (ii) compare the rates of abuse/misuse related posts between prescription and illicit opiods, and (iii) to implement and evaluate the performances ofsupervised machine learning algorithms for the characterization of opioid-related chatter, which can potentially automate social media based monitoring in the future.. We annotated a total of 9006 tweets into four categories, trained several machine learning algorithms and compared their performances. Deep convolutional neural networks marginally outperformed support vector machines and random forests, with an accuracy of 70.4%. Lack of context in tweets and data imbalance resulted in misclassification of many tweets to the majority class. The automatic classification experiments produced promising results, although there is room for improvement.

Social Media-Based Health Management Systems and Sustained Health Engagement: TPB Perspective

Background: With the popularity of mobile Internet and social networks, an increasing number of social media-based health management systems (SocialHMS) have emerged in recent years. These social media-based systems have been widely used in registration, payment, decision-making, chronic diseases management, health information and medical expenses inquiry, etc., and they greatly facilitate the convenience for people to obtain health services. Objective: This study aimed to investigate the factors influencing sustained health engagement of SocialHMS by combining the theory of planned behavior (TPB) with the big-five theory and the trust theory. Method: We completed an empirical analysis based on the 494 pieces of data collected from Anhui Medical University first affiliated hospital (AMU) in East China through structural equation modeling and SmartPLS (statistical analysis software). Results: Openness to new experience has a significantly positive influence on attitude (path coefficient = 0.671, t = 24.0571, R² = 0.451), perceived behavioral control (path coefficient = 0.752, t = 32.2893, R² = 0.565), and perceived risk (path coefficient = 0.651, t = 18.5940, R² = 0.424), respectively. Attitude, perceived behavioral control, subjective norms, and trust have a significantly positive influence on sustained health engagement (path coefficients = 0.206, 0.305, 0.197, 0.183 respectively, t = 3.6684, 4.9158, 4.3414, and 3.3715, respectively). The explained variance of the above factors to the sustained health engagement of SocialHMS is 60.7% (R² = 0.607). Perceived risk has a significantly negative influence on trust (path coefficient = 0.825, t = 46.9598, R² = 0.681). Conclusions: Attitude, perceived behavioral control, subjective norm, and trust are the determinants that affect sustained health engagement. The users’ personality trait of openness to new experience and perceived risk were also found to be important factors for sustained health engagement. For hospital managers, there is the possibility to take appropriate measures based on users’ personality to further enhance the implementation and utilization of SocialHMS. As for system suppliers, they can provide the optimal design for SocialHMS so as to meet users’ needs.

Global trends, local harms: availability of fentanyl-type drugs on the dark web and accidental overdoses in Ohio

As America's opioid crisis has become an "epidemic of epidemics," Ohio has been identified as one of the high burden states regarding fentanyl-related overdose mortality. This study aims to examine changes in the availability of fentanyl, fentanyl analogs, and other non-pharmaceutical opioids on cryptomarkets and assess relationship with the trends in unintentional overdoses in Ohio to provide timely information for epidemiologic surveillance. Cryptomarket data were collected at two distinct periods of time: (1) Agora data covered June 2014-September 2015 and were obtained from Grams archive; (2) Dream Market data from March-April 2018 were extracted using a dedicated crawler. A Named Entity Recognition algorithm was developed to identify and categorize the type of fentanyl and other synthetic opioids advertised on cryptomarkets. Time-lagged correlations were used to assess the relationship between the fentanyl, fentanyl analog and other synthetic opioid-related ads from cryptomarkets and overdose data from the Cincinnati Fire Department Emergency Responses and Montgomery County Coroner's Office. Analysis from the cryptomarket data reveals increases in fentanyl-like drugs and changes in the types of fentanyl analogues and other synthetic opioids advertised in 2015 and 2018 with potent substances like carfentanil available during the second period. The time-lagged correlation was the largest when comparing Agora data to Cincinnati Emergency Responses 1 month later 0.84 (95% CI 0.45, 0.96). The time-lagged correlation between Agora data and Montgomery County drug overdoses was the largest when comparing synthetic opioid-related Agora ads to Montgomery County overdose deaths 7 months later 0.78 (95% CI 0.47, 0.92). Further investigations are required to establish the relationship between cryptomarket availability and unintentional overdose trends related to specific fentanyl analogs and/or other illicit synthetic opioids.

Early Identification of Locally Emerging Trends in Psychoactive Substance Use - Experience and Best Practice in Four European Localities

Background: Timely information about trends in psychoactive substance use could yield tailored interventions and reduce potential harms. However, conventional epidemiological tools might have limited capacity to detect trends emerging on a local level. Objectives: The aim of this study was to explore best practice in the identification of new drug trends at the local level. Methods: A total of 33 key informants from seven European municipalities/regions were interviewed to describe trends in substance use in their locality and to provide expert insights on how these were identified. Semi-structured interviews were analyzed with open coding method. Results: Four case studies that described local trends and responses were compiled: onset of problematic GHB use in the Dutch municipality of Breda (1); emerging retail shops selling new psychoactive substances (NPS) across the regions of Czech Republic (2) and in the Portuguese Agueda and Coimbra (3); and use of drugs with unknown content in the Italian region of Emilia Romagna, and its city Bologna (4). "Early identifiers" in the four case studies were organizations that work directly with people who use drugs (PWUD), emergency departments, and local police. Efficient methods of horizontal and vertical information sharing, sometimes facilitated by communication platforms, were in place, such that included early warning systems on local, national, and supra-local level. Local-level identification systems appeared as best suited to provide locally relevant information. Conclusions: Best practice in identifying emerging trends should involve all relevant "early identifiers", should consist of supra-local exchange platforms, integrate the qualities of local-level identification, and be facilitated by local-level coordinators.

Literature-based automated discovery of tumor suppressor p53 phosphorylation and inhibition by NEK2

Scientific progress depends on formulating testable hypotheses informed by the literature. In many domains, however, this model is strained because the number of research papers exceeds human readability. Here, we developed computational assistance to analyze the biomedical literature by reading PubMed abstracts to suggest new hypotheses. The approach was tested experimentally on the tumor suppressor p53 by ranking its most likely kinases, based on all available abstracts. Many of the best-ranked kinases were found to bind and phosphorylate p53 (P value = 0.005), suggesting six likely p53 kinases so far. One of these, NEK2, was studied in detail. A known mitosis promoter, NEK2 was shown to phosphorylate p53 at Ser315 in vitro and in vivo and to functionally inhibit p53. These bona fide validations of text-based predictions of p53 phosphorylation, and the discovery of an inhibitory p53 kinase of pharmaceutical interest, suggest that automated reasoning using a large body of literature can generate valuable molecular hypotheses and has the potential to accelerate scientific discovery.

Detection and Analysis of Drug Misuses. A Study Based on Social Media Messages

Drug misuse may happen when patients do not follow the prescriptions and do actions which lead to potentially harmful situations, such as intakes of incorrect dosage (overuse or underuse) or drug use for indications different from those prescribed. Although such situations are dangerous, patients usually do not report the misuse of drugs to their physicians. Hence, other sources of information are necessary for studying these issues. We assume that online health fora can provide such information and propose to exploit them. The general purpose of our work is the automatic detection and classification of drug misuses by analysing user-generated data in French social media. To this end, we propose a multi-step method, the main steps of which are: (1) indexing of messages with extended vocabulary adapted to social media writing; (2) creation of typology of drug misuses; and (3) automatic classification of messages according to whether they contain drug misuses or not. We present the results obtained at different steps and discuss them. The proposed method permit to detect the misuses with up to 0.773 F-measure.

Systematic review of surveillance by social media platforms for illicit drug use

Background

The use of social media (SM) as a surveillance tool of global illicit drug use is limited. To address this limitation, a systematic review of literature focused on the ability of SM to better recognize illicit drug use trends was addressed.

Methods

A search was conducted in databases: PubMed, CINAHL via Ebsco, PsychINFO via Ebsco, Medline via Ebsco, ERIC, Cochrane Library, Science Direct, ABI/INFORM Complete and Communication and Mass Media Complete. Included studies were original research published in peer-reviewed journals between January 2005 and June 2015 that primarily focused on collecting data from SM platforms to track trends in illicit drug use. Excluded were studies focused on purchasing prescription drugs from illicit online pharmacies.

Results

Selected studies used a range of SM tools/applications, including message boards, Twitter and blog/forums/platform discussions. Limitations included relevance, a lack of standardized surveillance systems and a lack of efficient algorithms to isolate relevant items.

Conclusion

Illicit drug use is a worldwide problem, and the rise of global social networking sites has led to the evolution of a readily accessible surveillance tool. Systematic approaches need to be developed to efficiently extract and analyze illicit drug content from social networks to supplement effective prevention programs.

Scaling Up Research on Drug Abuse and Addiction Through Social Media Big Data

Background

Substance use–related communication for drug use promotion and its prevention is widely prevalent on social media. Social media big data involve naturally occurring communication phenomena that are observable through social media platforms, which can be used in computational or scalable solutions to generate data-driven inferences. Despite the promising potential to utilize social media big data to monitor and treat substance use problems, the characteristics, mechanisms, and outcomes of substance use–related communications on social media are largely unknown. Understanding these aspects can help researchers effectively leverage social media big data and platforms for observation and health communication outreach for people with substance use problems.

Objective

The objective of this critical review was to determine how social media big data can be used to understand communication and behavioral patterns of problematic use of prescription drugs. We elaborate on theoretical applications, ethical challenges and methodological considerations when using social media big data for research on drug abuse and addiction. Based on a critical review process, we propose a typology with key initiatives to address the knowledge gap in the use of social media for research on prescription drug abuse and addiction.

Methods

First, we provided a narrative summary of the literature on drug use–related communication on social media. We also examined ethical considerations in the research processes of (1) social media big data mining, (2) subgroup or follow-up investigation, and (3) dissemination of social media data-driven findings. To develop a critical review-based typology, we searched the PubMed database and the entire e-collection theme of “infodemiology and infoveillance” in the Journal of Medical Internet Research / JMIR Publications. Studies that met our inclusion criteria (eg, use of social media data concerning non-medical use of prescription drugs, data informatics-driven findings) were reviewed for knowledge synthesis. User characteristics, communication characteristics, mechanisms and predictors of such communications, and the psychological and behavioral outcomes of social media use for problematic drug use–related communications are the dimensions of our typology. In addition to ethical practices and considerations, we also reviewed the methodological and computational approaches used in each study to develop our typology.

Results

We developed a typology to better understand non-medical, problematic use of prescription drugs through the lens of social media big data. Highly relevant studies that met our inclusion criteria were reviewed for knowledge synthesis. The characteristics of users who shared problematic substance use–related communications on social media were reported by general group terms, such as adolescents, Twitter users, and Instagram users. All reviewed studies examined the communication characteristics, such as linguistic properties, and social networks of problematic drug use–related communications on social media. The mechanisms and predictors of such social media communications were not directly examined or empirically identified in the reviewed studies. The psychological or behavioral consequence (eg, increased behavioral intention for mimicking risky health behaviors) of engaging with and being exposed to social media communications regarding problematic drug use was another area of research that has been understudied.

Conclusions

We offer theoretical applications, ethical considerations, and empirical evidence within the scope of social media communication and prescription drug abuse and addiction. Our critical review suggests that social media big data can be a tremendous resource to understand, monitor and intervene on drug abuse and addiction problems.

Increases in synthetic cannabinoids-related harms: Results from a longitudinal web-based content analysis

BACKGROUND

Synthetic Cannabinoid Receptor Agonists (SCRA), also known as "K2" or "Spice," have drawn considerable attention due to their potential of abuse and harmful consequences. More research is needed to understand user experiences of SCRA-related effects. We use semi-automated information processing techniques through eDrugTrends platform to examine SCRA-related effects and their variations through a longitudinal content analysis of web-forum data.

METHOD

English language posts from three drug-focused web-forums were extracted and analyzed between January 1st 2008 and September 30th 2015. Search terms are based on the Drug Use Ontology (DAO) created for this study (189 SCRA-related and 501 effect-related terms). EDrugTrends NLP-based text processing tools were used to extract posts mentioning SCRA and their effects. Generalized linear regression was used to fit restricted cubic spline functions of time to test whether the proportion of drug-related posts that mention SCRA (and no other drug) and the proportion of these "SCRA-only" posts that mention SCRA effects have changed over time, with an adjustment for multiple testing.

RESULTS

19,052 SCRA-related posts (Bluelight (n=2782), Forum A (n=3882), and Forum B (n=12,388)) posted by 2543 international users were extracted. The most frequently mentioned effects were "getting high" (44.0%), "hallucinations" (10.8%), and "anxiety" (10.2%). The frequency of SCRA-only posts declined steadily over the study period. The proportions of SCRA-only posts mentioning positive effects (e.g., "High" and "Euphoria") steadily decreased, while the proportions of SCRA-only posts mentioning negative effects (e.g., "Anxiety," 'Nausea," "Overdose") increased over the same period.

CONCLUSION

This study's findings indicate that the proportion of negative effects mentioned in web forum posts and linked to SCRA has increased over time, suggesting that recent generations of SCRA generate more harms. This is also one of the first studies to conduct automated content analysis of web forum data related to illicit drug use.

Large-scale adverse effects related to treatment evidence standardization (LAERTES): an open scalable system for linking pharmacovigilance evidence sources with clinical data

BACKGROUND

Integrating multiple sources of pharmacovigilance evidence has the potential to advance the science of safety signal detection and evaluation. In this regard, there is a need for more research on how to integrate multiple disparate evidence sources while making the evidence computable from a knowledge representation perspective (i.e., semantic enrichment). Existing frameworks suggest well-promising outcomes for such integration but employ a rather limited number of sources. In particular, none have been specifically designed to support both regulatory and clinical use cases, nor have any been designed to add new resources and use cases through an open architecture. This paper discusses the architecture and functionality of a system called Large-scale Adverse Effects Related to Treatment Evidence Standardization (LAERTES) that aims to address these shortcomings.

RESULTS

LAERTES provides a standardized, open, and scalable architecture for linking evidence sources relevant to the association of drugs with health outcomes of interest (HOIs). Standard terminologies are used to represent different entities. For example, drugs and HOIs are represented in RxNorm and Systematized Nomenclature of Medicine -- Clinical Terms respectively. At the time of this writing, six evidence sources have been loaded into the LAERTES evidence base and are accessible through prototype evidence exploration user interface and a set of Web application programming interface services. This system operates within a larger software stack provided by the Observational Health Data Sciences and Informatics clinical research framework, including the relational Common Data Model for observational patient data created by the Observational Medical Outcomes Partnership. Elements of the Linked Data paradigm facilitate the systematic and scalable integration of relevant evidence sources.

CONCLUSIONS

The prototype LAERTES system provides useful functionality while creating opportunities for further research. Future work will involve improving the method for normalizing drug and HOI concepts across the integrated sources, aggregated evidence at different levels of a hierarchy of HOI concepts, and developing more advanced user interface for drug-HOI investigations.

Using Social Listening Data to Monitor Misuse and Nonmedical Use of Bupropion: A Content Analysis

Background

The nonmedical use of pharmaceutical products has become a significant public health concern. Traditionally, the evaluation of nonmedical use has focused on controlled substances with addiction risk. Currently, there is no effective means of evaluating the nonmedical use of noncontrolled antidepressants.

Objective

Social listening, in the context of public health sometimes called infodemiology or infoveillance, is the process of identifying and assessing what is being said about a company, product, brand, or individual, within forms of electronic interactive media. The objectives of this study were (1) to determine whether content analysis of social listening data could be utilized to identify posts discussing potential misuse or nonmedical use of bupropion and two comparators, amitriptyline and venlafaxine, and (2) to describe and characterize these posts.

Methods

Social listening was performed on all publicly available posts cumulative through July 29, 2015, from two harm-reduction Web forums, Bluelight and Opiophile, which mentioned the study drugs. The acquired data were stripped of personally identifiable identification (PII). A set of generic, brand, and vernacular product names was used to identify product references in posts. Posts were obtained using natural language processing tools to identify vernacular references to drug misuse-related Preferred Terms from the English Medical Dictionary for Regulatory Activities (MedDRA) version 18 terminology. Posts were reviewed manually by coders, who extracted relevant details.

Results

A total of 7756 references to at least one of the study antidepressants were identified within posts gathered for this study. Of these posts, 668 (8.61%, 668/7756) referenced misuse or nonmedical use of the drug, with bupropion accounting for 438 (65.6%, 438/668). Of the 668 posts, nonmedical use was discouraged by 40.6% (178/438), 22% (22/100), and 18.5% (24/130) and encouraged by 12.3% (54/438), 10% (10/100), and 10.8% (14/130) for bupropion, amitriptyline, and venlafaxine, respectively. The most commonly reported desired effects were similar to stimulants with bupropion, sedatives with amitriptyline, and dissociatives with venlafaxine. The nasal route of administration was most frequently reported for bupropion, whereas the oral route was most frequently reported for amitriptyline and venlafaxine. Bupropion and venlafaxine were most commonly procured from health care providers, whereas amitriptyline was most commonly obtained or stolen from a third party. The Fleiss kappa for interrater agreement among 20 items with 7 categorical response options evaluated by all 11 raters was 0.448 (95% CI 0.421-0.457).

Conclusions

Social listening, conducted in collaboration with harm-reduction Web forums, offers a valuable new data source that can be used for monitoring nonmedical use of antidepressants. Additional work on the capabilities of social listening will help further delineate the benefits and limitations of this rapidly evolving data source.

An unsupervised machine learning model for discovering latent infectious diseases using social media data

INTRODUCTION

The authors of this work propose an unsupervised machine learning model that has the ability to identify real-world latent infectious diseases by mining social media data. In this study, a latent infectious disease is defined as a communicable disease that has not yet been formalized by national public health institutes and explicitly communicated to the general public. Most existing approaches to modeling infectious-disease-related knowledge discovery through social media networks are top-down approaches that are based on already known information, such as the names of diseases and their symptoms. In existing top-down approaches, necessary but unknown information, such as disease names and symptoms, is mostly unidentified in social media data until national public health institutes have formalized that disease. Most of the formalizing processes for latent infectious diseases are time consuming. Therefore, this study presents a bottom-up approach for latent infectious disease discovery in a given location without prior information, such as disease names and related symptoms.

METHODS

Social media messages with user and temporal information are extracted during the data preprocessing stage. An unsupervised sentiment analysis model is then presented. Users' expressions about symptoms, body parts, and pain locations are also identified from social media data. Then, symptom weighting vectors for each individual and time period are created, based on their sentiment and social media expressions. Finally, latent-infectious-disease-related information is retrieved from individuals' symptom weighting vectors.

DATASETS AND RESULTS

Twitter data from August 2012 to May 2013 are used to validate this study. Real electronic medical records for 104 individuals, who were diagnosed with influenza in the same period, are used to serve as ground truth validation. The results are promising, with the highest precision, recall, and F₁ score values of 0.773, 0.680, and 0.724, respectively.

CONCLUSION

This work uses individuals' social media messages to identify latent infectious diseases, without prior information, quicker than when the disease(s) is formalized by national public health institutes. In particular, the unsupervised machine learning model using user, textual, and temporal information in social media data, along with sentiment analysis, identifies latent infectious diseases in a given location.

Social Media Mining for Toxicovigilance: Automatic Monitoring of Prescription Medication Abuse from Twitter

INTRODUCTION

Prescription medication overdose is the fastest growing drug-related problem in the USA. The growing nature of this problem necessitates the implementation of improved monitoring strategies for investigating the prevalence and patterns of abuse of specific medications.

OBJECTIVES

Our primary aims were to assess the possibility of utilizing social media as a resource for automatic monitoring of prescription medication abuse and to devise an automatic classification technique that can identify potentially abuse-indicating user posts.

METHODS

We collected Twitter user posts (tweets) associated with three commonly abused medications (Adderall(®), oxycodone, and quetiapine). We manually annotated 6400 tweets mentioning these three medications and a control medication (metformin) that is not the subject of abuse due to its mechanism of action. We performed quantitative and qualitative analyses of the annotated data to determine whether posts on Twitter contain signals of prescription medication abuse. Finally, we designed an automatic supervised classification technique to distinguish posts containing signals of medication abuse from those that do not and assessed the utility of Twitter in investigating patterns of abuse over time.

RESULTS

Our analyses show that clear signals of medication abuse can be drawn from Twitter posts and the percentage of tweets containing abuse signals are significantly higher for the three case medications (Adderall(®): 23 %, quetiapine: 5.0 %, oxycodone: 12 %) than the proportion for the control medication (metformin: 0.3 %). Our automatic classification approach achieves 82 % accuracy overall (medication abuse class recall: 0.51, precision: 0.41, F measure: 0.46). To illustrate the utility of automatic classification, we show how the classification data can be used to analyze abuse patterns over time.

CONCLUSION

Our study indicates that social media can be a crucial resource for obtaining abuse-related information for medications, and that automatic approaches involving supervised classification and natural language processing hold promises for essential future monitoring and intervention tasks.

"When 'Bad' is 'Good'": Identifying Personal Communication and Sentiment in Drug-Related Tweets

BACKGROUND

To harness the full potential of social media for epidemiological surveillance of drug abuse trends, the field needs a greater level of automation in processing and analyzing social media content.

OBJECTIVES

The objective of the study is to describe the development of supervised machine-learning techniques for the eDrugTrends platform to automatically classify tweets by type/source of communication (personal, official/media, retail) and sentiment (positive, negative, neutral) expressed in cannabis- and synthetic cannabinoid-related tweets.

METHODS

Tweets were collected using Twitter streaming Application Programming Interface and filtered through the eDrugTrends platform using keywords related to cannabis, marijuana edibles, marijuana concentrates, and synthetic cannabinoids. After creating coding rules and assessing intercoder reliability, a manually labeled data set (N=4000) was developed by coding several batches of randomly selected subsets of tweets extracted from the pool of 15,623,869 collected by eDrugTrends (May-November 2015). Out of 4000 tweets, 25% (1000/4000) were used to build source classifiers and 75% (3000/4000) were used for sentiment classifiers. Logistic Regression (LR), Naive Bayes (NB), and Support Vector Machines (SVM) were used to train the classifiers. Source classification (n=1000) tested Approach 1 that used short URLs, and Approach 2 where URLs were expanded and included into the bag-of-words analysis. For sentiment classification, Approach 1 used all tweets, regardless of their source/type (n=3000), while Approach 2 applied sentiment classification to personal communication tweets only (2633/3000, 88%). Multiclass and binary classification tasks were examined, and machine-learning sentiment classifier performance was compared with Valence Aware Dictionary for sEntiment Reasoning (VADER), a lexicon and rule-based method. The performance of each classifier was assessed using 5-fold cross validation that calculated average F-scores. One-tailed t test was used to determine if differences in F-scores were statistically significant.

RESULTS

In multiclass source classification, the use of expanded URLs did not contribute to significant improvement in classifier performance (0.7972 vs 0.8102 for SVM, P=.19). In binary classification, the identification of all source categories improved significantly when unshortened URLs were used, with personal communication tweets benefiting the most (0.8736 vs 0.8200, P<.001). In multiclass sentiment classification Approach 1, SVM (0.6723) performed similarly to NB (0.6683) and LR (0.6703). In Approach 2, SVM (0.7062) did not differ from NB (0.6980, P=.13) or LR (F=0.6931, P=.05), but it was over 40% more accurate than VADER (F=0.5030, P<.001). In multiclass task, improvements in sentiment classification (Approach 2 vs Approach 1) did not reach statistical significance (eg, SVM: 0.7062 vs 0.6723, P=.052). In binary sentiment classification (positive vs negative), Approach 2 (focus on personal communication tweets only) improved classification results, compared with Approach 1, for LR (0.8752 vs 0.8516, P=.04) and SVM (0.8800 vs 0.8557, P=.045).

CONCLUSIONS

The study provides an example of the use of supervised machine learning methods to categorize cannabis- and synthetic cannabinoid-related tweets with fairly high accuracy. Use of these content analysis tools along with geographic identification capabilities developed by the eDrugTrends platform will provide powerful methods for tracking regional changes in user opinions related to cannabis and synthetic cannabinoids use over time and across different regions.

Classification of Helpful Comments on Online Suicide Watch Forums

Among social media websites, Reddit has emerged as a widely used online message board for focused mental health topics including depression, addiction, and suicide watch (SW). In particular, the SW community/subreddit has nearly 40,000 subscribers and 13 human moderators who monitor for abusive comments among other things. Given comments on posts from users expressing suicidal thoughts can be written from any part of the world at any time, moderating in a timely manner can be tedious. Furthermore, Reddit's default comment ranking does not involve aspects that relate to the "helpfulness" of a comment from a suicide prevention (SP) perspective. Being able to automatically identify and score helpful comments from such a perspective can assist moderators, help SW posters to have immediate feedback on the SP relevance of a comment, and also provide insights to SP researchers for dealing with online aspects of SP. In this paper, we report what we believe is the first effort in automatic identification of helpful comments on online posts in SW forums with the SW subreddit as the use-case. We use a dataset of 3000 real SW comments and obtain SP researcher judgments regarding their helpfulness in the contexts of the corresponding original posts. We conduct supervised learning experiments with content based features including n-grams, word psychometric scores, and discourse relation graphs and report encouraging F-scores (≈ 80 - 90%) for the helpful comment classes. Our results indicate that machine learning approaches can offer complementary moderating functionality for SW posts. Furthermore, we realize assessing the helpfulness of comments on mental health related online posts is a nuanced topic and needs further attention from the SP research community.

"Those edibles hit hard": Exploration of Twitter data on cannabis edibles in the U.S

AIMS

Several states in the U.S. have legalized cannabis for recreational or medical uses. In this context, cannabis edibles have drawn considerable attention after adverse effects were reported. This paper investigates Twitter users' perceptions concerning edibles and evaluates the association edibles-related tweeting activity and local cannabis legislation.

METHODS

Tweets were collected between May 1 and July 31, 2015, using Twitter API and filtered through the eDrugTrends/Twitris platform. A random sample of geolocated tweets was manually coded to evaluate Twitter users' perceptions regarding edibles. Raw state proportions of Twitter users mentioning edibles were ajusted relative to the total number of Twitter users per state. Differences in adjusted proportions of Twitter users mentioning edibles between states with different cannabis legislation status were assesed via a permutation test.

RESULTS

We collected 100,182 tweets mentioning cannabis edibles with 26.9% (n=26,975) containing state-level geolocation. Adjusted percentages of geolocated Twitter users posting about edibles were significantly greater in states that allow recreational and/or medical use of cannabis. The differences were statistically significant. Overall, cannabis edibles were generally positively perceived among Twitter users despite some negative tweets expressing the unreliability of edible consumption linked to variability in effect intensity and duration.

CONCLUSION

Our findings suggest that Twitter data analysis is an important tool for epidemiological monitoring of emerging drug use practices and trends. Results tend to indicate greater tweeting activity about cannabis edibles in states where medical THC and/or recreational use are legal. Although the majority of tweets conveyed positive attitudes about cannabis edibles, analysis of experiences expressed in negative tweets confirms the potential adverse effects of edibles and calls for educating edibles-naïve users, improving edibles labeling, and testing their THC content.

Text mining applications in psychiatry: a systematic literature review

The expansion of biomedical literature is creating the need for efficient tools to keep pace with increasing volumes of information. Text mining (TM) approaches are becoming essential to facilitate the automated extraction of useful biomedical information from unstructured text. We reviewed the applications of TM in psychiatry, and explored its advantages and limitations. A systematic review of the literature was carried out using the CINAHL, Medline, EMBASE, PsycINFO and Cochrane databases. In this review, 1103 papers were screened, and 38 were included as applications of TM in psychiatric research. Using TM and content analysis, we identified four major areas of application: (1) Psychopathology (i.e. observational studies focusing on mental illnesses) (2) the Patient perspective (i.e. patients' thoughts and opinions), (3) Medical records (i.e. safety issues, quality of care and description of treatments), and (4) Medical literature (i.e. identification of new scientific information in the literature). The information sources were qualitative studies, Internet postings, medical records and biomedical literature. Our work demonstrates that TM can contribute to complex research tasks in psychiatry. We discuss the benefits, limits, and further applications of this tool in the future. Copyright © 2015 John Wiley & Sons, Ltd.

On mining latent topics from healthcare chat logs

BACKGROUND

Public and internet-based social media such as online healthcare-oriented chat groups provide a convenient channel for patients and people concerned about health to communicate and share information with each other. The chat logs of an online healthcare-oriented chat group can potentially be used to extract latent topics, to encourage participation, and to recommend relevant healthcare information to users.

OBJECTIVE

This paper addresses the use of online healthcare chat logs to automatically discover both underlying topics and user interests.

METHOD

We present a new probabilistic model that exploits healthcare chat logs to find hidden topics and changes in these topics over time. The proposed model uses separate but associated hidden variables to explore both topics and individual interests such that it can provide useful insights to the participants of online healthcare chat groups about their interests in terms of weighted topics or vice versa.

RESULTS

We evaluate the proposed model on a real-world chat log by comparing its performance to benchmark topic models, i.e., latent Dirichlet allocation (LDA) and Author Topic Model (ATM), on the topic extraction task. The chat log is obtained from an online chat group of pregnant women, which consists of 233,452 chat word tokens contributed by 118 users. Both detected individual interests and underlying topics with their progressive information over time are demonstrated. The results show that the performance of the proposed model exceeds that of the benchmark models.

CONCLUSION

The experimental results illustrate that the proposed model is a promising method for extracting healthcare knowledge from social media data.

Patterns of Treatment Switching in Multiple Sclerosis Therapies in US Patients Active on Social Media: Application of Social Media Content Analysis to Health Outcomes Research

BACKGROUND

Social media analysis has rarely been applied to the study of specific questions in outcomes research.

OBJECTIVE

The aim was to test the applicability of social media analysis to outcomes research using automated listening combined with filtering and analysis of data by specialists. After validation, the process was applied to the study of patterns of treatment switching in multiple sclerosis (MS).

METHODS

A comprehensive listening and analysis process was developed that blended automated listening with filtering and analysis of data by life sciences-qualified analysts and physicians. The population was patients with MS from the United States. Data sources were Facebook, Twitter, blogs, and online forums. Sources were searched for mention of specific oral, injectable, and intravenous (IV) infusion treatments. The representativeness of the social media population was validated by comparison with community survey data and with data from three large US administrative claims databases: MarketScan, PharMetrics Plus, and Department of Defense.

RESULTS

A total of 10,260 data points were sampled for manual review: 3025 from Twitter, 3771 from Facebook, 2773 from Internet forums, and 691 from blogs. The demographics of the social media population were similar to those reported from community surveys and claims databases. Mean age was 39 (SD 11) years and 14.56% (326/2239) of the population was older than 50 years. Women, patients aged 30 to 49 years, and those diagnosed for more than 10 years were represented by more data points than other patients were. Women also accounted for a large majority (82.6%, 819/991) of reported switches. Two-fifths of switching patients had lived with their disease for more than 10 years since diagnosis. Most reported switches (55.05%, 927/1684) were from injectable to oral drugs with switches from IV therapies to orals the second largest switch (15.38%, 259/1684). Switches to oral drugs accounted for more than 80% (927/1114) of the switches away from injectable therapies. Four reasons accounted for more than 90% of all switches: severe side effects, lack of efficacy, physicians' advice, and greater ease of use. Side effects were the main reason for switches to oral or to injectable therapies and search for greater efficacy was the most important factor in switches to IV therapies. Cost of medication was the reason for switching in less than 0.5% of patients.

CONCLUSIONS

Social intelligence can be applied to outcomes research with power to analyze MS patients' personal experiences of treatments and to chart the most common reasons for switching between therapies.

FIR: An Effective Scheme for Extracting Useful Metadata from Social Media

Recently, the use of social media for health information exchange is expanding among patients, physicians, and other health care professionals. In medical areas, social media allows non-experts to access, interpret, and generate medical information for their own care and the care of others. Researchers paid much attention on social media in medical educations, patient-pharmacist communications, adverse drug reactions detection, impacts of social media on medicine and healthcare, and so on. However, relatively few papers discuss how to extract useful knowledge from a huge amount of textual comments in social media effectively. Therefore, this study aims to propose a Fuzzy adaptive resonance theory network based Information Retrieval (FIR) scheme by combining Fuzzy adaptive resonance theory (ART) network, Latent Semantic Indexing (LSI), and association rules (AR) discovery to extract knowledge from social media. In our FIR scheme, Fuzzy ART network firstly has been employed to segment comments. Next, for each customer segment, we use LSI technique to retrieve important keywords. Then, in order to make the extracted keywords understandable, association rules mining is presented to organize these extracted keywords to build metadata. These extracted useful voices of customers will be transformed into design needs by using Quality Function Deployment (QFD) for further decision making. Unlike conventional information retrieval techniques which acquire too many keywords to get key points, our FIR scheme can extract understandable metadata from social media.