Infodemiological Examination of Personal and Commercial Tweets About Cannabidiol: Term and Sentiment Analysis

Evaluating the Credibility and Reliability of Online Information on Cannabidiol (CBD) for Epilepsy Treatment in Poland

The interest in the potential therapeutic use of cannabis, especially cannabidiol (CBD), has increased significantly in recent years. On the Internet, users can find lots of articles devoted to its medical features such as reducing seizure activity in epilepsy. The aim of our work was to evaluate the information contained on the websites, including social media, in terms of the credibility and the reliability of current knowledge about the usage of products containing cannabidiol in epilepsy treatment. We used online available links found using the Newspointtool. The initial database included 38,367 texts, but after applying the inclusion and exclusion criteria, 314 texts were taken into consideration. Analysis was performed using the DISCERN scale and the set of questions created by the authors. In the final assessment, we observed that most of the texts (58.9%) were characterized by a very poor level of reliability and the average DISCERN score was 26.97 points. Additionally, considering the form of the text, the highest average score (35.73) came from entries on blog portals, whereas the lowest average score (18.33) came from comments and online discussion forums. Moreover, most of the texts do not contain key information regarding the indications, safety, desired effects, and side effects of CBD therapy. The study highlights the need for healthcare professionals to guide patients towards reliable sources of information and cautions against the use of unverified online materials, especially as the only FDA-approved CBD medication, Epidiolex, differs significantly from over-the-counter CBD products.

How satisfied are patients with nursing care and why? A comprehensive study based on social media and opinion mining

To assess the overall experience of a patient in a hospital, many factors must be analyzed; nonetheless, one of the key aspects is the performance of nurses as they closely interact with patients on many occasions. Nurses carry out many tasks that could be assessed to understand the patient's satisfaction and consequently, the effectiveness of the offered services. To assess their performance, traditionally, expensive, and time-consuming methods such as questionnaires and interviews have been used; nevertheless, the development of social networks has allowed the patients to convey their opinions in a free and public manner. For that reason, in this study, a comprehensive analysis has been performed based on patients' opinions collected from a feedback platform for health and care services, to discover the topics about nurses the patients are more interested in. To do so, a topic modeling technique has been proposed. After this, sentiment analysis has been applied to classify the topics as satisfactory or unsatisfactory. Finally, the results have been compared with what the patients think about doctors. The results highlight what topics are most relevant to assess the patient satisfaction and to what extent. The results remark that the opinion about nurses is, in general, more positive than about doctors.

Using Social Media Data to Investigate Public Perceptions of Cannabis as a Medicine: Narrative Review

BACKGROUND

The use and acceptance of medicinal cannabis is on the rise across the globe. To support the interests of public health, evidence relating to its use, effects, and safety is required to match this community demand. Web-based user-generated data are often used by researchers and public health organizations for the investigation of consumer perceptions, market forces, population behaviors, and for pharmacoepidemiology.

OBJECTIVE

In this review, we aimed to summarize the findings of studies that have used user-generated text as a data source to study medicinal cannabis or the use of cannabis as medicine. Our objectives were to categorize the insights provided by social media research on cannabis as medicine and describe the role of social media for consumers using medicinal cannabis.

METHODS

The inclusion criteria for this review were primary research studies and reviews that reported on the analysis of web-based user-generated content on cannabis as medicine. The MEDLINE, Scopus, Web of Science, and Embase databases were searched from January 1974 to April 2022.

RESULTS

We examined 42 studies published in English and found that consumers value their ability to exchange experiences on the web and tend to rely on web-based information sources. Cannabis discussions have portrayed the substance as a safe and natural medicine to help with many health conditions including cancer, sleep disorders, chronic pain, opioid use disorders, headaches, asthma, bowel disease, anxiety, depression, and posttraumatic stress disorder. These discussions provide a rich resource for researchers to investigate medicinal cannabis-related consumer sentiment and experiences, including the opportunity to monitor cannabis effects and adverse events, given the anecdotal and often biased nature of the information is properly accounted for.

CONCLUSIONS

The extensive web-based presence of the cannabis industry coupled with the conversational nature of social media discourse results in rich but potentially biased information that is often not well-supported by scientific evidence. This review summarizes what social media is saying about the medicinal use of cannabis and discusses the challenges faced by health governance agencies and professionals to make use of web-based resources to both learn from medicinal cannabis users and provide factual, timely, and reliable evidence-based health information to consumers.

Detecting Tweets Containing Cannabidiol-Related COVID-19 Misinformation Using Transformer Language Models and Warning Letters From Food and Drug Administration: Content Analysis and Identification

BACKGROUND

COVID-19 has introduced yet another opportunity to web-based sellers of loosely regulated substances, such as cannabidiol (CBD), to promote sales under false pretenses of curing the disease. Therefore, it has become necessary to innovate ways to identify such instances of misinformation.

OBJECTIVE

We sought to identify COVID-19 misinformation as it relates to the sales or promotion of CBD and used transformer-based language models to identify tweets semantically similar to quotes taken from known instances of misinformation. In this case, the known misinformation was the publicly available Warning Letters from Food and Drug Administration (FDA).

METHODS

We collected tweets using CBD- and COVID-19-related terms. Using a previously trained model, we extracted the tweets indicating commercialization and sales of CBD and annotated those containing COVID-19 misinformation according to the FDA definitions. We encoded the collection of tweets and misinformation quotes into sentence vectors and then calculated the cosine similarity between each quote and each tweet. This allowed us to establish a threshold to identify tweets that were making false claims regarding CBD and COVID-19 while minimizing the instances of false positives.

RESULTS

We demonstrated that by using quotes taken from Warning Letters issued by FDA to perpetrators of similar misinformation, we can identify semantically similar tweets that also contain misinformation. This was accomplished by identifying a cosine distance threshold between the sentence vectors of the Warning Letters and tweets.

CONCLUSIONS

This research shows that commercial CBD or COVID-19 misinformation can potentially be identified and curbed using transformer-based language models and known prior instances of misinformation. Our approach functions without the need for labeled data, potentially reducing the time at which misinformation can be identified. Our approach shows promise in that it is easily adapted to identify other forms of misinformation related to loosely regulated substances.

Social media discourse and internet search queries on cannabis as a medicine: A systematic scoping review

The use of cannabis for medicinal purposes has increased globally over the past decade since patient access to medicinal cannabis has been legislated across jurisdictions in Europe, the United Kingdom, the United States, Canada, and Australia. Yet, evidence relating to the effect of medical cannabis on the management of symptoms for a suite of conditions is only just emerging. Although there is considerable engagement from many stakeholders to add to the evidence base through randomized controlled trials, many gaps in the literature remain. Data from real-world and patient reported sources can provide opportunities to address this evidence deficit. This real-world data can be captured from a variety of sources such as found in routinely collected health care and health services records that include but are not limited to patient generated data from medical, administrative and claims data, patient reported data from surveys, wearable trackers, patient registries, and social media. In this systematic scoping review, we seek to understand the utility of online user generated text into the use of cannabis as a medicine. In this scoping review, we aimed to systematically search published literature to examine the extent, range, and nature of research that utilises user-generated content to examine to cannabis as a medicine. The objective of this methodological review is to synthesise primary research that uses social media discourse and internet search engine queries to answer the following questions: (i) In what way, is online user-generated text used as a data source in the investigation of cannabis as a medicine? (ii) What are the aims, data sources, methods, and research themes of studies using online user-generated text to discuss the medicinal use of cannabis. We conducted a manual search of primary research studies which used online user-generated text as a data source using the MEDLINE, Embase, Web of Science, and Scopus databases in October 2022. Editorials, letters, commentaries, surveys, protocols, and book chapters were excluded from the review. Forty-two studies were included in this review, twenty-two studies used manually labelled data, four studies used existing meta-data (Google trends/geo-location data), two studies used data that was manually coded using crowdsourcing services, and two used automated coding supplied by a social media analytics company, fifteen used computational methods for annotating data. Our review reflects a growing interest in the use of user-generated content for public health surveillance. It also demonstrates the need for the development of a systematic approach for evaluating the quality of social media studies and highlights the utility of automatic processing and computational methods (machine learning technologies) for large social media datasets. This systematic scoping review has shown that user-generated content as a data source for studying cannabis as a medicine provides another means to understand how cannabis is perceived and used in the community. As such, it provides another potential 'tool' with which to engage in pharmacovigilance of, not only cannabis as a medicine, but also other novel therapeutics as they enter the market.

Sentiment Analysis of Online Patient-Written Reviews of Vascular Surgeons

BACKGROUND

Online patient reviews influence a patient's choice of a vascular surgeon. The aim of this study is to examine underlying factors that contribute to positive and negative patient reviews by leveraging sentiment analysis and machine learning methods.

METHODS

The Society of Vascular Surgeons publicly accessible member directory was queried and cross-referenced with a popular patient-maintained physician review website, healthgrades.com. Sentiment analysis and machine learning methods were used to analyze several parameters. Demographics (gender, age, and state of practice), star rating (of 5 stars), and written reviews were obtained for corresponding vascular surgeons. A sentiment analysis model was applied to patient-written reviews and validated against the star ratings. Student's t-test or one-way analysis of variance assessed demographic relationships with reviews. Word frequency assessments and multivariable logistic regression analyses were conducted to identify common and determinative components of written reviews.

RESULTS

A total of 1,799 vascular surgeons had public profiles with reviews. Female gender of surgeon was associated with lower star ratings (male = 4.19, female = 3.95, P < 0.01) and average sentiment score (male = 0.50, female = 0.40, P < 0.01). Younger physician age was associated with higher star rating (P = 0.02) but not average sentiment score (P = 0.12). In the Best reviews, the most commonly used one-words were Care (N = 999), Caring (N = 767), and Kind (N = 479), while the most commonly used two-word pairs were Saved/Life (N = 189), Feel/Comfortable (N = 106), and Kind/Caring (N = 104). For the Worst reviews, the most commonly used one-words were Pain (N = 254) and Rude (N = 148), while the most commonly used two-word pairs were No/One (N = 27), Waste/Time (N = 25), and Severe/Pain (N = 18). In a multiple logistic regression, satisfactory reviews were associated with words such as Confident (odds ratio [OR] = 8.93), Pain-free (OR = 4.72), Listens (OR = 2.55), and Bedside Manner (OR = 1.70), while unsatisfactory reviews were associated with words such as Rude (OR = 0.01), Arrogant (OR = 0.09), Infection (OR = 0.20), and Wait (OR = 0.48).

CONCLUSIONS

Female surgeons received significantly worse reviews and younger surgeons tended to receive better reviews. The positivity and negativity of reviews were largely related to words associated with the patient-doctor experience and pain. Vascular surgeons should focus on these 2 areas to improve patient experiences and their own reviews.

Topics and Sentiment Surrounding Vaping on Twitter and Reddit During the 2019 e-Cigarette and Vaping Use-Associated Lung Injury Outbreak: Comparative Study

BACKGROUND

Vaping or e-cigarette use has become dramatically more popular in the United States in recent years. e-Cigarette and vaping use-associated lung injury (EVALI) cases caused an increase in hospitalizations and deaths in 2019, and many instances were later linked to unregulated products. Previous literature has leveraged social media data for surveillance of health topics. Individuals are willing to share mental health experiences and other personal stories on social media platforms where they feel a sense of community, reduced stigma, and empowerment.

OBJECTIVE

This study aimed to compare vaping-related content on 2 popular social media platforms (ie, Twitter and Reddit) to explore the context surrounding vaping during the 2019 EVALI outbreak and to support the feasibility of using data from both social platforms to develop in-depth and intelligent vaping detection models on social media.

METHODS

Data were extracted from both Twitter (316,620 tweets) and Reddit (17,320 posts) from July 2019 to September 2019 at the peak of the EVALI crisis. High-throughput computational analyses (sentiment analysis and topic analysis) were conducted. In addition, in-depth manual content analyses were performed and compared with computational analyses of content on both platforms (577 tweets and 613 posts).

RESULTS

Vaping-related posts and unique users on Twitter and Reddit increased from July 2019 to September 2019, with the average post per user increasing from 1.68 to 1.81 on Twitter and 1.19 to 1.21 on Reddit. Computational analyses found the number of positive sentiment posts to be higher on Reddit (P<.001, 95% CI 0.4305-0.4475) and the number of negative posts to be higher on Twitter (P<.001, 95% CI -0.4289 to -0.4111). These results were consistent with the clinical content analyses results indicating that negative sentiment posts were higher on Twitter (273/577, 47.3%) than Reddit (184/613, 30%). Furthermore, topics prevalent on both platforms by keywords and based on manual post reviews included mentions of youth, marketing or regulation, marijuana, and interest in quitting.

CONCLUSIONS

Post content and trending topics overlapped on both Twitter and Reddit during the EVALI period in 2019. However, crucial differences in user type and content keywords were also found, including more frequent mentions of health-related keywords on Twitter and more negative health outcomes from vaping mentioned on both Reddit and Twitter. Use of both computational and clinical content analyses is critical to not only identify signals of public health trends among vaping-related social media content but also to provide context for vaping risks and behaviors. By leveraging the strengths of both Twitter and Reddit as publicly available data sources, this research may provide technical and clinical insights to inform automatic detection of social media users who are vaping and may benefit from digital intervention and proactive outreach strategies on these platforms.