Interventions to support consumer evaluation of online health information credibility: A scoping review

Educational Video Intervention to Improve Health Misinformation Identification on WhatsApp Among Saudi Arabian Population: Pre-Post Intervention Study

BACKGROUND

Health misinformation can adversely affect individuals' quality of life and increase the risk of mortality. People often fail to assess the content of messages before sharing them on the internet, increasing the spread of misinformation. The problem is exacerbated by the growing variety of digital information environments, especially social media, which presents as an effective platform for spreading misinformation due to its rapid information-sharing capabilities. Educational interventions have been developed to help consumers verify the validity of digital health information. However, tools designed to detect health misinformation on social media content have not been validated. Given the increased use of social media platforms, particularly WhatsApp, it is crucial to develop tools to help consumers assess the credibility of messages and detect misinformation.

OBJECTIVE

The main objective of this study is to develop and assess an educational tool aimed at educating consumers about detecting health misinformation on WhatsApp. The secondary objective is to assess the association between demographic factors and knowledge levels.

METHODS

The study used a single-arm, pre-post intervention design to evaluate the effectiveness of an educational video in improving participants' ability to detect health-related misinformation in WhatsApp messages. In the first phase, an educational video intervention was developed and validated. In the second phase, participants were invited to complete a web-based survey that consisted of pre-evaluation questions, followed by the educational video intervention. Subsequently, they were asked to answer the same questions as the postevaluation questions.

RESULTS

The web-based survey received 485 responses. The completion rate was 99.6% (n=483). Statistically significant associations existed between knowledge level and age, gender, employment, and region of residence (P<.05). The video intervention did elicit a statistically significant change in the participants' abilities to identify misinformation in WhatsApp messages (z=-6.887; P<.001). Viewing the video was associated with increased knowledge about the following concepts: checking the "forwarded" label (P<.001), looking for spelling and grammatical errors (P<.001), analyzing the facts (P=.03), checking links (P=.002, P=.001), and assessing the photos and videos (P<.001). There was a statistically significant difference in knowledge level before and after the intervention (P<.001).

CONCLUSIONS

This study developed and evaluated the effectiveness of an educational video intervention to improve health misinformation identification on WhatsApp among the Saudi Arabian population. The results indicate that educational videos can be valuable tools for improving participants' abilities to identify misinformation. The outcomes of this research can contribute to our understanding of what constitutes an effective tool for enhancing health misinformation awareness. Such interventions may be particularly useful in combating misinformation among Arabic-speaking populations on WhatsApp, which may ultimately improve eHealth literacy. Limiting the prevalence and impact of misinformation allows people to make better-informed health decisions.

An Active Model of Research Translation for the General Public: Content Analysis of a YouTube-Based Health Podcast

BACKGROUND

Online health information seeking is changing the way people engage with health care and the health system. Recent changes in practices related to seeking, accessing, and disseminating scientific research, and in particular health information, have enabled a high level of user engagement.

OBJECTIVE

This study aims to examine an innovative model of research translation, The Huberman Lab Podcast (HLP), developed by Andrew Huberman, Professor of Neurobiology and Ophthalmology at the Stanford School of Medicine. The HLP leverages social media to deliver health information translated into specific, actionable practices and health strategies directly to the general public. This research characterizes the HLP as an Active Model of Research Translation and assesses its potential as a framework for replicability and wider adoption.

METHODS

We applied conventional content analysis of the YouTube transcript data and directed content analysis of viewers' YouTube comments to 23 HLP episodes released from January to October 2021, reflecting the time of data analysis. We selected 7 episodes and a welcome video, to describe and identify key characteristics of the HLP model. We analyzed viewer comments for 18 episodes to determine whether viewers found the HLP content valuable, accessible, and easy to implement.

RESULTS

The key HLP features are direct-to-the-consumer, zero-cost, bilingual, and actionable content. We identified 3 main organizing categories and 10 subcategories as the key elements of the HLP: (1) Why: Educate and Empower and Bring Zero Cost to Consumer Information to the General Public; (2) What: Tools and Protocols; Underlying Mechanisms; and Grounded in Science; (3) How: Linear and Iterative Knowledge Building Process; Lecture-Style Sessions; Interactive and Consumer Informed; Easily Accessible; and Building the Community. Analysis of viewers' comments found strong consumer support for the key HLP model elements.

CONCLUSIONS

This Active Model of Research Translation offers a way to synthesize scientific evidence and deliver it directly to end users in the form of actionable tools and education. Timely evidence translation using effective consumer engagement and education techniques appears to improve access and confidence related to health information use and reduces challenges to understanding and applying health information received from health providers. Framing complex content in an approachable manner, engaging the target audience, encouraging participation, and ensuring open access to the content meet current recommendations on innovative practices for leveraging social media or other digital platforms for disseminating science and research findings to the general public, and are likely key contributors to HLP impact and potential for success. The model offers a replicable framework for translating and disseminating scientific evidence. Similar active models of research translation can have implications for accessing health information and implementing health strategies for improved outcomes. Areas for further investigation are specific and measurable impacts on health, usability, and relevance of the model for reaching marginalized and high-risk populations.

Consumers' longitudinal health information needs and seeking: a scoping review

Needing and seeking health information often is a longitudinal everyday life information behavior that involves the use of technology. However, no reviews of consumers' longitudinal health information needs (HIN) and health information-seeking (HIS) behavior have been conducted. We performed a scoping review to address this gap. Specifically, we surveyed the characteristics, timeline construction and research findings of studies investigating consumers' longitudinal HIN and HIS. Initial searches were conducted in November 2019 and updated in July 2022. A total of 128 papers were identified, reviewed and analyzed using content and thematic analyses. Results showed that most papers were quantitative, conducted in the USA, related to cancer, conducted during the diagnosis and treatment phases, and followed preset time intervals. Findings concerning the development patterns of consumers' HIN degrees and HIS effort were mixed (i.e. increasing, decreasing or being consistent over time). They seemed to be shaped by factors such as health conditions, data collection methods and the length of data collection. Consumers' use of sources changes depending on health status and source accessibility; their medical terminologies seem to expand over time. HIS has a strong emotional dimension which may lead to adaptive or maladaptive information behaviors (e.g. information avoidance). Overall, the results revealed a lack of understanding of HIN and HIS from a longitudinal perspective, particularly along health condition progression and coping trajectories. There is also a lack of understanding of the role of technologies in the longitudinal HIS process.

Analyzing the quality and educational value of Achilles tendinopathy-related videos on TikTok

BACKGROUND

Social media platforms, like TikTok, have become popular options for the consumption and distribution of healthcare information. Due to the lack of scientific oversight, the consistency of healthcare-related videos has become a focus of the current literature. However, orthopaedic surgery has lagged behind other specialties in acknowledging the widespread utilization of TikTok videos for medical information. This study aims to assess the quality and educational benefits of Achilles tendinopathy-related TikTok videos.

METHODS

TikTok was queried using the hashtags "#achillestendonexercises", "achillestendonitisexercises", "achillestendinosisexercises", and "achillestendinopathyexercises". 100 videos (25 for each term) were included after applying the exclusion criteria. The number of views, likes, shares, comments, and favorites was recorded. The content was graded using DISCERN (a well-validated informational analysis tool) and ATEES (a self-designed tool for exercise evaluation).

RESULTS

The total number of views of the 100 videos was 1647,148, with a median of 7562.5 (IQR = 2,281- 19,575). The videos collectively received 73,765 likes, 1125 comments, 14,491 favorites and 6897 shares with a median of 283 (IQR= 73.8-957.8), 7 (IQR= 1.8-16.0), 61.5 (IQR= 8.8-184.3), and 18.5 (IQR= 2.0-49.8), respectively. General users uploaded slightly less (48%) when compared to healthcare professionals (52%). Healthcare professionals had more videos graded as "very poor" (43.4%) in comparison to the general users (36.2%). General users had more videos graded as "poor" (63.8%) in comparison to healthcare professionals (54.7%). However, there were no significant differences between the groups on either of the video grading scales.

CONCLUSION

Although TikTok is a powerful tool for information distribution, the educational value of the videos related to Achilles tendinopathy exercises was poor. With only 1% of videos receiving a grade of 'fair,' and no videos reaching a score of 'good' or 'excellent', healthcare professionals should be aware of the high viewership of low-quality content easily accessible on TikTok.

LEVEL OF EVIDENCE: 3

The Reliability and Quality of Short Videos as a Source of Dietary Guidance for Inflammatory Bowel Disease: Cross-sectional Study

BACKGROUND

Dietary management is considered a potential adjunctive treatment for inflammatory bowel disease (IBD). Short-video sharing platforms have enabled patients to obtain dietary advice more conveniently. However, accessing useful resources while avoiding misinformation is not an easy task for most patients.

OBJECTIVE

This study aimed to evaluate the quality of the information in IBD diet-related videos on Chinese short-video sharing platforms.

METHODS

We collected and extracted information from a total of 125 video samples related to the IBD diet on the 3 Chinese short-video sharing platforms with the most users: TikTok, Bilibili, and Kwai. Two independent physicians evaluated each video in terms of content comprehensiveness, quality (rated by Global Quality Score), and reliability (rated by a modified DISCERN tool). Finally, comparative analyses of the videos from different sources were conducted.

RESULTS

The videos were classified into 6 groups based on the identity of the uploaders, which included 3 kinds of medical professionals (ie, gastroenterologists, nongastroenterologists, and clinical nutritionists) and 3 types of non-medical professionals (ie, nonprofit organizations, individual science communicators, and IBD patients). The overall quality of the videos was poor. Further group comparisons demonstrated that videos from medical professionals were more instructive in terms of content comprehensiveness, quality, and reliability than those from non-medical professionals. Moreover, IBD diet-related recommendations from clinical nutritionists and gastroenterologists were of better quality than those from nongastroenterologists, while recommendations from nonprofit organizations did not seem to be superior to other groups of uploaders.

CONCLUSIONS

The overall quality of the information in IBD diet-related videos is unsatisfactory and varies significantly depending on the source. Videos from medical professionals, especially clinical nutritionists and gastroenterologists, may provide dietary guidance with higher quality for IBD patients.

TikTok and YouTube as sources of information on anal fissure: A comparative analysis

Introduction

Anal fissure is a common colorectal disease impacting patients' life quality with high incidence. Social media platforms are becoming a kind of health information source nowadays. This study aims to evaluate and compare the quality of anal fissure-related videos on TikTok and YouTube.

Materials and methods

One hundred videos were sourced from TikTok and YouTube, respectively and videos were screened further. The completeness of six types of content within the videos is assessed, including the definition of disease, symptoms, risk factors, evaluation, management and outcomes. Finally, the DISCERN instrument, Patient Education Materials Assessment Tool and Global Quality scale are used to assess video display quality and content. A correlation analysis is undertaken considering the video features, DISCERN, PEMAT and GQS scores.

Results

Physicians and non-profit organizations contributed almost all video content among selected videos. A statistically significant correlation between DISCERN classification and duration, PEMAT understandability, PEMAT actionability and GQS scores is recorded. DISCERN total scores were significantly positively correlated with video duration, PEMAT understandability, PEMAT actionability and GQS scores. GQS scores were significantly positively correlated with duration, PEMAT understandability and PEMAT actionability scores. For content, the videos mainly described management and symptoms while containing limited information on the disease evaluation, and outcomes.

Conclusions

The sources of uploaders on YouTube are more diverse than TikTok, and the quality of videos is also relatively higher on YouTube. Even so, the video quality of the two platforms still needs to be further improved. Health information without integrity, reliability and practicability impacts patients' disease perception and health-seeking behavior, leading to serious consequences. Much effort must be taken to improve the quality of videos regarding anal fissures on the two platforms, which will facilitate the development of public health education on this issue.

Assessment of videos related to lung nodules in China

Background

With the popularization of mobile phones and the development of the Internet, many patients use social media platforms to seek health information. Currently, TikTok, iQiyi, Bilibili, and Weibo are the most popular video platforms in China. Therefore, based on the above facts, this study estimated the quality of lung nodule videos taken in China using these platforms.

Methods

The term “lung nodule” was searched on these platforms. Then, the first 30 videos were selected. Subsequently, some videos were excluded after they had been reviewed and analyzed, after which information on the features and sources of these videos was finally assessed using DISCERN, the Journal of the American Medical Association (JAMA) Benchmark Criteria, and the Hexagonal Radar Schema. Analysis was performed according to different groups.

Results

101 videos were included in this study. According to the different sources, although most videos were from physicians (71.3%), comprising those with shorter durations; faster updates; and more likes, comments, and shares; no significant difference in the scores were obtained. Moreover, regarding the different platforms, while Weibo had the highest update, TikTok had more likes, comments, and shares. Investigations also revealed that while score differences were recorded, most videos were rated “very poor” and “poor.” Besides, hexagonal radar charts showed a severe deficiency of video information.

Conclusions

Although the quality of most videos on the understudied social media platforms was poor, these platforms have huge potential. Therefore, caution should be exercised when using the platforms as information sources about lung nodules, and a better review and push system is needed.

Age and neurocognition are associated with credibility evaluations of health websites

The internet has become a common means by which many older adults seek out health information. The prevalence of misinformation on the internet makes the search for accurate online health information a more complex and evaluative process. This study examined the role of age and neurocognition in credibility evaluations of credible and non-credible health websites. Forty-one older adults and fifty younger adults completed a structured credibility rating task in which they evaluated a series of webpages displaying health information about migraine treatments. Participants also completed measures of neurocognition, internet use, and health literacy. Results suggested that older adults rated non-credible health websites as more credible than younger adults, but the age groups did not differ in their ratings of credible sites. Within the full sample, neurocognition was associated with credibility ratings for non-credible health websites, whereas health literacy was related to the ratings of credible sites. Findings indicate that older adults may be more likely to trust non-credible health websites than younger adults, which may be related to differences in higher-order neurocognitive functions. Future work might examine whether cognitive-based supports for credibility training in older adults can be used to improve the accuracy with which they evaluate online health information.

Assessing the Quality of Hearing Aids-Related Videos on TikTok

Hearing aids are effective at improving listening ability and health-related quality of life. Recently, we observed that there are many hearing aids-related videos published on TikTok. However, the quality of the information they offer remains unstudied. This study aimed to evaluate the information quality of hearing aids videos on TikTok. We collected a sample of 155 hearing aids-related videos in Chinese and extracted the basic information. First, we identified the source of each video. Two independent raters assessed the quality of the information in the videos, using the PEMAT-A/V tool and DISCERN instrument. Regarding content, the results showed that the video contents on TikTok mainly about features, functionalities, and suggestions of purchase or fitting of hearing aids, while the information about the disadvantages and complications of hearing aids was limited. The overall quality of the hearing aids-related videos was acceptable on average, although the quality varies greatly depending on the type of source. Patients should be cautious in obtaining information about hearing aids on TikTok.

The Importance of Social Influencer-Generated Contents for User Cognition and Emotional Attachment: An Information Relevance Perspective

It has become a marketing trend for marketers to use influencers to advertise and sell products because influencers can affect the attitudes and decision-making of other social media users. Most previous research on influencer marketing has concentrated on its effectiveness as a promotional tool. In contrast, there have been limited studies on the influencer-social media user relationship. The relationship that influencers have with other social media users is the foundation for the success of influencer marketing. Therefore, it is critical to investigate the factors that affect the influencers’ relationships with other users. In accordance with the concept of information relevance, this study presents a model relating the various attributes of influencer-generated content with emotional attachment and information quality to examine the relationship between influencers and other social media users. The findings of a survey of 280 respondents indicate that the interestingness, novelty, reliability, and understandability of influencer-generated content can effectively increase users’ emotional attachment to influencers. Reliability and understandability can also have a significant positive impact on information quality. This eventually inclines social media users to follow or recommend influencers to others, which can increase the popularity of influencers. This study helps researchers and marketers advance their understanding of influencers’ relationships with other social media users and offers management-related recommendations for influencers and marketers.

Short-Video Apps as a Health Information Source for Chronic Obstructive Pulmonary Disease: Information Quality Assessment of TikTok Videos

BACKGROUND

Chronic obstructive pulmonary disease (COPD) has become one of the most critical public health problems worldwide. Because many COPD patients are using video-based social media to search for health information, there is an urgent need to assess the information quality of COPD videos on social media. Recently, the short-video app TikTok has demonstrated huge potential in disseminating health information and there are currently many COPD videos available on TikTok; however, the information quality of these videos remains unknown.

OBJECTIVE

The aim of this study was to investigate the information quality of COPD videos on TikTok.

METHODS

In December 2020, we retrieved and screened 300 videos from TikTok and collected a sample of 199 COPD-related videos in Chinese for data extraction. We extracted the basic video information, coded the content, and identified the video sources. Two independent raters assessed the information quality of each video using the DISCERN instrument.

RESULTS

COPD videos on TikTok came mainly from two types of sources: individual users (n=168) and organizational users (n=31). The individual users included health professionals, individual science communicators, and general TikTok users, whereas the organizational users consisted of for-profit organizations, nonprofit organizations, and news agencies. For the 199 videos, the mean scores of the DISCERN items ranged from 3.42 to 4.46, with a total mean score of 3.75. Publication reliability (P=.04) and overall quality (P=.02) showed significant differences across the six types of sources, whereas the quality of treatment choices showed only a marginally significant difference (P=.053) across the different sources.

CONCLUSIONS

The overall information quality of COPD videos on TikTok is satisfactory, although the quality varies across different sources and according to specific quality dimensions. Patients should be selective and cautious when watching COPD videos on TikTok.

TikTok as a Health Information Source: Assessment of the Quality of Information in Diabetes-Related Videos

Background

Diabetes has become one of the most prevalent chronic diseases, and many people living with diabetes use social media to seek health information. Recently, an emerging social media app, TikTok, has received much interest owing to its popularity among general health consumers. We notice that there are many videos about diabetes on TikTok. However, it remains unclear whether the information in these videos is of satisfactory quality.

Objective

This study aimed to assess the quality of the information in diabetes-related videos on TikTok.

Methods

We collected a sample of 199 diabetes-related videos in Chinese. The basic information presented in the videos was coded and analyzed. First, we identified the source of each video. Next, 2 independent raters assessed each video in terms of the completeness of six types of content (the definition of the disease, symptoms, risk factors, evaluation, management, and outcomes). Then, the 2 raters independently assessed the quality of information in the videos, using the DISCERN instrument.

Results

In regard to the sources of the videos, we found 6 distinct types of uploaders; these included 3 kinds of individual users (ie, health professionals, general users, and science communicators) and 3 types of organizational users (ie, news agencies, nonprofit organizations, and for-profit organizations). Regarding content, our results show that the videos were primarily about diabetes management and contained limited information on the definition of the disease, symptoms, risk factors, evaluation, and outcomes. The overall quality of the videos was acceptable, on average, although the quality of the information varied, depending on the sources. The videos created by nonprofit organizations had the highest information quality, while the videos contributed by for-profit organizations had the lowest information quality.

Conclusions

Although the overall quality of the information in the diabetes videos on TikTok is acceptable, TikTok might not fully meet the health information needs of patients with diabetes, and they should exercise caution when using TikTok as a source of diabetes-related information.