TikTok and Bilibili as sources of information on Helicobacter pylori in China: A content and quality analysis

Health information in short videos about metabolic dysfunction-associated steatotic liver disease: Analysing quality and reliability

BACKGROUND & AIMS

Short videos, crucial for disseminating health information on metabolic dysfunction-associated steatotic liver disease (MASLD), lack a clear evaluation of quality and reliability. This study aimed to assess the quality and reliability of MASLD-related videos on Chinese platforms.

METHODS

Video samples were collected from three platforms (TikTok, Kwai and Bilibili) during the period from November 2019 to July 2023. Two independent reviewers evaluated the integrity of the information contained therein by scoring six key aspects of its content: definition, epidemiology, risk factors, outcomes, diagnosis and treatment. The quality and reliability of the videos were assessed using the Journal of the American Medical Association (JAMA) criteria, the Global Quality Score (GQS) and the modified DISCERN score.

RESULTS

A total of 198 videos were included. The video content exhibited an overall unsatisfactory quality, with a primary emphasis on risk factors and treatment, while diagnosis and epidemiology were seldom addressed. Regarding the sources of the videos, the GQS and modified DISCERN scores varied significantly between the platforms (p = .003), although they had generally similar JAMA scores (p = .251). Videos created by medical professionals differed significantly in terms of JAMA scores (p = .046) compared to those created by nonmedical professionals, but there were no statistically significant differences in GQS (p = .923) or modified DISCERN scores (p = .317).

CONCLUSIONS

The overall quality and reliability of the videos were poor and varied between platforms and uploaders. Platforms and healthcare professionals should strive to provide more reliable health-related information regarding MASLD.

Evaluation of TikTok videos on acute pancreatitis: content quality and reliability analysis

BACKGROUND

Acute pancreatitis (AP) is a common acute digestive system disorder, with patients often turning to TikTok for AP-related information. However, the platform's video quality on AP has not been thoroughly investigated.

OBJECTIVE

The main purpose of this study is to evaluate the quality of videos about AP on TikTok, and the secondary purpose is to study the related factors of video quality.

METHODS

This study involved retrieving AP-related videos from TikTok, determining, and analyzing them based on predefined inclusion and exclusion criteria. Relevant data were extracted and compiled for evaluation. Video quality was scored using the DISCERN instrument and the Health on the Net (HONcode) score, complemented by introducing the Acute Pancreatitis Content Score (APCS). Pearson correlation analysis was used to assess the correlation between video quality scores and user engagement metrics such as likes, comments, favorites, retweets, and video duration.

RESULTS

A total of 111 TikTok videos were included for analysis, and video publishers were composed of physicians (89.18%), news media organizations (13.51%), individual users (5.41%), and medical institutions (0.9%). The majority of videos focused on AP-related educational content (64.87%), followed by physicians' diagnostic and treatment records (15.32%), and personal experiences (19.81%). The mean scores for DISCERN, HONcode, and APCS were 33.05 ± 7.87, 3.09 ± 0.93, and 1.86 ± 1.30, respectively. The highest video scores were those posted by physicians (35.17 ± 7.02 for DISCERN, 3.31 ± 0.56 for HONcode, and 1.94 ± 1.34 for APCS, respectively). According to the APCS, the main contents focused on etiology (n = 55, 49.5%) and clinical presentations (n = 36, 32.4%), followed by treatment (n = 24, 21.6%), severity (n = 20, 18.0%), prevention (n = 19, 17.1%), pathophysiology (n = 17, 15.3%), definitions (n = 13, 11.7%), examinations (n = 10, 9%), and other related content. There was no correlation between the scores of the three evaluation tools and the number of followers, likes, comments, favorites, and retweets of the video. However, DISCERN (r = 0.309) and APCS (r = 0.407) showed a significant positive correlation with video duration, while HONcode showed no correlation with the duration of the video.

CONCLUSIONS

The general quality of TikTok videos related to AP is poor; however, the content posted by medical professionals shows relatively higher quality, predominantly focusing on clinical presentations and etiologies. There is a discernible correlation between video duration and quality ratings, indicating that a combined approach incorporating the guideline can comprehensively evaluate AP-related content on TikTok.

The status quo of short videos as a source of health information regarding bowel preparation before colonoscopy

Background

For high-quality colonoscopies, adequate bowel preparation is a prerequisite, closely associated with the diagnostic accuracy and therapeutic safety of colonoscopy. Although popular-science short videos can help people quickly access health information, the overall quality of such short videos as a source of health information regarding bowel preparation before colonoscopy is unclear. Therefore, we intend to conduct a cross-sectional study to investigate the quality of bowel preparation information before colonoscopy through short videos taken on TikTok and Bilibili.

Methods

The Chinese phrases "colonoscopy" and "bowel preparation" were used as keywords to search for and screen the top 100 videos in the comprehensive rankings on TikTok and Bilibili. The Global Quality Score (GQS) and the modified DISCERN score were used to assess the quality of the information provided in these short videos.

Results

A total of 186 short videos were included in this study; 56.5% of them were posted by health professionals, whereas 43.5% of them were posted by nonhealth professionals. The overall quality of these videos was unsatisfactory, with a median DISCERN score of 3 (2-4) and a median GQS of 3 (3-4). The radar maps showed that videos posted by gastroenterologists had higher completeness scores regarding outcomes, management, and risk factors, while nongastroenterologists had higher completeness scores concerning adverse effects, symptoms, and definitions of bowel preparation. Additionally, the median DISCERN score and GQS of the videos posted by gastroenterologists were 3 (3-4) and 3 (3-4), respectively, whereas the quality of the videos posted by patients was the worst, with a median DISCERN score of 2 (1-2) and a median GQS of 2 (1.25-3).

Conclusion

In conclusion, the overall quality of health information-related videos on bowel preparation before colonoscopy posted on specified short video platforms was not satisfactory. Gastroenterologists provide more information on the outcomes, management, and risk factors for bowel preparation before colonoscopy, while nongastroenterologists focus on adverse effects, symptoms, and definitions of bowel preparation.

Assessment of the reliability and quality of breast cancer related videos on TikTok and Bilibili: cross-sectional study in China

Background

As the most common malignant tumor in the world, breast cancer also brings a huge disease burden to China. Ordinary people are increasingly inclined to use the Internet, especially video social platforms, as a source of health information. Educating the public to obtain correct information is important to reduce the incidence of breast cancer and improve the prognosis. However, the quality and reliability of breast cancer-related video content have not been fully studied.

Objective

This study aims to evaluate the quality of the information of breast cancer-related videos on TikTok and Bilibili video sharing platforms and factors related to video quality.

Methods

We collected the top 100 videos about breast cancer on TikTok and Bilibili, respectively. Categorize videos according to video source and video content. Video quality and reliability were assessed using Global Quality Score (GQS) and modified DISCERN (mDISCERN) tools. We also analyzed the correlation between video quality and video likes, comments, saves, and shares.

Results

Although the quality and reliability of Bilibili's breast cancer videos were higher than TikTok (p = 0.002 and p = 0.001, respectively), the video quality of both video sharing platforms was not satisfactory, with a median GQS scores of 2.00 and 3.00 and mDISCERN scores of 1.00 and 2.00, respectively. In general, the quality and reliability of videos released by medical practitioners were higher than those of non-medical practitioners, and the quality and reliability of videos covering disease-related knowledge were higher than those of news reports (all p < 0.001). Among medical practitioners, the quality of videos uploaded by doctors in breast disease was significantly lower than that of doctors in other areas (p < 0.05). There was a significant positive correlation between video quality and duration (r = 0.240, p < 0.001), a weak negative correlation between video quality and likes (r = 0.191, p < 0.01), video quality and comments (r = 0.256, p < 0.001), video reliability and likes (r = 0.198, p < 0.001), video reliability and comments (r = 0.243, p < 0.01).

Conclusion

Our study shows that the quality and reliability of breast cancer-related videos on TikTok and Bilibili are poor, and the overall quality is unsatisfactory. But videos uploaded by medical practitioners covering disease knowledge, prevention and treatment are of higher quality. Medical practitioners are encouraged to publish more high-quality videos, while video social platforms should formulate relevant policies to censor and supervise health education videos, so as to enable the public to obtain reliable health information.

The status quo of short videos as a health information source of Helicobacter pylori: a cross-sectional study

Background

Health education about Helicobacter pylori (H. pylori) is one of the most effective methods to prevent H. pylori infection and standardize H. pylori eradication treatment. Short videos enable people to absorb and remember information more easily and are an important source of health education. This study aimed to assess the information quality of H. pylori-related videos on Chinese short video-sharing platforms.

Methods

A total of 242 H. pylori-related videos from three Chinese short video-sharing platforms with the most users, TikTok, Bilibili, and Kwai, were retrieved. The Global Quality Score (GQS) and the modified DISCERN tool were used to assess the quality and content of videos, respectively. Additionally, comparative analyzes of videos based on different sources and common H. pylori issues were also conducted.

Results

The median GQS score and DISCERN score was 2 for H. pylori-related videos analyzed in this study. Non-gastroenterologists posted the most H. pylori-related videos (136/242, 56.2%). Videos from gastroenterologists (51/242, 21.0%) had the highest GQS and DISCERN scores, with a median of 3. Few videos had content on family-based H. pylori infection control and management (5.8%), whether all H. pylori-positive patients need to undergo eradication treatment (27.7%), and the adverse effects of H. pylori eradication therapy (16.1%).

Conclusion

Generally, the content and quality of the information in H. pylori-related videos were unsatisfactory, and the quality of the video correlated with the source of the video. Videos from gastroenterologists provided more correct guidance with higher-quality information on the prevention and treatment of H. pylori infection.

Information quality of videos related to Helicobacter pylori infection on TikTok: Cross-sectional study

BACKGROUND

Helicobacter pylori (H. pylori) poses serious threats to human health. TikTok (Douyin in Chinese), a major social media platform focused on sharing short videos, has demonstrated great potential in spreading health information, including information related to H. pylori infection. This study aims to evaluate the content and quality of the information shared in TikTok videos about H. pylori infection in mainland China.

METHODS

We collected a sample of 116 videos in Chinese related to H. pylori infection from TikTok. Video contents were evaluated by the coding schema proposed by Goobie et al., and the Hexagonal Radar Schema was used to intuitively display the spotlight and weight of each aspect of the videos. The DISCERN questionnaire was used to evaluate the quality of the videos.

RESULTS

We identified two major sources of videos related to H. pylori: individual users (n = 89) and organizational users (n = 27). Regarding content, the Hexagonal Radar Charts showed that more than 35% of the videos delivered moderate to high quality content (>1 point) in terms of definition, symptoms and management of the disease, whereas risk factors, evaluation and outcomes of the disease were less discussed. The DISCERN classification data showed that 0.9% of the videos were "very poor," 5.2% "poor," 68.7% "fair," 20.0% "good," and only 5.2% "excellent". Regarding total DISCERN scores, videos published by nonprofit organizations had the highest scores, followed by videos uploaded by health professionals.

CONCLUSION

Although the overall quality of TikTok videos related to H. pylori infection was medium, users should be careful when obtaining information related to H. pylori infection on TikTok and opt for videos uploaded by nonprofit organizations and health professionals.