Quality and Reliability of Liver Cancer-Related Short Chinese Videos on TikTok and Bilibili: Cross-Sectional Content Analysis Study

Evaluating the Content and Quality of Videos Related to Hypertrophic Scarring on TikTok in China: Cross-Sectional Study

BACKGROUND

Hypertrophic scars (HTSs) are a predominant condition after burns and trauma, and it causes severe physiological and psychological problems. TikTok (Douyin in Chinese), a popular platform for sharing short videos, has shown the potential to spread health information, including information related to HTSs. Educating the public to obtain correct information is important to reduce the incidence of physiological and psychological problems caused by HTSs. However, the quality and reliability of HTS-related video content on TikTok in mainland China have not been thoroughly studied.

OBJECTIVE

This study aims to evaluate the content and quality of short videos related to HTSs on the Chinese version of TikTok (Douyin) and explore the factors related to their quality, providing valuable insights for health information dissemination.

METHODS

We collected a sample of 153 TikTok videos in Chinese related to HTSs and categorized them according to video source and content. We evaluated the video content using a coding schema, and a hexagonal radar schema was used to intuitively display the spotlight and weight of each aspect of the videos. We evaluated quality using 4 standardized tools: the modified DISCERN (mDISCERN) questionnaire, the Journal of the American Medical Association, the Global Quality Scale (GQS), and the Health on the Net Foundation Code of Conduct. We also explored the potential relationship between video quality and characteristics.

RESULTS

The analysis showed that health care professionals uploaded all videos about treating HTSs, which matched the hexagonal radar model analysis findings. The quality assessment scores for the Journal of the American Medical Association, GQS, mDISCERN, and the Health on the Net Foundation Code of Conduct had median values of 1 (IQR 1-2), 2 (IQR 2-3), 2 (IQR 2-3), and 3 (IQR 3-4), respectively, indicating a need to improve the quality and reliability of videos on HTSs. In addition, high-quality videos were more popular, based on metrics such as likes, comments, favorites, and shares (P<.001). Interestingly, the time when the videos were uploaded positively correlated with GQS and mDISCERN scores (r=0.393; P<.001 and r=0.273; P<.001), while the video length did not significantly correlate with evaluation scores (P=.78, P=.20, P=.07, and P=.04).

CONCLUSIONS

The quality of TikTok videos related to HTSs is generally moderate. Users should exercise caution when seeking information on HTSs from TikTok. It is advisable to choose videos uploaded by health care professionals from the burn department and the burn plastic surgery department, and in the Chinese context, those produced in first-tier cities and emerging first-tier cities.

Exploring TikTok's influence on surgical patient education

INTRODUCTION

Social media platforms, especially rapidly growing ones like TikTok, are increasingly used to disseminate health information. Its interactive features promote user participation, allowing for the sharing of experiences and raising awareness about specific medical conditions, while also simplifying complex procedures. This study aimed to explore the possible influence of TikTok short-video application on the education of surgical patients.

METHODS

A systematic search was performed in compliance with the PRISMA checklist. The research protocol was registered with the PROSPERO register (CRD42024551646). A search was performed in the PubMed and ScienceDirect databases from inception to 2024. The search terms used were "TikTok AND Surgery," "TikTok AND Surgical Education," and "TikTok AND surgery AND patient."

RESULTS

The present systematic search resulted in 697 citations, of which 50 relevant citations were included. The search revealed that TikTok has widely used among patients from different surgical specialties and has an influence on their education. The platform facilitates public health awareness, allowing surgeons to share educational content, including surgical techniques and patient-oriented information.

CONCLUSION

As one of the rapidly growing social media platforms, TikTok is increasingly utilised to disseminate health information. It has been adopted across various surgical specialties. While the platform presents a great opportunity to improve the education of surgical patients, it presents challenges related to the accuracy of information, potential misinformation, and lack of regulation. Surgeons and healthcare professionals should actively participate in creating accurate, evidence-based content that enhances patient education and promotes public health awareness.

Reliability and Educational Suitability of TikTok Videos as a Source of Information on Sleep and Awake Bruxism: A Cross-Sectional Analysis

BACKGROUND

TikTok contains many videos about bruxism that may help raise the level of awareness on the topic. However, the quality of these videos' information represents the greatest concern.

OBJECTIVE

The present cross-sectional analysis aimed to systematically assess the reliability and educational suitability of TikTok videos as a source of information on bruxism.

METHODS

TikTok was searched for relevant videos uploaded until 6 March 2024, using the hashtags #bruxism, #grindingteeth and #jawclenching. Independent pre-calibrated operators conducted video inclusion and data collection, noting videos' characteristics, source, popularity, content, reliability (assessed through the DISCERN scoring system) and educational value (assessed through the Global Quality Score [GQS]). The Kruskal-Wallis test was adopted to compare videos from different sources. Videos with low and high educational value were compared using the Mann-Whitney U-test. Tests were considered significant when the p-value was < 0.05.

RESULTS

A total of 105 bruxism videos were analysed. Most videos covered bruxism management and clinical features, and more than 60% were uploaded by healthcare professionals. According to the DISCERN and GQS scoring, the videos' reliability and educational value were judged to be very poor and low, respectively, but on average they were higher for videos uploaded by healthcare professionals compared to those uploaded by laypeople. When comparing videos with high educational value to those with low educational value, differences were found in popularity, content and reliability.

CONCLUSION

The present results suggest the need for greater control of information disseminated on social media to fulfil its potential role in educating laypeople about bruxism.

The Reliability and Quality of Videos as Guidance for Gastrointestinal Endoscopy: Cross-Sectional Study

BACKGROUND

Gastrointestinal endoscopy represents a useful tool for the diagnosis and treatment of gastrointestinal diseases. Video platforms for spreading endoscopy-related knowledge may help patients understand the pros and cons of endoscopy on the premise of ensuring accuracy. However, videos with misinformation may lead to adverse consequences.

OBJECTIVE

This study aims to evaluate the quality of gastrointestinal endoscopy-related videos on YouTube and to assess whether large language models (LLMs) can help patients obtain information from videos more efficiently.

METHODS

We collected information from YouTube videos about 3 commonly used gastrointestinal endoscopes (gastroscopy, colonoscopy, and capsule endoscopy) and assessed their quality (rated by the modified DISCERN Tool, mDISCERN), reliability (rated by the Journal of the American Medical Association), and recommendation (rated by the Global Quality Score). We tasked LLM with summarizing the video content and assessed it from 3 perspectives: accuracy, completeness, and readability.

RESULTS

A total of 167 videos were included. According to the indicated scoring, the quality, reliability, and recommendation of the 3 gastrointestinal endoscopy-related videos on YouTube were overall unsatisfactory, and the quality of the videos released by patients was particularly poor. Capsule endoscopy yielded a significantly lower Global Quality Score than did gastroscopy and colonoscopy. LLM-based summaries yielded accuracy scores of 4 (IQR 4-5), completeness scores of 4 (IQR 4-5), and readability scores of 2 (IQR 1-2).

CONCLUSIONS

The quality of gastrointestinal endoscope-related videos currently on YouTube is poor. Moreover, additional regulatory and improvement strategies are needed in the future. LLM may be helpful in generalizing video-related information, but there is still room for improvement in its ability.

The quality and reliability of online video resources concerning patient education for migraine treatment in China Mainland: an electronic media-based study

BACKGROUND

Migraine is an extremely prevalent and disabling primary neurological disease worldwide. Although multiple forms of patient education for migraine management have been employed in the past decades, the quality and reliability of headache-related online videos targeting migraine patients remained unclear, particularly those in China. Therefore, in this study, our research team aimed to explore the overall quality and credibility of online videos concerning patient education on migraine treatment in China Mainland.

METHODS

A total of 182 online videos concerning migraine treatment were retrieved from four most popular Chinese language online video platforms, including Douyin, BiliBili, Haokan Video, and Xigua Video. Our research team collected the producer identity and basic information of these videos, and then used two major score instruments, i.e., the Global Quality Score (GQS) scale and the DISCERN questionnaire, to evaluate the quality and reliability of its content. Subsequently, overall descriptive analysis and detailed comparison among specific video platforms and producers were performed. Finally, using the Spearman correlation coefficient, we also explored the potential correlation between video general information and video quality and reliability.

RESULTS

The overall quality and reliability of the migraine-related information provided by online videos were poor, yet those uploaded to Douyin were relatively more satisfactory. Among all study videos, 10 encouraged patients to keep a headache diary, 12 warned about the risk of medication overuse, and 32 emphasized the preventive treatment of chronic migraine. However, the treatment recommendations proposed by video creators were highly heterogenous, with the most frequently mentioned pharmacological, non-pharmacological, and traditional Chinese medicine measures being Triptans (n = 57, 31.3%), massage (n = 40, 22.0%), and acupuncture (n = 31, 17.0%), respectively. We also observed slight positive correlations between video quality and the numbers of likes and comments received.

CONCLUSIONS

The results of our research revealed that the quality and reliability of Chinese language online videos focused on patient education for migraine treatment were inadequate, suggesting that viewers should treat these contents with caution. However, the prospects for video-based patient education remain promising. Implementing appropriate strategies, such as strengthening regulations on health-related videos and instituting a review process conducted by medical professionals, may elevate the overall quality and trustworthiness of medical information shared through online video platforms.

The reliability and quality of short videos as health information of guidance for lymphedema: a cross-sectional study

Background

The prevalence of lymphedema is rising, necessitating accurate diagnostic and treatment information for affected patients. Short video-sharing platforms facilitate access to such information but require validation regarding the reliability and quality of the content presented. This study aimed to assess the reliability and quality of lymphedema-related information on Chinese short video-sharing platforms.

Methods

We collected 111 video samples addressing the diagnosis and treatment of lymphedema from four platforms: TikTok, Bilibili, WeChat, and Microblog. Two independent surgeons evaluated each video for content comprehensiveness, quality (using the Global Quality Score), and reliability (using the modified DISCERN tool). The videos from different sources were subsequently compared and analyzed.

Results

Out of 111 videos analyzed, 66 (59.46%) were uploaded by medical professionals, including breast surgeons, vascular surgeons, plastic surgeons, physical therapists, and gynecologists, while 45 (40.54%) were shared by non-medical professionals such as science bloggers, medical institutions, and lymphedema patients. Patient-uploaded videos received the highest engagement, with median likes of 2,257 (IQR: 246.25-10998.25) and favorites of 399 (IQR: 94.5-1794.75). 13 videos (11.71%) contained inaccuracies. Medical professionals' videos generally showed higher content comprehensiveness, particularly those by plastic surgeons, compared to non-medical professionals. The GQS and modified DISCERN tool were used to assess video quality and reliability respectively, with medical professionals scoring higher on both metrics (z = 3.127, p = 0.002; z = 2.010, p = 0.044). The quality and reliability of recommendations provided by plastic surgeons surpassed that of other medical professionals (χ 2 = 16.196, p = 0.003; χ 2 = 9.700, p = 0.046). No significant differences in video quality and reliability were found among the three categories of non-medical professionals (χ 2 = 3.491, p = 0.175; χ 2 = 2.098, p = 0.350).

Conclusion

Our study shows that lymphedema-related videos on short video platforms vary widely in quality. Videos by medical professionals are generally more accurate and of higher quality than those by non-professionals. However, patient-uploaded videos often get more engagement due to their relatability. To ensure public access to reliable information, establishing basic standards for this content is essential.

Comparative analysis of NAFLD-related health videos on TikTok: a cross-language study in the USA and China

BACKGROUND

The incidence of Non-alcoholic fatty liver disease (NAFLD) in China and USA is extremely high and rising. TikTok has become a popular channel for medical information dissemination and we aimed to evaluate the quality and reliability of NAFLD related videos on TikTok, in both its USA and Chinese versions.

METHODS

We analyzed the top 100 NAFLD videos on both the USA version and Chinese version of TikTok, a total of 200 videos, from which keywords were extracted and scored using the Global Quality Scale (GQS), modified DISCERN (mDISCERN), and Medical Quality Video Evaluation Tool (MQ-VET). Exploring the relationship between video quality and audience related factors, as well as ranking, through Spearman correlation analysis.

RESULTS

The mDISCERN scores of videos on the USA version of TikTok is higher than that on the Chinese version (P < 0.01), but there is no significant difference in the GQS and MQ-VET scores. The GQS, mDISCERN and MQ-VET scores of videos published by medical practitioners were significantly higher than those of non-medical practitioners (P < 0.001). However, there was no significant correlation between video quality and popularity indicators.

CONCLUSION

The quality of NAFLD related short videos on TikTok is acceptable, but the reliability is mediocre, and there is still room for improvement. The videos published by USA medical practitioners are more reliable than those of Chinese medical practitioners. The most concerned topic of both countries is diet. The TikTok recommendation algorithm may limit access to high-quality health videos, and further research on other platforms and languages is necessary.

Analyzing dissemination, quality, and reliability of Chinese brain tumor-related short videos on TikTok and Bilibili: a cross-sectional study

Background

As the Internet becomes an increasingly vital source of medical information, the quality and reliability of brain tumor-related short videos on platforms such as TikTok and Bilibili have not been adequately evaluated. Therefore, this study aims to assess these aspects and explore the factors influencing the dissemination of such videos.

Methods

A cross-sectional analysis was conducted on the top 100 brain tumor-related short videos from TikTok and Bilibili. The videos were evaluated using the Global Quality Score and the DISCERN reliability instrument. An eXtreme Gradient Boosting algorithm was utilized to predict dissemination outcomes. The videos were also categorized by content type and uploader.

Results

TikTok videos scored relatively higher on both the Global Quality Score (median 2, interquartile range [2, 3] on TikTok vs. median 2, interquartile range [1, 2] on Bilibili, p = 1.51E-04) and the DISCERN reliability instrument (median 15, interquartile range [13, 18.25] on TikTok vs. 13.5, interquartile range [11, 16] on Bilibili, p = 1.66E-04). Subgroup analysis revealed that videos uploaded by professional individuals and institutions had higher quality and reliability compared to those uploaded by non-professional entities. Videos focusing on disease knowledge exhibited the highest quality and reliability compared to other content types. The number of followers emerged as the most important variable in our dissemination prediction model.

Conclusion

The overall quality and reliability of brain tumor-related short videos on TikTok and Bilibili were unsatisfactory and did not significantly influence video dissemination. Future research should expand the scope to better understand the factors driving the dissemination of medical-themed videos.

How do health content creators perform well? An integration research of short video and livestream behaviors

Introduction

Short-video platforms have demonstrated vast potential for health education. To meet diverse user requirements, many short-video platforms have integrated livestreaming functionalities. This integration presents challenges for health content creators in formulating effective performance strategies, including decisions about which format to use (short video or livestream) and what type of content to produce. This study utilizes panel data from a prominent short-video platform in China to empirically investigate the impact of different forms and content characteristics on the performance of health content creators.

Methods

We conducted an empirical analysis using panel data obtained from a leading short-video platform in China. Our analysis focused on understanding how the behaviors associated with short videos and livestreaming impact the performance of health content creators. We examined form-level differences, analyzing the distinct roles of short video and livestreaming behaviors. Additionally, we explored content-level characteristics, investigating the effects of content coverage, health knowledge content, and advertising content on both short-term and long-term performance. The moderation effects of the creator's occupation and certification type were also analyzed.

Results

Our form-level analysis revealed that health creators' behaviors in short videos and livestreaming play distinct roles in their performance. Livestreaming behaviors resulted in short-term economic returns, while short video behaviors had a more significant effect on follow-ups, which are often viewed as long-term, more sustainable performance indicators. Content-level analysis showed that content coverage and health knowledge content enhance long-term performance but do not increase short-term performance. Conversely, advertising content was found to be essential for securing short-term financial income. The study also identified that the creator's occupation and certification type moderate the impact of content on performance.

Conclusion

This study integrates two media forms (short video and livestream), providing direct insights into the performance of health content creators in the realm of health education. Health content creators need to strategically balance their use of short videos and livestreaming to optimize both short-term and long-term performance outcomes. Specifically, increasing content coverage and health knowledge can enhance long-term engagement, while incorporating advertising content is crucial for immediate financial gains.

Douyin and Bilibili as sources of information on lung cancer in China through assessment and analysis of the content and quality

Lung cancer has emerged as a major global public health concern. With growing public interest in lung cancer, online searches for related information have surged. However, a comprehensive evaluation of the credibility, quality, and value of lung cancer-related videos on digital media platforms remains unexamined. This study aimed to assess the informational quality and content of lung cancer-related videos on Douyin and Bilibili. A total of 200 lung cancer-related videos that met the criteria were selected from Douyin and Bilibili for evaluation and analysis. The first step involved recording and analyzing the basic information provided in the videos. Subsequently, the source and type of content for each video were identified. All videos' educational content and quality were then evaluated using JAMA, GQS, and Modified DISCERN. Douyin videos were found to be more popular in terms of likes, comments, favorites, and shares, whereas Bilibili videos were longer in duration (P < .001). The majority of video content on both platforms comprised lung cancer introductions (31/100, 31%), with medical professionals being the primary source of uploaded videos (Douyin, n = 55, 55%; Bilibili, n = 43, 43%). General users on Douyin scored the lowest on the JAMA scale, whereas for-profit businesses scored the highest (2.50 points). The results indicated that the videos' informational quality was insufficient. Videos from science communications and health professionals were deemed more reliable regarding completeness and content quality compared to videos from other sources. The public should exercise caution and consider the scientific validity when seeking healthcare information on short video platforms.

Quality assessment of heatstroke videos on TikTok

Background

The prevalence of heatstroke is rising due to global warming, making it a serious but preventable condition, highlighting the urgent need for effective dissemination of relevant health education to the general public. Advances in technology have made accessing health information more convenient and rapid. In recent years, short videos have become a primary medium for delivering health education, with TikTok gaining considerable popularity among the general public. However, the quality of heatstroke-related health education content on TikTok deserves closer scrutiny.

Objective

This study aimed to evaluate the quality and content of heatstroke-related videos available on TikTok.

Methods

The present study analyzed the top 100 heatstroke-related short videos on TikTok, focusing on their characteristics, quality, and the content they conveyed. The quality of these videos was assessed using the DISCERN instrument. In addition, the completeness of the videos was assessed by examining six key aspects: disease definition, clinical manifestations, risk factors, assessment, management, and outcomes.

Results

The study included a total of 90 videos. The results showed that news organizations and healthcare professionals were the primary contributors to these videos, with those from news organizations receiving the most attention. In contrast, those from healthcare professionals received comparatively less engagement. Overall, the quality of the information was found to be moderately low, with the highest quality videos posted by non-profit organizations, followed by those posted by healthcare professionals. The majority of videos uploaded described the disease definition, clinical presentation, risk factors, assessment, management, and outcomes of heatstroke.

Conclusion

The quality of information provided in heatstroke-related short videos on TikTok is generally inadequate and requires significant improvement. In addition, such content should be subject to government review to ensure its accuracy and reliability.

The Quality of Short Videos as a Source of Coronary Heart Disease Information on TikTok: Cross-Sectional Study

BACKGROUND

Coronary heart disease (CHD) is a leading cause of death worldwide and imposes a significant economic burden. TikTok has risen as a favored platform within the social media sphere for disseminating CHD-related information and stands as a pivotal resource for patients seeking knowledge about CHD. However, the quality of such content on TikTok remains largely unexplored.

OBJECTIVE

This study aims to assess the quality of information conveyed in TikTok CHD-related videos.

METHODS

A comprehensive cross-sectional study was undertaken on TikTok videos related to CHD. The sources of the videos were identified and analyzed. The comprehensiveness of content was assessed through 6 questions addressing the definition, signs and symptoms, risk factors, evaluation, management, and outcomes. The quality of the videos was assessed using 3 standardized evaluative instruments: DISCERN, the Journal of the American Medical Association (JAMA) benchmarks, and the Global Quality Scale (GQS). Furthermore, correlative analyses between video quality and characteristics of the uploaders and the videos themselves were conducted.

RESULTS

The search yielded 145 CHD-related videos from TikTok, predominantly uploaded by health professionals (n=128, 88.3%), followed by news agencies (n=6, 4.1%), nonprofit organizations (n=10, 6.9%), and for-profit organizations (n=1, 0.7%). Content comprehensiveness achieved a median score of 3 (IQR 2-4). Median values for the DISCERN, JAMA, and GQS evaluations across all videos stood at 27 (IQR 24-32), 2 (IQR 2-2), and 2 (IQR 2-3), respectively. Videos from health professionals and nonprofit organizations attained significantly superior JAMA scores in comparison to those of news agencies (P<.001 and P=.02, respectively), whereas GQS scores for videos from health professionals were also notably higher than those from news agencies (P=.048). Within health professionals, cardiologists demonstrated discernibly enhanced performance over noncardiologists in both DISCERN and GQS assessments (P=.02). Correlative analyses unveiled positive correlations between video quality and uploader metrics, encompassing the positive correlations between the number of followers; total likes; average likes per video; and established quality indices such as DISCERN, JAMA, or GQS scores. Similar investigations relating to video attributes showed correlations between user engagement factors-likes, comments, collections, shares-and the aforementioned quality indicators. In contrast, a negative correlation emerged between the number of days since upload and quality indices, while a longer video duration corresponded positively with higher DISCERN and GQS scores.

CONCLUSIONS

The quality of the videos was generally poor, with significant disparities based on source category. The content comprehensiveness coverage proved insufficient, casting doubts on the reliability and quality of the information relayed through these videos. Among health professionals, video contributions from cardiologists exhibited superior quality compared to noncardiologists. As TikTok's role in health information dissemination expands, ensuring accurate and reliable content is crucial to better meet patients' needs for CHD information that conventional health education fails to fulfill.

Evaluating the Quality and Impact of TikTok Videos on Autologous Breast Reconstruction with Deep Inferior Epigastric Perforator Artery Flaps

Background

With the rising influence of social media on healthcare perceptions, this study investigates TikTok's role in educating the public about autologous breast reconstruction, specifically focusing on deep inferior epigastric perforator flaps.

Methods

We conducted a systematic analysis of 152 TikTok videos related to deep inferior epigastric perforator flap procedures, evaluating the accuracy of the content, viewer engagement metrics, and the influence of content creator characteristics on viewer interactions.

Results

Our analysis identified a wide variance in the quality of information, with many videos lacking in-depth educational content, thereby posing a risk of misinformation. Despite the presence of high-quality educational videos, there was a discrepancy between the educational value provided and viewer engagement levels. Thematic analysis highlighted common concerns among patients, providing insights for healthcare professionals to better tailor their social media content.

Conclusions

The study underscores the significant impact of platforms like TikTok on patient education and emphasizes the need for healthcare professionals to guide the narrative on social media and ensure the dissemination of accurate and helpful information, ultimately aiding patients in making informed decisions about their healthcare.

Public Fear of Pancreatic Diseases: Causes and Clinical Outcomes at a Single Korean Center

Background/Aims

The public fear of pancreatic diseases including pancreatic cancer (PC) appears to be growing. The aims of this study were to evaluate the causes of fear of pancreatic diseases and assess clinical outcomes of such individuals.

Methods

This was a retrospective study of 249 individuals who visited the Pancreatobiliary Diseases Center at Ewha Womans University Seoul Hospital due to the fear of pancreatic diseases between January 2019 and August 2021. Those referred from other departments or external medical facilities were excluded. Collected data included demographic details, comorbidities, causes of fear of pancreatic diseases, and the presence of pancreatic lesions in imaging studies.

Results

The median age was 55 years (range, 22 to 82 years). One hundred eleven subjects (44.6%) were male. The causes of fear of pancreatic diseases were abdominal pain (n=144, 57.8%), back pain (n=114, 45.8%), body weight change (n=35, 14.1%), family history of pancreatic diseases (n=32, 12.9%), and others (n=39, 15.7%). Within the group with family history of pancreatic diseases, 25 subjects had a first-degree relative with PC. Of the 200 subjects who underwent imaging, there was no evidence of pancreatic diseases in 182 (91.0%). Pancreatic lesions identified were cystic lesions (n=15, 7.5%), non-specific calcification (n=1, 0.5%), lipoma (n=1, 0.5%), and solid tumor (n=1, 0.5%), later diagnosed as unresectable PC.

Conclusions

Abdominal pain and back pain were the major causes of fear of pancreatic diseases. The prevalence of PC among those who underwent imaging was 0.5%. Such characteristics should be considered when consulting individuals with fear of pancreatic diseases.

YouTube/ Bilibili/ TikTok videos as sources of medical information on laryngeal carcinoma: cross-sectional content analysis study

BACKGROUND

YouTube, a widely recognized global video platform, is inaccessible in China, whereas Bilibili and TikTok are popular platforms for long and short videos, respectively. There are many videos related to laryngeal carcinoma on these platforms. This study aims to identify upload sources, contents, and feature information of these videos on YouTube, Bilibili, and TikTok, and further evaluate the video quality.

METHODS

On January 1, 2024, we searched the top 100 videos by default sort order (300 videos in total) with the terms "laryngeal carcinoma" and "throat cancer" on YouTube, "" on Bilibili and TikTok. Videos were screened for relevance and similarity. Video characteristics were documented, and quality was assessed by using the Patient Education Materials Assessment Tool (PEMAT), Video Information and Quality Index (VIQI), Global Quality Score (GQS), and modified DISCERN (mDISCERN).

RESULTS

The analysis included 99 YouTube videos, 76 from Bilibili, and 73 from TikTok. Median video lengths were 193 s (YouTube), 136 s (Bilibili), and 42 s (TikTok). TikTok videos demonstrated higher audience interaction. Bilibili had the lowest ratio of original contents (69.7%). Treatment was the most popular topic on YouTube and Bilibili, while that was the prognosis on TikTok. Solo narration was the most common video style across all platforms. Video uploaders were predominantly non-profit organizations (YouTube), self-media (Bilibili), and doctors (TikTok), with TikTok authors having the highest certification rate (83.3%). Video quality, assessed using PEMAT, VIQI, GQS, and mDISCERN, varied across platforms, with YouTube generally showing the highest scores. Videos from professional authors performed better than videos from non-professionals based on the GQS and mDISCERN scores. Spearman correlation analysis showed no strong relationships between the video quality and the audience interaction.

CONCLUSIONS

Videos on social media platforms can help the public learn about the knowledge of laryngeal cancer to some extent. TikTok achieves the best flow, but videos on YouTube are of the best quality. However, the video quality across all platforms still needs enhancement. We need more professional uploaders to ameliorate the video quality related to laryngeal carcinoma. Content creators also should be aware of the certification, the originality, and the style of video shooting. As for the platforms, refining the algorithm will allow users to receive more high-quality videos.

Health information in short videos about metabolic dysfunction-associated steatotic liver disease: Analysing quality and reliability

BACKGROUND & AIMS

Short videos, crucial for disseminating health information on metabolic dysfunction-associated steatotic liver disease (MASLD), lack a clear evaluation of quality and reliability. This study aimed to assess the quality and reliability of MASLD-related videos on Chinese platforms.

METHODS

Video samples were collected from three platforms (TikTok, Kwai and Bilibili) during the period from November 2019 to July 2023. Two independent reviewers evaluated the integrity of the information contained therein by scoring six key aspects of its content: definition, epidemiology, risk factors, outcomes, diagnosis and treatment. The quality and reliability of the videos were assessed using the Journal of the American Medical Association (JAMA) criteria, the Global Quality Score (GQS) and the modified DISCERN score.

RESULTS

A total of 198 videos were included. The video content exhibited an overall unsatisfactory quality, with a primary emphasis on risk factors and treatment, while diagnosis and epidemiology were seldom addressed. Regarding the sources of the videos, the GQS and modified DISCERN scores varied significantly between the platforms (p = .003), although they had generally similar JAMA scores (p = .251). Videos created by medical professionals differed significantly in terms of JAMA scores (p = .046) compared to those created by nonmedical professionals, but there were no statistically significant differences in GQS (p = .923) or modified DISCERN scores (p = .317).

CONCLUSIONS

The overall quality and reliability of the videos were poor and varied between platforms and uploaders. Platforms and healthcare professionals should strive to provide more reliable health-related information regarding MASLD.

Evaluation of TikTok videos on acute pancreatitis: content quality and reliability analysis

BACKGROUND

Acute pancreatitis (AP) is a common acute digestive system disorder, with patients often turning to TikTok for AP-related information. However, the platform's video quality on AP has not been thoroughly investigated.

OBJECTIVE

The main purpose of this study is to evaluate the quality of videos about AP on TikTok, and the secondary purpose is to study the related factors of video quality.

METHODS

This study involved retrieving AP-related videos from TikTok, determining, and analyzing them based on predefined inclusion and exclusion criteria. Relevant data were extracted and compiled for evaluation. Video quality was scored using the DISCERN instrument and the Health on the Net (HONcode) score, complemented by introducing the Acute Pancreatitis Content Score (APCS). Pearson correlation analysis was used to assess the correlation between video quality scores and user engagement metrics such as likes, comments, favorites, retweets, and video duration.

RESULTS

A total of 111 TikTok videos were included for analysis, and video publishers were composed of physicians (89.18%), news media organizations (13.51%), individual users (5.41%), and medical institutions (0.9%). The majority of videos focused on AP-related educational content (64.87%), followed by physicians' diagnostic and treatment records (15.32%), and personal experiences (19.81%). The mean scores for DISCERN, HONcode, and APCS were 33.05 ± 7.87, 3.09 ± 0.93, and 1.86 ± 1.30, respectively. The highest video scores were those posted by physicians (35.17 ± 7.02 for DISCERN, 3.31 ± 0.56 for HONcode, and 1.94 ± 1.34 for APCS, respectively). According to the APCS, the main contents focused on etiology (n = 55, 49.5%) and clinical presentations (n = 36, 32.4%), followed by treatment (n = 24, 21.6%), severity (n = 20, 18.0%), prevention (n = 19, 17.1%), pathophysiology (n = 17, 15.3%), definitions (n = 13, 11.7%), examinations (n = 10, 9%), and other related content. There was no correlation between the scores of the three evaluation tools and the number of followers, likes, comments, favorites, and retweets of the video. However, DISCERN (r = 0.309) and APCS (r = 0.407) showed a significant positive correlation with video duration, while HONcode showed no correlation with the duration of the video.

CONCLUSIONS

The general quality of TikTok videos related to AP is poor; however, the content posted by medical professionals shows relatively higher quality, predominantly focusing on clinical presentations and etiologies. There is a discernible correlation between video duration and quality ratings, indicating that a combined approach incorporating the guideline can comprehensively evaluate AP-related content on TikTok.

Myopia information on TikTok: analysis factors that impact video quality and audience engagement

BACKGROUND

TikTok is emerging as a vital platform for health information dissemination. Despite myopia being a global public health issue, the high-quality myopia information shared by health educators often fails to go viral. It is imperative to analyze the factors influencing video quality and popularity, especially from diverse perspectives of researchers, health educators, and audiences.

METHODS

TikTok myopia-related videos were retrieved using TikTok's default comprehensive search (DCS) and most liked search (MLS) strategies. Venn diagrams were employed to illustrate the relationships and commonalities between the two strategies across four sample sizes (top 200, 150, 100, and 50). Video metadata, including details such as creator information, production properties, upload time, video duration, and viewer engagement, were collected. Video quality was assessed using the DISCERN tool. Video content covering six aspects of myopia were evaluated. The impact of search strategies, video sample sizes, production properties, and myopia content on video quality and audience engagement was analyzed through single-factor or multi-factor analysis.

RESULTS

DCS and MLS retrieval strategies, as well as varying sample sizes, resulted in differences in audience engagement for myopia videos (P < 0.039), while The DISCERN quality scores remained comparable (P > 0.221). Videos published by healthcare professionals (HCPs) and non-profit organizations (NPOs) were associated with high-quality (P ≤ 0.014) but comparatively lower popularity (P < 0.033). Videos that reported contents of risk factors, management, and outcomes showed high popularity (P < 0.018), while longer video duration (> 60s) exhibited the opposite trend (P < 0.032). Content on myopia evaluation (P ≤ 0.001) and management (P ≤ 0.022) and video duration were positively correlated with higher DISCERN quality.

CONCLUSION

Videos created by HCPs and NPOs deserve greater attention. Rather than pursuing entertaining effects, professional educators should emphasize producing concise, and high-quality myopia content that readily resonates with the audience and has the potential to go viral on the platform.

The status quo of short videos as a source of health information regarding bowel preparation before colonoscopy

Background

For high-quality colonoscopies, adequate bowel preparation is a prerequisite, closely associated with the diagnostic accuracy and therapeutic safety of colonoscopy. Although popular-science short videos can help people quickly access health information, the overall quality of such short videos as a source of health information regarding bowel preparation before colonoscopy is unclear. Therefore, we intend to conduct a cross-sectional study to investigate the quality of bowel preparation information before colonoscopy through short videos taken on TikTok and Bilibili.

Methods

The Chinese phrases "colonoscopy" and "bowel preparation" were used as keywords to search for and screen the top 100 videos in the comprehensive rankings on TikTok and Bilibili. The Global Quality Score (GQS) and the modified DISCERN score were used to assess the quality of the information provided in these short videos.

Results

A total of 186 short videos were included in this study; 56.5% of them were posted by health professionals, whereas 43.5% of them were posted by nonhealth professionals. The overall quality of these videos was unsatisfactory, with a median DISCERN score of 3 (2-4) and a median GQS of 3 (3-4). The radar maps showed that videos posted by gastroenterologists had higher completeness scores regarding outcomes, management, and risk factors, while nongastroenterologists had higher completeness scores concerning adverse effects, symptoms, and definitions of bowel preparation. Additionally, the median DISCERN score and GQS of the videos posted by gastroenterologists were 3 (3-4) and 3 (3-4), respectively, whereas the quality of the videos posted by patients was the worst, with a median DISCERN score of 2 (1-2) and a median GQS of 2 (1.25-3).

Conclusion

In conclusion, the overall quality of health information-related videos on bowel preparation before colonoscopy posted on specified short video platforms was not satisfactory. Gastroenterologists provide more information on the outcomes, management, and risk factors for bowel preparation before colonoscopy, while nongastroenterologists focus on adverse effects, symptoms, and definitions of bowel preparation.

Assessment of the reliability and quality of breast cancer related videos on TikTok and Bilibili: cross-sectional study in China

Background

As the most common malignant tumor in the world, breast cancer also brings a huge disease burden to China. Ordinary people are increasingly inclined to use the Internet, especially video social platforms, as a source of health information. Educating the public to obtain correct information is important to reduce the incidence of breast cancer and improve the prognosis. However, the quality and reliability of breast cancer-related video content have not been fully studied.

Objective

This study aims to evaluate the quality of the information of breast cancer-related videos on TikTok and Bilibili video sharing platforms and factors related to video quality.

Methods

We collected the top 100 videos about breast cancer on TikTok and Bilibili, respectively. Categorize videos according to video source and video content. Video quality and reliability were assessed using Global Quality Score (GQS) and modified DISCERN (mDISCERN) tools. We also analyzed the correlation between video quality and video likes, comments, saves, and shares.

Results

Although the quality and reliability of Bilibili's breast cancer videos were higher than TikTok (p = 0.002 and p = 0.001, respectively), the video quality of both video sharing platforms was not satisfactory, with a median GQS scores of 2.00 and 3.00 and mDISCERN scores of 1.00 and 2.00, respectively. In general, the quality and reliability of videos released by medical practitioners were higher than those of non-medical practitioners, and the quality and reliability of videos covering disease-related knowledge were higher than those of news reports (all p < 0.001). Among medical practitioners, the quality of videos uploaded by doctors in breast disease was significantly lower than that of doctors in other areas (p < 0.05). There was a significant positive correlation between video quality and duration (r = 0.240, p < 0.001), a weak negative correlation between video quality and likes (r = 0.191, p < 0.01), video quality and comments (r = 0.256, p < 0.001), video reliability and likes (r = 0.198, p < 0.001), video reliability and comments (r = 0.243, p < 0.01).

Conclusion

Our study shows that the quality and reliability of breast cancer-related videos on TikTok and Bilibili are poor, and the overall quality is unsatisfactory. But videos uploaded by medical practitioners covering disease knowledge, prevention and treatment are of higher quality. Medical practitioners are encouraged to publish more high-quality videos, while video social platforms should formulate relevant policies to censor and supervise health education videos, so as to enable the public to obtain reliable health information.

The quality and reliability of short videos about thyroid nodules on BiliBili and TikTok: Cross-sectional study

Background

The detection rate of thyroid nodules has witnessed a significant surge in recent years, triggering heightened public apprehension. Short video platforms such as TikTok and BiliBili have showed tremendous potential in the dissemination of health information. There is a plethora of videos about thyroid nodules on TikTok and BiliBili, but the quality and reliability of videos concerning thyroid nodules remains unknown.

Methods

On December 3rd, 2023, the top 100 short videos related to thyroid nodules on BiliBili and TikTok were collected through a comprehensive search in Chinese. After extracting the basic information, the quality and reliability of each video was assessed by using the global quality score (GQS) and DISCERN score. Further, Spearman correlation analyses were applied to examine the correlation among video variables, GQS and DISCERN score.

Results

Compared to BiliBili, TikTok exhibits greater popularity, as evidenced by higher counts of likes (P = 0.021), comments (P = 0.008) and shares (P = 0.017). The median (interquartile range) scores of GQS and DISCERN score were 3 (2-3) on TikTok while 2 (2-3) on BiliBili. Both reviewers exhibited good consistency in GQS and DISCERN score. Moreover, it was observed that the videos shared by thyroid specialists demonstrated higher scores both in GQS (P = 0.014) and DISCERN score (P = 0.022) than others on TikTok. Spearman correlation analysis revealed no significant correlation between video variables and the scores of GQS and DISCERN score.

Conclusions

The quality and reliability of thyroid nodules videos on BiliBili and TikTok were unsatisfactory. Notably, videos shared by thyroid specialists are more likely to exhibit superior quality and reliability. People should exercise caution when perusing short videos.

TikTok video as a health education source of information on heart failure in China: a content analysis

Background

Heart failure (HF) is a complex and life-threatening syndrome associated with significant morbidity and mortality. While TikTok has gained popularity as a social media platform for sharing HF-related information, the quality of such content on TikTok remains unexplored.

Methods

A cross-sectional analysis was conducted on TikTok videos related to HF in China. The sources of the videos were identified and analyzed. The content comprehensiveness of the videos was evaluated using six questions that covered definition, signs and symptoms, risk factors, evaluation, management, and outcomes. The reliability and quality of the videos were assessed using three standardized evaluation instruments: DISCERN, JAMA benchmarks, and the Global Quality Scale. Additionally, the correlation between video quality and video characteristics was further investigated.

Results

Among the video sources, 92.2% were attributed to health professionals, while news agencies and non-profit organizations accounted for 5.7% and 2.1%, respectively. The content comprehensiveness score for the videos was 3.36 (SD 3.56), with news agencies receiving the highest scores of 4.06 (SD 3.31). The median DISCERN, JAMA, and GQS scores for all 141 videos were 26.50 (IQR 25.00-28.750), 2.00 (IQR 2.00-2.00), and 2.00 (IQR 2.00-2.00), respectively. Videos from health professionals had significantly higher JAMA scores compared to those from non-profit organizations (P < 0.01). Correlation analysis between video quality and video characteristics showed positive correlations between content comprehensiveness scores and video duration (r = 0.420, P < 0.001), number of comments (r = 0.195, P < 0.05), and number of shares (r = 0.174, P < 0.05). GQS scores were negatively or positively correlated with the number of days since upload (r = -0.212, P < 0.05) and video duration (r = 0.442, P < 0.001).

Conclusion

The overall quality of the videos was found to be unsatisfactory, with variations in quality scores observed across different video sources. Content comprehensiveness was inadequate, the reliability and quality of the information presented in the videos was questionable. As TikTok continues to grow as a platform for health information, it is essential to prioritize accuracy and reliability to enhance patients' self-care abilities and promote public health.