Quality of Internet Videos Related to Pediatric Urology in Mainland China: A Cross-Sectional Study

Evaluating the Content and Quality of Videos Related to Hypertrophic Scarring on TikTok in China: Cross-Sectional Study

BACKGROUND

Hypertrophic scars (HTSs) are a predominant condition after burns and trauma, and it causes severe physiological and psychological problems. TikTok (Douyin in Chinese), a popular platform for sharing short videos, has shown the potential to spread health information, including information related to HTSs. Educating the public to obtain correct information is important to reduce the incidence of physiological and psychological problems caused by HTSs. However, the quality and reliability of HTS-related video content on TikTok in mainland China have not been thoroughly studied.

OBJECTIVE

This study aims to evaluate the content and quality of short videos related to HTSs on the Chinese version of TikTok (Douyin) and explore the factors related to their quality, providing valuable insights for health information dissemination.

METHODS

We collected a sample of 153 TikTok videos in Chinese related to HTSs and categorized them according to video source and content. We evaluated the video content using a coding schema, and a hexagonal radar schema was used to intuitively display the spotlight and weight of each aspect of the videos. We evaluated quality using 4 standardized tools: the modified DISCERN (mDISCERN) questionnaire, the Journal of the American Medical Association, the Global Quality Scale (GQS), and the Health on the Net Foundation Code of Conduct. We also explored the potential relationship between video quality and characteristics.

RESULTS

The analysis showed that health care professionals uploaded all videos about treating HTSs, which matched the hexagonal radar model analysis findings. The quality assessment scores for the Journal of the American Medical Association, GQS, mDISCERN, and the Health on the Net Foundation Code of Conduct had median values of 1 (IQR 1-2), 2 (IQR 2-3), 2 (IQR 2-3), and 3 (IQR 3-4), respectively, indicating a need to improve the quality and reliability of videos on HTSs. In addition, high-quality videos were more popular, based on metrics such as likes, comments, favorites, and shares (P<.001). Interestingly, the time when the videos were uploaded positively correlated with GQS and mDISCERN scores (r=0.393; P<.001 and r=0.273; P<.001), while the video length did not significantly correlate with evaluation scores (P=.78, P=.20, P=.07, and P=.04).

CONCLUSIONS

The quality of TikTok videos related to HTSs is generally moderate. Users should exercise caution when seeking information on HTSs from TikTok. It is advisable to choose videos uploaded by health care professionals from the burn department and the burn plastic surgery department, and in the Chinese context, those produced in first-tier cities and emerging first-tier cities.

Quality of cerebral palsy videos on Chinese social media platforms

A significant research gap exists in evaluating the prevalence and quality of Chinese videos depicting CP on domestic social media platforms. In contrast to studies that focus on online video content concerning CP on YouTube, CP videos on YouTube are largely inaccessible to average citizens in mainland China. This disparity underscores the need for further investigation into the availability and nature of CP videos specifically on Chinese social media platforms. To assess the reliability and quality of short videos related to cerebral palsy (CP) on Chinese social media platforms. The present cross-sectional study examined 344 videos about CP from popular Chinese social media platforms, including TikTok, Kwai, Weibo, Bilibili, and RED. The analysis of these videos involved a detailed assessment of their sources, content, and characteristics. Additionally, quantitative scoring tools such as journal of the American medical association (JAMA) benchmarks, gobal quality score (GQS), and DISCERN were utilized to evaluate video quality. Furthermore, the potential relationship between video quality and various attributes such as duration, number of likes, and comments was explored and their impact on the quality of information presented in the videos was analyzed. The average duration of the 344 videos was 92.12 s (SD 105.69). CP rehabilitation training videos comprised 45.64% of the total, followed by expert-contributed videos at 40.70%. Mean scores for JAMA, GQS, and DISCERN were 1.62 (SD 0.60), 2.05 (SD 0.99), and 1.26 (SD 1.26) respectively. RED had the lowest average scores. Videos focusing on disease knowledge scored highest on JAMA and GQS scales. Experts achieved significantly higher GQS and DISCERN scores compared to health-related institutions and amateurs. Spearman correlation analysis revealed a strong positive correlation between likes and comments (r = .0.87, P < .0.001). Enhancing the management of medical content is crucial to address the compromised reliability of Chinese online short videos providing information to families of CP patients. Improving content professionalism and accuracy ensures users access genuinely valuable information.

Assessment of non-small cell lung cancer online videos in China: A cross-sectional study on quality, content, understandability, actionability, and reliability

Objective: This study aims to conduct a multidimensional evaluation of non-small cell lung cancer (NSCLC)-related videos on social media platforms in China (TikTok, Bilibili, and Red).Methods: Validated tools were used to evaluate video quality (DISCERN instrument), reliability (Journal of the American Medical Association [JAMA] benchmarks), understandability, and actionability (Patient Education Materials Assessment Tool [PEMAT]).Results: This study included 96 videos, primarily created by medical professionals (n = 63). The median DISCERN score was 30.0 (IQR 28.5-34.4), indicating poor quality overall. Compared to videos rated as "good", the "poor" videos had significantly shorter durations (P = 0.040). The overall median understandability and actionability scores were 81.8% (IQR 75.0-90.9%) and 0% (IQR 0.0-66.7%), respectively, indicating good understandability but extremely poor actionability. Only one met all four JAMA benchmarks. TikTok videos with the shortest durations garnered the highest numbers of "likes", "comments", and "bookmarks", while Bilibili videos exhibited a relatively high overall quality.Conclusions: To guide the public in making informed medical decisions, Chinese NSCLC videos need improvement in various aspects.

Can ChatGPT provide high-quality patient information on male lower urinary tract symptoms suggestive of benign prostate enlargement?

BACKGROUND

ChatGPT has recently emerged as a novel resource for patients' disease-specific inquiries. There is, however, limited evidence assessing the quality of the information. We evaluated the accuracy and quality of the ChatGPT's responses on male lower urinary tract symptoms (LUTS) suggestive of benign prostate enlargement (BPE) when compared to two reference resources.

METHODS

Using patient information websites from the European Association of Urology and the American Urological Association as reference material, we formulated 88 BPE-centric questions for ChatGPT 4.0+. Independently and in duplicate, we compared the ChatGPT's responses and the reference material, calculating accuracy through F1 score, precision, and recall metrics. We used a 5-point Likert scale for quality rating. We evaluated examiner agreement using the interclass correlation coefficient and assessed the difference in the quality scores with the Wilcoxon signed-rank test.

RESULTS

ChatGPT addressed all (88/88) LUTS/BPE-related questions. For the 88 questions, the recorded F1 score was 0.79 (range: 0-1), precision 0.66 (range: 0-1), recall 0.97 (range: 0-1), and the quality score had a median of 4 (range = 1-5). Examiners had a good level of agreement (ICC = 0.86). We found no statistically significant difference between the scores given by the examiners and the overall quality of the responses (p = 0.72).

DISCUSSION

ChatGPT demostrated a potential utility in educating patients about BPE/LUTS, its prognosis, and treatment that helps in the decision-making process. One must exercise prudence when recommending this as the sole information outlet. Additional studies are needed to completely understand the full extent of AI's efficacy in delivering patient education in urology.

Analysis of the quality of vulvar cancer-related videos on YouTube

Background

Vulvar cancer is a relatively rare malignant tumor that receives less attention than other gynecological malignancies. Short-video apps are playing an important role in promoting health. This study evaluated the quality of videos about vulvar cancer on YouTube with the aim of making facts-based recommendations and promoting public health engagement.

Methods

On May 15, 2024, the term "vulvar cancer" was searched on YouTube, and the top 100 videos identified in the search were chosen for our research. We evaluated the completeness of each video using six dimensions. The video quality was evaluated using the DISCERN instrument (Quality Criteria for Consumer Health Information), the Journal of the American Medical Association (JAMA) benchmark criteria, the Patient Education Materials Assessment Tool (PEMAT), and the Global Quality Scale (GQS). Correlations between video data, DISCERN, JAMA, PEMAT, and GQS scores were analyzed.

Results

Among the 65 videos that were included in this study, the majority (64.6%) were posted by educational and training institutes. The quality of the videos submitted by physicians was comparatively good, as indicated by the GQS scores (P=0.045). The relationships between the DISCERN categorization score and duration (P<0.001), views per day (P=0.02), likes per day (P<0.001), comments per day (P=0.03), PEMAT actionability (P<0.001), and GQS scores (P<0.001) were statistically significant. Additionally, there was a strong positive correlation between the GQS score and video length.

Conclusions

The quality of videos about vulvar cancer on YouTube is unsatisfactory. However, several measures can be adopted in the future to make YouTube a more practical tool for promoting the prevention and cure of vulvar cancer.

Health information analysis of cryptorchidism-related short videos: Analyzing quality and reliability

OBJECTIVE

Cryptorchidism is a common congenital anomaly in children. Short video content has increased awareness and urged timely intervention, but there is a lack of understanding about the quality and reliability of these videos. This survey assesses the quality and credibility of cryptorchidism-related videos on Chinese short video platforms to ensure accurate information for caregivers and healthcare professionals.

METHODS

We analyzed 228 videos from TikTok, Bilibili, and Kwai on 16 May 2024. Using the Journal of the American Medical Association (JAMA) criteria, Global Quality Score (GQS), and modified DISCERN score, we evaluated the videos based on six factors: definition, risk factors, symptoms, tests, treatment, and outcome.

RESULTS

Video quality varied significantly across platforms (P = .03). Medical professionals' videos had higher JAMA scores than those by nonmedical professionals (P < .001), but no significant differences were found in GQS (P = .633) or modified DISCERN scores (P = .853). Overall, video quality was suboptimal, focusing mainly on treatment, symptoms, and prognosis, while neglecting tests and risk factors. Longer videos correlated with higher GQS (r = .34, P < .001) and modified DISCERN scores (r = .39, P < .001), while newer videos were of higher quality (GQS: r = -.19, P < .005; modified DISCERN: r = -.25, P < .001). Higher engagement (comments: r = -.16, P = .01; shares: r = -.18, P = .04) was associated with lower quality.

CONCLUSION

Overall, the videos' quality and reliability were moderate, with professional content providing more accurate insights. This highlights the need for improved regulation of medical information on short video platforms.

Evaluation of the quality of depression-related information on Chinese websites and video platforms: a cross-sectional comparative analysis

Objectives

We aimed to assess the quality of information regarding depression on Chinese websites and popular video platforms.

Methods

We conducted searches on website platforms (Baidu, Bing) and video platforms (Bilibili, Douyin) using search terms "depression", "depressive disorder", "depression treatment", "depressive anxiety", "depressed patient", and "depressive symptoms". We collected the first 50 results with each search term in each platform. Each website and video included in this study was assessed using The DISCERN instrument (DISCERN), Journal of American Medical Association benchmark criteria (JAMA), Hexagonal Radar Schema (HRS), and Global Quality Scores (GQS).

Results

A total of 177 websites, 216 Bilibili videos, and 244 Douyin videos were included. Among all the platforms, websites had the highest median scores on DISCERN and HRS, at 33 and 2 respectively, but were still classified as "poor" and "very poor" according to the classification. Bilibili, Douyin, and websites had median scores of 3, 2, and 2 respectively in JAMA, indicating a moderate level of quality. Bilibili, Douyin, and websites all had a median score of 2 for GQS, and were of poor quality. Only the percentage score for JAMA was more than half of the weighted score, while none of the other scales reached half of the score. The median percentage scores of the websites in DISCERN, HRS, and GQS were higher than those of Bilibili and Douyin (P < 0.001). Compared to other sources, news media on websites and medical organizations on videos demonstrated higher quality (all P values < 0.05).

Conclusions

The findings of the study indicated an overall low quality of online depression information. Collaborative efforts between platforms and professionals are necessary to improve the comprehensiveness and quality of depression-related information available online. In addition, the platform needs to prioritize optimizing the algorithm of recommendations and present real high-quality health information to the audience.

Comparative analysis of NAFLD-related health videos on TikTok: a cross-language study in the USA and China

BACKGROUND

The incidence of Non-alcoholic fatty liver disease (NAFLD) in China and USA is extremely high and rising. TikTok has become a popular channel for medical information dissemination and we aimed to evaluate the quality and reliability of NAFLD related videos on TikTok, in both its USA and Chinese versions.

METHODS

We analyzed the top 100 NAFLD videos on both the USA version and Chinese version of TikTok, a total of 200 videos, from which keywords were extracted and scored using the Global Quality Scale (GQS), modified DISCERN (mDISCERN), and Medical Quality Video Evaluation Tool (MQ-VET). Exploring the relationship between video quality and audience related factors, as well as ranking, through Spearman correlation analysis.

RESULTS

The mDISCERN scores of videos on the USA version of TikTok is higher than that on the Chinese version (P < 0.01), but there is no significant difference in the GQS and MQ-VET scores. The GQS, mDISCERN and MQ-VET scores of videos published by medical practitioners were significantly higher than those of non-medical practitioners (P < 0.001). However, there was no significant correlation between video quality and popularity indicators.

CONCLUSION

The quality of NAFLD related short videos on TikTok is acceptable, but the reliability is mediocre, and there is still room for improvement. The videos published by USA medical practitioners are more reliable than those of Chinese medical practitioners. The most concerned topic of both countries is diet. The TikTok recommendation algorithm may limit access to high-quality health videos, and further research on other platforms and languages is necessary.

Health-related Internet Use Among New Urology Clinic Patients

OBJECTIVE

To assess internet usage among new patients seen by urologists and impact on post-consultation understanding for 4 common conditions: kidney stones, elevated prostate-specific antigen, male voiding, and female voiding.

METHODS

We performed a prospective study of new urology patients at our diverse urban, academic urology practice for the above conditions over a 1-year period. A voluntary questionnaire assessed patients' internet use related to referred conditions prior to encounters. Questions evaluated quality of information and patient understanding of symptoms/condition at baseline, after online searches, and after their urology visit. A patient-reported Likert scale of 1 (poor) to 10 (excellent) was used and internet "searchers" were compared to "non-searchers."

RESULTS

Two hundred fifteen patients participated. Most respondents were Latino (41%) or Black (35%) and English-speaking (81%). Cohorts comprised 130 searchers (60%) and 85 non-searchers (40%). Searchers were significantly younger (median 53 vs 63 years, P <.001), more likely to have home internet access (P <.001), and more general medical internet use (P <.001). Overall, patients' understanding of visit diagnoses increased after their encounters (median pre-visit rating 5 vs post-visit rating 10). Searchers reported a greater post-visit understanding compared to non-searchers (median rating 10 vs 9, P <.001), and a greater change in understanding from baseline (median +4 vs +3, P = .02).

CONCLUSION

Internet use is common amongst younger patients referred to urologists and may be associated with improved understanding of their condition after urologic consultation. Continued investigation of patient uses and attitude towards popular online resources can help urologists curate resources to benefit patients and providers alike.

Quality assessment of health science-related short videos on TikTok: A scoping review

OBJECTIVE

The aims of this review are to clarify the current state of research in terms of assessment tools and assessors of the quality of health science-related short videos on TikTok, to identify limitations in existing research; and to provide a reference for future studies.

METHODS

A scoping review was conducted. The Cochrane Library, PubMed, MEDLINE, Web of Science, Embase, Scopus, EBSCO, CNKI, VIP, Wanfang Data, and CBM databases were searched from September 2016 to November 2022. Manual searching was also performed to identify additional eligible studies. A total of 2620 documents were initially retrieved, and 29 were ultimately included. The literature was screened and collected, and data were extracted and summarized by 2 researchers.

RESULTS

(1) The quality evaluation tools used in the 29 papers included the DISCERN, PEMAT(A/V), GQS, JAMA, HONcode, guidelines and self-developed tools. Twenty-four of the included articles used the DISCERN for quality assessment, which was the most frequently used evaluation tool. However, most of these tools were not developed to assess health science-related short videos, lacked credibility tests, and had poor applicability; therefore, the accuracy of the evaluation results might be biased. (2) The assessors of the quality of health science-related short videos on TikTok were mainly experts in related fields and medical students, with doctors (12/14) being the most common evaluators. Fifteen studies did not report the identity of the evaluators, and 12 studies did not report interrater reliability.

CONCLUSION

This scoping review found that there is a lack of specific quality assessment tools for health science-related short videos on TikTok. Second, the current quality assessors of health science-related short videos on TikTok are limited. Future research should focus on the development of reliable, scientific quality assessment tools for health science-related short videos; unifying the evaluation standards; inviting users with different backgrounds and different health literacy levels to conduct quality assessments; exploring the quality assessment of health science-related short videos on TikTok from different perspectives.

Myopia information on TikTok: analysis factors that impact video quality and audience engagement

BACKGROUND

TikTok is emerging as a vital platform for health information dissemination. Despite myopia being a global public health issue, the high-quality myopia information shared by health educators often fails to go viral. It is imperative to analyze the factors influencing video quality and popularity, especially from diverse perspectives of researchers, health educators, and audiences.

METHODS

TikTok myopia-related videos were retrieved using TikTok's default comprehensive search (DCS) and most liked search (MLS) strategies. Venn diagrams were employed to illustrate the relationships and commonalities between the two strategies across four sample sizes (top 200, 150, 100, and 50). Video metadata, including details such as creator information, production properties, upload time, video duration, and viewer engagement, were collected. Video quality was assessed using the DISCERN tool. Video content covering six aspects of myopia were evaluated. The impact of search strategies, video sample sizes, production properties, and myopia content on video quality and audience engagement was analyzed through single-factor or multi-factor analysis.

RESULTS

DCS and MLS retrieval strategies, as well as varying sample sizes, resulted in differences in audience engagement for myopia videos (P < 0.039), while The DISCERN quality scores remained comparable (P > 0.221). Videos published by healthcare professionals (HCPs) and non-profit organizations (NPOs) were associated with high-quality (P ≤ 0.014) but comparatively lower popularity (P < 0.033). Videos that reported contents of risk factors, management, and outcomes showed high popularity (P < 0.018), while longer video duration (> 60s) exhibited the opposite trend (P < 0.032). Content on myopia evaluation (P ≤ 0.001) and management (P ≤ 0.022) and video duration were positively correlated with higher DISCERN quality.

CONCLUSION

Videos created by HCPs and NPOs deserve greater attention. Rather than pursuing entertaining effects, professional educators should emphasize producing concise, and high-quality myopia content that readily resonates with the audience and has the potential to go viral on the platform.

Quality assessment of videos on social media platforms related to gestational diabetes mellitus in China: A cross-section study

Purpose

This study aimed to systematically evaluate the quality of content and information in videos related to gestational diabetes mellitus on Chinese social media platforms.

Methods

The videos on various platforms, TikTok, Bilibili, and Weibo, were searched with the keyword "gestational diabetes mellitus" in Chinese, and the first 50 videos with a comprehensive ranking on each platform were included for subsequent analysis. Characteristic information of video was collected, such as their duration, number of days online, number of likes, comments, and number of shares. DISCREN, JAMA (The Journal of the American Medical Association) Benchmark Criteria, and GQS (Global Quality Scores) were used to assess the quality of all videos. Finally, the correlation analysis was performed among video features, video sources, DISCERN scores, and JAMA scores.

Results

Ultimately, 135 videos were included in this study. The mean DISCERN total score was 31.84 ± 7.85, the mean JAMA score was 2.33 ± 0.72, and the mean GQS was 2.00 ± 0.40. Most of the videos (52.6%) were uploaded by independent medical professionals, and videos uploaded by professionals had the shortest duration and time online (P < 0.001). The source of the video was associated with numbers of "likes", "comments", and "shares" for JAMA scores (P < 0.001), but there was no correlation with DISCERN scores. Generally, videos on TikTok with the shortest duration received the most numbers of "likes", "comments", and "shares", but the overall quality of videos on Weibo was higher.

Conclusion

Although the majority of the videos were uploaded by independent medical professionals, the overall quality appeared to be poor. Therefore, more efforts and actions should be taken to improve the quality of videos related to gestational diabetes mellitus.

The status quo of short videos as a source of health information regarding bowel preparation before colonoscopy

Background

For high-quality colonoscopies, adequate bowel preparation is a prerequisite, closely associated with the diagnostic accuracy and therapeutic safety of colonoscopy. Although popular-science short videos can help people quickly access health information, the overall quality of such short videos as a source of health information regarding bowel preparation before colonoscopy is unclear. Therefore, we intend to conduct a cross-sectional study to investigate the quality of bowel preparation information before colonoscopy through short videos taken on TikTok and Bilibili.

Methods

The Chinese phrases "colonoscopy" and "bowel preparation" were used as keywords to search for and screen the top 100 videos in the comprehensive rankings on TikTok and Bilibili. The Global Quality Score (GQS) and the modified DISCERN score were used to assess the quality of the information provided in these short videos.

Results

A total of 186 short videos were included in this study; 56.5% of them were posted by health professionals, whereas 43.5% of them were posted by nonhealth professionals. The overall quality of these videos was unsatisfactory, with a median DISCERN score of 3 (2-4) and a median GQS of 3 (3-4). The radar maps showed that videos posted by gastroenterologists had higher completeness scores regarding outcomes, management, and risk factors, while nongastroenterologists had higher completeness scores concerning adverse effects, symptoms, and definitions of bowel preparation. Additionally, the median DISCERN score and GQS of the videos posted by gastroenterologists were 3 (3-4) and 3 (3-4), respectively, whereas the quality of the videos posted by patients was the worst, with a median DISCERN score of 2 (1-2) and a median GQS of 2 (1.25-3).

Conclusion

In conclusion, the overall quality of health information-related videos on bowel preparation before colonoscopy posted on specified short video platforms was not satisfactory. Gastroenterologists provide more information on the outcomes, management, and risk factors for bowel preparation before colonoscopy, while nongastroenterologists focus on adverse effects, symptoms, and definitions of bowel preparation.

Evaluating the performance of ChatGPT in answering questions related to pediatric urology

INTRODUCTION

Artificial intelligence is advancing in various domains, including medicine, and its progress is expected to continue in the future.

OBJECTIVE

This research aimed to assess the precision and consistency of ChatGPT's responses to commonly asked inquiries related to pediatric urology.

MATERIALS AND METHODS

We examined commonly posed inquiries regarding pediatric urology found on urology association websites, hospitals, and social media platforms. Additionally, we referenced the recommendations tables in the European Urology Association's (EAU) 2022 Guidelines on Pediatric Urology, which contained robust data at the strong recommendation level. All questions were systematically presented to ChatGPT's May 23 Version, and two expert urologists independently assessed and assigned scores ranging from 1 to 4 to each response.

RESULTS

A hundred thirty seven questions about pediatric urology were included in the study. The answers to questions resulted in 92.0% completely correct. The completely correct rate in the questions prepared according to the strong recommendations of the EAU guideline was 93.6%. No question was answered completely wrong. The similarity rates of the answers to the repeated questions were between 93.8% and 100%.

CONCLUSION

ChatGPT has provided satisfactory responses to inquiries related to pediatric urology. Despite its limitations, it is foreseeable that this continuously evolving platform will occupy a crucial position in the healthcare industry.

Information quality of videos related to Helicobacter pylori infection on TikTok: Cross-sectional study

BACKGROUND

Helicobacter pylori (H. pylori) poses serious threats to human health. TikTok (Douyin in Chinese), a major social media platform focused on sharing short videos, has demonstrated great potential in spreading health information, including information related to H. pylori infection. This study aims to evaluate the content and quality of the information shared in TikTok videos about H. pylori infection in mainland China.

METHODS

We collected a sample of 116 videos in Chinese related to H. pylori infection from TikTok. Video contents were evaluated by the coding schema proposed by Goobie et al., and the Hexagonal Radar Schema was used to intuitively display the spotlight and weight of each aspect of the videos. The DISCERN questionnaire was used to evaluate the quality of the videos.

RESULTS

We identified two major sources of videos related to H. pylori: individual users (n = 89) and organizational users (n = 27). Regarding content, the Hexagonal Radar Charts showed that more than 35% of the videos delivered moderate to high quality content (>1 point) in terms of definition, symptoms and management of the disease, whereas risk factors, evaluation and outcomes of the disease were less discussed. The DISCERN classification data showed that 0.9% of the videos were "very poor," 5.2% "poor," 68.7% "fair," 20.0% "good," and only 5.2% "excellent". Regarding total DISCERN scores, videos published by nonprofit organizations had the highest scores, followed by videos uploaded by health professionals.

CONCLUSION

Although the overall quality of TikTok videos related to H. pylori infection was medium, users should be careful when obtaining information related to H. pylori infection on TikTok and opt for videos uploaded by nonprofit organizations and health professionals.

Evaluation of the quality and reliability of anal cancer and its precancerous lesions-related content on YouTube: a cross-sectional study

OBJECTIVES

This research aims at evaluating the quality of anal cancer and its precancerous lesions-related videos on YouTube.

DESIGN

Cross-sectional survey design.

SETTING

USA.

PARTICIPANTS

The top 150 videos on YouTube were selected for analysis based on three search terms. The duplicate, irrelevant, commercial, operation-related and audio-free videos were excluded. Finally, 105 relevant videos were included.

METHODS

We assessed the completeness of video content from six dimensions and marked the men having sex with men (MSM)-related videos. To measure the video quality, DISCERN, Journal of the American Medical Association (JAMA) Benchmark Criteria, Patient Education Materials Assessment Tool (PEMAT) and Global Quality Scale (GQS) were used. The correlation between DISCERN classification and duration, JAMA, PEMAT and GQS scores were recorded.

RESULTS

The video content was mainly about the management of the disease (mean score 1.086). Overall, the quality of videos uploaded by the non-profit organisation was relatively high. A correlation existed between each other of the JAMA, DISCERN and GQS scores (p<0.001). Moreover, they were positively correlated with video duration and PEMAT scores (p<0.001).

CONCLUSIONS

Although the overall quality of information about anal cancer and its precancerous lesions videos on YouTube is acceptable, it might not fully meet the health information needs of patients. Therefore, they should exercise caution when using YouTube as a source of anal cancer-related information, especially the MSM population.

Quality and Reliability of Liver Cancer-Related Short Chinese Videos on TikTok and Bilibili: Cross-Sectional Content Analysis Study

BACKGROUND

Liver cancer incidence has been increasing in China in the recent years, leading to increased public concern regarding the burden of this disease. Short videos on liver cancer are disseminated through TikTok and Bilibili apps, which have gained popularity in recent years as an easily accessible source of health information. However, the credibility, quality, and usefulness of the information in these short videos and the professional knowledge of the individuals uploading health information-based videos in these platforms have not yet been evaluated.

OBJECTIVE

Our study aims to assess the quality of the information in Chinese short videos on liver cancer shared on the TikTok and Bilibili short video-sharing platforms.

METHODS

In March 2023, we assessed the top 100 Chinese short videos on liver cancer in TikTok and Bilibili (200 videos in total) for their information quality and reliability by using 2 rating tools, namely, global quality score (GQS) and the DISCERN instrument. Correlation and Poisson regression analyses were applied to discuss the factors that could impact video quality.

RESULTS

Compared to Bilibili, TikTok is more popular, although the length of the videos on TikTok is shorter than that of the videos on Bilibili (P<.001). The quality of the short videos on liver cancer in TikTok and Bilibili was not satisfactory, with median GQS of 3 (IQR 2-4) and 2 (IQR 1-5) and median DISCERN scores of 5 (IQR 4-6) and 4 (IQR 2-7), respectively. In general, the quality of videos sourced from professional institutions and individuals was better than that of those sourced from nonprofessionals, and videos involving disease-related knowledge were of better quality than those covering news and reports. No significant differences were found in the quality of videos uploaded by individuals from different professions, with the exception of those uploaded by traditional Chinese medicine professionals, which demonstrated poorer quality. Only video shares were positively correlated with the GQS (r=0.17, P=.01), and no video variables could predict the video quality.

CONCLUSIONS

Our study shows that the quality of short videos on health information related to liver cancer is poor on Bilibili and TikTok, but videos uploaded by health care professionals can be considered reliable in terms of comprehensiveness and content quality. Thus, short videos providing medical information on TikTok and Bilibili must be carefully considered for scientific soundness by active information seekers before they make decisions on their health care management.

Content Quality of Web-Based Short-Form Videos for Fire and Burn Prevention in China: Content Analysis

BACKGROUND

Web-based short-form videos are increasingly popular for disseminating fire and burn prevention information, but their content quality is unknown.

OBJECTIVE

We aimed to systematically assess the characteristics, content quality, and public impact of web-based short-form videos offering primary and secondary (first aid) prevention recommendations for fires and burns in China between 2018 and 2021.

METHODS

We retrieved short-form videos offering both primary and secondary (first aid) information to prevent fire and burn injuries published on the 3 most popular web-based short-form video platforms in China: TikTok, Kwai, and Bilibili. To assess video content quality, we calculated the proportion of short-form videos that included information on each of the 15 recommendations for burn prevention education from the World Health Organization (WHO; P1) and that correctly disseminated each recommendation (P2). High P1 and P2 indicated better content quality. To assess their public impact, we calculated the median (IQR) of 3 indicators: the number of comments, likes, and saves as a favorite by viewers. Chi-square test, trend chi-square test, and Kruskal-Wallis H test examined differences in indicators across the 3 platforms, years, content, and time duration of videos and between videos disseminating correct versus incorrect information.

RESULTS

Overall, 1459 eligible short-form videos were included. The number of short-form videos increased by 16 times between 2018 and 2021. Of them, 93.97% (n=1371) were about secondary prevention (first aid) and 86.02% (n=1255) lasted <2 minutes. The proportion of short-form videos including each of the 15 WHO recommendations ranged from 0% to 77.86% (n=1136). Recommendations 8, 13, and 11 had the highest proportions (n=1136, 77.86%; n=827, 56.68%; and n=801, 54.9%, respectively), whereas recommendations 3 and 5 were never mentioned. Among the short-form videos that included the WHO recommendations, recommendations 1, 2, 4, 6, 9, and 12 were always disseminated correctly, but the other 9 recommendations were correctly disseminated in 59.11% (120/203) to 98.68% (1121/1136) of videos. The proportion of short-form videos including and correctly disseminating the WHO recommendations varied across platforms and years. The public impact of short videos varied greatly across videos, with a median (IQR) of 5 (0-34) comments, 62 (7-841) likes, and 4 (0-27) saves as a favorite. Short-form videos disseminating correct recommendations had larger public impact than those disseminating either partially correct or incorrect knowledge (median 5 vs 4 comments, 68 vs 51 likes, and 5 vs 3 saves as a favorite, respectively; all P<.05).

CONCLUSIONS

Despite the rapid increase in the number of web-based short-form videos about fire and burn prevention available in China, their content quality and public impact were generally low. Systematic efforts are recommended to improve the content quality and public impact of short-form videos on injury prevention topics such as fire and burn prevention.

TikTok as a source of information regarding premature ejaculation: a qualitative assessment

Background

Patients are increasingly looking to social media platforms for medical information.

Aim

In this study we aimed to evaluate the quality of information regarding premature ejaculation (PE) on TikTok.

Methods

The term "premature ejaculation" was searched on TikTok on a single day in May 2022. Videos were sorted by 3 reviewers as reliable or unreliable based on the accuracy of video content. Relevant user metrics were collected for each video, including the numbers of likes, shares, and followers, and the video length, source of upload, and speaker type. The quality of information was objectified with 2 validated tools, with mean scores obtained from the 3 reviewers, the Patient Education Materials Assessment Tool (PEMAT) and the 5-point modified DISCERN instrument.

Outcomes

Outcomes were video reliability categorization, video and user metrics as described above, and video quality as quantified by PEMAT and DISCERN scores.

Results

Eight videos were categorized as reliable and 32 videos were categorized as unreliable. The mean number of "likes" per video was higher in the reliable than in the unreliable group (1238 vs 126, P < .018). Accounts posting reliable videos had higher mean numbers of followers than those posting unreliable videos (55 050 vs 12 042, P = .025). The majority of unreliable videos (75%) vs reliable videos (12.5%) were posted by self-identified patients or individual users, whereas 62.5% of reliable videos vs versus 6.3% of unreliable videos were posted by individual physicians or physician groups. Few videos overall mentioned PE definition, indications for PE treatment, types of treatment, or value of psychological intervention (12.5%, 15%, 22.5%, and 5.0% of videos, respectively). Video length and number of shares did not differ between groups. Reliable videos had higher PEMAT (73.0 vs 45.1, P < .001) and DISCERN (2.7 vs 0, P < .001.) scores.

Clinical implications

There exists a critical need for enhanced quality of medical information on social media platforms in hopes of encouraging patients with impaired sexual function to seek appropriate medical care.

Strength and limitations

Strengths of this study include the objective use of validated quality assessment tools and a focus on TikTok as an emerging social media platform. Limitations include large numbers of excluded videos.

Conclusion

The quality of available information regarding PE on TikTok is low, with a significant percentage of videos on this topic fraught with inaccuracies. Given TikTok's prominence as a social media platform primarily geared toward younger audiences, we emphasize the need for improvement in the quality of information available regarding PE and its management.

Status quo of the public's knowledge of probiotics based on video-sharing platforms

BACKGROUND

Probiotics have been deemed multipotent and unprecedentedly applied in the health field recently. However, there are challenges in promoting credible and reliable resources while avoiding misinformation regarding probiotics for the public.

METHODS

This study analysed 400 eligible probiotic-related videos selected from YouTube, and the three most popular video-sharing platforms (Bilibili, Weibo and TikTok) in China. Video retrieval was performed on September 5^th, 2022. GQS and tailored DISCERN tool assess each video's quality, usage, and reliability. A comparative analysis of videos from different sources was carried out.

RESULTS

The identity distribution of probiotic video-producers was predominantly experts (n = 202, 50.50%), followed by amateurs (n = 161, 40.25%) and health-related institutions (n = 37, 9.25%). The videos' content category mainly discussed the function of probiotics (n = 120, 30%), the way to choose suitable products (n = 81, 20.25%), and the methods for taking probiotics (n = 71, 17.75%).The overall quality of videos was moderate (3/5 point) assessed by GQS, while the usage (1/6 point) and reliability (2/5 point) detailing probiotics assessed by tailored DISCERN tool were poor. The attitude of probiotic video-producers was primarily positive (n = 323, 80.75%), followed by neutral (n = 52, 13.00%) and negative (n = 25, 6.25%) (P < 0.001).

CONCLUSIONS

The current study showed that videos on social media platforms publicise important information including the concepts, usage, and precautions of probiotics to the public. But the overall quality of uploaded videos about probiotics was unsatisfactory. More efforts are needed to improve the higher-quality content of probiotic-related online videos and better propagate probiotic knowledge to the public in the future.

TikTok and adolescent vision health: Content and information quality assessment of the top short videos related to myopia

Background

Despite the increasing recognition of the public health value of social media platforms, TikTok short videos focusing on adolescent vision health have not received much attention. We aimed to evaluate the content, sources, and information quality of myopia-related videos on TikTok.

Methods

The top 200 most-liked myopia-related videos on the Chinese version of TikTok were queried and screened on March 12, 2022. The descriptive characteristics, contents, and sources of the selected 168 videos were obtained, and their overall quality, reliability, understandability, and actionability were assessed using the validated scoring instruments DISCERN and PEMAT-A/V.

Results

Medical professionals were the main source (45.8%, 77/168) of videos. Misinformation (10.1%, 17/168) was mainly attributable to for-profit organizations (20%, 3/15) and individual non-medical users (31.3%, 10/32). However, their videos enjoyed the highest numbers of "likes," "comments," and "shares" (P < 0.05). The mean reliability and overall quality regarding treatment choice were (2.5 ± 0.5) and (3.1 ± 0.9), respectively. Videos on TikTok showed relatively high understandability (84.7%) and moderate actionability (74.9%). Video producers tended to partly or fully provide information regarding management (81.5%, 137/168) and outcome (82.1%, 138/168), and to ignore or only slightly mention content related to definition (86.9%, 146/169) and signs (82.1%, 138/168). The five video sources showed significant differences in the prevalence of misleading information (P < 0.001), publication reliability (P < 0.001), overall quality (P = 0.039), content score (P = 0.019), and understandability (P = 0.024).

Conclusion

Considering the moderate-to-poor reliability and variable quality across video sources, the substantial myopia-related content on TikTok should be treated with caution. Nevertheless, TikTok videos may serve as a surrogate or supplement for information dissemination if providers can ensure more comprehensive and accurate content.

Assessment of videos related to lung nodules in China

Background

With the popularization of mobile phones and the development of the Internet, many patients use social media platforms to seek health information. Currently, TikTok, iQiyi, Bilibili, and Weibo are the most popular video platforms in China. Therefore, based on the above facts, this study estimated the quality of lung nodule videos taken in China using these platforms.

Methods

The term “lung nodule” was searched on these platforms. Then, the first 30 videos were selected. Subsequently, some videos were excluded after they had been reviewed and analyzed, after which information on the features and sources of these videos was finally assessed using DISCERN, the Journal of the American Medical Association (JAMA) Benchmark Criteria, and the Hexagonal Radar Schema. Analysis was performed according to different groups.

Results

101 videos were included in this study. According to the different sources, although most videos were from physicians (71.3%), comprising those with shorter durations; faster updates; and more likes, comments, and shares; no significant difference in the scores were obtained. Moreover, regarding the different platforms, while Weibo had the highest update, TikTok had more likes, comments, and shares. Investigations also revealed that while score differences were recorded, most videos were rated “very poor” and “poor.” Besides, hexagonal radar charts showed a severe deficiency of video information.

Conclusions

Although the quality of most videos on the understudied social media platforms was poor, these platforms have huge potential. Therefore, caution should be exercised when using the platforms as information sources about lung nodules, and a better review and push system is needed.