TikTok as an Information Hodgepodge: Evaluation of the Quality and Reliability of Genitourinary Cancers Related Content

The Reach and Accuracy of Information on Autism on TikTok

PURPOSE

Although social media platforms have made information about autism more accessible to the general public, concerns have been raised about the unfiltered nature of the content they host. In the current study, we examined the reach and accuracy of videos providing informational content about autism on TikTok, a popular social media platform.

METHODS

We examined engagement indicators (including views and "likes") for the TikTok videos associated with the #Autism hashtag. Two coders independently fact-checked informational content of the most viewed videos from the #Autism hashtag videos and coded it as either accurate, inaccurate or 'overgeneralization' based on the consistency of the information in the videos with current knowledge on autism.

RESULTS

Videos associated with the "#Autism" hashtag accrued 11.5 billion views collectively. An examination of the top 133 videos providing informational content on autism, which totaled 198.7 million views and 25.2 million likes, showed that 27% of the videos were classified as accurate, while 41% were classified as inaccurate and 32% as overgeneralized. There were no significant differences in engagement between accurate and inaccurate/overgeneralized videos. Videos created by healthcare professionals were more likely to include accurate information.

CONCLUSION

The informational content about autism made available on TikTok reaches a wide number of people. Most of the information provided, however, appears to be misaligned with current knowledge. It is important for healthcare providers and other professionals to be aware of the autism-related content being shared on TikTok so that they can better engage with the large community of TikTok users.

The content quality and educational significance of early childhood caries on short video platforms

BACKGROUND

Early clinical screening and prevention can reduce the incidence and severity of early childhood caries (ECC). With the development of social media, TikTok and Douyin were used as important tools for ECC popularization and early screening. The purpose of this study was to evaluate the educational impact from the integrity, accuracy and quality of ECC-related short videos on TikTok and Douyin.

METHODS

We searched for short videos related to ECC on the mobile application TikTok and Douyin on April 15, 2024. The search keywords were as follows: "Early childhood caries" on TikTok in both English and Japanese, and Chinese search on Douyin. The first 100 short videos were selected as samples for each group. we applied an instrument called DISCERN, which consisted of 3 sections and a total of 16 questions to evaluate the quality of each short video, and used a checklist to rate the content of videos. The accuracy of the content was evaluated based on the Children's Caries Risk Assessment and Management Guidelines.

RESULTS

A total of 115 short videos were assessed for the useful information quality of ECC, including 78 Chinese, 26 English, and 11 Japanese. The score for the content quality of short videos showed that each of the three groups assigned the highest scores to the sections on symptoms and treatment, with Chinese short videos achieving the top ratings. The DISCERN scores for useful short videos in each group were 33.10 ± 3.49 in Chinese, 29.54 ± 2.37 in English, and 28.27 ± 2.61 in Japanese, respectively. Compared with English and Japanese videos, Chinese videos had the highest DISCERN score with significant differences (p < 0.05). Meanwhile, in Chinese short videos, healthcare professionals or organizations uploaded videos with higher DISCERN scores, which were more comprehensive and extensive than those uploaded by private users.

CONCLUSIONS

It is necessary for more healthcare professionals and institutions to join in to improve the quality of content on short video platforms and solve more health problems for patients through short videos.

Evaluating the Content and Quality of Videos Related to Hypertrophic Scarring on TikTok in China: Cross-Sectional Study

BACKGROUND

Hypertrophic scars (HTSs) are a predominant condition after burns and trauma, and it causes severe physiological and psychological problems. TikTok (Douyin in Chinese), a popular platform for sharing short videos, has shown the potential to spread health information, including information related to HTSs. Educating the public to obtain correct information is important to reduce the incidence of physiological and psychological problems caused by HTSs. However, the quality and reliability of HTS-related video content on TikTok in mainland China have not been thoroughly studied.

OBJECTIVE

This study aims to evaluate the content and quality of short videos related to HTSs on the Chinese version of TikTok (Douyin) and explore the factors related to their quality, providing valuable insights for health information dissemination.

METHODS

We collected a sample of 153 TikTok videos in Chinese related to HTSs and categorized them according to video source and content. We evaluated the video content using a coding schema, and a hexagonal radar schema was used to intuitively display the spotlight and weight of each aspect of the videos. We evaluated quality using 4 standardized tools: the modified DISCERN (mDISCERN) questionnaire, the Journal of the American Medical Association, the Global Quality Scale (GQS), and the Health on the Net Foundation Code of Conduct. We also explored the potential relationship between video quality and characteristics.

RESULTS

The analysis showed that health care professionals uploaded all videos about treating HTSs, which matched the hexagonal radar model analysis findings. The quality assessment scores for the Journal of the American Medical Association, GQS, mDISCERN, and the Health on the Net Foundation Code of Conduct had median values of 1 (IQR 1-2), 2 (IQR 2-3), 2 (IQR 2-3), and 3 (IQR 3-4), respectively, indicating a need to improve the quality and reliability of videos on HTSs. In addition, high-quality videos were more popular, based on metrics such as likes, comments, favorites, and shares (P<.001). Interestingly, the time when the videos were uploaded positively correlated with GQS and mDISCERN scores (r=0.393; P<.001 and r=0.273; P<.001), while the video length did not significantly correlate with evaluation scores (P=.78, P=.20, P=.07, and P=.04).

CONCLUSIONS

The quality of TikTok videos related to HTSs is generally moderate. Users should exercise caution when seeking information on HTSs from TikTok. It is advisable to choose videos uploaded by health care professionals from the burn department and the burn plastic surgery department, and in the Chinese context, those produced in first-tier cities and emerging first-tier cities.

Assessing the quality of educational short videos on dry eye care: a cross-sectional study

Background

Short video social media platforms play a crucial role in public health by effectively disseminating health information. Despite this, many educational videos on dry eye care have not received sufficient attention. This study aimed to conduct a comprehensive analysis and evaluate the quality of educational short videos on dry eye care available on TikTok.

Methods

On August 30, 2024, the top 200 videos related to dry eye were viewed from the Chinese version of TikTok using the platform's default ranking. The overall quality, reliability, comprehensibility, and applicability of the videos are systematically evaluated using the DISCERN and PEMAT-A/V assessment tools.

Results

A total of 199 videos were included in the study and categorized based on account information: medical professional individual users, general professional individual users, for-profit organizations, non-profit organizations, and news organizations. Medical professionals were the predominant uploaders, contributing 81% of the videos. The overall misinformation rate was 2%. A majority of the videos (85.9%) addressed at least two aspects of dry eye, while only 14.1% covered three or more topics. The videos scored 22.4 ± 6.4 for reliability and 17.4 ± 6.2 for treatment options. Upon evaluation, the understandability and actionability of these videos were found to be 79.1% and 60.4%, respectively.

Conclusion

TikTok holds significant potential for disseminating health information, primarily through content created by medical professionals. Currently, much of the content focuses on the symptoms and management of dry eye, with limited discussion on its definition, classification, and diagnosis. While most video content is reliable, there is a risk of incomplete or inaccurate information, these videos can serve as a reference. Therefore, the public should exercise caution when seeking information on dry eye through TikTok and individuals experiencing symptoms are advised to consult healthcare professionals for accurate diagnosis and treatment.

Descriptive analysis of TikTok content on vaccination in Arabic

The extensive impact of social media on communication of public health information is a growing concern. This is particularly worrying in the context of vaccination. Thus, we investigated the quality of TikTok videos regarding vaccination in Arabic, with examination of the association of video source and content type with the information quality and video engagement metrics. The final sample comprised a total of 129 TikTok videos in Arabic posted between January 2021 and July 2024. Videos were categorized based on the source [healthcare professional (HCPs), lay individuals, media], and content type (COVID-19 vaccination, childhood vaccination, general vaccination, others). We utilized a miniaturized version of the DISCERN instrument (mini-DISCERN) scale to evaluate information quality by two independent raters and assessed video engagement metrics (Likes, Comments, Shares, and Saves). The results indicated a statistically significant discrepancy in information quality, with videos from HCPs and media outlets scoring higher on the mini-DISCERN scale compared to those from lay individuals [mean: (4.818 ± 0.726) vs. (4.053 ± 1.441) vs. (2.003 ± 1.640), P < 0.001]. The highest information quality was found for videos on childhood vaccination, whereas content on COVID-19 vaccination was rated significantly lower on mini-DISCERN [mean: (4.510 ± 1.269) vs. (2.542 ± 1.827), P < 0.001]. Videos with higher engagement metrics, particularly those from lay individuals, were negatively correlated with information quality. Linear regression analysis confirmed the significant influence of the creator background (β = -0.618, P < 0.001) and video topic (β = 0.179, P = 0.009) on information quality. This study highlights the critical role of content creator background and topic on the quality of vaccination-related information on TikTok in Arabic. We emphasize the need for stringent verification of TikTok content, especially from lay individuals, as videos with higher engagement metrics often contained lower-quality information regarding vaccination. We recommend enhanced support for content from HCPs and targeted digital literacy programs to combat vaccine misinformation on TikTok effectively.

Analysis of patient education materials on TikTok for erectile dysfunction treatment

Erectile dysfunction (ED) is widely prevalent and has diverse management options which are poorly understood and accessed by patients. This cross-sectional TikTok study aimed to evaluate the quality of ED educational materials and define trends in healthcare provider content development. Three reviewers independently analyzed 50 videos. Variables of interest included author characteristics, viewer engagement, content accuracy, and video quality, understandability, and actionability. Quantitative analysis was performed using the validated PEMAT and DISCERN screening tools. A wide range of treatment options were presented among the 26 healthcare and 24 non-healthcare videos, including behavioral techniques, herbs/ supplements, dietary modifications, pharmacology, and interventions. Healthcare authors tended to focus on pharmacology and intervention, and when they did discuss behavioral, herbal, or dietary options, accuracy significantly exceeded non-healthcare authors (96.2% vs. 12.5%, p < 0.001). Although healthcare-authored videos were superior in accuracy and understandability scores (p < 0.001), they had low actionability and reduced user engagement including likes (1195 vs. 4723, p = 0.050) and bookmarks (114 vs. 839, p = 0.010). Our findings indicate that despite the availability of high-quality ED treatment resources created by healthcare professionals on TikTok, engagement and actionability remain alarmingly low. Furthermore, there is substantial, readily accessible misinformation produced by non-healthcare entities. Modernized medical education paradigms, communications research, and awareness may optimize social media as a public health tool.

Evaluating HPV Vaccination-Related Content on a Burgeoning Social Media Platform: Insufficient Quality of TikTok

Objective

Assessing the quality of human papillomavirus (HPV) vaccination-related content on TikTok is crucial due to its popularity among adolescents. We assessed these videos while comparing the content and quality of videos with and without physician involvement.

Study Design

Cross-sectional cohort analysis.

Setting

HPV vaccination-related TikTok videos.

Methods

The TikTok library was queried using the search terms #HPVvaccine, #HPVvaccination, #Gardasil, #Gardasilvaccine, and #Gardasilvaccination. Video quality was evaluated using the DISCERN scale, assessing treatment-related information quality. Descriptive statistics were used to characterize our cohort. t Test and Fischer's exact test were used to assess for differences in video content and quality based on physician involvement. Significance was set at P < .05.

Results

Our search yielded 131 videos, averaging 68,503.12 views, 2314.27 likes, and 89.28 comments per video. Videos frequently involved physicians (48.09%), focused on education (54.96%) or advocacy (22.90%), and were US-made (68.90%). Otolaryngologists were rarely featured (3.17%). While most videos mentioned the HPV vaccine protected against cancer generally (86.26%), and cervical cancer specifically (67.94%), few discussed its protective effect against head and neck cancer (26.72%). Videos infrequently discussed updated eligibility among all adults ≤45 years of age (26.72%) or that men can also receive the vaccine (28.24%). Physician-involved videos were more focused on education (P < .001) and focused less on patient experiences (P < .001) and advocacy (P = .036). Overall DISCERN scores were low among physician (mean = 2.46, SD = 1.13) and nonphysician (mean = 2.09, SD = 1.02) content.

Conclusion

TikTok HPV vaccination content is poor in quality, even with physician involvement. Enhancing content quality and increasing otolaryngologist participation can boost HPV awareness and vaccination rates.

Quality assessment of heatstroke videos on TikTok

Background

The prevalence of heatstroke is rising due to global warming, making it a serious but preventable condition, highlighting the urgent need for effective dissemination of relevant health education to the general public. Advances in technology have made accessing health information more convenient and rapid. In recent years, short videos have become a primary medium for delivering health education, with TikTok gaining considerable popularity among the general public. However, the quality of heatstroke-related health education content on TikTok deserves closer scrutiny.

Objective

This study aimed to evaluate the quality and content of heatstroke-related videos available on TikTok.

Methods

The present study analyzed the top 100 heatstroke-related short videos on TikTok, focusing on their characteristics, quality, and the content they conveyed. The quality of these videos was assessed using the DISCERN instrument. In addition, the completeness of the videos was assessed by examining six key aspects: disease definition, clinical manifestations, risk factors, assessment, management, and outcomes.

Results

The study included a total of 90 videos. The results showed that news organizations and healthcare professionals were the primary contributors to these videos, with those from news organizations receiving the most attention. In contrast, those from healthcare professionals received comparatively less engagement. Overall, the quality of the information was found to be moderately low, with the highest quality videos posted by non-profit organizations, followed by those posted by healthcare professionals. The majority of videos uploaded described the disease definition, clinical presentation, risk factors, assessment, management, and outcomes of heatstroke.

Conclusion

The quality of information provided in heatstroke-related short videos on TikTok is generally inadequate and requires significant improvement. In addition, such content should be subject to government review to ensure its accuracy and reliability.

An analysis of oral contraceptive related videos on TikTok

Background

TikTok has increasingly become a source of information about reproductive health. Patients seeking health information about oral contraception on TikTok may be influenced by videos containing misinformation or biased information.

Objective

This social media infodemiological study aims to provide a descriptive content analysis of the quality and reliability of oral contraceptive health information on TikTok.

Study Design

Researchers screened 1,000 TikTok videos from December 2022 to March 2023 retrieved under various search terms related to oral contraceptives. Data, including engagement metrics such as views, likes, comments, saves, and shares, were recorded. Video content including contraceptive methods discussed, efficacy, tolerability, and side effects were recorded. Two reviewers independently used a modified DISCERN criteria and Global Quality Scale (GQS) to assess the quality and reliability of information for each video.

Results

Five hundred seventy-four videos were analyzed after applying exclusion criteria. Videos had a median length of 27 seconds (Q1=13sec, Q3=57sec) and received a median of 35,000 total views (Q1=4856 views, Q3=411,400 views) and 166 views per day (Q1=28 views per day, Q3=2021 views per day). Video creators were 83.3% female and 58.7% white. The mean modified DISCERN score was 1.63 (SD=1.06) and the mean GQS score was 2.28 (SD=1.37). Video creators were 83.3% female and 58.7% white. The mean modified DISCERN score was 1.63 (SD=1.06) and the mean GQS score was 2.28 (SD=1.37). The most common topic discussed in the videos was the effects of contraception. Healthcare professionals had significantly higher DISCERN and GQS scores (p<.001) than non-healthcare professionals. However, they received fewer views, likes, and comments on their videos (p<.001). Healthcare professionals were 86 times more likely than non-healthcare professionals to post educational videos (p<.001). However, non-educational content received significantly more views, likes, and comments than educational content (p<.001).

Conclusion

TikTok videos related to oral contraceptive health had low quality and reliability of information. The majority of videos were made by non-healthcare providers, and the most common topic discussed was the effects of contraception. Videos made by healthcare professionals contained more reliable contraceptive information, but received less engagement than videos made by non-healthcare professionals. Healthcare providers should consider the prevalence of poor-quality information about oral contraceptives on social media when counseling and educating patients about reproductive health.

Quality assessment of health science-related short videos on TikTok: A scoping review

OBJECTIVE

The aims of this review are to clarify the current state of research in terms of assessment tools and assessors of the quality of health science-related short videos on TikTok, to identify limitations in existing research; and to provide a reference for future studies.

METHODS

A scoping review was conducted. The Cochrane Library, PubMed, MEDLINE, Web of Science, Embase, Scopus, EBSCO, CNKI, VIP, Wanfang Data, and CBM databases were searched from September 2016 to November 2022. Manual searching was also performed to identify additional eligible studies. A total of 2620 documents were initially retrieved, and 29 were ultimately included. The literature was screened and collected, and data were extracted and summarized by 2 researchers.

RESULTS

(1) The quality evaluation tools used in the 29 papers included the DISCERN, PEMAT(A/V), GQS, JAMA, HONcode, guidelines and self-developed tools. Twenty-four of the included articles used the DISCERN for quality assessment, which was the most frequently used evaluation tool. However, most of these tools were not developed to assess health science-related short videos, lacked credibility tests, and had poor applicability; therefore, the accuracy of the evaluation results might be biased. (2) The assessors of the quality of health science-related short videos on TikTok were mainly experts in related fields and medical students, with doctors (12/14) being the most common evaluators. Fifteen studies did not report the identity of the evaluators, and 12 studies did not report interrater reliability.

CONCLUSION

This scoping review found that there is a lack of specific quality assessment tools for health science-related short videos on TikTok. Second, the current quality assessors of health science-related short videos on TikTok are limited. Future research should focus on the development of reliable, scientific quality assessment tools for health science-related short videos; unifying the evaluation standards; inviting users with different backgrounds and different health literacy levels to conduct quality assessments; exploring the quality assessment of health science-related short videos on TikTok from different perspectives.

Third-Line Overactive Bladder Therapies on TikTok: What Does the Public Learn?

IMPORTANCE

Millions of people rely on social media platforms, including TikTok, for health-related information. TikTok has not yet been evaluated as an information source for overactive bladder (OAB) third-line therapies.

OBJECTIVES

Our aim was to assess TikTok videos on third-line therapies for OAB for misinformation and quality.

STUDY DESIGN

In this cross-sectional analysis, we abstracted the top 50 TikTok videos for keywords: "Axonics," "sacral neuromodulation," "Interstim," "PTNS," "posterior tibial nerve stimulation," and "bladder Botox." Videos were scored for quality by 3 independent reviewers using the Medical Quality Video Evaluation Tool (MQ-VET). Two reviewers determined if videos contained misinformation.

RESULTS

Of 300 videos screened, 119 videos were included. Twenty-four (21%) were created by medical professionals (MPs). Medical professional videos were more frequently shared (5 vs 1, P < 0.01) but had similar views, likes, comments, and length. Although MP videos had significantly higher MQ-VET scores (43 vs 27, P < 0.01), there was no difference in the rate of misinformation between MP and non-MP videos (21% vs 18%). Twenty-two videos (18.4%) contained misinformation, which were 3 times longer (50.5 vs 15 seconds, P < 0.01) and had higher MQ-VET scores (34.5 vs 27, P = 0.03) than those without misinformation. Common themes of misinformation pertained to therapy indication, mechanism of action, and patient limitations after undergoing therapy.

CONCLUSIONS

Many TikTok videos on OAB third-line therapies contain misinformation. Most of these videos were not of high quality and created by the public. Medical professionals should be aware of misinformation permeating TikTok, given its large audience, and aim to promote or offer educational material of better accuracy and quality.

Evaluation of TikTok videos on acute pancreatitis: content quality and reliability analysis

BACKGROUND

Acute pancreatitis (AP) is a common acute digestive system disorder, with patients often turning to TikTok for AP-related information. However, the platform's video quality on AP has not been thoroughly investigated.

OBJECTIVE

The main purpose of this study is to evaluate the quality of videos about AP on TikTok, and the secondary purpose is to study the related factors of video quality.

METHODS

This study involved retrieving AP-related videos from TikTok, determining, and analyzing them based on predefined inclusion and exclusion criteria. Relevant data were extracted and compiled for evaluation. Video quality was scored using the DISCERN instrument and the Health on the Net (HONcode) score, complemented by introducing the Acute Pancreatitis Content Score (APCS). Pearson correlation analysis was used to assess the correlation between video quality scores and user engagement metrics such as likes, comments, favorites, retweets, and video duration.

RESULTS

A total of 111 TikTok videos were included for analysis, and video publishers were composed of physicians (89.18%), news media organizations (13.51%), individual users (5.41%), and medical institutions (0.9%). The majority of videos focused on AP-related educational content (64.87%), followed by physicians' diagnostic and treatment records (15.32%), and personal experiences (19.81%). The mean scores for DISCERN, HONcode, and APCS were 33.05 ± 7.87, 3.09 ± 0.93, and 1.86 ± 1.30, respectively. The highest video scores were those posted by physicians (35.17 ± 7.02 for DISCERN, 3.31 ± 0.56 for HONcode, and 1.94 ± 1.34 for APCS, respectively). According to the APCS, the main contents focused on etiology (n = 55, 49.5%) and clinical presentations (n = 36, 32.4%), followed by treatment (n = 24, 21.6%), severity (n = 20, 18.0%), prevention (n = 19, 17.1%), pathophysiology (n = 17, 15.3%), definitions (n = 13, 11.7%), examinations (n = 10, 9%), and other related content. There was no correlation between the scores of the three evaluation tools and the number of followers, likes, comments, favorites, and retweets of the video. However, DISCERN (r = 0.309) and APCS (r = 0.407) showed a significant positive correlation with video duration, while HONcode showed no correlation with the duration of the video.

CONCLUSIONS

The general quality of TikTok videos related to AP is poor; however, the content posted by medical professionals shows relatively higher quality, predominantly focusing on clinical presentations and etiologies. There is a discernible correlation between video duration and quality ratings, indicating that a combined approach incorporating the guideline can comprehensively evaluate AP-related content on TikTok.

Myopia information on TikTok: analysis factors that impact video quality and audience engagement

BACKGROUND

TikTok is emerging as a vital platform for health information dissemination. Despite myopia being a global public health issue, the high-quality myopia information shared by health educators often fails to go viral. It is imperative to analyze the factors influencing video quality and popularity, especially from diverse perspectives of researchers, health educators, and audiences.

METHODS

TikTok myopia-related videos were retrieved using TikTok's default comprehensive search (DCS) and most liked search (MLS) strategies. Venn diagrams were employed to illustrate the relationships and commonalities between the two strategies across four sample sizes (top 200, 150, 100, and 50). Video metadata, including details such as creator information, production properties, upload time, video duration, and viewer engagement, were collected. Video quality was assessed using the DISCERN tool. Video content covering six aspects of myopia were evaluated. The impact of search strategies, video sample sizes, production properties, and myopia content on video quality and audience engagement was analyzed through single-factor or multi-factor analysis.

RESULTS

DCS and MLS retrieval strategies, as well as varying sample sizes, resulted in differences in audience engagement for myopia videos (P < 0.039), while The DISCERN quality scores remained comparable (P > 0.221). Videos published by healthcare professionals (HCPs) and non-profit organizations (NPOs) were associated with high-quality (P ≤ 0.014) but comparatively lower popularity (P < 0.033). Videos that reported contents of risk factors, management, and outcomes showed high popularity (P < 0.018), while longer video duration (> 60s) exhibited the opposite trend (P < 0.032). Content on myopia evaluation (P ≤ 0.001) and management (P ≤ 0.022) and video duration were positively correlated with higher DISCERN quality.

CONCLUSION

Videos created by HCPs and NPOs deserve greater attention. Rather than pursuing entertaining effects, professional educators should emphasize producing concise, and high-quality myopia content that readily resonates with the audience and has the potential to go viral on the platform.

Quality assessment of videos on social media platforms related to gestational diabetes mellitus in China: A cross-section study

Purpose

This study aimed to systematically evaluate the quality of content and information in videos related to gestational diabetes mellitus on Chinese social media platforms.

Methods

The videos on various platforms, TikTok, Bilibili, and Weibo, were searched with the keyword "gestational diabetes mellitus" in Chinese, and the first 50 videos with a comprehensive ranking on each platform were included for subsequent analysis. Characteristic information of video was collected, such as their duration, number of days online, number of likes, comments, and number of shares. DISCREN, JAMA (The Journal of the American Medical Association) Benchmark Criteria, and GQS (Global Quality Scores) were used to assess the quality of all videos. Finally, the correlation analysis was performed among video features, video sources, DISCERN scores, and JAMA scores.

Results

Ultimately, 135 videos were included in this study. The mean DISCERN total score was 31.84 ± 7.85, the mean JAMA score was 2.33 ± 0.72, and the mean GQS was 2.00 ± 0.40. Most of the videos (52.6%) were uploaded by independent medical professionals, and videos uploaded by professionals had the shortest duration and time online (P < 0.001). The source of the video was associated with numbers of "likes", "comments", and "shares" for JAMA scores (P < 0.001), but there was no correlation with DISCERN scores. Generally, videos on TikTok with the shortest duration received the most numbers of "likes", "comments", and "shares", but the overall quality of videos on Weibo was higher.

Conclusion

Although the majority of the videos were uploaded by independent medical professionals, the overall quality appeared to be poor. Therefore, more efforts and actions should be taken to improve the quality of videos related to gestational diabetes mellitus.

Cancer: A model topic for misinformation researchers

Although cancer might seem like a niche subject, we argue that it is a model topic for misinformation researchers, and an ideal area of application given its importance for society. We first discuss the prevalence of cancer misinformation online and how it has the potential to cause harm. We next examine the financial incentives for those who profit from disinformation dissemination, how people with cancer are a uniquely vulnerable population, and why trust in science and medical professionals is particularly relevant to this topic. We finally discuss how belief in cancer misinformation has clear objective consequences and can be measured with treatment adherence and health outcomes such as mortality. In sum, cancer misinformation could assist the characterization of misinformation beliefs and be used to develop tools to combat misinformation in general.

Breath of Change: Evaluating Asthma Information on TikTok and Introducing the Video Health Information Credibility Score

Introduction Asthma's global prevalence underscores the need for accessible health information dissemination, especially in the digital age. TikTok, known for its wide reach and diverse content, presents both opportunities and challenges in health information dissemination. This study aims to characterize the quality and reach of asthma-related content on TikTok and introduces the Video Health Information Credibility Score (VHICS) as a novel tool for quality assessment. Materials and methods We used a systematic methodology to analyze the top 100 TikTok videos by the number of likes tagged with #asthma. Data were collected in June 2023 and January 2024 to allow for temporal trend analysis. Videos were evaluated based on engagement metrics (views, likes, comments, shares, and favorites) and quality using the DISCERN instrument. Results Our analysis showed that physician-generated content accounted for a significant proportion of asthma-related videos, with varying levels of engagement. The DISCERN scores, with a range of 1 (lowest) to 5 highest), provided insights into content quality, revealing trends in user engagement and information reliability over time. Temporal analysis indicated changes in content creation and audience interaction. Discussion The study highlights the evolving landscape of digital health communication on TikTok. The introduction of VHICS added depth to the quality assessment of future directions, indicating the necessity for accurate and reliable health information on social media. The findings suggest an imperative for healthcare professionals to address misinformation and leverage digital platforms for patient education effectively. Conclusions TikTok is a significant medium for health information dissemination, with substantial potential for impact in patient education. The introduction of VHICS can enrich the analysis of video content, offering a robust tool for assessing the quality of health information on social media. This study underscores the importance of credible, clear, and audience-relevant health communication in the digital era.

The quality and reliability of short videos about thyroid nodules on BiliBili and TikTok: Cross-sectional study

Background

The detection rate of thyroid nodules has witnessed a significant surge in recent years, triggering heightened public apprehension. Short video platforms such as TikTok and BiliBili have showed tremendous potential in the dissemination of health information. There is a plethora of videos about thyroid nodules on TikTok and BiliBili, but the quality and reliability of videos concerning thyroid nodules remains unknown.

Methods

On December 3rd, 2023, the top 100 short videos related to thyroid nodules on BiliBili and TikTok were collected through a comprehensive search in Chinese. After extracting the basic information, the quality and reliability of each video was assessed by using the global quality score (GQS) and DISCERN score. Further, Spearman correlation analyses were applied to examine the correlation among video variables, GQS and DISCERN score.

Results

Compared to BiliBili, TikTok exhibits greater popularity, as evidenced by higher counts of likes (P = 0.021), comments (P = 0.008) and shares (P = 0.017). The median (interquartile range) scores of GQS and DISCERN score were 3 (2-3) on TikTok while 2 (2-3) on BiliBili. Both reviewers exhibited good consistency in GQS and DISCERN score. Moreover, it was observed that the videos shared by thyroid specialists demonstrated higher scores both in GQS (P = 0.014) and DISCERN score (P = 0.022) than others on TikTok. Spearman correlation analysis revealed no significant correlation between video variables and the scores of GQS and DISCERN score.

Conclusions

The quality and reliability of thyroid nodules videos on BiliBili and TikTok were unsatisfactory. Notably, videos shared by thyroid specialists are more likely to exhibit superior quality and reliability. People should exercise caution when perusing short videos.

Information quality of videos related to Helicobacter pylori infection on TikTok: Cross-sectional study

BACKGROUND

Helicobacter pylori (H. pylori) poses serious threats to human health. TikTok (Douyin in Chinese), a major social media platform focused on sharing short videos, has demonstrated great potential in spreading health information, including information related to H. pylori infection. This study aims to evaluate the content and quality of the information shared in TikTok videos about H. pylori infection in mainland China.

METHODS

We collected a sample of 116 videos in Chinese related to H. pylori infection from TikTok. Video contents were evaluated by the coding schema proposed by Goobie et al., and the Hexagonal Radar Schema was used to intuitively display the spotlight and weight of each aspect of the videos. The DISCERN questionnaire was used to evaluate the quality of the videos.

RESULTS

We identified two major sources of videos related to H. pylori: individual users (n = 89) and organizational users (n = 27). Regarding content, the Hexagonal Radar Charts showed that more than 35% of the videos delivered moderate to high quality content (>1 point) in terms of definition, symptoms and management of the disease, whereas risk factors, evaluation and outcomes of the disease were less discussed. The DISCERN classification data showed that 0.9% of the videos were "very poor," 5.2% "poor," 68.7% "fair," 20.0% "good," and only 5.2% "excellent". Regarding total DISCERN scores, videos published by nonprofit organizations had the highest scores, followed by videos uploaded by health professionals.

CONCLUSION

Although the overall quality of TikTok videos related to H. pylori infection was medium, users should be careful when obtaining information related to H. pylori infection on TikTok and opt for videos uploaded by nonprofit organizations and health professionals.

Evaluation of the quality of thyroidectomy-related posts on a video-based social media platform

Objective

To evaluate the quality of thyroidectomy-related posts on TikTok, the fastest-growing social media platform worldwide.

Methods

Videos posted from April 2020 to September 2022 were queried on TikTok using the search terms "thyroidsurgery," "thyroidectomy," and "thyroidremoval." Two reviewers recorded thematic, demographic, and performance data of these posts. The DISCERN instrument was used to evaluate the quality and reliability of the information contained in the videos. Descriptive statistics were used to characterize post-submitter demographics and video content. Simple and multiple linear regression analyses were used to evaluate the association between DISCERN scores and video characteristics. Univariate analysis of variance was performed to compare DISCERN scores between author types.

Results

In this study, 228 TikTok videos were included which totaled over 23 million views. On average, each video accumulated more than 6000 "likes," 300 comments, and 70 shares. The average total DISCERN score was 27.46, which is deemed to be of poor overall quality. Upon multiple linear regression, video duration (β = 4.66, p < .001) and educational subject type (β = 3.97, p < .001) significantly positively predicted aggregate DISCERN scores, while journey subject type (β = -3.19, p = .006), and reassurance subject type (β = -2.52, p = .035) significantly negatively predicted aggregate DISCERN scores. Aggregate DISCERN scores varied significantly (p < .05) between author types.

Conclusion

Social media posts on TikTok about thyroidectomy are mostly of poor quality and reliability but vary by authorship, subject type, and video characteristics. Given its widespread popularity, TikTok videos may have an increasing role in shaping patient perception of thyroidectomy and may represent an opportunity to provide education.

Lay summary

TikTok posts about thyroidectomy are mostly of poor quality but vary by authorship, subject, and video characteristics. Given its popularity, TikTok videos may have a role in shaping the patient perception of thyroidectomy and may represent an opportunity to provide education.

Level of evidence

Level 4.

Quality and educational content of Douyin and TikTok short videos on early screening of rectal cancer

Background and Aim

The aim of this study was to assess the quality and content of videos on Douyin and TikTok for their educational role on early screening of rectal cancer (RC).

Methods

We conducted a search for videos related to RC on the Douyin and TikTok applications on 20 April 2023. The search was conducted in Chinese on Douyin and in English and Japanese on TikTok. A sample of the first 100 videos recommended by the software was selected for each language group. The content of the videos was evaluated using a content scorecard, while the quality of the videos was assessed using DISCERN. Subsequently, we conducted two partial correlations: one between the DISCERN score and the number of likes, and another between the video content score and the number of likes.

Results

This study encompassed a total of 89 Chinese, 54 English, and 51 Japanese videos. After selection, 78 Chinese, 38 English, and 25 Japanese videos were identified to contain content related to early screening for RC, prompting further quality assessment. Notably, videos in the Chinese language showed the highest DISCERN score (P < 0.05). In terms of partial correlation analysis, it was observed that both the content score and DISCERN score did not show a significant correlation with the number of likes (P > 0.05).

Conclusion

In terms of quality score and content score, the Chinese videos on Douyin show superiority over the English and Japanese videos on TikTok. However, there is potential for improving the overall appeal of the Chinese videos.

Evaluation of the quality and reliability of anal cancer and its precancerous lesions-related content on YouTube: a cross-sectional study

OBJECTIVES

This research aims at evaluating the quality of anal cancer and its precancerous lesions-related videos on YouTube.

DESIGN

Cross-sectional survey design.

SETTING

USA.

PARTICIPANTS

The top 150 videos on YouTube were selected for analysis based on three search terms. The duplicate, irrelevant, commercial, operation-related and audio-free videos were excluded. Finally, 105 relevant videos were included.

METHODS

We assessed the completeness of video content from six dimensions and marked the men having sex with men (MSM)-related videos. To measure the video quality, DISCERN, Journal of the American Medical Association (JAMA) Benchmark Criteria, Patient Education Materials Assessment Tool (PEMAT) and Global Quality Scale (GQS) were used. The correlation between DISCERN classification and duration, JAMA, PEMAT and GQS scores were recorded.

RESULTS

The video content was mainly about the management of the disease (mean score 1.086). Overall, the quality of videos uploaded by the non-profit organisation was relatively high. A correlation existed between each other of the JAMA, DISCERN and GQS scores (p<0.001). Moreover, they were positively correlated with video duration and PEMAT scores (p<0.001).

CONCLUSIONS

Although the overall quality of information about anal cancer and its precancerous lesions videos on YouTube is acceptable, it might not fully meet the health information needs of patients. Therefore, they should exercise caution when using YouTube as a source of anal cancer-related information, especially the MSM population.

Navigating Digital Dermatology: An Analysis of Acne-Related Content on TikTok

Background With TikTok's rising popularity as a hub for health information dissemination, the quality and nature of such content require assessment. This study investigates the popularity and quality of the top 100 most-liked videos tagged with "#acne" on TikTok. This study aims to examine the engagement and quality of acne-related content on TikTok, assess contributions from diverse sources, including physicians and non-physicians, and guide healthcare professionals in leveraging this platform for public health education. Methodology A cross-sectional analysis of the top 100 most-liked videos tagged with "#acne" on TikTok as of June 7, 2023, was conducted. Parameters assessed included the profession of the creator, gender, specialty, content type, and other observable characteristics. The quality was measured using the DISCERN tool. Results Of the dataset, 38 videos were by physicians and 29 by non-physicians. Physician-created content had higher mean views, likes, comments, shares, and favorites than non-physician-created content. Videos by dermatologists and non-dermatologists received similar engagement. Videos sharing personal experiences achieved the highest DISCERN score. Overall, DISCERN scores were uniformly low across all categories. Conclusions Physicians, especially dermatologists, are trusted sources of acne-related information on TikTok. The study underscores the need for professionals to provide reliable, evidence-based information on such platforms, guiding effective health communication in the digital age.

"More than a song and dance": Exploration of patient perspectives and educational quality of gynecologic cancer content on TikTok

OBJECTIVE

To investigate themes, quality, and reliability of gynecologic cancer-related content on the social media application TikTok.

METHODS

TikTok was systematically searched for the 100 most popular posts for ovarian cancer (OC), endometrial cancer (EC), cervical cancer (CC), vulvar cancer (VC), and gestational trophoblastic disease (GTD) in August 2022. Data was collected for demographics, tone, and themes. Educational videos were rated for quality and reliability utilizing the modified DISCERN scale. Relationships between content demographics, disease sites, and themes were assessed.

RESULTS

As of August 2022, the top five hashtags for each gynecologic cancer on TikTok had 466.7 million views. 430 of the top 500 posts were eligible for inclusion (OC: n = 86, CC: n = 93, EC: n = 98, GTD: n = 63, VC: n = 90). The majority of creators (n = 323, 75.1%) were White, 33 (7.7%) were Black, 20 (4.6%) were Asian/Pacific Islander (API), 10 (2.3%) were South Asian, 20 (4.7%) were Hispanic/Latino/a, 24 (5.5%) were unable to determine. Eleven central themes were identified, with significant differences when analyzed by disease site and race. The median DISCERN score for all posts was 1.0, indicating poor educational quality and reliability. When compared by race, South Asian/API posters received the highest scores (3, IQR 2.5) versus Black (2: IQR 3), Hispanic/Latino/a (2: IQR 0), and White posters (1, IQR 2) (p = 0.0013).

CONCLUSION(S)

Gynecologic cancer-related content on TikTok is of poor educational quality, and racial disparities in gynecologic cancer extend to social media. Opportunities exist to create more diverse content to support racial and cultural experiences in gynecologic cancer treatment.

Quality and Reliability of Liver Cancer-Related Short Chinese Videos on TikTok and Bilibili: Cross-Sectional Content Analysis Study

BACKGROUND

Liver cancer incidence has been increasing in China in the recent years, leading to increased public concern regarding the burden of this disease. Short videos on liver cancer are disseminated through TikTok and Bilibili apps, which have gained popularity in recent years as an easily accessible source of health information. However, the credibility, quality, and usefulness of the information in these short videos and the professional knowledge of the individuals uploading health information-based videos in these platforms have not yet been evaluated.

OBJECTIVE

Our study aims to assess the quality of the information in Chinese short videos on liver cancer shared on the TikTok and Bilibili short video-sharing platforms.

METHODS

In March 2023, we assessed the top 100 Chinese short videos on liver cancer in TikTok and Bilibili (200 videos in total) for their information quality and reliability by using 2 rating tools, namely, global quality score (GQS) and the DISCERN instrument. Correlation and Poisson regression analyses were applied to discuss the factors that could impact video quality.

RESULTS

Compared to Bilibili, TikTok is more popular, although the length of the videos on TikTok is shorter than that of the videos on Bilibili (P<.001). The quality of the short videos on liver cancer in TikTok and Bilibili was not satisfactory, with median GQS of 3 (IQR 2-4) and 2 (IQR 1-5) and median DISCERN scores of 5 (IQR 4-6) and 4 (IQR 2-7), respectively. In general, the quality of videos sourced from professional institutions and individuals was better than that of those sourced from nonprofessionals, and videos involving disease-related knowledge were of better quality than those covering news and reports. No significant differences were found in the quality of videos uploaded by individuals from different professions, with the exception of those uploaded by traditional Chinese medicine professionals, which demonstrated poorer quality. Only video shares were positively correlated with the GQS (r=0.17, P=.01), and no video variables could predict the video quality.

CONCLUSIONS

Our study shows that the quality of short videos on health information related to liver cancer is poor on Bilibili and TikTok, but videos uploaded by health care professionals can be considered reliable in terms of comprehensiveness and content quality. Thus, short videos providing medical information on TikTok and Bilibili must be carefully considered for scientific soundness by active information seekers before they make decisions on their health care management.

TikTok as a source of information regarding premature ejaculation: a qualitative assessment

Background

Patients are increasingly looking to social media platforms for medical information.

Aim

In this study we aimed to evaluate the quality of information regarding premature ejaculation (PE) on TikTok.

Methods

The term "premature ejaculation" was searched on TikTok on a single day in May 2022. Videos were sorted by 3 reviewers as reliable or unreliable based on the accuracy of video content. Relevant user metrics were collected for each video, including the numbers of likes, shares, and followers, and the video length, source of upload, and speaker type. The quality of information was objectified with 2 validated tools, with mean scores obtained from the 3 reviewers, the Patient Education Materials Assessment Tool (PEMAT) and the 5-point modified DISCERN instrument.

Outcomes

Outcomes were video reliability categorization, video and user metrics as described above, and video quality as quantified by PEMAT and DISCERN scores.

Results

Eight videos were categorized as reliable and 32 videos were categorized as unreliable. The mean number of "likes" per video was higher in the reliable than in the unreliable group (1238 vs 126, P < .018). Accounts posting reliable videos had higher mean numbers of followers than those posting unreliable videos (55 050 vs 12 042, P = .025). The majority of unreliable videos (75%) vs reliable videos (12.5%) were posted by self-identified patients or individual users, whereas 62.5% of reliable videos vs versus 6.3% of unreliable videos were posted by individual physicians or physician groups. Few videos overall mentioned PE definition, indications for PE treatment, types of treatment, or value of psychological intervention (12.5%, 15%, 22.5%, and 5.0% of videos, respectively). Video length and number of shares did not differ between groups. Reliable videos had higher PEMAT (73.0 vs 45.1, P < .001) and DISCERN (2.7 vs 0, P < .001.) scores.

Clinical implications

There exists a critical need for enhanced quality of medical information on social media platforms in hopes of encouraging patients with impaired sexual function to seek appropriate medical care.

Strength and limitations

Strengths of this study include the objective use of validated quality assessment tools and a focus on TikTok as an emerging social media platform. Limitations include large numbers of excluded videos.

Conclusion

The quality of available information regarding PE on TikTok is low, with a significant percentage of videos on this topic fraught with inaccuracies. Given TikTok's prominence as a social media platform primarily geared toward younger audiences, we emphasize the need for improvement in the quality of information available regarding PE and its management.

Accuracy of prostate cancer screening recommendations for high-risk populations on YouTube and TikTok

Objectives

This study aimed to evaluate content quality and racial/ethnic representation, particularly of high-risk cohorts, of prostate cancer screening videos on YouTube (YT) and TikTok (TK).

Materials and Methods

The top 50 videos populated for the search term 'prostate cancer screening' on YT and TK that met inclusion criteria were retrieved in a cache-cleared browser. Three reviewers analysed all videos using validated criteria for the quality of consumer health information (DISCERN and Patient Education Materials Assessment Tool [PEMAT]). High quality was defined as follows: DISCERN ≥ 4, PEMAT understandability ≥75% and PEMAT actionability ≥75%. A 5-point Likert scale was used to demonstrate the level of misinformation compared to American Urological Association and National Comprehensive Cancer Network guidelines. Perceived race and ethnicity of people in the videos were assessed by consensus approach.

Results

TK videos were shorter (median 3.7 vs. 0.5 min, p < 0.001) and had more views per month (5437.5 vs. 19.3, p = 0.03) than YT videos. Perceived Black and Hispanic representation was present in 10% and 6% of YT videos and 20% and 12% of TK videos, respectively. High-risk racial/ethnic groups were explicitly discussed in 46% of YT videos and 8% of TK videos. A total of 98% of YT videos and 100% of TK videos had low- to moderate-quality consumer health information, and 88% of YT videos and 100% of TK videos had moderate to high levels of misinformation based on screening guidelines.

Conclusions

YT and TK videos about prostate cancer screening are widely viewed but do not provide quality consumer health information. Black and Hispanic men remain under-represented on both platforms, and high-risk racial groups were not discussed in most videos despite the importance for screening criteria. The low understandability and actionability, significant misinformation and lack of diversity in online videos support the need for higher quality videos with adequate attention to high-risk ethnic cohorts.

Mpox (monkeypox) information on TikTok: analysis of quality and audience engagement

BACKGROUND

Online information on mpox (monkeypox) is not well studied. We have analysed the video content, information quality, and audience engagement of mpox-related videos on TikTok.

METHODS

Using a hashtag-based searching strategy, we identified 2462 mpox-related videos on TikTok from 1 January to 11 August 2022; 85 were included after exclusion criteria screening. Videos were evaluated for content on features and treatment of mpox. Video and information quality was assessed using the DISCERN instrument and the Journal of the American Medical Association (JAMA) criteria. We recorded video source, evaluation scores, and viewer engagement metrics. The Kruskal-Wallis test was used for statistical analysis and multiple linear regression for factor-association studies.

RESULTS

Of the 85 videos, two assessed all content topics and highlighted 33% of all content items in clinical guidelines. The overall average score for the videos was 39.56 of 80 on the DISCERN instrument and 1.93 of 4 on the JAMA criteria. No video met all JAMA criteria. Subgroup analysis based on author identity suggested the variance in video scores by source (p<0.05 for all). Overall scores were higher for videos produced by doctors and science communicators than for those made by institutional users, nurses, and the general public. Multiple linear regression analysis showed that having people in the video (69.20, p=0.0001) and including information on treatment choices (1.15, p=0.045) were significant, independent determinants of audience engagement.

CONCLUSION

Public-directed TikTok videos on mpox frequently provide incomplete, inaccurate information, highlighting the potential risks of using TikTok as a health information source.

Quality and Popularity Trends of Weight Loss Procedure Videos on TikTok

INTRODUCTION

The use of social media as a medical information tool parallels rising obesity rates. TikTok, the popular video-sharing platform, contains nearly 99,000 videos hashtagged "weightloss." Prior studies have analyzed the quality of medical information on TikTok in other areas of medicine. However, the quality of videos regarding weight loss procedures has not yet been determined.

METHODS

Hashtags encompassing three weight loss modalities were searched using TikTok's algorithm. The first 50 videos meeting inclusion criteria for each modality were considered. Two independent reviewers categorized videos and assessed their content quality using DISCERN. Quality scores and popularity were compared between videos sources, modalities, and content categories.

RESULTS

Of 150 videos included, 20.7% were created by physicians versus 79.3% by non-physicians (p < 0.001). The average DISCERN score for physician-created content was significantly higher than that of non-physicians (p < 0.001), despite significantly less popularity (p < 0.002). The 50 most popular videos had significantly lower DISCERN scores than the 50 least popular (p < 0.02). The average DISCERN score for endoscopic sleeve gastroplasty (ESG) videos were significantly higher than videos related to Roux-en-Y gastric bypass (RYGB) and vertical sleeve gastrectomy (VSG) (p < 0.001). VSG-related videos were significantly more popular than RYGB- and ESG-related videos (p < 0.001 and p < 0.001). Finally, educational videos had significantly higher DISCERN scores than weight loss transformation and personal experience videos (p < 0.001).

CONCLUSION

Videos on TikTok related to weight loss procedures are poor, and greater popularity trends with lower quality. Assessment of content can encourage viewers to seek better information and allow providers to improve patient information tools.

What do TikTok videos offer us about dental implants treatment?

OBJECTIVE

To evaluate the quality, source, popularity, visibility and reliability of Tiktok videos on dental implants.

MATERIALS AND METHODS

A Tiktok search for dental implants was performed English language setting. Search hashtags were determined as "#dentalimplants," "#dentalimplantsurgery," "#dentalimplantstreatment," and "#implantdentistry." 148 of the 300 videos watched were included the study. Two periodontologists scored the videos for quality, reliability, utility, visibility and popularity. Videos' quality was evaluated using the Global Quality Scale (GQS) and the DISCERN tools, by categorizing them through quality of communication, duration, likes and dislikes, views, source and video type of each video were recorded.

RESULTS

There was significant positive correlation between "GQS" and "Total DISCERN" (Rho: 0.636) and "Duration in seconds" (Rho: 0.343) (p<0.05). For Total DISCERN, averages of the 31-45 seconds (p=0.010) and 46 seconds and above (p=.018) groups were higher than the averages of the 0-15 seconds group and average of the Educational group was higher than the average of the Testimonial, Product Advertisement and Entertainment groups (p=0.001, p=0.033 and p=0.041). Healthcare professionals mostly upload GQS 2 score videos and Hospital/Universities mostly upload GQS 2 and 3 score videos (p<0.05). Testimonial videos mostly receive GQS2 score videos and the 'Videos rich in supplementary visuals' quality also receives the most GQS4 score videos (p<0.05).

CONCLUSIONS

The results of this study demonstrate that TikTok videos provide low to moderate quality information about dental implants and that TikTok may not provide reliable information about dental implants.

TikTok and adolescent vision health: Content and information quality assessment of the top short videos related to myopia

Background

Despite the increasing recognition of the public health value of social media platforms, TikTok short videos focusing on adolescent vision health have not received much attention. We aimed to evaluate the content, sources, and information quality of myopia-related videos on TikTok.

Methods

The top 200 most-liked myopia-related videos on the Chinese version of TikTok were queried and screened on March 12, 2022. The descriptive characteristics, contents, and sources of the selected 168 videos were obtained, and their overall quality, reliability, understandability, and actionability were assessed using the validated scoring instruments DISCERN and PEMAT-A/V.

Results

Medical professionals were the main source (45.8%, 77/168) of videos. Misinformation (10.1%, 17/168) was mainly attributable to for-profit organizations (20%, 3/15) and individual non-medical users (31.3%, 10/32). However, their videos enjoyed the highest numbers of "likes," "comments," and "shares" (P < 0.05). The mean reliability and overall quality regarding treatment choice were (2.5 ± 0.5) and (3.1 ± 0.9), respectively. Videos on TikTok showed relatively high understandability (84.7%) and moderate actionability (74.9%). Video producers tended to partly or fully provide information regarding management (81.5%, 137/168) and outcome (82.1%, 138/168), and to ignore or only slightly mention content related to definition (86.9%, 146/169) and signs (82.1%, 138/168). The five video sources showed significant differences in the prevalence of misleading information (P < 0.001), publication reliability (P < 0.001), overall quality (P = 0.039), content score (P = 0.019), and understandability (P = 0.024).

Conclusion

Considering the moderate-to-poor reliability and variable quality across video sources, the substantial myopia-related content on TikTok should be treated with caution. Nevertheless, TikTok videos may serve as a surrogate or supplement for information dissemination if providers can ensure more comprehensive and accurate content.

The Assessment of TikTok as a Source of Quality Health Information on Varicoceles

OBJECTIVE

To evaluate the quality of varicocele information on TikTok, a popular video platform that adolescent patients are now turning to as a source of medical information before visiting a doctor.

METHODS

Using the key word "varicocele," we retrieved the top 225 videos listed on TikTok in May 2022. We extracted general video and engagement data. Video information was coded and analyzed for the completeness of different types of content (definition, symptoms, evaluation, management, and outcomes). The quality of consumer health information was rated using the DISCERN instrument.

RESULTS

Thirty-six videos met inclusion criteria; 17 were created by general users, 16 by healthcare professionals or systems (2 by urologists), and 3 by scientific communities. Healthcare professionals had more views than non-healthcare (P = .05). The quality of health information using the DISCERN instrument was "poor" from health care professional videos and "very poor" from non-health care professionals. However, the quality of information provided by healthcare professionals was statistically better than that of non-healthcare (P< .05). Video content mainly focused on symptoms: 50% of videos from healthcare providers had some or extensive content and 41% of non-healthcare had some content. 23% of videos had misinformation.

CONCLUSION

The overall quality of information for varicoceles on TikTok is not acceptable and does not meet patient needs. It is imperative that urologists create robust, accurate content, and partner with these platforms to connect users with higher quality information. TikTok users should also be mindful that information may not be medically accurate.

Quality and accuracy of gastric cancer related videos in social media videos platforms

BACKGROUND

Gastric cancer is a major public health problem worldwide. Social media has affected public's daily lives in ways no one ever thought possible. Both TikoTok and its Chinese version Douyin are the most popular short video posting platform. This study aimed to evaluate the quality, accuracy, and completeness of videos for gastric cancer on TikTok and Douyin.

METHODS

The terms "gastric cancer" was searched on TikTok in both English and Japanese, and on Douyin in Chinese. The first 100 videos in three languages (website's default setting) were checked. QUality Evaluation Scoring Tool (QUEST) and DISCERN as the instrument for assessing the quality of the information in each video. Content was analysed under six categories (aetiology, anatomy, symptoms, preventions, treatments, and prognosis). The educational value and completeness were evaluated with a checklist developed by the researchers.

RESULTS

A total of 78 videos in English, 63 in Japanese, and 99 in Chinese were analyzed. The types of sources were as follows: 6.4% in English, 4.8% in Japanese, and 57.6% in Chinese for health professionals; 93.6% in English, 95.2% in Japanese, and 3.0% in Chinese for private users; none in English and Japanese, but 39.4% in Chinese for other sources. In all, 20.5% in English, 17.5% in Japanese, and 93.9% in Chinese of videos had useful information about gastric cancer. Among the useful videos, the videos published in Chinese had the highest QUEST(p < 0.05) and DISCERN scores(p < 0.05), followed by those published in Japanese. Among the educational videos, prognosis in English (37.5%), symptoms in Japanese (54.5%), and prevention in Chinese (47.3%) were the most frequently covered topic.

CONCLUSIONS

TikTok in English and Japanese might not fully meet the gastric cancer information needs of public, but Douyin in Chinese was the opposite.

TikTok and YouTube as sources of information on anal fissure: A comparative analysis

Introduction

Anal fissure is a common colorectal disease impacting patients' life quality with high incidence. Social media platforms are becoming a kind of health information source nowadays. This study aims to evaluate and compare the quality of anal fissure-related videos on TikTok and YouTube.

Materials and methods

One hundred videos were sourced from TikTok and YouTube, respectively and videos were screened further. The completeness of six types of content within the videos is assessed, including the definition of disease, symptoms, risk factors, evaluation, management and outcomes. Finally, the DISCERN instrument, Patient Education Materials Assessment Tool and Global Quality scale are used to assess video display quality and content. A correlation analysis is undertaken considering the video features, DISCERN, PEMAT and GQS scores.

Results

Physicians and non-profit organizations contributed almost all video content among selected videos. A statistically significant correlation between DISCERN classification and duration, PEMAT understandability, PEMAT actionability and GQS scores is recorded. DISCERN total scores were significantly positively correlated with video duration, PEMAT understandability, PEMAT actionability and GQS scores. GQS scores were significantly positively correlated with duration, PEMAT understandability and PEMAT actionability scores. For content, the videos mainly described management and symptoms while containing limited information on the disease evaluation, and outcomes.

Conclusions

The sources of uploaders on YouTube are more diverse than TikTok, and the quality of videos is also relatively higher on YouTube. Even so, the video quality of the two platforms still needs to be further improved. Health information without integrity, reliability and practicability impacts patients' disease perception and health-seeking behavior, leading to serious consequences. Much effort must be taken to improve the quality of videos regarding anal fissures on the two platforms, which will facilitate the development of public health education on this issue.

Assessment of videos related to lung nodules in China

Background

With the popularization of mobile phones and the development of the Internet, many patients use social media platforms to seek health information. Currently, TikTok, iQiyi, Bilibili, and Weibo are the most popular video platforms in China. Therefore, based on the above facts, this study estimated the quality of lung nodule videos taken in China using these platforms.

Methods

The term “lung nodule” was searched on these platforms. Then, the first 30 videos were selected. Subsequently, some videos were excluded after they had been reviewed and analyzed, after which information on the features and sources of these videos was finally assessed using DISCERN, the Journal of the American Medical Association (JAMA) Benchmark Criteria, and the Hexagonal Radar Schema. Analysis was performed according to different groups.

Results

101 videos were included in this study. According to the different sources, although most videos were from physicians (71.3%), comprising those with shorter durations; faster updates; and more likes, comments, and shares; no significant difference in the scores were obtained. Moreover, regarding the different platforms, while Weibo had the highest update, TikTok had more likes, comments, and shares. Investigations also revealed that while score differences were recorded, most videos were rated “very poor” and “poor.” Besides, hexagonal radar charts showed a severe deficiency of video information.

Conclusions

Although the quality of most videos on the understudied social media platforms was poor, these platforms have huge potential. Therefore, caution should be exercised when using the platforms as information sources about lung nodules, and a better review and push system is needed.

The reliability, functional quality, understandability, and actionability of fall prevention content in YouTube: an observational study

Background

Falls are common but dangerous in the elderly. More and more seniors are searching for healthcare information online. YouTube has become the world’s most popular video streaming platform. Albeit thousands of fall prevention videos are available on YouTube, their reliability, functional quality, understandability, and actionability have not been verified.

Methods

The top 300 watched videos on YouTube related to fall prevention were retrieved. After exclusion, all qualified sample videos were evaluated by three validated assessment instruments (the PEMAT scale, the HONCode scale, and the DISCERN instrument) regarding their reliability, functional quality, understandability, and actionability. Each video’s length, number of views/likes/comments, forms of expression, and the uploader’s profile were collected as well. The Wilcoxon rank sum test was performed for further analysis from the perspective of expression forms and uploaders’ identities.

Results

One hundred thirty-seven videos (45.67%) were qualified as sample videos, and individuals/organizations with medical backgrounds posted 54.01% of them. Most of the excluded videos (n = 163) were irrelevant (n = 91, 55.83%), and commercial (n = 52, 31.90%). The median video length for sample videos was 470 seconds. The DISCERN instrument indicated that 115 videos (83.94%) were of moderate to high overall quality. Medical practitioners and organizations gained the highest scores in functional quality and reliability (P < 0.05), while they also tended to use technical terms more often (mean = 3.15). The HONCode scale suggested a lack of traceability was common. The most popular and actionable form of expression was workout (n = 58, median score = 86.90, P < 0.05), while monolog and keynote presentations scored the highest in understandability (no significant difference between them). The PEMAT scale suggested videos uploaded by medical teams were the easiest to be understood (P = 0.011 and P < 0.001, respectively), whereas they were less actionable than those made by fitness trainers (P = 0.039 and P < 0.001, respectively).

Conclusions

Cooperation between the medical team and fitness trainers is expected for better health promotion. Plain language is advised, and sources should be provided. As for expression form, monolog or keynote presentations, plus workout clips, might be the most effective.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12877-022-03330-x.

Quality of Internet Videos Related to Pediatric Urology in Mainland China: A Cross-Sectional Study

Background

Pediatric urological diseases pose serious threats to children's physical and mental health. The COVID-19 pandemic has resulted in poor pediatric outcomes for cryptorchidism, hypospadias, and testicular torsion. Presently, many people tend to seek health information via social media platforms. This study aims to quantitatively assess the quality of videos as an information source for pediatric urology in mainland China.

Methods

In this cross-sectional study, a search was performed on social media platforms (Tiktok, Bilibili, and Weibo) with the search terms “cryptorchidism”, “hypospadias”, and “testicular torsion”. The first 30 results with any search term listed by relevance were selected in each platform. Video features (duration, number of likes, comments, and shares) and video sources were collected. Each video included in the study was assessed using DISCERN, Journal of the American Medical Association (JAMA) Benchmark Criteria, and Hexagonal Radar Schema. A correlation analysis was performed considering video features, video source, DISCERN scores and JAMA scores.

Results

A total of 152 videos were included and analyzed. The majority of videos were from physicians (65.8%). According to the DISCERN classification, most videos were rated as “very poor” (48.0%) and “poor” (36.8%). The mean DISCERN and JAMA scores were 36.56 and 2.68, respectively. The duration of videos uploaded by physicians was the shortest (P < 0.001). The video source had no relevance to numbers of “likes”, “comments”, “shares”, DISCERN scores, and JAMA scores (all P-values > 0.05). Other than video duration (P < 0.001), there was no statistically significant difference between groups for any of the recorded or calculated video data (all P values > 0.05). Hexagonal Radar Charts showed the severe imbalance and deficiency of video information. In general, Tiktok videos with the shortest duration received the most numbers of “likes”, “comments”, and “shares”, whereas the overall quality of videos on Weibo was relatively high.

Conclusions

Despite most of the videos on social media platforms being uploaded by medical authors, the overall quality was poor. The misleading, inaccurate and incomplete information may pose a health risk to the viewers, especially during the COVID-19 pandemic. Much effort needs to be undertaken to improve the quality of health-related videos regarding pediatric urology.

TikTok for Radiology Education: Is Now the Right Time?

TikTok is the fastest growing social media app in the world and is designed to be social and promote discovery. We have used various social media sites (i.e., Facebook, Twitter, YouTube, Instagram, and Pinterest) for radiology education for several years, and created a TikTok account in March 2020 (@CTisus) to determine its suitability for expanding our audience for radiology education. Since we create video content for our website and other social media outlets, we have posted those videos to TikTok, opting not to create anything specifically for TikTok. For the hashtag #radiology (which currently has 388.2 million views), we viewed the first 100 videos shown per TikTok's algorithm. About half the videos (n=46) were about radiology work life, including remarks by patients or basic information about becoming a radiology technologist. Twenty-four videos were radiology-related jokes. Seven videos showed radiology equipment, mainly how MRI scanners interact with metal. Ultimately, only eight were professional English-language videos pertaining to radiology education. Though the appeal of TikTok is clear based on popularity, potentially offensive, inappropriate, or irrelevant videos can appear. TikTok for radiology, then, should come with a disclaimer. But TikTok should not be summarily dismissed as a silly dancing app. Educators can reach a substantial audience, especially those in the earliest stages of their medical education. Though it is currently not the most suitable app for medical professionals, TikTok warrants consideration for use in radiology education as long as it is used with caution.