A systematic review of patient inflammatory bowel disease information resources on the World Wide Web

YouTube™ as a source of parents' information for craniosynostosis

OBJECTIVE

This study aimed to evaluate the content, reliability and quality levels of YouTube™ videos regarding craniosynostosis for parents' information.

METHODS

A keyword search for 'craniosynostosis' was conducted on YouTube, and the uniform resource locators of the first 160 videos were initially recorded and evaluated. Ninety-four videos that met the inclusion criteria were analysed. Each video received a score ranging from 0 to 9 points, classifying them as low-content (0-3), moderate-content (4-6) and high-content (7-9). The reliability scores adapted from DISCERN and Global Quality Scale (GQS) scores were recorded.

RESULTS

The median content score for the videos was 4. According to the content scores, 34% of included videos (n = 32) were classified as low-content, 60.6% (n = 57) as moderate-content, and 5.3% (n = 5) as high-content. The median reliability score for the videos was 3, and the median GQS score was 3. The reliability and quality levels of videos classified as high-content and moderate-content were significantly superior to low-content videos (P < .05). Laypersons were identified as the most frequent source of information in the videos. However, most of the videos lacked information about syndromic/non-syndromic forms and specific complications. The importance of early referral/timing of surgery and minimally invasive surgical treatment techniques was mentioned in all high-content videos.

CONCLUSION

The results of the present study suggest that YouTube™ in its current format, is not a fully trustable source for parents seeking information on craniosynostosis. Craniofacial units must increase the content, quality and reliability level of videos on craniosynostosis.

Health information in short videos about metabolic dysfunction-associated steatotic liver disease: Analysing quality and reliability

BACKGROUND & AIMS

Short videos, crucial for disseminating health information on metabolic dysfunction-associated steatotic liver disease (MASLD), lack a clear evaluation of quality and reliability. This study aimed to assess the quality and reliability of MASLD-related videos on Chinese platforms.

METHODS

Video samples were collected from three platforms (TikTok, Kwai and Bilibili) during the period from November 2019 to July 2023. Two independent reviewers evaluated the integrity of the information contained therein by scoring six key aspects of its content: definition, epidemiology, risk factors, outcomes, diagnosis and treatment. The quality and reliability of the videos were assessed using the Journal of the American Medical Association (JAMA) criteria, the Global Quality Score (GQS) and the modified DISCERN score.

RESULTS

A total of 198 videos were included. The video content exhibited an overall unsatisfactory quality, with a primary emphasis on risk factors and treatment, while diagnosis and epidemiology were seldom addressed. Regarding the sources of the videos, the GQS and modified DISCERN scores varied significantly between the platforms (p = .003), although they had generally similar JAMA scores (p = .251). Videos created by medical professionals differed significantly in terms of JAMA scores (p = .046) compared to those created by nonmedical professionals, but there were no statistically significant differences in GQS (p = .923) or modified DISCERN scores (p = .317).

CONCLUSIONS

The overall quality and reliability of the videos were poor and varied between platforms and uploaders. Platforms and healthcare professionals should strive to provide more reliable health-related information regarding MASLD.

Does YouTube Provide High-Quality Information for Patients Regarding Night Guards, Especially for Over-the-Counter Ones?

The aim of this study was to evaluate the quality of the information on YouTube regarding night guards (NGs). YouTube was systematically searched using the keyword "night guards." Two independent reviewers examined the first 100 videos and exclusion criteria were applied. Descriptive characteristics of the remaining 60 videos were recorded. In addition, the purpose, target audience, and source of the included videos were collected. A 12-point content scale (CS) was used to evaluate video content, and the Global Quality Scale (GQS) was used to determine video quality. Statistical analyses were performed using the Kruskal-Wallis and Mann-Whitney tests, and the correlation between scores was evaluated using Spearman rho. Of the included videos, 50% were uploaded by dentists/health institutions, 26% by commercial sources and 24% by laypersons. The aim of 80% of the videos was to inform laypeople and 14% to inform professionals only. The content discussed the most (59.3%) was the production stages of NGs. The mean CS and GQS score of the videos were 2.06 ± 1.35 (poor) and 1.71 ± 0.88 (generally poor), respectively. A positive correlation was found between the CS and GQS scores ( r = 0.447). YouTube videos were found to be poor in terms of both content and quality. Since NGs for treating bruxism will always be a trending topic for patients on social media, the content of YouTube videos should be checked and enriched by professionals so that patients can access accurate information, especially about NGs obtained over the counter.

Assessing the Potential Role of Artificial Intelligence in Medication-Related Osteonecrosis of the Jaw Information Sharing

BACKGROUND

Artificial Intelligence, by answering questions about disease prevention strategies, can contribute to making diseases more treatable in their early stages.

PURPOSE

This study aims to evaluate the quality of patient information by assessing the responses of the Chat Generative Pretrained Transformer (ChatGPT, Open AI, USA) artificial intelligence model to questions related to medication-related osteonecrosis of the jaw (MRONJ).

STUDY DESIGN, SETTING, SAMPLE

The study was prospective cross-sectional design. The study was conducted within the Department of Oral and Maxillofacial Surgery. The study's questions were prepared by an experienced oral and maxillofacial surgeon and directed to the artificial intelligence platform. The responses were evaluated by oral and maxillofacial surgeons using the Global Quality Scale (GQS).

PREDICTOR VARIABLE

The predictor variable is question type. A total of 120 questions were categorized into six groups, which encompassed general information about MRONJ (Group 1), queries from patients about to initiate medication therapy (Group 2), questions from patients currently undergoing medication treatment (Group 3), inquiries from patients who had completed medication usage (Group 4), general treatment-related information (Group 5), and case scenarios (Group 6).

MAIN OUTCOME VARIABLES

The main variable is the GQS score. The GQS rates the quality of information and its utility for the patients. The scores are as follows: Score 1: Poor quality, Score 2: Generally poor quality, Score 3: Moderate quality, Score 4: Good quality, Score 5: Excellent quality.

COVARIATES

Not applicable.

ANALYSES

Kruskal-Wallis and Mann-Whitney U tests were applied for intragroup and intergroup analyses. The statistical significance level was determined as P < .05 and P < .01.

RESULTS

The average score for all questions was calculated to be 3.9 ± 0.8, which is above the "moderate quality" threshold. Group 1 had a mean score of 3.4 ± 1.1; group 2 had 4.1 ± 0.7; group 3 had 3.8 ± 0.8; group 4 had 4.3 ± 0.6; group 5 had 4.2 ± 0.7; and group 6 had 4.1 ± 0.5. The variations in mean scores among these groups did not exhibit statistical significance (P > .05).

CONCLUSION AND RELEVANCE

The artificial intelligence model has generated responses of moderate quality to questions about MRONJ. The use of the artificial intelligence platform may assist in patients gaining a fundamental understanding of MRONJ.

Third-Line Overactive Bladder Therapies on TikTok: What Does the Public Learn?

IMPORTANCE

Millions of people rely on social media platforms, including TikTok, for health-related information. TikTok has not yet been evaluated as an information source for overactive bladder (OAB) third-line therapies.

OBJECTIVES

Our aim was to assess TikTok videos on third-line therapies for OAB for misinformation and quality.

STUDY DESIGN

In this cross-sectional analysis, we abstracted the top 50 TikTok videos for keywords: "Axonics," "sacral neuromodulation," "Interstim," "PTNS," "posterior tibial nerve stimulation," and "bladder Botox." Videos were scored for quality by 3 independent reviewers using the Medical Quality Video Evaluation Tool (MQ-VET). Two reviewers determined if videos contained misinformation.

RESULTS

Of 300 videos screened, 119 videos were included. Twenty-four (21%) were created by medical professionals (MPs). Medical professional videos were more frequently shared (5 vs 1, P < 0.01) but had similar views, likes, comments, and length. Although MP videos had significantly higher MQ-VET scores (43 vs 27, P < 0.01), there was no difference in the rate of misinformation between MP and non-MP videos (21% vs 18%). Twenty-two videos (18.4%) contained misinformation, which were 3 times longer (50.5 vs 15 seconds, P < 0.01) and had higher MQ-VET scores (34.5 vs 27, P = 0.03) than those without misinformation. Common themes of misinformation pertained to therapy indication, mechanism of action, and patient limitations after undergoing therapy.

CONCLUSIONS

Many TikTok videos on OAB third-line therapies contain misinformation. Most of these videos were not of high quality and created by the public. Medical professionals should be aware of misinformation permeating TikTok, given its large audience, and aim to promote or offer educational material of better accuracy and quality.

Can natural language processing serve as a consultant in oral surgery?

OBJECTIVE

In this comprehensive evaluation, ten experienced oral surgeon experts posed a total of twenty oral surgery-related questions, including dental implant and tooth extractions, to three distinct Natural Language Processing (NLP)-based chatbot platforms: ChatGPT, Microsoft Bing, and Google Bard. The study aimed to assess the effectiveness of these chatbots in responding to specialized medical questions.

MATERIALS AND METHODS

Two primary evaluation metrics were employed: a Likert Scale (LS) for measuring the accuracy and completeness of responses and a Global Quality Scale (GQS) for evaluating the clarity of responses. Statistical analyses, including one-way analysis of variance (ANOVA) and Post Hoc Tukey, were conducted to assess and compare the performance of the chatbots as rated by the experts.

RESULTS

The results of the study revealed significant differences in the performance of the chatbots. ChatGPT statistically achieved a better mean LS score of 1.4000±0.15986 than Microsoft Bing (1.8750±0.18143) and Google Bards (2.0500±0.12472) (P < 0.001). Additionally, ChatGPT statistically achieved a higher GQS score of 4.4200±0.30111 than Microsoft Bing (3.7550±0.28621) and Google Bards (3.5250±0.22392) (P < 0.001).

CONCLUSIONS

These findings showed the substantial advantage of ChatGPT in effectively addressing oral surgery-related questions with superior accuracy, completeness, and clarity. The study highlights the potential of advanced NLP platforms to enhance information retrieval and communication within the field of oral surgery, reinforcing the utility of such technologies in medical and surgical domains.

Assessing the Soft Tissue Infection Expertise of ChatGPT and Bard Compared to IDSA Recommendations

The aim of the study was to evaluate whether ChatGPT-3.5 and Bard provide safe and reliable medical answers to common topics related to soft tissue infections and their management according to the guidelines provided by the Infectious Disease Society of America (IDSA). IDSA's abridged recommendations for soft tissue infections were identified on the IDSA official website. Twenty-five queries were entered into the LLMs as they appear on the IDSA website. To assess the concordance and precision of the LLMs' responses with the IDSA guidelines, two infectious disease physicians independently compared and evaluated each response. This was done using a 5-point Likert scale, with 1 representing poor concordance and 5 excellent concordance, as adapted from the validated Global Quality Scale. The mean ± SD score for ChatGPT-generated responses was 4.34 ± 0.74, n = 25. This indicates that raters found the answers were good to excellent quality with the most important topics covered. Although some topics were not covered, the answers were in good concordance with the IDSA guidelines. The mean ± SD score for Bard-generate responses was 3.5 ± 1.2, n = 25, indicating moderate quality. Despite LLMs did not appear to provide wrong recommendations and covered most of the topics, the responses were often found to be generic, rambling, missing some details, and lacking actionability. As AI continues to evolve and researchers feed it with more extensive and diverse medical knowledge, it may be inching closer to becoming a reliable aid for clinicians, ultimately enhancing the accuracy of infectious disease diagnosis and management in the future.

Freely available, online videos to support neurological physiotherapists and students in task-specific training skill acquisition: a scoping review

BACKGROUND

Videos to support learning of clinical skills are effective; however, little is known about the scope and educational quality of the content of freely available online videos demonstrating task-specific training (TST). This review aimed to determine the extent, characteristics of freely available online videos, and whether the content is suitable to guide skill acquisition of task-specific training for neurological physiotherapists and students.

METHODS

A scoping review was conducted. Google video and YouTube were searched in December 2022. Videos that met our eligibility criteria and were explicitly designed for (TST) skill acquisition were included in the report.

RESULTS

Ten videos met the inclusion criteria and were difficult to find amongst the range of videos available. Most were presented by physiotherapists or occupational therapists, originated from the USA, featured stroke as the condition of the person being treated, and involved a range of interventions (upper limb, constraint induced movement therapy, balance, bicycling). Most videos were created by universities or private practices and only two used people with a neurological condition as the participant. When the content of videos and their presentation (instruction and/or demonstration), was assessed against each key component of TST (practice structure, specificity, repetition, modification, progression, feedback), five of the videos were rated very suitable and five moderately suitable to guide skill acquisition. Most videos failed to demonstrate and provide instruction on each key component of TST and were missing at least one component, with feedback most frequently omitted.

CONCLUSIONS

There are many freely available online videos which could be described as demonstrating TST; very few are suitable to guide skill acquisition. The development of a standardised and validated assessment tool, that is easy to use and assesses the content of TST videos is required to support learners to critically evaluate the educational quality of video content. Guidelines based on sound teaching theory and practice are required to assist creators of online videos to provide suitable resources that meet the learning needs of neurological physiotherapists and students.

Assessment of medical information on irritable bowel syndrome information in Wikipedia and Baidu Encyclopedia: comparative study

Background

Irritable bowel syndrome (IBS) is a functional gastrointestinal disorder (FGID) with heterogeneous clinical presentations. There are no clear testing parameters for its diagnosis, and the complex pathophysiology of IBS and the limited time that doctors have to spend with patients makes it difficult to adequately educate patients in the outpatient setting. An increased awareness of IBS means that patients are more likely to self-diagnose and self-manage IBS based on their own symptoms. These factors may make patients more likely to turn to Internet resources. Wikipedia is the most popular online encyclopedia among English-speaking users, with numerous validations. However, in Mandarin-speaking regions, the Baidu Encyclopedia is most commonly used. There have been no studies on the reliability, readability, and objectivity of IBS information on the two sites. This is an urgent issue as these platforms are accessed by approximately 1.45 billion people.

Objective

We compared the IBS content on Wikipedia (in English) and Baidu Baike (in Chinese), two online encyclopedias, in terms of reliability, readability, and objectivity.

Methods

The Baidu Encyclopedia (in Chinese) and Wikipedia (in English) were evaluated based on the Rome IV IBS definitions and diagnoses. All possible synonyms and derivatives for IBS and IBS-related FGIDs were screened and identified. Two gastroenterology experts evaluated the scores of articles for both sites using the DISCERN instrument, the Journal of the American Medical Association scoring system (JAMA), and the Global Quality Score (GQS).

Results

Wikipedia scored higher overall with DISCERN (p < .0001), JAMA (p < .0001) and GQS (p < .05) than the Baidu Encyclopedia. Specifically, Wikipedia scored higher in DISCERN Section 1 (p < .0001), DISCERN Section 2 (p < .01), DISCERN Section 3 (p < .001), and the General DISCERN score (p < .0001) than the Baidu Encyclopedia. Both sites had low DISCERN Section 2 scores (p = .18). Wikipedia also had a larger percentage of high quality scores in total DISCERN, DISCERN Section 1, and DISCERN Section 3 (p < .0001, P < .0001, P < .0004, respectively, based on the above 3 (60%) rule).

Conclusions

Wikipedia provides more reliable, higher quality, and more objective IBS-related health information than the Baidu Encyclopedia. However, there should be improvements in the information quality for both sites. Medical professionals and institutions should collaborate with these online platforms to offer better health information for IBS.

Frequently asked questions on erectile dysfunction: evaluating artificial intelligence answers with expert mentorship

The present study assessed the accuracy of artificiaI intelligence-generated responses to frequently asked questions on erectile dysfunction. A cross-sectional analysis involved 56 erectile dysfunction-related questions searched on Google, categorized into nine sections: causes, diagnosis, treatment options, treatment complications, protective measures, relationship with other illnesses, treatment costs, treatment with herbal agents, and appointments. Responses from ChatGPT 3.5, ChatGPT 4, and BARD were evaluated by two experienced urology experts using the F1 and global quality scores (GQS) for accuracy, relevance, and comprehensibility. ChatGPT 3.5 and ChatGPT 4 achieved higher GQS than BARD in categories such as causes (4.5 ± 0.54, 4.5 ± 0.51, 3.15 ± 1.01, respectively, p < 0.001), treatment options (4.35 ± 0.6, 4.5 ± 0.43, 2.71 ± 1.38, respectively, p < 0.001), protective measures (5.0 ± 0, 5.0 ± 0, 4 ± 0.5, respectively, p = 0.013), relationships with other illnesses (4.58 ± 0.58, 4.83 ± 0.25, 3.58 ± 0.8, respectively, p = 0.006), and treatment with herbal agents (3 ± 0.61, 3.33 ± 0.83, 1.8 ± 1.09, respectively, p = 0.043). F1 scores in categories: causes (1), diagnosis (0.857), treatment options (0.726), and protective measures (1), indicated their alignment with the guidelines. There was no significant difference between ChatGPT 3.5 and ChatGPT 4 regarding answer quality, but both outperformed BARD in the GQS. These results emphasize the need to continually enhance and validate AI-generated medical information, underscoring the importance of artificiaI intelligence systems in delivering reliable information on erectile dysfunction.

Characteristics, reliability, and quality of YouTube videos on meralgia paresthetica: a descriptive cross-sectional study

INTRODUCTION

The purpose of this study was to evaluate YouTube videos on meralgia paresthetica (MP) for reliability, quality, and differences between quality levels.

METHODS

We analyzed 59 videos related to MP. We evaluated several video characteristics, including views, likes, dislikes, duration, and speaker profile. We used view ratio, like ratio, Video Power Index (VPI), Global Quality Scale (GQS), JAMA criteria, and modified DISCERN (mDISCERN) to assess viewer engagement, popularity, educational quality, and reliability.

RESULTS

The videos received a total of 4,009,141 views (average 67,951.54), with 25.4% focused on exercise training and 23.7% focused on disease information. Mean scores were mDISCERN 2.4, GQS 2.8, and JAMA 2.1. Physician-led videos had higher mDISCERN scores, while allied health worker-led videos had more views, likes, dislikes, view ratios, and VPI. Poor and high-quality videos differed in views, likes, view ratio, VPI, and duration. Positive correlations existed among mDISCERN, JAMA, and GQS scores, with video duration positively correlated with GQS.

CONCLUSION

The content of YouTube videos discussing diseases significantly influences viewer engagement and popularity. To enhance the availability of valuable content on YouTube, which lacks a peer review process, medical professionals must contribute high-quality educational materials tailored to their target audience.

A comprehensive evaluation of online inhaler use techniques for obstructive airway disease

BACKGROUND

Pulmonary inhaler therapy is a core treatment modality for >600 million individuals affected by obstructive airways disease globally. Poor inhaler technique is associated with reduced disease control and increased health care utilization; however, many patients rely on the internet as a technical resource. This study assesses the content and quality of online resources describing inhaler techniques.

METHODS

A Google search was conducted in April 2023 capturing the top 5 search results for 12 common inhaler devices. Websites were compared to product monographs for preparation/first use, inhalational technique, and post-usage/device care. They were also assessed using accepted quality metrics (GQS, DISCERN, JAMA Benchmark scores) and clinically relevant aspects based on the literature and consensus statements.

RESULTS

Websites regularly excluded critical steps important for proper inhaler technique. They performed best on information related directly to inhalation technique (average median score 78%), whereas steps related to preparation/first use (58%) or post-usage/device care (50%) were less frequently addressed. Median GQS, DISCERN, and JAMA Benchmark scores were 3 [IQR 3-4], 3 [IQR 2-4], and 1 [IQR 1-3], respectively. Clinically relevant factors were only addressed in about one-fifth of websites with no websites addressing smoking cessation, environmental considerations, or risk factors for poor technique.

CONCLUSIONS

This study highlights gaps in online resources describing inhaler technique, particularly related to preparation/first use and post-usage/device care steps. Clinically relevant factors were rarely addressed across websites. Improvements in these areas could lead to enhanced inhaler technique and clinical outcomes.

Youtube is an unreliable source of information about delayed ejaculation treatment

BACKGROUND

Social platforms such as YouTube have become sources of information about diseases as they can be easily and rapidly accessed. However, this also has the risk of ill-intentioned content and misleading information.

OBJECTIVE

To evaluate the reliability of YouTube video content about delayed ejaculation treatment.

MATERIAL AND METHODS

YouTube videos were searched using the terms "delayed ejaculation," "retarded ejaculation," "inhibited ejaculation," and "anejaculation." Videos were excluded if they were not in English, were not related to the subject, or did not have audio and visual content. In accordance with the scientifically proven accurate information, the videos were separated as reliable (Group 2, n: 112) and unreliable videos (Group 1, n: 94). The groups were compared in respect of the video characteristics, and the scores obtained in the DISCERN-5, Global Quality Scale, the Patient Education Materials Assessment Tool Audiovisual, and the Journal of the American Medical Association scales. Intraclass correlation test was used to evaluate the level of agreement between the two investigators.

RESULTS

Of the 1200 videos, 994 were excluded. No significant difference was determined between the Group 1 and Group 2 in respect of the median number of views [1672 (4555) vs 1547 (28,559), p = 0.63] and likes [10 (42) vs 17 (255), p = 0.07]. There was a greater number of videos in the Group 2 (54.4%) and the points obtained on the scoring scales were significantly higher than the Group 1 (p < 0.001). The videos originating from universities/professional organizations/non-profit physician/physician group were comprised the majority of the reliable videos (55.3%) and the unreliable videos had more content related to treatment (71.4%) (p < 0.001).

CONCLUSION

Although there was a greater number of reliable videos related to the problem of delayed ejaculation, the content could be misleading and should be avoided by patients seeking treatment without consulting a physician.

YouTube™ as a source of information on prostatitis: a quality and reliability analysis

It was aimed to analyze the YouTube™ videos on prostatitis regarding their source, content, and information included. The term "prostatitis" was searched by relevance and the first 200 video links and features were recorded. Using the 5-point modified DISCERN tool, Global Quality Score (GQS), and Journal of American Medical Association (JAMA) score, the quality and reliability of the information were assessed by two urologists. Inter-rater agreement for DISCERN, JAMA, and GQS had Cohen's kappa coefficients of 0.883, 0.887, and 0.885, respectively. The most common source of upload was doctors/medical institutions (33.0%), and the majority of the content was about general information (27.0%). The mean modified DISCERN, GQS and JAMA scores were 3.24 ± 1.23 (1.00-5.00), 3.25 ± 1.26 (1.00-5.00) and 2.17 ± 1.36 (0.00-4.00), respectively. These scores were correlated with each other (r = 0.914, p < 0.001 between JAMA and GQS; r = 0.954, p < 0.001 between JAMA and modified DISCERN; and r = 0.885, p < 0.001 between GQS and modified DISCERN, Spearman test) and were the highest in the videos uploaded by doctors/medical institutions (p < 0.001, Kruskal-Wallis test). Of the videos, 25.5% were poor, 30.5% were moderate and 44.0% were high quality. The high quality videos were significantly shorter than those with poor quality (p = 0.039, Kruskal-Wallis test). The poor quality videos had the highest view ratio (50.49 ± 127.74 (0.03-618.91), p = 0.036, Kruskal-Wallis test). Most YouTube™ videos on prostatitis are short and high quality videos uploaded by doctors/medical institutions. However, these videos have less view ratios than those with poor quality.

Assessing the quality of YouTube™ videos on fixed dental implant home-care and maintenance protocols

OBJECTIVES

The implant's supporting structure differs from that of the teeth when plaque accumulates, making it more prone to inflammation and bone loss. To ensure the implant's longevity, an effective maintenance protocol should be followed. This study aimed to evaluate the information on oral hygiene procedures at home for implant-supported fixed prosthesis.

METHODS

The keywords 'cleaning dental implant,' 'how to clean dental implant,' and 'dental implant hygiene' used to search for videos on YouTube™. Following the exclusions, two researchers independently analysed the remaining 100 videos for demographic data and content usefulness.

RESULTS

In terms of usefulness score distribution, 53.52% of the videos were considered slightly useful, 38.4% moderately useful and 8.1% very useful. The video content had the least quantity of knowledge about toothpaste choice (11.1%), but the greatest quantity of knowledge on flossing (68.7%).

CONCLUSIONS

According to the study's findings, there is presently no evidence-based information on YouTube™ on dental implant oral hygiene protocols for home care procedures hygiene education. Therefore, dental care professionals should analyse the information's quality and reliability before recommending it to patients.

A quality assessment of YouTube as an information resource for tonsillectomy

PURPOSE

Online resources are increasingly being utilised by patients to guide their clinical decision making, as an alternative or supplement to the traditional clinical-patient relationship. YouTube is an online repository of user and community generated videos, which is one of the most popular websites globally. We undertook a study to examine the quality of information presented in YouTube videos related to tonsillectomy.

METHODS

We completed a systematic search of YouTube in May 2023 and identified 88 videos for inclusion in our study. Videos were published in the English language, focussing on tonsillectomy and tonsillectomy recovery, and were greater than 2 min in length. We recorded video quality metrics and two authors independently analysed the quality of information using three validated quality assessment tools described in the literature including the modified DISCERN, Global Quality Score, and the JAMA Benchmark Criteria.

RESULTS

The overall quality of the information was low with mean quality scores of Modified DISCERN (1.8 ± 1.3), GQS (2.6 ± 1.2), and JAMA Benchmark Criteria (1.6 ± 0.7). Information published by medical sources including medical professionals, healthcare organisations, and medical education channels scored significantly higher compared to non-medical sources across all quality measures and were of moderate overall quality and usefulness: Modified DISCERN (2.5 ± 1.1 vs 0.8 ± 0.9, z = -6.0, p < 0.001), GQS (3.2 ± 1.0 vs 1.7 ± 0.9, z = -5.7, p < 0.001), and JAMA (1.9 ± 0.8 vs 1.1 ± 0.3, z = -5.2, p < 0.001). Videos published during or after 2018 scored higher on Modified DISCERN (z = -3.2,p = 0.001) but not on GQS or JAMA. Video quality metrics such as total view count, likes, and comments, and channel subscriber count, did not correlate with higher video quality. However, amongst videos published by authoritative medical sources, total view count correlated positively with higher Modified DISCERN quality scores (p = 0.037).

CONCLUSION

The overall quality and usefulness of YouTube videos on tonsillectomy is of low quality, but information published by authoritative medical sources score significantly higher. Clinicians should be mindful of increasing use of online information sources such as YouTube when counselling patients. Further research is needed in the medical community to create engaging, high-quality content to provide guidance for patients.

Randomized controlled study: The effect of video-based distance education for approaching children with fever on parents' knowledge levels and fever management

AIM

The aim of the study was to evaluate the impact of distance learning, comprising of videos specifically designed for the management of fever in children, on parents' knowledge and practice of fever management.

METHOD

It was a randomized controlled pre/post-test study with 99 parents (mainly mothers, n = 91) of acute febrile children. The intervention group received fever management video training. "Descriptive Survey Form", "Fever and Fever Management Knowledge Form" and "Parent Fever Management Scale" were used to collect data. Cohen's d and 95% confidence interval were used to evaluate the effect size. The study was registered as NCT05707624 in Clinical Trials, retrospectively.

RESULTS

The intervention group's knowledge increased significantly from 52.2% to 65.5% (p = 0.003, d = 0.632) in the post-test. "Parent Fever Management Scale" scores of the intervention group were significantly lower (p < 0.001, d = 0.731) than the control group in the post-test.

CONCLUSION

The video training significantly enhanced parents' understanding of fever management, resulting in an effective reduction of their caregiving burden.

PRACTICE IMPLICATIONS

Fever management videos can be a valuable tool for parental education, particularly in clinical settings, aiding pediatric nurses in educating parents.

To trust or not to trust: evaluating the reliability and safety of AI responses to laryngeal cancer queries

PURPOSE

As online health information-seeking surges, concerns mount over the quality and safety of accessible content, potentially leading to patient harm through misinformation. On one hand, the emergence of Artificial Intelligence (AI) in healthcare could prevent it; on the other hand, questions raise regarding the quality and safety of the medical information provided. As laryngeal cancer is a prevalent head and neck malignancy, this study aims to evaluate the utility and safety of three large language models (LLMs) as sources of patient information about laryngeal cancer.

METHODS

A cross-sectional study was conducted using three LLMs (ChatGPT 3.5, ChatGPT 4.0, and Bard). A questionnaire comprising 36 inquiries about laryngeal cancer was categorised into diagnosis (11 questions), treatment (9 questions), novelties and upcoming treatments (4 questions), controversies (8 questions), and sources of information (4 questions). The population of reviewers consisted of 3 groups, including ENT specialists, junior physicians, and non-medicals, who graded the responses. Each physician evaluated each question twice for each model, while non-medicals only once. Everyone was blinded to the model type, and the question order was shuffled. Outcome evaluations were based on a safety score (1-3) and a Global Quality Score (GQS, 1-5). Results were compared between LLMs. The study included iterative assessments and statistical validations.

RESULTS

Analysis revealed that ChatGPT 3.5 scored highest in both safety (mean: 2.70) and GQS (mean: 3.95). ChatGPT 4.0 and Bard had lower safety scores of 2.56 and 2.42, respectively, with corresponding quality scores of 3.65 and 3.38. Inter-rater reliability was consistent, with less than 3% discrepancy. About 4.2% of responses fell into the lowest safety category (1), particularly in the novelty category. Non-medical reviewers' quality assessments correlated moderately (r = 0.67) with response length.

CONCLUSIONS

LLMs can be valuable resources for patients seeking information on laryngeal cancer. ChatGPT 3.5 provided the most reliable and safe responses among the models evaluated.

How good is ChatGPT at answering patients' questions related to early detection of oral (mouth) cancer?

OBJECTIVES

To examine the quality, reliability, readability, and usefulness of ChatGPT in promoting oral cancer early detection.

STUDY DESIGN

About 108 patient-oriented questions about oral cancer early detection were compiled from expert panels, professional societies, and web-based tools. Questions were categorized into 4 topic domains and ChatGPT 3.5 was asked each question independently. ChatGPT answers were evaluated regarding quality, readability, actionability, and usefulness using. Two experienced reviewers independently assessed each response.

RESULTS

Questions related to clinical appearance constituted 36.1% (n = 39) of the total questions. ChatGPT provided "very useful" responses to the majority of questions (75%; n = 81). The mean Global Quality Score was 4.24 ± 1.3 of 5. The mean reliability score was 23.17 ± 9.87 of 25. The mean understandability score was 76.6% ± 25.9% of 100, while the mean actionability score was 47.3% ± 18.9% of 100. The mean FKS reading ease score was 38.4% ± 29.9%, while the mean SMOG index readability score was 11.65 ± 8.4. No misleading information was identified among ChatGPT responses.

CONCLUSION

ChatGPT is an attractive and potentially useful resource for informing patients about early detection of oral cancer. Nevertheless, concerns do exist about readability and actionability of the offered information.

Is YouTube a Reliable and Quality Source on Unilateral Biportal Endoscopic Spine Surgery? A Cross-Sectional Study

OBJECTIVE

This study aimed to evaluate the quality and reliability of YouTube videos focusing on unilateral biportal endoscopic spine surgery, a novel technique for spinal decompression in degenerative spinal disease.

METHODS

This cross-sectional study, conducted in February 2023, involved an online search on YouTube using the term "unilateral biportal endoscopic spine surgery". Video popularity was assessed using the Video Power Index. Video reliability and quality were measured using the Global Quality Scale, the Journal of the American Medical Association benchmark criteria, and the modified DISCERN instrument.

RESULTS

Ninety-three videos were included for evaluation. Uploader profiles were categorized by continent, with 61.3% from Asia, 35.5% from the United States, 2.2% from Africa, and 1.1% from Australia. When comparing 3 groups as South Korea, United States, and other countries, no significant differences were observed in the technical characteristics of the videos. However, the educational quality and reliability of the videos were higher in those uploaded from South Korea (P < 0.001).When the videos were divided into 2 groups according to their educational quality, significant difference were noted in video duration, loading time, video quality, and reliability (P < 0.001).

CONCLUSIONS

The YouTube videos on unilateral biportal endoscopic spine surgery showed high quality and reliability. However, videos from South Korea were found to have higher educational quality and reliability, while other specifications were similar for all videos. Furthermore, it was determined that videos uploaded more recently and with longer duration were of higher quality.

Misinformation Persists in Complementary Health: Evaluating the Reliability and Quality of YouTube-Based Information on the Use of Acupuncture for Chronic Pain

Introduction

Acupuncture is commonly used to treat chronic pain. Patients often access public social media platforms for healthcare information when querying acupuncture. Our study aims to appraise the utility, accuracy, and quality of information available on YouTube, a popular social media platform, on acupuncture for chronic pain treatment.

Methods

Using search terms such as "acupuncture for chronic pain" and "acupuncture pain relief", the top 54 videos by view count were selected. Included videos were >1 minute duration, contained audio in English, had >7000 views, and was related to acupuncture. One primary outcome of interest was categorizing each video's usefulness as useful, misleading, or neither. Another primary outcome of interest was the quality and reliability of each video using validated instruments, including the modified DISCERN (mDISCERN) tool and the Global Quality Scale (GQS). The means were calculated for the video production characteristics, production sources, and mDISCERN and GQS scores. Continuous and categorical outcomes were compared using Student's t-test and chi-square test, respectively.

Results

Of the 54 videos, 57.4% were categorized as useful, 14.8% were misleading, and 27.8% were neither. Useful videos had a mean GQS and mDISCERN score of 3.77±0.67 and 3.48±0.63, respectively, while misleading videos had mean GQS and mDISCERN score of 2.50±0.53 and 2.38±0.52, respectively. 41.8% of the useful videos were produced by a healthcare institution while none of the misleading videos were produced by a healthcare institution. However, 87.5% of the misleading videos were produced by health media compared to only 25.8% of useful videos from health media.

Discussion

As patients increasingly depend on platforms like YouTube for trustworthy information on complementary health practices such as acupuncture, our study emphasizes the critical need for more higher-quality videos from unbiased healthcare institutions and physicians to ensure patients are receiving reliable information regarding this topic.

Assessing the quality and reliability of YouTube videos as a source of information on inflammatory back pain

Background

Inflammatory back pain is a chronic condition with localized pain, particularly in the axial spine and sacroiliac joints, that is associated with morning stiffness and improves with exercise. YouTube is the second most frequently used social media platform for accessing health information. This study sought to investigate the quality and reliability of YouTube videos on inflammatory back pain (IBP).

Methods

The study design was planned as cross-sectional. A search was conducted using the term "inflammatory back pain," and the first 100 videos that met the inclusion criteria were selected on October 19, 2023. The data of the videos selected according to the inclusion and exclusion criteria in the study settings were examined. Videos with English language, with audiovisual content , had a duration >30 s, non-duplicated and primary content related to IBP were included in the study. A number of video parameters such as the number of likes, number of views, duration, and content categories were assessed. The videos were assessed for reliability using the Journal of the American Medical Association (JAMA) Benchmark criteria and the DISCERN tool. Quality was assessed using the Global Quality Score (GQS). Continuous variables were checked for normality of distribution using Shapiro-Wilk test and Kolmogorov-Smirnov test. Kruskal-Wallis test and Mann-Whitney U test were used to analyze the continuous data depending on the number of groups. Categorical data were analyzed using Pearson's chi-square test.

Results

Reliability assessment based on JAMA scores showed 21% of the videos to have high reliability. Quality assessment based on GQS results showed 19% of the videos to have high quality. JAMA, DISCERN, and GQS scores differed significantly by source of video (p < 0.001, < 0.001, and = 0.002, respectively). Video duration had a moderate positive correlation with scores from the GQS (r = 0.418, p < 0.001), JAMA (r = 0.484, p < 0.001), and modified DISCERN (r = 0.418, p < 0.001).

Conclusion

The results of the present study showed that YouTube offers videos of low reliability and low quality on inflammatory back pain. Health authorities have a responsibility to protect public health and should take proactive steps regarding health information shared on social media platforms.

Large language models as assistance for glaucoma surgical cases: a ChatGPT vs. Google Gemini comparison

PURPOSE

The aim of this study was to define the capability of ChatGPT-4 and Google Gemini in analyzing detailed glaucoma case descriptions and suggesting an accurate surgical plan.

METHODS

Retrospective analysis of 60 medical records of surgical glaucoma was divided into "ordinary" (n = 40) and "challenging" (n = 20) scenarios. Case descriptions were entered into ChatGPT and Bard's interfaces with the question "What kind of surgery would you perform?" and repeated three times to analyze the answers' consistency. After collecting the answers, we assessed the level of agreement with the unified opinion of three glaucoma surgeons. Moreover, we graded the quality of the responses with scores from 1 (poor quality) to 5 (excellent quality), according to the Global Quality Score (GQS) and compared the results.

RESULTS

ChatGPT surgical choice was consistent with those of glaucoma specialists in 35/60 cases (58%), compared to 19/60 (32%) of Gemini (p = 0.0001). Gemini was not able to complete the task in 16 cases (27%). Trabeculectomy was the most frequent choice for both chatbots (53% and 50% for ChatGPT and Gemini, respectively). In "challenging" cases, ChatGPT agreed with specialists in 9/20 choices (45%), outperforming Google Gemini performances (4/20, 20%). Overall, GQS scores were 3.5 ± 1.2 and 2.1 ± 1.5 for ChatGPT and Gemini (p = 0.002). This difference was even more marked if focusing only on "challenging" cases (1.5 ± 1.4 vs. 3.0 ± 1.5, p = 0.001).

CONCLUSION

ChatGPT-4 showed a good analysis performance for glaucoma surgical cases, either ordinary or challenging. On the other side, Google Gemini showed strong limitations in this setting, presenting high rates of unprecise or missed answers.

Urological Cancers and ChatGPT: Assessing the Quality of Information and Possible Risks for Patients

INTRODUCTION

OpenAI has created ChatGPT, an artificial intelligence language model that has gained considerable recognition for its capacity to produce text responses resembling human language. Consequently, this study seeks to evaluate the effectiveness of ChatGPT's responses in addressing publicly accessible queries related to prostate, kidney, bladder, and testicular cancers.

MATERIAL AND METHODS

A comprehensive compilation of frequently asked questions (FAQs) pertaining to prostate, bladder, kidney, and testicular cancers was gathered from diverse sources. Additionally, the recommendations outlined in the European Association of Urology (EAU) 2023 Guideline Oncology were consulted. The chosen questions for evaluation were presented to the ChatGPT 4.0 premium version. The quality of ChatGPT responses was appraised using the global quality score (GQS). Each ChatGPT response was independently reviewed by a panel of physicians, who assigned a GQS score to assess its overall quality.

RESULTS

For prostate cancer, 64.6% of the questions had a GQS score of 5, compared to 62.9 % for bladder, 68.1% for kidney, and 63.9% for testicular cancers, whereas none of the responses had a GQS score of 1. Meanwhile, the category with the lowest proportion of responses, with a GQS score of 5 for each disease, was prognosis and follow-up. The mean GQS score of the answers given to EAU guideline questions was statistically significantly lower than the average score of the answers given to FAQs.

CONCLUSION

ChatGPT is a valuable tool for addressing general inquiries regarding urological cancers, boasting commendable accuracy rates. Nonetheless, its performance in responding to questions aligned with the EAU guideline was deemed unsatisfactory.

Are YouTube videos about skull bone anatomy useful for students?

The aim of this study was to evaluate the content, quality, and functionality of YouTube videos on the anatomy of skull bones and to measure their educational usefulness. In this cross-sectional study, the keywords "skull bones" and "skull anatomy" were searched in the YouTube search tab. Demographic data such as type, source, duration, upload date, and view rates of the videos were recorded. The quality and content of the videos were measured using the total content score (TCS), modified DISCERN scale, JAMA score, and Global Quality Scale (GQS). SPSS 26.0 software was used for statistical analysis. Twenty-five (34.7%) of the first 72 videos found by keyword searches were included in the study. According to the GQS criteria, six of them (24%) were considered useful and 19 (76%) not useful. There was a strong statistically significant correlation between the GQS and DISCERN scores (r = 0.813, p < 0.001). There were strong statistically significant positive correlations between TCS and GQS scores (r = 0.887, p < 0.001) and between TCS and modified DISCERN scores (r = 0.691, p < 0.001). Additionally, there was a moderately strong statistically significant positive correlation between GQS and JAMA scores (r = 0.507, p < 0.05). There were also moderately strong statistically significant correlations between JAMA score and DISCERN score (r = 0.521, p < 0.001), video length (r = 0.416, p < 0.05), number of comments (r = 0.457, p < 0.05), and number of "likes" (r = 0.608, p < 0.001). There was a moderately strong statistically significant positive correlation between TCS and JAMA scores (r = 0.431, p < 0.05). Most YouTube videos have insufficient information about skull bones to meet the expectations of medical and dental school curricula. Anatomists and institutions should be encouraged to prepare and present YouTube videos using assessment systems such as DISCERN, JAMA, GQS, and TCS, in line with current anatomy curricula.

An Assessment of the Quality of YouTube Videos as a Resource for Adolescents Experiencing Abnormal Uterine Bleeding

STUDY OBJECTIVE

YouTube, the largest accessible media-sharing platform, has become an important tool for pursuing health-related information. Adolescents may find it challenging to seek counseling or access adolescent-friendly services for menstruation-related problems, so YouTube may be a useful resource. The aim of this study was to examine the reliability, quality, and accuracy of YouTube videos concerning abnormal uterine bleeding in adolescents.

METHODS

A YouTube search using the key words "adolescent, teens, heavy period, abnormal uterine bleeding, heavy menstrual bleeding" yielded 109 videos. Video features (duration, time since upload, likes, views, comments), sources of upload, and content were recorded. All the videos were reviewed by 2 adolescent medicine specialists and scored using the Journal of the American Medical Association, the 5-point modified DISCERN tool, and the Global Quality Scale.

RESULTS

Fifty-eight videos met the inclusion criteria. Most (62.1%) were created by non-professionals, and a significant portion (81%) contained general descriptions. On the basis of the DISCERN classification, 50% exhibited poor quality. Similarly, the Journal of the American Medical Association assessment indicated that only 36.2% satisfied the requirements for good quality. The videos uploaded by professionals exhibited notably superior quality in comparison with those uploaded by non-professionals. Additionally, higher-quality videos were longer (P = .040) and more recent (P = .011).

CONCLUSION

Mot YouTube videos about adolescent abnormal uterine bleeding provide low-quality information. We believe that increasing the number of videos tailored by health care providers specializing in adolescent gynecology to address the specific physical and psychosocial needs of adolescents with menstrual problems would be beneficial.

Can ChatGPT be the Plastic Surgeon's New Digital Assistant? A Bibliometric Analysis and Scoping Review of ChatGPT in Plastic Surgery Literature

BACKGROUND

ChatGPT, an artificial intelligence (AI) chatbot that uses natural language processing (NLP) to interact in a humanlike manner, has made significant contributions to various healthcare fields, including plastic surgery. However, its widespread use has raised ethical and security concerns. This study examines the presence of ChatGPT, an artificial intelligence (AI) chatbot, in the literature of plastic surgery.

METHODS

A bibliometric analysis and scoping review of the ChatGPT plastic surgery literature were performed. PubMed was queried using the search term "ChatGPT" to identify all biomedical literature on ChatGPT, with only studies related to plastic, reconstructive, or aesthetic surgery topics being considered eligible for inclusion.

RESULTS

The analysis included 30 out of 724 articles retrieved from PubMed, focusing on publications from December 2022 to July 2023. Four key areas of research emerged: applications in research/creation of original work, clinical application, surgical education, and ethics/commentary on previous studies. The versatility of ChatGPT in research, its potential in surgical education, and its role in enhancing patient education were explored. Ethical concerns regarding patient privacy, plagiarism, and the accuracy of information obtained from ChatGPT-generated sources were also highlighted.

CONCLUSION

While ethical concerns persist, the study underscores the potential of ChatGPT in plastic surgery research and practice, emphasizing the need for careful utilization and collaboration to optimize its benefits while minimizing risks.

LEVEL OF EVIDENCE V

This journal requires that authors assign a level of evidence to each article. For a full description of these Evidence-Based Medicine ratings, please refer to the Table of Contents or the online Instructions to Authors www.springer.com/00266 .

Does YouTube™ Provide Adequate Information on Oral Health During Pregnancy?

Background This study aimed to assess the reliability, quality, and content of the information provided by YouTube™ videos on oral health during pregnancy to reveal the effectiveness of the videos for patients. Methodology This cross-sectional study was conducted by two experienced dental specialists. They initiated the study by searching for YouTube™ videos using the keyword 'pregnancy oral health'. The videos were then assessed based on various parameters, including origin, type, number of days since upload, duration, number of views, number of likes and dislikes, and number of comments. The specialists also calculated the interaction index and viewing rate. The reliability and quality of the videos were evaluated using the global quality scale (GQS) and modified DISCERN (mDISCERN) scales, while the content was assessed with the comprehensiveness tailor-made index. The data were analyzed with the Shapiro-Wilk, the Kruskal-Wallis, the post-hoc Bonferroni, and Fisher's exact tests. The significance level was set at P < 0.05. Results After reviewing initially 224 videos, 129 were included in the study. Health professionals were the publishers of most videos. A statistically significant positive correlation was found between content scores and video duration, number of comments, interaction index, and total DISCERN scores (p<0.05) (r=0.445, r=0.186, r=0.552, r=0.241, r=0.200, r=0.681, respectively). Statistically significant associations were found between GQS scores, video duration, number of comments, and total mDISCERN scores (p<0.05) (r=0.510, r=225, r=0.156, r=0.768, respectively). Statistically significant relationships were identified between the total content score, video source, and GQS (p<0.05). According to the total content score, 57.4% of the videos had a score of 2, 35.7% had a score of 1, and only 7% had a score of 0. Conclusions This study's findings underscore the significant variability in the scientific accuracy, content, and quality of health information on the Internet, particularly on YouTube™. It reveals that, while there are videos that provide rich content and high-quality information, there are also poor-quality and inadequate videos that may mislead patients. Health professionals should be aware of misinformation found on YouTube™ and ensure that patients always have access to accurate and reliable information.

YouTube® in Spanish as a source of information for patients with inflammatory bowel disease

INTRODUCTION AND AIM

The majority of patients with inflammatory bowel disease (IBD) seek information about their disease on the Internet. The reliability, comprehensiveness, and quality of said information in Spanish has not previously been studied.

MATERIALS AND METHODS

An analytic observational study was conducted that included YouTube® videos on IBD available in Spanish, describing general characteristics, engagement, and sources. Standard tools for evaluating reliability (DISCERN), comprehensiveness, and overall quality (Global Quality Score, GQS) were employed.

RESULTS

One hundred videos were included. Eighty-eight videos consisted of information produced by healthcare professionals (group 1) and 12 included patient opinions (group 2). There were no differences in the median scores for reliability (DISCERN 3 vs 3, p = 0.554) or comprehensiveness (3 vs 2.5, p = 0.768) between the two groups, but there was greater overall quality in the group 2 videos (GQS 3 vs 4, p = 0.007). Reliability was higher for the videos produced by professional organizations (DISCERN 4; IQR 3-4), when compared with healthcare information websites and for-profit agencies (DISCERN 3; IQR 2.5-3.5) (p < 0.001), but the videos with healthcare information website and for-profit sources had a higher quality score (GQS 3 vs 4, p < 0.001). Comprehensiveness scores were similar.

CONCLUSION

The majority of YouTube® videos in Spanish on IBD have good reliability, comprehensiveness, and quality. Reliability was greater for the videos produced by professional organizations, whereas quality was higher for those created from healthcare information websites and for-profit agencies.

Content quality and reliability of YouTube videos on oral appliance therapy for obstructive sleep apnea: A systematic analysis

INTRODUCTION

YouTube's popularity as a health information source raises concerns about credibility due to the absence of peer review. Therefore, this study assessed the content quality and reliability of YouTube videos related to oral appliance therapy for obstructive sleep apnea (OSA).

METHODS

Videos were systematically searched on August 20, 2023, using terms determined through Google Trends. Videos were included based on predefined criteria and independently assessed by two researchers. Video demographics were extracted. Video quality was evaluated using audio-visual (AV) quality, video information and quality index (VIQI), global quality score (GQS), and reliability using a modified DISCERN tool (mDISCERN). High and low-content videos were defined based on the customized 10-point scoring system. Inter- and intra-examiner reliability of scoring system were calculated.

RESULTS

Most videos were educational (46.3%), presented by dental sleep medicine specialists (42.6%), and aimed at laypersons (63%), with the majority originating from the United States (79.6%). The final 54 videos were categorized as high-content (n = 29, 54%) and low-content (n = 25, 46%). High-content videos had more views, comments, and longer video durations (7.07 ± 6.04 min). Significant differences (p < .05) were observed among high and low-content videos in total VIQI, mDISCERN, GQS, and TCS. Moderate correlations were found between GQS and TCS (r = 0.721), mDISCERN and VIQI (r = 0.649), GQS and VIQI (r = 0.601), and AV quality and VIQI (r = 0.531).

CONCLUSION

The study highlights variable content quality and reliability of YouTube videos on oral appliance therapy for OSA, emphasizing the need for guidelines to enhance their educational value and deliver reliable, evidence-based information to patients.

Assessment of internet-based information on statin therapy

AIMS

The use of statin therapy is deemed to be controversial by mainstream media. Patients increasingly source medical information from the internet, and the use of statins is no exception. This study aims to determine the quality and educational content of statin-focused information on the internet and YouTube.

METHODS AND RESULTS

'Statin' was searched on Google, Yahoo!, Bing, and YouTube. The first 50 results obtained from each search engine and the first 20 YouTube videos were screened by two assessors. Websites were assessed using the Flesch Reading Ease (FRE) score, University of Michigan Consumer Health Website Evaluation Checklist, and a customized scoring system evaluating statin-focused content for quality. Videos were scored using the Journal of the American Medical Association (JAMA) benchmark criteria, Global Quality Score (GQS), and the customized scoring system. Websites scored a median FRE score of 57.5 [interquartile range (IQR) 52.1-62.3], median Michigan score of 36 (IQR 32-41.5), and median content score of 5 (IQR 3.75-7). Good interobserver agreement was demonstrated [Michigan score interobserver coefficient correlation (ICC) = 0.968; content score ICC = 0.944]. Videos scored a median JAMA score of 2, median GQS score of 2.5, and median content score of 2.5. Good interobserver agreement was demonstrated (JAMA ICC = 0.746; GQS ICC = 0.874; content score ICC = 0.946).

CONCLUSION

Quality and readability of statin-focused online information are poor. Healthcare professionals should be aware of the limitations of the current available sources and design online resources that are accurate and patient-friendly.

Evaluation of the quality and content of YouTube videos as an educational resource in developing patients' inhaler use skills

BACKGROUND

YouTube has educational videos on inhalers. However, their content and quality are not adequately known.

OBJECTIVES

This study investigated the quality and content of educational YouTube videos on inhalers.

METHODS

This descriptive study analyzed 178 YouTube videos on inhalers between May and July 2022. Two researchers independently evaluated the videos. The Global Quality Score (GQS), Journal of American Medical Association (JAMA) Benchmark Criteria, and Inhaler Application Checklist (IAC) were used to assess the quality and content of the videos. Spearman's correlation, Kruskal-Wallis, Mann-Whitney U, ANOVA, and Post hoc analysis Bonferroni test were used for data analysis.

RESULTS

The videos had a mean GQS score of 3.70 ± 1.24, and JAMA score of 2.22 ± 0.60. A negative correlation was between the quality score of the videos and views, likes, comments, duration, and likes/views (respectively; r = -0.237 p < 0.005, r = -0.217 p < 0.003, r = -0.220 p < 0.005, r = -0.147, p < 0.005). The videos narrated by nurses and doctors had significantly higher mean JAMA and GQS scores than others (p = 0.001). The videos missed some procedural steps [gargling (29.1%), adding no more than five ml of medication and device cleaning (41.9%), and exhaling through the nose (37.5%)]. Videos uploaded by individual missed significantly more procedural steps than professional organizations (p < 0.05).

CONCLUSIONS

YouTube videos about inhaler techniques have a moderate level of quality. Videos uploaded by doctors and nurses as content narrators were of higher quality. The videos missed some procedural steps. Individual video uploaders had higher missed procedural steps. Counseling should be provided to patients regarding the reliability of online information.

Short video platforms as sources of health information about cervical cancer: A content and quality analysis

BACKGROUND

The development of short popular science video platforms helps people obtain health information, but no research has evaluated the information characteristics and quality of short videos related to cervical cancer. The purpose of this study was to evaluate the quality and reliability of short cervical cancer-related videos on TikTok and Kwai.

METHODS

The Chinese keyword "cervical cancer" was used to search for related videos on TikTok and Kwai, and a total of 163 videos were ultimately included. The overall quality of these videos was evaluated by the Global Quality Score (GQS) and the modified DISCERN tool.

RESULTS

A total of 163 videos were included in this study, TikTok and Kwai contributed 82 and 81 videos, respectively. Overall, these videos received much attention; the median number of likes received was 1360 (403-6867), the median number of comments was 147 (40-601), and the median number of collections was 282 (71-1296). In terms of video content, the etiology of cervical cancer was the most frequently discussed topic. Short videos posted on TikTok received more attention than did those posted on Kwai, and the GQS and DISCERN score of videos posted on TikTok were significantly better than those of videos posted on Kwai. In addition, the videos posted by specialists were of the highest quality, with a GQS and DISCERN score of 3 (2-3) and 2 (2-3), respectively. Correlation analysis showed that GQS was significantly correlated with the modified DISCERN scores (p<0.001).

CONCLUSION

In conclusion, the quality and reliability of cervical cancer-related health information provided by short videos were unsatisfactory, and the quality of the videos posted on TikTok was better than that of videos posted on Kwai. Compared with those posted by individual users, short videos posted by specialists provided higher-quality health information.

Exploring AI-chatbots' capability to suggest surgical planning in ophthalmology: ChatGPT versus Google Gemini analysis of retinal detachment cases

BACKGROUND

We aimed to define the capability of three different publicly available large language models, Chat Generative Pretrained Transformer (ChatGPT-3.5), ChatGPT-4 and Google Gemini in analysing retinal detachment cases and suggesting the best possible surgical planning.

METHODS

Analysis of 54 retinal detachments records entered into ChatGPT and Gemini's interfaces. After asking 'Specify what kind of surgical planning you would suggest and the eventual intraocular tamponade.' and collecting the given answers, we assessed the level of agreement with the common opinion of three expert vitreoretinal surgeons. Moreover, ChatGPT and Gemini answers were graded 1-5 (from poor to excellent quality), according to the Global Quality Score (GQS).

RESULTS

After excluding 4 controversial cases, 50 cases were included. Overall, ChatGPT-3.5, ChatGPT-4 and Google Gemini surgical choices agreed with those of vitreoretinal surgeons in 40/50 (80%), 42/50 (84%) and 35/50 (70%) of cases. Google Gemini was not able to respond in five cases. Contingency analysis showed significant differences between ChatGPT-4 and Gemini (p=0.03). ChatGPT's GQS were 3.9±0.8 and 4.2±0.7 for versions 3.5 and 4, while Gemini scored 3.5±1.1. There was no statistical difference between the two ChatGPTs (p=0.22), while both outperformed Gemini scores (p=0.03 and p=0.002, respectively). The main source of error was endotamponade choice (14% for ChatGPT-3.5 and 4, and 12% for Google Gemini). Only ChatGPT-4 was able to suggest a combined phacovitrectomy approach.

CONCLUSION

In conclusion, Google Gemini and ChatGPT evaluated vitreoretinal patients' records in a coherent manner, showing a good level of agreement with expert surgeons. According to the GQS, ChatGPT's recommendations were much more accurate and precise.

YouTube as an information source for bleeding gums: A quantitative and qualitative analysis

Gum bleeding is a common dental problem, and numerous patients seek health-related information on this topic online. The YouTube website is a popular resource for people searching for medical information. To our knowledge, no recent study has evaluated content related to bleeding gums on YouTube™. Therefore, this study aimed to conduct a quantitative and qualitative analysis of YouTube videos related to bleeding gums. A search was performed on YouTube using the keyword "bleeding gums" from Google Trends. Of the first 200 results, 107 videos met the inclusion criteria. The descriptive statistics for the videos included the time since upload, the video length, and the number of likes, views, comments, subscribers, and viewing rates. The global quality score (GQS), usefulness score, and DISCERN were used to evaluate the video quality. Statistical analysis was performed using the Kruskal-Wallis test, Mann-Whitney test, and Spearman correlation analysis. The majority (n = 69, 64.48%) of the videos observed were uploaded by hospitals/clinics and dentists/specialists. The highest coverage was for symptoms (95.33%). Only 14.02% of the videos were classified as "good". The average video length of the videos rated as "good" was significantly longer than the other groups (p <0.05), and the average viewing rate of the videos rated as "poor" (63,943.68%) was substantially higher than the other groups (p <0.05). YouTube videos on bleeding gums were of moderate quality, but their content was incomplete and unreliable. Incorrect and inadequate content can significantly influence patients' attitudes and medical decisions. Effort needs to be expended by dental professionals, organizations, and the YouTube platform to ensure that YouTube can serve as a reliable source of information on bleeding gums.

Evaluation of AI-generated responses by different artificial intelligence chatbots to the clinical decision-making case-based questions in oral and maxillofacial surgery

OBJECTIVES

This study aims to evaluate the correctness of the generated answers by Google Bard, GPT-3.5, GPT-4, Claude-Instant, and Bing chatbots to decision-making clinical questions in the oral and maxillofacial surgery (OMFS) area.

STUDY DESIGN

A group of 3 board-certified oral and maxillofacial surgeons designed a questionnaire with 50 case-based questions in multiple-choice and open-ended formats. Answers of chatbots to multiple-choice questions were examined against the chosen option by 3 referees. The chatbots' answers to the open-ended questions were evaluated based on the modified global quality scale. A P-value under .05 was considered significant.

RESULTS

Bard, GPT-3.5, GPT-4, Claude-Instant, and Bing answered 34%, 36%, 38%, 38%, and 26% of the questions correctly, respectively. In open-ended questions, GPT-4 scored the most answers evaluated as grades "4" or "5," and Bing scored the most answers evaluated as grades "1" or "2." There were no statistically significant differences between the 5 chatbots in responding to the open-ended (P = .275) and multiple-choice (P = .699) questions.

CONCLUSION

Considering the major inaccuracies in the responses of chatbots, despite their relatively good performance in answering open-ended questions, this technology yet cannot be trusted as a consultant for clinicians in decision-making situations.

Quality of Pelvic Floor Therapy Videos on YouTube: Does Popularity Predict Reliability?

ABSTRACT

This study reviewed instructional videos on YouTube regarding pelvic floor physical therapy and assessed the association between the videos' popularity and the reliability of the videos' content. YouTube was searched using the terms relevant to pelvic floor muscle training. The first 100 videos for each search term were screened, and relevant metrics were collected for those meeting the inclusion criteria. Videos were assessed by 2 independent, trained health care professionals for reliability using the Medical Quality Video Evaluation (MQ-VET) tool, the modified DISCERN tool, the Journal of American Medical Association benchmark criteria, and the Global Quality Score. Popularity was assessed using the Video Power Index (VPI). Higher values for all scoring systems correlated with greater reliability and greater popularity, respectively. Five hundred videos were screened. Two hundred thirty-four videos were duplicates, and 99 did not meet the inclusion criteria. A total of 167 videos were reviewed. The median VPI and MQ-VET score was 201,114.76 (interquartile range, 7,194,020.29) and 48.00 (interquartile range, 12.75), respectively. Spearman's R value was 0.292 (P < 0.001), demonstrating a weak positive correlation between MQ-VET scores and VPI. The interrater reliability of the MQ-VET was good, with an intraclass correlation coefficient of 0.86 (95% confidence interval, 0.71-0.92). In summary, we identified a statistically significant but weak positive correlation between the reliability and popularity of YouTube videos about pelvic floor physical therapy.

Validity and reliability of artificial intelligence chatbots as public sources of information on endodontics

AIM

This study aimed to evaluate and compare the validity and reliability of responses provided by GPT-3.5, Google Bard, and Bing to frequently asked questions (FAQs) in the field of endodontics.

METHODOLOGY

FAQs were formulated by expert endodontists (n = 10) and collected through GPT-3.5 queries (n = 10), with every question posed to each chatbot three times. Responses (N = 180) were independently evaluated by two board-certified endodontists using a modified Global Quality Score (GQS) on a 5-point Likert scale (5: strongly agree; 4: agree; 3: neutral; 2: disagree; 1: strongly disagree). Disagreements on scoring were resolved through evidence-based discussions. The validity of responses was analysed by categorizing scores into valid or invalid at two thresholds: The low threshold was set at score ≥4 for all three responses whilst the high threshold was set at score 5 for all three responses. Fisher's exact test was conducted to compare the validity of responses between chatbots. Cronbach's alpha was calculated to assess the reliability by assessing the consistency of repeated responses for each chatbot.

RESULTS

All three chatbots provided answers to all questions. Using the low-threshold validity test (GPT-3.5: 95%; Google Bard: 85%; Bing: 75%), there was no significant difference between the platforms (p > .05). When using the high-threshold validity test, the chatbot scores were substantially lower (GPT-3.5: 60%; Google Bard: 15%; Bing: 15%). The validity of GPT-3.5 responses was significantly higher than Google Bard and Bing (p = .008). All three chatbots achieved an acceptable level of reliability (Cronbach's alpha >0.7).

CONCLUSIONS

GPT-3.5 provided more credible information on topics related to endodontics compared to Google Bard and Bing.

Quality and comprehensiveness of YouTube videos on back pain during pregnancy

OBJECTIVES

Back pain during pregnancy is a common issue that impacts the quality of life for many women. YouTube has become an increasingly popular source of health information. Pregnant women often turn to YouTube for advice on managing back pain, but the quality of available videos is highly variable. This study aimed to assess the quality and comprehensiveness of YouTube videos related to back pain during pregnancy.

METHODS

A YouTube search was conducted using the keyword "back pain in pregnancy", and the first 100 resulting videos were included in the study. After a thorough review and exclusion of ineligible videos, the final sample consisted of 71 videos. Various parameters such as the number of views, likes, viewer interaction, video age, uploaded source (healthcare or nonhealthcare), and video length were evaluated for all videos.

RESULTS

Regarding the source of the videos, 44 (61.9%) were created by healthcare professionals, while 27 (38%) were created by nonprofessionals. Videos created by healthcare professionals had significantly higher scores in terms of DISCERN score, Journal of the American Medical Association (JAMA) score, and Global Quality Scale (GQS) (P < 0.001). Our findings indicate a statistically significant and strong positive correlation among the three scoring systems (P < 0.001).

CONCLUSION

Videos created by healthcare professionals were generally of higher quality, but many videos were still rated as low-moderate quality. The majority of videos focused on self-care strategies, with fewer discussing other treatment options. Our findings highlight the need for improved quality and comprehensiveness of YouTube videos on back pain during pregnancy.

A scoping review of the dietary information needs of people with inflammatory bowel disease

AIMS

This review aimed to explore and describe the dietary information needs of individuals with inflammatory bowel disease and sources of information.

METHODS

A scoping review of English language articles and grey literature, using electronic databases with a predefined search strategy was undertaken. Data were synthesised based on the identified variables (e.g. dietary information needs and sources of dietary information) corresponding to the aims of this review.

RESULTS

Forty-six studies were included, reporting data from 7557 people with inflammatory bowel disease, of which 58.6% had Crohn's disease and 60.1% were males. Dietary information was rated very important and appeared to be influenced by the disease course. The need to discuss it is heightened at important stages, namely diagnosis and relapse. Dietary information was described broadly and included advice about foods to avoid and dietary advice for symptoms management. No major differences were noted in the dietary information needs of people with Crohn's disease compared to ulcerative colitis. The main sources of dietary information were the gastroenterologist (36%-98%), the internet (9%-60%) and non-dietetic professionals (84.7%).

CONCLUSION

This review highlights limited literature describing the dietary information needs of people with inflammatory bowel disease. Importantly, the limited access to specialised dietary advice for this cohort is concerning. Future studies are required to explore not only the nuances in the needs of those with active disease and in remission, but to further understand issues of access to specialised dietary advice to provide holistic person-centred care desired by this cohort.

Consulting the Digital Doctor: Google Versus ChatGPT as Sources of Information on Breast Implant-Associated Anaplastic Large Cell Lymphoma and Breast Implant Illness

BACKGROUND

Breast implant-associated anaplastic large cell lymphoma (BIA-ALCL) is a rare complication associated with the use of breast implants. Breast implant illness (BII) is another potentially concerning issue related to breast implants. This study aims to assess the quality of ChatGPT as a potential source of patient education by comparing the answers to frequently asked questions on BIA-ALCL and BII provided by ChatGPT and Google.

METHODS

The Google and ChatGPT answers to the 10 most frequently asked questions on the search terms "breast implant associated anaplastic large cell lymphoma" and "breast implant illness" were recorded. Five blinded breast plastic surgeons were then asked to grade the quality of the answers according to the Global Quality Score (GQS). A Wilcoxon paired t-test was performed to evaluate the difference in GQS ratings for Google and ChatGPT answers. The sources provided by Google and ChatGPT were also categorized and assessed.

RESULTS

In a comparison of answers provided by Google and ChatGPT on BIA-ALCL and BII, ChatGPT significantly outperformed Google. For BIA-ALCL, Google's average score was 2.72 ± 1.44, whereas ChatGPT scored an average of 4.18 ± 1.04 (p < 0.01). For BII, Google's average score was 2.66 ± 1.24, while ChatGPT scored an average of 4.28 ± 0.97 (p < 0.01). The superiority of ChatGPT's responses was attributed to their comprehensive nature and recognition of existing knowledge gaps. However, some of ChatGPT's answers had inaccessible sources.

CONCLUSION

ChatGPT outperforms Google in providing high-quality answers to commonly asked questions on BIA-ALCL and BII, highlighting the potential of AI technologies in patient education.

LEVEL OF EVIDENCE

Level III, comparative study LEVEL OF EVIDENCE III: This journal requires that authors assign a level of evidence to each article. For a full description of these Evidence-Based Medicine ratings, please refer to the Table of Contents or the online Instructions to Authors www.springer.com/00266 .

Validity of Material Related to the Anterior Cruciate Ligament on TikTok

Background

Video material is one of the most common types of digital information on social media platforms.

Purpose

To assess the validity and informational value of TikTok videos with regard to the anterior cruciate ligament (ACL).

Study Design

Cross-sectional study.

Methods

Using the terms "anterior cruciate ligament" AND/OR "ACL," 420 TikTok videos were retrieved, of which 100 videos were included in the analysis. The video duration and the number of likes, shares, and views were recorded. Videos were categorized based on the source (private user, physical therapist, surgeon, and researcher), subject type (patient experience, physical therapy, injury mechanism, anatomy, clinical test, and surgical technique), content (patient experience/testimony, education, and rehabilitation), and any background audio (music or voice). Video quality assessments were conducted using the DISCERN instrument, The Journal of the American Medical Association (JAMA) benchmark criteria, and the Global Quality Score (GQS). Associations between quantitative variables were tested using the Spearman rank correlation. One-way analysis of variance or Mann-Whitney test was performed to assess whether video quality differed by video characteristics.

Results

A total of 41 videos were published by private users (41%), 34 by physical therapists (34%), 23 by surgeons (23%), and 2 by researchers (2%). Most of the information regarded patient experience (34%), followed by physical therapy (20%), injury mechanism (19%), anatomy (11%), clinical test (9%), and surgical technique (7%). The mean video length was 40.55 ± 41.58 seconds. The mean number of views was 151,084.39 ± 487,150.02, while the mean numbers of comments, likes, and shares were 72.80 ± 249.68, 6781.49 ± 29,163.96, and 98.71 ± 307.76, respectively. The mean DISCERN, JAMA, and GQS scores were 15.73 ± 1.44, 0.19 ± 0.39, and 1.16 ± 0.37, respectively, indicating the poorest quality on all 3 indices. The number of views, likes, shares, comments, and video lengths were all positively correlated with DISCERN (except the number of shares), JAMA, and GQS scores (P < .05). A significant difference was found in DISCERN scores between videos by private users and those by surgeons (15.37 ± 0.98 vs 16.22 ± 1.57; P = .007).

Conclusion

Our analysis has demonstrated that the educational value of these videos on the ACL on TikTok is poor. Given the rapid growth of TikTok, further research is needed.

Social Media Videos on Contraceptive Implants: An Assessment of Video Quality and Reliability

STUDY OBJECTIVE

There are many videos on contraception on YouTube and TikTok, and women around the world use video platforms extensively to seek health information from videos of uncertain reliability and quality. The main objective of this research was to evaluate the scientific reliability and quality of the most popular social media videos about contraceptive subdermal implants.

METHODS

TikTok and YouTube videos were assessed separately by two gynecologists. The video quality was evaluated according to the DISCERN score, modified DISCERN score, and Global Quality Scale (GQS) score.

RESULTS

The study included the 100 most popular videos, 44 of which were uploaded by health care professionals. The median DISCERN score for videos shared by health care professionals was 50 (range 15-75), whereas it was 22 (range 15-56) for videos shared by independent users (P < .001). The median modified DISCERN score was 4 (min-max 0-5), and the median GQS score was 4 (min-max 1-5) for the videos uploaded by health care professionals. The modified DISCERN and GQS scores of TikTok videos were lower than those of YouTube videos (both P < .001).

CONCLUSION

Social media videos about contraceptive subdermal implants are popular and have been viewed tens of thousands of times, but the overall medical validity, which we evaluated according to the scoring systems, was poor. Despite the large number of videos, the content's quality and reliability are quite limited. There is a need to prioritize the education provided to patients by gynecologists, as well as to create high-quality content for YouTube and other similar platforms.

Assessment of usefulness and reliability of YouTube™ videos on denture care

INTRODUCTION

The world's population is in a demographic transition with a rising ageing population. Tooth loss is frequent among older people resulting in the replacement of natural teeth using complete or partial dentures. YouTube™ is the second most popular website in the world and is being increasingly used to access health care information. The aim of this study is to evaluate the usefulness and reliability of the information in YouTube™ videos regarding denture care.

METHODS

The YouTube™ website was used to systematically search for videos using the keyword 'denture care'. Videos meeting the eligibility criteria were assessed separately by two independent researchers. The usefulness of the videos was assessed using the Global Quality Assessment Scale and a customized usefulness scoring scheme. Based on these scores, the usefulness of the videos was categorized as low, medium and high. A modified DISCERN tool (mDISCERN) was used for assessing reliability with scores ranging from 0 to 5. Other video characteristics like source/ownership of the videos, duration, views, likes, dislikes, number of days posted, like ratio, view ratio, interaction index and Video Power Index were also obtained. Statistical analysis was carried out using the Kruskal-Wallis test, Spearman correlation test and multiple linear regression analysis.

RESULTS

A total of 120 videos were included. Based on the usefulness score, the usefulness of 65.8% of videos were classified as low, 32.5% were medium and 1.6% had high usefulness. The mDISCERN score for 74.2% of videos was 2 or below 2 indicating that the majority of videos had low reliability. Video characteristics did not differ significantly according to the usefulness of videos. Videos uploaded by dentists or dental hygienists had significantly higher usefulness scores (p < 0.001) in comparison to videos uploaded by other sources. However, reliability scores did not differ based on the sources of the videos. Video reliability was found to have a significant (B = 2.08, p < 0.001) positive association with video usefulness.

CONCLUSION

YouTube™ cannot be recommended as the only source of information for denture care as most videos received low usefulness and reliability ratings in our study. Dentists and dental health professionals could take an active part in enhancing denture care-related content on YouTube™ and enable patients to have adequate and reliable knowledge of denture hygiene practices.

YouTube as a Source of Patient and Trainee Education in Vascular Surgery: A Systematic Review

Objective

Due to its video based approach, YouTube has become a widely accessed educational resource for patients and trainees. This systematic review characterised and evaluated the peer reviewed literature investigating YouTube as a source of patient or trainee education in vascular surgery.

Data sources

A comprehensive literature search was conducted using EMBASE, MEDLINE, and Ovid HealthStar from inception until 19 January 2023. All primary studies and conference abstracts evaluating YouTube as a source of vascular surgery education were included.

Review methods

Video educational quality was analysed across several factors, including pathology, video audience, and length.

Results

Overall, 24 studies were identified examining 3 221 videos with 123.1 hours of content and 37.1 million views. Studies primarily examined YouTube videos on diabetic foot care (7/24, 29%), peripheral arterial disease (3/24, 13%), carotid artery stenosis (3/24, 13%), varicose veins (3/24, 13%), and abdominal aortic aneurysm (2/24, 8%). Video educational quality was analysed using standardised assessment tools, author generated scoring systems, or global author reported assessment of quality. Six studies assessed videos for trainee education, while 18 studies evaluated videos for patient education. Among the 20 studies which reported on the overall quality of educational content, 10/20 studies deemed it poor, and 10/20 studies considered it fair, with 53% of studies noting poor educational quality for videos intended for patients and 40% of studies noting poor educational quality in videos intended for trainees. Poor quality videos had more views than fair quality videos (mean 27 348, 95% CI 15 154-39 543 views vs. 11 372, 95% CI 3 115-19 629 views, p = .030).

Conclusion

The overall educational quality of YouTube videos for vascular surgery patient and trainee education is suboptimal. There is significant heterogeneity in the quality assessment tools used in their evaluation. A standardised approach to online education with a consistent quality assessment tool is required to better support online patient and trainee education in vascular surgery.

Assessment of the reliability and quality of breast cancer related videos on TikTok and Bilibili: cross-sectional study in China

Background

As the most common malignant tumor in the world, breast cancer also brings a huge disease burden to China. Ordinary people are increasingly inclined to use the Internet, especially video social platforms, as a source of health information. Educating the public to obtain correct information is important to reduce the incidence of breast cancer and improve the prognosis. However, the quality and reliability of breast cancer-related video content have not been fully studied.

Objective

This study aims to evaluate the quality of the information of breast cancer-related videos on TikTok and Bilibili video sharing platforms and factors related to video quality.

Methods

We collected the top 100 videos about breast cancer on TikTok and Bilibili, respectively. Categorize videos according to video source and video content. Video quality and reliability were assessed using Global Quality Score (GQS) and modified DISCERN (mDISCERN) tools. We also analyzed the correlation between video quality and video likes, comments, saves, and shares.

Results

Although the quality and reliability of Bilibili's breast cancer videos were higher than TikTok (p = 0.002 and p = 0.001, respectively), the video quality of both video sharing platforms was not satisfactory, with a median GQS scores of 2.00 and 3.00 and mDISCERN scores of 1.00 and 2.00, respectively. In general, the quality and reliability of videos released by medical practitioners were higher than those of non-medical practitioners, and the quality and reliability of videos covering disease-related knowledge were higher than those of news reports (all p < 0.001). Among medical practitioners, the quality of videos uploaded by doctors in breast disease was significantly lower than that of doctors in other areas (p < 0.05). There was a significant positive correlation between video quality and duration (r = 0.240, p < 0.001), a weak negative correlation between video quality and likes (r = 0.191, p < 0.01), video quality and comments (r = 0.256, p < 0.001), video reliability and likes (r = 0.198, p < 0.001), video reliability and comments (r = 0.243, p < 0.01).

Conclusion

Our study shows that the quality and reliability of breast cancer-related videos on TikTok and Bilibili are poor, and the overall quality is unsatisfactory. But videos uploaded by medical practitioners covering disease knowledge, prevention and treatment are of higher quality. Medical practitioners are encouraged to publish more high-quality videos, while video social platforms should formulate relevant policies to censor and supervise health education videos, so as to enable the public to obtain reliable health information.

Quality of YouTube Videos Regarding Anterior Cruciate Ligament Reconstruction Using Quadriceps Tendon Autograft Is Unsatisfactory

PURPOSE

To assess the validity and informational value of teaching material regarding anterior cruciate ligament reconstruction (ACLR) using quadriceps tendon (QT) autograft provided on the YouTube video platform.

METHODS

An extensive systematic search of the YouTube video platform was performed, and all videos that met the criteria were included in the analysis. The analysis of the video content was performed using the DISCERN instrument, Journal of American Medical Association (JAMA) benchmark criteria, and Global Quality Score (GQS). The duration of the videos, the date of publication, and the number of likes and views were recorded. Furthermore, videos were categorized based on the source (physicians, companies, patients), the subject (surgical technique, patient experience and overview [overview videos were videos in which multiple aspects were analyzed]), and the type of content (educational or subjective patient experience).

RESULTS

A total of 88 videos were included in the analysis. Seventy-one (80.7%) videos were published by physicians, 15 (17.0%) by patients, and 2 (2.3%) by companies. The majority of the videos described various surgical techniques (59%-67.0%), 80.7% of the videos (72%-81.8%) had an educational nature, and the remaining 18.2% described patient experiences. The mean length of the videos was 8.21 ± 7.88 minutes. The mean number of views was 3,988.51 ± 9,792.98 (range 9-56,047), whereas the mean numbers of comments and likes were 30.07 ± 70.07 (range 0-493) and 4.48 ± 14.22 (range 0-82), respectively. The mean DISCERN score, JAMA score, and GQS were 27.43 ±11.56 (95% confidence interval [CI] 25.01-29.85; range: 17-68), 1.22 ± 0.85 (95% CI 1.04-1.40; range 0-3), and 1.82 ± 0.93 (95% CI 1.63-2.01; range 1-4), respectively. For all scores, videos published by physicians had greater quality (DISCERN score, JAMA score, and GQS) (P < .05). Among all of the analyzed videos, overview videos were of the highest quality (P < .05).

CONCLUSIONS

YouTube is a fast and open-access source of mass information. The overall quality of the videos on ACLR performed using QT autograft was unsatisfactory, demonstrating low educational quality and reliability. Currently, YouTube cannot be recommended as a reliable source of information on ACLR with the QT.

The Quality and Reliability of Information in YouTube Videos on Occupational Health and Safety

Background

Education is very important to prevent occupational injuries and accidents, which are almost all completely preventable. The aim of this study was to evaluate training videos on this subject on the YouTube platform.

Methods

Six search terms related to occupational health and safety (OHS) were scanned on May 31, 2021. After the application of exclusion criteria, a total of 176 videos were included for final analysis using the parameters of country origin, source of the video, content, number of views, comments, likes, dislikes, and video duration. The Global Quality Scale (GQS) and modified DISCERN tools were used to evaluate the quality and reliability of the videos in this analytical cross-sectional study.

Results

According to the GQS score, 111 (63.1%) videos were of low quality. Statistically significant differences were found between the low-, moderate-, and high-quality groups with respect to video length, likes, dislikes, comments, likes per day, dislikes per day, comments per day, video category, and the DISCERN scores (P < 0.05). The vast majority of videos contained low-quality information. A large number of videos were uploaded on OHS content from independent users and the USA.

Conclusion

There is a clear need for professionals to play a more active role in uploading and sharing high-quality information on Internet platforms on the subject of OHS.

Evaluating the understandability and actionability of online CKD educational materials

BACKGROUND

Previous studies have not fully determined whether online education materials on chronic kidney disease (CKD) for Japanese patients are easy to understand and help change their behavior. Therefore, this study quantitatively assessed the understandability and actionability of online CKD education materials.

METHODS

In September 2021, we searched Google and Yahoo Japan using the keywords "kidney," "kidney disease," "CKD," "chronic kidney disease," and "renal failure" to identify 538 webpages. We used the Japanese version of the Patient Education Materials Assessment Tool (PEMAT), ranging from 0 to 100%, to evaluate the understandability and actionability of webpages. We set the cutoff point to 70%.

RESULTS

Of the 186 materials included, the overall understandability and actionability were 61.5% (± 16.3%) and 38.7% (± 30.6%), respectively. The materials were highly technical in their terminology and lacked clear and concise charts and illustrations to encourage action. Compared to lifestyle modification materials on CKD overview, symptoms/signs, examination, and treatment scored significantly lower on the PEMAT. In addition, the materials produced by medical institutions and academic organizations scored significantly lower than those produced by for-profit companies.

CONCLUSION

Medical institutions and academic organizations are encouraged to use plain language and to attach explanations of medical terms when preparing materials for patients. They are also expected to improve visual aids to promote healthy behaviors.

YouTubeTM as a source of information on autosomal dominant polycystic kidney disease: A quality analysis

Introduction

Autosomal dominant polycystic kidney disease (ADPKD) is the most common inherited kidney disease in adults. As a social media platform, YouTube has tremendous potential to both support and hinder public health efforts. The aim of this study was to assess the reliability and quality of the most viewed English-language YouTube videos on ADPKD.

Methods

A YouTube search was conducted on 3 August 2023, using the keyword ADPKD disease and the top 200 videos were analyzed for relevance. Videos in the "Short" category that were duplicates, were not in English, were not audio or visual, and contained advertisements were excluded. Two reviewers divided the 159 included videos into groups based on their source and content.

Results

In 106 (66.7%) of the 159 videos, general information about the disease was given, 58 (36.5%) discussed medical treatment, 11 (6.9%) discussed surgical treatment, 30 (18.9%) included patient images and radiological images, and eight (5%) discussed the genetic and pathological features of the disease. Additionally, 16 (10.1%) videos fell into the "other" category. According to the Journal of the American Medical Association, Quality Criteria for Consumer Health Information and Global Quality Scale scoring systems, videos uploaded by health associations and foundations received the highest scores (3 (1-4), 54 (28-70), 4 (1-5), respectively).

Conclusion

Academic institutions and other official health organizations such as Health Associations/Foundations need to use YouTube more effectively to disseminate accurate, reliable and useful health-related information to society.