Assessing information on YouTube™ as a quality source for the treatment of varicoceles

A systematic review assessing the reliability of studies focusing on urological content on YouTube

INTRODUCTION

In recent years, several publications have focused on analyzing the quality of medical content on YouTube. The current systematic review aimed to summarize and analyze the available studies examining YouTube video content in the urological field.

EVIDENCE ACQUISITION

This is a systematic review including studies examining urological content uploaded on the YouTube platform published before November 2023. The following keywords were combined to capture relevant publications with a title/abstract search: ("Urology" OR "Andrology") AND ("YouTube" OR "Social media").

EVIDENCE SYNTHESIS

According to the inclusion criteria, 84 studies were included. Of all, 74 (88%) studies were published after the COVID-19 pandemic outbreak. A total of 52 (62%) studies used the DISCERN score, 29 (35%) the PEMAT A/V score, 30 (36%) the GQS, 23 (27%) the Misinformation score, 14 (17%) the Likert scale, and 13 (15%) the JAMA score. According to the conclusion, 62 (74%) studies reported poor quality results. Among all, only 10 (12%) studies respected our criteria of best quality methodology, defined as: 1) description of the research time frame; 2) use of incognito status; 3) the description of the inter-rater variability between reviewers; 4) use of at least one quality assessment tool.

CONCLUSIONS

The systematic review highlights significant variability in results and methodologies across studies on the quality analysis of urological content on YouTube. The official urological community should establish guidelines for authors, aiming to enhance the reliability and importance of such publications as valuable resources for daily clinical practice.

An infodemiologic review of internet resources on dental hypersensitivity: A quality and readability assessment

BACKGROUND

This study aimed to investigate the quality and readability of online English health information about dental sensitivity and how patients evaluate and utilize these web-based information.

METHODS

The credibility and readability of health information was obtained from three search engines. We conducted searches in "incognito" mode to reduce the possibility of biases. Quality assessment utilized JAMA benchmarks, the DISCERN tool, and HONcode. Readability was analyzed using the SMOG, FRE, and FKGL indices.

RESULTS

Out of 600 websites, 90 were included, with 62.2% affiliated with dental or medical centers, among these websites, 80% exclusively related to dental implant treatments. Regarding JAMA benchmarks, currency was the most commonly achieved and 87.8% of websites fell into the "moderate quality" category. Word and sentence counts ranged widely with a mean of 815.7 (±435.4) and 60.2 (±33.3), respectively. FKGL averaging 8.6 (±1.6), SMOG scores averaging 7.6 (±1.1), and FRE scale showed a mean of 58.28 (±9.1), with "fair difficult" being the most common category.

CONCLUSION

The overall evaluation using DISCERN indicated a moderate quality level, with a notable absence of referencing. JAMA benchmarks revealed a general non-adherence among websites, as none of the websites met all of the four criteria. Only one website was HON code certified, suggesting a lack of reliable sources for web-based health information accuracy. Readability assessments showed varying results, with the majority being "fair difficult". Although readability did not significantly differ across affiliations, a wide range of the number of words and sentences count was observed between them.

Evaluating quality, understandability, and actionability of YouTube content for gender-affirming surgery

INTRODUCTION

The purpose of this study is to evaluate YouTube content about metoidioplasty on completeness of perioperative information, actionability, understandability, degree of misinformation, quality, and presence of commercial bias.

METHODS

A YouTube search for "Metoidioplasty" was conducted and the first 100 video results were watched by five independent reviewers. Videos in English, <30 minutes in length were included and videos primarily showing surgical footage were excluded. Videos were evaluated between January 2022 and June 2022. Each video was evaluated for presenter demographics, channel/video statistics, and whether it covered topics including anatomy, treatment options, outcomes, procedure risks, and misinformation, and whether it had a clickbait title. Calculated scores for validated DISCERN and patient education materials assessment tool (PEMAT) metrics were the primary outcome variables used to quantify quality, actionability, and understandability. For PEMAT, a cutoff of 75% was used to differentiate between "poor" vs. "good/sufficient." Multivariate and univariate logistic regressions were performed to assess correlations among primary outcome variables and other variables.

RESULTS

Of the 79 videos analyzed, 24% (n=19) were of high quality; 99% (n=78) had poor understandability and 100% (n=79%) had poor actionability. Patients/consumers were the most common publisher type (n=71, 90%).

CONCLUSIONS

This study demonstrates metoidioplasty content available on YouTube is not comprehensive and is of poor quality, and poor actionability and understandability, demonstrating a clear need for more relevant, accessible, comprehensible, and accurate content.

Size matters: characterizing penile augmentation content from the 100 most popular YouTube videos

Aesthetic penile augmentation is considered investigational and not shown to be safe or efficacious. This study sought to characterize the quality and reliability of YouTube videos on the topic of penile augmentation. A systematic search identifying the 100 most viewed YouTube videos on penile augmentation was conducted. The videos were then evaluated by two independent urologists for reliability and quality using a modified DISCERN scoring system and Global Quality Scale (GQS). The median total views were 530,612 (range 123,478-32,914,713). The median DISCERN and GQS scores for all 100 videos were generally poor at 1.75 (IQR 1-2.63) and 2.5 (IQR 1.5-3.5), respectively. A little under half of the videos had a physician present (44.7%). DISCERN and GQS scores were significantly higher in videos with physicians compared to those without one (p < 0.001 for both). The majority of videos discussed nonsurgical methods of penile augmentation (65.1%) with penile traction devices being the most frequently discussed (19.2%). Urologists and medical organizations should strive to have more of a presence in this space to ensure patients are appropriately educated and counseled before pursuing potentially ineffective or harmful treatments.

Evaluation of YouTube As A Source For Graves' Disease Information: Is High-Quality Guideline-Based Information Available?

Objective

To understand the quality of informational Graves' disease (GD) videos on YouTube for treatment decision-making quality and inclusion of American Thyroid Association (ATA) treatment guidelines.

Study Design

Cross-sectional cohort.

Setting

Informational YouTube videos with subject matter "Graves' Disease treatment."

Method

The top 50 videos based on our query were assessed using the DISCERN instrument. This validated algorithm discretely rates treatment-related information from excellent (≥4.5) to very poor (<1.9). Videos were also screened for ATA guideline inclusion. Descriptive statistics were used for cohort characterization. Univariate and multivariate linear regressions characterized factors associated with DISCERN scores. Significance was set at P < .05.

Results

The videos featured 57,513.43 views (SD = 162,579.25), 1054.70 likes (SD = 2329.77), and 168.80 comments (SD = 292.97). Most were patient education (52%) or patient experience (24%). A minority (40%) were made by thyroid specialists (endocrinologists, endocrine surgeons, or otolaryngologists). Under half did not mention all 3 treatment modalities (44%), and 54% did not mention any ATA recommendations. Overall, videos displayed poor reliability (mean = 2.26, SD = 0.67), treatment information quality (mean = 2.29, SD = 0.75), and overall video quality (mean = 2.47, SD = 1.07). Physician videos were associated with lower likes, views, and comments (P < .001) but higher DISCERN reliability (P = .015) and overall score (P = .019). Longer videos (P = .015), patient accounts (P = .013), and patient experience (P = .002) were associated with lower scores.

Conclusion

The most available GD treatment content on YouTube varies significantly in the quality of medical information. This may contribute to suboptimal disease understanding, especially for patients highly engaged with online health information sources.

Evaluating YouTube as a Source of Education for Patients Undergoing Surgery: A Systematic Review

OBJECTIVE

The objective of this systematic review is to characterize the peer-reviewed literature investigating YouTube as a source of patient education for patients undergoing surgery.

SUMMARY BACKGROUND DATA

YouTube is the largest online video sharing platform and has become a substantial source of health information that patients are likely to access before surgery, yet there has been no systematic assessment of peer-reviewed studies. A comprehensive literature search was conducted using EMBASE, MEDLINE, and Ovid HealthStar from inception through to December of 2021.

METHODS

All primary studies evaluating YouTube as a source of patient education relating to surgical procedures (general, cardiac, urology, otolaryngology, plastic, vascular) were included. Study screening and data extraction occurred in duplicate with two reviewers. Characteristics extracted included video length, view count, upload source, overall video educational quality, and quality of individual studies.

RESULTS

Among 6,453 citations, 56 studies were identified that examined 6,797 videos with 547 hours of content and 1.39 billion views. There were 49 studies that evaluated the educational quality of the videos. A total of 43 quality assessment tools were used, with each study using a mean of 1.90 assessment tools. Per the global rating for assessments, 34/49 studies (69%) concluded that the overall quality of educational content was poor.

CONCLUSIONS

While the impact of non-peer-reviewed YouTube videos on patient knowledge for surgery is unclear, the large amount of online content suggests that they are in demand. The overall educational content of these videos is poor, however, and there is substantial heterogeneity in the quality assessment tools used in their evaluation. A peer-reviewed and standardized approach to online education with video content is needed to better support patients.

YouTube as a Source of Information on Lipedema: Property, Quality, and Reliability Assessment

Background/Aim: YouTube provides information on several health-conditions including lipedema. The aim of this study was to investigate the properties, quality, and quantity of YouTube videos on lipedema. Methods: We explored YouTube using the key word lipedema and the initial top 50 videos were included to review. The properties comprising informers, target, and domains of videos covering number of views, likes, dislikes, duration, viewing rate (VR), and video power index (VPI) were recorded. A modified DISCERN tool and global quality scale (GQS) were used to assess the reliability and quality of videos, respectively. Results: The top 50 videos had a mean of 35,805 views, 282 likes, 12 dislikes, and 30 comments. The mean VPI (96.4) and VR (63.8%) were high. The videos were generally uploaded by health professionals for patient/public and health professional targets with the same ratio (50%). The majority of video contents was related to general information (68%) followed by surgical treatment (62%). Only a small ratio of their content (22%) was about nonsurgical management. The reliability and quality of the videos were intermediate to low. The median DISCERN and GQS scores were higher in the videos uploaded by health professional group compared with nonhealth professionals, but the number of views, VPI, and VR were similar between the groups with regard to the source. Conclusion: YouTube videos on lipedema are mostly provided by health professionals targeting both public/patients and health care providers but the content is limited and the quality and reliability of them were low to intermediate. Therefore, the lipedema specialists are suggested to work together to create up-to-date, high-quality, accessible online educational content to meet the needs of both patients/public and the health professionals. In addition, control mechanisms and careful peer reviewing of the videos informed by nonhealth professionals are warranted to avoid misleading information.

Assessment of quality, absorbability, and educational value of YouTube videos regarding ankle fractures

Aims & objectives

YouTube is a non-peer-reviewed platform with a large library of healthcare-related videos which attempt to provide educational content. The goal of this study is to analyze the quality, absorbability, and educational content of videos available to patients on YouTube regarding ankle fractures.

Materials & methods

On May 31, 2022, over 550 videos populated the initial search of "ankle fracture" within YouTube's platform. The first 100 videos were reviewed, and 62 videos were included in the final analysis. Video characteristics were recorded and evaluated. Videos were assessed using three objective scoring systems: (1) the Journal of American Medical Association (JAMA) benchmark criteria, (2) the Patient Education Materials Assessment Tool for audio and visual materials (PEMAT), and (3) the novel Ankle Fracture Content Score (AFCS).

Results

Each scoring system had high internal consistency and interrater reliability. The mean JAMA, PEMAT understandability, PEMAT actionability, and AFCS were 2.92, 61.85%, 16.38%, and 4.67, respectively. No association was seen between video popularity metrics and quality of information. The understandability of the patient-targeted videos was greater than those targeted at healthcare professionals (P = 0.049).

Conclusion

The information regarding ankle fractures available on YouTube for patient education is poor with no correlation between quality and popularity. This study illustrates the need for future collaboration between YouTube and trusted medical societies to provide patients with the highest quality information.

Quality and Reliability Analysis of YouTube Videos on Magnetic Resonance Imaging Claustrophobia

Aim Magnetic resonance imaging (MRI)-induced anxiety is not infrequent with a reported incidence as high as 37% and the rate of failed MRI imaging due to claustrophobia ranges between 0.5% and 14.5%. The objective of this study was to evaluate the quality and reliability of YouTube^TM videos on MRI claustrophobia. Methods Sixty-five videos were included in the final analysis. Video information analyzed included video length (minutes), video content, qualification of the video uploaders, time of upload, time since upload, the number of total views and the mean daily views, and like counts. We divided the videos according to the uploaders into professional and non-professional groups and further grouped the videos as useful and misleading. Data obtained from the videos were evaluated with three tools including subjective evaluation, Quality Criteria for Consumer Health Information (DISCERN), and Global Quality Scale (GQS) tools. Results The mean video duration was found as 4.14±4.45 minutes. The mean view count was 104.59±408,788.68 and the mean like count was found as 272.55±1096.25. Seventeen (26.15%) videos were uploaded by professionals and 48 (73.85%) by non-professionals. Twenty-eight (43.08%) of the videos were useful and 37 (56.92%) were useless. The mean DISCERN and GQS scores were statistically significantly higher in the professional videos compared to the non-professional videos and in useful videos compared to non-useful videos (for all, p<0.001). Conclusion A majority of the YouTube^TM videos concerning MRI claustrophobia were uploaded by non-professionals. Physicians and other healthcare personnel should be encouraged to provide useful and accurate videos and to direct patients appropriately.

Quality and content analysis of female urethroplasty videos on YouTube

OBJECTIVES

In this study, we aimed to analyze scientific quality and content of female urethroplasty videos on YouTube.

METHODS

We searched YouTube using the "female urethroplasty", "female urethral stricture", and "urethroplasty" keywords on February 22, 2022. The quality and content of videos were analyzed using the Global Quality Score (GQS) and Female Urethroplasty-Specific Checklist Score (FUSCS) which was developed by our clinic. Video analysis was performed by two independent urologists. The relationship between the video characteristics and GQS and FUSCS was examined.

RESULTS

A total of 38 videos were analyzed. Fourteen (36.8%) videos were uploaded by academic sources such as urology societies and universities/hospitals, while 24 (63.2%) videos were uploaded by urologists. The median GQS was 3 (range, 2-4) and the median FUSCS was 8 (range, 5-9) for all videos. The Cohen's kappa was 0.834 for GQS and 0.899 for FUSCS, indicating a high level of agreement between the observers. The median GQS was 4 (range, 4-5) and the median FUSCS was 9 (range, 8-10) for academic videos, indicating a statistically significantly higher scores than the urologists videos (p = .002 and p < .001, respectively).

CONCLUSION

Academic videos on female urethroplasty on YouTube have adequate scientific quality and content for both patients and healthcare professionals. The number of videos by academic sources on female urethroplasty should be increased and individuals should be encouraged to search such videos on search engines.