Analysis of the Quality of Parotidectomy Videos on YouTube Using the IVORY-Grading-System

Evaluation of the Quality of Tympanoplasty Videos on YouTube Using the Ivory Grading System

Purpose

YouTube has become a key platform for sharing information on surgical procedures. However, the absence of peer review raises concerns about the educational quality and reliability of its content. The IVORY grading system was developed to address this gap in otorhinolaryngology. This study aims to evaluate the educational quality of tympanoplasty videos on YouTube using the IVORY system and identify deficiencies.

Methods

Ninety-four tympanoplasty videos were analyzed based on inclusion and exclusion criteria. Video metrics such as duration, views, and likes were recorded, and videos were scored on a 0-2 scale using the IVORY system. Total scores were categorized from A to F. Statistical analyses examined the relationships between IVORY scores and video characteristics.

Results

The median IVORY score of the videos was 21.0 (IQR: 17.0-24.0). Only 4.3% of the videos (A and B categories) were of high educational quality, while 68.1% were classified as low quality (F category). A weak but significant correlation was found between IVORY scores and metrics such as views (p = 0.008, r = 0.271) and likes (p = 0.005, r = 0.288). Video duration showed a significant negative correlation with IVORY scores (beta = -0.05, p = 0.012). Geographic differences significantly affected video quality (p < 0.05).

Conclusion

This study highlights YouTube's potential as a resource for surgical education while also revealing significant shortcomings in video quality. The broader adoption of guidelines like the IVORY system and the encouragement of producing content aligned with these standards would be an important step toward improving the quality of surgical educational materials.

Level of Evidence

NA.

Evaluation of the Educational Quality of Endonasal Endoscopic Dacryocystorhinostomy Videos on YouTube with IVORY and LAP-VEGaS Guidelines

Objective: The aim of this study was to evaluate the educational quality of endonasal endoscopic dacryocystorhinostomy (EE-DCR) videos on YouTube with Instructional Videos in Otorhinolaryngology by YO-IFOS (IVORY) and LAParoscopic surgery Video Educational GuidelineS (LAP-VEGaS) guidelines and to evaluate the correlation of the 2 guidelines. Methods: EE-DCR videos were queried using search terms on YouTube. Views, likes, likes/dislikes ratio, age, and length of videos were noted. Videos were evaluated using the IVORY and LAP-VEGaS guidelines. Two IVORY scores were created: total (IVORY-1) and organ-specific (IVORY-2). The correlation analysis between video features and guideline scores was performed. Results: A total of 61 EE-DCR videos were evaluated. The mean score of LAP-VEGaS was 10.3 (±SD 2.7), the mean IVORY-1 score was 22.5 (±SD 5.5), and the mean IVORY-2 score was 10.6 (±SD 1.94). Correlation analysis revealed a statistically significant correlation between the IVORY-1 total score and the number of likes, the duration of the video, the age of the video, and the LAP-VEGaS score. Linear regression analysis showed that higher IVORY-1 scores predicted longer video duration, newer video age, and higher LAP-VEGaS scores. There was a significant association between LAP-VEGaS categories and the IVORY-1 total score (P < .001). Conclusion: The quality of EE-DCR videos is generally low to moderate. The IVORY and LAP-VEGaS guidelines were found to be correlated with each other. Both guidelines can be used to evaluate EE-DCR videos and otolaryngology surgical education videos in general. We believe that scales such as IVORY and LAP-VEGaS may be improved according to specific surgical procedures.

Evaluating HPV Vaccination-Related Content on a Burgeoning Social Media Platform: Insufficient Quality of TikTok

Objective

Assessing the quality of human papillomavirus (HPV) vaccination-related content on TikTok is crucial due to its popularity among adolescents. We assessed these videos while comparing the content and quality of videos with and without physician involvement.

Study Design

Cross-sectional cohort analysis.

Setting

HPV vaccination-related TikTok videos.

Methods

The TikTok library was queried using the search terms #HPVvaccine, #HPVvaccination, #Gardasil, #Gardasilvaccine, and #Gardasilvaccination. Video quality was evaluated using the DISCERN scale, assessing treatment-related information quality. Descriptive statistics were used to characterize our cohort. t Test and Fischer's exact test were used to assess for differences in video content and quality based on physician involvement. Significance was set at P < .05.

Results

Our search yielded 131 videos, averaging 68,503.12 views, 2314.27 likes, and 89.28 comments per video. Videos frequently involved physicians (48.09%), focused on education (54.96%) or advocacy (22.90%), and were US-made (68.90%). Otolaryngologists were rarely featured (3.17%). While most videos mentioned the HPV vaccine protected against cancer generally (86.26%), and cervical cancer specifically (67.94%), few discussed its protective effect against head and neck cancer (26.72%). Videos infrequently discussed updated eligibility among all adults ≤45 years of age (26.72%) or that men can also receive the vaccine (28.24%). Physician-involved videos were more focused on education (P < .001) and focused less on patient experiences (P < .001) and advocacy (P = .036). Overall DISCERN scores were low among physician (mean = 2.46, SD = 1.13) and nonphysician (mean = 2.09, SD = 1.02) content.

Conclusion

TikTok HPV vaccination content is poor in quality, even with physician involvement. Enhancing content quality and increasing otolaryngologist participation can boost HPV awareness and vaccination rates.

Assessing Laryngectomy Patient Education on YouTube: Investigating Quality and Reliability

Objective

This study aimed to characterize the quality of laryngectomy-related patient education on YouTube and understand factors impacting video content quality.

Study Design

Cross-sectional cohort analysis.

Setting

Laryngectomy-related videos on YouTube.

Methods

YouTube was anonymously queried for various laryngectomy procedure search terms. Video quality was evaluated using the validated DISCERN instrument which assesses treatment-related information quality. Descriptive statistics were used to characterize our cohort. Univariate and multivariable linear regression were used to assess factors associated with increased DISCERN score. Significance was set at P < .05.

Results

Our 78-video cohort exhibited moderate levels of engagement, averaging 13,028.40 views (SD = 24,246.93), 69.79 likes (SD = 163.75), and 5.27 comments (SD = 18.81). Videos were most frequently uploaded to accounts belonging to physicians (43.59%) or health care groups (41.03%) and showcased operations (52.56%) or physician-led education (20.51%). Otolaryngologists were featured in most videos (85.90%), and most videos originated outside the United States (67.95%). Laryngectomy videos demonstrated poor reliability (mean = 2.35, SD = 0.77), quality of treatment information (mean = 1.92, SD = 0.86), and overall video quality (mean = 1.97, SD = 1.12). In multivariable linear regression, operative videos were associated with lower video quality relative to nonoperative videos (β = -1.63, 95% confidence interval [CI] = [-2.03 to -1.24], P < .001); the opposite was true for videos from accounts with higher subscriber counts (β = 0.02, 95% CI = [0.01-0.03], P = .005).

Conclusion

The quality and quantity of YouTube's laryngectomy educational content is limited. There is an acute need to increase the quantity and quality of online laryngectomy-related content to better support patients and caregivers as they cope with their diagnosis, prepare for, and recover from surgery.