Quality and reliability evaluation of online videos on carpal tunnel syndrome: a YouTube video-based study

Characteristics, reliability, and quality of YouTube videos on meralgia paresthetica: a descriptive cross-sectional study

INTRODUCTION

The purpose of this study was to evaluate YouTube videos on meralgia paresthetica (MP) for reliability, quality, and differences between quality levels.

METHODS

We analyzed 59 videos related to MP. We evaluated several video characteristics, including views, likes, dislikes, duration, and speaker profile. We used view ratio, like ratio, Video Power Index (VPI), Global Quality Scale (GQS), JAMA criteria, and modified DISCERN (mDISCERN) to assess viewer engagement, popularity, educational quality, and reliability.

RESULTS

The videos received a total of 4,009,141 views (average 67,951.54), with 25.4% focused on exercise training and 23.7% focused on disease information. Mean scores were mDISCERN 2.4, GQS 2.8, and JAMA 2.1. Physician-led videos had higher mDISCERN scores, while allied health worker-led videos had more views, likes, dislikes, view ratios, and VPI. Poor and high-quality videos differed in views, likes, view ratio, VPI, and duration. Positive correlations existed among mDISCERN, JAMA, and GQS scores, with video duration positively correlated with GQS.

CONCLUSION

The content of YouTube videos discussing diseases significantly influences viewer engagement and popularity. To enhance the availability of valuable content on YouTube, which lacks a peer review process, medical professionals must contribute high-quality educational materials tailored to their target audience.

Evaluation of Patient Education Materials From Large-Language Artificial Intelligence Models on Carpal Tunnel Release

BACKGROUND

ChatGPT, an artificial intelligence technology, has the potential to be a useful patient aid, though the accuracy and appropriateness of its responses and recommendations on common hand surgical pathologies and procedures must be understood. Comparing the sources referenced and characteristics of responses from ChatGPT and an established search engine (Google) on carpal tunnel surgery will allow for an understanding of the utility of ChatGPT for patient education.

METHODS

A Google search of "carpal tunnel release surgery" was performed and "frequently asked questions (FAQs)" were recorded with their answer and source. ChatGPT was then asked to provide answers to the Google FAQs. The FAQs were compared, and answer content was compared using word count, readability analyses, and content source.

RESULTS

There was 40% concordance among questions asked by the programs. Google answered each question with one source per answer, whereas ChatGPT's answers were created from two sources per answer. ChatGPT's answers were significantly longer than Google's and multiple readability analysis algorithms found ChatGPT responses to be statistically significantly more difficult to read and at a higher grade level than Google's. ChatGPT always recommended "contacting your surgeon."

CONCLUSION

A comparison of ChatGPT's responses to Google's FAQ responses revealed that ChatGPT's answers were more in-depth, from multiple sources, and from a higher proportion of academic Web sites. However, ChatGPT answers were found to be more difficult to understand. Further study is needed to understand if the differences in the responses between programs correlate to a difference in patient comprehension.

The Lack of High-quality Educational Resources about Adhesive Capsulitis on YouTube

Objective  The advent of the Internet has provided new, easily accessible resources for patients seeking additional health information. Many doctors and healthcare organizations post informative videos on this platform, and nearly all patients are looking for videos online for a second opinion. Methods  The phrases "frozen shoulder," "frozen shoulder treatment," "adhesive" capsulitis, and "adhesive capsulitis treatment" were entered into YouTube's search bar for a normal inquiry. The informativeness and overall quality of the adhesive capsulitis videos were rated using three separate scales. Results  The mean and standard deviation values of the scoring systems were JAMA 1.25 ± 0.51, DISCERN 39.4 ± 13.4, GQS 2.83 ± 0.96 and ACSS 7.43 ± 4.86, respectively. Number of views, rate of views, and likes all had a positive correlation with Global Quality Score (GQS), as did DISCERN and ACSS. There was no statistically significant difference between the median JAMA, GQS score and Discern Criteria values according to the video source/uploader (p > 0.05). Conclusion  YouTube videos on adhesive capsulitis, thus, need to be of higher quality, reliability, and instructive quality. There is a need for reliable videos about adhesive capsulitis, with instructional and high-quality cited.

Are YouTube videos claiming to describe lumbar spinal manipulation techniques adequate?

BACKGROUND AND OBJECTIVE

YouTube has become a digital visual library in almost all fields of life, including medicine. Healthcare professionals and students frequently use YouTube to gain new skills and knowledge; however, the content of these videos has not been scientifically evaluated. Therefore, this study aimed to determine the descriptive adequacy and quality of YouTube videos on lumbar spine manipulation techniques (LSMTs) prepared by different healthcare professionals.

METHODS

The first 50 most relevant videos retrieved on searching YouTube for the keyword 'lumbar spinal manipulation techniques' were included in the study. The video metrics (total duration, number of views, time since upload, number of comments, number of likes, and number of dislikes) that could be accessed from video descriptions were recorded. However the videos were scored according to manipulation definition criteria proposed by the American Academy of Orthopedic Manual Physical Therapists (AAOMPT manipulation description score - AAOMPT-MDS) and benchmark criteria for quality of digital content by the Journal of American Medical Association's (JAMA). The video metrics, AAOMPT-MDS and JAMA scores of the videos prepared by medical doctors, chiropractors, osteopaths, and physiotherapists were compared.

RESULTS

Video metrics of groups were similar. The mean AAOMPT-MDS of the videos was 2.40 ± 1.57 out of 6.00 (higher score was better), and the mean JAMA score was 2.14 ± 1.05 out of 4.00 (higher score was better). Videos created by all professional groups had statistically comparable AAOMPT-MDS and JAMA scores (p > 0.05).

CONCLUSION

Although YouTube videos on LSMTs offer valuable information for professionals and students, creators should follow the proposed recommendations when producing these videos to ensure quality content and systematic presentation.

Patient-Directed Online Education for Carpal Tunnel Syndrome and Release: Analysis of What Patients Ask and Quality of Resources

Purpose

This study classifies common questions searched by patients from the Google search engine and categorizes the types and quality of online education resources used by patients regarding carpal tunnel syndrome (CTS) and carpal tunnel release (CTR).

Methods

Google's results were extracted and compiled using the "People also ask" function for frequent questions and associated web pages for CTS and CTR. Questions were categorized using Rothwell's classification with further topic subcategorization. Web pages were evaluated by using Journal of the American Medical Association Benchmark Criteria for source quality.

Results

Of the 600 questions evaluated, "How do I know if I have carpal tunnel or tendonitis?" and "What causes carpal tunnel to flare up?" were the most commonly investigated questions for CTS. For CTR, frequent questions investigated included "How long after hand surgery can I drive" and "How do you wipe after carpal tunnel surgery." The most common questions for CTS by Rothwell classification were policy (51%), fact (41%), and value (8%) with the highest subcategories being indications/management (46%) and technical details (27%). For CTR, the most common questions entailed fact (54%), policy (34%), and value (11%) with the highest subcategories as technical details (31%) and indications/management (26%). The most common web pages were academic and medical practice. The mean Journal of the American Medical Association score for all 600 web pages was 1.43, with journals (mean = 3.91) having the highest score and legal (mean = 0.52) and single surgeon practice websites (mean = 0.28) having the lowest scores.

Conclusions

Patients frequently inquire online about etiology, precipitating factors, diagnostic criteria, and activity restrictions regarding CTS/CTR. Overall, the quality of online resources for this topic was poor, especially from single surgeon practices and legal websites.

Clinical relevance

Understanding the type and quality of information patients are accessing assists physicians in tailoring counseling to patient concerns and facilitates informed decision-making regarding CTS/CTR as well as guiding patients to high-quality online searches.

Comparing the educational quality of free flap technique videos on public and paid platforms

BACKGROUND

Surgical videos are reshaping the landscape for surgical education. As this form of education has rapidly grown and become a valuable resource for experienced surgeons, residents, and students, there is great variability in the presentation of what is offered. This study aimed to assess and compare the educational quality of free flap instructional videos on public and paid platforms.

METHODS

Free flap videos from public (YouTube) and paid (American Society of Plastic Surgeons Education Network and Plastic and Reconstructive Surgery Journal) sources were screened independently by three reviewers. Sample size was calculated to reach 80% power. The educational quality of the videos was determined using a modified version of Laparoscopic Surgery Video Educational Guidelines (0-6 low, 7-12 medium, 13-18 high). Professionally-made videos were identified per lighting, positioning, and video/imaging quality. Interrater reliability between the three reviewers was calculated. The educational quality of the videos was compared between public and paid sources using Mood's median test. Pearson's correlation coefficient was utilized to assess the correlation between video length and educational quality.

RESULTS

Seventy-six videos were included (40 public, 36 paid). The median video lengths for public and paid platforms were 9.43(IQR = 12.33) and 5.07(IQR = 6.4) min, respectively. There were 18 high, 16 medium, and 6 low-quality public videos, versus 13 high, 21 medium, and 2 low-quality paid videos. Four public and seven paid videos were identified as professionally made. Interrater reliability was high (α = .9). No differences in educational quality were identified between public and paid platforms. Video length was not correlated with quality (p = .15). A video library compiling public high-quality videos was created (https://www.youtube.com/playlist?list=PL-d5BBgQF75VWSkbvEq6mfYI--9579oPK).

CONCLUSIONS

Public and paid platforms may provide similar surgical education on free tissue transfer. Therefore, whether to subscribe to a paid video platform for supplemental free flap education should be determined on an individual basis.

YouTube online videos as a source for patient education of cervical spondylosis-a reliability and quality analysis

BACKGROUND

Given a prolonged course of Cervical spondylosis (CS) could cause irreversible neurological deficits, it is crucial to disseminate CS-related health information to the public to promote early diagnosis and treatment. YouTube has been widely used to search for medical information. However, the reliability and quality of videos on YouTube vary greatly. Thus, this study aimed to assess the reliability and educational quality of YouTube videos concerning CS and further explore strategies for optimization of patient education.

METHODS

We searched YouTube online library for the keywords "cervical spondylosis", "cervical radiculopathy" and "cervical myelopathy" on January 15, 2023. Ranked by "relevance", the first 50 videos of each string were recorded. After exclusions, a total of 108 videos were included. All videos were extracted for characteristics and classified based on different sources or contents. Two raters independently evaluated the videos using Journal of American Medical Association (JAMA) benchmark criteria, Modified DISCERN (mDISCERN) tool, Global Quality Scale (GQS) and Cervical-Spondylosis-Specific Scale (CSSS), followed by statistical analyses. All continuous data were described as median (interquartile range).

RESULTS

All videos had median values for JAMA, mDISCERN, GQS and CSSS scores of were 3.00 (1.00), 3.00 (2.00), 2.00 (1.00) and 7.00 (8.88), respectively. There were significant differences in VPI (P = 0.009) and JAMA (P = 0.001), mDISCERN (P < 0.001), GQS (P < 0.001) and CSSS (P < 0.001) scores among different sources. Videos from academic source had advantages in reliability and quality scores than other sources. VPI (P < 0.001), mDISCERN (P = 0.001), GQS (P < 0.001) and CSSS (P = 0.001) scores also significantly differed among videos of various contents. Spearman correlation analysis indicated VPI was not correlated with either reliability or quality. Multiple linear regression analysis showed a longer duration and an academic source were independent predictors of higher reliability and quality, while a clinical source also led to the higher video quality.

CONCLUSIONS

The reliability and educational quality of current CS-related videos on YouTube are unsatisfactory. Users face a high risk of encountering inaccurate and misleading information when searching for CS on YouTube. Longer duration, source of academic or clinician were closely correlated to higher video reliability and quality. Improving the holistic reliability and quality of online information requires the concerted effort from multiple parties, including uploaders, the platform and viewers.

Rhinoplasty and YouTube: A Cross-Sectional Study to Assess the Quality, Dependability, and Reliability of Videos on Rhinoplasty

INTRODUCTION

Rhinoplasty, also referred to as a nose job or a reconstruction of the nose, is a surgical procedure that alters and reconstructs the nose for aesthetic or functional purposes. With the emergence of social media and modern internet accessibility, YouTube has gained popularity among users of all ages. Despite this, the accuracy and credibility of these videos and the information they include could be cause for concern.

AIMS

This study intends to assess the competence, quality, and dependability of the information in the videos related to "Rhinoplasty surgery" on YouTube.

METHODOLOGY

This is a cross-sectional observational study that analyzes rhinoplasty information on YouTube. A Google Forms questionnaire was used to collect the data. The Global Quality Score (GQS), reliability score, and Video Power Index (VPI) were used to assess quality and reliability, and statistical analysis was performed using IBM Corp. Released 2012. IBM SPSS Statistics for Windows, Version 21.0. Armonk, NY: IBM Corp. The inclusion criteria were videos ranging from 1 minute to 20 minutes in duration, pertinent to the topic of rhinoplasty surgery, and in either English or Hindi.

RESULTS

A total of 71 videos were analyzed, and 70 videos were included. A comparison of GQS, reliability score, and VPI based on the type of uploader was done by the Kruskal-Wallis test. The association between VPI, GQS, and reliability score with that of the uploader of the video was found to be statistically insignificant (p<0.05). Videos uploaded by healthcare organizations, news outlets, patients, or other relevant groups have the most GQS (4.5), whereas videos uploaded by hospitals have the lowest.

CONCLUSIONS

Compared to the type of uploader, videos have no statistically significant changes in quality, reliability, or video power, implying that the type of uploader does not necessarily impact the overall quality or reliability of the information presented in the investigated YouTube videos. While the majority of the videos addressed the indications of rhinoplasty and provided information about the etiology, there were gaps in discussing pre-procedural investigations and preventive measures. Due to our limitations, expanding the number of accounts used for search and increasing the number of videos might overcome the search algorithm.

YouTube as a Patient Information Source for Tendon Repair Surgery

Background For tendon rupture, a disabling musculoskeletal injury, surgical management is considered the gold standard. The goal is to reduce complications and enable the patient to regain full mobility and strength. With the rise of modern internet accessibility and social media, YouTube has become a frequently used platform for all ages; however, the accuracy and reliability of the videos and the information therein may be a point of concern. Methodology This cross-sectional, observational study was designed to analyze tendon repair surgery information available on YouTube. Data were collected using a Google Forms questionnaire which included questions analyzing the videos and their content and the professional status of the uploaders. Quality and reliability scores were assessed through the Global Quality Score (GQS), reliability score, and Video Power Index (VPI). Statistical analysis was performed using SPSS software (IBM Corp., Armonk, NY, USA). We included videos one minute to twenty minutes in length that were relevant to the topic of tendon repair surgery and in the English language. Results A total of 82 videos were evaluated, of which 67 videos were chosen. A comparison of GQS, reliability score, and VPI based on the type of uploader was done using the Kruskal-Wallis test. The association between GQS and reliability score with that of the video uploader was found to be statistically significant (p < 0.05). Videos uploaded by hospitals had the highest GQS (4) and reliability score (4). Conclusions On comparing the uploader type, videos uploaded by hospitals had good quality and were useful for patients. The quality and reliability of the videos were almost above average. Only half discussed the signs and symptoms and even fewer discussed pre- and post-procedural care. The most important aspect, i.e., prevention, was mentioned in none of the videos. Due to our limitations, expanding the number of accounts used for search and increasing the number of videos might overcome the search algorithm.

Evaluation of online video content related to reverse shoulder arthroplasty: a YouTube-based study

BACKGROUND

Reverse shoulder arthroplasty (RSA) has evolved continuously over recent years, with expanded indications and better outcomes. YouTube is one of the most popular sources globally for health-related information available to patients. Evaluating the reliability of YouTube videos concerning RSA is important to ensure proper patient education.

METHODS

YouTube was queried for the term "reverse shoulder replacement." The first 50 videos were evaluated using three different scores: Journal of the American Medical Association (JAMA) benchmark criteria, the global quality score (GQS), and the reverse shoulder arthroplasty-specific score (RSAS). Multivariate linear regression analyses were conducted to determine the presence of a relationship between video characteristics and quality scores.

RESULTS

The average number of views was 64,645.78±264,160.9 per video, and the average number of likes was 414 per video. Mean JAMA, GQS, and RSAS scores were 2.32±0.64, 2.31±0.82, and 5.53±2.43, respectively. Academic centers uploaded the highest number of videos, and surgical techniques/approach videos was the most common video content. Videos with lecture content predicted higher JAMA scores whereas videos uploaded by industry predicted lower RSAS scores.

CONCLUSIONS

Despite its massive popularity, YouTube videos provide a low quality of information on RSA. Introducing a new editorial review process or developing a new platform for patients' medical education may be necessary. Level of evidence: Not applicable.

Quality of online video resources concerning patient education for neck pain: A YouTube-based quality-control study

Background

More than 70 percent of the world's population is tortured with neck pain more than once in their vast life, of which 50-85% recur within 1-5 years of the initial episode. With medical resources affected by the epidemic, more and more people seek health-related knowledge via YouTube. This article aims to assess the quality and reliability of the medical information shared on YouTube regarding neck pain.

Methods

We searched on YouTube using the keyword "neck pain" to include the top 50 videos by relevance, then divided them into five and seven categories based on their content and source. Each video was quantitatively assessed using the Journal of American Medical Association (JAMA), DISCERN, Global Quality Score (GQS), Neck Pain-Specific Score (NPSS), and video power index (VPI). Spearman correlation analysis was used to evaluate the correlation between JAMA, GQS, DISCERN, NPSS and VPI. A multiple linear regression analysis was applied to identify video features affecting JAMA, GQS, DISCERN, and NPSS.

Results

The videos had a mean JAMA score of 2.56 (SD = 0.43), DISCERN of 2.55 (SD = 0.44), GQS of 2.86 (SD = 0.72), and NPSS of 2.90 (SD = 2.23). Classification by video upload source, non-physician videos had the greatest share at 38%, and sorted by video content, exercise training comprised 40% of the videos. Significant differences between the uploading sources were observed for VPI (P = 0.012), JAMA (P < 0.001), DISCERN (P < 0.001), GQS (P = 0.001), and NPSS (P = 0.007). Spearman correlation analysis showed that JAMA, DISCERN, GQS, and NPSS significantly correlated with each other (JAMA vs. DISCERN, p < 0.001, JAMA vs. GQS, p < 0.001, JAMA vs. NPSS, p < 0.001, DISCERN vs. GQS, p < 0.001, DISCERN vs. NPSS, p < 0.001, GQS vs. NPSS, p < 0.001). Multiple linear regression analysis suggested that a higher JAMA score, DISCERN, or GQS score were closely related to a higher probability of an academic, physician, non-physician or medical upload source (P < 0.005), and a higher NPSS score was associated with a higher probability of an academic source (P = 0.001) than of an individual upload source.

Conclusions

YouTube videos pertaining to neck pain contain low quality, low reliability, and incomplete information. Patients may be put at risk for health complications due to inaccurate, and incomplete information, particularly during the COVID-19 crisis. Academic groups should be committed to high-quality video production and promotion to YouTube users.