Evaluating the Quality of Overactive Bladder Patient Education Material on YouTube: A Pilot Study Using the Patient Education Materials Assessment Tool

A systematic review assessing the reliability of studies focusing on urological content on YouTube

INTRODUCTION

In recent years, several publications have focused on analyzing the quality of medical content on YouTube. The current systematic review aimed to summarize and analyze the available studies examining YouTube video content in the urological field.

EVIDENCE ACQUISITION

This is a systematic review including studies examining urological content uploaded on the YouTube platform published before November 2023. The following keywords were combined to capture relevant publications with a title/abstract search: ("Urology" OR "Andrology") AND ("YouTube" OR "Social media").

EVIDENCE SYNTHESIS

According to the inclusion criteria, 84 studies were included. Of all, 74 (88%) studies were published after the COVID-19 pandemic outbreak. A total of 52 (62%) studies used the DISCERN score, 29 (35%) the PEMAT A/V score, 30 (36%) the GQS, 23 (27%) the Misinformation score, 14 (17%) the Likert scale, and 13 (15%) the JAMA score. According to the conclusion, 62 (74%) studies reported poor quality results. Among all, only 10 (12%) studies respected our criteria of best quality methodology, defined as: 1) description of the research time frame; 2) use of incognito status; 3) the description of the inter-rater variability between reviewers; 4) use of at least one quality assessment tool.

CONCLUSIONS

The systematic review highlights significant variability in results and methodologies across studies on the quality analysis of urological content on YouTube. The official urological community should establish guidelines for authors, aiming to enhance the reliability and importance of such publications as valuable resources for daily clinical practice.

Content quality and reliability of the YouTube videos about chronic prostatitis

Background

YouTube is one of the most used social media platforms for accessing health information.

Objective

To evaluate the quality and reliability of YouTube videos about chronic prostatitis.

Methods

YouTube search using the keywords "kronik prostatit" for Turkish videos and 'chronic prostatitis' for English videos were done. The videos were evaluated through modified-Quality Criteria for Consumer Health Information (DISCERN), the Journal of the American Medical Association (JAMA), the Global Quality Scale (GQS), and Video Power Index (VPI) scoring systems. The characters of the videos were also recorded and analyzed.

Results

Of the 65 Turkish videos, videos of health professions (HPv) were uploaded 58 and seven videos of non-professional in health (NPv). There were no significant differences between the views, like counts, VPI, or the content quality and reliability of HPv and NPv. Of the 62 English videos, videos of HP were uploaded 40 and 22 videos of non-professional in health. Although HPv were found to have greater DISCERN and JAMA values, Lv had more views, view ratio, and Video Power Index than HPv. When all 127 videos were evaluated regardless of the language, NPv were found to have more total views and ratings, but there were no significant differences between like ratio, VPI, DISCERN, JAMA, and GQS values between the two groups.

Conclusion

Most YouTube videos about chronic prostatitis did not have enough quality and reliable information. Health associations should be more attentive to posting more content videos of sufficient quality and reliability on social media platforms.

Multilingual COVID-19 vaccination videos in NSW, Australia: a case study of cultural-responsiveness on social media

Multimodal communication via social media employed by governments as a COVID-19 communication strategy with multilingual populations hopes to alter behaviours and attitudes. However, there is presently no understanding about the responsiveness of these videos to the needs of culturally and linguistically diverse (CaLD) populations in Australia. This study aimed to analyse the cultural responsiveness of content in multilingual videos shared via a government social media page from NSW, Australia. A systematic search of videos shared between June 2021 and October 2021 was conducted. Using quantitative methods, 37 videos were analysed using a modified version of the Patient-oriented and culturally-adapted (POCA) healthcare translation model and readability indexes. Of these, 5/37 were classified as culturally responsive. The culturally responsive videos scored higher than those that were not culturally responsive. While credible sources, positive language and cultural symbols were observed in several of the videos, there was a lack of familiar experiences and economically viable vaccine uptake behaviours. Videos favoured generic examples of vaccine practices and failed to address concerns about vaccine eligibility, cost, and transport. All videos exceeded recommended readability indices for CaLD populations. Removing complex and abstract terminology and including familiar vaccine experiences could improve multilingual communication for CaLD communities.

Cross-sectional and comparative analysis of videos on erectile dysfunction treatment on YouTube and TikTok

The aim of this study was to evaluate the quality of information regarding erectile dysfunction (ED) treatment on YouTube and TikTok. The term "erectile dysfunction" was searched on YouTube and TikTok in July 2021. The first 50 videos on each platform that met inclusion were included. Videos were sorted as reliable or unreliable based on accuracy of video content. Quality of information was evaluated using Patient Education Materials Assessment Tool (PEMAT) and 5-point modified DISCERN. TikTok videos were shorter (0.4 minutes vs. 5.2 minutes, p < 0.001) and had more likes (2294 vs. 1000, p = 0.005), views per month (17,281 vs. 3521, p < 0.001) and subscribers/followers (97,500 vs. 23,000, p = 0.016) than YouTube videos. TikTok videos were less reliable than YouTube videos (TikTok 5/50 [10%] vs. YouTube 21/50 [42%], p < 0.001). YouTube mentioned more about phosphodiesterase type 5 inhibitors (32% vs. 10%, p = 0.007), while TikTok mentioned more about alternative supplements (36% vs. 4%, p < 0.001). YouTube had a higher DISCERN (1.99 vs. 0.98, p < 0.001) and PEMAT actionability scores (64.2% vs. 54.0%, p = 0.039) when compared to TikTok. YouTube videos were of higher quality than TikTok videos. Nevertheless, YouTube had a considerable amount of unreliable information. We recommend a collaborative effort from the medical community to improve information regarding ED treatment on YouTube and TikTok.

Assessing information on YouTube™ as a quality source for the treatment of varicoceles

Introduction:

YouTube™ has grown into one of the largest disseminators of health care information. We assessed the quality of information on varicoceles and their treatment, available on YouTube™.

Methods:

Using a YouTube™ search query with the keyword “varicocele,” the quality of the first 50, nonrepeat videos in English were assessed as a representative group for the topic. DISCERN and Patient Education Materials Assessment Tool for Audiovisual Materials (PEMAT-AV) standardized tools were utilized by three independent reviewers to grade the quality of these videos based on content, understandability, and actionability.

Results:

The average and median DISCERN score was 31.34 (±9.37) and 31 (interquartile range 25–35), respectively, indicating poor quality. The interrater reliability (IRR) scores ranged from 0.51 to 0.93, indicating fair to excellent reliability. The average PEMAT-AV understandability and actionability scores were 69.8% ±15.4% and 11.0% ±24.6%, respectively, indicating mostly understandable but poor actionability. The t-test results showed that international videos scored higher without statistical significance in the DISCERN or PEMAT-AV scores (P = 0.18, 0.59, and 0.20).

Conclusions:

The current quality of videos on YouTube™ on the topic of varicoceles is of poor quality due to a lack of a holistic approach in explaining the wide range of treatment options available. With the ease of access to produce and disseminate health information, there is a need to create high-quality videos on varicoceles that empower a patient to make an informed decision.

Youtube videos as an information source about urinary incontinence

AIM

Youtube is one of the most popular video-sharing websites, and people use Youtube as a source of information. Patients with urinary incontinence may seek information about their condition on Youtube. This study aims to assess the videos on Youtube about urinary incontinence and evaluate the information regarding whether patients can understand and/or act accordingly.

METHODS

We performed a Youtube search with the keywords of "incontinence," "urinary incontinence," and "overactive bladder" in the English language with the incognito mode on the browser. All links were extracted and recorded in an excel file. Duplicated links were removed, and metadata of the videos were collected. A custom python language script was used to perform this operation. We selected the most viewed 150 videos for the assessment. After removing the non-related videos, 112 of them were included in the study. Two researchers separately evaluated all the videos with the Patients Education Material Assessment Tool (PEMAT, audiovisual version).

RESULTS

The total duration of all included (n:112) videos was 12.6 hours, and these videos had been watched 37,332,178 times until the query date. The vast majority of the videos were about information, management, and treatment options (Kegel exercises, surgery modalities) of incontinence, individual experiences of patients with incontinence, commercials about the diapers, and healthcare professionals who wanted to introduce themselves or their services. Mean understandability and actionability scores of the videos were 57.9% and, 44.7% respectively. Our analysis showed that only 12.5% of the videos on Youtube related to incontinence were understandable, as well as actionable, in terms of PEMAT scores.

CONCLUSION

According to our study, 87.5% of the videos about incontinence on Youtube.com in the English language were not understandable and actionable for users. Development of high-quality content about incontinence is needed.

YouTube Videos on Parkinson's Disease are a Relevant Source of Patient Information

BACKGROUND

Parkinson's disease (PD) is the most frequent movement disorder. Patients access YouTube, one of the largest video databases in the world, to retrieve health-related information increasingly often.

OBJECTIVE

We aimed to identify high-quality publishers, so-called "channels" that can be recommended to patients. We hypothesized that the number of views and the number of uploaded videos were indicators for the quality of the information given by a video on PD.

METHODS

YouTube was searched for 8 combinations of search terms that included "Parkinson" in German. For each term, the first 100 search results were analyzed for source, date of upload, number of views, numbers of likes and dislikes, and comments. The view ratio (views / day) and the likes ratio (likes * 100 / [likes + dislikes]) were determined to calculate the video popularity index (VPI). The global quality score (GQS) and title - content consistency index (TCCI) were assessed in a subset of videos.

RESULTS

Of 800 search results, 251 videos met the inclusion criteria. The number of views or the publisher category were not indicative of higher quality video content. The number of videos uploaded by a channel was the best indicator for the quality of video content.

CONCLUSION

The quality of YouTube videos relevant for PD patients is increased in channels with a high number of videos on the topic. We identified three German channels that can be recommended to PD patients who prefer video over written content.