Citation indices for social media articles in urology

Longitudinal analysis of YouTube videos discussing post-prostatectomy erectile dysfunction

BACKGROUND

YouTube is heavily utilized by patients as an educational resource, but this content can be fraught with misinformation. We sought to characterize the quality of videos on YouTube discussing postprostatectomy erectile dysfunction and to evaluate metrics associated with retaining a top position in search results over time.

METHODS

In October 2019, we watched the first 100 YouTube videos using the search query "radical prostatectomy erectile dysfunction." Videos not relevant to the topic were excluded. Video metrics were collected, and content quality was evaluated using the DISCERN instrument. In June 2022, the search was repeated and video metrics were updated. Video characteristics were associated with search rank and the ability to remain in the top 100 spots using the Pearson correlation coefficient (r) and logistic regression, respectively.

RESULTS

We included 81 videos which amassed 529,428 views in 2019. The median total DISCERN score was 29 (IQR 21-42), which is interpreted as a poor quality video. Self-promotion or commercial bias was present in 42 videos (51.9%); false claims were present in 16 (19.8%). There was no correlation between DISCERN score and search rank (r = 0.08, p = 0.49). In 2022, 15 videos remained in the top 100 search results and had a higher median DISCERN score than videos no longer in the top 100 (46 vs. 28.5, p = 0.01). Each additional DISCERN point was associated with a 7% higher odds of remaining in the top 100 (OR 1.07, 95% CI 1.01-1.11, p = 0.003).

CONCLUSIONS

The quality of the top 100 YouTube videos discussing postprostatectomy erectile dysfunction is low. Higher quality videos had a higher odds of remaining in the top 100 search results over time but do not correlate with the order in which they are ranked.

The Use of Social Media to Increase the Impact of Health Research: Systematic Review

BACKGROUND

Academics in all disciplines increasingly use social media to share their publications on the internet, reaching out to different audiences. In the last few years, specific indicators of social media impact have been developed (eg, Altmetrics), to complement traditional bibliometric indicators (eg, citation count and h-index). In health research, it is unclear whether social media impact also translates into research impact.

OBJECTIVE

The primary aim of this study was to systematically review the literature on the impact of using social media on the dissemination of health research. The secondary aim was to assess the correlation between Altmetrics and traditional citation-based metrics.

METHODS

We conducted a systematic review to identify studies that evaluated the use of social media to disseminate research published in health-related journals. We specifically looked at studies that described experimental or correlational studies linking the use of social media with outcomes related to bibliometrics. We searched the Medical Literature Analysis and Retrieval System Online (MEDLINE), Excerpta Medica dataBASE (EMBASE), and Cumulative Index to Nursing and Allied Health Literature (CINAHL) databases using a predefined search strategy (International Prospective Register of Systematic Reviews: CRD42017057709). We conducted independent and duplicate study selection and data extraction. Given the heterogeneity of the included studies, we summarized the findings through a narrative synthesis.

RESULTS

Of a total of 18,624 retrieved citations, we included 51 studies: 7 (14%) impact studies (answering the primary aim) and 44 (86%) correlational studies (answering the secondary aim). Impact studies reported mixed results with several limitations, including the use of interventions of inappropriately low intensity and short duration. The majority of correlational studies suggested a positive association between traditional bibliometrics and social media metrics (eg, number of mentions) in health research.

CONCLUSIONS

We have identified suggestive yet inconclusive evidence on the impact of using social media to increase the number of citations in health research. Further studies with better design are needed to assess the causal link between social media impact and bibliometrics.