Attending guidance advised: educational quality of surgical videos on YouTube

A Multi-Center Randomized Study Assessing If Validated Short Videos Improve Sinus Education

OBJECTIVE

To determine if a short 10-minute video of either CT images (Video1: V1) or CT and endoscopic surgical videos (Video 2: V2) could be used to improve sinonasal anatomy knowledge in medical students (Med) and otolaryngology residents (OtoR).

BACKGROUND

YouTube is a widely used platform for surgical training, yet many educational videos are of poor quality. We developed and validated two 10-minute narrated videos of sinus anatomy, the first (V1) incorporated CT images of critical structures while the second (V2) combined CT images and surgical endoscopic video. In tandem, we developed a sinonasal assessment used to test sinonasal anatomy, surgical landmarks, and situational awareness.

METHODS

We performed a multicenter, randomized IRB-approved educational study evaluating the efficacy of the V1 and V2 videos by comparing pre-test (PrT) and post-test (PoT) scores in Med and OtoR subject groups. Subjects then watched the alternate video and preferences were assessed.

RESULTS

A total of 30 Med and 37 OtoR successfully completed the study at 6 different institutions. There were significant differences in pre-test knowledge with OtoR scoring higher than Med in all 3 pre-test subdomains [(S1: 4.3 v s2.9, P < .0001, S2: 4.4 vs 3.1, P < .0001, and S3: 4.6 vs 3.2, P < .0001)]. In the Med group, both V1 and V2 educational videos significantly improved post-test scores compared to pre-test scores (V1: 10.06 vs 12.59, P = .0005; V2: 8.23 vs 11.08, P = .0008). In the OtoR group, only the V2 educational video showed significant improvement (13.24 vs 14.76, P < .0001). Both groups thought the videos were helpful and improved their spatial awareness of sinus anatomy.

CONCLUSIONS

Short, validated videos significantly improve sinonasal education and should be incorporated in modern training programs.

The Utilisation, Application, and Quality of Videos of Clinical Interventions in Peer-Reviewed Literature: A Scoping Review

BACKGROUND

Videos of clinical interventions (VoCIs) demonstrating surgical and interventional procedures have become a mainstay in clinical practice and peer-reviewed academic literature. Despite the widespread availability of VoCI in the literature, there remain no established guidelines regarding the reporting of VoCI. We undertook a scoping review to investigate the current utilisation, application, and quality in VoCI reporting.

SUMMARY

A comprehensive literature search of Medline, Embase, Emcare, and CINAHL databases was performed to retrieve articles presenting VoCI, from January 2020 to December 2023. A customised data extraction tool assessed video characteristics (e.g., case presentation, outcomes), utility (e.g., target audience, reproducibility of procedure), and quality (subjective and objective). A total of 624 VoCIs were included (mean length 06:06), with over 62 h of VoCI reviewed. The most common VoCI perspectives were endoscopic (n = 153; 25%) and laparoscopic (n = 140; 22%). The clinical background and outcomes were described in 480 (76.9%) and 403 cases (64.6%), respectively, with disclosures (n = 23; 3.8%) rarely presented. VoCI primarily targeted trainees (n = 547; 87.7%) with most videos providing technical guidance (n = 394; 63.1%). In total, 248 videos (40%) were rated as medium or low quality on subjective assessment.

KEY MESSAGES

There are significant heterogeneity and notably poor-quality control in VoCI reporting in peer-reviewed literature resulting in the omission of critical procedural steps and suboptimal visual quality. VoCI reporting guidelines are therefore urgently required to provide a set of minimum items that should be reported by clinicians when uploading VoCI.

Current insights on social media as a tool for the dissemination of research and education in surgery: a narrative review

The purpose of our narrative review is to summarize the utilization of social media (SoMe) platforms for research communication within the field of surgery. We searched the PubMed database for articles in the last decade that discuss the utilization of SoMe in surgery and then categorized the diverse purposes of SoMe. SoMe proved to be a powerful tool for disseminating articles. Employing strategic methods like visual abstracts enhances article citation rates, the impact factor, h-index, and Altmetric score (an emerging alternative metric that comprehensively and instantly quantifies the social impact of scientific papers). SoMe also proved valuable for surgical education, with online videos shared widely for surgical training. However, it is essential to acknowledge the associated risk of inconsistency in quality. Moreover, SoMe facilitates discussion on specific topics through hashtags or closed groups and is instrumental in recruiting surgeons, with over half of general surgery residency programs in the US efficiently leveraging these platforms to attract the attention of potential candidates. Thus, there is a wealth of evidence supporting the effective use of SoMe for surgeons. In the contemporary era where SoMe is widely utilized, surgeons should be well-versed in this evidence.

For Your Eyes Only? The Use of Surgical Videos in Urological Residency Training: A European-wide Survey

Background and objective

Video-based learning may be beneficial in surgical education, both in the preparation for surgery and to evaluate surgical performance. The use of a video is not yet anchored in European urology residency programs, and it is unclear how frequently residents use videos. The purpose of this study is to investigate whether and how urology residents utilize videos to prepare for surgical procedures and evaluate their surgical performance.

Methods

We conducted a European-wide, survey-based, needs assessment among urology residents. The survey was distributed electronically among the participants in the European Urology Residents Education Program 2022 and all the members of the European Society of Residents in Urology.

Key findings and limitations

Seventy-two surveys were completed by the residents of 12 nationalities. Of the residents, 98.6% used videos in preparation, mainly for open, laparoscopic, and robotic procedures. YouTube was by far the most used source. Of the residents, 86% believed that a postsurgical video review would be helpful. In total, 39% of the residents actually had this possibility. Of them, 30% had the opportunity to do this together with a supervisor.

Conclusions and clinical implications

This study demonstrated that European urology residents often use videos to prepare surgical procedures. Considering that the majority of the respondents use YouTube as the main source of videos, this seems not to be formalized within their training. Although most residents would value a postsurgical video review, preferably together with a supervisor, the latter is not available to the majority. We recommend the use of professional, and not public, video channels and easier access to postsurgical video review.

Patient summary

Video-based learning may have an important role in surgical education. Videos often are a source of education for European urology residents to prepare for surgical procedures. Although most residents would appreciate a postsurgical video review or video-based coaching, this is not available to the majority of them.

Quality of YouTube Videos Regarding Anterior Cruciate Ligament Reconstruction Using Quadriceps Tendon Autograft Is Unsatisfactory

PURPOSE

To assess the validity and informational value of teaching material regarding anterior cruciate ligament reconstruction (ACLR) using quadriceps tendon (QT) autograft provided on the YouTube video platform.

METHODS

An extensive systematic search of the YouTube video platform was performed, and all videos that met the criteria were included in the analysis. The analysis of the video content was performed using the DISCERN instrument, Journal of American Medical Association (JAMA) benchmark criteria, and Global Quality Score (GQS). The duration of the videos, the date of publication, and the number of likes and views were recorded. Furthermore, videos were categorized based on the source (physicians, companies, patients), the subject (surgical technique, patient experience and overview [overview videos were videos in which multiple aspects were analyzed]), and the type of content (educational or subjective patient experience).

RESULTS

A total of 88 videos were included in the analysis. Seventy-one (80.7%) videos were published by physicians, 15 (17.0%) by patients, and 2 (2.3%) by companies. The majority of the videos described various surgical techniques (59%-67.0%), 80.7% of the videos (72%-81.8%) had an educational nature, and the remaining 18.2% described patient experiences. The mean length of the videos was 8.21 ± 7.88 minutes. The mean number of views was 3,988.51 ± 9,792.98 (range 9-56,047), whereas the mean numbers of comments and likes were 30.07 ± 70.07 (range 0-493) and 4.48 ± 14.22 (range 0-82), respectively. The mean DISCERN score, JAMA score, and GQS were 27.43 ±11.56 (95% confidence interval [CI] 25.01-29.85; range: 17-68), 1.22 ± 0.85 (95% CI 1.04-1.40; range 0-3), and 1.82 ± 0.93 (95% CI 1.63-2.01; range 1-4), respectively. For all scores, videos published by physicians had greater quality (DISCERN score, JAMA score, and GQS) (P < .05). Among all of the analyzed videos, overview videos were of the highest quality (P < .05).

CONCLUSIONS

YouTube is a fast and open-access source of mass information. The overall quality of the videos on ACLR performed using QT autograft was unsatisfactory, demonstrating low educational quality and reliability. Currently, YouTube cannot be recommended as a reliable source of information on ACLR with the QT.

CLINICAL RELEVANCE

Surgeons treating anterior cruciate ligament injuries should take special care when suggesting outside sources for patients to use to further educate themselves about this procedure. Due to the poor quality of the content, orthopaedic health care professionals should alert patients about the inaccuracies of YouTube videos addressing anterior cruciate ligament reconstruction with the quadriceps tendon. Additionally, health care practitioners should attempt to offer patients better options.

Adoption of routine surgical video recording: a nationwide freedom of information act request across England and Wales

Background

Surgical video contains data with significant potential to improve surgical outcome assessment, quality assurance, education, and research. Current utilisation of surgical video recording is unknown and related policies/governance structures are unclear.

Methods

A nationwide Freedom of Information (FOI) request concerning surgical video recording, technology, consent, access, and governance was sent to all acute National Health Service (NHS) trusts/boards in England/Wales between 20th February and 20th March 2023.

Findings

140/144 (97.2%) trusts/boards in England/Wales responded to the FOI request. Surgical procedures were routinely recorded in 22 trusts/boards. The median estimate of consultant surgeons routinely recording their procedures was 20%. Surgical video was stored on internal systems (n = 27), third-party products (n = 29), and both (n = 9). 32/140 (22.9%) trusts/boards ask for consent to record procedures as part of routine care. Consent for recording included non-clinical purposes in 55/140 (39.3%) trusts/boards. Policies for surgeon/patient access to surgical video were available in 48/140 (34.3%) and 32/140 (22.9%) trusts/boards, respectively. Surgical video was used for non-clinical purposes in 64/140 (45.7%) trusts/boards. Governance policies covering surgical video recording, use, and/or storage were available from 59/140 (42.1%) trusts/boards.

Interpretation

There is significant heterogeneity in surgical video recording practices in England and Wales. A minority of trusts/boards routinely record surgical procedures, with large variation in recording/storage practices indicating scope for NHS-wide coordination. Revision of surgical video consent, accessibility, and governance policies should be prioritised by trusts/boards to protect key stakeholders. Increased availability of surgical video is essential for patients and surgeons to maximally benefit from the ongoing digital transformation of surgery.

Funding

KL is supported by an NIHR Academic Clinical Fellowship and acknowledges infrastructure support for this research from the National Institute for Health Research (NIHR) Imperial Biomedical Research Centre (BRC).

Use of targeted educational resources to improve robotic bariatric surgery training

BACKGROUND

Evidence for how to best train surgical residents for robotic bariatric procedures is lacking. We developed targeted educational resources to promote progression on the robotic bariatric learning curve. This study aimed to characterize the effect of resources on resident participation in robotic bariatric procedures.

METHODS

Performance metrics from the da Vinci Surgical System were retrospectively reviewed for sleeve gastrectomy (SG) and Roux-en-Y gastric bypass (RYGB) cases involving general surgery trainees with a single robotic bariatric surgeon. Pictorial case guides and narrated operative videos were developed for these procedures and disseminated to trainees. Percent active control time (%ACT)-amount of trainee console time spent in active instrument manipulations over total active time from both consoles-was the primary outcome measure following dissemination. One-way ANOVA, Student's t-tests, and Pearson correlations were applied.

RESULTS

From September 2020 to July 2021, 50 cases (54% SG, 46% RYGB) involving 14 unique trainees (PGY1-PGY5) were included. From November 2021 to May 2022 following dissemination, 29 cases (34% SG, 66% RYGB) involving 8 unique trainees were included. Mean %ACT significantly increased across most trainee groups following resource distribution: 21% versus 38% for PGY3s (p = 0.087), 32% versus 45% for PGY4s (p = 0.0009), and 38% versus 57% for PGY5s (p = 0.0015) and remained significant when stratified by case type. Progressive trainee %ACT was not associated with total active time for SG cases before or after intervention (pre r = - 0.0019, p = 0.9; post r = - 0.039, p = 0.9). It was moderately positively associated with total active time for RYGB cases before dissemination (r = 0.46, p = 0.027) but lost this association following intervention (r = 0.16, p = 0.5).

CONCLUSION

Use of targeted educational resources promoted increases in trainee participation in robotic bariatric procedures with more time spent actively operating at the console. As educators continue to develop robotic training curricula, efforts should include high-quality resource development for other sub-specialty procedures. Future work will examine the impact of increased trainee participation on clinical and patient outcomes.

YouTube as a Source of Patient and Trainee Education in Vascular Surgery: A Systematic Review

Objective

Due to its video based approach, YouTube has become a widely accessed educational resource for patients and trainees. This systematic review characterised and evaluated the peer reviewed literature investigating YouTube as a source of patient or trainee education in vascular surgery.

Data sources

A comprehensive literature search was conducted using EMBASE, MEDLINE, and Ovid HealthStar from inception until 19 January 2023. All primary studies and conference abstracts evaluating YouTube as a source of vascular surgery education were included.

Review methods

Video educational quality was analysed across several factors, including pathology, video audience, and length.

Results

Overall, 24 studies were identified examining 3 221 videos with 123.1 hours of content and 37.1 million views. Studies primarily examined YouTube videos on diabetic foot care (7/24, 29%), peripheral arterial disease (3/24, 13%), carotid artery stenosis (3/24, 13%), varicose veins (3/24, 13%), and abdominal aortic aneurysm (2/24, 8%). Video educational quality was analysed using standardised assessment tools, author generated scoring systems, or global author reported assessment of quality. Six studies assessed videos for trainee education, while 18 studies evaluated videos for patient education. Among the 20 studies which reported on the overall quality of educational content, 10/20 studies deemed it poor, and 10/20 studies considered it fair, with 53% of studies noting poor educational quality for videos intended for patients and 40% of studies noting poor educational quality in videos intended for trainees. Poor quality videos had more views than fair quality videos (mean 27 348, 95% CI 15 154-39 543 views vs. 11 372, 95% CI 3 115-19 629 views, p = .030).

Conclusion

The overall educational quality of YouTube videos for vascular surgery patient and trainee education is suboptimal. There is significant heterogeneity in the quality assessment tools used in their evaluation. A standardised approach to online education with a consistent quality assessment tool is required to better support online patient and trainee education in vascular surgery.

Cricothyrotomy Online: Quality Assessment of Educational Videos on YouTube

BACKGROUND

Medical learners may use YouTube® videos to prepare for procedures. Videos are convenient and readily available, but without any uploading standards, their accuracy and quality for education are uncertain. We assessed the quality of emergency cricothyrotomy videos on YouTube through an expert panel of surgeons with objective quality metrics.

METHODS

A YouTube® search for "emergency cricothyrotomy" was performed and results were filtered to remove animations and lectures. The 4 most-viewed videos were sent to a panel of trauma surgeons for evaluation. An educational quality (EQ) score was generated for each video based on its ability to explain the procedure indications, orient the viewer to the patient, provide accurate narration, provide clear views of procedure, identify relevant instrumentation and anatomy, and explain critical maneuvers. Reviewers were also asked if safety concerns were present and encouraged to give feedback in a free-response field.

RESULTS

Four surgical attendings completed the survey. The median EQ score was 6 on a 7-point scale (95% CI [6, 6]). All but one of the individual parameters had a median EQ score of 6 (95% CI: indications [3, 7], orientation [5, 7], narration [6, 7], clarity [6, 7], instruments [6, 7], anatomy [6, 6], critical maneuvers [5, 6]). Safety received a lower EQ score (5.5, 95% CI [2, 6]).

CONCLUSIONS

The most-viewed cricothyrotomy videos were rated positively by surgical attendings. Still, it is necessary to know if medical learners can distinguish high from low quality videos. If not, this suggests a need for surgical societies to create high-quality videos that can be reliably and efficiently accessed on YouTube®.

Impact of Digital Health upon the Surgical Patient Experience: The Patient as Consumer

The adoption of digital health services in surgical care delivery is changing the patient experience. The goal of patient-generated health data monitoring incorporated with patient-centered education and feedback is to optimally prepare patients for surgery and personalize postoperative care to improve outcomes that matter to both patients and surgeons. Challenges include the need for the adoption of new methods for implementation and evaluation and equitable application of surgical digital health interventions, with considerations for accessibility as well as the development of new diagnostics and decision support that include the needs and characteristics of all populations served.

Generation Learning Differences in Surgery: Why They Exist, Implication, and Future Directions

The evolution of the knowledge economy and technology industry have fundamentally changed the learning environments occupied by contemporary surgical trainees and created pressures that will force the surgical community to consider. Although some learning differences are intrinsic to the generations themselves, these differences are primarily a function of the environments in which surgeons of different generations trained. Acknowledgment of the principles of connectivism and thoughtful integration of artificial intelligence and computerized decision support tools must play a central role in charting the future course of surgical education.

Evolution of the digital operating room: the place of video technology in surgery

PURPOSE

The aim of this review was to collate current evidence wherein digitalisation, through the incorporation of video technology and artificial intelligence (AI), is being applied to the practice of surgery. Applications are vast, and the literature investigating the utility of surgical video and its synergy with AI has steadily increased over the last 2 decades. This type of technology is widespread in other industries, such as autonomy in transportation and manufacturing.

METHODS

Articles were identified primarily using the PubMed and MEDLINE databases. The MeSH terms used were "surgical education", "surgical video", "video labelling", "surgery", "surgical workflow", "telementoring", "telemedicine", "machine learning", "deep learning" and "operating room". Given the breadth of the subject and the scarcity of high-level data in certain areas, a narrative synthesis was selected over a meta-analysis or systematic review to allow for a focussed discussion of the topic.

RESULTS

Three main themes were identified and analysed throughout this review, (1) the multifaceted utility of surgical video recording, (2) teleconferencing/telemedicine and (3) artificial intelligence in the operating room.

CONCLUSIONS

Evidence suggests the routine collection of intraoperative data will be beneficial in the advancement of surgery, by driving standardised, evidence-based surgical care and personalised training of future surgeons. However, many barriers stand in the way of widespread implementation, necessitating close collaboration between surgeons, data scientists, medicolegal personnel and hospital policy makers.