The educational quality of the critical view of safety in videos on youtube® versus specialized platforms: which is better? Critical view of safety in virtual resources

Quality evolution of laparoscopic cholecystectomy videos over two decades: a comparative study of YouTube and WebSurg

BACKGROUND

Laparoscopic cholecystectomy is one of the most commonly performed surgeries worldwide. With the rise of online platforms like YouTube and WebSurg, surgical videos have become popular educational tools. However, the quality of these videos varies, raising concerns about their reliability. This study evaluates the changes in the quality of laparoscopic cholecystectomy videos over two decades and compares the educational value of YouTube and WebSurg videos.

METHODS

Twenty-four videos were analyzed and divided into four groups: older YouTube, older WebSurg, newer YouTube, and newer WebSurg. Six videos from each group were selected based on relevance and popularity. Three independent surgeons assessed them using standardized scoring systems, including the JAMA Benchmark Score, Global Quality Score (GQS), LAP-VEGaS, and a new Laparoscopic Cholecystectomy-Specific Score (LAP Chole-SS). Video characteristics such as duration, uploader type, and viewer engagement were also considered. Statistical comparisons were made between the groups.

RESULTS

The analysis showed that although newer videos were longer, the difference was not statistically significant (P = 0.74). Newer videos had significantly better image quality (P < 0.001). WebSurg videos consistently outperformed YouTube videos across all evaluation criteria. WebSurg scored higher in the JAMA Benchmark (2.62 versus 1.66), GQS (3.58 versus 2.63), LAP-VEGaS (13.7 versus 6.58), and LAP Chole-SS (4.08 versus 2.33).

CONCLUSION

In conclusion, WebSurg provides higher-quality, peer-reviewed content, making it more reliable for surgical education, while YouTube offers accessibility but often lacks educational rigor.

Comparison of Educational and Academic Quality of Laparoscopic Distal Pancreatectomy Videos on WebSurg® and YouTube® Platforms

BACKGROUND

The aim of this study was to compare the educational and academic quality of laparoscopic distal pancreatectomy (LDP) videos on YouTube® and WebSurg® platforms.

MATERIAL AND METHODS

YouTube and WebSurg platforms were searched with the keyword "laparoscopic distal pancreatectomy". According to the exclusion criteria, 12 videos were found on WebSurg. To ensure a 1:1 ratio, the first 12 videos that met the criteria on YouTube were also analyzed. Journal of American Medical Association (JAMA) benchmark criteria were used to evaluate the reliability of the videos. The non-educational quality of the videos was calculated using the Global Quality Score (GQS), the educational and academic quality of videos was calculated using Laparoscopic Distal Pancreatectomy-specific score (LDP-SS) and Laparoscopic Surgery Video Educational Guidelines scoring system (LAP-VEGaS).

RESULTS

The mean JAMA score was 1.58 on YouTube and 2.83 on WebSurg (P < .001). The median GQS was 2 on YouTube and 5 on WebSurg (P < .001). The median LAP-VEGaS score was 8 on YouTube and 14.5 on WebSurg (P < .001). The median LDP-SS score was 6 on YouTube and 9.5 on WebSurg (P = .001). According to the LAP-VEGaS, eleven (91.7%) of the WebSurg videos had a high score of 11 or more (P = .04). According to Spearman correlation analysis, there was a statistically significant positive correlation between LDP-SS and JAMA, GQS and LAP-VEGaS (r: .589, P = .002; r: .648, P = .001; r: .848, P < .001 respectively).

CONCLUSIONS

The WebSurg is superior to the YouTube in terms of educational and academic value, quality, accuracy, reliability and usability in scientific meetings for LDP videos.

[The clinical importance of the critical view of safety in laparoscopic cholecystectomy]

BACKGROUND

Injury of the bile duct during cholecystectomy (CHE) is a severe complication. The critical view of safety (CVS) can help to reduce the frequency of this complication during laparoscopic CHE. So far, no scoring of CVS images with a grading system is available.

METHOD

The CVS images of 534 patients with laparoscopic CHE could be structurally analyzed and assessed with marks from 1 (very good) to 5 (insufficient). The CVS mark was correlated with the perioperative course. Additionally, the perioperative course of patients after laparoscopic CHE with and without a CVS image was investigated.

RESULTS

In 534 patients 1 or more CVS images could be analyzed. The average CVS mark was 1.9, whereby 280 patients (52.4%) had a 1, 126 patients (23.6%) a 2, 114 (21.3%) a 3 and 14 patients (2.6%) a 4 or 5. Younger patients with elective laparoscopic CHE had CVS images significantly more frequently (p ≤ 0.04). The statistical examination with Pearson's χ2-test and the F‑test (ANOVA) showed a significant correlation between improving CVS marks and reduction of surgery time (p < 0.01) and the hospitalization time (p < 0.01). For senior physicians the quota of CVS images ranged from 71% to 92% and the average marks from 1.5 to 2.2. The marks for the CVS images were significantly better for female than male patients (1.8 vs. 2.1, p < 0.01).

DISCUSSION

There was a relatively broad distribution of marks for CVS images. Injuries of the bile duct can be avoided with a high degree of certainty with marks 1‑2 for the CVS image. The CVS is not always adequately visualized in laparoscopic CHE.

Does livestreaming surgical education have the future? Development and participant evaluation of a national COVID-19 livestreaming initiative

Backgrounds

COVID-19 related reduction of surgical procedures jeopardizes learning on the job of surgical residents. Many educators resorted to digital resources in the search for alternatives. However, these resources are often limited to the extent they offer resident-surgeon interaction like a joint surgical performance does. Here we present a roadmap of livestreaming surgical procedures, and evaluate how surgical livestreams on human cadavers address the unmet educational needs of surgical residents in our Dutch nationwide initiative.

Methods

Technical and organizational feasibility, and definition of outcome deliverables for the livestream series and per livestream were essential in livestream development. Faculty selected interventions, lecture contents, and participant preparations. Appropriate location, technical setup, and support were imperative for a stable, high-quality stream with integrated interaction, while maintaining digital privacy. A survey was sent to livestream participants to evaluate each livestream, and allow for constant improvement during the broadcasting of the series. Only surveys which were completed by surgical residents were included in the analysis of this study.

Results

Each livestream attracted 139–347 unique viewers and a total of 307 surveys were completed by participants (response rate of 23–38% per livestream). Sixty percent of surveys (n = 185) were completed by surgical residents. Livestreams were highly valued (appreciation 7.7 ± 1.1 and recommendation 8.6 ± 1.1), especially the live procedures combined with interaction and theoretical backgrounds. Criticized were technical difficulties and timing of the livestreams between 5 and 7 pm, which interfered with clinical duties.

Conclusion

Livestreaming surgical procedures on human cadavers is a valid and valued solution to augment resident education. Digital privacy and a stable, high-quality interactive stream are essential, as are appropriate moderation and relevant lectures. While livestreaming cannot replace hands-on training in the operating room, it enables surgeon-resident interaction which is key in education—and missed in pre-recorded surgical procedures which are currently available online.

The reliability of trabeculectomy surgical videos on the internet for educational purposes in the changing world

BACKGROUND AND PURPOSE OF THE STUDY

The use of social media that facilitates access to surgical training is increasing among general practitioners/surgeons. The present study aimed to evaluate the educational quality of videos on social media and the medical education websites in terms of trabeculectomy surgery.

METHODS

In this cross-sectional and register-based study, the term "trabeculectomy" has been searched on 22 websites containing medical surgery training videos. Demographical features and descriptive statistics of videos are noted. All videos were evaluated independently by two ophthalmologists according to DISCERN, Journal of American Medical Association, and Global Quality scoring system. The main 11 steps of trabeculectomy surgery were taken into consideration in each video and Video Quality Score was determined based on these steps.

THE MAIN FINDINGS

In total, 731 videos were watched and 634 were excluded and 97 videos were included in the study. The total quality of all videos according to DISCERN, JAMA, GQS, and VQS scores were 31.6 ± 9.1 (poor quality), 1.3 ± 0.4 (poor quality), 2.6 ± 0.9 (fair quality), and 6.9 ± 2.1 (poor quality) respectively. Only 6 of the 97 evaluated videos included all the steps of trabeculectomy surgery. Videos have longer duration, videos with narration or videos with descriptive subtitles were found to be significantly higher quality than those are not.

CONCLUSSION

The educational quality of internet videos may be far from the quality it should be and it is indisputable that it is necessary to be able to access surgical educational videos that are peer-viewed and whose quality is not doubted.

Are YouTube Videos a Reliable Training Method for Safe Laparoscopic Cholecystectomy? A Simulated Decision-Making Exercise to Assess the Critical View of Safety

Background  The present study assesses the educational value of laparoscopic cholecystectomy videos on YouTube regarding the correct application of the critical view of safety (CVS), and evaluates… surgical trainees' perceptions of the CVS criteria in a simulated, operative decision-making exercise.

Methods  YouTube was systematically searched for laparoscopic cholecystectomy videos, explicitly reporting a satisfactory CVS. The top 30 most popular videos, by number of views, were identified and scored on the 6-point scale by three experienced consultants. After watching a training module on CVS rationale and criteria, 10 trainees, blinded to the consultants' assessment, were instructed to view the videos, score each criterion and answer the binary question “Would you divide the cystic structures?” by “yes” or “no.”

Results  An inadequate CVS was found in 30% of the included videos. No statistical association was noted between number of views, likes, or dislikes with successful CVS rates. Inter-observer agreement between consultants and trainees ranged from minimal to moderate ( k  = 0.07–0.60). Discrepancy between trainees' CVS scores and their simulated decision to proceed to division of the cystic structures was found in 15% of assessments, with intra-observer agreement ranging from minimal to excellent ( k  = 0.27–1.0). For the CVS requirements, inter-observer agreement was minimal for the dissection of the cystic plate ( k  = 0.26) and triangle clearance ( k  = 0.39) and moderate for the identification of two and only two structures ( k  = 0.42).

Conclusion  The CVS is central to the culture of safety in laparoscopic cholecystectomy. Surgical videos are a useful training tool as simulated, operative decision-making exercises. However, public video platforms should be used judiciously, since their content is not peer-reviewed or quality-controlled.

Assessment of the Educational Quality, Accuracy, and Transparency of WebSurg Videos on Minimally Invasive Video-Assisted Parathyroidectomy

Background

The internet has changed the way both physicians and patients search for health information. WebSurg® is a valuable source of information that informs surgeons about new technologies and techniques and aims to promote quality, safety, and patient-centered care. In this study, our aim is to evaluate the popularity, quality, transparency, and accuracy of videos about minimally invasive video-assisted parathyroidectomy (MIVAP).

Materials and methods

A total of 31 videos related to MIVAP returned by the WebSurg® search engine in response to the keywords “MIVAP”, “video assisted parathyroidectomy’’, and “minimally invasive parathyroidectomy’’ were included in this study. Videos were evaluated in terms of time since upload, run time, country, academic degree, and the number of views and likes. The popularity of videos was determined by the video power index (VPI) formula. The DISCERN questionnaire score (DISCERNqs), global quality score (GQSc), and Journal of American Medical Association benchmark criteria (JAMABC) scoring systems were used to analyze WebSurg® videos for reliability and quality.

Results

The academic degree of the members was MD in 90.32% of uploaded videos. Forty-eight point thirty-eight percent (48.38%) of the videos were uploaded by members from France. There was no significant difference between the DISCERNqs, JAMABC, GQSc, and MIVAP scoring system (MIVAP-SS) scores in terms of academic degree and country. A statistically significant negative correlation was found between the time since upload and the VPI score (r=-0.683, p<0.001). The run time was positively correlated with the DISCERNqs, JAMABC, GQSc, and MIVAP-SS scores (p=0.003, p=0.002, p=0.003, p<0.001, respectively). For the MIVAP-SS score, the Spearman correlation analysis demonstrated a statistically significant positive correlation with VPI, DISCERNqs, JAMABC, and GQSc (p<0.05).

Conclusion

Videos about MIVAP are helpful for surgeons to learn the procedure step-by-step before the surgery they will be performing but still below the expected quality. It is recommended to use MIVAP-SS points, which is a novel scoring system, to ensure standardization and improve quality.