Instructional Video and Medical Student Surgical Knot-Tying Proficiency: Randomized Controlled Trial

Improved Learning Gain in Medical Students by Using Animated Whiteboard-Videos in Comparison to Textbooks in Surgery

BACKGROUND

Animated videos have become popular in teaching medical students, although there is a certain lack of evidence concerning its efficacy. Surgery seems to be an ideal field for its application, since animations are very helpful to understand anatomic structures and complex procedures. The aim of this study was to investigate the effects of animated videos compared to textbooks on learning gain.

METHODS

A prospective 2-arm cohort study with 5th-year medical students was conducted during their 2-week surgical training module. The initial cohort of students received textbook sections on 3 major topics in visceral surgery as learning medium (text cohort). During the following semester, the second cohort of students received 3 animated whiteboard videos (animated videos) containing equivalent content (video cohort). All participants completed a multiple-choice test consisting of 15 questions on the learning content at baseline (pre-test) and after the learning period (post-test) and answered an additional evaluation questionnaire.

RESULTS

Both cohorts were similar in their descriptive data and demonstrated significant learning gain during the 2-week learning period. The video cohort achieved better results (80% vs 73% correct answers; P = .028) and a higher learning gain (17% vs 11%; P = .034) in the post-test compared to the text cohort. The estimated learning time was longer in the video cohort (62 min vs 37 min; P < .001) and watching the videos resulted in higher learning gain (21% vs 6%; P < .001). Subgroups with higher learning gain by video learning were female gender (20% vs 11%; P = .040), native German speakers (18% vs 11%; P = .009), students without prior surgical experience (19% vs 12%; P = .033) and those undecided concerning a surgical career (22% vs 9%; P = .020). Interestingly, "low digital orientation" students benefited from videos (22% vs 13%; P = .021), whereas "high digital orientation" students did not.

CONCLUSIONS

Animated videos increase medical students' learning gain and interest in surgery.

Role of video self-assessment in laparoscopic simulation training: a randomized pilot trial

BACKGROUND

Residency programs have implemented simulation training to compensate for reduced operating room exposure. Video recording is an educational tool that can be utilized for coaching, telepresence, and self-assessment during simulation training. Data is limited on the utility of video recording and self-assessment for laparoscopic training in Ob/Gyn residency programs..

OBJECTIVE

This study aimed to determine the role of video self-assessment as an educational tool in laparoscopic simulation training and to establish the feasibility of our study design for a larger randomized controlled trial.

STUDY DESIGN

This was a prospective pilot study with a parallel, randomized, trial design that occurred in the Department of Obstetrics and Gynecology at the Mount Sinai Hospital. Subject participation took place in a surgical simulation training room. A total of 23 subjects were recruited (7 medical students, 15 residents, 1 fellow) voluntarily. All participants completed the study. All the subjects completed a pretest survey. The surgical simulation room contained a single Fundamentals of Laparoscopic Surgery box trainer and video-recording station. For session #1, each participant performed 2 Fundamentals of Laparoscopic Surgery tasks (A, peg transfer; B, intracorporeal knot tie). Participants were video recorded during session #1 and were randomized to either receive or not receive their video recording. The video group (n=13) and control group (n=10) repeated the Fundamentals of Laparoscopic Surgery tasks 7 to 10 days later (session #2). The primary outcome was percentage change in completion time between sessions. Secondary outcomes were percentage change in peg and needle drops between sessions.

RESULTS

The participant characteristics (video vs control) were as follows: average training level (6.15 vs 4.90 years), self-assessment (1=poor, 10=excellent) of surgical skill (4.8 vs 3.7), and laparoscopic skill (4.4 vs 3.5). Training level was inversely correlated with completion time for tasks A and B (r, -0.79 and -0.87; P<.0001). Less experienced trainees required the maximum time allotted for each task in session #1 (A, 3; B, 13). Regarding the primary outcome, the video group improved less than the control group (A, 16.7% vs 28.3%; B, 14.4% vs 17.3%). After controlling for training level (residents only), the video group improved more in the primary outcome (A, 17% vs 7.4%; B, 20.9% vs 16.5%) and secondary outcomes (A, 0.0% vs -194.1%; B, 41.3% vs 37.6%).

CONCLUSION

Video self-assessment has a potential role in simulation training for obstetrics-gynecology residents. With key improvements, the feasibility of our study design was demonstrated in preparation for a future definitive trial.

Undergraduate Skills Training in Pandemic Times: Where Is the Future of Medical Education?

BACKGROUND

The COVID-19 pandemic forced medical programs to rapidly switch to remote teaching from scratch, impacting hands-on skills training. This study compared the efficacy of a hybrid online format to a regular in-person session for a mandatory surgical skills class.

METHODS

Third-year undergraduate medical students attending the surgical skills class in the winter semester of 2020/21 at the Medical University of Graz were randomly assigned to either the hybrid or in-person class, depending on their course schedule and government regulations. The hybrid class involved online videos, one-on-one peer tutoring, and an Objective Structured Clinical Examination (OSCE). Pre- and post-class self-assessments were conducted to evaluate their theoretical and practical knowledge of a single interrupted suture.

RESULTS

The study included 85 students in the regular in-person class and 50 in the hybrid class. A pre-class assessment revealed higher self-assessments in the hybrid class for theoretical and practical knowledge, but a post-class assessment showed no significant difference. The advantages and disadvantages of both modalities were identified, providing valuable insights for future curriculum development.

CONCLUSIONS

Both teaching modes were effective for undergraduate surgical skills training. This study recommends implementing positive aspects of both the hybrid and in-person formats while recognizing their respective limitations.

Is Online Video-Based Education an Effective Method to Teach Basic Surgical Skills to Students and Surgical Trainees? A Systematic Review and Meta-analysis

BACKGROUND

Online education has been increasingly utilized over the past decades. The COVID-19 pandemic accelerated the transition of conventional face-to-face curricula to online platforms, with limited evidence for its teaching efficacy. This systematic review aims to assess the effectiveness of online video-based education compared with standard conventional education in teaching basic surgical skills to surgical trainees and students undergoing medical training.

METHODS

We performed a literature search in Embase, Medline, Cochrane CENTRAL and Scopus from inception until February 2022. Studies included were randomised controlled trials (RCTs) and observational studies. We included randomised controlled trials only for meta-analysis. The primary outcome was surgical skill proficiency. The secondary outcomes were participant perception, confidence and satisfaction. Two authors independently assessed the search results for eligibility, extracted the data and assessed the risk of bias using the Cochrane Risk of Bias tool 2. Where appropriate, we performed random effects meta-analyses of the pooled study data to calculate a standardized mean difference.

RESULTS

A total of 11 studies met the inclusion criteria totaling 715 participants; 603 were included in qualitative analysis and 380 in meta-analysis. All included studies were assessed as having a low risk of bias. The majority of studies found no significant difference between conventional and video-based education in teaching basic surgical skills, three studies found video-based education was superior and one study found conventional education was superior. There was no statistically significant difference in skill proficiency between the two groups (standardized mean difference of -0.02 (95% CI: -0.34, 0.30); p=0.90). Video-based education results in an equivalent improvement in confidence and satisfaction rates. Additional benefits of video-based education include convenience, accessibility and efficiency.

CONCLUSIONS

Basic surgical skills can be taught as effectively through online video-based education as conventional teaching methods. Online education should be utilized as an adjunct to medical curricula beyond the COVID-19 era.

Using a 360° Virtual Reality or 2D Video to Learn History Taking and Physical Examination Skills for Undergraduate Medical Students: Pilot Randomized Controlled Trial

BACKGROUND

Learning through a 360° virtual reality (VR) or 2D video represents an alternative way to learn a complex medical education task. However, there is currently no consensus on how best to assess the effects of different learning materials on cognitive load estimates, heart rate variability (HRV), outcomes, and experience in learning history taking and physical examination (H&P) skills.

OBJECTIVE

The aim of this study was to investigate how learning materials (ie, VR or 2D video) impact learning outcomes and experience through changes in cognitive load estimates and HRV for learning H&P skills.

METHODS

This pilot system-design study included 32 undergraduate medical students at an academic teaching hospital. The students were randomly assigned, with a 1:1 allocation, to a 360° VR video group or a 2D video group, matched by age, sex, and cognitive style. The contents of both videos were different with regard to visual angle and self-determination. Learning outcomes were evaluated using the Milestone reporting form. Subjective and objective cognitive loads were estimated using the Paas Cognitive Load Scale, the National Aeronautics and Space Administration Task Load Index, and secondary-task reaction time. Cardiac autonomic function was assessed using HRV measurements. Learning experience was assessed using the AttrakDiff2 questionnaire and qualitative feedback. Statistical significance was accepted at a two-sided P value of <.01.

RESULTS

All 32 participants received the intended intervention. The sample consisted of 20 (63%) males and 12 (38%) females, with a median age of 24 (IQR 23-25) years. The 360° VR video group seemed to have a higher Milestone level than the 2D video group (P=.04). The reaction time at the 10th minute in the 360° VR video group was significantly higher than that in the 2D video group (P<.001). Multiple logistic regression models of the overall cohort showed that the 360° VR video module was independently and positively associated with a reaction time at the 10th minute of ≥3.6 seconds (exp B=18.8, 95% CI 3.2-110.8; P=.001) and a Milestone level of ≥3 (exp B=15.0, 95% CI 2.3-99.6; P=.005). However, a reaction time at the 10th minute of ≥3.6 seconds was not related to a Milestone level of ≥3. A low-frequency to high-frequency ratio between the 5th and 10th minute of ≥1.43 seemed to be inversely associated with a hedonic stimulation score of ≥2.0 (exp B=0.14, 95% CI 0.03-0.68; P=.015) after adjusting for video module. The main qualitative feedback indicated that the 360° VR video module was fun but caused mild dizziness, whereas the 2D video module was easy to follow but tedious.

CONCLUSIONS

Our preliminary results showed that 360° VR video learning may be associated with a better Milestone level than 2D video learning, and that this did not seem to be related to cognitive load estimates or HRV indexes in the novice learners. Of note, an increase in sympathovagal balance may have been associated with a lower hedonic stimulation score, which may have met the learners' needs and prompted learning through the different video modules.

TRIAL REGISTRATION

ClinicalTrials.gov NCT03501641; https://clinicaltrials.gov/ct2/show/NCT03501641.

Knowledge Retention of the NIH Stroke Scale among Stroke Unit Health Care Workers Using Video vs. E-Learning: Protocol for a Web-Based, Randomized Controlled Trial

The National Institutes of Health Stroke Scale (NIHSS) is commonly used to triage and monitor the evolution of stroke victims. Data regarding NIHSS knowledge in nurses and physicians working with stroke patients are scarce, and a progressive decline in specific knowledge regarding this challenging scale is to be expected even among NIHSS certified personnel. This protocol was designed according to the CONSORT-eHealth (Consolidated Standards of Reporting Trials) guidelines. It describes the design of a randomized controlled trial whose primary objective is to determine if nurses and physicians who work in stroke units improve their NIHSS knowledge more significantly after following a highly interactive e-learning module than after following the traditional didactic video. Univariate and multivariable linear regression will be used to analyze the primary outcome, which will be the difference between the score on a 50-question quiz answered before and immediately after following the allocated learning material. Secondary outcomes will include knowledge retention at one month, assessed using the same 50-question quiz, user satisfaction, user course duration perception, and probability of recommending the allocated learning method. The study is scheduled to begin during the first semester of 2022.

Video-Based Guided Simulation without Peer or Expert Feedback is Not Enough: A Randomized Controlled Trial of Simulation-Based Training for Medical Students

BACKGROUND

Feedback is a pivotal cornerstone and a challenge in psychomotor training. There are different teaching methodologies; however, some may be less effective.

METHODS

A prospective randomized controlled trial was conducted in 130 medical students to compare the effectiveness of the video-guided learning (VLG), peer-feedback (PFG) and the expert feedback (EFG) for teaching suturing skills. The program lasted 4 weeks. Students were recorded making 3-simple stitches (pre-assessment and post-assessment). The primary outcome was a global scale (OSATS). The secondary outcomes were performance time, specific rating scale (SRS) and the impact of the intervention (IOI), defined as the variation between the final and initial OSATS and SRS scores.

RESULTS

No significant differences were found between PFG and EFG in post-assessment results of OSATS, SRS scores or in the IOI for OSATS and SRS scores. Post-assessment results of PFG and EFG were significantly superior to VLG in OSATS and SRS scores [(19.8 (18.5-21); 16.6 (15.5-17.5)) and (20.3 (19.88-21); 16.8 (16-17.5)) vs (15.7 (15-16); 13.3 (12.5-14)) (p < 0.05)], respectively. The results of PFG and EFG were significantly superior to VLG in the IOI for OSATS [7 (4.5-9) and 7.4 (4.88-10) vs 3.5 (1.5-6) (p < 0.05)] and SRS scores [5.4 (3.5-7) and 6.3 (4-8.5) vs 3.1 (1.13-4.88) (p < 0.05)], respectively.

CONCLUSION

The video-guided learning methodology without any kind of feedback is not enough for teaching suturing skills compared to expert or peer feedback. The peer feedback methodology appears to be a viable alternative to handling the emerging demands in medical education.

Video-based coaching in surgical education: a systematic review and meta-analysis

BACKGROUND

In the era of competency-based surgical education, VBC has gained increased attention and may enhance the efficacy of surgical education. The objective of this systematic review was to summarize the existing evidence of video-based coaching (VBC) and compare VBC to traditional master-apprentice-based surgical education.

METHODS

We performed a systematic review and meta-analysis of randomized controlled trials (RCT) assessing VBC according to the PRISMA and Cochrane guidelines. The MEDLINE, EMBASE, and COCHRANE and Researchgate databases were searched for eligible manuscripts. Standard mean difference (SMD) of performance scoring scales was used to assess the effect of VBC versus traditional training without VBC (control).

RESULTS

Of 627 studies identified, 24 RCTs were eligible and evaluated. The studies included 778 surgical trainees (n = 386 VBC vs. n = 392 control). 13 performance scoring scales were used to assess technical competence; OSATS-GRS was the most common (n = 15). VBC was provided preoperative (n = 11), intraoperative (n = 1), postoperative (n = 10), and perioperative (n = 2). The majority of studies were unstructured, where identified coaching frameworks were PRACTICE (n = 1), GROW (n = 2) and Wisconsin Coaching Framework (n = 1). There was an effect on performance scoring scales in favor of VBC coaching (SMD 0.87, p < 0.001). In subgroup analyses, the residents had a larger relative effect (SMD 1.13; 0.61-1.65, p < 0.001) of VBC compared to medical students (SMD 0.43, 0.06-0.81, p < 0.001). The greatest source of potential bias was absence of blinding of the participants and personnel (n = 20).

CONCLUSION

Video-based coaching increases technical performance of medical students and surgical residents. There exist significant study and intervention heterogeneity that warrants further exploration, showing the need to structure and standardize video-based coaching tools.

Exploring Care Providers' Perceptions and Current Use of Telehealth Technology at Work, in Daily Life, and in Education: Qualitative and Quantitative Study

BACKGROUND

A telehealth technology education curriculum designed to integrate information technology and telecommunication well has great potential to prepare care providers for health care delivery across space, time, and social and cultural barriers. It is important to assess the readiness level of care providers to use and maximize the benefits of telehealth technology in the health care delivery process. Therefore, this study explored care providers' existing experience using technology in various use contexts and compared their familiarity with telehealth technology's relevant features.

OBJECTIVE

This study's objective was to explore care providers' familiarity with using technology in different settings and their perceptions of telehealth-driven care performance to lay a foundation for the design of an effective telehealth education program.

METHODS

The study used quantitative and qualitative analyses. The online survey included four items that measured care providers' perceptions of care performance when using telehealth technology. Advanced practice registered nurse students rated each item on a 7-point Likert scale, ranging from 1 ("strongly disagree") to 7 ("strongly agree"). They also responded to three open-ended questions about what kinds of health information technology they use at work, after work, and in their current educational program.

RESULTS

A total of 109 advanced practice registered nurse students responded to the online survey and open-ended questionnaire. Most indicated that using telehealth technology enhances care performance (mean 5.67, median 6.0, SD 1.36), helps make their care tasks more effective (mean 5.73, median 6.0, SD 1.30), improves the quality of performing care tasks (mean 5.71, median 6.0, SD 1.30), and decreases error in communicating and sharing information with others (mean 5.35, median 6.0, SD 1.53). In addition, our qualitative analyses revealed that the students used the electronic health records technology primarily at work, combined with clinical decision support tools for medication and treatment management. Outside work, they primarily used video-text communication tools and were exposed to some telehealth technology in their education setting. Further, they believe that use of nonhealth technology helps them use health information technology to access health information, confirm their diagnoses, and ensure patient safety.

CONCLUSIONS

This research highlights the importance of identifying care providers' existing experience of using technology to better design a telehealth technology education program. By focusing explicitly on the characteristics of care providers' existing technology use in work, nonwork, and educational settings, we found a potential consistency between practice and education programs in care providers' requirements for technology use, as well as areas of focus to complement their frequent use of nonhealth technologies that resemble telehealth technology. Health policymakers and practitioners need to provide compatible telehealth education programs tailored to the level of care providers' technological familiarity in both their work and nonwork environments.

Developing a five-step training model for transperineal prostate biopsies in a naïve residents' group: a prospective observational randomised study of two different techniques

PURPOSE

To evaluate a five-step training model for transperineal prostate biopsies (TPPB) and the differences in terms of the detection rate (DR) and the ease of execution when using either the "fan technique" (FT) or the use of a Free Hand technique (FH).

METHODS

A prospective observational randomised study was conducted from September 2015 to November 2017. Six naïve residents, who underwent the same five-steps training model, were randomly subdivided into two different groups of three residents based on the selected TPPB technique: A (FT) and B (FH). Patient characteristics (age, PSA, prostatic volume, DRE, MRI), intraoperative (operative time, number of samples) and postoperative parameters (histologic, pain) were evaluated in the 2 groups. The overall and stratified DR for PSA ranges and prostate volume (PV), operative time and complications were compared.

RESULTS

The overall detection rate was very high in both groups (FT 58.2% vs FH 59.6%) and not statistically different between the two techniques. There were no differences in terms of complication rates and pain. The FH showed a better detection rate in prostates smaller than 40 cc (p = 0.023) and a faster operative time (p = 0.025) compared to FT.

CONCLUSIONS

Within the TPPB, FH is associated with a higher detection rate in patients with prostate < 40 cc compared to an FT when performed by inexperienced trainees. Standardised training organised in consecutive steps seems to contribute to the achievement of overall high detection rates with both methods.