A serious game skills competition increases voluntary usage and proficiency of a virtual reality laparoscopic simulator during first-year surgical residents' simulation curriculum

Gamification to enhance clinical and technical skills in surgical residency: A systematic review

OBJECTIVE

Gamification has emerged as an adjunct to traditional teaching methods, however, literature on its application in surgical education is limited. We sought to explore the prevalence and impact of gamification techniques among surgical trainees.

DESIGN

A systematic review was performed to identify studies using gamification in surgical training, where gamification was defined as the use of game elements to foster competition.

PARTICIPANTS

Surgical residents.

RESULTS

Twenty-two studies, including 1283 participants, described the use of gamification in surgical education. Thirteen studies focused on knowledge-based games and ten on technical skills. Gamification was associated with improvements in technical performance, knowledge acquisition, and overall engagement among surgical trainees. Additionally, satisfaction surveys indicated a positive reception of gamification as an educational tool.

CONCLUSIONS

Gamification presents a promising approach to enhancing the performance of surgical trainees in an engaging learning environment.

The PLET (Portable Laparoscopic Endo-Trainer) study: a randomized controlled trial of home- versus hospital-based surgical training

PURPOSE

The purpose of this study was to assess the effect of training with a personal, portable laparoscopic endo-trainer (PLET) on residents' laparoscopic skills.

METHODS

The study took place at a tertiary-care academic university hospital in Switzerland. All participants were randomized to either a home- or hospital-based PLET training group, and surgical skill performance was assessed using five laparoscopic exercises. 24 surgical residents, 13 females and 11 males, were enrolled at any training stage. Nine residents completed the assessments. Endpoints consisted of subjective and objective assessment ratings as well as exercise time and qualitative data up to 12 weeks. The primary outcome was the difference in exercise time and secondary outcomes included performance scores as well as qualitative data.

RESULTS

The hospital-based training group performed exercises number 1, 3 and 4 faster at 12 weeks than at baseline (p = .003, < 0.001 and 0.024). Surgical skill performance was not statistically significantly different in any of the endpoints between the hospital- and home-based training groups at 12 weeks. Both the subjective and objective assessment ratings significantly improved in the hospital-based training group between baseline and 12 weeks (p = .006 and 0.003, respectively). There was no statistically significant improvement in exercise time as well as subjective and objective assessment ratings over time in the home-based training group. The qualitative data suggested that participants who were randomized to the hospital-based training group wished to have the PLET at home and vice versa. Several participants across groups lacked motivation because of their workload or time constraints, though most believed the COVID-19 pandemic had no influence on their motivation or the time they had for training.

CONCLUSION

The PLET enhances laparoscopic surgical skills over time in a hospital-based training setting. In order to understand and optimize motivational factors, further research is needed.

TRIAL REGISTRATION

This trial was retrospectively registered on clinicaltrials.gov (NCT06301230).

Perceptions of Competition-Based Learning After a Brief Experience at a National Surgical Meeting

BACKGROUND

Competition-based learning (CBL) facilitates learning through competitions. At the 2022 & 2023 Annual SAGES meetings, we evaluated a CBL experience (TOP GUN Shootout) developed from a modified version of the previously validated TOP GUN Laparoscopic Skills and Suturing Program. The project sought to evaluate the TOP GUN Shootout's (TGS) ability to enhance participant engagement in pursuit of laparoscopic surgical skills.

METHODS

Participants competed in the TGS. Their scores (time and errors) were recorded for: Fundamentals of Laparoscopic Surgery Peg Pass, Cup Drop Task, and Intracorporeal Suturing. All participants completed a 10-question satisfaction survey on a 7-point Likert scale, with questions assessing 3 domains: (1) capability/confidence in MIS skill performance prior to the competition; (2) applicability and satisfaction with TGS's capacity to develop MIS skills; and (3) interest in seeking additional MIS training and appropriateness of CBL in MIS training. Descriptive statistics were used to evaluate these areas.

RESULTS

Overall, 121 participants completed the TGS, of whom 84 (69%) completed the satisfaction survey. The average age was 32.9 years, 67% were males. On average (+/- SD), participant satisfaction was 5.04 (+/- 2.08) for Domain 1, 6.20 (+/- 1.28) for Domain 2, and 6.58 (+/- .95) for Domain 3.

CONCLUSION

Participants described an overall lack of confidence in their MIS skills prior to the 2022-2023 Annual SAGES conference. Participants felt that this brief CBL experience, aided in the development of their MIS skills. Furthermore, this brief CBL experience may inspire learners to seek out further training of their MIS skills.

Association of a Gamified Journal Club on Internal Medicine Residents' Engagement and Critical Appraisal Skills

Background

Prior literature demonstrates internal medicine residents have suboptimal competence in critical appraisal. Journal clubs are a common intervention to address this skill, but engagement and critical appraisal skill improvement are variable.

Objective

We evaluated journal club engagement and critical appraisal skills after implementation of a gamified format.

Methods

This was a single-arm study, conducted from July 1, 2020 to June 30, 2021, involving internal medicine residents at 2 US programs. Residents participated in a 12-month gamified journal club that sorted residents into 2 teams. Residents attended an orientation followed by 6 to 10 monthly, hour-long competitions. In each competition, a subset of the resident teams competed to answer a clinical prompt by critically appraising an original article of their choice. A chief medical resident or faculty member moderated each session and chose the winning team, which received a nominal prize of candy. The primary outcome was engagement, measured by a 7-question survey developed de novo by the authors with Likert scale responses at baseline and 12 months. The secondary outcome was critical appraisal skills assessed by the Berlin Questionnaire.

Results

Sixty-one of 72 eligible residents (84.7%) completed both engagement surveys. Residents reported statistically significant improvements in most dimensions of engagement, including a higher likelihood of reading articles before sessions (posttest minus pretest score -1.08; 95% CI -1.34 to -0.82; P<.001) and valuing time spent (posttest minus pretest score -0.33; 95% CI -0.55 to -0.11; P=.004). Critical appraisal skills marginally improved at 12 months (posttest minus pretest score -0.84; 95% CI -1.54 to -0.14; P=.02).

Conclusions

Our study demonstrates a gamified journal club was associated with improvements in engagement and minimal change in critical appraisal skills.

Gamification in otolaryngology: A narrative review

INTRODUCTION

The medical field has incorporated gamification elements into education platforms over the past decade. The standard definition for gamification that has been adopted by most research studies is the addition of game elements and game mechanics within a platform to enhance user engagement. In this review, seven established, consolidated components, as well as an additional new or novel component, will be evaluated: a point system/leaderboards, question banks or gradable content, social interaction with other participants, leaderboards, progress or levels, immediate feedback, badges/icons or a reward system, and the novel component, a story line.

METHODS

Two reviewers searched MEDLINE, Cochrane, PsycINFO, Web of Knowledge, and the Nursing Registry. This review compares the one identified otolaryngology study with current residency education gamification practices within the medical field.The authors searched "residency AND gamification", "residency AND video games", and "residency AND games". After applying exclusion criteria, the 13 remaining studies included a procedure, questions/scenarios, and at least three gamification elements.

RESULTS

Across the 13 studies, the average number of included gamification elements was higher than the minimum threshold of three (3.84). Ten of the studies incorporated leaderboards, feedback, and social interaction; eight incorporated a question bank; and four incorporated progress bars, rewards, and story lines. The otolaryngology study incorporated four of the gamification components: a point system, instant feedback/solution after a question was answered, player-to-player communication, and a leaderboard.

CONCLUSION

Review of the current literature found that the medical field has limited research regarding the use of gamification in educational platforms. Despite many simulation studies and attempts at gamification, the medical community has not fully embraced gamification within residency education. In closing, the medical education community should establish a definition of "gamification" and survey residency programs to identify desired gamification elements.

Effects of Gamification on the Benefits of Student Response Systems in Learning of Human Anatomy: Three Experimental Studies

This paper presents three experiments to assess the impact of gamifying an audience response system on the perceptions and educational performance of students. An audience response system called SIDRA (Immediate Audience Response System in Spanish) and two audience response systems with gamification features, R-G-SIDRA (gamified SIDRA with ranking) and RB-G-SIDRA (gamified SIDRA with ranking and badges), were used in a General and Descriptive Human Anatomy course. Students participated in an empirical study. In the academic year 2019–2020, a total of 90 students used RB-G-SIDRA, 90 students employed R-G-SIDRA in the academic year 2018–2019, and 92 students used SIDRA in the academic year 2017–2018. Statistically significant differences were found between final exam grades obtained by using RB-G-SIDRA and SIDRA, U = 39.211 adjusted p = 0.001 and RB-G-SIDRA and R-G-SIDRA U = 31.157 adjusted p = 0.015, thus finding strong evidence with respect to the benefit of the badges used in RB-G-SIDRA. Moreover, in the students’ SIDRA systems scores, statistically significant differences were found between RB-G-SIDRA and SIDRA, U = −90.521 adjusted p < 0.001, and between R-G-SIDRA and SIDRA, U = −87.998 adjusted p < 0.001. Significant correlations between individual and team scores were also found in all of the tests in RB-G-SIDRA and G-SIDRA. The students expressed satisfaction, engagement, and motivation with SIDRA, R-G-SIDRA, and RB-G-SIDRA, thus obtaining a final average assessment of 4.28, 4.61, and 4.47 out of 5, respectively. Students perform better academically with gamified versus non-gamified audience response systems. Findings can be used to build a gamified adaptive learning system.

Emerging simulation technologies in global craniofacial surgical training

The last few decades have seen an exponential growth in the development and adoption of novel technologies in medical and surgical training of residents globally. Simulation is an active and innovative teaching method, and can be achieved via physical or digital models. Simulation allows the learners to repeatedly practice without the risk of causing any error in an actual patient and enhance their surgical skills and efficiency. Simulation may also allow the clinical instructor to objectively test the ability of the trainee to carry out the clinical procedure competently and independently prior to trainee's completion of the program. This review aims to explore the role of emerging simulation technologies globally in craniofacial training of students and residents in improving their surgical knowledge and skills. These technologies include 3D printed biomodels, virtual and augmented reality, use of google glass, hololens and haptic feedback, surgical boot camps, serious games and escape games and how they can be implemented in low and middle income countries. Craniofacial surgical training methods will probably go through a sea change in the coming years, with the integration of these new technologies in the surgical curriculum, allowing learning in a safe environment with a virtual patient, through repeated exercise. In future, it may also be used as an assessment tool to perform any specific procedure, without putting the actual patient on risk. Although these new technologies are being enthusiastically welcomed by the young surgeons, they should only be used as an addition to the actual curriculum and not as a replacement to the conventional tools, as the mentor-mentee relationship can never be replaced by any technology.

Surgical Skills Olympiad: A 4-Year Experience in a General Surgery Residency Program

Background  The acquisition of operative skills is the critical defining component of general surgery training. Performing simulated tasks has been shown to increase a resident's technical skills. As such, we devised the Surgical Skills Olympiad, an annual simulation-based skills competition. We examined our 4-year experience with the Olympiad at a large academic general surgery residency program.

Objective  This study aimed to use competition to motivate trainees to increase the time they spent practicing basic surgical skills, resulting in improved performance over time.

Methods  Teams were formed from members of each postgraduate year (PGY) class. Competition tasks were level specific: knot tying for PGY-1, basic laparoscopy for PGY-2, handsewn bowel anastomosis for PGY-3, vascular anastomosis for PGY-4, and advanced laparoscopy for PGY-5. Task scores over a 4-year period (2014–2017) were analyzed and a survey of participating teaching faculty was conducted.

Results  Ten faculty members responded to the survey, for a response rate of 63%. A total of 50% respondents felt that the caliber of surgical skills increased since the Olympiad was implemented. Ninety percent agreed that the Olympiad was beneficial for residents to assess their skills against their peers. Over 4 years, there was an improvement in scores for suturing task, advanced laparoscopy, and bowel anastomosis ( p  < 0.05 for all three).

Conclusion  A residency-wide surgical skills competition can improve resident performance in technical tasks and promote faculty engagement in resident skills training.

Medical Students' Perceptions of Play and Learning: Qualitative Study With Focus Groups and Thematic Analysis

Background

In times where distance learning is becoming the norm, game-based learning (GBL) is increasingly applied to health profession education. Yet, decisions for if, when, how, and for whom GBL should be designed cannot be made on a solid empirical basis. Though the act of play seems to be intertwined with GBL, it is generally ignored in the current scientific literature.

Objective

The objective of our study was to explore students’ perceptions of play in leisure time and of GBL as part of a mechanistic, bottom-up approach towards evidence-informed design and implementation of GBL in health profession education.

Methods

We conducted 6 focus group discussions with medical and dentistry students, which were analyzed using thematic analysis.

Results

A total of 58 students participated. We identified 4 major themes based on the students’ perception of play in leisure time and on the combination of play and learning. Our results indicate that, while play preferences were highly various in our health profession student cohort, pleasure was the common ground reported for playing. Crucially, play and the serious act of learning seemed paradoxical, indicating that the value and meaning of play are strongly context-dependent for students.

Conclusions

Four key points can be constructed from our study. First, students play for pleasure. Perceptions of pleasure vary considerably among students. Second, students consider play as inefficient. Inefficiency will only be justified when it increases learning. Third, play should be balanced with the serious and only be used for difficult or tedious courses. Fourth, GBL activities should not be made compulsory for students. We provide practical implications and directions for future research.

Assessment of technical skills based on learning curve analyses in laparoscopic surgery training

BACKGROUND

Objective force- and motion-based assessment is currently lacking in laparoscopic skills curricula. This study aimed to evaluate the added value of parameter-based assessment and feedback during training.

METHODS

Laparoscopy-naïve surgical residents that took part in a 3-week skills training curriculum were included. A box trainer equipped with the ForceSense system was used for assessment of tissue manipulation- (MaxForce) and instrument-handling skills (Path length and Time). Learning curves were established using linear regression tests. Pre- and post-course comparisons indicated the overall progression and were compared to predefined proficiency levels. A post-course survey was carried out to assess face validity.

RESULTS

In total, 4,268 trials, executed by 24 residents, were successfully assessed. Median (interquartile range) MaxForce outcomes improved from 2.7 Newton (interquartile range 1.9-3.8) to 1.8 Newton (interquartile range 1.2-2.4) between pre- and post-course assessment (P ≤ .009). Instrument Path length improved from 7,102.2 mm (interquartile range 5,255.2-9,025.9) to 3,545.3 mm (interquartile range 2,842.9-4,563.2) (P ≤.001). Time to execute the task improved from 159.8 seconds (interquartile range 119.8-219.0) to 60.7 seconds (interquartile range 46.0-79.5) (P ≤ .001). The learning curves revealed during what training phase the proficiency benchmarks were reached for each trainee. In the survey outcomes, trainees indicated that this curriculum should be part of a surgical residency program (mean visual analog scale score of 9.2 ± 0.9 standard deviation).

CONCLUSION

Force-, motion-, and time-parameters can be objectively measured during basic laparoscopic skills curricula and do indicate progression of skills over time. The ForceSense parameters enable curricula to be designed for specific proficiency-based training goals and offer the possibility for objective classification of the levels of expertise.

Gamification of health professions education: a systematic review

Gamification refers to using game attributes in a non-gaming context. Health professions educators increasingly turn to gamification to optimize students' learning outcomes. However, little is known about the concept of gamification and its possible working mechanisms. This review focused on empirical evidence for the effectiveness of gamification approaches and theoretical rationales for applying the chosen game attributes. We systematically searched multiple databases, and included all empirical studies evaluating the use of game attributes in health professions education. Of 5044 articles initially identified, 44 met the inclusion criteria. Negative outcomes for using gamification were not reported. Almost all studies included assessment attributes (n = 40), mostly in combination with conflict/challenge attributes (n = 27). Eight studies revealed that this specific combination had increased the use of the learning material, sometimes leading to improved learning outcomes. A relatively small number of studies was performed to explain mechanisms underlying the use of game attributes (n = 7). Our findings suggest that it is possible to improve learning outcomes in health professions education by using gamification, especially when employing game attributes that improve learning behaviours and attitudes towards learning. However, most studies lacked well-defined control groups and did not apply and/or report theory to understand underlying processes. Future research should clarify mechanisms underlying gamified educational interventions and explore theories that could explain the effects of these interventions on learning outcomes, using well-defined control groups, in a longitudinal way. In doing so, we can build on existing theories and gain a practical and comprehensive understanding of how to select the right game elements for the right educational context and the right type of student.

The impact of multi-person virtual reality competitive learning on anatomy education: a randomized controlled study

BACKGROUND

Anatomy is one of the core subjects in medical education. Students spend considerable time and effort on learning the requisite anatomy knowledge. This study explored the effect of a multiple-player virtual reality (VR) gaming system on anatomy learning.

METHODS

18 participants were randomly assigned into 3 learning conditions: (1) a textbook reading control group (CG), (2) a single-player VR (SP) group; and (3) a multiple-player VR (MP) group. The participants studied anatomy for 5 days, and completed a multiple-choice test on Days 1, 5, and 12. In the VR environment, the participants used handheld controllers to move the simulated tissues. The mission of the game was to complete puzzles of a human body. The SP and MP groups filled out a motivation inventory on Day 5. The scores on the multiple-choice test, the correct assembly rates, and the motivation inventory scores were analyzed using the 2-way ANOVA or independent t-test to compare group differences.

RESULTS

There was a significant interaction effect of group and timepoint (p = 0.003) in the multiple-choice test. In the CG, the scores on Day 1, Day 5, and Day 12 were significantly different (p < 0.001). The scores on Day 5 were significantly higher than those on Day 1 (p < 0.001). Although the scores declined slightly on Day 12, they were still significantly higher than those on Day 1 (p < 0.001). The SP and MP groups had similar results (p < 0.001, p < 0.001). The differences between the groups were only significant on Day 12 (p = 0.003), not Day 5 (p = 0.06). On Day 12, the scores of the MP group were higher than those of the CG (p = 0.002). The SP group and MP group had high scores on the interest, competence, and importance subscales of the motivation inventory. Both VR groups considered the system to be fun and beneficial to their learning. However, the MP group reported higher stress levels than the SP group.

CONCLUSION

The results indicated that the proposed VR learning system had a positive impact on the anatomy learning. Although the between-player competition caused higher stress levels for the VR groups, the stress could have been a mediator of their learning outcomes.

TRIAL REGISTRATION

ETRD, ETRD-D-19-00573. Registered 20 December 2018, http://www.edah.org.tw/irb/index.htm.

The Fun Factor: Does Serious Gaming Affect the Volume of Voluntary Laparoscopic Skills Training?

Background

The availability of validated laparoscopic simulators has not resulted in sustainable high-volume training. We investigated whether the validated laparoscopic serious game Underground would increase voluntary training by residents. We hypothesized that by removing intrinsic barriers and extrinsic barriers, residents would spend more time on voluntary training with Underground compared to voluntary training with traditional simulators.

Methods

After 1 year, we compared amount of voluntary time spent on playing Underground to time spent on all other laparoscopic training modalities and to time spent on performing laparoscopic procedures in the OR for all surgical residents. These data were compared to resident’ time spent on laparoscopic activities over the prior year before the introduction of Underground.

Results

From March 2016 until March 2017, 63 residents spent on average 20 min on voluntary serious gaming, 17 min on voluntary simulator training, 2 h and 44 min on mandatory laparoscopic training courses, and 14 h and 49 min on laparoscopic procedures in the OR. Voluntary activities represented 3% of laparoscopic training activities which was similar in the prior year wherein fifty residents spent on average 33 min on voluntary simulator training, 3 h and 28 min on mandatory laparoscopic training courses, and 11 h and 19 min on laparoscopic procedures.

Conclusion

Serious gaming has not increased total voluntary training volume. Underground did not mitigate intrinsic and extrinsic barriers to voluntary training. Mandatory, scheduled training courses remain needed. Serious gaming is flexible and affordable and could be an important part of such training courses.

Serious games, a game changer in teaching neonatal resuscitation? A review

BACKGROUND

Neonatal healthcare professionals require frequent simulation-based education (SBE) to improve their cognitive, psychomotor and communication skills during neonatal resuscitation. However, current SBE approaches are resource-intensive and not routinely offered in all healthcare facilities. Serious games (board and computer based) may be effective and more accessible alternatives.

OBJECTIVE

To review the current literature about serious games, and how these games might improve knowledge retention and skills in neonatal healthcare professionals.

METHOD

Literature searches of PubMed, Google Scholar, Cochrane Central Register of Controlled Trials, CINAHL, Web of Science and EMBASE databases were performed to identify studies examining serious games in neonatology. All games, such as board games, tabletop games, video games, screen-based simulators, tabletop simulators and virtual reality games were included.

RESULTS

Twelve serious games were included in this review (four board games, five video games and three virtual reality games). Overall, knowledge improvement was reported for the RETAIN (REsuscitationTrAINing for healthcare professionals) board game (10% increase in knowledge retention) and The Neonatology Game (4.15 points higher test score compared with control). Serious games are increasingly incorporated into Nursing and Medical School Curriculums to reinforce theoretical and practical learning.

CONCLUSIONS

Serious games have the potential to improve healthcare professionals' knowledge, skills and adherence to the resuscitation algorithm and could enhance access to SBE in resource-intensive and resource-limited areas. Future research should examine important clinical outcomes in newborn infants.

The Career Impact of the National Undergraduate Neuroanatomy Competition

BACKGROUND

Neurosurgery is a notoriously difficult career to enter and requires medical students to engage in extracurricular activities to demonstrate their commitment to the specialty. The National Undergraduate Neuroanatomy Competition (NUNC) was established in 2013 as a means for students to display this commitment as well as academic ability.

METHODS

A bespoke 22-item questionnaire was designed to determine career outcomes and the role of competition attendance in job applications. It was distributed using the SurveyMonkey website to the 87 attendees at the 2013 and 2014 competitions.

RESULTS

Responses were received by 40 competitors (response rate, 46.0%). Twenty-four responders (60.0%) intended to pursue a career in either neurosurgery (n = 18) or neurology (n = 6). This included 10 responders (25.0%) who had successfully entered either neurosurgery (n = 9) or neurology (n = 1). The performance of these 10 was significantly better than the other responders (57.0 ± 13.6% vs. 46.5 ± 13.5% [n = 30]; P = 0.036). Seventeen responders (42.5%) either included their attendance at NUNC in a post-Foundation job application or intend to.

CONCLUSIONS

The NUNC provides the opportunity for medical students to demonstrate their interest in neurosurgery. It has the potential to be used as a tool for recognizing medical students suitable for neurosurgery training.

Local and national laparoscopic skill competitions: residents' opinions and impact on adoption of simulation-based training

BACKGROUND

Dedicated practice using laparoscopic simulators improves operative performance. Yet, voluntary utilization is minimal. We hypothesized that skill competition between peers, at the local and national level, positively influences residents' use of laparoscopic simulators.

METHODS

A web-based survey evaluated the relationship between Canadian General Surgery residents' use of laparoscopic simulation and participation in competition. Secondary outcomes assessed attitudes regarding simulation training, factors limiting use, and associations between competition level and usage.

RESULTS

One hundred ninety (23%) of 826 potential participants responded. Eighty-three percent rated their laparoscopic abilities as novice or intermediate. More than 70% agreed that use of simulation practice improves intra-operative performance, and should be a mandatory component of training. However, 58% employed simulator practice less than once per month, and 18% never used a simulator. Sixty-five percent engaged in simulator training for 5 h or less over the preceding 6 months. Seventy-three percent had participated in laparoscopic skill competition. Of those, 51% agreed that competition was a motivation for simulation practice. No association was found between those with competition experience and simulator use. However, 83% of those who had competed nationally reported >5 h of simulator use in the previous 6 months compared to those with no competition experience (26%), local competition (40%), and local national-qualifying competition (23%) (p < 0.001).

CONCLUSIONS

This study does not support the hypothesis that competition alone universally increases voluntary use of simulation-based training, with only the minority of individuals competing at the national level demonstrated significantly higher simulation use. However, simulation training was perceived as a valuable exercise. Lack of time and access to simulators, as opposed to lack of interest, were the most commonly reported to limited use.