Implementing economic evaluation in simulation-based medical education: challenges and opportunities

Simulation-Based Teaching and Learning in Respiratory Care Education: A Narrative Review

Simulation-based pedagogy has become an essential aspect of healthcare education. However, there is a significant gap in the literature regarding the application of simulation-based modalities in respiratory care education. This review aims to address this gap by providing insight into the theory and current uses of simulation, its effectiveness in respiratory care education, and strategies to enhance faculty development. The study utilizes a narrative synthesis approach to review relevant literature and provide a comprehensive understanding of the topic. The research involved comprehensive searches of electronic databases, including PubMed and Google Scholar, to identify relevant literature, encompassing original articles, reviews, and other pertinent content, focusing on simulation-based teaching and learning in respiratory care education published between 1990 and 2022. Findings suggest that simulation-based education is an effective tool for improving respiratory care education and can enhance the clinical skills of learners. The study concludes by discussing the future of simulation in respiratory care education and the potential benefits it may offer.

Virtual Reality for Cardiopulmonary Resuscitation Healthcare Professionals Training: A Systematic Review

INTRODUCTION

Virtual reality (VR) is becoming increasingly popular to train health-care professionals (HCPs) to acquire and/or maintain cardiopulmonary resuscitation (CPR) basic or advanced skills.

AIM

To understand whether VR in CPR training or retraining courses can have benefits for patients (neonatal, pediatric, and adult), HCPs and health-care organizations as compared to traditional CPR training.

METHODS

A systematic review (PROSPERO: CRD42023431768) following the Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) guidelines. In June 2023, the PubMed, Cochrane Library, Scopus and Cumulative Index to Nursing and Allied Health Literature (CINAHL) databases were searched and included studies evaluated in their methodological quality with Joanna Briggs Institute checklists. Data were narratively summarized.

RESULTS

Fifteen studies published between 2013 and 2023 with overall fair quality were included. No studies investigated patients' outcomes. At the HCP level, the virtual learning environment was perceived to be engaging, realistic and facilitated the memorization of the procedures; however, limited decision-making, team building, psychological pressure and frenetic environment were underlined as disadvantages. Moreover, a general improvement in performance was reported in the use of the defibrillator and carrying out the chest compressions. At the organizational level, one study performed a cost/benefit evaluation in favor of VR as compared to traditional CPR training.

CONCLUSIONS

The use of VR for CPR training and retraining is in an early stage of development. Some benefits at the HCP level are promising. However, more research is needed with standardized approaches to ensure a progressive accumulation of the evidence and inform decisions regarding the best training methodology in this field.

Unleashing excellence: using a project management approach to effectively implement a simulation curriculum to improve residents' preparedness

BACKGROUND

Integrating innovative, simulation-based training programs into medical curricula frequently encounters familiar challenges, including scepticism, limited faculty time, and financial constraints. Recognized for its success in business projects, the Harvard Project Management Theory emerges as a promising approach to optimizing the implementation process and achieving sustainable success. This study endeavours to elucidate the application of project management theory in our implementation process and assess its impact on the clinical preparedness of novice residents.

METHODS

The research utilized a structured four-phase implementation strategy-Planning, Build-up, Execution, and Closing-to develop a simulation-based education curriculum. Incorporating project management tools like project charters and risk management tools played a crucial role in facilitating the effective implementation of standardized processes and improved clinical outcomes. Essential components of this innovative management approach encompass stakeholder engagement, milestone definition, and the alignment of institutional policies and processes.

RESULTS

A collective of 395 residents actively engaged in eight monthly simulation-based events, reflecting an average participation rate of 39 residents per lecture (± 19). A noteworthy enhancement was observed in the average rating for knowledge gain, with a significant improvement from 5.9/10 to 8.8/10 (p = 0.0001). Participants highlighted the program's considerable impact on future clinical practice (4.7/5) and teamwork (4.8/5) as particularly valuable aspects. The introduction of a novel organizational structure received favourable feedback from faculty members, with a notable rating of 4.8/5 for predictive time planning. Qualitative insights from the evaluation highlighted the significance of targeted incentive schemes in optimizing the implementation process.

CONCLUSION

This project underscores the constructive influence of project management principles in designing simulation-based curricula, explicitly focusing on stakeholder engagement, faculty motivation, and data utilization. Adopting the Harvard Project Management Approach emerges as a catalyst for heightened success in curriculum design, contributing to enhanced emergency preparedness among novice residents. The positive outcomes observed in this study provide valuable insights for future implementations, offering a foundation for refining and optimizing medical education programs to meet the evolving needs of learners and stakeholders alike.

Recommendations for embedding simulation in health services

Aspirations to achieve quality and safety goals in health services through simulation have led to significant investments in simulation equipment, space and faculty. However, the optimal governance and operational models through which these resources are expertly applied in health services are not known. There is growing evidence supporting 'service' models for simulation. In these models, simulation activities are co-designed and delivered by a team of simulation experts in partnership with health service units, specifically targeting quality and safety goals. Embedded simulation specialist teams working within these programs offer benefits not fully captured by traditional models of health education or by traditional systems for quality and safety.In this article, we explore broad and specific recommendations for establishing a simulation consultancy service within an Australian metropolitan health service. We base these recommendations on a review of current Australian practice and healthcare simulation literature, and on a specific example within a large outer metropolitan health service. The broad domains discussed include (1) governance and leadership; (2) human resources; (3) principles and planning; (4) operationalise and evaluate and (5) look to the future.The recommendations recognise that healthcare simulation is moving beyond solely addressing individual learning outcomes. The value of simulation addressing organisation and system objectives through various simulation modalities is increasingly being explored and demonstrating value. There is a growing demand for translational simulation in these contexts, and a consequent requirement for organisations to consider how simulation services can be successfully operationalised. Recommendations included in this paper are discussed and described with the intent of facilitating a deeper appreciation of the complexities associated with, and opportunities afforded by, a well-integrated simulation service.

A cost analysis of a 5-day simulation-based learning program for speech-language pathology student training

Purpose: There is poor reporting of the cost of simulation and greater transparency is needed. The primary study aim was to conduct a financial analysis of the university/training institution costs associated with a 5-day simulation-based learning program for speech-language pathology students. The secondary aim was to consider the economic costs of the model.Method: Costs associated with the delivery of a 5-day simulation-based learning program for speech-language pathology students from six Australian universities were collected regarding: (a) pre-program training, (b) personnel, (c) room hire, (d) equipment, and (e) consumables. Both financial costs and economic costs (Australian dollar, at June 2017) were calculated per university site, and per student.Result: The simulation program was run 21 times involving 176 students. Average total financial cost per program ranged from $4717 to $11 425, with cost variation primarily attributed to local labour costs and various use of in-kind support. Average financial cost per student was $859 (range $683-$1087), however this was almost double ($1461 per student, range $857-$2019) in the economic cost calculation. Personnel was the largest contributing cost component accounting for 76.6% of financial costs. Personnel was also the highest contributing cost in the economic analysis, followed by room hire.Conclusion: This study provides clarity regarding financial and economic costing for a 5-day simulation-based learning program. These data can help universities consider potential up-front financial costs, and well as strategies for financial cost minimisation, when implementing simulation-based learning within the university context.

Exploring academic teachers perspectives regarding the impact of using medical simulation in dentistry pre- and post-COVID-19 pandemic: a qualitative study

BACKGROUND

Medical simulation allows for the achievement of many educational goals and the continued education of some practical skills. The COVID-19 pandemic's restrictions have led to a major increase in dental education simulations. The aim of this study was to analyse the perspectives of academic teachers towards dental simulation, their concerns and evaluation of this teaching method, as well as their opinion on the use of medical simulation during the COVID-19 pandemic.

METHOD

A focus study was conducted in a group of 5 academic teachers, comprising 10% of academic teachers of a Dental Faculty using simulation techniques. Prior to and during the COVID-19 pandemic, the interviewed teachers had expertise with medical simulation in dentistry education methods. A facilitator used pre-planned, open-ended questions about the use of simulation in dentistry also with regard to the COVID-19 pandemic period. The group discussion has been managed, monitored, and recorded. The data analysis model was based on Braun and Clarke's six phases of thematic analysis. Five thematic domains/fields were evaluated: (1) Simulation as a didactic method; (2) Simulation during COVID-19 pandemic; (3) General observations and expectations with regard to simulation; (4) Teachers in simulation; (5) Concerns in relation to simulation. Two researchers analysed the data.

RESULTS

Based on interviewed teachers' perspective the simulation allows students to learn basic and complex skills providing the repeatability of the procedures performed. During Covid-19 the simulation methods undoubtedly filled the gap in the training of future dentists. However, interviewed teachers pointed out the high cost of the methods dictated by the need to prepare the simulation environment at a high level, in order to reflect the real clinical situation.

CONCLUSIONS

The use of simulation methods requires adequate preparation of academic teachers, continuous education and updating of knowledge in the field of medical simulation. The COVID-19 pandemic significantly influenced the growth of dental education simulation techniques as well as staff knowledge of the usage of medical simulation.

Integrating simulation into surgical training: a qualitative case study of a national programme

BACKGROUND

Applying simulation-based education (SBE) into surgical curricula is challenging and exacerbated by the absence of guidance on implementation processes. Empirical studies evaluating implementation of SBE interventions focus primarily on outcomes. However, understanding the processes involved in organising, planning, and delivering SBE adds knowledge on how best to develop, implement, and sustain surgical SBE. This study used a reform of early years surgical training to explore the implementation of a new SBE programme in Scotland. It aimed to understand the processes that are involved in the relative success (or failure) when implementing surgical SBE interventions.

METHODS

This qualitative case study, underpinned by social constructionism, used publicly available documents and the relevant surgical SBE literature to inform the research focus and contextualise data obtained from semi-structured interviews with core surgical trainees (n = 46), consultant surgeons (n = 25), and key leaders with roles in surgical training governance in Scotland (n = 7). Initial data coding and analysis were inductive. Secondary data analysis was then undertaken using Normalisation Process Theory (NPT). NPTs' four constructs (coherence, cognitive participation, collective action, reflexive monitoring) provided an explanatory framework for scrutinising how interventions are implemented, embedded, and integrated into practice, i.e. the "normalisation" process.

RESULTS

Distributed leadership (individual SBE initiatives assigned to faculty but overall programme overseen by a single leader) and the quality improvement practise of iterative refinement were identified as key novel processes promoting successful normalisation of the new SBE programme. Other processes widely described in the literature were also identified: stakeholder collaboration, personal contacts/relational processes, effective communication, faculty development, effective leadership, and tight programme management. The study also identified that learners valued SBE activities in group- or team-based social environments over isolated deliberate practice.

CONCLUSIONS

SBE is most effective when designed as a comprehensive programme aligned to the curriculum. Programmes incorporating both group-based and isolated SBE activities promote deliberate practice. Distributed leadership amongst faculty attracts wide engagement integral to SBE programme implementation, while iterative programme refinement through regular evaluation and action on feedback encourages integration into practice. The knowledge contributed by critically analysing SBE programme implementation processes can support development of much needed guidance in this area.

Proficiency and Retention of Five Clinical Veterinary Skills Using Multipurpose Reusable Canine Manikins vs. Live Animals: Model Development and Validation

Simulation in veterinary education provides a safe and ethical alternative to using live animals, but most simulators are single purpose and unvalidated. In this study, canine training manikins were created using readily available materials to teach fine needle aspiration (FNA) of peripheral lymph nodes, jugular venipuncture, cephalic venipuncture, intravenous catheterization, and cystocentesis. Undergraduate subjects were prospectively enrolled and stratified by veterinary experience prior to randomization into two groups. Students were taught a new skill each week through a written description of the technique, video training, and hands-on practice (live animal vs. manikin). The following week, participants were scored on the performance of the previous week's skill on a live animal using a standardized rubric by reviewers blinded to the training group. Six weeks later, the assessment was repeated for all skills. Scores were compared between groups and time points using repeated-measures ANOVA after logarithmic transformation. p < .05 was significant. There were no significant differences in scores for any of the skills between the groups immediately following or 6 weeks after training. Initial proficiency and short-term retention of clinical skills do not differ for students trained using a manikin vs. a live dog.

A Decade Later-Progress and Next Steps for Pediatric Simulation Research

SUMMARY STATEMENT

A decade ago, at the time of formation of the International Network for Pediatric Simulation-based Innovation, Research, and Education, the group embarked on a consensus building exercise. The goal was to forecast the facilitators and barriers to growth and maturity of science in the field of pediatric simulation-based research. This exercise produced 6 domains critical to progress in the field: (1) prioritization, (2) research methodology and outcomes, (3) academic collaboration, (4) integration/implementation/sustainability, (5) technology, and (6) resources/support/advocacy. This article reflects on and summarizes a decade of progress in the field of pediatric simulation research and suggests next steps in each domain as we look forward, including lessons learned by our collaborative grass roots network that can be used to accelerate research efforts in other domains within healthcare simulation science.

A Region-Wide All-Hazard Training Program for Prehospital Mass Casualty Incident Management: A Real-World Case Study

OBJECTIVE

We report the development, implementation, and results of a sustainable region-wide mass-casualty management prehospital training program implemented by the Regione Lombardia emergency medical services (EMS) agency AREU in Italy.

METHODS

The educational program learning objectives are: (1) command and control, communications, and resource management; (2) mass casualty triage and the START triage protocol; (3) on-scene management; (4) Regione Lombardia and AREU Mass Casualty standard operating procedures; and (5) inter-agency communications and relations. For each course edition data on participants' summative assessment, participants' feedback and costs were collected.

RESULTS

Between June 26, 2013, and December 31, 2020, a total of 84 editions of the provider training event were delivered, training an overall 1329 prehospital providers; 1239 (93%) passed the summative assessment and were qualified as being operationally "ready." Regarding participant feedback, the overall program was rated 4.4 ± 0.7 out of 5. The overall cost of running the provider program during the study period was €321 510 (circa US $382 000). The average cost per edition was €3828 and €242 per participant.

CONCLUSIONS

We have described a simple yet interactive simulation and blended-learning approach, which has yielded good pass rates, good participant satisfaction, and contained costs to systematically train emergency medical service personnel.

Unpacking economic programme theory for supervision training: Preliminary steps towards realist economic evaluation

INTRODUCTION

Cost studies are increasingly popular given resource constraints. While scholars stress the context-dependent nature of cost, and the importance of theory, cost studies remain context-blind and atheoretical. However, realist economic evaluation (REE) privileges context and the testing/refinement of economic programme theory. This preliminary REE serves to test and refine economic programme theory for supervision training programmes of different durations to better inform future programme design/implementation.

METHODS

Our preliminary REE unpacked how short (half-day) and extended (12 week) supervision training programmes in Victoria, Australia, produced costs and outcomes. We employed mixed methods: qualitative realist and quantitative cost methods. Economically optimised programme models were developed guided by identified cost-sensitive mechanisms and contexts.

RESULTS

As part of identified context-mechanism-outcome configurations (CMOCs) for both training programmes, we found a wider diversity of positive outcomes but greater costs for the extended programme (11 outcomes; AU$3069/learner) compared with the short programme (7 outcomes; $385/learner). We identified four shared cost-sensitive mechanisms for both programmes (training duration, learner protected time, learner engagement, and facilitator competence) and one shared cost-sensitive context (learners' supervisory experience). We developed two economically optimised programme models: (1) short programme for experienced supervisors facilitated by senior educators ($406/learner); and (2) extended programme for inexperienced supervisors facilitated by junior educators ($2104/learner).

DISCUSSION

Our initial economic programme theory was somewhat supported, refuted and refined. Results were partly consistent with previous research, but also extended it through unpacking cost-sensitive mechanisms and contexts. Although our preliminary REE fills a pressing gap in the methodology literature, conducting REE was challenging given our desire to integrate economic and realist analyses fully, and remain faithful to realist principles. Attention to training duration and experience levels of the facilitator-learner dyad may help to balance the cost and outcomes of training programmes.

Video-Assisted Peer Teaching for Surgical Skills Training - Innovative Potential for the Medical Curriculum and Beyond: A Randomized Controlled Trial

OBJECTIVE

Hygienic healthcare standards are essential for avoiding hospital infections. However, medical students and staff lack training in this field, which may be due to high personnel resources of present educational approaches. Thus, there is an urgent need for a novel and efficient approach. Aim of the study is to compare a newly developed video-assisted peer feedback (VAPF) method for teaching wound dressings to the traditional teaching method with qualified instructor feedback (QIF) with respect to essential learning outcomes.

DESIGN, SETTING AND PARTICIPANTS

In this randomized controlled noninferiority trial, 251 medical undergraduates were randomly assigned to one of two interventions (QIF n = 127; VAPF n = 124). In QIF, participants received feedback from a qualified instructor. In VAPF, participants video-recorded each other while performing a wound dressing and gave each other feedback assisted by a standardized checklist. Outcome measures were participants' score in an objective structured practical examination (OSPE) and a written exam after the course.

RESULTS

Noninferiority of VAPF (n = 123) compared to QIF (n = 127) was confirmed for both OSPE (QIF: 8.83 ± 1.30; VAPF: 8.88 ± 1.04; mean difference -0.04, 95% CI -0.34 to 0.25) and written exam (QIF: 8.99 ± 1.06; VAPF: 9.14 ± 1.05; mean difference -0.15, 95% CI -0.41 to 0.12).

CONCLUSIONS

VAPF is a cost-efficient and viable alternative to QIF commonly used in medical education. It provides comparable training outcomes to the traditional training method with lower personnel investment. VAPF is a promising educational method for improving essential clinical competencies.

Simulation interprofessional education in health professions education: a scoping review protocol

OBJECTIVE

The objective of this scoping review is to identify, collate, and map the evidence on simulation interprofessional education activities in any setting for the education of health professional students.

INTRODUCTION

Simulation interprofessional education activities comprise in-person and collaborative online learning embedded in formal curricula. Though the number of simulation interprofessional education activities has increased with the knowledge of the importance of effective interprofessional collaboration, the literature still lacks a description of the characteristics of existing activities.

INCLUSION CRITERIA

This scoping review will consider interprofessional education activities taking place within a simulation environment. Included papers will report on activities with two or more types of learners in health professional programs.

METHODS

The proposed scoping review will be conducted in accordance with the JBI methodology for scoping reviews. Databases searched will include PubMed, CINAHL, and ERIC. Results will be limited to English-language publications from 2016 to the present year. Data extraction will be performed using a purposefully developed data extraction tool. Teams of reviewers will screen abstracts and full texts of articles for potential inclusion, and decisions will be determined via consensus of two out of three reviewers. Extracted data will be presented in diagrammatic or tabular form in a manner that aligns with the objective of this scoping review. A narrative summary will accompany the tabulated and/or charted results and will describe how the results relate to the review's objective and questions, and how the results might inform future simulation interprofessional education activities in health professions education.

Cost-effectiveness of a quality improvement project, including simulation-based training, on reducing door-to-needle times in stroke thrombolysis

BACKGROUND

Rapid revascularisation in acute ischaemic stroke is crucial to reduce its total burden including societal costs. A quality improvement (QI) project that included streamlining the stroke care pathway and simulation-based training was followed by a significant reduction in median door-to-needle time (27 to 13 min) and improved patient outcomes after stroke thrombolysis at our centre. Here, we present a retrospective cost-effectiveness analysis of the QI project.

METHODS

Costs for implementing and sustaining QI were assessed using recognised frameworks for economic evaluations. Effectiveness was calculated from previously published outcome measures. Cost-effectiveness was presented as incremental cost-effectiveness ratios including costs per minute door-to-needle time reduction per patient, and costs per averted death in the 13-month post-intervention period. We also estimated incremental cost-effectiveness ratios for a projected 5-year post-intervention period and for varying numbers of patients treated with thrombolysis. Furthermore, we performed a sensitivity analysis including and excluding costs of unpaid time.

RESULTS

All costs including fixed costs for implementing the QI project totalled US$44 802, while monthly costs were US$2141. We calculated a mean reduction in door-to-needle time of 13.1 min per patient and 6.36 annual averted deaths. Across different scenarios, the estimated costs per minute reduction in door-to-needle time per patient ranged from US$13 to US$29, and the estimated costs per averted death ranged from US$4679 to US$10 543.

CONCLUSIONS

We have shown that a QI project aiming to improve stroke thrombolysis treatment at our centre can be implemented and sustained at a relatively low cost with increasing cost-effectiveness over time. Our work builds on the emerging theory and practice for economic evaluations in QI projects and simulation-based training. The presented cost-effectiveness data might help guide healthcare leaders planning similar interventions.

How to conduct cost and value analyses in health professions education: AMEE Guide No. 139

Growing demand for accountability, transparency, and efficiency in health professions education is expected to drive increased demand for, and use of, cost and value analyses. In this AMEE Guide, we introduce key concepts, methods, and literature that will enable novices in economics to conduct simple cost and value analyses, hold informed discussions with economic specialists, and undertake further learning on more advanced economic topics. The practical structure for conducting analyses provided in this guide will enable researchers to produce robust results that are meaningful and useful for improving educational practice. Key steps include defining the economic research question, identifying an appropriate economic study design, carefully identifying cost ingredients, quantifying, and pricing the ingredients consumed, and conducting sensitivity analyses to explore uncertainties in the results.

Most significant barriers and proposed solutions for medical schools to facilitate simulation-based undergraduate curriculum in OBGYN

Despite having a good understanding of medicine, doctors lack clinical skills, problem-solving abilities, and the ability to apply knowledge to patient care, particularly in unanticipated circumstances. To overcome this, medical education has evolved into a system-oriented core curriculum with cognitive, psychomotor, and affective learning goals. With an emphasis on problem-based learning, the educator's aim is to establish a long-term, predetermined improvement in the learner's behavior, acquired skills, and attitudes (Datta R, Upadhyay KK, Jaideep CN. Simulation and its role in medical education. Med J Armed Forces India. 2012;68(2):167-172. https://doi.org/10.1016/S0377-1237(12)60040-9 ). However, teaching these disciplines to real patients is almost impossible; this is where simulation comes in. This opinion paper will discuss the relevance and necessity of a simulation-based undergraduate curriculum in obstetrics and gynecology. What are the biggest obstacles that medical schools face in making the most of simulation-based learning, and how can they be overcome?

Costs of hospital trauma team simulation training: a prospective cohort study

OBJECTIVES

This study investigated the costs of 2-hour multiprofessional in situ hospital trauma team simulation training and its effects on teams' non-technical skills using the T-NOTECHS instrument.

BACKGROUND

Simulation is a feasible and effective teaching and learning method. Calculating the costs of simulated trauma team training in medical emergency situations can yield valuable information for improving its overall cost-effectiveness.

DESIGN

A prospective cohort study.

SETTING

Trauma resuscitation room in Central Finland Hospital, Finland.

PARTICIPANTS

475 medical professionals in 81 consecutive, simulated trauma teams.

PRIMARY AND SECONDARY OUTCOME MEASURES

Team simulation training costs in 2017 and 2018 were analysed in the following two phases: (1) start-up costs and (2) costs of education. Primary outcome measures were training costs per participant and training costs per team. Secondary outcome measures were non-technical skills, which were measured on a 5-25-point scale using the T-NOTECHS instrument.

RESULTS

The annual mean total costs of trauma team simulation training were €58 000 for 40 training sessions and 238 professionals. Mean cost per participant was €203. Mean cost per team was €1220. The annual costs of simulation training markedly decreased when at least 70-80 teams participated in the training. Mean change in T-NOTECHS score after simulation training was +2.86 points (95% CI 1.97 to 3.75;+14.5%).

CONCLUSIONS

The greater the number of teams trained per year, the lower the costs per trauma team. In this study, we developed an activity-based costing method to calculate the costs of trauma team simulation training to help stakeholders make decisions about whether to initiate or increase existing trauma team simulation training or to obtain these services elsewhere.

Rational and Design of the SIMULATOR Study: A Multicentre Randomized Study to Assess the Impact of SIMULation-bAsed Training on Transoesophageal echocardiOgraphy leaRning for Cardiology Residents

Introduction: Simulation-based training in transesophageal echocardiography (TEE) seems promising. However, data are limited to non-randomized or single-center studies. To assess the impact of simulation-based vs. traditional teaching on TEE knowledge and performance for medical residents in cardiology. Materials and Methods: Nationwide prospective randomized multicenter study involving 43 centers throughout France allowing for the inclusion of >70% of all French cardiology residents. All cardiology residents naive from TEE will be included. Randomization with stratification by center will allocate residents to either a control group receiving theoretical knowledge by e-learning only, or to an intervention group receiving two simulation-based training sessions on a TEE simulator in addition. Results: All residents will undergo both a theoretical test (0-100 points) and a practical test on a TEE simulator (0-100 points) before and 3 months after the training. Satisfaction will be assessed by a 5-points Likert scale. The primary outcomes will be to compare the scores in the final theoretical and practical tests between the two groups, 3 months after the completion of the training. Conclusion: Data regarding simulation-based learning in TEE are limited to non-randomized or single-center studies. The randomized multicenter SIMULATOR study will assess the impact of simulation-based vs. traditional teaching on TEE knowledge and performance for medical residents in cardiology, and whether such an educational program should be proposed in first line for TEE teaching.

Translational simulation: from description to action

This article describes an operational framework for implementing translational simulation in everyday practice. The framework, based on an input-process-output model, is developed from a critical review of the existing translational simulation literature and the collective experience of the authors' affiliated translational simulation services. The article describes how translational simulation may be used to explore work environments and/or people in them, improve quality through targeted interventions focused on clinical performance/patient outcomes, and be used to design and test planned infrastructure or interventions. Representative case vignettes are used to show how the framework can be applied to real world healthcare problems, including clinical space testing, process development, and culture. Finally, future directions for translational simulation are discussed. As such, the article provides a road map for practitioners who seek to address health service outcomes using translational simulation.

An Approach to Economic Evaluation in Undergraduate Anatomy Education

Medical education research is becoming increasingly concerned with the value (defined as "educational outcomes per dollar spent") of different teaching approaches. However, the financial costs of various approaches to teaching anatomy are under-researched, making evidence-based comparisons of the value of different teaching approaches impossible. Therefore, the aims of this study were to report the cost of six popular anatomy teaching methods through a specific, yet generalizable approach, and to demonstrate a process in which these results can be used in conjunction with existing effectiveness data to undertake an economic evaluation. A cost analysis was conducted to report the direct and indirect costs of six anatomy teaching methods, using an established approach to cost-reporting. The financial information was then combined with previously published information about the effectiveness of these six teaching methods in increasing anatomy knowledge, thereby demonstrating how estimations of value can be made. Dissection was reported as the most expensive teaching approach and computer aided instruction/learning (CAI/L) was the least, based on an estimation of total cost per student per year and assuming a student cohort size of just over 1,000 (the United Kingdom average). The demonstrated approach to economic evaluation suggested computer aided instruction/learning as the approach that provided the most value, in terms of education outcomes per dollar spent. The study concludes by suggesting that future medical education research should incorporate substantially greater consideration of cost, in order to draw important conclusions about value for learners.

The effect of multiple exposures in scenario-based simulation-A mixed study systematic review

Aims

To examine the use and effects of multiple simulations in nursing education.

Design

A mixed study systematic review. Databases (CINAHL, Medline, PubMed, EMBASE, ERIC, Education source and Science Direct) were searched for studies published until April 2020.

Method

Researchers analysed the articles. Bias risk was evaluated using the Critical Appraisal Skills Programme and Cochrane Risk of Bias tool.

Results

In total, 27 studies were included and four themes identified. Students participated in multiple simulation sessions, over weeks to years, which included 1-4 scenarios in various nursing contexts. Simulations were used to prepare for, or partly replace, students' clinical practice. Learning was described in terms of knowledge, competence and confidence.

Conclusion

Multiple scenario-based simulation is a positive intervention that can be implemented in various courses during every academic year to promote nursing students' learning. Further longitudinal research is required, including randomized studies, with transparency regarding study design and instruments.

Physiotherapy students can be educated to portray realistic patient roles in simulation: a pragmatic observational study

BACKGROUND

Simulation-based education (SBE) has many benefits for learners, but costs can limit embedding SBE in health professional curricula. Peer simulation involves students portraying patient roles, and may reduce costs while still providing the benefits of other SBE experiences. However, the quality of the SBE may be impacted if students cannot portray authentic and realistic patient roles. The aim of this study was to investigate whether targeted education was associated with observable changes to physiotherapy students' abilities to portray patient roles in SBE.

METHODS

Second year pre-registration physiotherapy students (n = 40) participated. Students completed online and face-to-face education about SBE, patient portrayal skills, and how to portray a specific patient role. Students were video-recorded portraying patient roles in practical exams before and after the program. Three blinded independent assessors rated the overall quality of portrayals using a purpose-developed assessment instrument.

RESULTS

Twenty-three sets of pre- and post-program videos were analysed. Correlations between assessor scores spanned 0.62 to 0.82 for analyses of interest, which justified using average assessor ratings in analysis. Statistically significant higher scores were seen for post-program assessments for overall portrayal scores (mean difference 6.5, 95%CI [1.51-11.45], p = 0.013), accuracy (mean difference 3.4, 95%CI [0.69-6.13], p = 0.016) and quality (mean difference 3.1, 95%CI [0.64-5.49], p = 0.016).

CONCLUSIONS

Physiotherapy students appear capable of playing realistic patient roles. Peer simulation can be embedded into health professional programs, and education in patient role portrayal appears to be associated with improvements in portrayal quality and realism. Given these findings, further investigation, including testing program effects in a randomised study, is warranted.

Implementing, embedding and sustaining simulation-based education: What helps, what hinders

OBJECTIVES

Although there is much evidence to support the use of simulation-based education (SBE) in undergraduate education of health care professionals, less attention has been paid to how SBE, viewed as a complex intervention, is implemented and becomes embedded and sustained. This paper aims to explore factors that inhibited or promoted SBE becoming normal practice in undergraduate health care professional programmes.

METHODS

Participants involved in the organisation, design and delivery of SBE in the north of England were recruited purposefully from higher education institutions (HEI) and National Health Service (NHS) Trusts through local networks for qualitative telephone interviews. Transcripts were analysed inductively using a hybrid approach involving simultaneous inductive open coding and deductive coding using normalisation process theory (NPT) as a theoretical lens.

FINDINGS

A total of 12 NHS staff from 11 trusts and seven individuals from four HEIs were interviewed. There was considerable variation in the approach taken to implementation across organisations, which resulted in varying degrees of embeddedness. Implementation was challenged or enabled by organisational leadership, professional buy-in and the development and maturity of the strategic approach. Variation in understanding of the scope and pedagogical aims of SBE led to inequity between professions and organisations in investment and participation, as well as design and delivery of SBE.

CONCLUSIONS

Given the complexity of SBE, best practice in implementation should be considered fundamental to the successful delivery of SBE. The findings provide an explanation of how contextual factors can support or hinder implementation to maximise potential benefits and learning outcomes; this understanding can be used to better inform development of SBE strategies and highlight potential factors needed to navigate contextual barriers so that learning outcomes can be maximised.

Cost-effectiveness analysis of workplace-based distributed cardiopulmonary resuscitation training versus conventional annual basic life support training

Context

Although distributed cardiopulmonary resuscitation (CPR) practice has been shown to improve learning outcomes, little is known about the cost-effectiveness of this training strategy. This study assesses the cost-effectiveness of workplace-based distributed CPR practice with real-time feedback when compared with conventional annual CPR training.

Methods

We measured educational resource use, costs, and outcomes of both conventional training and distributed training groups in a prospective-randomised trial conducted with paediatric acute care providers over 12 months. Costs were calculated and reported from the perspective of the health institution. Incremental costs and effectiveness of distributed CPR training relative to conventional training were presented. Cost-effectiveness was expressed as an incremental cost-effectiveness ratio (ICER) if appropriate. One-way sensitivity analyses and probabilistic sensitivity analysis were conducted.

Results

A total of 87 of 101 enrolled participants completed the training (46/53 in intervention and 41/48 in the control). Compared with conventional training, the distributed CPR training group had a higher proportion of participants achieving CPR excellence, defined as over 90% guideline compliant for chest compression depth, rate and recoil (control: 0.146 (6/41) vs intervention 0.543 (25/46), incremental effectiveness: +0.397) with decreased costs (control: $C266.50 vs intervention $C224.88 per trainee, incremental costs: −$C41.62). The sensitivity analysis showed that when the institution does not pay for the training time, distributed CPR training results in an ICER of $C147.05 per extra excellent CPR provider.

Conclusion

Workplace-based distributed CPR training with real-time feedback resulted in improved CPR quality by paediatric healthcare providers and decreased training costs, when training time is paid by the institution. If the institution does not pay for training time, implementing distributed training resulted in better CPR quality and increased costs, compared with conventional training. These findings contribute further evidence to the decision-making processes as to whether institutions/programmes should financially adopt these training programmes.

Cost-effectiveness of a video game versus live simulation for disaster training

Introduction

Disaster triage training for emergency medical service (EMS) providers is unstandardised. We hypothesised that disaster triage training with the paediatric disaster triage (PDT) video game ‘60 s to Survival’ would be a cost-effective alternative to live simulation-based PDT training.

Methods

We synthesised data for a cost-effectiveness analysis from two previous studies. The video game data were from the intervention arm of a randomised controlled trial that compared triage accuracy in a live simulation scenario of exposed vs unexposed groups to the video game. The live simulation and feedback data were from a prospective cohort study evaluating live simulation and feedback for improving disaster triage skills. Postintervention scores of triage accuracy were measured for participants via live simulations and compared between both groups. Cost-effectiveness between the live simulation and video game groups was assessed using (1) A net benefit regression model at various willingness-to-pay (WTP) values. (2) A cost-effectiveness acceptability curve (CEAC).

Results

The total cost for the live simulation and feedback training programme was $81 313.50 and the cost for the video game was $67 822. Incremental net benefit values at various WTP values revealed positive incremental net benefit values, indicating that the video game is more cost-effective compared with live simulation and feedback. Moreover, the CEAC revealed a high probability (>0.6) at various WTP values that the video game is more cost-effective.

Conclusions

A video game-based simulation disaster triage training programme was more cost-effective than a live simulation and feedback-based programme. Video game-based training could be a simple, scalable and sustainable solution to training EMS providers.

High-fidelity simulation-based education in pre-registration healthcare programmes: a systematic review of reviews to inform collaborative and interprofessional best practice

Simulation-based education (SBE) is recognized as an effective interprofessional teaching and learning method. Whilst there is a large volume of research evidence concerning elements of SBE there is a lack of clarity concerning foundational principles of best practice. This is important for educators wishing to utilize high-quality SBE to deliver interprofessional education. The aim of this review is to synthesize review evidence of SBE best practice in a broad range of pre-registration healthcare programs and contextualize findings in light of relevant educational theory. A systematic search of PubMed, Scopus, Medline/Ovid, British Nursing Index, and the Cochrane Library databases was undertaken in February 2020. Data extraction and quality evaluation were undertaken by two authors. Fifteen reviews were included. In addition to identifying barriers and enablers to implementation, three interdependent themes regarding SBE best practice were found: curriculum level integration and planning (curriculum level integration, the opportunity for deliberate repeated practice, distribution, and sequencing); simulation design and delivery (clearly defined learning outcomes and benchmarks, pre-brief, multiple learning strategies, interactivity and individualized learning, feedback, and debrief); and resources (facilitator competency, controlled environments). These themes broadly align with the social constructivist theory of experiential learning whereby structured opportunities to learn via concrete experience, reflective observation, abstract conceptualization, and active experimentation are provided through effective planning, design, and delivery of SBE. Interdependencies suggest that integration of SBE at curriculum-level enables planning and implementation of best practice principles which are associated with effective learning, which also inform and facilitate the availability of adequate simulation resources.

Improving Pediatric Administrative Disaster Preparedness Through Simulated Disaster Huddles

Members of an emergency department (ED) staff need to be prepared for mass casualty incidents (MCIs) at all times. Didactic sessions, drills, and functional exercises have shown to be effective, but it is challenging to find time and resources for appropriate training. We conducted brief, task-specific drills (deemed "disaster huddles") in a pediatric ED (PED) to examine if such an approach could be an alternative or supplement to traditional MCI training paradigms. Over the course of the study, we observed an improving trend in the overall score for administrative disaster preparedness. Disaster huddles may be an effective way to improve administrative disaster preparedness in the PED. Low-effort, low-time commitment education could be an attractive way for further disaster preparedness efforts. Further studies are indicated to show a potential impact on lasting behavior and patient outcomes.

Cost evaluations in health professions education: a systematic review of methods and reporting quality

CONTEXT

High-quality research into education costs can inform better decision making. Improvements to cost research can be guided by information about the research questions, methods and reporting of studies evaluating costs in health professions education (HPE). Our objective was to appraise the overall state of the field and evaluate temporal trends in the methods and reporting quality of cost evaluations in HPE research.

METHODS

We searched the MEDLINE, CINAHL (Cumulative Index to Nursing and Allied Health Literature), EMBASE, Business Source Complete and ERIC (Education Resources Information Centre) databases on 31 July 2017. To evaluate trends over time, we sampled research reports at 5-year intervals (2001, 2006, 2011 and 2016). All original research studies in HPE that reported a cost outcome were included. The Medical Education Research Study Quality Instrument (MERSQI) and the BMJ economic checklist were used to appraise methodological and reporting quality, respectively. Trends in quality over time were analysed.

RESULTS

A total of 78 studies were included, of which 16 were published in 2001, 15 in 2006, 20 in 2011 and 27 in 2016. The region most commonly represented was the USA (n = 43). The profession most commonly referred to was that of the physician (n = 46). The mean ± standard deviation (SD) MERSQI score was 10.9 ± 2.6 out of 18, with no significant change over time (p = 0.55). The mean ± SD BMJ score was 13.5 ± 7.1 out of 35, with no significant change over time (p = 0.39). A total of 49 (63%) studies stated a cost-related research question, 23 (29%) stated the type of cost evaluation used, and 31 (40%) described the method of estimating resource quantities and unit costs. A total of 16 studies compared two or more interventions and reported both cost and learning outcomes.

CONCLUSIONS

The absolute number of cost evaluations in HPE is increasing. However, there are shortcomings in the quality of methodology and reporting, and these are not improving over time.

Can simulation-based education and precision teaching improve paediatric trainees' behavioural fluency in performing lumbar puncture? A pilot study

BACKGROUND

Low levels of success in performing lumbar puncture have been observed among paediatric trainees. This study assessed the efficacy of simulation-based education with frequency building and precision teaching for training lumbar puncture to behavioural fluency.

METHODS

The intervention group was assessed at baseline, at the final training trial, in the presence of distraction, and a minimum of one month after the cessation of the intervention in order to ascertain whether behavioural fluency in lumbar puncture was obtained. Subsequently, the performance of this intervention group (10 paediatric senior house officers) was compared to the performance of a comparator group of 10 more senior colleagues (paediatric registrars) who had not received the intervention. Retrospective chart audit was utilised to examine performance in the clinical setting.

RESULTS

Intervention group participants required a mean of 5 trials to achieve fluency. Performance accuracy was significantly higher in the intervention group than the comparator group. Learning was retained at follow-up and persisted during distraction. Retrospective chart audit revealed no significant difference between the performance of the intervention group and a comparator group, comprised of more senior physicians, in the clinical setting, although the interpretation of these analyses are limited by a low number of lumbar punctures performed in the clinical setting.

CONCLUSIONS

The programme of simulation-based education with frequency building and precision teaching delivered produced behavioural fluency in lumbar puncture among paediatric trainees. Following the intervention, the performance of these participants was equivalent to, or greater than, that of senior paediatricians. This study supports the need for further research exploring the effectiveness of simulation-based education with precision teaching to train procedural skills to fluency, and the consideration of how best to explore the impact of these on patient outcomes.

A systematic review of 7 years of research on entrustable professional activities in graduate medical education, 2011-2018

PURPOSE

This review aimed to synthesise some of the extant work on the use of entrustable professional activities (EPAs) for postgraduate physicians, to assess the quality of the work and provide direction for future research and practice.

METHOD

Systematic searches were conducted within five electronic databases (Medline, Scopus, Web of Science, PsycINFO and CINAHL) in September 2018. Reference lists, Google Scholar and Google were also searched. Methodological quality was assessed using the Quality Assessment Tool for Studies with Diverse Designs (QATSDD).

RESULTS

In total, 49 studies were included, classified as Development of EPAs (n = 37; 76% of total included), Implementation and/or assessment of EPAs (n = 10; 20%), or both (n = 2; 4%). EPAs were described for numerous specialties, including internal medicine (n = 14; 36%), paediatrics (n = 8; 21%) and psychiatry (n = 4; 10%). Of the development studies, 92% utilised more than one method to generate EPAs. The two most commonly used methods were developing initial EPAs in a working group, (n = 27; 69%) and revising through deliberation (n = 21; 54%). Development papers were of variable quality (mean QATSDD score = 20, range 6-41). Implementation and assessment studies utilised methods that included observing trainee performance (n = 6; 50%) and enrolling trainees in competency-based curricula, which included EPAs (n = 4; 33%). The methodological quality of these implementation studies varied (mean QATSDD score = 19.5, range = 6-32).

CONCLUSIONS

This review highlighted a need for: (i) consideration of best practice guidelines for EPA development; (ii) focus on the methodological quality of research on EPA development and of EPAs, and (iii) further work investigating the implementation of EPAs in the curriculum.

Simulation Use in Acute Care Hospitals in the United States

Three national nursing associations formed a collaborative partnership to research simulation use in acute care hospitals in the United States and military hospitals abroad. An electronic survey was used to determine simulation modalities used, participants engaged, space allocation, purposes of use, commonly taught skills, logistics, and barriers to use. Data from 521 respondents revealed widespread use of a variety of simulation modalities. However, use of this educational strategy could be expanded to patients and families.

Values and value in simulated participant methodology: A global perspective on contemporary practices

This article has been written for the 40th year of the publication of Medical Teacher. While we celebrate the contribution of simulated participants (SPs) to health professions education through values and value-based learning, we also offer critical reflection on elements of our practice, commencing with language. We argue for the use of the term simulated rather than standardized and acknowledge the dominant role of the SP as patient and the origins of the methodology. These shifts in terms and their implications in practice reflect changes in the conceptualization of SP-based methodology. Recently published standards for those who work with SPs (SP practitioners) are noted as an important milestone in our community's development. We consider contemporary practices addressing the complex notions of values and value in SP-based learning. We simultaneously refer to the work of SPs and SP practitioners. Phases of educational design including identifying learning objectives, scenario design, implementation, feedback and debriefing are used to illustrate methodological shifts. Within each of these phases, there are relational issues that have to date often gone unchecked and are under reported in literature. Finally, using the metaphor of a murmuration, we celebrate contemporary practices of the global SP practitioner community.