Evaluation of a Computer-Based Educational Intervention to Improve Medical Teamwork and Performance During Simulated Patient Resuscitations:

Increasing pre-exposure prophylaxis (PrEP) in primary care: A study protocol for a multi-level intervention using the multiphase optimization strategy (MOST) framework

BACKGROUND

In the United States, over 1.2 million people are living with HIV. This disease disproportionately affects men who have sex with men (MSM), people of color, youth and young adults, and transgender individuals. Pre-exposure prophylaxis (PrEP) is an effective HIV prevention method. Barriers exist for both primary care providers (PCPs) to prescribe PrEP and prevent patients from initiating PrEP.

METHODS

This study, MOST: PrEP, follows the multiphase optimization strategy (MOST) framework. The purpose is to identify a multi-level intervention among patients and PCPs to increase PrEP prescriptions in primary care. First, feedback will be obtained from providers and patients via focus groups, then, suggestions related to the context-specific (provider and individual level) factors of intervention component delivery will be incorporated. Subsequently, a rigorous experiment will be conducted using a 24 factorial design focusing on priority populations for PrEP initiation. Provider components include computer-based simulation training and a best practice alert. Patient components include a tailored PrEP educational video and HIV risk assessment. Finally, the facilitators and barriers to implementing the intervention components will be qualitatively examined.

CONCLUSION

In this protocol paper, we describe the one of the first known multilevel MOST optimization trial in healthcare. Intervention components are to be delivered to patients and providers in a large healthcare system, based in an HIV Ending the Epidemic priority jurisdiction. If effective, this multi-level approach could be disseminated to providers and patients in other large healthcare systems to make a significant impact on HIV prevention.

A Literature Study of Medical Simulations for Non-Technical Skills Training in Emergency Medicine: Twenty Years of Progress, an Integrated Research Framework, and Future Research Avenues

Medical simulations have led to extensive developments in emergency medicine. Apart from the growing number of applications and research efforts in patient safety, few studies have focused on modalities, research methods, and professions via a synthesis of simulation studies with a focus on non-technical skills training. Intersections between medical simulation, non-technical skills training, and emergency medicine merit a synthesis of progress over the first two decades of the 21st century. Drawing on research from the Web of Science Core Collection's Science Citation Index Expanded and Social Science Citation Index editions, results showed that medical simulations were found to be effective, practical, and highly motivating. More importantly, simulation-based education should be a teaching approach, and many simulations are utilised to substitute high-risk, rare, and complex circumstances in technical or situational simulations. (1) Publications were grouped by specific categories of non-technical skills, teamwork, communication, diagnosis, resuscitation, airway management, anaesthesia, simulation, and medical education. (2) Although mixed-method and quantitative approaches were prominent during the time period, further exploration of qualitative data would greatly contribute to the interpretation of experience. (3) High-fidelity dummy was the most suitable instrument, but the tendency of simulators without explicitly stating the vendor selection calls for a standardised training process. The literature study concludes with a ring model as the integrated framework of presently known best practices and a broad range of underexplored research areas to be investigated in detail.

The Effect of Teaching Nontechnical Skills in Advanced Life Support: A Systematic Review

OBJECTIVES

The objective of this study was to evaluate the effect of nontechnical skills (NTS) training on performance in advanced life support (ALS) simulation. Furthermore, we aimed to determine the ideal frequency of training sessions for an optimal retention and the value of debriefing.

METHODS

A systematic search was performed using PubMed, EMBASE, WoS, ERIC, CINAHL, and the Cochrane Library conducted through August 1, 2018. All primary studies mentioning NTS in ALS education were included. Three reviewers independently extracted data on study design and outcome. The MERSQI approach was used to evaluate the overall quality of evidence.

RESULTS

Of the 10,723 identified articles, 40 studies were included with a combined total of 3,041 participants, ranging from students to experts. Depending on the focus of the study, articles were categorized in NTS (n = 25), retention (n = 8), and feedback (n = 10). Incorporating NTS during ALS simulation showed significant improvements in timing for performing critical first steps. Furthermore, good leadership skills had a favorable effect on overall technical performance and teamwork during simulation improved team dynamics and performance. Finally, debriefing also had a beneficial effect on team performance. One particular type of debriefing does not appear to be superior to other types of debriefing.

CONCLUSION

Team simulation training resulted in improved NTS and a reduction in the time required to complete a simulated cardiac arrest. Therefore, a formal NTS program should be introduced into ALS courses. Feedback and repetitive practice are key factors to train NTS. The impact of training on team behaviors can persist for at least 3 to 6 months. In conclusion, understanding and improving NTS may help to create more effective teams. The effect on patient outcome requires further investigation.

The effect of team and leadership training of advanced life support providers on patient outcomes: A systematic review

AIM

To conduct a systematic review evaluating improvement in team and leadership performance and resuscitation outcomes after such a training of healthcare providers during advanced life support (ALS) courses.

METHODS

This systematic review asked the question of whether students taking structured and standardised ALS courses in an educational setting which include specific leadership or team training, compared to no such specific training in these courses, improves patient survival, skill performance in actual resuscitations, skill performance at 3-15 months (patient tasks, teamwork, leadership), skill performance at course conclusion (patient tasks, teamwork, leadership), or cognitive knowledge PubMed, Embase and the Cochrane database were searched until April 2020. Screening of articles, analysis of risk of bias, outcomes and quality assessment were performed according to the Grading of Recommendations Assessment, Development and Evaluation methodology. Only studies with abstracts in English were included.

RESULTS

14 non-randomised studies and 17 randomised controlled trials, both in adults and children, and seven studies involving patients were included in this systematic review. No randomised controlled trials but three observational studies of team and leadership training showed improvement in the critical outcome of "patient survival". However, they suffered from risk of bias (indirectness and imprecision). The included studies reported many different methods to teach leadership skills and team behaviour.

CONCLUSION

This systematic review found very low certainty evidence that team and leadership training as part of ALS courses improved patient outcome. This supports the inclusion of team and leadership training in ALS courses for healthcare providers.

Education, Implementation, and Teams: 2020 International Consensus on Cardiopulmonary Resuscitation and Emergency Cardiovascular Care Science With Treatment Recommendations

For this 2020 International Consensus on Cardiopulmonary Resuscitation and Emergency Cardiovascular Care Science With Treatment Recommendations, the Education, Implementation, and Teams Task Force applied the population, intervention, comparator, outcome, study design, time frame format and performed 15 systematic reviews, applying the Grading of Recommendations, Assessment, Development, and Evaluation guidance. Furthermore, 4 scoping reviews and 7 evidence updates assessed any new evidence to determine if a change in any existing treatment recommendation was required. The topics covered included training for the treatment of opioid overdose; basic life support, including automated external defibrillator training; measuring implementation and performance in communities, and cardiac arrest centers; advanced life support training, including team and leadership training and rapid response teams; measuring cardiopulmonary resuscitation performance, feedback devices, and debriefing; and the use of social media to improve cardiopulmonary resuscitation application.

Education, Implementation, and Teams: 2020 International Consensus on Cardiopulmonary Resuscitation and Emergency Cardiovascular Care Science With Treatment Recommendations

For this 2020 International Consensus on Cardiopulmonary Resuscitation and Emergency Cardiovascular Care Science With Treatment Recommendations, the Education, Implementation, and Teams Task Force applied the population, intervention, comparator, outcome, study design, time frame format and performed 15 systematic reviews, applying the Grading of Recommendations, Assessment, Development, and Evaluation guidance. Furthermore, 4 scoping reviews and 7 evidence updates assessed any new evidence to determine if a change in any existing treatment recommendation was required. The topics covered included training for the treatment of opioid overdose; basic life support, including automated external defibrillator training; measuring implementation and performance in communities, and cardiac arrest centers; advanced life support training, including team and leadership training and rapid response teams; measuring cardiopulmonary resuscitation performance, feedback devices, and debriefing; and the use of social media to improve cardiopulmonary resuscitation application.

Systematic review of the characteristics of brief team interventions to clarify roles and improve functioning in healthcare teams

AIM

Describe brief (less than half a day) interventions aimed at improving healthcare team functioning.

METHODS

A systematic review on brief team interventions aimed at role clarification and team functioning (PROSPERO Registration Number: CRD42018088922). Experimental or quasi-experimental studies were included. Database searches included CINAHL, Medline, EMBASE, PUBMED, Cochrane, RCT Registry-1990 to April 2020 and grey literature. Articles were screened independently by teams of two reviewers. Risk of bias was assessed. Data from the retained articles were extracted by one reviewer and checked by a second reviewer independently. A narrative synthesis was undertaken.

RESULTS

Searches yielded 1928 unique records. Final sample contained twenty papers describing 19 studies, published between 2009 and 2020. Studies described brief training interventions conducted in acute care in-patient settings and included a total of 6338 participants. Participants' socio-demographic information was not routinely reported. Studies met between two to six of the eight risk of bias criteria. Interventions included simulations for technical skills, structured communications and speaking up for non-technical skills and debriefing. Debriefing sessions generally lasted between five to 10 minutes. Debriefing sessions reflected key content areas but it was not always possible to determine the influence of the debriefing session on participants' learning because of the limited information reported.

DISCUSSION

Interest in short team interventions is recent. Single two-hour sessions appear to improve technical skills. Three to four 30- to 60-minute training sessions spread out over several weeks with structured facilitation and debriefing appear to improve non-technical skills. Monthly meetings appear to sustain change over time.

CONCLUSION

Short team interventions show promise to improve team functioning. Effectiveness of interventions in primary care and the inclusion of patients and families needs to be examined. Primary care teams are structured differently than teams in acute care and they may have different priorities.

An Event-based Approach to Measurement: Facilitating Observational Measurement in Highly Variable Clinical Settings

BACKGROUND

Translational research in medical education requires the ability to rigorously measure learner performance in actual clinical settings; however, current measurement systems cannot accommodate the variability inherent in many patient care  environments. This is especially problematic in emergency medicine, where patients represent a wide spectrum of severity for a single clinical presentation. Our objective is to describe and implement EBAM, an event-based approach to measurement that can be applied to actual emergency medicine clinical events.

METHODS

We used a four-step event-based approach to create an emergency department trauma resuscitation patient care measure. We applied the measure to a database of 360 actual trauma resuscitations recorded in a Level I trauma center using trained raters. A subset (n = 50) of videos was independently rated in duplicate to determine inter-rater reliability. Descriptive analyses were performed to describe characteristics of resuscitation events and Cohen's kappa was used to calculate reliability.

RESULTS

The methodology created a metric containing both universal items that are applied to all trauma resuscitation events and conditional items that only apply in certain situations. For clinical trauma events, injury severity scores ranged from 1 to 75 with a mean (±SD) of 21 (±15) and included both blunt (254/360; 74%) and penetrating (86/360; 25%) traumatic injuries, demonstrating the diverse nature of the clinical encounters. The mean (±SD) Cohen's kappa for patient care items was 0.7 (±0.3).

CONCLUSION

We present an event-based approach to performance assessment that may address a major gap in translational education research. Our work centered on assessment of patient care behaviors during trauma resuscitation. More work is needed to evaluate this approach across a diverse array of clinical events.

Simulated patient scenario development: A methodological review of validity and reliability reporting

INTRODUCTION

Some healthcare scholars (educators and researchers) develop their own simulated patient scenarios to address specific learning objectives. Clear processes of validity and reliability are needed in the development of simulated scenarios for the purpose of replication and the transfer of findings to other contexts.

METHODS

This paper reports a methodological review of CINAHL to determine how valid and reliable simulated patient scenarios are developed. We reviewed 375 abstracts based on specific inclusion and exclusion criteria to yield 17 qualifying records. Data about the discipline, population, type of simulation, and validity and reliability processes were extracted.

RESULTS

Selected records were from nursing, medicine, and paramedicine. While some studies used high-fidelity simulations, some used low-fidelity or a combination of high- and low-fidelity simulations. Scholars validated scenarios by using personal experience, consulting experts, or requesting participant feedback. They also examined different types of validity (face, content, construct). Most studies did not address how reliability of scenarios was determined. To ensure consistency in scenario delivery, some studies piloted scenarios with participants, or examined performance through video-tapes or virtual patients.

CONCLUSIONS

This review shows that scholars use inconsistent processes to develop valid and reliable simulated patient scenarios, often overlooking evidence-based approaches to determining validity and reliability. Future practices pertaining to scenario development should use systematic processes in determining validity and reliability so simulation exercises can be replicated in other contexts.

Basic life support training using shared mental models improves team performance of first responders on normal wards: A randomised controlled simulation trial

INTRODUCTION

Survival of in-hospital cardiac arrest (IHCA) depends on fast and effective action of the first responding team. Not only technical skills, but professional teamwork is required. Observational studies and theoretical models suggest that shared mental models of members improve teamwork. This study investigated if a training on shared mental models, improves team performance in simulated in-hospital cardiac arrest.

METHODS

On the background of an introduction of mandatory Basic Life Support (BLS) training for clinical staff a randomized controlled trial was performed to compare two training methods. Staff from clinical departments was randomised to receive either a conventional instructor led training (control group) or an interventional training (intervention group). The interventional training was based on self-directed learning of the group in order to develop shared mental models. Primary outcome were mean scores of the team assessment scale (TAS) and the hands-off time. Secondary outcome were mean scores for quality of BLS.

RESULTS

Performance of 75 teams of the interventional and 66 of the control group was analysed. The hands-off time was significantly lower in the interventional group (5.42% vs. 8.85%, p = 0.029). Scores of the TAS and the overall BLS score were high and not significantly different between the groups. Hands-off time correlated significantly negative with all TAS items.

CONCLUSION

BLS training for clinical staff which creates shared mental models reduces hands-off time in a simulated cardiac arrest scenario. Training methods establishing shared mental models of team members can be considered for effective team trainings without adding additional training time.

Observer-based tools for non-technical skills assessment in simulated and real clinical environments in healthcare: a systematic review

Background

Over the past three decades multiple tools have been developed for the assessment of non-technical skills (NTS) in healthcare. This study was designed primarily to analyse how they have been designed and tested but also to consider guidance on how to select them.

Objectives

To analyse the context of use, method of development, evidence of validity (including reliability) and usability of tools for the observer-based assessment of NTS in healthcare.

Design

Systematic review.

Data sources

Search of electronic resources, including PubMed, Embase, CINAHL, ERIC, PsycNet, Scopus, Google Scholar and Web of Science. Additional records identified through searching grey literature (OpenGrey, ProQuest, AHRQ, King’s Fund, Health Foundation).

Study selection

Studies of observer-based tools for NTS assessment in healthcare professionals (or undergraduates) were included if they: were available in English; published between January 1990 and March 2018; assessed two or more NTS; were designed for simulated or real clinical settings and had provided evidence of validity plus or minus usability. 11,101 articles were identified. After limits were applied, 576 were retrieved for evaluation and 118 articles included in this review.

Results

One hundred and eighteen studies describing 76 tools for assessment of NTS in healthcare met the eligibility criteria. There was substantial variation in the method of design of the tools and the extent of validity, and usability testing. There was considerable overlap in the skills assessed, and the contexts of use of the tools.

Conclusion

This study suggests a need for rationalisation and standardisation of the way we assess NTS in healthcare and greater consistency in how tools are developed and deployed.

Development and Empirical Testing of a Novel Team Leadership Assessment Measure: A Pilot Study Using Simulated and Live Patient Encounters

BACKGROUND

Team leadership is critical to health care resuscitation team performance. There has been increased focus on competency in team leadership behaviors; however, there is still variability in how team leadership is assessed within emergency medicine. The objective of this study was to develop and pilot a novel team leadership assessment measure for emergency medicine resuscitation teams.

METHODS

Team leadership dimensions and associated behaviors were identified through a systematic literature review and expert consensus. Included behaviors were used to create behaviorally anchored rating scales, which were then revised based on subject matter expert ratings. Four raters from three different academic institutions observed 30 video-recorded resuscitations (20 simulated and 10 actual patient care resuscitations). Mean leadership scores were calculated. Intraclass coefficients (ICCs) were calculated for each item and for overall leadership scores. Leader scores for the simulation-based scenarios were compared to external variables including level of training, team process, clinical performance, and team situational awareness. The study was conducted from July 2017 through June 2018.

RESULTS

Leadership scores ranged from 2.23 to 4.30 (mean [±SD] = 3.18 [±0.50]). The ICC for the overall score was 0.79 for all observations, 0.87 for simulation-based observations, and 0.24 for the patient care observations. Team leadership scores on simulation-based observations did not correlate with available external variables.

CONCLUSIONS

We developed a novel team leadership assessment measure for emergency medicine resuscitation teams with supporting validity evidence, including content validity and response process. The measure demonstrated acceptable inter-rater reliability when applied to simulation-based medical resuscitations; however, this did not translate to trauma resuscitations in the actual patient care setting.

A Simulation-based Approach to Measuring Team Situational Awareness in Emergency Medicine: A Multicenter, Observational Study

OBJECTIVES

Team situational awareness (TSA) is critical for effective teamwork and supports dynamic decision making in unpredictable, time-pressured situations. Simulation provides a platform for developing and assessing TSA, but these efforts are limited by suboptimal measurement approaches. The objective of this study was to develop and evaluate a novel approach to TSA measurement in interprofessional emergency medicine (EM) teams.

METHODS

We performed a multicenter, prospective, simulation-based observational study to evaluate an approach to TSA measurement. Interprofessional emergency medical teams, consisting of EM resident physicians, nurses, and medical students, were recruited from the University of Washington (Seattle, WA) and Wayne State University (Detroit, MI). Each team completed a simulated emergency resuscitation scenario. Immediately following the simulation, team members completed a TSA measure, a team perception of shared understanding measure, and a team leader effectiveness measure. Subject matter expert reviews and pilot testing of the TSA measure provided evidence of content and response process validity. Simulations were recorded and independently coded for team performance using a previously validated measure. The relationships between the TSA measure and other variables (team clinical performance, team perception of shared understanding, team leader effectiveness, and team experience) were explored. The TSA agreement metric was indexed by averaging the pairwise agreement for each dyad on a team and then averaging across dyads to yield agreement at the team level. For the team perception of shared understanding and team leadership effectiveness measures, individual team member scores were aggregated within a team to create a single team score. We computed descriptive statistics for all outcomes. We calculated Pearson's product-moment correlations to determine bivariate correlations between outcome variables with two-tailed significance testing (p < 0.05).

RESULTS

A total of 123 participants were recruited and formed three-person teams (n = 41 teams). All teams completed the assessment scenario and postsimulation measures. TSA agreement ranged from 0.19 to 0.9 and had a mean (±SD) of 0.61 (±0.17). TSA correlated with team clinical performance (p < 0.05) but did not correlate with team perception of shared understanding, team leader effectiveness, or team experience.

CONCLUSIONS

Team situational awareness supports adaptive teams and is critical for high reliability organizations such as healthcare systems. Simulation can provide a platform for research aimed at understanding and measuring TSA. This study provides a feasible method for simulation-based assessment of TSA in interdisciplinary teams that addresses prior measure limitations and is appropriate for use in highly dynamic, uncertain situations commonly encountered in emergency department systems. Future research is needed to understand the development of and interactions between individual-, team-, and system (distributed)-level cognitive processes.

A review of simulation-enhanced, team-based cardiopulmonary resuscitation training for undergraduate students

Cardiopulmonary resuscitation training is an essential element of clinical skill development for healthcare providers. The International Liaison Committee on Resuscitation has described issues related to cardiopulmonary resuscitation and emergency cardiovascular care education. Educational interventions have been initiated to try to address these issues using a team-based approach and simulation technologies that offer a controlled, safe learning environment. The aim of the study is to review and synthesize published studies that address the primary question "What are the features and effectiveness of educational interventions related to simulation-enhanced, team-based cardiopulmonary resuscitation training?" We conducted a systematic review focused on educational interventions pertaining to cardiac arrest and emergencies that addressed this main question. The findings are presented together with a discussion of the effectiveness of various educational interventions. In conclusion, student attitudes toward interprofessional learning and simulation experiences were more positive. Research reports emphasized the importance of adherence to established guidelines, adopting a holistic approach to training, and that preliminary training, briefing, deliberate practices, and debriefing should help to overcome deficiencies in cardiopulmonary resuscitation training.

Interprofessional Team Training at the Prelicensure Level: A Review of the Literature

PURPOSE

The authors undertook a descriptive analysis review to gain a better understanding of the various approaches to and outcomes of team training initiatives in prelicensure curricula since 2000.

METHOD

In July and August 2014, the authors searched the MEDLINE, PsycINFO, Embase, Business Source Premier, and CINAHL databases to identify evaluative studies of team training programs' effects on the team knowledge, communication, and skills of prelicensure students published from 2000 to August 2014. The authors identified 2,568 articles, with 17 studies meeting the selection criteria for full text review.

RESULTS

The most common study designs were single-group, pre/posttest studies (n = 7), followed by randomized controlled or comparison trials (n = 6). The Situation, Background, Assessment, Recommendation communication tool (n = 5); crisis resource management principles (n = 6); and high-fidelity simulation (n = 4) were the most common curriculum bases used. Over half of the studies (n = 9) performed training with students from more than one health professions program. All but three used team performance assessments, with most (n = 8) using observed behavior checklists created for that specific study. The majority of studies (n = 16) found improvements in team knowledge, communication, and skills.

CONCLUSIONS

Team training appears effective in improving team knowledge, communication, and skills in prelicensure learners. Continued exploration of the best method of team training is necessary to determine the most effective way to move forward in prelicensure interprofessional team education.

Leadership and Teamwork in Trauma and Resuscitation

INTRODUCTION

Leadership skills are described by the American College of Surgeons' Advanced Trauma Life Support (ATLS) course as necessary to provide care for patients during resuscitations. However, leadership is a complex concept, and the tools used to assess the quality of leadership are poorly described, inadequately validated, and infrequently used. Despite its importance, dedicated leadership education is rarely part of physician training programs. The goals of this investigation were the following: 1. Describe how leadership and leadership style affect patient care; 2. Describe how effective leadership is measured; and 3. Describe how to train future physician leaders.

METHODS

We searched the PubMed database using the keywords "leadership" and then either "trauma" or "resuscitation" as title search terms, and an expert in emergency medicine and trauma then identified prospective observational and randomized controlled studies measuring leadership and teamwork quality. Study results were categorized as follows: 1) how leadership affects patient care; 2) which tools are available to measure leadership; and 3) methods to train physicians to become better leaders.

RESULTS

We included 16 relevant studies in this review. Overall, these studies showed that strong leadership improves processes of care in trauma resuscitation including speed and completion of the primary and secondary surveys. The optimal style and structure of leadership are influenced by patient characteristics and team composition. Directive leadership is most effective when Injury Severity Score (ISS) is high or teams are inexperienced, while empowering leadership is most effective when ISS is low or teams more experienced. Many scales were employed to measure leadership. The Leader Behavior Description Questionnaire (LBDQ) was the only scale used in more than one study. Seven studies described methods for training leaders. Leadership training programs included didactic teaching followed by simulations. Although programs differed in length, intensity, and training level of participants, all programs demonstrated improved team performance.

CONCLUSION

Despite the relative paucity of literature on leadership in resuscitations, this review found leadership improves processes of care in trauma and can be enhanced through dedicated training. Future research is needed to validate leadership assessment scales, develop optimal training mechanisms, and demonstrate leadership's effect on patient-level outcome.

Assessing Team Leadership in Emergency Medicine: The Milestones and Beyond

BACKGROUND

Team leadership is a critical skill for emergency medicine physicians that directly affects team performance and the quality of patient care. There exists a robust body of team science research supporting team leadership conceptual models and behavioral skill sets. However, to date, this work has not been widely incorporated into health care team leadership education.

OBJECTIVE

This narrative review has 3 aims: (1) to synthesize the team science literature and to translate important concepts and models to health care team leadership; (2) to describe how team leadership is currently represented in the health care literature and in the Accreditation Council for Graduate Medical Education Milestones for emergency medicine; and (3) to propose a novel, evidence-based framework for the assessment of team leadership in emergency medicine.

METHODS

We conducted a narrative review of the team science and health care literature. We summarized our findings and identified a list of team leadership behaviors that were then used to create a framework for team leadership assessment.

RESULTS

Current health care team leadership measurement tools do not incorporate evidence-based models of leadership concepts from other established domains. The emergency medicine milestones include several team leadership behaviors as part of a larger resident evaluation program. However, they do not offer a comprehensive or cohesive representation of the team leadership construct.

CONCLUSIONS

Despite the importance of team leadership to patient care, there is no standardized approach to team leadership assessment in emergency medicine. Based on the results of our review, we propose a novel team leadership assessment framework that is supported by the team science literature.

Addressing the Interprofessional Collaboration Competencies of the Association of American Medical Colleges: A Systematic Review of Assessment Instruments in Undergraduate Medical Education

PURPOSE

To summarize characteristics and validity evidence of tools that assess teamwork in undergraduate medical education (UME), and provide recommendations for addressing the interprofessional collaboration competencies of the Association of American Medical Colleges (AAMC).

METHOD

The authors conducted a systematic review, searching MEDLINE, MEDLINE In-process, CINAHL, and PsycINFO from January 1, 1979, through April 1, 2014; they searched reference lists and national meeting abstracts. They included original research reports that described a quantitative tool used to assess teamwork in UME. They abstracted characteristics and validity evidence for the tools, plus study quality, according to established frameworks. Two authors independently abstracted 25% of articles and calculated agreement. Authors then applied predefined criteria to identify tools best suited to address the AAMC's teamwork competencies.

RESULTS

Of 13,549 citations, 70 articles describing 64 teamwork assessment tools were included. Of these 64 tools, 27 (42%) assessed teamwork in classroom, 31 (48%) in simulation, and only 7 (11%) in actual clinical settings. The majority (47; 73%) of tools assessed medical students' teamwork in interprofessional teams. On the basis of content concordance, strength of validity evidence, generalizability of scores, and level of outcomes, four published tools were recommended to assess the AAMC's teamwork competencies: the Collaborative Healthcare Interdisciplinary Relationship Planning Scale, Readiness for Interprofessional Learning Scale, Communication and Teamwork Skills assessment, and Teamwork Mini-Clinical Evaluation Exercise.

CONCLUSIONS

Substantial validity evidence supports the use of several UME teamwork assessments. Four tools have been appropriately designed and sufficiently studied to constitute appropriate assessments of the AAMC's teamwork competencies.

Thai nursing students' experiences when attending real life situations involving cardiac life support: A Phenomenological study

BACKGROUND

During the last few years, manikin simulations have been used for cardiac life support training procedures in medical and nursing education. However, some nursing students have experienced attending real events involving cardiac life support during their clinical practice.

OBJECTIVE

This study aims to describe the meaning of experience of Thai nursing students when attending real situations of cardiac life support.

METHODS

A hermeneutic phenomenological study was used. Third and fourth year bachelor of nursing students at a university in the southern region of Thailand who had the experience of attending real situation of cardiac life support were purposely selected as the informants. The data were generated from individual in-depth interviews with eighteen nursing students. Van Manen's approach was used to analyze the data. Trustworthiness was established using the criteria set out by Lincoln and Guba.

RESULTS

Essential themes situated in the context of the four existential grounds of body, time, space, and relation emerged. These were: being worried and fearful while desiring to participate in cardiac life support procedures; enhancing self value; knowing each moment is meaningful for one's life; having time to understand the reality of life; being in a small corner; appreciating such opportunities and the encouragement given by nurses and the healthcare team; and feeling empathy.

CONCLUSIONS

Besides learning in classrooms and practicing in labs, experiencing real situations is beneficial for nursing students in learning cardiac life support. This study provides information that can be used for clinical teaching management in the topics relating to cardiac life support.

Leveraging Social Science-Healthcare Collaborations to Improve Teamwork and Patient Safety

Effective teamwork is critical to the provision of safe, effective healthcare. High functioning teams adapt to rapidly changing patient and environmental factors, preventing diagnostic and treatment errors. While the emphasis on teamwork and patient safety is relatively new, significant team-related foundational and implementation research exists in disciplines outside of healthcare. Social scientists, including, organizational psychologists, have expertise in the study of teams, multi-team units, and organizations. This article highlights guiding team science principles from the organizational psychology literature that can be applied to the study of teams in healthcare. The authors' goal is to provide some common language and understanding around teams and teamwork. Additionally, they hope to impart an appreciation for the potential synergy present within clinician-social scientist collaborations.

Improving Resident Performance Through a Simulated Rapid Response Team: A Pilot Study

BACKGROUND

The Joint Commission requires hospitals to develop systems in which a team of clinicians can rapidly recognize and respond to changes in a patient's condition. The rapid response team (RRT) concept has been widely adopted as the solution to this mandate. The role of house staff in RRTs and the impact on resident education has been controversial. At Christiana Care Health System, eligible residents in their second through final years lead the RRTs.

OBJECTIVE

To evaluate the use of a team-based, interdisciplinary RRT training program for educating and training first-year residents in an effort to improve global RRT performance before residents start their second year.

METHODS

This pilot study was administered in 3 phases. Phase 1 provided residents with classroom-based didactic sessions using case-based RRT scenarios. Multiple choice examinations were administered, as well as a confidence survey based on a Likert scale before and after phase 1 of the program. Phase 2 involved experiential training in which residents engaged as mentored participants in actual RRT calls. A qualitative survey was used to measure perceived program effectiveness after phase 2. In phase 3, led by senior residents, simulated RRTs using medical mannequins were conducted. Participants were divided into 5 teams, in which each resident would rotate in the roles of leader, nurse, and respiratory therapist. This phase measured resident performance with regard to medical decision making, data gathering, and team behaviors during the simulated RRT scenarios. Performance was scored by an attending and a senior resident.

RESULTS

A total of 18 residents were eligible (N=18) for participation. The average multiple choice test score improved by 20% after didactic training. The average confidence survey score before training was 3.44 out of 5 (69%) and after training was 4.13 (83%), indicating a 14% improvement. High-quality team behaviors correlated with medical decision making (0.92) more closely than did high-quality data gathering (0.11). This difference narrowed during high-pressure scenarios (0.84 and 0.72, respectively).

CONCLUSION

Our data suggest that resident training using a team-based, interdisciplinary RRT training program may improve resident education, interdisciplinary team-based dynamics, and global RRT performance. In turn, data gathering and medical decision making may be enhanced, which may result in better patient outcomes during RRT scenarios.

Implementing a third-year emergency medicine medical student curriculum

BACKGROUND

Emergency medicine (EM) is commonly introduced in the fourth year of medical school because of a perceived need to have more experienced students in the complex and dynamic environment of the emergency department. However, there is no evidence supporting the optimal time or duration for an EM rotation, and a number of institutions offer third-year rotations.

OBJECTIVE

A recently published syllabus provides areas of knowledge, skills, and attitudes that third-year EM rotation directors can use to develop curricula. This article expands on that syllabus by providing a comprehensive curricular guide for the third-year medical student rotation with a focus on implementation.

DISCUSSION

Included are consensus-derived learning objectives, discussion of educational methods, considerations for implementation, and information on feedback and evaluation as proposed by the Clerkship Directors in Emergency Medicine Third-Year Curriculum Work Group. External validation results, derived from a survey of third-year rotation directors, are provided in the form of a content validity index for each content area.

CONCLUSIONS

This consensus-derived curricular guide can be used by faculty who are developing or revising a third-year EM medical student rotation and provide guidance for implementing this curriculum at their institution.

Critical appraisal of emergency medicine education research: the best publications of 2013

OBJECTIVES

The objective was to critically appraise and highlight methodologically superior medical education research articles published in 2013 whose outcomes are pertinent to teaching and education in emergency medicine (EM).

METHODS

A search of the English-language literature in 2013 querying Education Resources Information Center (ERIC), PsychINFO, PubMed, and Scopus identified 251 EM-related studies using hypothesis-testing or observational investigations of educational interventions. Two reviewers independently screened all of the publications and removed articles using established exclusion criteria. Six reviewers then independently scored the remaining 43 publications using either a qualitative a or quantitative scoring system, based on the research methodology of each article. Each scoring system consisted of nine criteria. Selected criteria were based on accepted educational review literature and chosen a priori. Both scoring systems used parallel scoring metrics and have been used previously within this annual review.

RESULTS

Forty-three medical education research papers (37 quantitative and six qualitative studies) met the a priori criteria for inclusion and were reviewed. Six quantitative and one qualitative study were scored and ranked most highly by the reviewers as exemplary and are summarized in this article.

CONCLUSIONS

This annual critical appraisal article aims to promote superior research in EM-related education, by reviewing and highlighting seven of 43 major education research studies, meeting a priori criteria, and published in 2013. Common methodologic pitfalls in the 2013 papers are noted, and current trends in medical education research in EM are discussed.