Teamwork behaviours and errors during neonatal resuscitation

Quality improvement initiative: implementing and redefining video review of real-time neonatal procedures using action research

Video review (VR) of procedures in the medical environment can be used to drive quality improvement. However, first it has to be implemented in a safe and effective way. Our primary objective was to (re)define a guideline for implementing interprofessional VR in a neonatal intensive care unit (NICU). Our secondary objective was to determine the rate of acceptance by providers attending VR. For 9 months, VR sessions were evaluated with a study group, consisting of different stakeholders. A questionnaire was embedded at the end of each session to obtain feedback from providers on the session and on the safe learning environment. In consensus meetings, success factors and preconditions were identified and divided into different factors that influenced the rate of adoption of VR. The number of providers who recorded procedures and attended VR sessions was determined. A total of 18 VR sessions could be organised, with an equal distribution of medical and nursing staff. After the 9-month period, 101/125 (81%) of all providers working on the NICU attended at least 1 session and 80/125 (64%) of all providers recorded their performance of a procedure at least 1 time. In total, 179/297 (61%) providers completed the questionnaire. Almost all providers (99%) reported to have a positive opinion about the review sessions. Preconditions and success factors related to implementation were identified and addressed, including improving the pathway for obtaining consent, preparation of VR, defining the role of the chair during the session and building a safe learning environment. Different strategies were developed to ensure findings from sessions were used for quality improvement. VR was successfully implemented on our NICU and we redefined our guideline with various preconditions and success factors. The adjusted guideline can be helpful for implementation of VR in emergency care settings.

Record, reflect and refine: using video review as an initiative to improve neonatal care

BACKGROUND

The goal of every medical team is to provide optimal care for their patients. We aimed to use video review (VR) sessions to identify and address areas for improvement in neonatal care.

METHODS

For nine months, neonatal procedures (stabilization at birth, intubations and sterile line insertions) were video recorded and reviewed with the neonatal care providers. Action research was used to identify and address areas for improvement which were categorized as (1) protocol/equipment adjustments, (2) input for research, (3) aspects of variety, or (4) development of educational material or training programs.

RESULTS

Eighteen VR sessions were organized with a mean(SD) of 17(5) staff members participating. In total, 120 areas for improvement were identified and addressed, of which 84/120 (70%) were categorized as aspects of variety, 20/120 (17%) as development of educational material or training programs, 10/120 (8%) as protocol/equipment adjustments, and 6/120 (5%) as input for research. The areas for improvement were grouped in themes per category, including sterility, technique, equipment, communication, teamwork, parents' perspective and ventilation.

CONCLUSION

Our study showed that regularly organized VR empowered healthcare providers to identify and address a large variety of areas for improvement, contributing to continuous learning and improvement processes.

IMPACT

Video review empowered healthcare providers to identify areas for improvement in neonatal care Video review gave providers the opportunity to address identified areas for improvement, either by enhancing the application of external evidence (i.e. guidelines), learning from individual clinical expertise or strengthening resilience and teamwork Embedding regularly organized video review sessions allowed for continuous monitoring of care by providers, which can be beneficial for creating ongoing learning and improvement processes The structured pathways, supporting implementation of changes that were proposed based on the video review sessions, could help other centers make use of the potential video review has to offer.

Strengths and weaknesses of the incident reporting system: An Italian experience

One of the cornerstones for enhancing the patient safety culture is the incident reporting system (IRS). It is a process for detecting, reporting, collecting, and summarizing adverse events (AEs) and near-misses in healthcare, and so it represents a vital tool for clinical risk management. We analyzed the 5-year experience of a third-level hospital's IRSs, showing its trends and highlighting its main strengths and weaknesses. Patients’ falls and physical or verbal aggression toward the providers or between patients are the most reported events. Underreporting is the main limitation of the system, especially among nurses. Visible actions, forceful analysis of the reports, operators’ education, no-blame culture promotion, and organizational adjustments may improve operators’ adherence to IRS. Providers do not willingly inform patients’ relatives about fatal incidents. Despite that, the IRS is far from its potential, and the number of data collected has increased.

Assessing the healthcare quality issues for digital incident reporting in Sweden: Incident reports analysis

Objective

This study explored healthcare quality issues affecting the reporting and investigation levels of digital incident reporting systems.

Methods

A total of 38 health information technology-related incident reports (free-text narratives) were collected from one of Sweden's national incident reporting repositories. The incidents were analysed using an existing framework, i.e., the Health Information Technology Classification System, to identify the types of issues and consequences. The framework was applied in two fields, 'event description' by the reporters and 'manufacturer's measures', to assess the quality of reporting incidents by the reporters. Additionally, the contributing factors, i.e., either human or technical factors for both fields, were identified to evaluate the quality of the reported incidents.

Results

Five types of issues were identified and changes made between before-and-after investigations: Machine to software-related issues (n  =  8), machine to use-related issues (n  =  5), software to software-related issues (n  =  5), use to software-related issues (n  =  4) and use to use-related issues (n  =  1). Over two-thirds (n  =  15) of the incidents demonstrated a change in the contributing factors after the investigation. Only four incidents were identified as altering the consequences after the investigation.

Conclusion

This study shed some light on the issues of incident reporting and the gap between the reporting and investigation levels. Facilitating sufficient staff training sessions, agreeing on common terms for health information technology systems, refining the existing classifications systems, enforcing mini-root cause analysis, and ensuring unit-based local reporting and standard national reporting may help bridge the gap between reporting and investigation levels in digital incident reporting.

Electronic Decision Support in the Delivery Room Using Augmented Reality to Improve Newborn Life Support Guideline Adherence: A Randomized Controlled Pilot Study

INTRODUCTION

The Newborn Life Support (NLS) guideline aims to provide healthcare professionals a consistent approach during neonatal resuscitation. Adherence to this and analogous guidelines has repetitively been proven to be difficult.This study evaluates adherence to guideline using a novel augmented reality (Microsoft HoloLens) electronic decision support tool during standardized simulated neonatal resuscitation compared with subjects working from memory alone.

METHODS

In this randomized controlled pilot study, 18 professionals responsible for neonatal resuscitation were randomized to the intervention group and 11 to the control group. Demographic characteristics were similar between both groups. A standardized neonatal resuscitation scenario was performed, which was recorded and later assessed for adherence to the NLS algorithm by 2 independent reviewers. Secondary outcomes were error classification in case of algorithm deviation and time to the execution or completion of critical steps in the algorithm to determine delay.

RESULTS

Median (interquartile range) scores of a theoretical maximum of 40 in the intervention group were 34 (32.5-35.5) versus 29 (27-33) in the control group ( P = 0.004). Errors of commission were committed less frequently with the electronic decision support tool 2 (1-2.5) compared with 4 (2-4) in the control group ( P = 0.029). Analysis of time to initiation or completion of key steps in the NLS algorithm showed no significant differences between both groups.

CONCLUSIONS

Healthcare professionals using an electronic decision support tool showed improved adherence to the NLS guideline during simulated neonatal resuscitation.

Video recording emergency care and video-reflection to improve patient care; a narrative review and case-study of a neonatal intensive care unit

As the complexity of emergency care increases, current research methods to improve care are often unable to capture all aspects of everyday clinical practice. Video recordings can visualize clinical care in an objective way. They can be used as a tool to assess care and to reflect on care with the caregivers themselves. Although the use of video recordings to reflect on medical interventions (video-reflection) has increased over the years, it is still not used on a regular basis. However, video-reflection proved to be of educational value and can improve teams' management and performance. It has a positive effect on guideline adherence, documentation, clinical care and teamwork. Recordings can also be used for video-reflexivity. Here, caregivers review recordings together to reflect on their everyday practice from new perspectives with regard to context and conduct in general. Although video-reflection in emergency care has proven to be valuable, certain preconditions have to be met and obstacles need to be overcome. These include gaining trust of the caregivers, having a proper consent-procedure, maintaining confidentiality and adequate use of technical equipment. To implement the lessons learned from video-reflection in a sustainable way and to continuously improve care, it should be integrated in regular simulation training or education. This narrative review will describe the development of video recording in emergency care and how video-reflection can improve patient care and safety in new ways. On our own department, the NICU at the LUMC, video-reflection has already been implemented and we want to further expand this. We will describe the use of video-reflection in our own unit. Based on the results of this narrative review we will propose options for future research to increase the value of video-reflection.

Teamwork and Adherence to Guideline on Newborn Resuscitation-Video Review of Neonatal Interdisciplinary Teams

BACKGROUND

Little is known about the importance of non-technical skills for the adherence to guidelines, when teams of midwives, obstetricians, anesthesiologists, and pediatricians resuscitate and support the transition of newborns. Non-technical skills are competences underpinning successful teamwork in healthcare. These are usually referred to as leadership, situational awareness, communication, teamwork, decision making, and coping with stress and fatigue.

OBJECTIVE

By review of videos of teams managing newborns with difficult transition, we aimed to investigate whether the level of the teams' non-technical skills was associated with the degree of adherence to guidelines for newborn resuscitation and transitional support at birth.

METHODS

Four expert raters independently assessed 43 real-life videos of teams managing newborns with transitional difficulties, two assessed the non-technical score and two assessed the clinical performance. Exposure was the non-technical score, obtained by the Global Assessment Of Team Performance checklist (GAOTP). GAOTP was rated on a Likert Scale 1-5 (1 = poor, 3 = average and 5 = excellent). The outcome was the clinical performance score of the team assessed according to adherence of the European Resuscitation Counsel (ERC) guideline for neonatal resuscitation and transitional support. The ERC guideline was adapted into the checklist TeamOBS-Newborn to facilitate a structured and simple performance assessment (low score 0-60, average 60-84, high 85-100). Interrater agreement was analyzed by intraclass correlation (ICC), Bland-Altman analysis, and Cohen's kappa weighted. The risk of high and low clinical performance was analyzed on the logit scale to meet the assumptions of normality and constant standard deviation.

RESULTS

Teams with an excellent non-technical score had a relative risk 5.5 [95% confidence interval (CI) 2.4-22.5] of high clinical performance score compared to teams with average non-technical score. In addition, we found a dose response like association. The specific non-technical skills associated with the highest degree of adherence to guidelines were leadership and teamwork, coping with stress and fatigue, and communication with parents. Inter-rater agreement was high; raters assessing non-technical skills had an interclass coefficient (ICC) 0.88 (95% CI 0.79-0.94); the neonatologists assessing clinical performance had an ICC of 0.81 (95% CI 0.66-0.89).

CONCLUSION

Teams with an excellent non-technical score had five times the chance of high clinical performance compared to teams with average non-technical skills. High performance teams were characterized by good leadership and teamwork, coping with stress, and fatigue and communication with parents.

Classification strategies for non-routine events occurring in high-risk patient care settings: A scoping review

INTRODUCTION

Non-routine events (NREs) are atypical or unusual occurrences in a pre-defined process. Although some NREs in high-risk clinical settings have no adverse effects on patient care, others can potentially cause serious patient harm. A unified strategy for identifying and describing NREs in these domains will facilitate the comparison of results between studies.

METHODS

We conducted a literature search in PubMed, CINAHL, and EMBASE to identify studies related to NREs in high-risk domains and evaluated the methods used for event observation and description. We applied The Joint Commission on Accreditation of Healthcare Organization (JCAHO) taxonomy (cause, impact, domain, type, prevention, and mitigation) to the descriptions of NREs from the literature.

RESULTS

We selected 25 articles that met inclusion criteria for review. Real-time documentation of NREs was more common than a retrospective video review. Thirteen studies used domain experts as observers and seven studies validated observations with interrater reliability. Using the JCAHO taxonomy, "cause" was the most frequently applied classification method, followed by "impact," "type," "domain," and "prevention and mitigation."

CONCLUSIONS

NREs are frequent in high-risk medical settings. Strengths identified in several studies included the use of multiple observers with domain expertise and validation of the event ascertainment approach using interrater reliability. By applying the JCAHO taxonomy to the current literature, we provide an example of a structured approach that can be used for future analyses of NREs.

Translation, Cross-Cultural Adaptation, and Measurement Properties of the Portuguese Version of the Global Trigger Tool for Adverse Events

Purpose

To adapt and validate the Global Trigger Tool (IHI-GTT), which identifies and analyzes adverse events (AE) in hospitalized patients and their measurement properties in the Portuguese context.

Methods

A retrospective cross-sectional study was based on a random sample of 90 medical records. The stages of translation and cross-cultural adaptation of the IHI-GTT were based on the Cross-Cultural Adaptation Protocol that originated from the Portuguese version, GTT-PT, for the hospital context in medical-surgical departments. Internal consistency, reliability, reproducibility, diagnostic tests, and discriminatory predictive value were investigated.

Results

The final phase of the GTT-PT showed insignificant inconsistencies. The pre-test phase confirmed translation accuracy, easy administration, effectiveness in identifying AEs, and relevance of integrating it into hospital risk management. It had a sensitivity of 97.8% and specificity of 74.8%, with a cutoff point of 0.5, an accuracy of 83%, and a positive predictive value of 69.8% and a negative predictive value of 0.98%.

Conclusion

The GTT-PT is a reliable, accurate, and valid tool to identify AE, with robust measurement properties.

The experiences of the community pharmacy team in supporting people with dementia and family carers with medication management during the COVID-19 pandemic

BACKGROUND

The novel coronavirus COVID-19 pandemic has changed the lives of people across the globe in significant and long-lasting ways. People with dementia were significantly and disproportionally affected at the height of the pandemic in England. Community pharmacies in England continued to operate during the pandemic but had to adjust the way they provided key healthcare services. The impact of these changes on the provision of medication services to people with dementia is underexplored.

OBJECTIVE

To explore the experiences of the community pharmacy team in supporting people with dementia and their family carers with the management of medications during the COVID-19 pandemic.

METHODS

An interpretivist/constructivist research paradigm was used; semi-structured one-to-one telephone interviews were conducted with any member of the community pharmacy team who had been involved in providing medication services to people with dementia in England before and during the COVID-19 pandemic. Recruitment took place between July and August 2020. Interviews were audio-recorded, transcribed verbatim and analysed using thematic analysis.

RESULTS

Fourteen participants were interviewed with equal numbers of qualified pharmacists and non-pharmacist staff. Participants were in their role for an average of 4.5 years. The analysis of interviews generated three themes: 1) key interactions curtailed due to COVID-19 restrictions, 2) utilising resources within and outside of the pharmacy to provide tailored services for people with dementia, and 3) the interplay between professional duty and personal values underpinned decisions to provide medication services.

CONCLUSIONS

The study provided a unique and important first insights to our understanding of how the community pharmacy team in England supported people with dementia and their family carers during the COVID-19 pandemic. These insights provide opportunities for reflection by individuals, healthcare teams, healthcare organisations, policy makers and the public, in an international context, to enable long-term planning, investment and implementation of strategies beyond the current pandemic.

Silence is golden: the role of team coordination in health operations

Purpose

This study investigates the relationships between team dynamics and performance in healthcare operations. Specifically, it explores, through wearable sensors, how team coordination mechanisms can influence the likelihood of surgical glitches during routine surgery.

Design/methodology/approach

Breast surgeries of a large Italian university hospital were monitored using Sociometric Badges – wearable sensors developed at MIT Media Lab – for collecting objective and systematic measures of individual and group behaviors in real time. Data retrieved were used to analyze team coordination mechanisms, as it evolved in the real settings, and finally to test the research hypotheses.

Findings

Findings highlight that a relevant portion of glitches in routine surgery is caused by improper team coordination practices. In particular, results show that the likelihood of glitches decreases when practitioners adopt implicit coordination mechanisms rather than explicit ones. In addition, team cohesion appears to be positively related with the surgical performance.

Originality/value

For the first time, direct, objective and real time measurements of team behaviors have enabled an in-depth evaluation of the team coordination mechanisms in surgery and the impact on surgical glitches. From a methodological perspective, this research also represents an early attempt to investigate coordination behaviors in dynamic and complex operating environments using wearable sensor tools.

Mindset Moderates Healthcare Providers' Longitudinal Performance in a Digital Neonatal Resuscitation Simulator

Background: Simulation education can benefit healthcare providers (HCPs) by providing opportunities to practice complex neonatal-resuscitation tasks in low-stake environments. To our knowledge, no study investigated the role of growth mindset on longitudinal performance on neonatal resuscitation before and after simulation-based training. Objectives: This study examines whether 1) the RETAIN digital/table-top simulators facilitate HCPs' neonatal resuscitation knowledge gain, retention, and transfer and 2) growth mindset moderates HCPs' longitudinal performance in neonatal resuscitation. Methods: Participants were n = 50 HCPs in a tertiary perinatal center in Edmonton, Canada. This longitudinal study was conducted in three stages including 1) a pretest and a mindset survey, immediately followed by a posttest using the RETAIN digital simulator from April to August 2019; 2) a 2-month delayed posttest using the same RETAIN neonatal resuscitation digital simulator from June to October 2019; and 3) a 5-month delayed posttest using the low-fidelity table-top neonatal resuscitation digital simulator from September 2019 to January 2020. Three General Linear Mixed Model (GLMM) repeated-measure analyses investigated HCPs' performance on neonatal resuscitation over time and the moderating effect of growth mindset on the association between test time points and task performance. Results: Compared with their pretest performance, HCPs effectively improved their neonatal resuscitation knowledge after the RETAIN digital simulation-based training on the immediate posttest (Est = 1.88, p < 0.05), retained their knowledge on the 2-month delayed posttest (Est = 1.36, p < 0.05), and transferred their knowledge to the table-top simulator after 5 months (Est = 2.01, p < 0.05). Although growth mindset did not moderate the performance gain from the pretest to the immediate posttest, it moderated the relationship between HCPs' pretest and long-term knowledge retention (i.e., the interaction effect of mindset and the 2-month posttest was significant: Est = 0.97, p < 0.05). The more they endorsed a growth mindset, the better the HCPs performed on the posttest, but only when they were tested after 2 months. Conclusions: Digital simulators for neonatal resuscitation training can effectively facilitate HCPs' knowledge gain, maintenance, and transfer. Besides, growth mindset shows a positive moderating effect on the longitudinal performance improvement in simulation-based training. Future research can be conducted to implement growth-mindset interventions promoting more effective delivery of technology-enhanced, simulation-based training and assessment.

How effective is teamwork really? The relationship between teamwork and performance in healthcare teams: a systematic review and meta-analysis

OBJECTIVES

To investigate the relationship between teamwork and clinical performance and potential moderating variables of this relationship.

DESIGN

Systematic review and meta-analysis.

DATA SOURCE

PubMed was searched in June 2018 without a limit on the date of publication. Additional literature was selected through a manual backward search of relevant reviews, manual backward and forward search of studies included in the meta-analysis and contacting of selected authors via email.

ELIGIBILITY CRITERIA

Studies were included if they reported a relationship between a teamwork process (eg, coordination, non-technical skills) and a performance measure (eg, checklist based expert rating, errors) in an acute care setting.

DATA EXTRACTION AND SYNTHESIS

Moderator variables (ie, professional composition, team familiarity, average team size, task type, patient realism and type of performance measure) were coded and random-effect models were estimated. Two investigators independently extracted information on study characteristics in accordance with Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines.

RESULTS

The review identified 2002 articles of which 31 were included in the meta-analysis comprising 1390 teams. The sample-sized weighted mean correlation was r=0.28 (corresponding to an OR of 2.8), indicating that teamwork is positively related to performance. The test of moderators was not significant, suggesting that the examined factors did not influence the average effect of teamwork on performance.

CONCLUSION

Teamwork has a medium-sized effect on performance. The analysis of moderators illustrated that teamwork relates to performance regardless of characteristics of the team or task. Therefore, healthcare organisations should recognise the value of teamwork and emphasise approaches that maintain and improve teamwork for the benefit of their patients.

Surgeon Workload in Colorectal Surgery: Perceived Drivers of Procedural Difficulty

BACKGROUND

To understand how surgeon expectation of case difficulty relates to workload for colon and rectal procedures and to identify possible surgeon-perceived drivers contributing to case difficulty.

MATERIALS AND METHODS

For 3 mo, surgeons were asked to complete a modified NASA-Task Load Index (NASA-TLX) questionnaire following each surgical case. Questions included items on distractions, fatigue, procedural difficulty, and expectation plus the validated NASA-TLX items. All but expectation were rated on a 20-point scale (0 = low, 20 = high). Expectation was rated on a 3-point scale (i.e., more difficult than expected, as expected, less difficult than expected). Surgeons also reported perceived drivers contributing to case ease or difficulty. Patient and procedural data were analyzed for procedures with completed surveys.

RESULTS

Seven surgeons (three female) rated 122 procedures over the research period using a modified NASA-TLX survey. Mean surgeon-perceived workload was highest for effort (mean [M] = 10.83, standard deviation [SD] = 5.66) followed by mental demand (M = 10.18, SD = 5.17), and physical demand (M = 9.19, SD = 5.60). Procedural difficulty varied significantly by procedure type (P < 0.001). Thirty-five percent of cases were considered more difficult than expected. Surgeon-perceived workload and most subscales differed significantly according to expectation level. There was no significant difference in patient factors by expectation level. Surgeons most frequently reported patient anatomy, body habitus, and operative team characteristics as drivers to difficulty and ease of cases.

CONCLUSIONS

Procedural difficulty significantly differed across procedure type. More than one-third of cases were more difficult than expected, during which surgeons attributed this to operative team characteristics as well as issues in patient anatomy and body habitus.

Facilitators of and barriers to successful teamwork during resuscitations in a neonatal intensive care unit

OBJECTIVE

Effective teamwork is essential in high-risk healthcare delivery environments. In this study, we aimed to identify facilitators of and barriers to successful teamwork during resuscitations in the NICU Study Design: 36 in-situ interprofessional simulation sessions were held in a level 4 NICU. Each session was followed by a debriefing where staff talked about the simulation scenario but also about their prior experiences during resuscitations in the NICU. Using content analysis, we analyzed the transcriptions of debriefings to address the study aims.

RESULT

Participant responses yielded three major themes: communicating well, getting tasks done well, and working well together. Each main theme had subthemes.

CONCLUSION

Teamwork is a complex process that is enhanced and hindered by a variety of factors. The factors identified in this study can be used to enhance relationship-based teamwork training programs. Future research is needed to determine which teamwork behaviors are most associated with patient outcomes.

Anticipation and preparation for every delivery room resuscitation

A majority of babies initiate spontaneous respirations shortly after birth. Up to 10%, however, require resuscitative measures to make the transition from fetus to newborn. Ideally, the need for resuscitation at birth would be predicted before delivery, and a skilled neonatal resuscitation team would be available and ready. This is not always possible. Therefore, neonatal resuscitation teams must be prepared to provide lifesaving resuscitation at every delivery. In this report, we examine risk factors for resuscitation at birth, discuss the importance of communication between obstetric and newborn teams, review key questions to ask before delivery, and investigate antenatal counseling methods. We also investigate ways to prepare for newborn deliveries, including personnel and equipment preparation, and pre-delivery team briefing. Finally, we explore ways in which neonatal resuscitation teams can improve their preparedness through the use of simulation and post-resuscitation debriefing. This report will help neonatal resuscitation teams to anticipate and prepare for every delivery room resuscitation.

Growth Mindset Moderates the Effect of the Neonatal Resuscitation Program on Performance in a Computer-Based Game Training Simulation

This study examines for the first time the moderating role of growth mindset on the association between the time elapsed since participants' last refresher neonatal resuscitation program (NRP) course and their performance on neonatal resuscitation tasks in the RETAIN computer game training simulation. Participants were n = 50 health-care providers affiliated with a large university hospital. Results revealed that growth mindset moderated the relation between participants' task performance in the game and the time since their latest refresher NRP course. Specifically, participants who completed the course more recently (i.e., between 8 and 9 months before the current study) made significantly more mistakes in the game than the rest of the participants but only when they endorsed lower levels of growth mindset. Implications of this research include growth mindset interventions and increased screen time in simulation sessions that have the potential to help health-care providers achieve better performance on neonatal resuscitation clinical tasks.

Likelihood of reporting medication errors in hospitalized children: a survey of nurses and physicians

Background

Hospitalized children are at risk of medication errors (MEs) due to complex dosage calculations and preparations. Incident reporting systems may facilitate prevention of MEs but underreporting potentially undermines this system. We aimed to examine whether scenarios involving medications should be reported to a national mandatory incident reporting system and the likelihood of self- and peer-reporting these scenarios among paediatric nurses and physicians.

Methods

Participants' reporting of MEs was explored through a questionnaire involving 20 medication scenarios. The scenarios represented different steps in the medication process, types of error, patient outcomes and medications. Reporting rates and odds ratios with 95% confidence interval [OR, (95% CI)] were calculated. Barriers to and enablers of reporting were identified through content analysis of participants' comments.

Results

The response rate was 42% (291/689). Overall, 61% of participants reported that scenarios should be reported. The likelihood of reporting was 60% for self-reporting and 37% for peer-reporting. Nurses versus physicians, and healthcare professionals with versus without patient safety responsibilities assessed to a larger extent that the scenarios should be reported [OR = 1.34 (1.05-1.70) and OR = 1.41 (1.12-1.78), respectively]; were more likely to self-report, [OR = 2.81 (1.71-4.62) and OR = 2.93 (1.47-5.84), respectively]; and were more likely to peer-report [OR = 1.89 (1.36-2.63) and OR = 3.61 (2.57-5.06), respectively].Healthcare professionals with versus without management responsibilities were more likely to peer-report [OR = 5.16 (3.44-7.72)]. Participants reported that scenarios resulting in actual injury or incidents considered to have a learning potential should be reported.

Conclusion

The likelihood of underreporting scenarios was high among paediatric nurses and physicians. Nurses and staff with patient safety responsibilities were more likely to assess that scenarios should be reported and to report. Incidents with actual injury or learning potential were more likely to be reported. The potential for improving reporting rates involving MEs seems high.

Impact of Trust and Technology on Interprofessional Collaboration in Healthcare Settings

The increases in complexity of patient care, healthcare costs, and technological advancements shifted the healthcare delivery to interprofessional collaborative care. The study aims for identifying the factors influencing the quality of team collaboration. The study examines the impact of trust and technology orientation on collaboration with the mediating effects of communication, coordination and cooperation. A questionnaire survey was conducted to gather data from healthcare professionals (N=216). Statistical analysis conducted for this study include correlations, factor analysis with reliability and validity tests and Partial Least Squares (PLS) method. The results of the study validate that (i) collaboration has positive and significant relationship with coordination, and cooperation; (ii) trust has positive and significant relationship with communication, coordination, and cooperation; and (iii) technology orientation has positive and significant relationship with cooperation but not with communication and coordination. The research and managerial implications of these factors are given in discussion. As with most empirical studies, the subjectivity of the opinion of respondents present some limitations to generalization. Other limitations include the lack of availability and use of standard measures for various constructs in the research model. The results can be used by healthcare professionals and managers to advance their understanding on the impact of trust and technology on collaboration mediating communication, coordination and cooperation practices. The significant value of this study is the identification of the factors influencing the quality of team collaboration in healthcare industry.

Impact of an electronic handoff documentation tool on team shared mental models in pediatric critical care

OBJECTIVE

To examine the impact of the implementation of an electronic handoff tool (the Handoff Tool) on shared mental models (SMM) within patient care teams as measured by content overlap and discrepancies in verbal handoff presentations given by different clinicians caring for the same patient.

MATERIALS AND METHODS

Researchers observed, recorded, and transcribed verbal handoffs given by different members of patient care teams in a pediatric intensive care unit. The transcripts were qualitatively coded and analyzed for content overlap scores and the number of discrepancies in handoffs of different team members before and after the implementation of the tool.

RESULTS

Content overlap scores did not change post-implementation. The average number of discrepancies nearly doubled following the implementation (from 0.76 discrepancies per handoff group pre-implementation to 1.17 discrepancies per handoff group post-implementation); however, this change was not statistically significant (p=0.37). Discrepancies classified as related to dosage of treatment or procedure and to patients' symptoms increased in frequency post-implementation.

DISCUSSION

The results suggest that the Handoff Tool did not have the desired positive impact on SMM within patient care teams. Future electronic tools for facilitating team handoff may need longer implementation times, complementary changes to handoff process and structure, and improved designs that integrate a common core of shared information with discipline-specific records.

CONCLUSION

While electronic handoff tools provide great opportunities to improve communication and facilitate the formation of shared mental models within patient care teams, further work is necessary to realize their full potential.

Ventilation fraction during the first 30s of neonatal resuscitation

AIM

Approximately 5% of newborns receive positive pressure ventilation (PPV) for successful transition. Guidelines urge providers to ensure effective PPV for 30-60s before considering chest compressions and intravenous therapy. Pauses in this initial PPV may delay recovery of spontaneous respiration. The aim was to find the ventilation fraction during the first 30s of PPV in non-breathing babies.

METHODS

Prospective observational study in two hospitals in Norway. All newborns receiving PPV immediately after delivery were included. Cameras with motion detectors were installed at every resuscitation bay capturing both expected and unexpected compromised newborns. We determined the cumulative number of seconds with PPV efforts excluding pauses in infants without spontaneous breathing and reported ventilation fraction during the first minute. Data are presented as median (IQR).

RESULTS

110 of 3508 (3%) newborns received PPV and were filmed in the resuscitation bays. PPV started 42 (18-78)s after arrival at the resuscitation bay and median duration was 100 (35-225)s. Forty-eight infants (44%) were ventilated continuously, or with minimal pause (ventilation fraction >90%) during the first 30s of PPV. For the remaining 62 infants ventilation fraction was 60% (39-75). PPV was interrupted due to adjustments, checking heart rate, stimulation, administration of CPAP and suctioning.

CONCLUSION

In 56% of the neonatal resuscitations interruptions in ventilation are frequent with 60% ventilation fraction during the first 30s of PPV. Eliminating disruption for improved quality of PPV delivery should be emphasized when training newborn resuscitation providers.

Integrating teamwork, clinician occupational well-being and patient safety - development of a conceptual framework based on a systematic review

BACKGROUND

There is growing evidence that teamwork in hospitals is related to both patient outcomes and clinician occupational well-being. Furthermore, clinician well-being is associated with patient safety. Despite considerable research activity, few studies include all three concepts, and their interrelations have not yet been investigated systematically. To advance our understanding of these potentially complex interrelations we propose an integrative framework taking into account current evidence and research gaps identified in a systematic review.

METHODS

We conducted a literature search in six major databases (Medline, PsycArticles, PsycInfo, Psyndex, ScienceDirect, and Web of Knowledge). Inclusion criteria were: peer reviewed papers published between January 2000 and June 2015 investigating a statistical relationship between at least two of the three concepts; teamwork, patient safety, and clinician occupational well-being in hospital settings, including practicing nurses and physicians. We assessed methodological quality using a standardized rating system and qualitatively appraised and extracted relevant data, such as instruments, analyses and outcomes.

RESULTS

The 98 studies included in this review were highly diverse regarding quality, methodology and outcomes. We found support for the existence of independent associations between teamwork, clinician occupational well-being and patient safety. However, we identified several conceptual and methodological limitations. The main barrier to advancing our understanding of the causal relationships between teamwork, clinician well-being and patient safety is the lack of an integrative, theory-based, and methodologically thorough approach investigating the three concepts simultaneously and longitudinally. Based on psychological theory and our findings, we developed an integrative framework that addresses these limitations and proposes mechanisms by which these concepts might be linked.

CONCLUSION

Knowledge about the mechanisms underlying the relationships between these concepts helps to identify avenues for future research, aimed at benefiting clinicians and patients by using the synergies between teamwork, clinician occupational well-being and patient safety.

Learning from defects using a comprehensive management system for incident reports in critical care

Incident reporting systems are often used without a structured review process, limiting their utility to learn from defects and compromising their impact on improving the healthcare system. The objective of this study is to describe the experience of implementing a Comprehensive Management System (CMS) for incident reports in the ICU. A physician-led multidisciplinary Incident Report Committee was created to review, analyse and manage the department incident reports. New protocols, policies and procedures, and other patient safety interventions were developed as a result. Information was disseminated to staff through multiple avenues. We compared the pre- and post-intervention periods for the impact on the number of incident reports, level of harm, time needed to close reports and reporting individuals. A total of 1719 incidents were studied. ICU-related incident reports increased from 20 to 36 incidents per 1000 patient days (P=0.01). After implementing the CMS, there was an increase in reporting 'no harm' from 14.2 to 28.1 incidents per 1000 patient days (P<0.001). There was a significant decrease in the time needed to close incident report after implementing the CMS (median of 70 days [Q1-Q3: 26-212] versus 13 days [Q1-Q3: 6-25, P<0.001]). A physician-led multidisciplinary CMS resulted in significant improvement in the output of the incident reporting system. This may be important to enhance the effectiveness of incident reporting systems in highlighting system defects, increasing learning opportunities and improving patient safety.

Are we at risk of groupthink in our approach to teamwork interventions in health care?

CONTEXT

The incidence of medical error, adverse clinical events and poor quality health care is unacceptably high and there are data to suggest that poor coordination of care, or teamwork, contributes to adverse outcomes. So, can we assume that increased collaboration in multidisciplinary teams improves performance and health care outcomes for patients?

METHODS

In this essay, the authors discuss some reasons why we should not presume that collective decision making leads to better decisions and collaborative care results in better health care outcomes.

RESULTS

Despite an exponential increase in interventions designed to improve teamwork and interprofessional education (IPE), we are still lacking good quality data on whether these interventions improve important outcomes. There are reasons why some of the components of 'effective teamwork', such as shared mental models, team orientation and mutual trust, could impair delivery of health care. For example, prior studies have found that brainstorming results in fewer ideas rather than more, and hinders rather than helps productivity. There are several possible explanations for this effect, including 'social loafing' and cognitive overload. Similarly, attributes that improve cohesion within groups, such as team orientation and mutual trust, may increase the risk of 'groupthink' and group conformity bias, which may lead to poorer decisions.

CONCLUSIONS

In reality, teamwork and IPE are not inherently good, bad or neutral; instead, as with any intervention, their effect is modified by the persons involved, the situation and the interaction between persons and situation. Thus, rather than assume better outcomes with teamwork and IPE interventions, as clinicians and educators we must demonstrate that our interventions improve the delivery of health care.

Analysis and classification of errors made by teams during neonatal resuscitation

AIM

The Neonatal Resuscitation Program (NRP) algorithm serves as a guide to healthcare professionals caring for neonates transitioning to extrauterine life. Despite this, adherence to the algorithm is challenging, and errors are frequent. Information-dense, high-risk fields such as air traffic control have proven that formal classification of errors facilitates recognition and remediation. This study was performed to determine and characterize common deviations from the NRP algorithm during neonatal resuscitation.

METHODS

Audiovisual recordings of 250 real neonatal resuscitations were obtained between April 2003 and May 2004. Of these, 23 complex resuscitations were analyzed for adherence to the contemporaneous NRP algorithm and scored using a novel classification tool based on the validated NRP Megacode Checklist.

RESULTS

Seven hundred eighty algorithm-driven tasks were observed. One hundred ninety-four tasks were completed incorrectly, for an average error rate of 23%. Forty-two were errors of omission (28% of all errors) and 107 were errors of commission (72% of all errors). Many errors were repetitive and potentially clinically significant: failure to assess heart rate and/or breath sounds, improper rate of positive pressure ventilation, inadequate peak inspiratory and end expiratory pressures during ventilation, improper chest compression technique, and asynchronous PPV and CC.

CONCLUSIONS

Errors of commission, especially when performing advanced life support interventions such as positive pressure ventilation, intubation, and chest compressions, are common during neonatal resuscitation and are sources of potential harm. The adoption of error reduction strategies capable of decreasing cognitive and technical load and standardizing communication - strategies common in other industries - should be considered in healthcare.

How can we improve the recognition, reporting and resolution of medical device-related incidents in hospitals? A qualitative study of physicians and registered nurses

BACKGROUND

To explore factors that influence and to identify initiatives to improve the recognition, reporting and resolution of device-related incidents.

METHODS

Semi-structured telephone interviews with 16 health professionals in two tertiary care hospitals were conducted. Purposive sampling was used to identify appropriate study participants. Transcribed interviews were read independently by one individual to identify, define and organize themes and verified by another reviewer.

RESULTS

Themes related to incident recognition were the hospital staff's knowledge and professional experience, medical device performance and clinical manifestations of patients, while incident reporting was influenced by error severity, personal attitudes of clinicians, feedback received on the error reported. Physicians often discontinued using medical devices if they malfunctioned. Education and training and the implementation of registries were discussed as important initiatives to improve medical device surveillance in clinical practice.

CONCLUSIONS

Results from the telephone interviews suggest that multiple factors that influence participation in medical device surveillance activities are consistent with results for medical errors as reported in previous studies. The study results helped to propose a conceptual framework for a medical device surveillance system in a hospital context that would enhance patient safety and health care delivery.

NASCAR pit-stop model improves delivery room and admission efficiency and outcomes for infants <27 weeks' gestation

AIM

To evaluate a new process based on teamwork in a manner similar to the race car pit stop on organization and efficiency during the "Golden Hours" for extremely preterm infants.

METHODS

A team designed an improved process focused on checklists, preparation, assigning roles, and best practices, for the care of infants <27 weeks' gestation in the delivery room (DR) through admission to the neonatal intensive care unit (NICU). Clinical outcomes 2 years before and after implementation were analyzed. A survey was administered to NICU staff prior to and 14 months after implementation. The survey assessed organization and efficiency in the DR and during the admission process of the target population.

RESULTS

There were 62 inborn infants prior to and 90 infants after implementation with overall survival of 90.3% and 86.6%, respectively (p = 0.61). Infants were more stable on admission with a mean arterial blood pressure equal to or greater than their gestational age in the post intervention group compared to the pre-cohort (76% vs 57%, p = 0.02) and discharged home at a lower mean postmenstrual age (39.0 ± 2.2 vs 40.1 ± 3.5 weeks, p = 0.04) The survey demonstrated improvement in assessment of roles being clearly defined in the DR and in the organization and the efficiency both in the DR and during the NICU admission (p < 0.05).

CONCLUSIONS

A systematic approach to the care of the <27 weeks' gestation neonate increased staff perception of improved organization and efficiency in the DR through admission processes and improved outcomes.

Factors that influence the recognition, reporting and resolution of incidents related to medical devices and other healthcare technologies: a systematic review

BACKGROUND

Medical devices have improved the treatment of many medical conditions. Despite their benefit, the use of devices can lead to unintended incidents, potentially resulting in unnecessary harm, injury or complications to the patient, a complaint, loss or damage. Devices are used in hospitals on a routine basis. Research to date, however, has been primarily limited to describing incidents rates, so the optimal design of a hospital-based surveillance system remains unclear. Our research objectives were twofold: i) to explore factors that influence device-related incident recognition, reporting and resolution and ii) to investigate interventions or strategies to improve the recognition, reporting and resolution of medical device-related incidents.

METHODS

We searched the bibliographic databases: MEDLINE, Embase, the Cochrane Central Register of Controlled Trials and PsycINFO database. Grey literature (literature that is not commercially available) was searched for studies on factors that influence incident recognition, reporting and resolution published and interventions or strategies for their improvement from 2003 to 2014. Although we focused on medical devices, other health technologies were eligible for inclusion.

RESULTS

Thirty studies were included in our systematic review, but most studies were concentrated on other health technologies. The study findings indicate that fear of punishment, uncertainty of what should be reported and how incident reports will be used and time constraints to incident reporting are common barriers to incident recognition and reporting. Relevant studies on the resolution of medical errors were not found. Strategies to improve error reporting include the use of an electronic error reporting system, increased training and feedback to frontline clinicians about the reported error.

CONCLUSIONS

The available evidence on factors influencing medical device-related incident recognition, reporting and resolution by healthcare professionals can inform data collection and analysis in future studies. Since evidence gaps on medical device-related incidents exist, telephone interviews with frontline clinicians will be conducted to solicit information about their experiences with medical devices and suggested strategies for device surveillance improvement in a hospital context. Further research also should investigate the impact of human, system, organizational and education factors on the development and implementation of local medical device surveillance systems.

Identifying improvements for delivery room resuscitation management: results from a multicenter safety audit

BACKGROUND

Stabilization and resuscitation of a newborn infant is a complex activity that involves multiple team members. Neonatal intensive care units (NICU) participating in the Vermont Oxford Network (VON) iNICQ 2012 quality improvement collaborative reported on delivery room care policies and guidelines and submitted information on up to 10 consecutive deliveries attended by NICU team members. Teams received immediate feedback on their local performance and a summary of results from all participating units for use in quality improvement planning.

RESULTS

Most of the 84 NICU teams that participated in the audit had policies or guidelines about which deliveries required NICU team attendance (83%), personnel who should attend (81%), and their required training (79%). Fewer had policies about briefing prior to the delivery (8%), debriefing after delivery (6%), or communicating with family members (10%). Eighty-one percent of NICUs reported using simulation-based resuscitation training, 14% used a safety checklist, and 2% videotaped deliveries for review. Of the 609 audited deliveries, 88% had team member attendance that conformed to unit policy, 66% had a briefing before delivery, 19% had a debriefing after delivery, and 92% had family communication occur within 30 minutes.

CONCLUSIONS

NICU teams can improve the quality and safety of delivery room care by implementing formal tools designed to facilitate teamwork such as briefings, debriefings, checklists, and videotape reviews. Rapid online audits are effective methods for helping teams identify opportunities for improvement.

Perceptions of teamwork among code team members

BACKGROUND

Cardiopulmonary arrest (CPA) teams, known as code teams, provide coordinated and evidenced-based interventions by various disciplines during a CPA. Teamwork behaviors are essential during CPA resuscitation and may have an impact on patient outcomes.

OBJECTIVES

The purpose of this study was to explore the perceptions of teamwork during CPA events among code team members and to determine if differences in perception existed between disciplines within the code team.

METHODS

A prospective, descriptive, comparative design using the Code Teamwork Perception Tool online survey was used to assess the perception of teamwork during CPA events by medical residents, critical care nurses, and respiratory therapists.

RESULTS

Sixty-six code team members completed the Code Teamwork Perception Tool. Mean teamwork scores were 2.63 on a 5-point scale (0-4). No significant differences were found in mean scores among disciplines. Significant differences among scores were found on 7 items related to code leadership, roles and responsibilities between disciplines, and in those who had participated on a code team for less than 2 years and certified in Advanced Cardiac Life Support for less than 4 years.

CONCLUSIONS

Teamwork perception among members of the code team was average. Teamwork training for resuscitation with all disciplines on the code team may promote more effective teamwork during actual CPA events. Clinical nurse specialists can aid in resuscitation efforts by actively participating on committees, identifying opportunities for improvement, being content experts, leading the development of team training programs, and conducting research in areas lacking evidence.

What to do with healthcare incident reporting systems

Incident Reporting Systems (IRS) are and will continue to be an important influence on improving patient safety. They can provide valuable insights into how and why patients can be harmed at the organizational level. However, they are not the panacea that many believe them to be. They have several limitations that should be considered. Most of these limitations stem from inherent biases of voluntary reporting systems. These limitations include: i) IRS can’t be used to measure safety (error rates); ii) IRS can’t be used to compare organizations; iii) IRS can’t be used to measure changes over time; iv) IRS generate too many reports; v) IRS often don’t generate in-depth analyses or result in strong interventions to reduce risk; vi) IRS are associated with costs. IRS do offer significant value; their value is found in the following: i) IRS can be used to identify local system hazards; ii) IRS can be used to aggregate experiences for uncommon conditions; iii) IRS can be used to share lessons within and across organizations; iv) IRS can be used to increase patient safety culture. Moving forward, several strategies are suggested to maximize their value: i) make reporting easier; ii) make reporting meaningful to the reporter; iii) make the measure of success system changes, rather than events reported; iv) prioritize which events to report and investigate, report and investigate them well; v) convene with diverse stakeholders to enhance the value of IRS.

How do chiropractors manage clinical risk? A questionnaire study

Background

The literature on chiropractic safety tends to focus on adverse events and little is known about how chiropractors ensure safety and manage risk in the course of their daily practice. The purpose of this study was to investigate how chiropractors manage potentially risky clinical scenarios. We also sought to establish how chiropractors perceive the safety climate in their workplace and thus whether there is an observable culture of safety within the profession.

Methods

An online questionnaire was designed to determine which of nine management options would be chosen by the respondent in response to four defined clinical case scenarios. Safety climate within the respondent’s practice setting was measured by seeking the level of agreement with 23 statements relating to six different safety dimensions. 260 licensed chiropractors in Switzerland and 1258 UK members of The Royal College of Chiropractors were invited to complete the questionnaire. Questionnaire responses were analysed quantitatively in respect of the four clinical scenarios and the nine management options to determine the likelihood of each option being undertaken, with results recorded in terms of % likelihood. Gender differences in response to the management options for each scenario were evaluated using the Mann–Whitney U (MWU) test. Positive agreement with elements comprising each of the six safety dimensions contributed to a composite ‘% positive agreement’ score calculated for each dimension.

Results

Questionnaire responses were received from 76% (200/260) of Swiss participants and 31% (393/1258) of UK members of The Royal College of Chiropractors. There was a general trend for Swiss and UK chiropractors to manage clinical scenarios where treatment appears not to be successful, not indicated, possibly harmful or where a patient is apparently getting worse, by re-evaluating their care. Stopping treatment and/or incident reporting to a safety incident reporting and learning system were generally found to be unlikely courses of action. Gender differences were observed with female chiropractors appearing to be more risk averse.

Conclusions

Swiss and UK chiropractors tend to manage potentially risky clinical scenarios by re-evaluating the case. The unlikeliness of safety incident reporting is probably due to a range of recognised barriers, although Swiss and UK chiropractors are positive about local communication and openness which are important tenets for safety incident reporting. The observed positivity towards key aspects of clinic safety indicates a developing safety culture within the Swiss and UK chiropractic professions.

Co-ACT--a framework for observing coordination behaviour in acute care teams

BACKGROUND

Acute care teams (ACTs) represent action teams, that is, teams in which members with specialised roles must coordinate their actions during intense situations, often under high time pressure and with unstable team membership. Using behaviour observation, patient safety research has been focusing on defining teamwork behaviours-particularly coordination-that are critical for patient safety during these intense situations. As one result of this divergent research landscape, the number, scope and variety of applied behaviour observation taxonomies are growing, making comparison and convergent integration of research findings difficult.

AIM

To facilitate future ACT research by presenting a framework that provides a shared language of teamwork behaviours, allows for comparing previous and future ACT research and offers a measurement tool for ACT observation.

METHOD

Based on teamwork theory and empirical evidence, we developed Co-ACT-the Framework for Observing Coordination Behaviour in ACT. Integrating two previous, extensive taxonomies into Co-ACT, we also suggested 12 behavioural codes for which we determined inter-rater reliability by analysing the teamwork of videotaped anaesthesia teams in the clinical setting.

RESULTS

The Co-ACT framework consists of four quadrants organised along two dimensions (explicit vs implicit coordination; action vs information coordination). Each quadrant provides three categories for which Cohen's κ overall value was substantial; but values for single categories varied considerably.

CONCLUSIONS

Co-ACT provides a framework for organising behaviour codes and offers respective categories for succinctly measuring teamwork in ACTs. Furthermore, it has the potential to allow for guiding and comparing ACTs study results. Future work using Co-ACT in different research and training settings will show how well it can generally be applied across ACTs.

Maternity care and liability: most promising policy strategies for improvement

BACKGROUND

The present liability system is not serving well childbearing women and newborns, maternity care clinicians, or maternity care payers. Examination of evidence about the impact of this system on maternity care led us to identify seven aims for a high-functioning liability system in this clinical context. Herein, we identify policy strategies that are most likely to meet these aims and contribute to needed improvements. A companion paper considers strategies that hold little promise.

METHODS

We considered whether 25 strategies that have been used or proposed for improvement have met or could meet the seven aims. We used a best available evidence approach and drew on more recent empirical legal studies and health services research about maternity care and liability when available, and considered other studies when unavailable.

FINDINGS

Ten strategies seem to have potential to improve liability matters in maternity care across multiple aims. The most promising strategy--implementing rigorous maternity care quality improvement (QI) programs--has led to better quality and outcomes of care, and impressive declines in liability claims, payouts, and premium levels.

CONCLUSIONS

A number of promising strategies warrant demonstration and evaluation at the level of states, health systems, or other appropriate entities. Rigorous QI programs have a growing track record of contributing to diverse aims of a high-functioning liability system and seem to be a win-win-win prevention strategy for childbearing families, maternity care providers, and payers. Effective strategies are also needed to assist families when women and newborns are injured.

The emergency medical services safety champions

The overarching mission of prehospital emergency medical services (EMS) is to deliver lifesaving care for people when their needs are greatest. Fulfilling this mission is challenged by threats to patient and provider safety. The EMS setting is a high-risk one because care is delivered rapidly in the out-of-hospital setting where resources of benefit to patients are limited. There is growing evidence that safety culture varies widely across EMS agencies. A poor safety culture may manifest as error in medication, back injuries, and other poor outcomes for patient and provider. Recently, federal and national leaders of EMS (ie, the National Highway Traffic Safety Administration) have made improving EMS safety culture a national priority. Unfortunately, few initiatives can help local EMS leaders achieve that priority. The authors describe the successful EMS Champs Fellowship program, supported by the Jewish Healthcare Foundation, designed to train EMS leaders to improve safety for patients and providers.

Twelve best practices for team training evaluation in health care

BACKGROUND

Evaluation and measurement are the building blocks of effective skill development, transfer of training, maintenance and sustainment of effective team performance, and continuous improvement. Evaluation efforts have varied in their methods, time frame, measures, and design. On the basis of the existing body of work, 12 best practice principles were extrapolated from the science of evaluation and measurement into the practice of team training evaluation. Team training evaluation refers to efforts dedicated to enumerating the impact of training (1) across multiple dimensions, (2) across multiple settings, and (3) over time. Evaluations of efforts to optimize teamwork are often afterthoughts in an industry that is grounded in evidence-based practice. The best practices regarding team training evaluation are provided as practical reminders and guidance for continuing to build a balanced and robust body of evidence regarding the impact of team training in health care. THE 12 BEST PRACTICES: The best practices are organized around three phases of training: planning, implementation, and follow-up. Rooted in the science of team training evaluation and performance measurement, they range from Best Practice 1: Before designing training, start backwards: think about traditional frameworks for evaluation in reverse to Best Practice 7: Consider organizational, team, or other factors that may help (or hinder) the effects of training and then to Best Practice 12: Report evaluation results in a meaningful way, both internally and externally.

CONCLUSIONS

Although the 12 best practices may be perceived as intuitive, they are intended to serve as reminders that the notion of evidence-based practice applies to quality improvement initiatives such as team training and team development as equally as it does to clinical intervention and improvement efforts.