A pilot study to determine the incidence, type, and severity of non-routine events in neonates undergoing gastrostomy tube placement

BACKGROUND

Non-routine events (NRE) are defined as any suboptimal occurrences in a process being measured in the opinion of the reporter and comes from the field of human factors engineering. These typically occur well up-stream of an adverse event and NRE measurement has not been applied to the complex context of neonatal surgery. We sought to apply this novel safety event measurement methodology to neonates in the NICU undergoing gastrostomy tube placement.

METHODS

A prospective pilot study was conducted between November 2016 and August 2020 in the Level IV NICU and the pediatric operating rooms of an urban academic children's hospital to determine the incidence, severity, impact, and contributory factors of clinician-reported non-routine events (NREs, i.e., deviations from optimal care) and 30-day NSQIP occurrences in neonates receiving a G-tube.

RESULTS

Clinicians reported at least one NRE in 32 of 36 (89%) G-tube cases, averaging 3.0 (Standard deviation: 2.5) NRE reports per case. NSQIP-P review identified 7 cases (19%) with NSQIP-P occurrences and each of these cases had multiple reported NREs. One case in which NREs were not reported was without NSQIP-P occurrences. The odds ratio of having a NSQIP-P occurrence with the presence of an NRE was 0.695 (95% CI 0.06-17.04).

CONCLUSION

Despite being considered a "simple" operation, >80% of neonatal G-tube placement operations had at least one reported NRE by an operative team member. In this pilot study, NRE occurrence was not significantly associated with the subsequent reporting of an NSQIP-P occurrence. Understanding contributory factors of NREs that occur in neonatal surgery may promote surgical safety efforts and should be evaluated in larger and more diverse populations.

LEVEL OF EVIDENCE

IV.

Defining the Epidemiology of Safety Risks in Neonatal Intensive Care Unit Patients Requiring Surgery

OBJECTIVE

The aim of the study was to determine the incidence, type, severity, preventability, and contributing factors of nonroutine events (NREs)-events perceived by care providers or skilled observers as a deviations from optimal care based on the clinical situation-in the perioperative (i.e., preoperative, operative, and postoperative) care of surgical neonates in the neonatal intensive care unit and operating room.

METHODS

A prospective observational study of noncardiac surgical neonates, who received preoperative and postoperative neonatal intensive care unit care, was conducted at an urban academic children's hospital between November 1, 2016, and March 31, 2018. One hundred twenty-nine surgical cases in 109 neonates were observed. The incidence and description of NREs were collected via structured researcher-administered survey tool of involved clinicians. Primary measurements included clinicians' ratings of NRE severity and contributory factors and trained research assistants' ratings of preventability.

RESULTS

One or more NREs were reported in 101 (78%) of 129 observed cases for 247 total NREs. Clinicians reported 2 (2) (median, interquartile range) NREs per NRE case with a maximum severity of 3 (1) (possible range = 1-5). Trained research assistants rated 47% of NREs as preventable and 11% as severe and preventable. The relative risks for National Surgical Quality Improvement Program - pediatric major morbidity and 30-day mortality were 1.17 (95% confidence interval = 0.92-1.48) and 1.04 (95% confidence interval = 1.00-1.08) in NRE cases versus non-NRE cases.

CONCLUSIONS

The incidence of NREs in neonatal perioperative care at an academic children's hospital was high and of variable severity with a myriad of contributory factors.

Modeling Care Team Structures in the Neonatal Intensive Care Unit through Network Analysis of EHR Audit Logs

BACKGROUND

 In the neonatal intensive care unit (NICU), predefined acuity-based team care models are restricted to core roles and neglect interactions with providers outside of the team, such as interactions that transpire via electronic health record (EHR) systems. These unaccounted interactions may be related to the efficiency of resource allocation, information flow, communication, and thus impact patient outcomes. This study applied network analysis methods to EHR audit logs to model the interactions of providers beyond their core roles to better understand the interaction network patterns of acuity-based teams and relationships of the network structures with postsurgical length of stay (PSLOS).

METHODS

 The study used the EHR log data of surgical neonates from a large academic medical center. The study included 104 surgical neonates, for whom 9,206 unique actions were performed by 457 providers in their EHRs. We applied network analysis methods to model EHR provider interaction networks of acuity-based teams in NICU postoperative care. We partitioned each EHR network into three subnetworks based on interaction types: (1) interactions between known core providers who were documented in scheduling records (core subnetwork); (2) interactions between core and noncore providers (extended subnetwork); and (3) interactions between noncore providers (extended subnetwork). For each core subnetwork, we assessed its capability to replicate predefined core-provider relations as documented in scheduling records. We further compared each EHR network, as well as its subnetworks, using standard network measures to determine its differences in network topologies. We conducted a case study to learn provider interaction networks taking care of 15 neonates who underwent gastrostomy tube placement surgery from EHR log data and measure the effectiveness of the interaction networks on PSLOS by the proportional-odds model.

RESULTS

 The provider networks of four acuity-based teams (two high and two low acuity), along with their subnetworks, were discovered. We found that beyond capturing the predefined core-provider relations, EHR audit logs can also learn a large number of relations between core and noncore providers or among noncore providers. Providers in the core subnetwork exhibited a greater number of connections with each other than with providers in the extended subnetworks. Many more providers in the core subnetwork serve as a hub than those in the other types of subnetworks. We also found that high-acuity teams exhibited more complex network structures than low-acuity teams, with high-acuity team generating 6,416 interactions between 407 providers compared with 931 interactions between 124 providers, respectively. In addition, we discovered that high-acuity and low-acuity teams shared more than 33 and 25% of providers with each other, respectively, but exhibited different collaborative structures demonstrating that NICU providers shift across different acuity teams and exhibit different network characteristics. Results of case study show that providers, whose patients had lower PSLOS, tended to disperse patient-related information to more colleagues within their network than those who treated higher PSLOS patients (p = 0.03).

CONCLUSION

 Network analysis can be applied to EHR log data to model acuity-based NICU teams capturing interactions between providers within the predesigned core team as well as those outside of the core team. In the NICU, dissemination of information may be linked to reduced PSLOS. EHR log data provide an efficient, accessible, and research-friendly way to study provider interaction networks. Findings should guide improvements in the EHR system design to facilitate effective interactions between providers.

Factors Influencing Time-Dependent Quality Indicators for Patients With Suspected Acute Coronary Syndrome

OBJECTIVES

Rapid risk stratification and timely treatment are critical to favorable outcomes for patients with acute coronary syndrome (ACS). Our objective was to identify patient and system factors that influence time-dependent quality indicators (QIs) for patients with unstable angina/non-ST elevation myocardial infarction (NSTEMI) in the emergency department (ED).

METHODS

A retrospective, cohort study was conducted during a 42-month period of all patients 24 years or older suspected of having ACS as defined by receiving an electrocardiogram and at least 1 cardiac biomarker test. Cox regression was used to model the effects of patient characteristics, ancillary service use, staffing provisions, equipment availability, and ED and hospital crowding on ACS QIs.

RESULTS

Emergency department adherence rates to national standards for electrocardiogram readout time and biomarker turnaround time were 42% and 37%, respectively. Cox regression models revealed that chief complaints without chest pain and the timing of stress testing and medication administration were associated with the most significant delays.

CONCLUSIONS

Patient and system factors both significantly influenced QI times in this cohort with unstable angina/NSTEMI. These results illustrate both the complexity of diagnosing patients with NSTEMI and the competing effects of clinical and system factors on patient flow through the ED.

Provider Networks in the Neonatal Intensive Care Unit Associate with Length of Stay

We strive to understand care coordination structures of multidisciplinary teams and to evaluate their effect on post-surgical length of stay (PSLOS) in the Neonatal Intensive Care Unit (NICU). Electronic health record (EHR) data were extracted for 18 neonates, who underwent gastrostomy tube placement surgery at the Vanderbilt University Medical Center NICU. Based on providers' interactions with the EHR (e.g. viewing, documenting, ordering), provider-provider relations were learned and used to build patient-specific provider networks representing the care coordination structure. We quantified the networks using standard network analysis metrics (e.g., in-degree, out-degree, betweenness centrality, and closeness centrality). Coordination structure effectiveness was measured as the association between the network metrics and PSLOS, as modeled by a proportional-odds, logistical regression model. The 18 provider networks exhibited various team compositions and various levels of structural complexity. Providers, whose patients had lower PSLOS, tended to disperse patient-related information to more colleagues within their network than those, who treated higher PSLOS patients (P = 0.0294). In the NICU, improved dissemination of information may be linked to reduced PSLOS. EHR data provides an efficient, accessible, and resource-friendly way to study care coordination using network analysis tools. This novel methodology offers an objective way to identify key performance and safety indicators of care coordination and to study dissemination of patient-related information within care provider networks and its effect on care. Findings should guide improvements in the EHR system design to facilitate effective clinical communications among providers.

Improving the Effectiveness of Health Information Technology: The Case for Situational Analytics

Health information technology has contributed to improvements in quality and safety in clinical settings. However, the implementation of new technologies in health care has also been associated with the introduction of new sociotechnical hazards, produced through a range of complex interactions that vary with social, physical, temporal, and technological context. Other industries have been confronted with this problem and have developed advanced analytics to examine context-specific activities of workers and related outcomes. The skills and data exist in health care to develop similar insights through situational analytics, defined as the application of analytic methods to characterize human activity in situations and identify patterns in activity and outcomes that are influenced by contextual factors. This article describes the approach of situational analytics and potentially useful data sources, including trace data from electronic health record activity, reports from users, qualitative field data, and locational data. Key implementation requirements are discussed, including the need for collaboration among qualitative researchers and data scientists, organizational and federal level infrastructure requirements, and the need to implement a parallel research program in ethics to understand how the data are being used by organizations and policy makers.

Implementing Strategies to Identify and Mitigate Adverse Safety Events: A Case Study with Unplanned Extubations

BACKGROUND

Patient safety events result from failures in complex health care delivery processes. To ensure safety, teams must implement ways to identify events that occur in a nonrandom fashion and respond in a timely manner. To illustrate this, one children's hospital's experience with an outbreak of unplanned extubations (UEs) in the neonatal ICU (NICU) is described.

METHODS

The quality improvement team measured UEs using three complementary data streams. Interventions to decrease the rate of UE were tested with success. Three statistical process control (SPC) charts (u-chart, g-chart, and an exponentially weighted moving average [EWMA] chart) were used for real-time monitoring.

RESULTS

From July 2015 to May 2016, the UE rate was stable at 1.1 UE/100 ventilator days. In early June 2016, a cluster of UEs, including four events within one week, was observed. Two of three SPC charts showed special cause variation, although at different time points. The EWMA chart alerted the team more than two weeks earlier than the u-chart. Within days of discovering the outbreak, the team identified that the hospital had replaced the tape used to secure endotracheal tubes with a nearly identical product. After multiple tape products were tested over the next month, the team selected one that returned the system to a state of stability.

CONCLUSION

Ongoing monitoring using SPC charts allowed early detection and rapid mitigation of an outbreak of UEs in the NICU. This highlights the importance of continuous monitoring using tools such as SPC charts that can alert teams to both improvement and worsening of processes.

Understanding Emergency Care Delivery Through Computer Simulation Modeling

In 2017, Academic Emergency Medicine convened a consensus conference entitled, "Catalyzing System Change through Health Care Simulation: Systems, Competency, and Outcomes." This article, a product of the breakout session on "understanding complex interactions through systems modeling," explores the role that computer simulation modeling can and should play in research and development of emergency care delivery systems. This article discusses areas central to the use of computer simulation modeling in emergency care research. The four central approaches to computer simulation modeling are described (Monte Carlo simulation, system dynamics modeling, discrete-event simulation, and agent-based simulation), along with problems amenable to their use and relevant examples to emergency care. Also discussed is an introduction to available software modeling platforms and how to explore their use for research, along with a research agenda for computer simulation modeling. Through this article, our goal is to enhance adoption of computer simulation, a set of methods that hold great promise in addressing emergency care organization and design challenges.

Cry presence and amplitude do not reflect cortical processing of painful stimuli in newborns with distinct responses to touch or cold

OBJECTIVE

Newborns requiring hospitalisation frequently undergo painful procedures. Prevention of pain in infants is of prime concern because of adverse associations with physiological and neurological development. However, pain mitigation is currently guided by behavioural observation assessments that have not been validated against direct evidence of pain processing in the brain. The aim of this study was to determine whether cry presence or amplitude is a valid indicator of pain processing in newborns.

DESIGN

Prospective observational cohort.

SETTING

Newborn nursery.

PATIENTS

Healthy infants born at >37 weeks and <42 weeks gestation.

INTERVENTIONS

We prospectively studied newborn cortical responses to light touch, cold and heel stick, and the amplitude of associated infant vocalisations using our previously published paradigms of time-locked electroencephalogram (EEG) with simultaneous audio recordings.

RESULTS

Latencies of cortical peak responses to each of the three stimuli type were significantly different from each other. Of 54 infants, 13 (24%), 19 (35%) and 35 (65%) had cries in response to light touch, cold and heel stick, respectively. Cry in response to non-painful stimuli did not predict cry in response to heel stick. All infants with EEG data had measurable pain responses to heel stick, whether they cried or not. There was no association between presence or amplitude of cries and cortical nociceptive amplitudes.

CONCLUSIONS

In newborns with distinct brain responses to light touch, cold and pain, cry presence or amplitude characteristics do not provide adequate behavioural markers of pain signalling in the brain. New bedside assessments of newborn pain may need to be developed using brain-based methodologies as benchmarks in order to provide optimal pain mitigation.

A simulation-based curriculum to introduce key teamwork principles to entering medical students

BACKGROUND

Failures of teamwork and interpersonal communication have been cited as a major patient safety issue. Although healthcare is increasingly being provided in interdisciplinary teams, medical school curricula have traditionally not explicitly included the specific knowledge, skills, attitudes, and behaviors required to function effectively as part of such teams.

METHODS

As part of a new "Foundations" core course for beginning medical students that provided a two-week introduction to the most important themes in modern healthcare, a multidisciplinary team, in collaboration with the Center for Experiential Learning and Assessment, was asked to create an experiential introduction to teamwork and interpersonal communication. We designed and implemented a novel, all-day course to teach second-week medical students basic teamwork and interpersonal principles and skills using immersive simulation methods. Students' anonymous comprehensive course evaluations were collected at the end of the day. Through four years of iterative refinement based on students' course evaluations, faculty reflection, and debriefing, the course changed and matured.

RESULTS

Four hundred twenty evaluations were collected. Course evaluations were positive with almost all questions having means and medians greater than 5 out of 7 across all 4 years. Sequential year comparisons were of greatest interest for examining the effects of year-to-year curricular improvements. Differences were not detected among any of the course evaluation questions between 2007 and 2008 except that more students in 2008 felt that the course further developed their "Decision Making Abilities" (OR 1.69, 95% CI 1.07-2.67). With extensive changes to the syllabus and debriefer selection/assignment, concomitant improvements were observed in these aspects between 2008 and 2009 (OR = 2.11, 95% CI: 1.28-3.50). Substantive improvements in specific exercises also yielded significant improvements in the evaluations of those exercises.

CONCLUSIONS

This curriculum could be valuable to other medical schools seeking to inculcate teamwork foundations in their medical school's preclinical curricula. Moreover, this curriculum can be used to facilitate teamwork principles important to inter-disciplinary, as well as uni-disciplinary, collaboration.

Does the American College of Surgeons National Surgical Quality Improvement Program pediatric provide actionable quality improvement data for surgical neonates?

BACKGROUND/PURPOSE

The purpose of this project was to examine the American College of Surgeons National Surgical Quality Improvement Program Pediatric (ACSNSQIP-P) Participant Use File (PUF) to compare risk-adjusted outcomes of neonates versus other pediatric surgical patients.

METHODS

In the ACS-NSQIP-P 2012-2013 PUF, patients were classified as preterm neonate, term neonate, or nonneonate at the time of surgery. The primary outcomes were 30-day mortality and composite morbidity. Patient characteristics significantly associated with the primary outcomes were used to build a multivariate logistic regression model.

RESULTS

The overall 30-day mortality rate for preterm neonates, term neonate, and nonneonates was 4.9%, 2.0%, 0.1%, respectively (p<0.0001). The overall 30-day morbidity rate for preterm neonates, term neonates, and nonneonates was 27.0%, 17.4%, 6.4%, respectively (p<0.0001). After adjustment for preoperative and operative risk factors, both preterm (adjusted odds ratio, 95% CI: 2.0, 1.4-3.0) and term neonates (aOR, 95% CI: 1.9, 1.2-3.1) had a significantly increased odds of 30-day mortality compared to nonneonates.

CONCLUSION

Surgical neonates are a cohort who are particularity susceptible to postoperative morbidity and mortality after adjusting for preoperative and operative risk factors. Collaborative efforts focusing on surgical neonates are needed to understand the unique characteristics of this cohort and identify the areas where the morbidity and mortality can be improved.

Reducing intraoperative red blood cell unit wastage in a large academic medical center

BACKGROUND

The wastage of red blood cell (RBC) units within the operative setting results in significant direct costs to health care organizations. Previous education-based efforts to reduce wastage were unsuccessful at our institution. We hypothesized that a quality and process improvement approach would result in sustained reductions in intraoperative RBC wastage in a large academic medical center.

STUDY DESIGN AND METHODS

Utilizing a failure mode and effects analysis supplemented with time and temperature data, key drivers of perioperative RBC wastage were identified and targeted for process improvement.

RESULTS

Multiple contributing factors, including improper storage and transport and lack of accurate, locally relevant RBC wastage event data were identified as significant contributors to ongoing intraoperative RBC unit wastage. Testing and implementation of improvements to the process of transport and storage of RBC units occurred in liver transplant and adult cardiac surgical areas due to their history of disproportionately high RBC wastage rates. Process interventions targeting local drivers of RBC wastage resulted in a significant reduction in RBC wastage (p < 0.0001; adjusted odds ratio, 0.24; 95% confidence interval, 0.15-0.39), despite an increase in operative case volume over the period of the study. Studied process interventions were then introduced incrementally in the remainder of the perioperative areas.

CONCLUSIONS

These results show that a multidisciplinary team focused on the process of blood product ordering, transport, and storage was able to significantly reduce operative RBC wastage and its associated costs using quality and process improvement methods.

Surgical debriefing: a reliable roadmap to completing the patient safety cycle

Morbidity and mortality due to preventable medical errors are a disastrous reality in medicine. Debriefing, a process that allows individuals to discuss team performance in a constructive, supportive environment, has been linked to improved performance in various medical and surgical fields, including improvements in specific procedures, teamwork and communication, and error identification. However, the neurosurgical literature on this topic is limited. The authors review the debriefing literature in the field of medicine, with a specific emphasis on the operating room, and they report their own institutional experience with a debriefing module, from invention to pilot implementation, at Vanderbilt University Medical Center. The authors share the challenges and lessons learned from their quality improvement project. The field of neurosurgery would undoubtedly benefit from embracing debriefing, as its potential has been established in other medical specialties and can serve as a valuable role in immediately learning from mistakes. The authors hope that their colleagues can learn from this experience and improve their own.

Quality improvement projects targeting health care-associated infections: comparing Virtual Collaborative and Toolkit approaches

BACKGROUND

Collaborative and toolkit approaches have gained traction for improving quality in health care.

OBJECTIVE

To determine if a quality improvement virtual collaborative intervention would perform better than a toolkit-only approach at preventing central line-associated bloodstream infections (CLABSIs) and ventilator-associated pneumonias (VAPs).

DESIGN AND SETTING

Cluster randomized trial with the Intensive Care Units (ICUs) of 60 hospitals assigned to the Toolkit (n=29) or Virtual Collaborative (n=31) group from January 2006 through September 2007.

MEASUREMENT

CLABSI and VAP rates. Follow-up survey on improvement interventions, toolkit utilization, and strategies for implementing improvement.

RESULTS

A total of 83% of the Collaborative ICUs implemented all CLABSI interventions compared to 64% of those in the Toolkit group (P = 0.13), implemented daily catheter reviews more often (P = 0.04), and began this intervention sooner (P < 0.01). Eighty-six percent of the Collaborative group implemented the VAP bundle compared to 64% of the Toolkit group (P = 0.06). The CLABSI rate was 2.42 infections per 1000 catheter days at baseline and 2.73 at 18 months (P = 0.59). The VAP rate was 3.97 per 1000 ventilator days at baseline and 4.61 at 18 months (P = 0.50). Neither group improved outcomes over time; there was no differential performance between the 2 groups for either CLABSI rates (P = 0.71) or VAP rates (P = 0.80).

CONCLUSION

The intensive collaborative approach outpaced the simpler toolkit approach in changing processes of care, but neither approach improved outcomes. Incorporating quality improvement methods, such as ICU checklists, into routine care processes is complex, highly context-dependent, and may take longer than 18 months to achieve.

Organisational culture: variation across hospitals and connection to patient safety climate

CONTEXT

Bureaucratic organisational culture is less favourable to quality improvement, whereas organisations with group (teamwork) culture are better aligned for quality improvement.

OBJECTIVE

To determine if an organisational group culture shows better alignment with patient safety climate.

DESIGN

Cross-sectional administration of questionnaires. Setting 40 Hospital Corporation of America hospitals.

PARTICIPANTS

1406 nurses, ancillary staff, allied staff and physicians.

MAIN OUTCOME MEASURES

Competing Values Measure of Organisational Culture, Safety Attitudes Questionnaire (SAQ), Safety Climate Survey (SCSc) and Information and Analysis (IA).

RESULTS

The Cronbach alpha was 0.81 for the group culture scale and 0.72 for the hierarchical culture scale. Group culture was positively correlated with SAQ and its subscales (from correlation coefficient r = 0.44 to 0.55, except situational recognition), ScSc (r = 0.47) and IA (r = 0.33). Hierarchical culture was negatively correlated with the SAQ scales, SCSc and IA. Among the 40 hospitals, 37.5% had a hierarchical dominant culture, 37.5% a dominant group culture and 25% a balanced culture. Group culture hospitals had significantly higher safety climate scores than hierarchical culture hospitals. The magnitude of these relationships was not affected after adjusting for provider job type and hospital characteristics.

CONCLUSIONS

Hospitals vary in organisational culture, and the type of culture relates to the safety climate within the hospital. In combination with prior studies, these results suggest that a healthcare organisation's culture is a critical factor in the development of its patient safety climate and in the successful implementation of quality improvement initiatives.

The effect of physician triage on emergency department length of stay

BACKGROUND

Emergency Department (ED) overcrowding is a serious public health issue, but few solutions exist.

OBJECTIVES

We sought to determine the impact of physician triage on ED length of stay for discharged and admitted patients, left-without-being-seen (LWBS) rates, and ambulance diversion.

METHODS

This was a pre-post study performed using retrospective data at an urban, academic tertiary care, Level I trauma center. On July 11, 2005, physician triage was initiated from 1:00 p.m. to 9:00 p.m., 7 days a week. An additional physician was placed in triage so that the ED diagnostic evaluation and treatment could be started in waiting room patients. Using the hospital information system, we obtained individual patient data, ED and waiting room statistics, and diversion status data from a 9-week pre-physician triage (May 11, 2005 to July 10, 2005) and a 9-week physician triage (July 11, 2005 to September 9, 2005) period.

RESULTS

We observed that overall ED length of stay decreased by 11 min, but this decrease was entirely attributed to non-admitted patients. No difference in ED length of stay was observed in admitted patients. LWBS rates decreased from 4.5% to 2.5%. Total time spent on ambulance diversion decreased from 5.6 days per month to 3.2 days per month.

CONCLUSION

Physician triage was associated with a decrease in LWBS rates, and time spent on ambulance diversion. However, its effect on ED LOS was modest in non-admitted ED patients and negligible in admitted patients.

Shifting Toward Balance: Measuring the Distribution of Workload Among Emergency Physician Teams

STUDY OBJECTIVE

The objective of this investigation is to determine time-dependent workload patterns for emergency department (ED) physician teams across work shifts. A secondary aim was to demonstrate how ED demand patterns and the timing of shift changes influence the balance of workload among a physician team.

METHODS

Operational measurements of an adult ED were collected from a clinical information system to characterize physician workload patterns during all current work shifts. Plots of patient load versus time were developed for each physician shift, in which patient load was defined as the number of patients a physician simultaneously managed at a point in time. Patient-load curves for each shift were superimposed during 24 hours to display how patient load was distributed among a team of physicians.

RESULTS

Resident shift changes during daily peak occupancy periods caused patient load imbalances so that residents on a particular shift consistently managed a disproportionate number of patients (mean 9.4 patients; 95% confidence interval [CI] 6.7 to 12.1 patients) compared with other residents on duty (mean 3.4 patients; 95% CI 2.1 to 4.7 patients).

CONCLUSION

Physician patient load patterns and ED demand patterns should be taken into consideration when physician shift times are scheduled so that patient load may be balanced among a team. Real-time monitoring of physician patient load may reduce stress and prevent physicians from exceeding their safe capacity for workload.

The effect of emergency department expansion on emergency department overcrowding

OBJECTIVES

To examine the effects of emergency department (ED) expansion on ambulance diversion at an urban, academic Level 1 trauma center.

METHODS

This was a pre-post study performed using administrative data from the ED and hospital electronic information systems. On April 19, 2005, the adult ED expanded from 28 to 53 licensed beds. Data from a five-month pre-expansion period (November 1, 2004, to March 1, 2005) and a five-month postexpansion period (June 1, 2005, to October 31, 2005) were included for this analysis. ED and waiting room statistics as well as diversion status were obtained. Total ED length of stay (LOS) was defined as the time from patient registration to the time leaving the ED. Admission hold LOS was defined as the time from the inpatient bed request to the time leaving the ED for admitted patients. Mean differences (95% confidence interval [CI]) in total time spent on ambulance diversion per month, diversion episodes per month, and duration per diversion episode were calculated. An accelerated failure time model was performed to test if ED expansion was associated with a reduction in ambulance diversion while adjusting for potential confounders.

RESULTS

From pre-expansion to postexpansion, daily patient volume increased but ED occupancy decreased. There was no significant change in the time spent on ambulance diversion per month (mean difference, 10.9 hours; 95% CI = -74.0 to 95.8), ambulance diversion episodes per month (two episodes per month; 95% CI = -4.2 to 8.2), and duration of ambulance diversion per episode (0.3 hours; 95% CI = -4.0 to 3.5). Mean (+/-SD) total LOS increased from 4.6 (+/-1.9) to 5.6(+/-2.3) hours, and mean (+/-SD) admission hold LOS also increased from 3.0 (+/-0.2) to 4.1 (+/-0.2) hours. The proportion of patients who left without being seen was 3.5% and 2.7% (p = 0.06) in the pre-expansion and postexpansion periods, respectively. In the accelerated failure time model, ED expansion did not affect the time to the next ambulance diversion episode.

CONCLUSIONS

An increase in ED bed capacity did not affect ambulance diversion. Instead, total and admission hold LOS increased. As a result, ED expansion appears to be an insufficient solution to improve diversion without addressing other bottlenecks in the hospital.

Assessment of adverse drug events among patients in a tertiary care medical center

PURPOSE

Specific patient and clinical characteristics associated with an increased risk of sustaining an adverse event (AE) were identified.

METHODS

AE reports for patients in a 658-bed tertiary care medical center between January 1, 2000, and June 30, 2002, were analyzed. The data collected from each report included medical record number, patient sex, patient age, clinical service, date of occurrence, diagnoses, type of error, suspected medication, and severity of the AE. A three-stage logistic regression model with high-risk indicators was used to evaluate key indicators of the most vulnerable patient populations.

RESULTS

The number of control patients and those with AEs totaled 60,206. This population was then randomly split into two equal groups of patients: the training data set (n = 30,103) and the validation data set (n = 30,103). AEs occurred in a higher percentage of patients who were age <1 year, 1-15, 47-59, and > or =60 years than in other groups. A higher percentage of AEs were reported in men than women, but the groups were not significantly different when comparing those with an AE and those without an AE. Asian Indian patients demonstrated a high rate of AEs, but this may be a statistical artifact, reflecting their very small percentage in the study. Evaluation of admission sources revealed that doctors' offices, clinic referrals, and local hospital transfers accounted for higher rates of AEs than other sources.

CONCLUSION

Certain age groups, diagnoses, admission sources, types of insurance, and the use of specific medications or medication classes were associated with increased AE rates at a tertiary care medical center.

System complexity as a measure of safe capacity for the emergency department

OBJECTIVES

System complexity is introduced as a new measure of system state for the emergency department (ED). In its original form, the measure quantifies the uncertainty of demands on system resources. For application in the ED, the measure is being modified to quantify both workload and uncertainty to produce a single integrated measure of system state.

METHODS

Complexity is quantified using an information-theoretic or entropic approach developed in manufacturing and operations research. In its original form, complexity is calculated on the basis of four system parameters: 1) the number of resources (clinicians and processing entities such as radiology and laboratory systems), 2) the number of possible work states for each resource, 3) the probability that a resource is in a particular work state, and 4) the probability of queue changes (i.e., where a queue is defined by the number of patients or patient orders being managed by a resource) during a specified time period.

RESULTS

An example is presented to demonstrate how complexity is calculated and interpreted for a simple system composed of three resources (i.e., emergency physicians) managing varying patient loads. The example shows that variation in physician work states and patient queues produces different scores of complexity for each physician. It also illustrates how complexity and workload differ.

CONCLUSIONS

System complexity is a viable and technically feasible measurement for monitoring and managing surge capacity in the ED.

Relationship between patient complaints and surgical complications

BACKGROUND

Patient complaints are associated with increased malpractice risk but it is unclear if complaints might be associated with medical complications. The purpose of this study was to determine whether an association exists between patient complaints and surgical complications.

METHODS

A retrospective analysis of 16,713 surgical admissions was conducted over a 54 month period at a single academic medical center. Surgical complications were identified using administrative data. The primary outcome measure was unsolicited patient complaints.

RESULTS

During the study period 0.9% of surgical admissions were associated with a patient complaint. 19% of admissions associated with a patient complaint included a postoperative complication compared with 12.5% of admissions without a patient complaint (p = 0.01). After adjusting for surgical specialty, co-morbid illnesses and length of stay, admissions with complications had an odds ratio of 1.74 (95% confidence interval 1.01 to 2.98) of being associated with a complaint compared with admissions without complications.

CONCLUSIONS

Admissions with surgical complications are more likely to be associated with a complaint than surgical admissions without complications. Further research is necessary to determine if patient complaints might serve as markers for poor clinical outcomes.

Evaluation of a Hands-Free Wireless Communication Device in the Perioperative Environment

The objective of this study was to evaluate the efficiency and reliability of a hands-free voice over Internet protocol (VOIP) communication system in the perioperative environment. Two surveys were administered to anesthesiologists and operating room (OR) nurses working at an academic medical center. Providers were queried by alphanumeric pages or VOIP queries during OR work shifts to measure communication response times. Providers, responding to the query, were asked to verbally complete a system performance survey to capture information regarding their workload and work environment at the time of the query. A user feedback survey was independently administered in writing to a convenience sample of OR providers to obtain information regarding provider communication preferences, concerns, and recommendations. OR providers responded to communication queries four times faster when using VOIP compared to alphanumeric pagers. Providers found VOIP to be much less reliable than conventional pager-telephone systems. Dead spots in the 802.11b network and errors in speaker recognition were frequently cited as sources of system failures. Providers also expressed concern in maintaining confidentiality of patient data or other clinical data communicated using this system. The results of this study suggest that VOIP is still a developing technology but one that is currently viable in the clinical setting. The technology can be used efficiently and securely in health care if users are given the proper training its functions and capabilities.

Tracking workload in the emergency department

OBJECTIVE

The primary objective of this study was to create a methodology for measuring transient levels of physician workload in a live emergency department (ED) environment.

BACKGROUND

Characterizing, defining, and measuring aspects of this interrupt-driven work environment represent the preliminary steps in addressing impending issues concerning ED overcrowding, efficiency, and patient and provider safety.

METHODS

A time-motion task analysis was conducted. Twenty emergency medicine (EM) physicians were observed for 180-min intervals in an ED of an academic medical center. Near continuous workload measures were developed and used to track changing workload levels in time. These measures were taken from subjective, objective, and physiological perspectives. The NASA-Task Load Index was administered to each physician after observational sessions to measure subjective workload. Physiological measurements were taken throughout the duration of the observation to measure stress response. Additional information concerning physicians' patient quantity and patient complexity was extracted from the ED information system.

RESULTS

Graphical workload profiles were created by combining observational and subjective data with system state data. Methodologies behind the creation of workload profiles are discussed, the workload profiles are compared, and quantitative and qualitative analyses are conducted.

CONCLUSION

Using human factors methods to measure workload in a setting such as the ED proves to be challenging but has relevant application in improving the efficiency and safety of EM.

APPLICATION

Techniques implemented in this research are applicable in managing ED staff and real-time monitoring of physician workload.

Emergency physicians’ behaviors and workload in the presence of an electronic whiteboard

BACKGROUND

As the demands on the emergency medicine (EM) system continue to increase, improvements in the organization of work and the access to timely clinical and system information will be required for providers to manage their workload in a safe and efficient manner. Information technology (IT) solutions are beginning to find their place in the emergency department (ED) and it is time to begin understanding how these systems are effecting physician behavior, communication and workload.

METHODS

The study used a time-in-motion, primary task analyses to study faculty and resident physician behavior in the presence of an electronic whiteboard. The NASA-Task Load Index (TLX) was used to measure subjective workload and the underlying dimensions of workload at the end of each physician observation. Work, communication and workload were characterized using descriptive statistics and compared using Mann-Whitney U-tests.

RESULTS

Physicians in our study performed more tasks and were interrupted less than physicians studied previously in conventional EDs. Interruptions interrupted direct patient care tasks less than other clinical activities. Temporary interruptions appear to be a major source of inefficiency in the ED, and likely a major threat to patient safety. Face-to-face interruptions persist even in the presence of advanced IT systems, such as the electronic whiteboard. Faculty physicians exhibited lower workload scores than resident physicians. Frustration was a significant contributing factor to workload in resident physicians. All physicians ranked temporal demands and mental demands as major contributing factors to workload.

CONCLUSION

The results indicate that the electronic whiteboard improves the efficiency of work and communication in the ED. IT solutions may have great utility in improving provider situational awareness and distributing workload among ED providers. The results also demonstrate that IT solutions alone will not solve all problems in the ED. IT solutions will probably be most effective in improving efficiency and safety outcomes when paired with human-based interventions, such as crew resource management. Future studies must investigate team interaction, workload and situational awareness, and the association of these factors to patient and provider outcomes.

Crew resource management training-Clinicians' reactions and attitudes

Many health care organizations are adopting crew resource management (CRM) training from the aviation industry as a patient safety practice. Although CRM has high face validity, its effects have not been thoroughly evaluated in aviation or health care. Its potential to improve team communication, coordination, and patient safety, however, makes efforts to study CRM necessary and worthwhile. This article evaluates clinicians' attitudes about and reactions to CRM after they participated in an eight-hour, commercially developed training program.

Volatility: A New Vital Sign Identified Using a Novel Bedside Monitoring Strategy

BACKGROUND

SIMON (Signal Interpretation and Monitoring) monitors and archives continuous physiologic data in the ICU (HR, BP, CPP, ICP, CI, EDVI, SVO2, SPO2, SVRI, PAP, and CVP). We hypothesized: heart rate (HR) volatility predicts outcome better than measures of central tendency (mean and median).

METHODS

More than 600 million physiologic data points were archived from 923 patients over 2 years in a level one trauma center. Data were collected every 1 to 4 seconds, stored in a MS-SQL 7.0 relational database, linked to TRACS, and de-identified. Age, gender, race, Injury Severity Score (ISS), and HR statistics were analyzed with respect to outcome (death and ventilator days) using logistic and Poisson regression.

RESULTS

We analyzed 85 million HR data points, which represent more than 71,000 hours of continuous data capture. Mean HR varied by age, gender and ISS, but did not correlate with death or ventilator days. Measures of volatility (SD, % HR >120) correlated with death and prolonged ventilation.

CONCLUSIONS

1) Volatility predicts death better than measures of central tendency. 2) Volatility is a new vital sign that we will apply to other physiologic parameters, and that can only be fully explored using techniques of dense data capture like SIMON. 3) Densely sampled aggregated physiologic data may identify sub-groups of patients requiring new treatment strategies.

The impact of aviation-based teamwork training on the attitudes of health-care professionals

BACKGROUND

Both the Institute of Medicine and the Agency for Healthcare Research and Quality suggest patient safety can be enhanced by implementing aviation Crew Resource Management (CRM) in health care. CRM emphasizes six key areas: managing fatigue, creating and managing teams, recognizing adverse situations (red flags), cross-checking and communication, decision making, and performance feedback. This study evaluates participant reactions and attitudes to CRM training.

STUDY DESIGN

From April 22, 2003, to December 11, 2003, clinical teams from the trauma unit, emergency department, operative services, cardiac catheterization laboratory, and administration underwent an 8-hour training course. Participants completed an 11-question End-of-Course Critique (ECC), designed to assess the perceived need for training and usefulness of CRM skill sets. The Human Factors Attitude Survey contains 23 items and is administered on the same day both pre- and posttraining. It measures attitudinal shifts toward the six training modules and CRM.

RESULTS

Of the 489 participants undergoing CRM training during the study period, 463 (95%) completed the ECC and 338 (69%) completed the Human Factors Attitude Survey. The demographics of the group included 288 (59%) nurses and technicians, 104 (21%) physicians, and 97 (20%) administrative personnel. Responses to the ECC were very positive for all questions, and 95% of respondents agreed or strongly agreed CRM training would reduce errors in their practice. Responses to the Human Factors Attitude Survey indicated that the training had a positive impact on 20 of the 23 items (p < 0.01).

CONCLUSIONS

CRM training improves attitudes toward fatigue management, team building, communication, recognizing adverse events, team decision making, and performance feedback. Participants agreed that CRM training will reduce errors and improve patient safety.

Improving pediatric chemotherapy safety through voluntary incident reporting: lessons from the field

BACKGROUND

A multidisciplinary team within Vanderbilt Children's Hospital (VCH) designed, developed, and implemented a pediatric chemotherapy incident reporting and improvement system (CIRIS) for pediatric oncology nurse and pharmacists. The aim of this collaboration was to improve pediatric chemotherapy by translating recommendations made by the Institute of Medicine into an operational safety improvement system that is embedded into daily care processes.

METHODS

CIRIS improves chemotherapy safety by linking two distinct components: (a) a technical component that uses desktop, laptop, and portable wireless handheld computers to interface the Web-based software application for point-of-care incident reporting and on-demand retrieval of patient support information, and (b) a human component that performs process analysis, data reporting, and clinical improvement. This integrated system facilitates and supports a blame-free culture for reporting of near misses and preventable adverse drug events.

RESULTS

Between February 8, 2002, and March 9, 2003, pediatric oncology nurses and chemotherapy pharmacists electronically reported 97 chemotherapy-related incidents associated with 96 unique patients. Ordering errors were the most commonly reported incidents. CIRIS improved reporting performance demonstrated using the conventional paper-based reporting system.

Reduced heart rate volatility: an early predictor of death in trauma patients

OBJECTIVE

To determine if using dense data capture to measure heart rate volatility (standard deviation) measured in 5-minute intervals predicts death.

BACKGROUND

Fundamental approaches to assessing vital signs in the critically ill have changed little since the early 1900s. Our prior work in this area has demonstrated the utility of densely sampled data and, in particular, heart rate volatility over the entire patient stay, for predicting death and prolonged ventilation.

METHODS

Approximately 120 million heart rate data points were prospectively collected and archived from 1316 trauma ICU patients over 30 months. Data were sampled every 1 to 4 seconds, stored in a relational database, linked to outcome data, and de-identified. HR standard deviation was continuously computed over 5-minute intervals (CVRD, cardiac volatility-related dysfunction). Logistic regression models incorporating age and injury severity score were developed on a test set of patients (N = 923), and prospectively analyzed in a distinct validation set (N = 393) for the first 24 hours of ICU data.

RESULTS

Distribution of CVRD varied by survival in the test set. Prospective evaluation of the model in the validation set gave an area in the receiver operating curve of 0.81 with a sensitivity and specificity of 70.1 and 80.0, respectively. CVRD predict death as early as 24 hours in the validation set.

CONCLUSIONS

CVRD identifies a subgroup of patients with a high probability of dying. Death is predicted within first 24 hours of stay. We hypothesize CVRD is a surrogate for autonomic nervous system dysfunction.

A chemotherapy incident reporting and improvement system

BACKGROUND

The Vanderbilt University Medical Center (VUMC) has designed and deployed the Chemotherapy Incident Reporting and Improvement System (CIRIS), which is embedded into daily care processes. The system uses commercial information technologies, including handheld computers, to create a mobile Web-based chemotherapy incident reporting system for nurses and pharmacists. Two phases--(1) development and implementation of the CIRIS incident reporting safety registry and (2) development of the handheld-computer interface--were implemented. The final phase entails integration of the computerized order entry system into the front end of the CIRIS architecture. The voluntary incident reporting system data are stored over time for use by the multidisciplinary safety improvement team.

RESULTS

Staff buy-in has been demonstrated by increased reporting rates, the high number of provider-initiated improvements made to the reporting tool during the first year of implementation, and specific chemotherapy safety interventions conceived from analysis of the reported data.

CONCLUSION

The CIRIS model for pediatric chemotherapy safety improvement has been implemented in the inpatient setting but could easily be configured for a variety of other clinical applications in inpatient or outpatient settings. CIRIS has been effective, especially in the chemotherapy pharmacy, where incident reporting has increased dramatically.

Acoustical properties of speech as indicators of depression and suicidal risk

Acoustic properties of speech have previously been identified as possible cues to depression, and there is evidence that certain vocal parameters may be used further to objectively discriminate between depressed and suicidal speech. Studies were performed to analyze and compare the speech acoustics of separate male and female samples comprised of normal individuals and individuals carrying diagnoses of depression and high-risk, near-term suicidality. The female sample consisted of ten control subjects, 17 dysthymic patients, and 21 major depressed patients. The male sample contained 24 control subjects, 21 major depressed patients, and 22 high-risk suicidal patients. Acoustic analyses of voice fundamental frequency (Fo), amplitude modulation (AM), formants, and power distribution were performed on speech samples extracted from audio recordings collected from the sample members. Multivariate feature and discriminant analyses were performed on feature vectors representing the members of the control and disordered classes. Features derived from the formant and power spectral density measurements were found to be the best discriminators of class membership in both the male and female studies. AM features emerged as strong class discriminators of the male classes. Features describing Fo were generally ineffective discriminators in both studies. The results support theories that identify psychomotor disturbances as central elements in depression and suicidality.