Identification of patient information corruption in the intensive care unit: using a scoring tool to direct quality improvements in handover. Crit Care Med. 2009;37:2905-2912. [PMID: 19770735 DOI: 10.1097/ccm.0b013e3181a96267]

Unit-to-unit transfer due to shortage of intensive care beds in Sweden 2015-2019 was associated with a lower risk of death but a longer intensive care stay compared to no transfer: a registry study

BACKGROUND

Intensive care unit-to-unit transfer due to temporary shortage of beds is increasing in Sweden. Transportation induces practical hazards, and the change of health care provider may prolong the length of stay in intensive care. We previously showed that the risk of death at 90 days did not differ between patients transferred due to a shortage of beds and non-transferred patients with a similar burden of illness in a tertiary intensive care unit. The aim of this study was to widen the analysis to a nation-wide cohort of critically ill patients transferred to another intensive care unit in Sweden due to shortage of intensive care beds.

METHODS

Retrospective comparison between capacity transferred and non-transferred patients, based on data from the Swedish Intensive Care Registry during a 5-year period before the COVID-19 pandemic. Patients with insufficient data entries or a recurring capacity transfer within 90 days were excluded. To assess the association between capacity transfer and death as well as intensive care stay within 90 days after ICU admission, logistic regression models with step-wise adjustment for SAPS3 score, primary ICD-10 ICU diagnosis and the number of days in the intensive care unit before transfer were applied.

RESULTS

From 161,140 eligible intensive care admissions, 2912 capacity transfers were compared to 135,641 discharges or deaths in the intensive care unit. Ninety days after ICU admission, 28% of transferred and 21% of non-transferred patients were deceased. In the fully adjusted model, capacity transfer was associated with a lower risk of death within 90 days than no transfer; OR (95% CI) 0.71 (0.65-0.69) and the number of days spent in intensive care was longer: 12.4 [95% CI 12.2-12.5] vs 3.3 [3.3-3.3].

CONCLUSIONS

Intensive care unit-to-unit transfer due to shortage of bed capacity as compared to no transfer during a 5-year period preceding the COVID-19 pandemic in Sweden was associated with lower risk of death within 90 days but with longer stay in intensive care.

Intensive care unit to unit capacity transfers are associated with increased mortality: an observational cohort study on patient transfers in the Swedish Intensive Care Register

Background

Transfers from one intensive care unit (ICU) to another ICU are associated with increased length of intensive care and hospital stay. Inter-hospital ICU transfers are carried out for three main reasons: clinical transfers, capacity transfers and repatriations. The aim of the study was to show that different ICU transfers differ in risk-adjusted mortality rate with repatriations having the least risk.

Results

Observational cohort study of adult patients transferred between Swedish ICUs during 3 years (2016–2018) with follow-up ending September 2019. Primary and secondary end-points were survival to 30 days and 180 days after discharge from the first ICU. Data from 75 ICUs in the Swedish Intensive Care Register, a nationwide intensive care register, were used for analysis (89% of all Swedish ICUs), covering local community hospitals, district general hospitals and tertiary care hospitals. We included adult patients (16 years or older) admitted to ICU and subsequently discharged by transfer to another ICU. Only the first admission was used. Exposure was discharge to any other ICU (ICU-to-ICU transfer), whether in the same or in another hospital. Transfers were grouped into three predefined categories: clinical transfer, capacity transfer, and repatriation. We identified 15,588 transfers among 112,860 admissions (14.8%) and analysed 11,176 after excluding 4112 repeat transfer of the same individual and 300 with missing risk adjustment. The majority were clinical transfers (62.7%), followed by repatriations (21.5%) and capacity transfers (15.8%). Unadjusted 30-day mortality was 25.0% among capacity transfers compared to 14.5% and 16.2% for clinical transfers and repatriations, respectively. Adjusted odds ratio (OR) for 30-day mortality were 1.25 (95% CI 1.06–1.49 p = 0.01) for capacity transfers and 1.17 (95% CI 1.02–1.36 p = 0.03) for clinical transfers using repatriation as reference. The differences remained 180 days post-discharge.

Conclusions

There was a large proportion of ICU-to-ICU transfers and an increased odds of dying for those transferred due to other reasons than repatriation.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13613-022-01003-x.

A Model for a Standardized and Sustainable Pediatric Anesthesia-Intensive Care Unit Hand-Off Process

Background and Objectives: The hand-off process between pediatric anesthesia and intensive care unit (ICU) teams involves the exchange of patient health information and plays a major role in reducing errors and increasing staff satisfaction. Our objectives were to (1) standardize the hand-off process in children’s ICUs, and (2) evaluate the provider satisfaction, efficiency and sustainability of the improved hand-off process. Methods: Following multidisciplinary discussions, the hand-off process was standardized for transfers of care between anesthesia-ICU teams. A pre-implementation and two post-implementation (6 months, >2 years) staff satisfaction surveys and audits were conducted to evaluate the success, quality and sustainability of the hand-off process. Results: There was no difference in the time spent during the sign out process following standardization—median 5 min for pre-implementation versus 5 and 6 min for post-implementation at six months and >2 years, respectively. There was a significant decrease in the number of missed items (airway/ventilation, venous access, medications, and laboratory values pertinent events) post-implementation compared to pre-implementation (p ≤ 0.001). In the >2 years follow-up survey, 49.2% of providers felt that the hand-off could be improved versus 78.4% in pre-implementation and 54.2% in the six-month survey (p < 0.001). Conclusion: A standardized interactive hand-off improves the efficiency and staff satisfaction, with a decreased rate of missed information at the cost of no additional time.

Data Omission by Physician Trainees on ICU Rounds

OBJECTIVES

Incomplete patient data, either due to difficulty gathering and synthesizing or inappropriate data filtering, can lead clinicians to misdiagnosis and medical error. How completely ICU interprofessional rounding teams appraise the patient data set that informs clinical decision-making is unknown. This study measures how frequently physician trainees omit data from prerounding notes ("artifacts") and verbal presentations during daily rounds.

DESIGN

Observational study.

SETTING

Tertiary academic medical ICU with an established electronic health record and where physician trainees are the primary presenters during daily rounds.

SUBJECTS

Presenters (medical student or resident physician), interprofessional rounding team.

INTERVENTIONS

None.

MEASUREMENTS AND MAIN RESULTS

We quantified the amount and types of patient data omitted from photocopies of physician trainees' artifacts and audio recordings of oral ICU rounds presentations when compared with source electronic health record data. An audit of 157 patient presentations including 6,055 data elements across nine domains revealed 100% of presentations contained omissions. Overall, 22.9% of data were missing from artifacts and 42.4% from presentations. The interprofessional team supplemented only 4.1% of additional available data. Frequency of trainee data omission varied by data type and sociotechnical factors. The strongest predictor of trainee verbal omissions was a preceding failure to include the data on the artifact. Passive data gathering via electronic health record macros resulted in extremely complete artifacts but paradoxically predicted greater likelihood of verbal omission when compared with manual notation. Interns verbally omitted the most data, whereas medical students omitted the least.

CONCLUSIONS

In an academic rounding model reliant on trainees to preview and select data for presentation during ICU rounds, verbal appraisal of patient data was highly incomplete. Additional trainee oversight and education, improved electronic health record tools, and novel academic rounding paradigms are needed to address this potential source of medical error.

Seizure frequency in patients with isolated subdural hematoma and preserved consciousness

Background: Seizures are a complication of subdural hematoma (SDH), and there is substantial variability in the use of seizure prophylaxis for patients with SDH. However, the incidence of seizures in patients with SDH without severe neurotrauma is not clear. The objective of this study was to assess the frequency of and factors associated with seizures in patients with isolated SDH (iSDH) without severe neurotrauma. Methods: In this retrospective, observational study, we identified adults with Glasgow Coma Score (GCS) ≥13 and computed tomography (CT)-documented iSDH. The primary outcome was clinical seizure frequency. Seizure medication use was also assessed. Fisher's exact test and logistic regression were used to assess association. Results: Of 643 patients with iSDH, 14 (2.2%) had seizures during hospitalization. Of 630 patients (98%) not receiving seizure medication prior to SDH, 522 (82.9%) received levetiracetam. Of the patients who received a seizure medication, 12 (2.3%) had a seizure, while of the 121 patients who did not receive seizure medications, 2 (1.9%) had a seizure (p = .49). In multivariable regression, the only variable significantly associated with seizure was thickness of subdural hematoma (OR 1.16, p = .005). Conclusion: In patients with iSDH and preserved consciousness, in-hospital seizures were rare regardless of seizure medications use.

A mixed-methods evaluation framework for electronic health records usability studies

BACKGROUND

Poor EHR design adds further challenges, especially in the areas of order entry and information visualization, with a net effect of increased rates of incidents, accidents, and mortality in ICU settings.

OBJECTIVE

The purpose of this study was to propose a novel, mixed-methods framework to understand EHR-related information overload by identifying and characterizing areas of suboptimal usability and clinician frustration within a vendor-based, provider-facing EHR interface.

METHODS

A mixed-methods, live observational usability study was conducted at a single, large, tertiary academic medical center in the Southeastern US utilizing a commercial, vendor based EHR. Physicians were asked to complete usability patient cases, provide responses to three surveys, and participant in a semi-structured interview.

RESULTS

Of the 25 enrolled ICU physician participants, there were 5(20%) attending physicians, 9 (36%) fellows, and 11 (44%) residents; 52% of participants were females. On average, residents were the quickest in completing the tasks while attending physician took the longest to complete the same task. Poor usability, complex interface screens, and difficulty to navigate the EHR significantly correlated with high frustration levels. Significant association were found between the occurrence of error messages and temporal demand such that more error messages resulted in longer completion time (p = .03).

DISCUSSION

Physicians remain frustrated with the EHR due to difficulty in finding patient information. EHR usability remains a critical challenge in healthcare, with implications for medical errors, patient safety, and clinician burnout. There is a need for scientific findings on current information needs and ways to improve EHR-related information overload.

Select hyperacute complications of ischemic stroke: cerebral edema, hemorrhagic transformation, and orolingual angioedema secondary to intravenous Alteplase

INTRODUCTION

Remarkable advances have occurred in the management of acute ischemic stroke, especially in regards to reperfusion treatments. With advances in reperfusion treatments come the risk of complications associated with these treatments. Areas covered: The article focuses on three acute complications that can occur in the setting of acute ischemic stroke: cerebral edema, hemorrhagic transformation, and orolingual angioedema following administration of alteplase, a recombinant tissue plasminogen activator. Predictors of the development of these complications are reviewed. The management of cerebral edema and hemorrhagic transformation is also reviewed in depth including potential new treatments targeting the blood-brain barrier. The article also reviews the management of the rare but potentially fatal complication of orolingual angioedema secondary to alteplase. Expert commentary: An understanding of the pathophysiology leading to the development of malignant cerebral edema and hemorrhagic transformation allows the clinician to anticipate and properly manage these acute complications. Regardless of a patient's age or comorbidities, the decision to pursue decompressive hemicraniectomy in patients with malignant cerebral edema should be based on an honest assessment of expected outcome and guided by the patient's prior wishes regarding an acceptable quality of life.

Prompting with electronic checklist improves clinician performance in medical emergencies: a high-fidelity simulation study

Background

Inefficient processes of care delivery during acute resuscitation can compromise the “Golden Hour,” the time when quick interventions can rapidly determine the course of the patient’s outcome. Checklists have been shown to be an effective tool for standardizing care models. We developed a novel electronic tool, the Checklist for Early Recognition and Treatment of Acute Illness (CERTAIN) to facilitate standardized evaluation and treatment approach for acutely decompensating patients. The checklist was enforced by the use of a “prompter,” a team member separate from the leader who records and reviews pertinent CERTAIN algorithms and verbalizes these to the team. Our hypothesis was that the CERTAIN model, with the use of the tool and a prompter, can improve clinician performance and satisfaction in the evaluation of acute decompensating patients in a simulated environment.

Methods

Volunteer clinicians with valid adult cardiac life support (ACLS) certification were invited to test the CERTAIN model in a high-fidelity simulation center. The first session was used to establish a baseline evaluation in a standard clinical resuscitation scenario. Each subject then underwent online training before returning to a simulation center for a live didactic lecture, software knowledge assessment, and practice scenarios. Each subject was then evaluated on a scenario with a similar content to the baseline. All subjects took a post-experience satisfaction survey. Video recordings of the pre-and post-test sessions were evaluated using a validated method by two blinded reviewers.

Results

Eighteen clinicians completed baseline and post-education sessions. CERTAIN prompting was associated with reduced omissions of critical tasks (46 to 32%, p < 0.01) and 12 out of 14 general assessment tasks were completed in a more timely manner. The post-test survey indicated that 72% subjects felt better prepared during an emergency scenario using the CERTAIN model and 85% would want to be treated with the CERTAIN if they were critically ill.

Conclusion

Prompting with electronic checklist improves clinicians’ performance and satisfaction when dealing with medical emergencies in high-fidelity simulation environment.

Electronic supplementary material

The online version of this article (10.1186/s12245-018-0185-8) contains supplementary material, which is available to authorized users.

Focused Training for the Handover of Critical Patient Information During Simulated Pediatric Emergencies

OBJECTIVES

Miscommunication has been implicated as a leading cause of medical errors, and standardized handover programs have been associated with improved patient outcomes. However, the role of structured handovers in pediatric emergencies remains unclear. We sought to determine if training with an airway, breathing, circulation, situation, background, assessment, recommendation handover tool could improve the transmission of essential patient information during multidisciplinary simulations of critically ill children.

METHODS

We conducted a prospective, randomized, intervention study with first-year pediatric residents at a quaternary academic children's hospital. Baseline and second handovers were recorded for residents in the intervention group (n = 12) and residents in the control group (n = 8) during multidisciplinary simulations throughout the academic year. The intervention group received handover education after baseline handover observation and a cognitive aid before second handover observation. Audio-recorded handovers were scored by using a Delphi-developed assessment tool by a blinded rater.

RESULTS

There was no difference in baseline handover scores between groups (P = .69), but second handover scores were significantly higher in the intervention group (median 12.5 [interquartile range 12-13] versus median 7.5 [interquartile range 6-8] in the control group; P < .01). Trained residents were more likely to include a reason for the call (P < .01), focused history (P = .02), and summative assessment (P = .03). Neither timing of the second observation in the academic year nor duration between first and second observation were associated with the second handover scores (both P > .5).

CONCLUSIONS

Structured handover training and provision of a cognitive aid may improve the inclusion of essential patient information in the handover of simulated critically ill children.

Information needs for the rapid response team electronic clinical tool

Background

Information overload in healthcare is dangerous. It can lead to critical errors and delays. During Rapid Response Team (RRT) activations providers must make decisions quickly to rescue patients from physiological deterioration. In order to understand the clinical data required and how best to present that information in electronic systems we aimed to better assess the data needs of providers on the RRT when they respond to an event.

Methods

A web based survey to evaluate clinical data requirements was created and distributed to all RRT providers at our institution. Participants were asked to rate the importance of each data item in guiding clinical decisions during a RRT event response.

Results

There were 96 surveys completed (24.5% response rate) with fairly even distribution throughout all clinical roles on the RRT. Physiological data including heart rate, respiratory rate, and blood pressure were ranked by more than 80% of responders as being critical information. Resuscitation status was also considered critically useful by more than 85% of providers.

Conclusion

There is a limited dataset that is considered important during an RRT. The data is widely available in EMR. The findings from this study could be used to improve user-centered EMR interfaces.

Accuracy of Laboratory Data Communication on ICU Daily Rounds Using an Electronic Health Record

Supplemental Digital Content is available in the text.

Objectives:

Accurately communicating patient data during daily ICU rounds is critically important since data provide the basis for clinical decision making. Despite its importance, high fidelity data communication during interprofessional ICU rounds is assumed, yet unproven. We created a robust but simple methodology to measure the prevalence of inaccurately communicated (misrepresented) data and to characterize data communication failures by type. We also assessed how commonly the rounding team detected data misrepresentation and whether data communication was impacted by environmental, human, and workflow factors.

Design:

Direct observation of verbalized laboratory data during daily ICU rounds compared with data within the electronic health record and on presenters’ paper prerounding notes.

Setting:

Twenty-six-bed academic medical ICU with a well-established electronic health record.

Subjects:

ICU rounds presenter (medical student or resident physician), interprofessional rounding team.

Interventions:

None.

Measurements and Main Results:

During 301 observed patient presentations including 4,945 audited laboratory results, presenters used a paper prerounding tool for 94.3% of presentations but tools contained only 78% of available electronic health record laboratory data. Ninty-six percent of patient presentations included at least one laboratory misrepresentation (mean, 6.3 per patient) and 38.9% of all audited laboratory data were inaccurately communicated. Most misrepresentation events were omissions. Only 7.8% of all laboratory misrepresentations were detected.

Conclusion:

Despite a structured interprofessional rounding script and a well-established electronic health record, clinician laboratory data retrieval and communication during ICU rounds at our institution was poor, prone to omissions and inaccuracies, yet largely unrecognized by the rounding team. This highlights an important patient safety issue that is likely widely prevalent, yet underrecognized.

Implementing situation-background-assessment-recommendation in an anaesthetic clinic and subsequent information retention among receivers: A prospective interventional study of postoperative handovers

BACKGROUND

Communication errors cause clinical incidents and adverse events in relation to surgery. To ensure proper postoperative patient care, it is essential that personnel remember and recall information given during the handover from the operating theatre to the postanaesthesia care unit. Formalizing the handover may improve communication and aid memory, but research in this area is lacking.

OBJECTIVE

The objective of this study was to evaluate whether implementing the communication tool Situation-Background-Assessment-Recommendation (SBAR) affects receivers' information retention after postoperative handover.

DESIGN

A prospective intervention study with an intervention group and comparison nonintervention group, with assessments before and after the intervention.

SETTING

The postanaesthesia care units of two hospitals in Sweden during 2011 and 2012.

PARTICIPANTS

Staff involved in the handover between the operating theatre and the postanaesthesia care units within each hospital.

INTERVENTION

Implementation of the communication tool SBAR in one hospital.

MAIN OUTCOME MEASURES

The main outcome was the percentage of recalled information sequences among receivers after the handover. Data were collected using both audio-recordings and observations recorded on a study-specific protocol form.

RESULTS

Preintervention, 73 handovers were observed (intervention group, n = 40; comparison group, n = 33) involving 72 personnel (intervention group, n = 40; comparison group, n = 32). Postintervention, 91 handovers were observed (intervention group, n = 44; comparison group, n = 47) involving 57 personnel (intervention group, n = 31; comparison group, n = 26). In the intervention group, the percentage of recalled information sequences by the receivers increased from 43.4% preintervention to 52.6% postintervention (P = 0.004) and the SBAR structure improved significantly (P = 0.028). In the comparison group, the corresponding figures were 51.3 and 52.6% (P = 0.725) with no difference in SBAR structure. When a linear regression generalised estimating equation model was used to account for confounding influences, we were unable to show a significant difference in the information recalled between the intervention group and the nonintervention group over time.

CONCLUSION

Compared with the comparison group with no intervention, when SBAR was implemented in an anaesthetic clinic, we were unable to show any improvement in recalled information among receivers following postoperative handover.

TRIAL REGISTRATION

Current controlled trials http://www.controlled-trials.com Identifier: ISRCTN37251313.

Information Needs Assessment for a Medicine Ward-Focused Rounding Dashboard

To identify the routine information needs of inpatient clinicians on the general wards for the development of an electronic dashboard. Survey of internal medicine and subspecialty clinicians from March 2014-July 2014 at Saint Marys Hospital in Rochester, Minnesota. An information needs assessment was generated from all unique data elements extracted from all handoff and rounding tools used by clinicians in our ICUs and general wards. An electronic survey was distributed to 104 inpatient medical providers. 89 unique data elements were identified from currently utilized handoff and rounding instruments. All data elements were present in our multipurpose ICU-based dashboard. 42 of 104 (40 %) surveys were returned. Data elements important (50/89, 56 %) and unimportant (24/89, 27 %) for routine use were identified. No significant differences in data element ranking were observed between supervisory and nonsupervisory roles. The routine information needs of general ward clinicians are a subset of data elements used routinely by ICU clinicians. Our findings suggest an electronic dashboard could be adapted from the critical care setting to the general wards with minimal modification.

Improving Escalation of Care: Development and Validation of the Quality of Information Transfer Tool

OBJECTIVE

To develop and provide validity and feasibility evidence for the QUality of Information Transfer (QUIT) tool.

BACKGROUND

Prompt escalation of care in the setting of patient deterioration can prevent further harm. Escalation and information transfer skills are not currently measured in surgery.

METHODS

This study comprised 3 phases: the development (phase 1), validation (phase 2), and feasibility analysis (phase 3) of the QUIT tool. Phase 1 involved identification of core skills needed for successful escalation of care through literature review and 33 semistructured interviews with stakeholders. Phase 2 involved the generation of validity evidence for the tool using a simulated setting. Thirty surgeons assessed a deteriorating postoperative patient in a simulated ward and escalated their care to a senior colleague. The face and content validity were assessed using a survey. Construct and concurrent validity of the tool were determined by comparing performance scores using the QUIT tool with those measured using the Situation-Background-Assessment-Recommendation (SBAR) tool. Phase 3 was conducted using direct observation of escalation scenarios on surgical wards in 2 hospitals.

RESULTS

A 7-category assessment tool was developed from phase 1 consisting of 24 items. Twenty-one of 24 items had excellent content validity (content validity index >0.8). All 7 categories and 18 of 24 (P < 0.05) items demonstrated construct validity. The correlation between the QUIT and SBAR tools used was strong indicating concurrent validity (r = 0.694, P < 0.001). Real-time scoring of escalation referrals was feasible and indicated that doctors currently have better information transfer skills than nurses when faced with a deteriorating patient.

CONCLUSIONS

A validated tool to assess information transfer for deteriorating surgical patients was developed and tested using simulation and real-time clinical scenarios. It may improve the quality and safety of patient care on the surgical ward.

Automatic quality improvement reports in the intensive care unit: One step closer toward meaningful use

AIM: To examine the feasibility and validity of electronic generation of quality metrics in the intensive care unit (ICU).

METHODS: This minimal risk observational study was performed at an academic tertiary hospital. The Critical Care Independent Multidisciplinary Program at Mayo Clinic identified and defined 11 key quality metrics. These metrics were automatically calculated using ICU DataMart, a near-real time copy of all ICU electronic medical record (EMR) data. The automatic report was compared with data from a comprehensive EMR review by a trained investigator. Data was collected for 93 randomly selected patients admitted to the ICU during April 2012 (10% of admitted adult population). This study was approved by the Mayo Clinic Institution Review Board.

RESULTS: All types of variables needed for metric calculations were found to be available for manual and electronic abstraction, except information for availability of free beds for patient-specific time-frames. There was 100% agreement between electronic and manual data abstraction for ICU admission source, admission service, and discharge disposition. The agreement between electronic and manual data abstraction of the time of ICU admission and discharge were 99% and 89%. The time of hospital admission and discharge were similar for both the electronically and manually abstracted datasets. The specificity of the electronically-generated report was 93% and 94% for invasive and non-invasive ventilation use in the ICU. One false-positive result for each type of ventilation was present. The specificity for ICU and in-hospital mortality was 100%. Sensitivity was 100% for all metrics.

CONCLUSION: Our study demonstrates excellent accuracy of electronically-generated key ICU quality metrics. This validates the feasibility of automatic metric generation.

Surgical suite to pediatric intensive care unit handover protocol: implementation process and long-term sustainability

The article reports the long-term sustainability of a standardized transfer protocol from cardiac surgical suite to the pediatric intensive care unit. Using rapid process improvement technique, the original mean defect rate per handover decreased from 13.2 to 0 and 0.3, 12, and 24 months postimplementation, respectively. This study stresses the importance of long-term assessment to control for possible observation biases; it also illustrates a successful implementation strategy that used video recording to engage staff in identifying solutions to the observed defects.

Clinician perceptions of operating room to intensive care unit handoffs and implications for patient safety: a qualitative study

BACKGROUND

Operating room (OR) to the intensive care unit (ICU) handoffs are known sources of medical error, yet little is known about the relationship between process failures and patient harm.

METHODS

Interviews were conducted with clinicians involved in the OR-to-ICU handoff to characterize the relationship between handoff process failures and patient harm. Qualitative analysis was used to inductively identify key themes.

RESULTS

A total of 38 interviews were conducted. Dominant themes included early communication from the OR to the ICU, team member participation in the handoff, and relationships between clinicians; clinician perspectives varied depending substantially on role within the team.

CONCLUSIONS

The findings suggest that ambiguous roles and conflicting expectations of team members during the OR-to-ICU handoff can increase risk of patient harm. Future studies should investigate early postoperative ICU care as outcome markers of handoff quality and the effect of interprofessional education on clinician adherence to interventions.

Evaluating Outcomes of Electronic Tools Supporting Physician Shift-to-Shift Handoffs: A Systematic Review

BACKGROUND

Multiple organizations have recognized that handoffs are prone to errors, and there has been an increase in the use of electronic health records and computerized tools in health care.

OBJECTIVE

This systematic review evaluates the current evidence on the effectiveness of electronic solutions used to support shift-to-shift handoffs.

METHODS

We searched the English-language literature for research studies published between January 1, 2008, and September 19, 2014, using National Library of Medicine PubMed, EBSCO CINAHL, OvidSP All Journals, and ProQuest PsycINFO. Included studies focused on the evaluation of physician shift-to-shift handoffs and an electronic solution designed to support handoffs. We assessed articles using a quality scoring system, conducted a review of barriers and strategies, and categorized study outcomes into self-report, process, and outcome measures.

RESULTS

Thirty-seven articles met inclusion criteria, including 20 single group pre- and posttest studies; 8 posttest only or cross-sectional studies; 4 nonrandomized controlled trials; 1 cohort study; 1 randomized crossover study; and 3 qualitative studies. Quality scores ranged from 3.5 to 14 of a possible 16. Most articles documented some positive outcomes, with 2 of the 3 studies evaluating patient outcomes yielding statistically significant improvements. The only other study that analyzed patient outcomes showed that interventions other than the electronic tool were responsible for most of the significant improvements.

CONCLUSIONS

The majority of studies supported using an electronic tool, yet few measured patient outcomes, and numerous studies suffered from methodology issues. Future studies should evaluate patient outcomes, improve study design, assess the role of faculty oversight, and broaden the focus to recognize the role of human factors.

Association of face-to-face handoffs and outcomes of hospitalized internal medicine patients

BACKGROUND

Failures in communication at the time of patient handoff have been implicated as contributing factors to preventable adverse events.

OBJECTIVE

Examine the relationship between face-to-face handoffs and the rate of patient outcomes, including adverse events.

DESIGN

Retrospective cohort.

SETTING

A 1157-bed academic tertiary referral hospital.

PATIENTS

There were 805 adult patients admitted to general internal medicine services.

INTERVENTION

Retrospective comparison of clinical outcomes, including the rate of adverse events, of patients whose care was transitioned with and without face-to-face handoffs.

MEASUREMENTS

Rapid response team calls, code team calls, transfers to a higher level of care, death in hospital, 30-day readmission rate, length of stay, and adverse events (as identified using the Global Trigger Tool).

RESULTS

There was no significant difference with respect to the frequency of rapid response team calls, code team calls, transfers to a higher level of care, deaths in hospital, length of stay, 30-day readmission rate, or adverse events between patients whose care was transitioned with or without a face-to-face handoff.

CONCLUSIONS

Face-to-face handoff of patients admitted to general medical services at a large academic tertiary referral hospital was not associated with a significant difference in measured patient outcomes, including the rate of adverse events, compared to a non-face-to-face handoff. Additional study is needed to determine the qualities of patient handoff that optimize efficiency and safety.

The implementation of clinician designed, human-centered electronic medical record viewer in the intensive care unit: a pilot step-wedge cluster randomized trial

OBJECTIVES

AWARE (Ambient Warning and Response Evaluation) is a novel electronic medical record (EMR) dashboard designed by clinicians to support bedside clinical information management in the ICU. AWARE sits on top of pre-existing, comprehensive EMR systems. The purpose of the study was to test the acceptance and impact of AWARE on data management in live clinical ICU settings. The primary outcome measure was observed efficiency of data utilization as determined by time spent in data gathering before morning rounds.

DESIGN

Step wedge cluster randomization trial.

SETTING

Four ICUs (surgical, medical, and mixed) at an academic referral center.

SUBJECTS

All members of the critical care team participating in morning ICU rounds.

INTERVENTION

Pilot implementation of a novel EMR interface with direct observation and survey.

MEASUREMENTS AND MAIN RESULTS

The study took place between April and July 2012. A total of 80 and 63 direct observations were made in the pre- and post-implementation study periods respectively. The time spent on pre-round data gathering per patient decreased from 12 (10-15) to 9 (7.3-11) min for pre- and post-implementation phases respectively (p=0.03). Compared to the existing EMR, information management (data presentation format, efficiency of data access) was reported to be better after AWARE implementation. AWARE made the task of gathering data for rounds significantly less difficult and mentally demanding.

CONCLUSIONS

The introduction of a novel, patient-centered EMR viewer for the ICU was associated with improved efficiency and ease of clinical data management compared to the standard EMR.

Understanding the perceptions and experiences of Certified Registered Nurse Anaesthetists regarding handovers: a focus group study

Aim

The aim of this exploratory study was to gain further insight into the perceptions and experiences of Certified Registered Nurse Anaesthetists regarding intraoperative handovers of care.

Background

Handovers of care often result in adverse events in hospitalized patients and this risk is increased in the operating room setting where handovers occur frequently. Handovers between nurse anaesthetists, who provide the majority of anaesthesia in the United States today, is under‐researched.

Design

Focus groups with Certified Registered Nurse Anaesthetists.

Methods

Two groups of nurse anaesthetists were recruited to participate in focus groups exploring their perception and experiences with intraoperative handovers of care. Content analysis was used to construe meaning from the context of the interviews. The findings were interpreted and discussed in a framework of Relationship‐Based Care.

Findings

There were four main themes that emerged from the data: (1) characteristics of the setting are a threat to handover quality; (2) individual provider characteristics have an impact on handover quality; (3) The timing of the handover represents a threat to handover quality and (4) individual patient characteristics have an impact on handover quality.

Conclusion

The specific threats to safe handover of care between nurse anaesthetists were perceived to fall into four major themes; this provides information needed to strengthen the environment of care and to improve safety in handover of care in the operating suite.

Clinical data needs in the neonatal intensive care unit electronic medical record

Background

The amount of clinical information that providers encounter daily creates an environment for information overload and medical error. To create a more efficient EMR human-computer interface, we aimed to understand clinical information needs among NICU providers.

Methods

A web-based survey to evaluate 98 data items was created and distributed to NICU providers. Participants were asked to rate the importance of each data item in helping them make routine clinical decisions in the NICU.

Results

There were 23 responses (92% – response rate) with participants distributed among four clinical roles. The top 5 items with the highest mean score were daily weight, pH, pCO2, FiO2, and blood culture results. When compared by clinical role groupings, supervisory physicians gave individual data item ratings at the extremes of the scale when compared to providers more responsible for the daily clinical care of NICU patients.

Conclusion

NICU providers demonstrate a need for large amounts of EMR data to help guide clinical decision making with differences found when comparing by clinical role. When creating an EMR interface in the NICU there may be a need to offer options for varying degrees of viewable data densities depending on clinical role.

Intraoperative Transitions of Anesthesia Care and Postoperative Adverse Outcomes

Background:

Transfers of patient care and responsibility among caregivers, “handovers,” are common. Whether handovers worsen patient outcome remains unclear. The authors tested the hypothesis that intraoperative care transitions among anesthesia providers are associated with postoperative complications.

Methods:

From the records of 138,932 adult Cleveland Clinic (Cleveland, Ohio) surgical patients, the authors assessed the association between total number of anesthesia handovers during a case and an adjusted collapsed composite of in-hospital mortality and major morbidities using multivariable logistic regression.

Results:

Anesthesia care transitions were significantly associated with higher odds of experiencing any major in-hospital mortality/morbidity (incidence of 8.8, 11.6, 14.2, 17.0, and 21.2% for patients with 0, 1, 2, 3, and ≥4 transitions; odds ratio 1.08 [95% CI, 1.05 to 1.10] for an increase of 1 transition category, P &lt; 0.001). Care transitions among attending anesthesiologists and residents or nurse anesthetists were similarly associated with harm (odds ratio 1.07 [98.3% CI, 1.03 to 1.12] for attending [incidence of 9.4, 13.9, 17.4, and 21.5% for patients with 0, 1, 2, and ≥3 transitions] and 1.07 [1.04 to 1.11] for residents or nurses [incidence of 9.4, 13.0, 15.4, and 21.2% for patients with 0, 1, 2, and ≥3 transitions], both P &lt; 0.001). There was no difference between matched resident only (8.5%) and nurse anesthetist only (8.8%) cases on the collapsed composite outcome (odds ratio, 1.00 [98.3%, 0.93 to 1.07]; P = 0.92).

Conclusion:

Intraoperative anesthesia care transitions are strongly associated with worse outcomes, with a similar effect size for attendings, residents, and nurse anesthetists.

The quality of intensive care unit nurse handover related to end of life: a descriptive comparative international study

BACKGROUND

Quality ICU end-of-life-care has been found to be related to good communication. Handover is one form of communication that can be problematic due to lost or omitted information. A first step in improving care is to measure and describe it.

OBJECTIVE

The objective of this study was to describe the quality of ICU nurse handover related to end-of-life care and to compare the practices of different ICUs in three different countries.

DESIGN

This was a descriptive comparative study.

SETTINGS

The study was conducted in seven ICUs in three countries: Australia (1 unit), Israel (3 units) and the UK (3 units).

PARTICIPANTS

A convenience sample of 157 handovers was studied.

METHODS

Handover quality was rated based on the ICU End-of-Life Handover tool, developed by the authors.

RESULTS

The highest levels of handover quality were in the areas of goals of care and pain management while lowest levels were for legal issues (proxy and advanced directives) related to end of life. Significant differences were found between countries and units in the total handover score (country: F(2,154)=25.97, p=<.001; unit: F(6,150)=58.24, p=<.001), for the end of life subscale (country: F(2, 154)=28.23, p<.001; unit: F(6,150)=25.25, p=<.001), the family communication subscale (country: F(2,154)=15.04, p=<.001; unit: F(6,150)=27.38, p=<.001), the family needs subscale (F(2,154)=22.33, p=<.001; unit: F(6,150)=42.45, p=<.001) but only for units on the process subscale (F(6,150)=8.98, p=<.001. The total handover score was higher if the oncoming RN did not know the patient (F(1,155)=6.51, p=<.05), if the patient was expected to die during the shift (F(1,155)=89.67, p=<.01) and if the family were present (F(1,155)=25.81, p=<.01).

CONCLUSIONS

Practices of end-of-life-handover communication vary greatly between units. However, room for improvement exists in all areas in all of the units studied. The total score was higher when quality of care might be deemed at greater risk (if the nurses did not know the patient or the patient was expected to die), indicating that nurses were exercising some form of discretionary decision making around handover communication; thus validating the measurement tool.

Information needs for the OR and PACU electronic medical record

OBJECTIVE

The amount of clinical information that anesthesia providers encounter creates an environment for information overload and medical error. In an effort to create more efficient OR and PACU EMR viewer platforms, we aimed to better understand the intraoperative and post-anesthesia clinical information needs among anesthesia providers.

MATERIALS AND METHODS

A web-based survey to evaluate 75 clinical data items was created and distributed to all anesthesia providers at our institution. Participants were asked to rate the importance of each data item in helping them make routine clinical decisions in the OR and PACU settings.

RESULTS

There were 107 survey responses with distribution throughout all clinical roles. 84% of the data items fell within the top 2 proportional quarters in the OR setting compared to only 65% in the PACU. Thirty of the 75 items (40%) received an absolutely necessary rating by more than half of the respondents for the OR setting as opposed to only 19 of the 75 items (25%) in the PACU. Only 1 item was rated by more than 20% of respondents as not needed in the OR compared to 20 data items (27%) in the PACU.

CONCLUSION

Anesthesia providers demonstrate a larger need for EMR data to help guide clinical decision making in the OR as compared to the PACU. When creating EMR platforms for these settings it is important to understand and include data items providers deem the most clinically useful. Minimizing the less relevant data items helps prevent information overload and reduces the risk for medical error.

An analysis of patient safety incidents associated with medications reported from critical care units in the North West of England between 2009 and 2012

Incident reporting is promoted as a key tool for improving patient safety in healthcare. We analysed 2238 patient safety incidents involving medications submitted from up to 29 critical care units each year in the North West of England between 2009 and 2012; 452 (20%) of these incidents led to harm to patients. Although 1461 (65%) incidents were judged to have been preventable, there was no reduction in the rate of incidents per 1000 days between 2009 and 2012 (5.9 in 2009, 6.6 in 2012). Furthermore, in the 2012 data, there were wide variations in the incident rates between units, the median (IQR [range]) rate per 1000 patient days for individual units being 6.8 (3.8-11.0 [1.3-37.1]). The variation in the percentage that could have been avoided was narrower, with a median (IQR [range]) of 70% (61-80% [38-100%]). The most commonly reported drugs were noradrenaline (161 incidents, 92 with harm), heparins (153 incidents, 29 with harm), morphine (131 incidents, 14 with harm) and insulin (111 incidents, 54 with harm). The administration of drugs was the stage in the process where incidents were most commonly reported; it was also the stage most likely to harm patients. We conclude that the wide range in reported rates between units, and the scope for preventing many incidents, suggest that quality improvement initiatives could improve medication safety in the units studied.

Fragmentation of patient safety research: a critical reflection of current human factors approaches to patient handover

The integration of human factors science in research and interventions aimed at increased patient safety has led to considerable improvements. However, some challenges to patient safety persist and may require human factors experts to critically reflect upon their predominant approaches to research and improvement. This paper is a call to start a discussion of these issues in the area of patient handover. Briefly reviewing recent handover research shows that while these studies have provided valuable insights into the communication practices for a range of handover situations, the predominant research strategy of studying isolated handover episodes replicates the very problem of fragmentation of care that the studies aim to overcome. Thus, there seems to be a need for a patient-centred approach to handover research that aims to investigate the interdependencies of handover episodes during a series of transitions occurring along the care path. Such an approach may contribute to novel insights and help to increase the effectiveness and sustainability of interventions to improve handover. Significance for public healthWhile much of public health research has a preventive focus, health services research is generally concerned with the ways in which care is provided to those requiring treatment. This paper calls for a patient-centred approach to research on patient handover; a significant contributor to adverse events in healthcare. It is argued that this approach has the potential to improve our understanding of handover processes along the continuum of care. Thus, it can provide a scientific foundation for effective improvements in handover that are likely to reduce patient harm and help to maintain patient safety.

A preliminary study of the impact of a handover cognitive aid on clinical reasoning and information transfer

OBJECTIVES

To assess the impact of a written cognitive aid on expressed clinical reasoning and quantity and the accuracy of information transfer during resident doctor handover.

METHODS

This study was a randomised controlled trial in an academic paediatric intensive care unit (PICU) of 20 handover events (10 events per group) from residents in their first PICU rotation using a written handover cognitive aid (intervention) or standard practice (control). Before rounds, an investigator generated a reference standard of the handover event by completing a handover aid. Resident handovers were then audio-recorded and transcribed by a blinded research assistant. The content of this transcript was inserted into a blank handover aid. A blinded content expert scored the quantity and accuracy of the information in this aid according to predetermined criteria and these information scores (ISs) were compared with the reference standard. The same expert also blindly scored the transcripts in five domains of clinical reasoning and effectiveness: (i) effective summary of events; (ii) expressed understanding of the care plan; (iii) presentation clarity; (iv) organisation; (v) overall handover effectiveness. Differences between intervention and control groups were assessed using the Mann-Whitney test and multivariate linear regression.

RESULTS

The intervention group had total ISs that more closely approximated the reference standard (81% versus 61%; p < 0.01). The intervention group had significantly higher clinical reasoning scores when compared by total score (21.1 versus 15.9 points; p = 0.01) and in each of the five domains. No difference was observed in the duration of handover between groups (7.4 versus 7.7 minutes; p = 0.97).

CONCLUSIONS

Using a novel scoring system, our simple handover cognitive aid was shown to improve information transfer and resident expression of clinical reasoning without prolonging the handover duration.

Data utilization for medical decision making at the time of patient admission to ICU

OBJECTIVES

Information overload in electronic medical records can impede providers' ability to identify important clinical data and may contribute to medical error. An understanding of the information requirements of ICU providers will facilitate the development of information systems that prioritize the presentation of high-value data and reduce information overload. Our objective was to determine the clinical information needs of ICU physicians, compared to the data available within an electronic medical record.

DESIGN

Prospective observational study and retrospective chart review.

SETTING

Three ICUs (surgical, medical, and mixed) at an academic referral center.

SUBJECTS

Newly admitted ICU patients and physicians (residents, fellows, and attending staff).

MEASUREMENTS AND MAIN RESULTS

The clinical information used by physicians during the initial diagnosis and treatment of admitted patients was captured using a questionnaire. Clinical information concepts were ranked according to the frequency of reported use (primary outcome) and were compared to information availability in the electronic medical record (secondary outcome). Nine hundred twenty-five of 1,277 study questionnaires (408 patients) were completed. Fifty-one clinical information concepts were identified as being useful during ICU admission. A median (interquartile range) of 11 concepts (6-16) was used by physicians per patient admission encounter with four used greater than 50% of the time. Over 25% of the clinical data available in the electronic medical record was never used, and only 33% was used greater than 50% of the time by admitting physicians.

CONCLUSIONS

Physicians use a limited number of clinical information concepts at the time of patient admission to the ICU. The electronic medical record contains an abundance of unused data. Better electronic data management strategies are needed, including the priority display of frequently used clinical concepts within the electronic medical record, to improve the efficiency of ICU care.

Chart biopsy: an emerging medical practice enabled by electronic health records and its impacts on emergency department-inpatient admission handoffs

OBJECTIVE

To examine how clinicians on the receiving end of admission handoffs use electronic health records (EHRs) in preparation for those handoffs and to identify the kinds of impacts such usage may have.

MATERIALS AND METHODS

This analysis is part of a two-year ethnographic study of emergency department (ED) to internal medicine admission handoffs at a tertiary teaching and referral hospital. Qualitative data were gathered and analyzed iteratively, following a grounded theory methodology. Data collection methods included semi-structured interviews (N = 48), observations (349 hours), and recording of handoff conversations (N = 48). Data analyses involved coding, memo writing, and member checking.

RESULTS

The use of EHRs has enabled an emerging practice that we refer to as pre-handoff "chart biopsy": the activity of selectively examining portions of a patient's health record to gather specific data or information about that patient or to get a broader sense of the patient and the care that patient has received. Three functions of chart biopsy are identified: getting an overview of the patient; preparing for handoff and subsequent care; and defending against potential biases. Chart biopsies appear to impact important clinical and organizational processes. Among these are the nature and quality of handoff interactions, and the quality of care, including the appropriateness of dispositioning of patients.

CONCLUSIONS

Chart biopsy has the potential to enrich collaboration and to enable the hospital to act safely, efficiently, and effectively. Implications for handoff research and for the design and evaluation of EHRs are also discussed.

Clinical review: the hospital of the future - building intelligent environments to facilitate safe and effective acute care delivery

The translation of knowledge into rational care is as essential and pressing a task as the development of new diagnostic or therapeutic devices, and is arguably more important. The emerging science of health care delivery has identified the central role of human factor ergonomics in the prevention of medical error, omission, and waste. Novel informatics and systems engineering strategies provide an excellent opportunity to improve the design of acute care delivery. In this article, future hospitals are envisioned as organizations built around smart environments that facilitate consistent delivery of effective, equitable, and error-free care focused on patient-centered rather than provider-centered outcomes.

The effects of patient handoff characteristics on subsequent care: a systematic review and areas for future research

PURPOSE

To summarize the available evidence about patient handoff characteristics and their impact on subsequent patient care in hospitals.

METHOD

In January and February 2011, the authors searched the Cochrane Central Register of Controlled Trials, PubMed, Embase, CINAHL, PsycINFO, ERIC, ISI Web of Science, and the reference lists of relevant articles to carry out their systematic review. They selected articles that (1) had patient handoffs in hospitals as their explicit research focus and (2) reported at least one statistical test of an association between a handoff characteristic and outcome. They assessed study quality using 11 quality indicators.

RESULTS

The authors identified 18 articles reporting 37 statistical associations between a handoff characteristic and outcome. The only handoff characteristic investigated in more than one study was the use of a standardized handoff sheet. Seven of those 12 studies reported significant improvements after introduction of the sheet. Four of the 18 studies used a randomized controlled trial design.

CONCLUSIONS

Published research is highly diverse and idiosyncratic regarding the handoff characteristics and outcomes assessed and the methodologies used, so comparing studies and drawing general conclusions about the field are difficult endeavors. The quality of research on the topic is rather preliminary, and there is not yet enough research to inform evidence-based handoff strategies. Future research, then, should focus on research methods, which outcomes should be assessed, handoff characteristics beyond information transfer, mechanisms that link handoff characteristics and outcomes, and the conditions that moderate the characteristics' effects.

Faculty member review and feedback using a sign-out checklist: improving intern written sign-out

PURPOSE

Although residents commonly perform patient care sign-out during training, faculty do not frequently supervise or evaluate sign-out. The authors designed a sign-out checklist, and they investigated whether use of the checklist, paired with faculty member review and feedback, would improve interns' written sign-out.

METHOD

In a randomized, controlled design in 2011, the authors compared the sign-out content and the overall sign-out summary scores of interns who received twice-monthly faculty member sign-out evaluation with those of interns who received the standard sign-out instruction. A sign-out checklist, which the authors developed on the basis of internal needs assessment and published sign-out recommendations, guided the evaluation of written sign-out content and sign-out organization as well as the twice-monthly, face-to-face evaluation that the interns in the intervention group received.

RESULTS

Using the sign-out checklist and receiving feedback from a faculty member led to statistically significant improvements in interns' sign-out. Through regression analysis, the authors calculated a 23% difference in the sign-out content (P = .005) and a 2.2-point difference in the overall summary score (on a 9-point scale, P = .009) between the interns who received sign-out feedback and those who did not. The content and quality of the intervention group's sign-outs improved, whereas the content and quality of the control group's worsened.

CONCLUSIONS

A sign-out checklist paired with twice-monthly, face-to-face feedback from a faculty member led to improvements in the content and quality of interns' written sign-out.

Clinical handover in acute psychiatric and community mental health settings

This study collected an area-wide snapshot of current handover practice in psychiatric settings which included acute care units and community mental health centres. The study was conducted in two stages. Firstly, a questionnaire was sent to all clinical mental health staff within an area-wide health service regarding normal handover procedures and processes. The second part of the study used non-participant observers to evaluate actual handovers in inpatient and community settings. Of the 1125 surveys distributed in stage one, 380 (34%) were returned completed. Of the 40 handovers observed in stage two in which 637 patients were discussed, 40% included at least one consultant psychiatrist or registrar as a participant. Almost all the handovers were completed face-to-face in a specific location with a set time and duration. Eighty-six per cent of respondents reported that deteriorating patients were escalated for rapid response. The results of the survey and structured observations support the issues emerging from the literature from medical, surgical and clinical team handovers. Additionally, the issue of identifiers for deterioration of a psychiatric patient emerged as an area worthy of further investigation and incorporation into clinical handover education and training for psychiatric services.

The patient handoff: a comprehensive curricular blueprint for resident education to improve continuity of care

In 2010, the Accreditation Council for Graduate Medical Education released its resident duty hours restrictions, requiring that faculty monitor their residents' patient handoffs to ensure that residents are competent in handoff communications. Although studies have reported the need to improve the effectiveness of the handoff and a variety of curricula have been suggested and implemented, a common method for teaching and evaluating handoff skills has not been developed. Also in 2010, engineers, informaticians, and physicians interested in patient handoffs attended a symposium in Savannah, Georgia, hosted by the Association for Computing Machinery, entitled Handovers and Handoffs: Collaborating in Turns. As a result of this symposium, a workgroup formed to develop practical and readily implementable educational materials for medical educators involved in teaching patient handoffs to residents. In this article, the result of that yearlong collaboration, the authors aim to provide clarity on the definition of the patient handoff, to review the barriers to performing effective handoffs in academic health centers, to identify available solutions to improve handoffs, and to provide a structured approach to educating residents on handoffs via a curricular blueprint. The authors' blueprint was developed to guide educators in customizing handoff education programs to fit their specific, local needs. Hopefully, it also will provide a starting point for future research into improving the patient handoff. Increasingly complex patient care environments require both innovations in handoff education and improvements in patient care systems to improve continuity of care.

Stereotyping stigma: undergraduate health students' perceptions at handover

The World Health Organization (WHO) has recognized that errors in communication are one of the leading causes of adverse patient outcomes. Consequently, the WHO developed the High 5s Project to review, among other variables, handover of patients between shifts, professionals, and organizations. Seven countries were involved in the initial project. Australia responded by using the ISOBAR (Identify, Situation, Observations, Background, Agreed plan, and Read-back) tool as a template. However, none of the countries involved considered the social and emotional effects of handover on the staff or patients, although research has demonstrated that attitudes and values can be handed over from one nurse to another during this process. This article shows how the nurse who hands over care from one shift to the next can transfer stigma and labeling and offers suggestions for nurse educators and clinicians to apply national standards and core values to clinical practice and education.

Implementing faculty evaluation of written sign-out

PURPOSE

Recently the Accreditation Council for Graduate Medical Education mandated decreased shift duration for intern physicians to no more than 16 hours. Such work-hour restrictions are likely to increase patient care hand-offs. It is well accepted that sign-out (i.e., hand-off) processes are error prone and lack standardization. Moreover, many residency programs do not evaluate sign-out. We designed and tested whether a sign-out evaluation process could be implemented to improve written sign-out.

METHOD

Based on observed sign-out deficiencies at our institution we adapted a simple curriculum incorporating the SIGNOUT mnemonic, which we paired with weekly faculty member evaluation and feedback on sign-out using a structured sign-out evaluation tool. Later in the week, written sign-out was independently scored by 2-blinded senior resident reviewers who compared the inclusion of sign-out content, organization, and readability.

RESULTS

Compared to baseline data in 128 written sign-outs, the pairing of a 1-page curriculum with weekly faculty member evaluation of written sign-out improved the inclusion of advanced directives from 38% to 69% (p < .001) and anticipatory guidance from a mean score of 1.8 (SD = 1.2) to 2.3 (SD = 1.5) on a 5-point scale (p = .01) in 177 written sign-outs. Readability and organization were unchanged.

CONCLUSIONS

A simple curriculum paired with structured faculty evaluation and feedback can improve some parameters of sign-out. Structured evaluative sign-out tools may be useful to improve and teach sign-out skills.

The effect of two different electronic health record user interfaces on intensive care provider task load, errors of cognition, and performance

OBJECTIVES

The care of critically ill patients generates large quantities of data. Increasingly, these data are presented to the provider within an electronic medical record. The manner in which data are organized and presented can impact on the ability of users to synthesis that data into meaningful information. The objective of this study was to test the hypothesis that novel user interfaces, which prioritize the display of high-value data to providers within system-based packages, reduce task load, and result in fewer errors of cognition compared with established user interfaces that do not.

DESIGN

Randomized crossover study.

SETTING

Academic tertiary referral center.

SUBJECTS

Attending, resident and fellow critical care physicians.

INTERVENTIONS

Novel health care record user interface.

MEASUREMENT

Subjects randomly assigned to either a standard electronic medical record or a novel user interface, were asked to perform a structured task. The task required the subjects to use the assigned electronic environment to review the medical record of an intensive care unit patient said to be actively bleeding for data that formed the basis of answers to clinical questions posed in the form of a structured questionnaire. The primary outcome was task load, measured using the paper version of the NASA-task load index. Secondary outcome measures included time to task completion, number of errors of cognition measured by comparison of subject to post hoc gold standard questionnaire responses, and the quantity of information presented to subjects by each environment.

MAIN RESULTS

Twenty subjects completed the task on eight patients, resulting in 160 patient-provider encounters (80 in each group). The standard electronic medical record contained a much larger data volume with a median (interquartile range) number of data points per patient of 1008 (895-1183) compared with 102 (77-112) contained within the novel user interface. The median (interquartile range) NASA-task load index values were 38.8 (32-45) and 58 (45-65) for the novel user interface compared with the standard electronic medical record (p < .001). The median (interquartile range) times in seconds taken to complete the task for four consecutive patients were 93 (57-132), 60 (48-71), 68 (48-80), and 54 (42-64) for the novel user interface compared with 145 (109-201), 125 (113-162), 129 (100-145), and 112 (92-123) for the standard interface (p < .0001), respectively. The median (interquartile range) number of errors per provider was 0.5 (0-1) and two (0.25-3) for the novel user interface and standard electronic medical record interface, respectively (p = .007).

CONCLUSIONS

A novel user interface was designed based on the information needs of intensive care unit providers with a specific goal of development being the reduction of task load and errors of cognition associated with filtering, extracting, and using medical data contained within a comprehensive electronic medical record. The results of this simulated clinical experiment suggest that the configuration of the intensive care unit user interface contributes significantly to the task load, time to task completion, and number of errors of cognition associated with the identification, and subsequent use, of relevant patient data. Task-specific user interfaces, developed from an understanding of provider information requirements, offer advantages over interfaces currently available within a standard electronic medical record.

Content overlap in nurse and physician handoff artifacts and the potential role of electronic health records: a systematic review

PURPOSE

The aims of this systematic review were: (1) to analyze the content overlap between nurse and physician hospital-based handoff documentation for the purpose of developing a list of interdisciplinary handoff information for use in the future development of shared and tailored computer-based handoff tools, and (2) to evaluate the utility of the Continuity of Care Document (CCD) standard as a framework for organizing hospital-based handoff information for use in electronic health records (EHRs).

METHODS

We searched PubMed for studies published through July 2010 containing the indexed terms: handoff(s), hand-off, handover(s), shift-report, shift report, signout, and sign-out. Original, hospital-based studies of acute care nursing or physician handoff were included. Handoff information content was organized into lists of nursing, physician, and interdisciplinary handoff information elements. These information element lists were organized using CCD sections, with additional sections being added as needed.

RESULTS

Analysis of 36 studies resulted in a total of 95 handoff information elements. Forty-six percent (44/95) of the information overlapped between the nurse and physician handoff lists. Thirty-six percent (34/95) were specific to the nursing list and 18% (17/95) were specific to the physician list. The CCD standard was useful for categorizing 80% of the terms in the lists and 12 category names were developed for the remaining 20%.

CONCLUSION

Standardized interdisciplinary, nursing-specific, and physician-specific handoff information elements that are organized around the CCD standard and incorporated into EHRs in a structured narrative format may increase the consistency of data shared across all handoffs, facilitate the establishment of common ground, and increase interdisciplinary communication.

Resident sign-out and patient hand-offs: opportunities for improvement

BACKGROUND

Inpatient care is characterized by multiple transitions of patient care responsibilities. In most residency programs trainees manage transitions via verbal, written, or combined methods of communication termed "sign-out." Often sign-out occurs without standardization or supervision.

PURPOSE

The purpose was to assess daily sign-out with a goal of identifying aspects of this process most in need of improvement.

METHODS

This was a prospective, observational cohort study of interns' sign-out conducted by industrial engineering students. Daily sign-out was analyzed for inclusion of multiple criteria and scored on organization (on a scale of 0-4) based on how effectively written information was conveyed.

RESULTS

We observed 124 unique verbal and written sign-outs. We found that 99% of sign-outs included a general hospital course. Sign-outs were well organized with a mean of 3.1, though substantial variation was noted (SD = 0.8). Directions for anticipated patient events were included in only 42% of sign-outs. Do Not Resuscitate (DNR) or advanced directive discussions were reported in only 11% of sign-outs. Only 50% of successive daily sign-outs were updated.

CONCLUSIONS

We found variability in the content and organization of interns' sign-out, possibly reflecting a lack of instruction and supervision. Standardization of sign-out content, and education on good sign-out skills are increasingly important as patient hand-offs become more frequent.