Design and implementation of an automated email notification system for results of tests pending at discharge

Human Factors Considerations in Transitions in Care Clinical Decision Support System Implementation Studies

Objective: Review transitions in care clinical decision support system (CDSS) implementation studies and describe human factors considerations in users, design, alert types, intervention timing, and implementation outcomes. Methods: Literature review in PubMed guided by subject matter experts. Results: Twelve articles were included. Targeted users included physicians, nurses, pharmacists, or interdisciplinary teams. Alerts were deployed via email, cloud-based software, or the EHR in inpatient and/or outpatient settings. Outcome measures varied across articles, with mixed performance. There were six readmissions-focused, two prescribing, one laboratory, two prescribing and laboratory, and one discharge disposition CDSS. Few articles reported statistically significant differences in outcomes, and many reported alert fatigue. Discussion and Conclusion: Despite the increasing prevalence of CDSS for transitions in care, few articles describe implementation processes and outcomes, and evidence of clinical practice improvement is mixed. Future studies should utilize implementation science frameworks and incorporate appropriate implementation outcomes in addition to traditional clinical outcomes like readmission rates.

Improving Follow-Up of Tests Pending at Discharge

BACKGROUND AND OBJECTIVES

Follow-up on results of inpatient tests pending at discharge (TPAD) must occur to ensure patient safety and high-quality care continue after discharge. We identified a need to improve follow-up of TPAD and began a quality improvement initiative with an aim of reducing the rate of missed follow-up of TPAD to ≤20% within 12 months.

METHODS

The team used the Plan-Do-Study-Act method of quality improvement and implemented a process using reminder messages in the electronic health record. We collected data via retrospective chart review for the 6 months before the intervention and monthly thereafter. The primary outcome measure was the percentage of patients with missed follow-up of TPAD, defined as no documented follow-up within 72 hours of a result being available. The use of a reminder message was monitored as a process measure.

RESULTS

We reviewed charts of 764 discharged patients, and 216 (28%) were noted to have TPAD. At baseline, the average percentage of patients with missed follow-up was 80%. The use of reminder messages was quickly adopted. The average percentage of patients with missed follow-up of TPAD after beginning the quality improvement interventions was 35%.

CONCLUSIONS

We had significant improvement in follow-up after our interventions. Additional work is needed to ensure continued and sustained improvement, focused on reducing variability in performance between providers and investing in technology to allow for automation of the follow-up process.

Variation in electronic test results management and its implications for patient safety: A multisite investigation

Objective

The management and follow-up of diagnostic test results is a major patient safety concern. The aim of this qualitative study was to explore how clinicians manage test results on an everyday basis (work-as-done) in a health information technology–enabled emergency department setting. The objectives were to identify (1) variations in work-as-done in test results management and (2) the strategies clinicians use to ensure optimal management of diagnostic test results.

Materials and Methods

Qualitative interviews (n = 26) and field observations were conducted across 3 Australian emergency departments. Interview data coded for results management (ie, tracking, acknowledgment, and follow-up), and artifacts, were reviewed to identify variations in descriptions of work-as-done. Thematic analysis was performed to identify common themes.

Results

Despite using the same test result management application, there were variations in how the system was used. We identified 5 themes relating to electronic test results management: (1) tracking test results, (2) use and understanding of system functionality, (3) visibility of result actions and acknowledgment, (4) results inbox use, and (5) challenges associated with the absence of an inbox for results notifications for advanced practice nurses.

Discussion

Our findings highlight that variations in work-as-done can function to overcome perceived impediments to managing test results in a HIT-enabled environment and thus identify potential risks in the process. By illuminating work-as-done, we identified strategies clinicians use to enhance test result management including paper-based manual processes, cognitive reminders, and adaptive use of electronic medical record functionality.

Conclusions

Test results tracking and follow-up is a priority area in need of health information technology development and training to improve team-based collaboration/communication of results follow-up and diagnostic safety.

Email Use Reconsidered in Health Professions Education: Viewpoint

Email has become a popular means of communication in the past 40 years, with more than 200 billion emails sent each day worldwide. When used appropriately, email can be an effective and useful form of correspondence, although improper practices, such as email incivility, can present challenges. Email is ubiquitous in education and health care, where it is used for student-to-teacher, provider-to-provider, and patient-to-provider communications, but not all students, faculty members, and health professionals are skilled in its use. This paper examines the challenges and opportunities posed by email communication in health professions education and reveals important deficiencies in training, as well as steps that can be taken by health professions educators to address them. Recommendations are offered to help health professions educators develop approaches for teaching email professionalism.

Interventions to Improve Follow-Up of Laboratory Test Results Pending at Discharge: A Systematic Review

Failure to follow up test results pending at discharge (TPAD) from hospitals or emergency departments is a major patient safety concern. The purpose of this review is to systematically evaluate the effectiveness of interventions to improve follow-up of laboratory TPAD. We conducted literature searches in PubMed, CINAHL, Cochrane, and EMBASE using search terms for relevant health care settings, transition of patient care, laboratory tests, communication, and pending or missed tests. We solicited unpublished studies from the clinical laboratory community and excluded articles that did not address transitions between settings, did not include an intervention, or were not related to laboratory TPAD. We also excluded letters, editorials, commentaries, abstracts, case reports, and case series. Of the 9,592 abstracts retrieved, eight met the inclusion criteria and reported the successful communication of TPAD. A team member abstracted predetermined data elements from each study, and a senior scientist reviewed the abstraction. Two experienced reviewers independently appraised the quality of each study using published Laboratory Medicine Best Practices (LMBP™) A-6 scoring criteria. We assessed the body of evidence using the A-6 methodology, and the evidence suggested that electronic tools or one-on-one education increased documentation of pending tests in discharge summaries. We also found that automated notifications improved awareness of TPAD. The interventions were supported by suggestive evidence; this type of evidence is below the level of evidence required for LMBP™ recommendations. We encourage additional research into the impact of these interventions on key processes and health outcomes.

The Impact of Automated Notification on Follow-up of Actionable Tests Pending at Discharge: a Cluster-Randomized Controlled Trial

BACKGROUND

Follow-up of tests pending at discharge (TPADs) is poor. We previously demonstrated a twofold increase in awareness of any TPAD by attendings and primary care physicians (PCPs) using an automated email intervention OBJECTIVE: To determine whether automated notification improves documented follow-up for actionable TPADs DESIGN: Cluster-randomized controlled trial SUBJECTS: Attendings and PCPs caring for adult patients discharged from general medicine and cardiology services with at least one actionable TPAD between June 2011 and May 2012 INTERVENTION: An automated system that notifies discharging attendings and network PCPs of finalized TPADs by email MAIN MEASURES: The primary outcome was the proportion of actionable TPADs with documented action determined by independent physician review of the electronic health record (EHR). Secondary outcomes included documented acknowledgment, 30-day readmissions, and adjusted median days to documented follow-up.

KEY RESULTS

Of the 3378 TPADs sampled, 253 (7.5%) were determined to be actionable by physician review. Of these, 150 (123 patients discharged by 53 attendings) and 103 (90 patients discharged by 44 attendings) were assigned to intervention and usual care groups, respectively, and underwent chart review. The proportion of actionable TPADs with documented action was 60.7 vs. 56.3% (p = 0.82) in the intervention vs. usual care groups, similar for documented acknowledgment. The proportion of patients with actionable TPADs readmitted within 30 days was 22.8 vs. 31.1% in the intervention vs. usual care groups (p = 0.24). The adjusted median days [95% CI] to documented action was 9 [6.2, 11.8] vs. 14 [10.2, 17.8] (p = 0.04) in the intervention vs. usual care groups, similar for documented acknowledgment. In sub-group analysis, the intervention had greater impact on documented action for patients with network PCPs compared with usual care (70 vs. 50%, p = 0.03).

CONCLUSIONS

Automated notification of actionable TPADs shortened time to action but did not significantly improve documented follow-up, except for network-affiliated patients. The high proportion of actionable TPADs without any documented follow-up (~ 40%) represents an ongoing safety concern.

CLINICAL TRIALS IDENTIFIER

NCT01153451.

Physician communication via Internet-enabled technology: A systematic review

The use of Internet-enabled technology (information and communication technology such as smartphone applications) may enrich information exchange among providers and, consequently, improve health care delivery. The purpose of this systematic review was to gain a greater understanding of the role that Internet-enabled technology plays in enhancing communication among physicians. Studies were identified through a search in three electronic platforms: the Association for Computing Machinery Digital Library, ProQuest, and Web of Science. The search identified 5140 articles; of these, 21 met all inclusion criteria. In general, physicians were satisfied with Internet-enabled technology, but consensus was lacking regarding whether Internet-enabled technology improved efficiency or made a difference to clinical decision-making. Internet-enabled technology can play an important role in enhancing communication among physicians, but the extent of that benefit is influenced by (1) the impact of Internet-enabled technology on existing work practices, (2) the availability of adequate resources, and (3) the nature of institutional elements, such as privacy legislation.

Clinician Perspectives on the Management of Abnormal Subcritical Tests in an Urban Academic Safety-Net Health Care System

BACKGROUND

Missed or delayed follow-up of abnormal subcritical tests (tests that do not require immediate medical attention) can lead to poor patient outcomes. Safety-net health systems with limited resources and socially complex patients are vulnerable to safety gaps resulting from delayed management. Clinician perspectives to identify system challenges, vulnerable situations, and potential solutions were sought in focus groups.

METHODS

Five semistructured focus groups were conducted in 2015 with purposefully sampled clinicians from radiology, hospital medicine, emergency medicine, risk management, and ambulatory care from an urban, academic, integrated, safety-net health system. Thematic analysis identified challenges of current management of abnormal subcritical tests, vulnerable situations, and solution characteristics. A total of 43 clinicians participated.

RESULTS

Clinicians cited challenges in assigning responsibility for follow-up and identified tests pending at discharge and tests requiring delayed follow-up as vulnerable situations. The lack of tracking systems and missing contact information for patients and providers exacerbated these challenges. Proposed solution characteristics involved protocols to aid in assigning responsibility, reliable paths of communication, and systems to track the status of tests. Clinicians noted a strong desire for integration of the work flow and technology solutions into existing structures.

CONCLUSION

In an urban safety-net setting, clinicians recommended outlining clear chains of responsibility and communication in the management of subcritical test results, and employing simple, integrated technological solutions that allow for tracking and management of tests. Existing test management solutions should be adapted to work within safety-net systems, which often have fewer resources and more complex patients and may function in the absence of integrated technology systems.

Linking acknowledgement to action: closing the loop on non-urgent, clinically significant test results in the electronic health record

Failure to follow-up nonurgent, clinically significant test results (CSTRs) is an ambulatory patient safety concern. Tools within electronic health records (EHRs) may facilitate test result acknowledgment, but their utility with regard to nonurgent CSTRs is unclear. We measured use of an acknowledgment tool by 146 primary care physicians (PCPs) at 13 network-affiliated practices that use the same EHR. We then surveyed PCPs to assess use of, satisfaction with, and desired enhancements to the acknowledgment tool. The rate of acknowledgment of non-urgent CSTRs by PCPs was 78%. Of 73 survey respondents, 72 reported taking one or more actions after reviewing a CSTR; fewer (40-75%) reported that using the acknowledgment tool was helpful for a specific purpose. Forty-six (64%) were satisfied with the tool. Both satisfied and nonsatisfied PCPs reported that enhancements linking acknowledgment to routine actions would be useful. EHR vendors should consider enhancements to acknowledgment functionality to ensure follow-up of nonurgent CSTRs.

Pending studies at hospital discharge: a pre-post analysis of an electronic medical record tool to improve communication at hospital discharge

BACKGROUND

Achieving safe transitions of care at hospital discharge requires accurate and timely communication. Both the presence of and follow-up plan for diagnostic studies that are pending at hospital discharge are expected to be accurately conveyed during these transitions, but this remains a challenge.

OBJECTIVE

To determine the prevalence, characteristics, and communication of studies pending at hospital discharge before and after the implementation of an electronic medical record (EMR) tool that automatically generates a list of pending studies.

DESIGN

Pre-post analysis.

PATIENTS

260 consecutive patients discharged from inpatient general medicine services from July to August 2013.

INTERVENTION

Development of an EMR-based tool that automatically generates a list of studies pending at discharge.

MAIN MEASURES

The main outcomes were prevalence and characteristics of pending studies and communication of studies pending at hospital discharge. We also surveyed internal medicine house staff on their attitudes about communication of pending studies.

KEY RESULTS

Pre-intervention, 70% of patients had at least one pending study at discharge, but only 18% of these were communicated in the discharge summary. Most studies were microbiology cultures (68%), laboratory studies (16%), or microbiology serologies (10%). The majority of study results were ultimately normal (83%), but 9% were newly abnormal. Post-intervention, communication of studies pending increased to 43% (p < 0.001).

CONCLUSIONS

Most patients are discharged from the hospital with pending studies, but in usual practice, the presence of these studies has rarely been communicated to outpatient providers in the discharge summary. Communication significantly increased with the implementation of an EMR-based tool that automatically generated a list of pending studies from the EMR and allowed users to import this list into the discharge summary. This is the first study to our knowledge to introduce an automated EMR-based tool to communicate pending studies.

Email for clinical communication between healthcare professionals

BACKGROUND

Email is one of the most widely used methods of communication, but its use in healthcare is still uncommon. Where email communication has been utilised in health care, its purposes have included clinical communication between healthcare professionals, but the effects of using email in this way are not well known. We updated a 2012 review of the use of email for two-way clinical communication between healthcare professionals.

OBJECTIVES

To assess the effects of email for clinical communication between healthcare professionals on healthcare professional outcomes, patient outcomes, health service performance, and service efficiency and acceptability, when compared to other forms of communicating clinical information.

SEARCH METHODS

We searched: the Cochrane Consumers and Communication Review Group Specialised Register, Cochrane Central Register of Controlled Trials (CENTRAL, The Cochrane Library, Issue 9 2013), MEDLINE (OvidSP) (1946 to August 2013), EMBASE (OvidSP) (1974 to August 2013), PsycINFO (1967 to August 2013), CINAHL (EbscoHOST) (1982 to August 2013), and ERIC (CSA) (1965 to January 2010). We searched grey literature: theses/dissertation repositories, trials registers and Google Scholar (searched November 2013). We used additional search methods: examining reference lists and contacting authors.

SELECTION CRITERIA

Randomised controlled trials, quasi-randomised trials, controlled before and after studies, and interrupted time series studies examining interventions in which healthcare professionals used email for communicating clinical information in the form of: 1) unsecured email, 2) secure email, or 3) web messaging. All healthcare professionals, patients and caregivers in all settings were considered.

DATA COLLECTION AND ANALYSIS

Two authors independently assessed studies for inclusion, assessed the included studies' risk of bias, and extracted data. We contacted study authors for additional information and have reported all measures as per the study report.

MAIN RESULTS

The previous version of this review included one randomised controlled trial involving 327 patients and 159 healthcare providers at baseline. It compared an email to physicians containing patient-specific osteoporosis risk information and guidelines for evaluation and treatment versus usual care (no email). This study was at high risk of bias for the allocation concealment and blinding domains. The email reminder changed health professional actions significantly, with professionals more likely to provide guideline-recommended osteoporosis treatment (bone density measurement or osteoporosis medication, or both) when compared with usual care. The evidence for its impact on patient behaviours or actions was inconclusive. One measure found that the electronic medical reminder message impacted patient behaviour positively (patients had a higher calcium intake), and two found no difference between the two groups. The study did not assess health service outcomes or harms.No new studies were identified for this update.

AUTHORS' CONCLUSIONS

Only one study was identified for inclusion, providing insufficient evidence for guiding clinical practice in regard to the use of email for clinical communication between healthcare professionals. Future research should aim to utilise high-quality study designs that use the most recent developments in information technology, with consideration of the complexity of email as an intervention.

Assessment of follow-up completeness and notification preferences for imaging findings of possible cancer: what happens after radiologists submit their reports?

RATIONALE AND OBJECTIVES

To understand the reasons leading to potentially inappropriate management of imaging findings concerning for malignancy and identify optimal methods for communicating these findings to providers.

MATERIALS AND METHODS

We identified all abdominal imaging examinations with findings of possible cancer performed on six randomly selected days in August to December 2013. Electronic medical records (EMR) of one patient group were reviewed 3 months after the index examination to determine whether management was appropriate (completed follow-up or documented reason for no follow-up) or potentially inappropriate (no follow-up or no documented reason). Providers of a second patient group were contacted 5-6 days after imaging examinations to determine notification preferences.

RESULTS

Among 43 patients in the first group, five (12%) received potentially inappropriate management. Reasons included patient loss to follow-up and provider failure to review imaging results, document known imaging findings, or communicate findings to providers outside the health system. Among 16 providers caring for patients in the second group, 33% were unaware of the findings, 75% preferred to be notified of abnormal findings via e-mail or EMR, 56% wanted an embedded hyperlink enabling immediate follow-up order entry, and only 25% had a system to monitor whether patients had completed ordered testing.

CONCLUSIONS

One in eight patients did not receive potentially necessary follow-up care within 3 months of imaging findings of possible cancer. Automated notification of imaging findings and follow-up monitoring not only is desired by providers but can also address many of the reasons we found for inappropriate management.

An initiative to improve the management of clinically significant test results in a large health care network

BACKGROUND

The failure of providers to communicate and follow up clinically significant test results (CSTR) is an important threat to patient safety. The Massachusetts Coalition for the Prevention of Medical Errors has endorsed the creation of systems to ensure that results can be received and acknowledged.

METHODS

In 2008 a task force was convened that represented clinicians, laboratories, radiology, patient safety, risk management, and information systems in a large health care network with the goals of providing recommendations and a road map for improvement in the management of CSTR and of implementing this improvement plan during the sub-force sequent five years. In drafting its charter, the task broadened the scope from "critical" results to "clinically significant" ones; clinically significant was defined as any result that requires further clinical action to avoid morbidity or mortality, regardless of the urgency of that action.

RESULTS

The task force recommended four key areas for improvement--(1) standardization of policies and definitions, (2) robust identification of the patient's care team, (3) enhanced results management/tracking systems, and (4) centralized quality reporting and metrics. The task force faced many challenges in implementing these recommendations, including disagreements on definitions of CSTR and on who should have responsibility for CSTR, changes to established work flows, limitations of resources and of existing information systems, and definition of metrics.

CONCLUSIONS

This large-scale effort to improve the communication and follow-up of CSTR in a health care network continues with ongoing work to address implementation challenges, refine policies, prepare for a new clinical information system platform, and identify new ways to measure the extent of this important safety problem.

Impact of an automated email notification system for results of tests pending at discharge: a cluster-randomized controlled trial

BACKGROUND AND OBJECTIVE

Physician awareness of the results of tests pending at discharge (TPADs) is poor. We developed an automated system that notifies responsible physicians of TPAD results via secure, network email. We sought to evaluate the impact of this system on self-reported awareness of TPAD results by responsible physicians, a necessary intermediary step to improve management of TPAD results.

METHODS

We conducted a cluster-randomized controlled trial at a major hospital affiliated with an integrated healthcare delivery network in Boston, Massachusetts. Adult patients with TPADs who were discharged from inpatient general medicine and cardiology services were assigned to the intervention or usual care arm if their inpatient attending physician and primary care physician (PCP) were both randomized to the same study arm. Patients of physicians randomized to discordant study arms were excluded. We surveyed these physicians 72 h after all TPAD results were finalized. The primary outcome was awareness of TPAD results by attending physicians. Secondary outcomes included awareness of TPAD results by PCPs, awareness of actionable TPAD results, and provider satisfaction.

RESULTS

We analyzed data on 441 patients. We sent 441 surveys to attending physicians and 353 surveys to PCPs and received 275 and 152 responses from 83 different attending physicians and 112 different PCPs, respectively (attending physician survey response rate of 63%). Intervention attending physicians and PCPs were significantly more aware of TPAD results (76% vs 38%, adjusted/clustered OR 6.30 (95% CI 3.02 to 13.16), p<0.001; 57% vs 33%, adjusted/clustered OR 3.08 (95% CI 1.43 to 6.66), p=0.004, respectively). Intervention attending physicians tended to be more aware of actionable TPAD results (59% vs 29%, adjusted/clustered OR 4.25 (0.65, 27.85), p=0.13). One hundred and eighteen (85%) and 43 (63%) intervention attending physician and PCP survey respondents, respectively, were satisfied with this intervention.

CONCLUSIONS

Automated email notification represents a promising strategy for managing TPAD results, potentially mitigating an unresolved patient safety concern.

CLINICAL TRIAL REGISTRATION

ClinicalTrials.gov (NCT01153451).

Test result management in global health settings

Across the globe, the ways in which patients' test results are managed are as varied as the many different types of healthcare systems that manage these data. The outcomes, however, are often not too dissimilar: too many clinically significant test results fall through the cracks. The consequences of not following up test results in a timely manner are serious and often devastating to patients: diagnoses are delayed, treatments are not initiated or altered in time, and diseases progress. In resource-poor settings, test results too commonly get filed away within the paper chart in ways that isolate them and prevent passage to future providers caring for a patient. To make matters worse, the onus to act upon these test results often rests on patients who need to return to the clinic within a specified timeframe in order to obtain their results but who may not have the means or are too ill to do so. Even in more developed healthcare settings that use electronic records, clinical data residing in the electronic medical record (EMR) are often stubbornly "static"-key pieces of clinical information are frequently not recognized, retrieved, or shared easily. In this way, EMRs are not unlike paper record systems, and therefore, EMRs alone will not solve this problem. To illustrate this problem, consider the case of a patient newly diagnosed with HIV in 3 different healthcare delivery settings.