EHR-related medication errors in two ICUs

Development of a Human Factors-Based Guideline to Support the Design, Evaluation, and Continuous Improvement of Clinical Decision Support

Objective

To develop a vendor-agnostic, human factors (HF)-based guideline to guide the design, evaluation, and continuous improvement of clinical decision support (CDS).

Participants and Methods

The study used a 2-phased iterative approach between June 2022 and June 2024. Phase 1 involved a search for relevant industry standards and literature and consultation with multidisciplinary subject matter experts. Phase 2 involved a workshop with 30 health care and academic stakeholders to evaluate face validity and perceived usefulness of the initial section of the guideline. Participants were asked if the guideline met their expectations, to report on usefulness and ease of use and to suggest areas for improvement.

Results

Phase 1 resulted in a compilation of accessible, best practice, and context-appropriate HF guidance for CDS design and optimization. The guideline supports users in determining whether use of CDS is appropriate, and if yes, CDS options and design guidance. During phase 2, the guideline addressed 15 of participants' 19 expectations for a CDS guideline. Participants said the guideline was helpful, comprehensive, easy to use, and provided step-by-step guidance, boundaries, and transparency around CDS decisions. Participants recommended strengthening guidance around the need to understand system capabilities and the technical burden or complexity of CDS, and further guidance on how to approach CDS optimization using the guideline.

Conclusion

The 2-phased iterative development and feedback process resulted in the development of an HF-informed guideline to provide consolidated, accessible, and current best practice guidance on the appropriateness of CDS and CDS options, as well as designing, evaluating, and continuously improving CDS. Future work will evaluate the impact and implementation of the guideline in real-world settings.

Association of Polypharmacy and Burden of Comorbidities on COVID-19 Adverse Outcomes in People with Type 1 or Type 2 Diabetes

INTRODUCTION

It is widely accepted that the higher the number of medications prescribed and taken by an individual, the higher the risk of poor health outcomes. We have investigated whether polypharmacy and comorbidities conveyed more risk of adverse health outcomes following COVID-19 infection (as a paradigm of serious viral infections in general) in people with type 1 diabetes (T1DM) or type 2 diabetes (T2DM).

METHODS

The Greater Manchester Care Record (GMCR) is an integrated database of electronic health records containing data collected from 433 general practices in Greater Manchester. Baseline demographic information (age, body mass index [BMI], gender, ethnicity, smoking status, deprivation index), hospital admission or death within 28 days of infection were extracted for adults (18+) diagnosed with either T1DM or T2DM.

RESULTS

The study cohort included individuals diagnosed as T1DM and T2DM separately. Across the Greater Manchester Region, a total of 145,907 individuals were diagnosed with T2DM and 9705 were diagnosed with T1DM. For the T2DM individuals, 45.2% were women and for the T1DM individuals, 42.7% were women. For T2DM, 16-20 medications (p = 0.005; odds ratio [OR] [95% confidence interval (CI) 2.375 [1.306-4.319]) and > 20 medications (p < 0.001; OR [95% CI] 3.141 [1.755-5.621]) were associated with increased risk of death following COVID-19 infection. Increased risk of hospital admissions in T2DM individuals was associated with 11 to 15 medications (p = 0.013; OR = 1.341 (95% CI) [1.063-1.692]). This was independent of comorbidities, metabolic and demographic factors. For T1DM, there was no association of polypharmacy with hospital admission. Additionally, respiratory, cardiovascular/cerebrovascular and gastrointestinal conditions were associated with increased risk of hospital admissions and deaths in T2DM (p < 0.001). Many comorbidities were common across both T1DM and T2DM.

CONCLUSIONS

We have shown in T2DM an independent association of multiple medications taken from 11 upwards with adverse health consequences following COVID-19 infection. We also found that individuals with diabetes develop comorbidities that were common across both T1DM and T2DM. This study has laid the foundation for future investigations into the way that complex pharmacological interactions may influence clinical outcomes in people with T2DM.

The influence of electronic health record design on usability and medication safety: systematic review

BACKGROUND

The advantages of electronic health records (EHRs) are well-documented regarding the process of care, enhanced data accessibility and cost savings. However, EHR design can also contribute to usability challenges, with poorly designed EHRs being implicated in user errors including patient overdoses. Our study seeks to evaluate how EHR design influences both usability and medication safety.

METHODS

A systematic review was conducted of PubMed, EMBASE, CINAHL and the ACM library from 1 January 2009 to 8 October 2024. Eligible studies reported on the impact of specific EHR design elements on usability and/or medication safety, involved healthcare providers and took place in a secondary, tertiary or quaternary care setting. Usability was defined as the extent to which an EHR can be used to achieve specified goals with effectiveness, efficiency and satisfaction, while medication safety related to the risk of drug-related problems, including adverse drug events and medication errors. Design features identified within studies were validated, by cross-referencing these elements with ISO standards regarding design recommendations. A narrative synthesis was conducted, with studies tabulated based on whether they assessed usability and/or medication safety. Patterns were identified and common design elements between studies translated into themes. The Mixed Methods Appraisal Tool was used to evaluate study quality and PRISMA guidelines were followed throughout.

RESULTS

Thirty-two studies were identified. The design features described in these studies fit within seven broad design themes: searchability, automation, customisation, data entry, workflow, user guidance and interoperability. EHR systems that prioritised these areas were associated with higher reported usability and enhanced medication safety, while the opposite was found for systems that overlooked these design aspects. Our review also highlighted the numerous ways these themes can be implemented, while identifying the contributing factors that enable their successful implementation.

CONCLUSION

The design of EHRs can enhance or undermine usability and medication safety, depending on the searchability and customisability of these systems, how data entry processes and provider workflow are facilitated and how automation, user guidance and interoperability are implemented. Future EHR evaluations should be performed throughout the design process and consensus building is required regarding what exactly constitutes a design element, within an EHR context.

Teaching digital interprofessional collaboration

BACKGROUND

Interprofessional communication in Australian clinical practice has recently shifted from paper records to electronic medical records (EMRs), and there is therefore a need for universities to prepare health graduates for digital communication.

APPROACH

An interprofessional team co-designed and co-facilitated an online interprofessional activity for third year pharmacy and fifth year medical students utilising a simulated EMR (EHR Go™). Students completed a series of profession-specific tasks relating to a simulated patient, then came together in interprofessional groups of 10-12 to establish a collaborative medication charting plan.

EVALUATION

A total of 640 students participated in the activity, of which 60% (386/640) were medical students. Immediately after the interprofessional workshop, students were invited to complete a voluntary anonymous evaluation. Five-point Likert scales were used to rate the relevance to practice, achievement of learning outcomes, organisation and overall quality of the activity. Students were also asked to contribute qualitative feedback. Of the participants, 28% (180/640) completed the survey, and 53% (96/180) of respondents were medical students. A majority of survey respondents agreed or strongly agreed that the activity was relevant to practice (94%; 170/180), achieved the learning outcomes (84%; 151/180), was well organised (74%; 133/180) and was a quality learning experience (79%; 143/180). The positive feedback focused on appreciating the opportunity to discuss with interdisciplinary colleagues the rationale for admission medications. Constructive feedback included the need for clearer directives regarding pre-workshop activities.

IMPLICATIONS

This interprofessional education (IPE) activity presents a feasible, innovative approach to teaching pharmacy and medical students digital communication and collaboration using a simulated EMR. Overall, a majority of learners were satisfied with the learning experience and felt that the IPE activity achieved the learning outcomes and was relevant to practice.

Evaluating EHR-Integrated Digital Technologies for Medication-Related Outcomes and Health Equity in Hospitalised Adults: A Scoping Review

The purpose of this scoping review is to identify and evaluate studies that examine the effectiveness and implementation strategies of Electronic Health Record (EHR)-integrated digital technologies aimed at improving medication-related outcomes and promoting health equity among hospitalised adults. Using the Consolidated Framework for Implementation Research (CFIR), the implementation methods and outcomes of the studies were evaluated, as was the assessment of methodological quality and risk of bias. Searches through Medline, Embase, Web of Science, and CINAHL Plus yielded 23 relevant studies from 1,232 abstracts, spanning 11 countries and from 2008 to 2022, with varied research designs. Integrated digital tools such as alert systems, clinical decision support systems, predictive analytics, risk assessment, and real-time screening and surveillance within EHRs demonstrated potential in reducing medication errors, adverse events, and inappropriate medication use, particularly in older patients. Challenges include alert fatigue, clinician acceptance, workflow integration, cost, data integrity, interoperability, and the potential for algorithmic bias, with a call for long-term and ongoing monitoring of patient safety and health equity outcomes. This review, guided by the CFIR framework, highlights the importance of designing health technology based on evidence and user-centred practices. Quality assessments identified eligibility and representativeness issues that affected the reliability and generalisability of the findings. This review also highlights a critical research gap on whether EHR-integrated digital tools can address or worsen health inequities among hospitalised patients. Recognising the growing role of Artificial Intelligence (AI) and Machine Learning (ML), this review calls for further research on its influence on medication management and health equity through integration of EHR and digital technology.

Enteral nutrition: An underappreciated source of patient safety events

Enteral nutrition (EN) therapies are prescribed for patients not able to maintain adequate nutrition through the oral route. Medical errors and close calls associated with the provision of EN therapy leading to actual and potential patient harm have been reported. The purpose of this study was to determine the number, type, and severity of safety events related to the provision of EN therapies reported to a national database and provide workable recommendations from the literature to improve safety. An interdisciplinary team queried the National Center for Patient Safety (NCPS) Joint Patient Safety Reporting (JPSR) system using keywords related to EN therapy use. The team reviewed the number, type, and severity of reported events and safety codes as categorized by the NCPS and then thematically classified the narratives using the Medication Use Process (MUP). Our query revealed 1227 safety events related to the EN keywords. Thematic analysis of the top five event subtypes (n = 1030) revealed that there were 691 EN safety reports directly related to an MUP step, and the majority fell into the steps of administering (31%), followed by monitoring (28%), dispensing (26%), prescribing (11%), and transcription (4%), with many events involving more than one MUP step. Safety events associated with the provision of EN therapies leading to patient harm have been reported to the JPSR system. To improve safety related to EN use, modifications to prescribing, transcribing/documenting, dispensing, administering, and monitoring of prescribed EN therapies are needed.

The Solutions in Health Analytics for Rural Equity Across the Northwest (SHARE-NW) Dashboard for Health Equity in Rural Public Health: Usability Evaluation

BACKGROUND

Given the dearth of resources to support rural public health practice, the solutions in health analytics for rural equity across the northwest dashboard (SHAREdash) was created to support rural county public health departments in northwestern United States with accessible and relevant data to identify and address health disparities in their jurisdictions. To ensure the development of useful dashboards, assessment of usability should occur at multiple stages throughout the system development life cycle. SHAREdash was refined via user-centered design methods, and upon completion, it is critical to evaluate the usability of SHAREdash.

OBJECTIVE

This study aims to evaluate the usability of SHAREdash based on the system development lifecycle stage 3 evaluation goals of efficiency, satisfaction, and validity.

METHODS

Public health professionals from rural health departments from Washington, Idaho, Oregon, and Alaska were enrolled in the usability study from January to April 2022. The web-based evaluation consisted of 2 think-aloud tasks and a semistructured qualitative interview. Think-aloud tasks assessed efficiency and effectiveness, and the interview investigated satisfaction and overall usability. Verbatim transcripts from the tasks and interviews were analyzed using directed content analysis.

RESULTS

Of the 9 participants, all were female and most worked at a local health department (7/9, 78%). A mean of 10.1 (SD 1.4) clicks for task 1 (could be completed in 7 clicks) and 11.4 (SD 2.0) clicks for task 2 (could be completed in 9 clicks) were recorded. For both tasks, most participants required no prompting-89% (n=8) participants for task 1 and 67% (n=6) participants for task 2, respectively. For effectiveness, all participants were able to complete each task accurately and comprehensively. Overall, the participants were highly satisfied with the dashboard with everyone remarking on the utility of using it to support their work, particularly to compare their jurisdiction to others. Finally, half of the participants stated that the ability to share the graphs from the dashboard would be "extremely useful" for their work. The only aspect of the dashboard cited as problematic is the amount of missing data that was present, which was a constraint of the data available about rural jurisdictions.

CONCLUSIONS

Think-aloud tasks showed that the SHAREdash allows users to complete tasks efficiently. Overall, participants reported being very satisfied with the dashboard and provided multiple ways they planned to use it to support their work. The main usability issue identified was the lack of available data indicating the importance of addressing the ongoing issues of missing and fragmented public health data, particularly for rural communities.

Methods for studying medication safety following electronic health record implementation in acute care: a scoping review

OBJECTIVES

The objective of this scoping review is to map methods used to study medication safety following electronic health record (EHR) implementation. Patterns and methodological gaps can provide insight for future research design.

MATERIALS AND METHODS

We used the Joanna Briggs Institute scoping review methodology and a custom data extraction table to summarize the following data: (1) study demographics (year, country, setting); (2) study design, study period, data sources, and measures; (3) analysis strategy; (4) identified limitations or recommendations; (5) quality appraisal; and (6) if a Safety-I or Safety-II perspective was employed.

RESULTS

We screened 5879 articles. One hundred and fifteen articles met our inclusion criteria and were assessed for eligibility by full-text review. Twenty-seven articles were eligible for extraction.

DISCUSSION AND CONCLUSION

We found little consistency in how medication safety following EHR implementation was studied. Three study designs, 7 study settings, and 10 data sources were used across 27 articles. None of the articles shared the same combination of design, data sources, study periods, and research settings. Outcome measures were neither defined nor measured consistently. It may be difficult for researchers to aggregate and synthesize medication safety findings following EHR implementation research. All studies but one used a Safety-I perspective to study medication safety. We offer a conceptual model to support a more consistent approach to studying medication safety following EHR implementation.

Post-implementation usability evaluation of a human factors-based clinical decision support for pulmonary embolism (PE) diagnosis (Dx): PE Dx Study Part 1

While there is promise for health IT, such as Clinical Decision Support (CDS), to improve patient safety and clinician efficiency, poor usability has hindered widespread use of these tools. Human Factors (HF) principles and methods remain the gold standard for health IT design; however, there is limited information on how HF methods and principles influence CDS usability "in the wild". In this study, we explore the usability of an HF-based CDS used in the clinical environment; the CDS was designed according to a human-centered design process, which is described in Carayon et al. (2020). In this study, we interviewed 12 emergency medicine physicians, identifying 294 excerpts of barriers and facilitators of the CDS. Sixty-eight percent of excerpts related to the HF principles applied in the human-centered design of the CDS. The remaining 32% of excerpts related to 18 inductively-created categories, which highlight gaps in the CDS design process. Several barriers were related to the physical environment and organization work system elements as well as physicians' broader workflow in the emergency department (e.g., teamwork). This study expands our understanding of the usability outcomes of HF-based CDS "in the wild". We demonstrate the value of HF principles in the usability of CDS and identify areas for improvement to future human-centered design of CDS. The relationship between these usability outcomes and the HCD process is explored in an accompanying Part 2 manuscript.

Retrospective analysis of the human-centered design process used to develop a clinical decision support in the emergency department: PE Dx Study Part 2

With the growing implementation and use of health IT such as Clinical Decision Support (CDS), there is increasing attention on the potential negative impact of these technologies on patients (e.g., medication errors) and clinicians (e.g., increased workload, decreased job satisfaction, burnout). Human-Centered Design (HCD) and Human Factors (HF) principles are recommended to improve the usability of health IT and reduce its negative impact on patients and clinicians; however, challenges persist. The objective of this study is to understand how an HCD process influences the usability of health IT. We conducted a systematic retrospective analysis of the HCD process used in the design of a CDS for pulmonary embolism diagnosis in the emergency department (ED). Guided by the usability outcomes (e.g., barriers and facilitators) of the CDS use "in the wild" (see Part 1 of this research in the accompanying manuscript), we performed deductive content analysis of 17 documents (e.g., design session transcripts) produced during the HCD process. We describe if and how the design team considered the barriers and facilitators during the HCD process. We identified 7 design outcomes of the HCD process, for instance designing a workaround and making a design change to the CDS. We identify gaps in the current HCD process and demonstrate the need for a continuous health IT design process.

Meta-Analysis of Medication Administration Errors in African Hospitals

ABSTRACT

The incidence of medication administration errors (MAEs) and associated patient harm continue to plague hospitals worldwide. Moreover, there is a lack of evidence to address this problem, especially in Africa. This research synthesis was intended to provide current evidence to decrease the incidence of MAEs in Africa. Standardized search criteria were used to identify primary studies that reported the incidence and/or predictors of MAEs in Africa. Included studies met specifications and were validated with a quality-appraisal tool. The pooled incidence of MAEs in African hospitals was estimated to be 0.56 (CI: 0.4324-0.6770) with a 0.13-0.93 prediction interval. The primary estimates were highly heterogeneous. Most MAEs are explained by system failure and patient factors. The contribution of system factors can be minimized through adequate and ongoing training of nurses on the aspects of safe medication administration. In addition, ensuring the availability of drug use guidelines in hospitals, and minimizing disruptions during the medication process can decrease the incidence of MAEs in Africa.

How do automated reasoning features impact the usability of a clinical task management system? Development and usability testing of a prototype

BACKGROUND

Electronic clinical task management systems (ECTMSs) have been developed and adopted by care providers to improve care coordination. Some systems utilised automated reasoning (AR) to enable more intelligent task management functionalities, such as automated task allocation. Yet, the impact of such features on usability remains unclear. Poor usability of health information systems has been described to cause frustration and contribute to patient safety incidents.

AIM

To design AR features for an ECTMS and to evaluate their impact on usability.

METHODS

In this mixed methods study, four ECTMS feature prototypes were co-designed with two clinicians. For each prototype, one AR variant and one non-AR variant with equivalent functionalities were developed. A moderated usability testing was conducted with seven clinicians to obtain ease-of-use ratings of prototypes and measure task durations. Parameters related to demographics and attitudes of participants were obtained via a questionnaire. A framework analysis was performed to summarise qualitative feedback. To determine statistical relationships of study variables, Spearmańs rank coefficients were calculated and presented as a correlation matrix.

RESULTS

Three out of four prototypes received higher median ease-of-use ratings for AR variants and were associated with shorter average task durations. Multiple clinical use cases suitable for AR were identified. Preference for AR was found to moderately correlate with digital proficiency and prior experience with ECTMSs. Insufficient trust in automation, alert fatigue, and system customisation were identified as challenges in the adoption of AR features.

CONCLUSIONS

This study provides evidence for the potential of AR to enhance usability in ECTMSs. Consideration of psychological and organisational context of users in the feature design was found to be decisive for usability. Future research should explore implications for operational and clinical outcomes.

Human factors and safety analysis methods used in the design and redesign of electronic medication management systems: A systematic review

INTRODUCTION

Poorly designed electronic medication management systems (EMMS) or computerized physician order entry (CPOE) systems in hospital settings can result in usability issues and in turn, patient safety risks. As a safety science, human factors and safety analysis methods have potential to support the safe and usable design of EMMS.

OBJECTIVE

To identify and describe human factors and safety analysis methods that have been used in the design or redesign of EMMS used in hospital settings.

MATERIALS AND METHODS

A systematic review, following PRISMA guidelines, was conducted by searching online databases and relevant journals from January 2011 to May 2022. Studies were included if they described the practical application of human factors and safety analysis methods to support the design or redesign of a clinician-facing EMMS, or its components. Methods used were extracted and mapped to human centered design (HCD) activities: understanding context of use; specifying user requirements; producing design solutions; and evaluating the design.

RESULTS

Twenty-one papers met the inclusion criteria. Overall, 21 human factors and safety analysis methods were used in the design or redesign of EMMS with prototyping, usability testing, participant surveys/questionnaires and interviews the most frequent. Human factors and safety analysis methods were most frequently used to evaluate the design of a system (n = 67; 56.3%). Nineteen of 21 (90%) methods used aimed to identify usability issues and/or support iterative design; only one paper utilized a safety-oriented method and one, a mental workload assessment method.

DISCUSSION AND CONCLUSION

While the review identified 21 methods, EMMS design primarily utilized a subset of available methods, and rarely a method focused on safety. Given the high-risk nature of medication management in complex hospital environments, and the potential for harm due to poorly designed EMMS, there is significant potential to apply more safety-oriented human factors and safety analysis methods to support EMMS design.

Teaching pharmacy students a systematic approach to medication order verification

BACKGROUND AND PURPOSE

Inpatient medication order verification is an important skill for pharmacy students to learn for patient safety. This article describes a systematic approach to order verification that enables students to apply didactic knowledge and determine the presence of drug therapy problems during verification decisions.

EDUCATIONAL ACTIVITY AND SETTING

At two different colleges of pharmacy, an order verification module for second-year pharmacy students introduced a checklist for reviewing medication orders in a patient chart and identifying the presence of drug therapy problems. Students had to make a "verify or not" decision for each non-verified order and document their decision in both the chart and on a game-based learning platform.

FINDINGS

Over four academic years, 756 students participated in the module. With the checklist approach to order verification, students were able to identify the drug therapy problems of "dose too high" and "no drug therapy problem present" but were challenged by "wrong drug," "dose too low/renal dosing," and "duplication of therapy."

SUMMARY

The order verification checklist was a beneficial tool for teaching a systematic approach to inpatient medication order verification.

State of the evidence on simulation-based electronic health records training: A scoping review

This study synthesized the available evidence of simulation-based electronic health records (EHRs) training in educational and clinical environments for healthcare providers in the literature. The Arksey and O'Malley methodological framework was employed. A systematic search was carried out in relevant databases from inception to January 2020, identifying 24 studies for inclusion. Three themes emerged: (a) role of simulation-based EHR training in evaluating improvement interventions, (b) debriefing and feedback methods used, and (c) challenges of evaluating simulation-based EHR training. The majority of the studies aimed to emphasize the practical skills of individual medical trainees and employed post-simulation feedback as the feedback method. Future research should focus on (a) using simulation-based EHR training to achieve specific learning goals, (b) investigating aspects of clinical performance that are susceptible to skill decay, and (c) examining the influence of simulation-based EHR training on team dynamics.

The biopsychosociotechnical model: a systems-based framework for human-centered health improvement

The biopsychosocial model is among the most influential frameworks for human-centered health improvement but has faced significant criticism- both conceptual and pragmatic. This paper extends and fundamentally re-structures the biopsychosocial model by combining it with sociotechnical systems theory. The resulting biopsychosociotechnical model addresses key critiques of the biopsychosocial model, providing a more "practical theory" for human-centered health improvement. It depicts the determinants of health as complex adaptive system of systems; includes the the artificial world (technology); and provides a roadmap for systems improvement by: differentiating between "health status" and "health and needs assessment", [promoting problem framing]; explaining health as an emergent property of the biopsychosociotechnical context [imposing a systems orientation]; focusing on "interventions" vs. "treatments" to modify the biopsychosociotechnical determinants of health, [expanding the solution space]; calling for a participatory design process [supporting systems awareness and goal-orientation]; and including intervention management to support the full lifecycle of health improvement.

A Mobile, Electronic Health Record-Connected Application for Managing Team Workflows in Inpatient Care

BACKGROUND

 Clinical workflows require the ability to synthesize and act on existing and emerging patient information. While offering multiple benefits, in many circumstances electronic health records (EHRs) do not adequately support these needs.

OBJECTIVES

 We sought to design, build, and implement an EHR-connected rounding and handoff tool with real-time data that supports care plan organization and team-based care. This article first describes our process, from ideation and development through implementation; and second, the research findings of objective use, efficacy, and efficiency, along with qualitative assessments of user experience.

METHODS

 Guided by user-centered design and Agile development methodologies, our interdisciplinary team designed and built Carelign as a responsive web application, accessible from any mobile or desktop device, that gathers and integrates data from a health care institution's information systems. Implementation and iterative improvements spanned January to July 2016. We assessed acceptance via usage metrics, user observations, time-motion studies, and user surveys.

RESULTS

 By July 2016, Carelign was implemented on 152 of 169 total inpatient services across three hospitals staffing 1,616 hospital beds. Acceptance was near-immediate: in July 2016, 3,275 average unique weekly users generated 26,981 average weekly access sessions; these metrics remained steady over the following 4 years. In 2016 and 2018 surveys, users positively rated Carelign's workflow integration, support of clinical activities, and overall impact on work life.

CONCLUSION

 User-focused design, multidisciplinary development teams, and rapid iteration enabled creation, adoption, and sustained use of a patient-centered digital workflow tool that supports diverse users' and teams' evolving care plan organization needs.

Preliminary Exploration of Main Elements for Systematic Classification Development: Case Study of Patient Safety Incidents (Preprint)

Background

Currently, there is no holistic theoretical approach available for guiding classification development. On the basis of our recent classification development research in the area of patient safety in health information technology, this focus area would benefit from a more systematic approach. Although some valuable theoretical and methodological approaches have been presented, classification development literature typically is limited to methodological development in a specific domain or is practically oriented.

Objective

The main purposes of this study are to fill the methodological gap in classification development research by exploring possible elements of systematic development based on previous literature and to promote sustainable and well-grounded classification outcomes by identifying a set of recommended elements. Specifically, the aim is to answer the following question: what are the main elements for systematic classification development based on research evidence and our use case?

Methods

This study applied a qualitative research approach. On the basis of previous literature, preliminary elements for classification development were specified, as follows: defining a concept model, documenting the development process, incorporating multidisciplinary expertise, validating results, and maintaining the classification. The elements were compiled as guiding principles for the research process and tested in the case of patient safety incidents (n=501).

Results

The results illustrate classification development based on the chosen elements, with 4 examples of technology-induced errors. Examples from the use case regard usability, system downtime, clinical workflow, and medication section problems. The study results confirm and thus suggest that a more comprehensive and theory-based systematic approach promotes well-grounded classification work by enhancing transparency and possibilities for assessing the development process.

Conclusions

We recommend further testing the preliminary main elements presented in this study. The research presented herein could serve as a basis for future work. Our recently developed classification and the use case presented here serve as examples. Data retrieved from, for example, other type of electronic health records and use contexts could refine and validate the suggested methodological approach.

A Fully Collaborative, Noteless Electronic Medical Record Designed to Minimize Information Chaos: Software Design and Feasibility Study

Background

Clinicians spend large amounts of their workday using electronic medical records (EMRs). Poorly designed documentation systems contribute to the proliferation of out-of-date information, increased time spent on medical records, clinician burnout, and medical errors. Beyond software interfaces, examining the underlying paradigms and organizational structures for clinical information may provide insights into ways to improve documentation systems. In particular, our attachment to the note as the major organizational unit for storing unstructured medical data may be a cause of many of the problems with modern clinical documentation. Notes, as currently understood, systematically incentivize information duplication and information scattering, both within a single clinician’s notes over time and across multiple clinicians’ notes. Therefore, it is worthwhile to explore alternative paradigms for unstructured data organization.

Objective

The aim of this study is to demonstrate the feasibility of building an EMR that does not use notes as the core organizational unit for unstructured data and which is designed specifically to disincentivize information duplication and information scattering.

Methods

We used specific design principles to minimize the incentive for users to duplicate and scatter information. By default, the majority of a patient’s medical history remains the same over time, so users should not have to redocument that information. Clinicians on different teams or services mostly share the same medical information, so all data should be collaboratively shared across teams and services (while still allowing for disagreement and nuance). In all cases where a clinician must state that information has remained the same, they should be able to attest to the information without redocumenting it. We designed and built a web-based EMR based on these design principles.

Results

We built a medical documentation system that does not use notes and instead treats the chart as a single, dynamically updating, and fully collaborative workspace. All information is organized by clinical topic or problem. Version history functionality is used to enable granular tracking of changes over time. Our system is highly customizable to individual workflows and enables each individual user to decide which data should be structured and which should be unstructured, enabling individuals to leverage the advantages of structured templating and clinical decision support as desired without requiring programming knowledge. The system is designed to facilitate real-time, fully collaborative documentation and communication among multiple clinicians.

Conclusions

We demonstrated the feasibility of building a non–note-based, fully collaborative EMR system. Our attachment to the note as the only possible atomic unit of unstructured medical data should be reevaluated, and alternative models should be considered.

Clinical Informatics Training During Emergency Medicine Residency: The University of Michigan Experience

Clinical informatics (CI) is a rich field with longstanding ties to resident education in many clinical specialties, although a historic gap persists in emergency medicine. To address this gap, we developed a CI track to facilitate advanced training for senior residents at our 4-year emergency medicine residency. We piloted an affordable project-based approach with strong ties to operational leadership at our institution and describe specific projects and their outcomes. Given the relatively low cost, departmental benefit, and unique educational value, we believe that our model is generalizable to many emergency medicine residencies. We present a pathway to defining a formal curriculum using Kern's framework.

Medication Without Harm: Developing optimal medication error reporting systems

Medication errors are amongst the most frequently occurring health care related incidents and have the potential to lead to life-threatening harm to patients. An incident reporting system is a traditional approach to improvement of patient safety and entails the retrieval of information from incident reports. This not only provides a better understanding of causes and contributing factors but also enables the collection of data on the severity of incidents, system deficiencies and the role of human factors in safety incidents. Medication error reporting systems are often developed as a part of larger incident reporting systems which deal with other types of incidents. Although a rise in the prevalence of medication errors has led to an increased demand for medication error reporting, little is known about characteristics and limitations of medication error reporting systems. The authors broach the subject of medication error reporting systems and propose a more robust and standardized approach.

Medication errors related to computerized provider order entry systems in hospitals and how they change over time: A narrative review

BACKGROUND

Evaluations of computerized provider order entry (CPOE) systems have revealed that reductions in certain types of medication errors occur simultaneously with the emergence of system-related errors - errors that are unlikely or not possible to occur with the use of paper-based medication charts. System-related errors appear to persist many years post-implementation of CPOE, although little is known about whether the types and rates of system-related errors that occur immediately following CPOE implementation are similar to those that endure or emerge after years of system use.

OBJECTIVE

To analyze and synthesize the literature on system-related errors, specifically in relation to the length of time that CPOE systems have been in use, to determine what is currently known about how system-related errors change over time.

METHODS

A literature search was undertaken using the PubMed database to identify English language articles published between January 2005 and March 2020 that provided original data on system-related errors resulting from CPOE system use. Studies were included if they provided results on system-related errors and information relating to the length of time that CPOE had been in use.

RESULTS

Thirty-one studies met the inclusion criteria for this narrative review. System-related errors were identified and described during short, medium and long-term use of CPOE systems, but no single study examined how errors changed over time. In comparing findings across studies, results suggest that system-related errors persist with long-term use of CPOE systems, although likely to occur at a reduced rate.

CONCLUSIONS

This review has highlighted a significant gap in knowledge on how system-related errors change over time. Determining what and when system-related errors occur and the system factors that contribute to their occurrence at different time points after CPOE implementation is necessary for the future prevention and mitigation of these errors.

Augmenting patient safety through participation by design - An assessment of dual monitors for patients in the outpatient clinic

BACKGROUND

Patients and physicians engaging together in the electronic health record (EHR) during clinical visits may provide opportunities to both improve patient understanding and reduce medical errors.

OBJECTIVE

To assess the potential impact of a patient EHR display intervention on patient quality and safety. We hypothesized that if patients had a dedicated display with an explicit invitation to follow clinicians in the EHR that this would identify several opportunities to engage patients in their care quality and safety.

MATERIAL AND METHODS

Physician-patient outpatient encounters (24 patients and 8 physicians) were videotaped. Encounters took place in a hospital-based general internal medicine outpatient clinic where physicians and patients had their respective EHR monitors. Following the visits, each patient and physician was interviewed for 30 min to understand their perception of the mirrored-screen setting.

RESULTS

The following 7 themes were identified (a) curiosity, (b) opportunity to ask questions, (c) error identification, (d) control over medications, (e) awareness, (f) shared understanding & decision-making, (g) data privacy. These themes collectively comprised a conceptual model for how patient engagement in electronic health record use, through a dedicated second screen or an explicitly shared screen, relates to safety and quality opportunities. Therefore, the double EHR screen provides an explicit invitation for patients to join the process to influence safety.

CONCLUSION

Desired outcomes include real-time error identification and better-shared understanding and decision-making, leading to better downstream follow-through with care plans.

Pharmacy students' perspectives on the initial implementation of a teaching electronic medical record: results from a mixed-methods assessment

BACKGROUND

Electronic medical records (EMRs) have been used for nearly three decades. Pharmacists use EMRs on a daily basis, but EMRs have only recently been incorporated into pharmacy education. Some pharmacy programs have implemented teaching electronic medical records (tEMRs), but best practices for incorporating tEMRs into pharmacy education remain unknown. The objectives of this study were to 1) assess pharmacy students' views and experiences with a tEMR; and 2) identify current learning activities and future priorities for tEMR use in pharmacy education.

METHODS

We used a mixed-methods approach, including three, two-hour student focus groups and a 42-item web-based survey to examine student perspectives of the tEMR. All first, second, and third year professional pharmacy students were eligible to participate in the survey and a focus group. Web-based survey items were measured on a 7-point Likert scale, and quantitative analyses included descriptive statistics. Two researchers independently coded transcripts using both deductive and inductive approaches to identify emergent themes. These analysts met and resolved any coding discrepancies via consensus.

RESULTS

Focus groups were conducted with 22 total students, with 6-8 students represented from each year of pharmacy training. The survey was completed by 156 students: 47 first year, 55 second year, and 54 third year. Overall, 48.7% of survey respondents altogether agreed or strongly agreed that using the tEMR enhanced their learning in pharmacy classes and laboratories. Qualitative data were organized into four major themes regarding tEMR adoption: current priorities for use within the pharmacy curriculum; tEMR benefits; tEMR barriers; and future priorities for tEMR use to prepare students for pharmacy practice.

CONCLUSIONS

This study reveals pharmacy students' perspectives and attitudes towards using a tEMR, the types of classroom activities that incorporate the tEMR, and students' future suggestions to enhance the design or application of the tEMR for their learning. Our research findings may aid other pharmacy programs and promote more effective use of tEMRs in pharmacy education. In the long-term, this study may strengthen pharmacy education on EMRs and thus increase the efficacy and safety of pharmacists' EMR use for patients' medication management.

Human Factors and Usability for Health Information Technology: Old and New Challenges

OBJECTIVES

Despite national mandates, incentives, and other programs, the design of health information technology (IT) remains problematic and usability problems continue to be reported. This paper reviews recent literature on human factors and usability of health IT, with a specific focus on research aimed at applying human factors methods and principles to improve the actual design of health IT, its use, and associated patient and clinician outcomes.

METHODS

We reviewed recent literature on human factors and usability problems of health IT and research on human-centered design of health IT for clinicians and patients.

RESULTS

Studies continue to show usability problems of health IT experienced by multiple groups of health care professionals (e.g., physicians and nurses) as well as patients. Recent research shows that usability is influenced by both designers (e.g., IT vendors) and implementers in health care organizations, and that the application of human-centered design practices needs to be further improved and extended. We welcome emerging research on the design of health IT for teams as team-based care is increasingly implemented throughout health care.

CONCLUSIONS

Progress in the application of human factors methods and principles to the design of health IT is occurring, with important information provided on their actual impact on care processes and patient outcomes. Future research should examine the work of health IT designers and implementers, which would help to develop strategies for further embedding human factors engineering in IT design processes.

Healthcare practitioner behaviours that influence unsafe use of hospital information systems

This study aims to investigate healthcare practitioner behaviour in adopting Health Information Systems which could affect patients' safety and quality of health. A qualitative study was conducted based on a semi-structured interview protocol on 31 medical doctors in three Malaysian government hospitals implementing the Total Hospital Information Systems. The period of study was between March and May 2015. A thematic qualitative analysis was performed on the resultant data to categorize them into relevant themes. Four themes emerged as healthcare practitioners' behaviours that influence the unsafe use of Hospital Information Systems. The themes include (1) carelessness, (2) workarounds, (3) noncompliance to procedure, and (4) copy and paste habit. By addressing these behaviours, the hospital management could further improve patient safety and the quality of patient care.

Challenges And Opportunities For Improving Patient Safety Through Human Factors And Systems Engineering

Despite progress on patient safety since the publication of the Institute of Medicine's 1999 report, To Err Is Human, significant problems remain. Human factors and systems engineering (HF/SE) has been increasingly recognized and advocated for its value in understanding, improving, and redesigning processes for safer care, especially for complex interacting sociotechnical systems. However, broad awareness of HF/SE and its adoption into safety improvement work have been frustratingly slow. We provide an overview of HF/SE, its demonstrated value to a wide range of patient safety problems (in particular, medication safety), and challenges to its broader implementation across health care. We make a variety of recommendations to maximize the spread of HF/SE, including formal and informal education programs, greater adoption of HF/SE by health care organizations, expanded funding to foster more clinician-engineer partnerships, and coordinated national efforts to design and operationalize a system for spreading HF/SE into health care nationally.