An analysis of electronic health record-related patient safety concerns

The influence of digital technologies on resilient performance: Contributions, drawbacks, and a research agenda

The growing use of digital technologies (DTs) has a myriad of implications to socio-technical systems, which are not yet fully recognised. This paper investigates the contributions and drawbacks of DTs to resilient performance (RP), an aspect that so far has received less attention in comparison to others such as efficiency. To this end, a survey questionnaire was applied to 79 academics and practitioners linked to resilience engineering. Data analysis involved descriptive statistics and a thematic analysis of the open-text responses to the survey. Mixed impacts were identified, with 10 themes related to contributions and 16 to drawbacks. Regarding the contributions, the results highlighted the use of DTs for monitoring and anticipating system performance. Machine learning seems to be the most promising approach for this purpose. A key drawback is the need for developing new skills across the workforce so that they can make sense of the outputs of DTs and are aware of their strengths and weaknesses. The human role is expected to remain crucial for RP, which makes the current coordination difficulties with DTs even more important to address. A research agenda composed of five topics is proposed, encompassing description, prescription, and assessment. The agenda emphasizes the need for mapping the attributes or functionalities of DTs onto resilience concepts, models, and frameworks.

Implementation of a health information technology safety classification system in the Veterans Health Administration's Informatics Patient Safety Office

OBJECTIVE

Implement the 5-type health information technology (HIT) patient safety concern classification system for HIT patient safety issues reported to the Veterans Health Administration's Informatics Patient Safety Office.

MATERIALS AND METHODS

A team of informatics safety analysts retrospectively classified 1 year of HIT patient safety issues by type of HIT patient safety concern using consensus discussions. The processes established during retrospective classification were then applied to incoming HIT safety issues moving forward.

RESULTS

Of 140 issues retrospectively reviewed, 124 met the classification criteria. The majority were HIT failures (eg, software defects) (33.1%) or configuration and implementation problems (29.8%). Unmet user needs and external system interactions accounted for 20.2% and 10.5%, respectively. Absence of HIT safety features accounted for 2.4% of issues, and 4% did not have enough information to classify.

CONCLUSION

The 5-type HIT safety concern classification framework generated actionable categories helping organizations effectively respond to HIT patient safety risks.

Development of minimum data set and dashboard for monitoring adverse events in radiology departments

Background

To reduce the risk of errors, patient safety monitoring in the medical imaging department is crucial. Interventions are required and these can be provided as a framework for documenting, reporting, evaluating, and recognizing events that pose a threat to patient safety. The aim of this study was to develop minimum data set and dashboard for monitoring adverse events in radiology departments.

Material and methods

This developmental research was conducted in multiple phases, including content determination using the Delphi technique; database designing using SQL Server; user interface (UI) building using PHP; and dashboard evaluation in three aspects: the accuracy of calculating; UI requirements; and usability.

Results

This study identified 26 patient safety (PS) performance metrics and 110 PS-related significant data components organized into 14 major groupings as the system contents. The UI was built with three tabs: pre-procedure, intra-procedure, and post-procedure. The evaluation results proved the technical feasibility of the dashboard. Finally, the dashboard's usability was highly rated (76.3 out of 100).

Conclusion

The dashboard can be used to supplement datasets to obtain a more accurate picture of the PS condition and to draw attention to characteristics that professionals might otherwise overlook or undervalue.

Assessing the Usability and Feasibility of Digital Assistant Tools for Direct Support Professionals: Participatory Design and Pilot-Testing

BACKGROUND

The United States is experiencing a direct support professional (DSP) crisis, with demand far exceeding supply. Although generating documentation is a critical responsibility, it is one of the most wearisome aspects of DSPs' jobs. Technology that enables DSPs to log informal time-stamped notes throughout their shift could help reduce the burden of end-of-shift documentation and increase job satisfaction, which in turn could improve the quality of life of the individuals with intellectual and developmental disabilities (IDDs) whom DSPs support. However, DSPs, with varied ages, levels of education, and comfort using technology, are not likely to adopt tools that detract from caregiving responsibilities or increase workload; therefore, technological tools for them must be relatively simple, extremely intuitive, and provide highly valued capabilities.

OBJECTIVE

This paper describes the development and pilot-testing of a digital assistant tool (DAT) that enables DSPs to create informal notes throughout their shifts and use these notes to facilitate end-of-shift documentation. The purpose of the pilot study was to assess the usability and feasibility of the DAT.

METHODS

The research team applied an established user-centered participatory design process to design, develop, and test the DAT prototypes between May 2020 and April 2023. Pilot-testing entailed having 14 DSPs who support adults with IDDs use the first full implementation of the DAT prototypes during 2 or 3 successive work shifts and fill out demographic and usability questionnaires.

RESULTS

Participants used the DAT prototypes to create notes and help generate end-of-shift reports. The System Usability Scale score of 81.79 indicates that they found the prototypes easy to use. Survey responses imply that using the DAT made it easier for participants to produce required documentation and suggest that they would adopt the DAT if this tool were available for daily use.

CONCLUSIONS

Simple technologies such as the DAT prototypes, which enable DSPs to use mobile devices to log time-stamped notes throughout their shift with minimal effort and use the notes to help write reports, have the potential to both reduce the burden associated with producing documentation and enhance the quality (level of detail and accuracy) of this documentation. This could help to increase job satisfaction and reduce turnover in DSPs, both of which would help improve the quality of life of the individuals with IDDs whom they support. The pilot test results indicate that DSPs found the DAT easy to use. Next steps include (1) producing more robust versions of the DAT with additional capabilities, such as storing data locally on mobile devices when Wi-Fi is not available; and (2) eliciting input from agency directors, families, and others who use data about adults with IDDs to help care for them to ensure that data produced by DSPs are relevant and useful.

An Analysis of Incident Reports Related to Electronic Medication Management: How They Change Over Time

OBJECTIVE

Electronic medication management (EMM) systems have been shown to introduce new patient safety risks that were not possible, or unlikely to occur, with the use of paper charts. Our aim was to examine the factors that contribute to EMM-related incidents and how these incidents change over time with ongoing EMM use.

METHODS

Incidents reported at 3 hospitals between January 1, 2010, and December 31, 2019, were extracted using a keyword search and then screened to identify EMM-related reports. Data contained in EMM-related incident reports were then classified as unsafe acts made by users and the latent conditions contributing to each incident.

RESULTS

In our sample, 444 incident reports were determined to be EMM related. Commission errors were the most frequent unsafe act reported by users (n = 298), whereas workarounds were reported in only 13 reports. User latent conditions (n = 207) were described in the highest number of incident reports, followed by conditions related to the organization (n = 200) and EMM design (n = 184). Over time, user unfamiliarity with the system remained a key contributor to reported incidents. Although fewer articles to electronic transfer errors were reported over time, incident reports related to the transfer of information between different computerized systems increased as hospitals adopted more clinical information systems.

CONCLUSIONS

Electronic medication management-related incidents continue to occur years after EMM implementation and are driven by design, user, and organizational conditions. Although factors contribute to reported incidents in varying degrees over time, some factors are persistent and highlight the importance of continuously improving the EMM system and its use.

Operational disruption in healthcare associated with software functionality issue due to software security patching: a case report

Despite many benefits, the extensive deployment of Health Information Technology (HIT) systems by healthcare organizations has encountered many challenges, particularly in the field of telemetry concerning patient monitoring and its operational workflow. These challenges can add more layers of complexity when an unplanned software security patching is performed, affecting patient monitoring and causing disruption in daily clinical operations. This study is a reflection on what happened associated with software security patching and why it happened through the lens of an incident report to develop potential preventive and corrective strategies using qualitative analyses—inductive and deductive approaches. There is a need for such analyses to identify the underlying mechanism behind such issues since very limited research has been conducted on the study of software patching. The incident was classified as a “software functionality” issue, and the consequence was an “incident with a noticeable consequence but no patient harm”, and the contributing factor was a software update, i.e., software security patching. This report describes how insufficient planning of software patching, lack of training for healthcare professionals, contingency planning on unplanned system disruption, and HIT system configuration can compromise healthcare quality and cause risks to patient safety. We propose 15 preventive and corrective strategies grouped under four key areas based on the system approach and social-technical aspects of the patching process. The key areas are (i) preparing, developing, and deploying patches; (ii) training the frontline operators; (iii) ensuring contingency planning; and (iv) establishing configuration and communication between systems. These strategies are expected to minimize the risk of HIT-related incidents, enhance software security patch management in healthcare organizations, and improve patient safety. However, further discussion should be continued about general HIT problems connected to software security patching.

EHR-BERT: A BERT-based model for effective anomaly detection in electronic health records

OBJECTIVE

Physicians and clinicians rely on data contained in electronic health records (EHRs), as recorded by health information technology (HIT), to make informed decisions about their patients. The reliability of HIT systems in this regard is critical to patient safety. Consequently, better tools are needed to monitor the performance of HIT systems for potential hazards that could compromise the collected EHRs, which in turn could affect patient safety. In this paper, we propose a new framework for detecting anomalies in EHRs using sequence of clinical events. This new framework, EHR-Bidirectional Encoder Representations from Transformers (BERT), is motivated by the gaps in the existing deep-learning related methods, including high false negatives, sub-optimal accuracy, higher computational cost, and the risk of information loss. EHR-BERT is an innovative framework rooted in the BERT architecture, meticulously tailored to navigate the hurdles in the contemporary BERT method; thus, enhancing anomaly detection in EHRs for healthcare applications.

METHODS

The EHR-BERT framework was designed using the Sequential Masked Token Prediction (SMTP) method. This approach treats EHRs as natural language sentences and iteratively masks input tokens during both training and prediction stages. This method facilitates the learning of EHR sequence patterns in both directions for each event and identifies anomalies based on deviations from the normal execution models trained on EHR sequences.

RESULTS

Extensive experiments on large EHR datasets across various medical domains demonstrate that EHR-BERT markedly improves upon existing models. It significantly reduces the number of false positives and enhances the detection rate, thus bolstering the reliability of anomaly detection in electronic health records. This improvement is attributed to the model's ability to minimize information loss and maximize data utilization effectively.

CONCLUSION

EHR-BERT showcases immense potential in decreasing medical errors related to anomalous clinical events, positioning itself as an indispensable asset for enhancing patient safety and the overall standard of healthcare services. The framework effectively overcomes the drawbacks of earlier models, making it a promising solution for healthcare professionals to ensure the reliability and quality of health data.

Electronic health record competency in graduate nurses: A grounded theory study

BACKGROUND

The use of electronic health records is ubiquitous in healthcare settings, yet newly graduated nurses struggle with developing electronic health record competency prior to entry into nursing practice. Insufficient electronic health record knowledge, skills, and attitudes among newly graduated nurses are contributing to patient harm, clinical burn-out, and unsafe practices. In this study, we interviewed electronic health record educators to identify how newly graduated nurses develop electronic health record competency characteristics and to learn about their educational approaches for teaching electronic health record proficiency.

METHOD

This study used a constructive grounded theory approach to develop a theoretical model to make sense of electronic health record educators' experiences working with newly graduated nurses during electronic health record education and training sessions.

FINDINGS

Electronic health record educators found that in the newly graduated nurse population, practicing builds competency in electronic health record knowledge, skills, and attitudes. The research revealed that it is the combination of teaching through modeling, working hard as a new graduate, and understanding charting to standards requirements that impacts the development of electronic health record competency characteristics.

CONCLUSION

Electronic health record competency characteristics are developed when an educator is modeling documentation knowledge, skills, and attitudes, the newly graduated nurse is working hard to learn, and there is clarity by nursing leadership related to charting to standards requirements. It is the success or failure in these core areas that impacts a newly graduated nurse's ability to achieve electronic health record competency. A level of competency and proficiency in electronic health record is required to provide care that is safe and patient centered.

Use of Electronic Medical Records (EMR) in Gerontology: Benefits, Considerations and a Promising Future

Electronic medical records (EMRs) have many benefits in clinical research in gerontology, enabling data analysis, development of prognostic tools and disease risk prediction. EMRs also offer a range of advantages in clinical practice, such as comprehensive medical records, streamlined communication with healthcare providers, remote data access, and rapid retrieval of test results, ultimately leading to increased efficiency, enhanced patient safety, and improved quality of care in gerontology, which includes benefits like reduced medication use and better patient history taking and physical examination assessments. The use of artificial intelligence (AI) and machine learning (ML) approaches on EMRs can further improve disease diagnosis, symptom classification, and support clinical decision-making. However, there are also challenges related to data quality, data entry errors, as well as the ethics and safety of using AI in healthcare. This article discusses the future of EMRs in gerontology and the application of AI and ML in clinical research. Ethical and legal issues surrounding data sharing and the need for healthcare professionals to critically evaluate and integrate these technologies are also emphasized. The article concludes by discussing the challenges related to the use of EMRs in research as well as in their primary intended use, the daily clinical practice.

Limitations in the use of automated mental status detection for clinical decision support

BACKGROUND

Clinical decision support (CDS) tools improve adherence to evidence-based practices but are dependent upon data quality in the electronic health record (EHR). Mental status is an integral component of many risk stratification scores, but it is not known whether EHR-measures of altered mental status are reliable. The Glasgow Coma Scale (GCS) is a measure of altered mentation that is widely adopted and entered in the EHR in structured format. We sought to determine the accuracy GCS < 15 as an EHR-measure of altered mentation compared to ED provider documentation.

METHODS

In patients presenting to an academic Emergency Department (ED) with pneumonia we abstracted GCS values entered by nurses during routine care and in a randomly selected subset manually reviewed provider documentation for evidence of altered mental status. We defined eConfusion as present if GCS < 15 at any point during the ED encounter. We then calculated the CURB-65 score and corresponding suggested disposition using each method. Performance of eConfusion and corresponding CURB-65 compared to manual versions was measured using agreement (Cohen's K), sensitivity, and specificity.

RESULTS

Among 300 randomly selected encounters, 47 (16 %) had eConfusion present and 46 (15 %) had evidence of altered mental status in provider documentation with Cohen's K 0.73. eConfusion had 78 % sensitivity and 96 % specificity for provider documented altered mental status. When input into CURB-65 to recommend inpatient disposition, eConfusion had 95 % sensitivity, and recommended discordant disposition for 3 %.

CONCLUSIONS

There was modest agreement between eConfusion and provider documentation of altered mental status. eConfusion had good specificity but low sensitivity which resulted in under-estimation of the CURB-65 score and occasional inappropriate disposition recommendations compared to provider documentation. These data do not support the use of GCS as a measure for altered mentation for use in CDS tools in the ED.

Characterization of Safety Events Involving Technology in Primary and Community Care

BACKGROUND

The adoption of technology in health care settings is often touted as an opportunity to improve patient safety. While some adverse events can be reduced by health information technologies, technology has also been implicated in or attributed to safety events. To date, most studies on this topic have focused on acute care settings.

OBJECTIVES

To describe voluntarily reported safety events that involved health information technology in community and primary care settings in a large Canadian health care organization.

METHODS

Two years of safety events involving health information technology (2016-2018) were extracted from an online voluntary safety event reporting system. Events from primary and community care settings were categorized according to clinical setting, type of event, and level of harm. The Sittig and Singh sociotechnical system model was then used to identify the most prominent sociotechnical dimensions of each event.

RESULTS

Of 104 reported events, most (n = 85, 82%) indicated the event resulted in no harm. Public health had the highest number of reports (n = 45, 43%), whereas home health had the fewest (n = 7, 7%). Of the 182 sociotechnical concepts identified, many events (n = 61, 59%) mapped to more than one dimension. Personnel (n = 48, 46%), Workflow and Communication (n = 37, 36%), and Content (n = 30, 29%) were the most common. Personnel and Content together was the most common combination of dimensions.

CONCLUSION

Most reported events featured both technical and social dimensions, suggesting that the nature of these events is multifaceted. Leveraging existing safety event reporting systems to screen for safety events involving health information technology, and applying a sociotechnical analytic framework can aid health organizations in identifying, responding to, and learning from reported events.

Cell Therapy Informatics: Updates on the Integration of HCT/IEC Functionalities into an Electronic Medical Record System in the US to Promote Efficiency, Patient Safety, Research, and Data Interoperability

The use of electronic health/medical record (EMR) systems has streamlined medical practice and improved efficiency of clinical care in recent years. However, EMR systems are not generally well designed to support research and tracking of longitudinal outcomes across populations, which are particularly important in hematopoietic stem cell transplantation (HCT) and immune effector cell therapy (IEC), where data reporting to registries and regulatory agencies are often required. Since its formation in 2014, the HCT EMR user group has worked with a large EMR vendor (Epic) to develop many functionalities within the EMR to improve the care of HCT/IEC patients and facilitate the capture of HCT/IEC data in an easily interoperable format. Awareness and the widespread adoption of these new tools among transplant centers remains a challenge, however. In this report, we aim to increase awareness and adoption of these new features in the Epic EMR across the transplantation community, advocate for the use of data standards, and promote future collaboration with other commercial EMRs to develop standardized HCT/IEC content to improve patient care and facilitate interoperable data exchange.

Classification of Health Information Technology Safety Events in a Pediatric Tertiary Care Hospital

OBJECTIVE

State agencies have developed reporting systems of safety events that include events related to health information technology (HIT). These data come from hospital reporting systems where staff submit safety reports and nurses, in the role of safety managers, review, and code events. Safety managers may have varying degrees of experience with identifying events related to HIT. Our objective was to review events potentially involving HIT and compare those with what was reported to the state.

METHODS

We performed a structured review of 1 year of safety events from an academic pediatric healthcare system. We reviewed the free-text description of each event and applied a classification scheme derived from the AHRQ Health IT Hazard Manager and compared the results with events reported to the state as involving HIT.

RESULTS

Of 33,218 safety events for a 1-year period, 1247 included key words related to HIT and/or were indicated by safety managers as involving HIT. Of the 1247 events, the structured review identified 769 as involving HIT. In comparison, safety managers only identified 194 of the 769 events (25%) as involving HIT. Most events, 353 (46%), not identified by safety managers were documentation issues. Of the 1247 events, the structured review identified 478 as not involving HIT while safety managers identified and reported 81 of these 478 events (17%) as involving HIT.

CONCLUSIONS

The current process of reporting safety events lacks standardization in identifying health technology contributions to safety events, which may minimize the effectiveness of safety initiatives.

Software-related challenges in Swedish healthcare through the lens of incident reports: A desktop study

Objective

To identify a subset of software issues occurring in daily Swedish healthcare practice and devise a set of local solutions to overcome the challenges.

Methods

A sample of 46 incident reports was collected from one of Sweden's national incident reporting repositories, ranging from June 2019 to December 2021. The reports were first subjected to an algorithm to identify if they were health information technology-related incidents and were analysed using an existing framework, i.e., the Health Information Technology Classification System, to identify the software-related incidents. The incidents associated with software issues were then subjected to thematic analysis, in which themes were extracted and presented under the category assigned by the existing framework used.

Results

Of 46 reports, 45 (with one exception) were included using the algorithm. Of 45 incidents, 31 software-related incidents were identified using the classification system. Six types of software issues were identified, including software functionality (n = 10), interface with other software systems or components (n = 10), system configuration (n = 7), interface with devices (n = 2), record migration (n = 1) and increased volume of transactions (n = 1). Each issue was further categorised into different themes; for example, software interface-related problems were grouped into 'two patients being active in the system simultaneously' (n = 6) and 'transfer of patient information' (n = 4).

Conclusions

The study provided some insights into software issues and relevant consequences. A set of local solutions were devised to overcome the present challenges encountered in Swedish healthcare in their daily clinical practice. Systematic identification and characterisation of such software challenges should be a routine part of clinical practice for all major health information technology implementations.

Assessing the healthcare quality issues for digital incident reporting in Sweden: Incident reports analysis

Objective

This study explored healthcare quality issues affecting the reporting and investigation levels of digital incident reporting systems.

Methods

A total of 38 health information technology-related incident reports (free-text narratives) were collected from one of Sweden's national incident reporting repositories. The incidents were analysed using an existing framework, i.e., the Health Information Technology Classification System, to identify the types of issues and consequences. The framework was applied in two fields, 'event description' by the reporters and 'manufacturer's measures', to assess the quality of reporting incidents by the reporters. Additionally, the contributing factors, i.e., either human or technical factors for both fields, were identified to evaluate the quality of the reported incidents.

Results

Five types of issues were identified and changes made between before-and-after investigations: Machine to software-related issues (n  =  8), machine to use-related issues (n  =  5), software to software-related issues (n  =  5), use to software-related issues (n  =  4) and use to use-related issues (n  =  1). Over two-thirds (n  =  15) of the incidents demonstrated a change in the contributing factors after the investigation. Only four incidents were identified as altering the consequences after the investigation.

Conclusion

This study shed some light on the issues of incident reporting and the gap between the reporting and investigation levels. Facilitating sufficient staff training sessions, agreeing on common terms for health information technology systems, refining the existing classifications systems, enforcing mini-root cause analysis, and ensuring unit-based local reporting and standard national reporting may help bridge the gap between reporting and investigation levels in digital incident reporting.

Assessment of Clinical Information Quality in Digital Health Technologies: International eDelphi Study

BACKGROUND

Digital health technologies (DHTs), such as electronic health records and prescribing systems, are transforming health care delivery around the world. The quality of information in DHTs is key to the quality and safety of care. We developed a novel clinical information quality (CLIQ) framework to assess the quality of clinical information in DHTs.

OBJECTIVE

This study explored clinicians' perspectives on the relevance, definition, and assessment of information quality dimensions in the CLIQ framework.

METHODS

We used a systematic and iterative eDelphi approach to engage clinicians who had information governance roles or personal interest in information governance; the clinicians were recruited through purposive and snowball sampling techniques. Data were collected using semistructured online questionnaires until consensus was reached on the information quality dimensions in the CLIQ framework. Responses on the relevance of the dimensions were summarized to inform decisions on retention of the dimensions according to prespecified rules. Thematic analysis of the free-text responses was used to revise definitions and the assessment of dimensions.

RESULTS

Thirty-five clinicians from 10 countries participated in the study, which was concluded after the second round. Consensus was reached on all dimensions and categories in the CLIQ framework: informativeness (accuracy, completeness, interpretability, plausibility, provenance, and relevance), availability (accessibility, portability, security, and timeliness), and usability (conformance, consistency, and maintainability). A new dimension, searchability, was introduced in the availability category to account for the ease of finding needed information in the DHTs. Certain dimensions were renamed, and some definitions were rephrased to improve clarity.

CONCLUSIONS

The CLIQ framework reached a high expert consensus and clarity of language relating to the information quality dimensions. The framework can be used by health care managers and institutions as a pragmatic tool for identifying and forestalling information quality problems that could compromise patient safety and quality of care.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.1136/bmjopen-2021-057430.

Electronic Health Record Knowledge, Skills, and Attitudes Among Newly Graduated Nurses: A Scoping Review

Background This scoping review aimed to identify key characteristics related to electronic health record (EHR) end-user system optimization levels among graduating/newly graduated nurses. Method Using a systematic approach to conducting a scoping review, 11 articles were identified from three databases. Articles were reviewed for nursing level status, type of EHR used for research, type of assessment, and which EHR knowledge, skills, or attitudes were studied. Results The majority of the studies used a reported by evaluator approach that examined the accuracy of EHR documentation (e.g., skills). EHR knowledge was examined in two studies. No study examined EHR attitudes. Studies that reflected self-reported data mainly focused on EHR skills related to navigating, finding, utilizing, and showing and EHR knowledge gains. Conclusion Graduating/newly graduated nurses have gaps in EHR skills, knowledge, and attitudes. Simulation and EHR education are viable pedagogical approaches to building EHR end-user system optimization. [J Contin Educ Nurs. 2022;53(11):505-512.].

Acceptance of information communication technology-based health information services: Exploring the culture in primary-level health care of South Ethiopia, using Utaut Model, Ethnographic Study

Introduction

In sub-Saharan African countries including Ethiopia, the acceptance of Information Communication Technology (ICT) in health is at the proof-of-concept level with a few unsustainable piecemeal of pilot projects. Thus, a desirable willingness of acceptance among healthcare providers is a paramount.

Material and Methods

Eight months elapsed ethnographic study design was conducted using participant observation and key informant interviews. The data were entered on Qualitative Data Analysis mine software version 1.4. The quotes and field notes were thematized. The Unified Technology Acceptance and Use Theory (UTAUT) is validated and used to generate new meanings.

Results

This study highlighted the different instances of technology acceptance. Although the primary-level healthcare (PLHC) providers displayed tendencies to accept ICTs-based health information services consistent with the UTAUT dimensions such as the degree of simplicity associated with performance expectancy, use/effort expectancy, facilitating conditions, social issue, individual variation, and organization culture there are instances that disputed acceptance. For instance, the gains in data quality and reporting secondary to the use of District Health Information System Two (DHIS-II) are not influenced by acceptance. Rather PLHC providers are burnt-out of additional clerical duties of filling data on the DHIS-2. Furthermore, ICT acceptance is influenced by individual variations and the unique culture of primary level facilities such as leadership commitment.

Conclusions

On this basis, we conclude that the willingness to accept ICT-based health information services at the primary level is not limited to those factors discussed in the UTAUT model.

Issues with the Swedish e-prescribing system - An analysis of health information technology-related incident reports using an existing classification system

Objective

To identify issues with the Swedish e-prescribing system and devise a set of recommendations to overcome the identified challenges.

Methods

A number of health information technology-related incidents were collected retrospectively from various sources using purposive and snowball sampling. A search term containing five keywords was used to identify the electronic prescription-related incidents. The identified incidents (n = 24) were subjected to an existing framework, i.e., the Health Information Technology Classification System. Special attention was paid to the software-related issues, which were analysed using thematic analysis.

Results

Several types of software-related issues (n = 22) were identified: system configuration, interface with other software systems or components, software functionality, data storage and backup, record migration, software not accessible, and network/server down or slow. Both human and technical factors contributed to these incidents, including prescriptions not cancelled actively, drug handling errors, software programming errors, and system updates/upgrades. These software problems led to various consequences, such as incidents affecting multiple patients’ care management, delays in patient care, and risks of serious deterioration of health. Several temporary initiatives or administrative adjustments, for instance, cover letters to patients and local strategies, were used to overcome some of these challenges.

Conclusions

This study provides insights into the challenges related to the e-prescribing system, contributing factors, consequences, and actions taken to mitigate those risks. Therefore, healthcare organisations using the e-prescribing system should adopt the provided recommendations to minimise the risks of design and developmental challenges, implementation and use-related issues, and the problems related to monitoring, evaluation, and optimisation.

Engaging the disability community in informatics research: rationales and practical steps

As the informatics community grows in its ability to address health disparities, there is an opportunity to expand our impact by focusing on the disability community as a health disparity population. Although informaticians have primarily catered design efforts to one disability at a time, digital health technologies can be enhanced by approaching disability from a more holistic framework, simultaneously accounting for multiple forms of disability and the ways disability intersects with other forms of identity. The urgency of moving toward this more holistic approach is grounded in ethical, legal, and design-related rationales. Shaped by our research and advocacy with the disability community, we offer a set of guidelines for effective engagement. We argue that such engagement is critical to creating digital health technologies which more fully meet the needs of all disabled individuals.

Efficiency and Safety of Electronic Health Records in Switzerland-A Comparative Analysis of 2 Commercial Systems in Hospitals

OBJECTIVES

Differences in efficiency and safety between 2 electronic health record (systems A and B) in Swiss hospitals were investigated.

METHODS

In a scenario-based usability test under experimental conditions, a total of 100 physicians at 4 hospitals were asked to complete typical routine tasks, like medication or imaging orders. Differences in number of mouse clicks and time-on-task as indicators of efficiency and error type, error count, and rate as indicators of patient safety between hospital sites were analyzed. Time-on-task and clicks were correlated with error count.

RESULTS

There were differences in efficiency and safety between hospitals. Overall, physicians working with system B required less clicks (A: 511, B: 442, P = 0.001) and time (A: 2055 seconds, B: 1713 seconds, P = 0.055) and made fewer errors (A: 40%, B: 27%, P < 0.001). No participant completed all tasks correctly. The most frequent error in medication and radiology ordering was a wrong dose and a wrong level, respectively. Time errors were particularly prevalent in laboratory orders. Higher error counts coincided with longer time-on-task (r = 0.50, P < 0.001) and more clicks (r = 0.47, P < 0.001).

CONCLUSIONS

The variations in clicks, time, and errors are likely due to naive functionality and design of the systems and differences in their implementation. The high error rates coincide with inefficiency and jeopardize patient safety and produce economic costs and burden on physicians. The results raise usability concerns with potential for severe patient harm. A deeper understanding of differences as well as regulative guidelines and policy making are needed.

Interfacing With the Electronic Health Record (EHR): A Comparative Review of Modes of Documentation

Electronic health records (EHRs) have provided physicians with a systematic framework for collecting patient data, organizing notes from the healthcare team, and managing the daily workflow in the modern era of healthcare. Despite these advantages, EHRs have proven to be problematic for clinicians. The burdensome regulations requiring increased documentation with the EHR paradigm have led to inefficiencies from data-entry requirements forcing physicians to spend an inordinate amount of time on it, affecting the time available for direct patient care as well as leading to professional burnout. As a result, new modalities such as speech recognition, medical scribes, pre-made EHR templates, and digital scribes [a form of artificial intelligence (AI) based on ambient speech recognition] are increasingly being used to reduce charting time and increase the time available for patient care. The purpose of our review is to provide an up-to-date review of the literature on these modalities including their benefits and shortcomings, to help physicians and other medical professionals choose the best methods to document their patient-care encounters efficiently and effectively.

Stakeholder perspectives of system-related errors: Types, contributing factors, and consequences

BACKGROUND

Despite growing evidence of the benefits of electronic medication management systems (EMMS), research has also identified a range of new safety risks linked with their use. There is limited qualitative research focusing on system-related errors that result from use of EMMS. The aim of this study was to explore in-depth stakeholders' perceptions and experiences of system-related errors.

METHODS

Semi-structured interviews were conducted with EMMS users and other relevant staff (e.g. supporting roles in EMMS) across a local health district in Sydney, Australia. Analysis was conducted iteratively using a general inductive approach, and then mapped to Reason's accident causation model, where codes were categorized as 1) unsafe acts (i.e. what error occurred), 2) latent conditions (i.e. what factors contributed to errors), and 3) consequences resulting from the error.

RESULTS

Twenty-five participants were interviewed between September 2020 and May 2021. Participants most frequently described omission errors (e.g. failure to check for duplicate orders) as unsafe acts, although commission errors and workarounds were also reported. Poor EMMS design was reported to be a significant workplace factor contributing to system-related errors, however participants also described user factors, such as an overreliance on the system, and organizational factors, such as system downtime, as contributing to errors. Reported consequences of system-related errors included medication errors, but also impacts to the EMMS and on workers.

CONCLUSIONS

EMMS design is a significant contributor to system-related errors, but this research showed that user and organizational factors are also at play. As these factors are not independent, minimizing system-related errors requires a multi-faceted approach, where mitigation strategies target not only the EMMS, but also the context in which the system has been implemented.

Clinical information quality of digital health technologies: protocol for an international eDelphi study

INTRODUCTION

Digital health technologies (DHTs) such as electronic health records, clinical decision support systems and electronic prescribing systems are widely used in healthcare. While adoption of DHTs can improve healthcare delivery, information quality (IQ) problems associated with DHTs can compromise quality and safety of care. The clinical information quality (CLIQ) framework for digital health is a novel approach to assessing the quality of clinical information from DHTs. This study aims to appraise the CLIQ framework by exploring clinicians' perspectives on the relevance, definition and assessment of IQ dimensions as defined in the framework. This study will adapt the CLIQ framework to the needs of clinical information users-the clinicians. The contextualised CLIQ framework will offer a pragmatic approach to assessing clinical information from DHTs and may help to forestall IQ problems that can compromise quality and safety of care.

METHODS AND ANALYSIS

The electronic Delphi (eDelphi) approach will be used to engage a heterogeneous group of clinicians with patient-facing and/or information governance roles recruited through purposive and snowball sampling techniques. A semi-structured online questionnaire will be used to explore clinicians' perspectives on relevance, definition and assessment of IQ dimensions in the CLIQ framework. Survey responses on the relevance of dimensions will be summarised using descriptive statistics to inform decisions on retention of dimensions and termination of the study, based on pre-specified rules. Analysis of the free-text responses will be used to revise definition and assessment of dimensions.

ETHICS AND DISSEMINATION

Ethics approval has been obtained from the Imperial College Research Governance and Integrity Team (Imperial College Research Ethics Committee (ICREC) Reference number: 20IC6396). The results of the study will be published in a peer-reviewed journal and presented at scientific conferences.

Applying requisite imagination to safeguard electronic health record transitions

Over the next decade, many health care organizations (HCOs) will transition from one electronic health record (EHR) to another; some forced by hospital acquisition and others by choice in search of better EHRs. Herein, we apply principles of Requisite Imagination, or the ability to imagine key aspects of the future one is planning, to offer 6 recommendations on how to proactively safeguard these transitions. First, HCOs should implement a proactive leadership structure that values communication. Second, HCOs should implement proactive risk assessment and testing processes. Third, HCOs should anticipate and reduce unwarranted variation in their EHR and clinical processes. Fourth, HCOs should establish a culture of conscious inquiry with routine system monitoring. Fifth, HCOs should foresee and reduce information access problems. Sixth, HCOs should support their workforce through difficult EHR transitions. Proactive approaches using Requisite Imagination principles outlined here can help ensure safe, effective, and economically sound EHR transitions.

The biopsychosociotechnical model: a systems-based framework for human-centered health improvement

The biopsychosocial model is among the most influential frameworks for human-centered health improvement but has faced significant criticism- both conceptual and pragmatic. This paper extends and fundamentally re-structures the biopsychosocial model by combining it with sociotechnical systems theory. The resulting biopsychosociotechnical model addresses key critiques of the biopsychosocial model, providing a more "practical theory" for human-centered health improvement. It depicts the determinants of health as complex adaptive system of systems; includes the the artificial world (technology); and provides a roadmap for systems improvement by: differentiating between "health status" and "health and needs assessment", [promoting problem framing]; explaining health as an emergent property of the biopsychosociotechnical context [imposing a systems orientation]; focusing on "interventions" vs. "treatments" to modify the biopsychosociotechnical determinants of health, [expanding the solution space]; calling for a participatory design process [supporting systems awareness and goal-orientation]; and including intervention management to support the full lifecycle of health improvement.

Toward Data-Driven Radiation Oncology Using Standardized Terminology as a Starting Point: Cross-sectional Study

Background

The inability to seamlessly exchange information across radiation therapy ecosystems is a limiting factor in the pursuit of data-driven clinical practice. The implementation of semantic interoperability is a prerequisite for achieving the full capacity of the latest developments in personalized and precision medicine, such as mathematical modeling, advanced algorithmic information processing, and artificial intelligence approaches.

Objective

This study aims to evaluate the state of terminology resources (TRs) dedicated to radiation oncology as a prerequisite for an oncology semantic ecosystem. The goal of this cross-sectional analysis is to quantify the state of the art in radiation therapy specific terminology.

Methods

The Unified Medical Language System (UMLS) was searched for the following terms: radio oncology, radiation oncology, radiation therapy, and radiotherapy. We extracted 6509 unique concepts for further analysis. We conducted a quantitative analysis of available source vocabularies (SVs) and analyzed all UMLS SVs according to the route source, number, author, location of authors, license type, the lexical density of TR, and semantic types. Descriptive data are presented as numbers and percentages.

Results

The concepts were distributed across 35 SVs. The median number of unique concepts per SV was 5 (range 1-5479), with 14% (5/35) of SVs containing 94.59% (6157/6509) of the concepts. The SVs were created by 29 authors, predominantly legal entities registered in the United States (25/35, 71%), followed by international organizations (6/35, 17%), legal entities registered in Australia (2/35, 6%), and the Netherlands and the United Kingdom with 3% (1/35) of authors each. Of the total 35 SVs, 16 (46%) did not have any restrictions on use, whereas for 19 (54%) of SVs, some level of restriction was required. Overall, 57% (20/35) of SVs were updated within the last 5 years. All concepts found within radiation therapy SVs were labeled with one of the 29 semantic types represented within UMLS. After removing the stop words, the total number of words for all SVs together was 56,219, with a median of 25 unique words per SV (range 3-50,682). The total number of unique words in all SVs was 1048, with a median of 19 unique words per vocabulary (range 3-406). The lexical density for all concepts within all SVs was 0 (0.02 rounded to 2 decimals). Median lexical density per unique SV was 0.7 (range 0.0-1.0). There were no dedicated radiation therapy SVs.

Conclusions

We did not identify any dedicated TRs for radiation oncology. Current terminologies are not sufficient to cover the need of modern radiation oncology practice and research. To achieve a sufficient level of interoperability, of the creation of a new, standardized, universally accepted TR dedicated to modern radiation therapy is required.

Preliminary Exploration of Main Elements for Systematic Classification Development: Case Study of Patient Safety Incidents (Preprint)

Background

Currently, there is no holistic theoretical approach available for guiding classification development. On the basis of our recent classification development research in the area of patient safety in health information technology, this focus area would benefit from a more systematic approach. Although some valuable theoretical and methodological approaches have been presented, classification development literature typically is limited to methodological development in a specific domain or is practically oriented.

Objective

The main purposes of this study are to fill the methodological gap in classification development research by exploring possible elements of systematic development based on previous literature and to promote sustainable and well-grounded classification outcomes by identifying a set of recommended elements. Specifically, the aim is to answer the following question: what are the main elements for systematic classification development based on research evidence and our use case?

Methods

This study applied a qualitative research approach. On the basis of previous literature, preliminary elements for classification development were specified, as follows: defining a concept model, documenting the development process, incorporating multidisciplinary expertise, validating results, and maintaining the classification. The elements were compiled as guiding principles for the research process and tested in the case of patient safety incidents (n=501).

Results

The results illustrate classification development based on the chosen elements, with 4 examples of technology-induced errors. Examples from the use case regard usability, system downtime, clinical workflow, and medication section problems. The study results confirm and thus suggest that a more comprehensive and theory-based systematic approach promotes well-grounded classification work by enhancing transparency and possibilities for assessing the development process.

Conclusions

We recommend further testing the preliminary main elements presented in this study. The research presented herein could serve as a basis for future work. Our recently developed classification and the use case presented here serve as examples. Data retrieved from, for example, other type of electronic health records and use contexts could refine and validate the suggested methodological approach.

Digital technologies: An exploratory study of their role in the resilience of healthcare services

Descriptions of resilient performance in healthcare services usually emphasize the role of skills and knowledge of caregivers. At the same time, the human factors discipline often frames digital technologies as sources of brittleness. This paper presents an exploratory investigation of the upside of ten digital technologies derived from Healthcare 4.0 (H4.0) in terms of their perceived contribution to six healthcare services and the four abilities of resilient healthcare: monitor, anticipate, respond, and learn. This contribution was assessed through a multinational survey conducted with 109 experts. Emergency rooms (ERs) and intensive care units (ICUs) stood out as the most benefited by H4.0 technologies. That is consistent with the high complexity of those services, which demand resilient performance. Four H4.0 technologies were top ranked regarding their impacts on the resilience of those services. They are further explored in follow-up interviews with ER and ICU professionals from hospitals in emerging and developed economies to collect examples of applications in their routines.

Identifying Electronic Medication Administration Record (eMAR) Usability Issues from Patient Safety Event Reports

BACKGROUND

Improving our understanding of the association between medication errors and health information technology (health IT) usability has the potential to reduce errors and improve patient safety. This study used patient safety event reports (PSEs) to investigate the contribution of usability challenges associated with the electronic medication administration record (eMAR) to medication errors.

METHODS

Free-text descriptions of 849 medication-related PSEs selected from 2.3 million reports were analyzed. Coders identified the specific health IT components, usability challenge categories, and nuanced usability themes that contributed to each PSE. Thematic analysis was conducted to refine categorizations and identify emerging themes. Final analysis was limited to PSEs involving a contribution from eMAR, either as the point of origin or as a downstream contributor to error.

RESULTS

eMAR contributed to 473 PSEs. eMAR was the point of origin for 84 (17.8% of 473) PSEs. Usability challenge categories included Workflow support (n = 52, 11.0%) and Display/Visual clutter (n = 30, 6.3%). eMAR contributed downstream from the point of origin in 389 (82.2% of 473) PSEs, with errors stemming primarily from Pharmacy IT and computerized provider order entry (CPOE). Prominent secondary eMAR-associated usability challenges included Display/Visual clutter (n = 327, 69.1%) and Alerting (n = 32, 6.8%).

CONCLUSION

This study identified several eMAR usability challenges, through the analysis of PSEs, that contribute to medication errors. Findings highlight the critical need for improving the eMAR user interface. Improved interface design, better vendor usability testing, eMAR-focused certification testing, consideration of work system factors, and eMAR-focused usability and safety testing by health care facilities can improve eMAR technology and patient safety.

Empowering physicians with health information technology: An empirical investigation in Chinese hospitals

OBJECTIVE

Few studies examine physicians' use of different features of health information technology (HIT) in relation to their psychological empowerment and stress, especially in China, where many hospitals are being pushed to share digitized medical information. Further, there are mixed findings about the impact of HIT on stress, with some studies suggesting that HIT increases stress and others suggesting no effect. Hence, there is a need for a nuanced view of HITs to incorporate different features, regions, and outcomes. This work seeks to extend the existing body of knowledge on HIT by assessing the effects of basic (data-related) and advanced (clinical) HIT features on physician empowerment, stress, and ultimately, job satisfaction in Chinese hospitals.

MATERIALS AND METHODS

We surveyed 367 physicians at 5 class 3 hospitals (ie, regional hospitals that provide specialist medical and healthcare services and carry out high levels of teaching and scientific research tasks) in 5 provinces in China. We specified and estimated a structural equation model using partial least squares.

RESULTS

Physicians who used advanced features experienced improvement in all dimensions of physician empowerment and significant reduction in stress. Physicians who used basic technology, however, experienced improvement in fewer dimensions of physician empowerment and no significant change in stress. Except for efficacy, all dimensions of physician empowerment and stress predicted job satisfaction.

CONCLUSIONS

Healthcare professionals should assess the purpose of HIT features and expect different effects on intermediate and ultimate outcomes. The nuanced view of HIT features and processes leading to outcomes sheds light on their differential effects and resolves inconsistencies in prior findings on HIT effects.

Physician experiences of screen-level features in a prominent electronic health record: Design recommendations from a qualitative study

The goal of this qualitative study was to assess physicians' perceptions around features of key screens within a prominent commercial EHR, and to solicit end-user recommendations for improved retrieval of high-priority clinical information. We conducted a qualitative, descriptive study of 25 physicians in a medical ICU setting. at a tertiary academic medical center. An in-depth, semi-structured interview guide was developed to elicit physician perceptions on information retrieval as well as favorable and unfavorable features of specific EHR screens. Transcripts were independently coded in a qualitative software management tool by at least two trained coders using a common code book. We successfully obtained vendor permission to map physicians perception's on full Epic© screenshots. Among the 25 physician participants (13 female; 5 attending physicians, 9 fellows, 11 residents), the majority of participants reported experiencing challenges finding clinical information in the EHR. We present the most favorable and unfavorable screen-level features for four central EHR screens: Flowsheet, Notes/Chart Review, Results Review, and Vital Signs. We also compiled participants' recommendations for a comprehensive EHR dashboard screen to better support clinical workflow and information retrieval in the medical ICU through User-Centered Design. ICU physicians demonstrated a mix of positive and negative attitudes toward specific screen-level features in a major vendor-based EHR system. Physician perceptions of information overload emerged as a theme across multiple EHR screens. Our findings underscore the importance of qualitative research and end-user feedback in EHR software design and interface optimization at both the vendor and institutional level.

Information Quality Frameworks for Digital Health Technologies: Systematic Review

Background

Digital health technologies (DHTs) generate a large volume of information used in health care for administrative, educational, research, and clinical purposes. The clinical use of digital information for diagnostic, therapeutic, and prognostic purposes has multiple patient safety problems, some of which result from poor information quality (IQ).

Objective

This systematic review aims to synthesize an IQ framework that could be used to evaluate the extent to which digital health information is fit for clinical purposes.

Methods

The review was conducted according to the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analysis) guidelines. We searched Embase, MEDLINE, PubMed, CINAHL, Maternity and Infant Care, PsycINFO, Global Health, ProQuest Dissertations and Theses Global, Scopus, and HMIC (the Health Management Information Consortium) from inception until October 2019. Multidimensional IQ frameworks for assessing DHTs used in the clinical context by health care professionals were included. A thematic synthesis approach was used to synthesize the Clinical Information Quality (CLIQ) framework for digital health.

Results

We identified 10 existing IQ frameworks from which we developed the CLIQ framework for digital health with 13 unique dimensions: accessibility, completeness, portability, security, timeliness, accuracy, interpretability, plausibility, provenance, relevance, conformance, consistency, and maintainability, which were categorized into 3 meaningful categories: availability, informativeness, and usability.

Conclusions

This systematic review highlights the importance of the IQ of DHTs and its relevance to patient safety. The CLIQ framework for digital health will be useful in evaluating and conceptualizing IQ issues associated with digital health, thus forestalling potential patient safety problems.

Trial Registration

PROSPERO International Prospective Register of Systematic Reviews CRD42018097142; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=97142

International Registered Report Identifier (IRRID)

RR2-10.1136/bmjopen-2018-024722

Using a Semi-Structured Qualitative Interview to Evaluate Pediatric Interns' Use of the Electronic Medical Record in a Simulated Setting

Introduction

Effective use of electronic medical record (EMR) is paramount to delivering safe and effective care. Current EMR education is inadequate, with literature showing frequent deficiencies in skills needed to obtain and interpret data. This study aims to evaluate pediatric interns' perception of EMR inclusion in scenario-based simulation training.

Methods

A total of 13 pediatric interns participated in an EMR-enhanced, multidisciplinary simulation of a pediatric patient with septic shock during the 2019-2020 academic year. Following the simulation, the interns participated in a semi-structured interview to evaluate the experience of having the EMR incorporated into the simulation and what benefits it offers.

Results

Of the 13 interns, 12 (92%) felt that incorporating the EMR into the simulation increased the realism of the scenario. All (100%) interns reported that EMR inclusion led to increased learning about the EMR, including gaining or re-learning skills needed to access or interpret electronic clinical data. Participants felt that EMR inclusion in the simulation provided valuable learning opportunities not present in traditional EMR education.

Conclusions

Integrating the EMR into simulation is viewed positively by pediatric interns, is perceived to improve simulation realism, and helps teach important EMR skills. EMR training would benefit from incorporation into scenario-based simulations.

Electronic health record usability and workload changes over time for provider and nursing staff following transition to new EHR

The ubiquity of EHRs in healthcare means that small EHR inefficiencies can have a major impact on clinician workload. We conducted a sequential explanatory mixed methods study to: 1) identify EHR-associated workload and usability effects for clinicians following an EHR change over time, 2) determine workload and usability differences for providers (MD and Advance Practice Nurses) versus nurses (RNs and MAs), 3) determine if usability predicts workload, 4) identify potential sources of EHR design flaws. Workload (NASA-Task Load Index) and usability (System Usability Scale) measures were administered pre, 6-8 month and 30-32 months post-implementation. We found significant increase in perceived workload post-implementation that persisted for 2.5 years (p < .001). The workload increase was associated with usability ratings, which in turn may relate to EHR interface design violations identified by a heuristic evaluation. Our findings suggest further innovation and attention to interface design flaws are needed to improve EHR usability and reduce clinician workload.

Development of safety and usability guideline for clinical information system

Clinical information systems (CISs) that do not consider usability and safety could lead to harmful events. Therefore, we aimed to develop a safety and usability guideline of CISs that is comprehensive for both users and developers. And the guideline was categorized to apply actual clinical workflow and work environment.The guideline components were extracted through a systematic review of the articles published between 2000 and 2015, and existing CIS safety and/or usability design guidelines. The guideline components were categorized according to clinical workflow and types of user interface (UI). The contents of the guideline were evaluated and validated by experts with 3 specialties: medical informatics, patient safety, and human engineering.Total 1276 guideline components were extracted through article and guideline review. Of these, 464 guideline components were categorized according to 5 divisions of the clinical workflow: "Data identification and selection," "Document entry," "Order entry," "Clinical decision support and alert," and "Management". While 521 guideline components were categorized according to 4 divisions of UI: UIs related to information process steps, "Perception," "Recognition," "Control," and "Feedback". We developed a guideline draft with 219 detailed guidance for clinical task and 70 for UI. Overall appropriateness and comprehensiveness were proven to achieve more than 90% in experts' survey. However, there were significant differences among the groups of specialties in the judgment of appropriateness (P < .001) and comprehensiveness (P = .038).We developed and verified a safety and usability guideline for CIS that qualifies the requirements of both clinical workflows and usability issues. The developed guideline can be a practical tool to enhance the usability and safety of CISs. Further validation is required by applying the guideline for designing the actual CIS.

Going digital: a checklist in preparing for hospital-wide electronic medical record implementation and digital transformation

Objective In an era of rapid digitisation of Australian hospitals, practical guidance is needed in how to successfully implement electronic medical records (EMRs) as both a technical innovation and a major transformative change in clinical care. The aim of the present study was to develop a checklist that clearly and comprehensively defines the steps that best prepare hospitals for EMR implementation and digital transformation. Methods The checklist was developed using a formal methodological framework comprised of: literature reviews of relevant issues; an interactive workshop involving a multidisciplinary group of digital leads from Queensland hospitals; a draft document based on literature and workshop proceedings; and a review and feedback from senior clinical leads. Results The final checklist comprised 19 questions, 13 related to EMR implementation and six to digital transformation. Questions related to the former included organisational considerations (leadership, governance, change leaders, implementation plan), technical considerations (vendor choice, information technology and project management teams, system and hardware alignment with clinician workflows, interoperability with legacy systems) and training (user training, post-go-live contingency plans, roll-out sequence, staff support at point of care). Questions related to digital transformation included cultural considerations (clinically focused vision statement and communication strategy, readiness for change surveys), management of digital disruption syndromes and plans for further improvement in patient care (post-go-live optimisation of digital system, quality and benefit evaluation, ongoing digital innovation). Conclusion This evidence-based, field-tested checklist provides guidance to hospitals planning EMR implementation and separates readiness for EMR from readiness for digital transformation. What is known about the topic? Many hospitals throughout Australia have implemented, or are planning to implement, hospital wide electronic medical records (EMRs) with varying degrees of functionality. Few hospitals have implemented a complete end-to-end digital system with the ability to bring about major transformation in clinical care. Although the many challenges in implementing EMRs have been well documented, they have not been incorporated into an evidence-based, field-tested checklist that can practically assist hospitals in preparing for EMR implementation as both a technical innovation and a vehicle for major digital transformation of care. What does this paper add? This paper outlines a 19-question checklist that was developed using a formal methodological framework comprising literature review of relevant issues, proceedings from an interactive workshop involving a multidisciplinary group of digital leads from hospitals throughout Queensland, including three hospitals undertaking EMR implementation and one hospital with complete end-to-end EMR, and review of a draft checklist by senior clinical leads within a statewide digital healthcare improvement network. The checklist distinguishes between issues pertaining to EMR as a technical innovation and EMR as a vehicle for digital transformation of patient care. What are the implications for practitioners? Successful implementation of a hospital-wide EMR requires senior managers, clinical leads, information technology teams and project management teams to fully address key operational and strategic issues. Using an issues checklist may help prevent any one issue being inadvertently overlooked or underemphasised in the planning and implementation stages, and ensure the EMR is fully adopted and optimally used by clinician users in an ongoing digital transformation of care.

Human-Computer Interaction, Ethics, and Biomedical Informatics

Objectives : To provide an overview of recent work at the intersection of Biomedical Informatics, Human-Computer Interaction, and Ethics.

Methods : Search terms for Human-Computer Interaction, Biomedical Informatics, and Ethics were used to identify relevant papers published between 2017 and 2019.Relevant papers were identified through multiple methods, including database searches, manual reviews of citations, recent publications, and special collections, as well as through peer recommendations. Identified articles were reviewed and organized into broad themes.

Results : We identified relevant papers at the intersection of Biomedical Informatics, Human-Computer Interactions, and Ethics in over a dozen journals. The content of these papers was organized into three broad themes: ethical issues associated with systems in use, systems design, and responsible conduct of research.

Conclusions : The results of this overview demonstrate an active interest in exploring the ethical implications of Human-Computer Interaction concerns in Biomedical Informatics. Papers emphasizing ethical concerns associated with patient-facing tools, mobile devices, social media, privacy, inclusivity, and e-consent reflect the growing prominence of these topics in biomedical informatics research. New questions in these areas will likely continue to arise with the growth of precision medicine and citizen science.

Nurse workarounds in the electronic health record: An integrative review

OBJECTIVE

The study sought to synthesize published literature on direct care nurses' use of workarounds related to the electronic health record.

MATERIALS AND METHODS

We conducted an integrative review of qualitative and quantitative peer-reviewed research through a structured search of Academic Search Complete, EBSCO Cumulative Index of Nursing and Allied Health Literature (CINAHL), Embase, Engineering Village, Ovid Medline, Scopus, and Web of Science. We systematically applied exclusion rules at the title, abstract, and full article stages and extracted and synthesized their research methods, workaround classifications, and probable causes from articles meeting inclusion criteria.

RESULTS

Our search yielded 5221 results. After removing duplicates and applying rules, 33 results met inclusion criteria. A total of 22 articles used qualitative approaches, 10 used mixed methods, and 1 used quantitative methods. While researchers may classify workarounds differently, they generally fit 1 of 3 broad categories: omission of process steps, steps performed out of sequence, and unauthorized process steps. Each study identified probable causes, which included technology, task, organizational, patient, environmental, and usability factors.

CONCLUSIONS

Extensive study of nurse workarounds in acute settings highlights the gap in ambulatory care research. Despite decades of electronic health record development, poor usability remains a key concern for nurses and other members of care team. The widespread use of workarounds by the largest group of healthcare providers subverts quality health care at every level of the healthcare system. Research is needed to explore the gaps in our understanding of and identify strategies to reduce workaround behaviors.

A Sociotechnical Framework for Safety-Related Electronic Health Record Research Reporting: The SAFER Reporting Framework

Electronic health record (EHR)-based interventions to improve patient safety are complex and sensitive to who, what, where, why, when, and how they are delivered. Success or failure depends not only on the characteristics and behaviors of individuals who are targeted by an intervention, but also on the technical characteristics of the intervention and the culture and environment of the health system that implements it. Current reporting guidelines do not capture the complexity of sociotechnical factors (technical and nontechnical factors, such as workflow and organizational issues) that confound or influence these interventions. This article proposes a methodological reporting framework for EHR interventions targeting patient safety and builds on an 8-dimension sociotechnical model previously developed by the authors for design, development, implementation, use, and evaluation of health information technology. The Safety-related EHR Research (SAFER) Reporting Framework enables reporting of patient safety-focused EHR-based interventions while accounting for the multifaceted, dynamic sociotechnical context affecting intervention implementation, effectiveness, and generalizability. As an example, an EHR-based intervention to improve communication and timely follow-up of subcritical abnormal test results to operationalize the framework is presented. For each dimension, reporting should include what sociotechnical changes were made to implement an EHR-related intervention to improve patient safety, why the intervention did or did not lead to safety improvements, and how this intervention can be applied or exported to other health care organizations. A foundational list of research and reporting recommendations to address implementation, effectiveness, and generalizability of EHR-based interventions needed to effectively reduce preventable patient harm is provided. The SAFER Reporting Framework is not meant to replace previous research reporting guidelines, but rather provides a sociotechnical adjunct that complements their use.

Assessment of Health Information Technology-Related Outpatient Diagnostic Delays in the US Veterans Affairs Health Care System: A Qualitative Study of Aggregated Root Cause Analysis Data

IMPORTANCE

Diagnostic delay in the outpatient setting is an emerging safety priority that health information technology (HIT) should help address. However, diagnostic delays have persisted, and new safety concerns associated with the use of HIT have emerged.

OBJECTIVE

To analyze HIT-related outpatient diagnostic delays within a large, integrated health care system.

DESIGN, SETTING, AND PARTICIPANTS

This cohort study involved qualitative content analysis of safety concerns identified in aggregated root cause analysis (RCA) data related to HIT and outpatient diagnostic delays. The setting was the US Department of Veterans Affairs using all RCAs submitted to the Veterans Affairs (VA) National Center for Patient Safety from January 1, 2013, to July 31, 2018.

MAIN OUTCOMES AND MEASURES

Common themes associated with the role of HIT-related safety concerns were identified and categorized according to the Health IT Safety framework for measuring, monitoring, and improving HIT safety. This framework includes 3 related domains (ie, safe HIT, safe use of HIT, and using HIT to improve safety) situated within an 8-dimensional sociotechnical model accounting for interacting technical and nontechnical variables associated with safety. Hence, themes identified enhanced understanding of the sociotechnical context and domain of HIT safety involved.

RESULTS

Of 214 RCAs categorized by the terms delay and outpatient submitted during the study period, 88 were identified as involving diagnostic delays and HIT, from which 172 unique HIT-related safety concerns were extracted (mean [SD], 1.97 [1.53] per RCA). Most safety concerns (82.6% [142 of 172]) involved problems with safe use of HIT, predominantly sociotechnical factors associated with people, workflow and communication, and a poorly designed human-computer interface. Fewer safety concerns involved problems with safe HIT (14.5% [25 of 172]) or using HIT to improve safety (0.3% [5 of 172]). The following 5 key high-risk areas for diagnostic delays emerged: managing electronic health record inbox notifications and communication, clinicians gathering key diagnostic information, technical problems, data entry problems, and failure of a system to track test results.

CONCLUSIONS AND RELEVANCE

This qualitative study of a national RCA data set suggests that interventions to reduce outpatient diagnostic delays could aim to improve test result management, interoperability, data visualization, and order entry, as well as to decrease information overload.

Patient Safety Culture, Health Information Technology Implementation, and Medical Office Problems That Could Lead to Diagnostic Error

BACKGROUND

Diagnostic errors may cause harm to patients by preventing or delaying appropriate treatment or by leading to unnecessary or harmful treatment.

OBJECTIVES

The aim of the study was to investigate the relationship between patient safety culture, health information technology (IT) implementation, and the frequency of problems that could lead to diagnostic errors in the medical office setting, such as unavailable test results, unavailable medical records, or unpursued abnormal results.

METHODS

We used survey data from 925 medical offices nationwide that voluntarily submitted results to the 2012 Agency for Healthcare Research and Quality Medical Office Surveys on Patient Safety Culture database. At the office level, we ran a multivariate regression model to estimate the effect of culture on problem frequency while controlling for office-reported implementation levels of health IT, office characteristics such as the number of locations, and survey characteristics such as the percent of respondents that were physicians.

RESULTS

The most frequent problem was "results from a lab or imaging test were not available when needed"; across 925 offices, the average was 15% reporting that it happened daily or weekly. Higher overall culture scores were significantly associated with fewer occurrences of each problem assessed. Compared with offices with completed health IT implementation, offices in the process of health IT implementation had higher frequency of problems.

CONCLUSIONS

This study offers insight into how patient safety culture and health IT implementation in medical offices can influence the frequency of breakdowns in processes of care, thereby identifying potential vulnerabilities that can increase diagnostic errors.

Electronic Health Record-Related Events in Medical Malpractice Claims

Background

There is widespread agreement that the full potential of health information technology (health IT) has not yet been realized and of particular concern are the examples of unintended consequences of health IT that detract from the safety of health care or from the use of health IT itself. The goal of this project was to obtain additional information on these health IT–related problems, using a mixed methods (qualitative and quantitative) analysis of electronic health record–related harm in cases submitted to a large database of malpractice suits and claims.

Methods

Cases submitted to the CRICO claims database and coded during 2012 and 2013 were analyzed. A total of 248 cases (<1%) involving health IT were identified and coded using a proprietary taxonomy that identifies user- and system-related sociotechnical factors. Ambulatory care accounted for most of the cases (146 cases). Cases were most typically filed as a result of an error involving medications (31%), diagnosis (28%), or a complication of treatment (31%). More than 80% of cases involved moderate or severe harm, although lethal cases were less likely in cases from ambulatory settings. Etiologic factors spanned all of the sociotechnical dimensions, and many recurring patterns of error were identified.

Conclusions

Adverse events associated with health IT vulnerabilities can cause extensive harm and are encountered across the continuum of health care settings and sociotechnical factors. The recurring patterns provide valuable lessons that both practicing clinicians and health IT developers could use to reduce the risk of harm in the future. The likelihood of harm seems to relate more to a patient's particular situation than to any one class of error.

Failure to Rescue Event Mitigation System Assessment: A Mixed-methods Approach to Analysis of Complex Adaptive Systems

Although it is widely acknowledged that health care delivery systems are complex adaptive systems, there are gaps in understanding the application of systems engineering approaches to systems analysis and redesign in the health care domain. Commonly employed methods, such as statistical analysis of risk factors and outcomes, are simply not adequate to robustly characterize all system requirements and facilitate reliable design of complex care delivery systems. This is especially apparent in institutional-level systems, such as patient safety programs that must mitigate the risk of infections and other complications that can occur in virtually any setting providing direct and indirect patient care. The case example presented here illustrates the application of various system engineering methods to identify requirements and intervention candidates for a critical patient safety problem known as failure to rescue. Detailed descriptions of the analysis methods and their application are presented along with specific analysis artifacts related to the failure to rescue case study. Given the prevalence of complex systems in health care, this practical and effective approach provides an important example of how systems engineering methods can effectively address the shortcomings in current health care analysis and design, where complex systems are increasingly prevalent.

Real-Time Automated Hazard Detection Framework for Health Information Technology Systems

An increase in the reliability of Health Information Technology (HIT) will facilitate institutional trust and credibility of the systems. In this paper, we present an end-to-end framework for improving the reliability and performance of HIT systems. Specifically, we describe the system model, present some of the methods that drive the model, and discuss an initial implementation of two of the proposed methods using data from the Veterans Affairs HIT and Corporate Data Warehouse systems. The contributions of this paper, thus, include (1) the design of a system model for monitoring and detecting hazards in HIT systems, (2) a data-driven approach for analysing the health care data warehouse, (3) analytical methods for characterising and analysing failures in HIT systems, and (4) a tool architecture for generating and reporting hazards in HIT systems. Our goal is to work towards an automated system that will help identify opportunities for improvements in HIT systems.

Communication and patient safety in gynecology and obstetrics - study protocol of an intervention study

Background

Patient safety is a key target in public health, health services and medicine. Communication between all parties involved in gynecology and obstetrics (clinical staff/professionals, expectant mothers/patients and their partners, close relatives or friends providing social support) should be improved to ensure patient safety, including the avoidance of preventable adverse events (pAEs). Therefore, interventions including an app will be developed in this project through a participatory approach integrating two theoretical models. The interventions will be designed to support participants in their communication with each other and to overcome difficulties in everyday hospital life. The aim is to foster effective communication in order to reduce the frequency of pAEs. If communication is improved, clinical staff should show an increase in work satisfaction and patients should show an increase in patient satisfaction.

Methods

The study will take place in two maternity clinics in Germany. In line with previous studies of complex interventions, it is divided into three interdependent phases. Each phase provides its own methods and data. Phase 1: Needs assessment and a training for staff (n = 140) tested in a pre-experimental study with a pre/post-design. Phase 2: Assessment of communication training for patients and their social support providers (n = 423) in a randomized controlled study. Phase 3: Assessment of an app supporting the communication between staff, patients, and their social support providers (n = 423) in a case-control study. The primary outcome is improvement of communication competencies. A range of other implementation outcomes will also be assessed (i.e. pAEs, patient/treatment satisfaction, work satisfaction, safety culture, training-related outcomes).

Discussion

This is the first large intervention study on communication and patient safety in gynecology and obstetrics integrating two theoretical models that have not been applied to this setting. It is expected that the interventions, including the app, will improve communication practice which is linked to a lower probability of pAEs. The app will offer an effective and inexpensive way to promote effective communication independent of users’ motivation. Insights gained from this study can inform other patient safety interventions and health policy developments.

Trial registration

ClinicalTrials.gov Identifier: NCT03855735; date of registration: February 27, 2019.

Unintended adverse consequences of a clinical decision support system: two cases

Many institutions have implemented clinical decision support systems (CDSSs). While CDSS research papers have focused on benefits of these systems, there is a smaller body of literature showing that CDSSs may also produce unintended adverse consequences (UACs). Detailed here are 2 cases of UACs resulting from a CDSS. Both of these cases were related to external systems that fed data into the CDSS. In the first case, lack of knowledge of data categorization in an external pharmacy system produced a UAC; in the second case, the change of a clinical laboratory instrument produced the UAC. CDSSs rely on data from many external systems. These systems are dynamic and may have changes in hardware, software, vendors, or processes. Such changes can affect the accuracy of CDSSs. These cases point to the need for the CDSS team to be familiar with these external systems. This team (manager and alert builders) should include members in specific clinical specialties with deep knowledge of these external systems.

Variation in Physicians' Electronic Health Record Documentation and Potential Patient Harm from That Variation

BACKGROUND

Physician-to-physician variation in electronic health record (EHR) documentation not driven by patients' clinical status could be harmful.

OBJECTIVE

Measure variation in completion of common clinical documentation domains. Identify perceived causes and effects of variation and strategies to mitigate negative effects.

DESIGN

Sequential, explanatory, mixed methods using log data from a commercial EHR vendor and semi-structured interviews with outpatient primary care practices.

PARTICIPANTS

Quantitative: 170,332 encounters led by 809 physicians in 237 practices. Qualitative: 40 interviewees in 10 practices.

MAIN MEASURES

Interquartile range (IQR) of the proportion of encounters in which a physician completed documentation, for each documentation category. Multilevel linear regression measured the proportion of variation at the physician level.

KEY RESULTS

Five clinical documentation categories had substantial and statistically significant (p < 0.001) variation at the physician level after accounting for state, organization, and practice levels: (1) discussing results (IQR = 50.8%, proportion of variation explained by physician level = 78.1%); (2) assessment and diagnosis (IQR = 60.4%, physician-level variation = 76.0%); (3) problem list (IQR = 73.1%, physician-level variation = 70.1%); (4) review of systems (IQR = 62.3%, physician-level variation = 67.7%); and (5) social history (IQR = 53.3%, physician-level variation = 62.2%). Drivers of variation from interviews included user preferences and EHR designs with multiple places to record similar information. Variation was perceived to create documentation inefficiencies and risk patient harm due to missed or misinterpreted information. Mitigation strategies included targeted user training during EHR implementation and practice meetings focused on documentation standardization.

CONCLUSIONS

Physician-to-physician variation in EHR documentation impedes effective and safe use of EHRs, but there are potential strategies to mitigate negative consequences.

Oncologists' Views Regarding the Role of Electronic Health Records in Care Coordination

BACKGROUND

Electronic health records (EHRs) play a significant role in complex health care processes, especially in information transfer with patients and care coordination among providers. EHRs may also generate unintended consequences, introducing new patient safety risks. To date, little investigation has been performed in oncology settings, despite the need for quality provider-patient communication and information transfer during oncology visits. In this qualitative study, we focused on oncology providers' perceptions of EHRs for supporting communication with patients and coordination of care with other providers.

METHODS

We conducted semistructured interviews with oncologists from an urban academic medical center to learn their perceptions of the use of EHRs before, during, and after clinic visits with patients. Our interview guide was developed on the basis of the work system model. We coded transcripts using inductive content analysis.

RESULTS

Data analysis yielded four main themes regarding oncologists' practices in using the EHR and perceptions about EHRs: (1) EHR use for care coordination (eg, timeliness of receiving information, SmartSet documentation); (2) EHR use in the clinic visit (eg, educating patients, using as a reinforcement tool); (3) safety hazards in care coordination associated with EHRs (eg, incomplete documentation, error propagating, no filtering mechanism to capture errors); and (4) suggestions for improvements (eg, improved SmartSet functionalities, simplification of user interface).

CONCLUSION

Current EHRs do not adequately support teamwork of oncology providers, which could lead to potential hazards in the care of patients with cancer. Redesigning EHR features that are tailored to support oncology care and addressing the concerns regarding information overload, improved organization of flagging abnormal results, and documentation-related workload are needed to minimize potential safety hazards.