Human-centered development of an electronic health record-embedded, interactive information visualization in the emergency department using fast healthcare interoperability resources

The role of information systems in emergency department decision-making-a literature review

OBJECTIVES

Healthcare providers employ heuristic and analytical decision-making to navigate the high-stakes environment of the emergency department (ED). Despite the increasing integration of information systems (ISs), research on their efficacy is conflicting. Drawing on related fields, we investigate how timing and mode of delivery influence IS effectiveness. Our objective is to reconcile previous contradictory findings, shedding light on optimal IS design in the ED.

MATERIALS AND METHODS

We conducted a systematic review following PRISMA across PubMed, Scopus, and Web of Science. We coded the ISs' timing as heuristic or analytical, their mode of delivery as active for automatic alerts and passive when requiring user-initiated information retrieval, and their effect on process, economic, and clinical outcomes.

RESULTS

Our analysis included 83 studies. During early heuristic decision-making, most active interventions were ineffective, while passive interventions generally improved outcomes. In the analytical phase, the effects were reversed. Passive interventions that facilitate information extraction consistently improved outcomes.

DISCUSSION

Our findings suggest that the effectiveness of active interventions negatively correlates with the amount of information received during delivery. During early heuristic decision-making, when information overload is high, physicians are unresponsive to alerts and proactively consult passive resources. In the later analytical phases, physicians show increased receptivity to alerts due to decreased diagnostic uncertainty and information quantity. Interventions that limit information lead to positive outcomes, supporting our interpretation.

CONCLUSION

We synthesize our findings into an integrated model that reveals the underlying reasons for conflicting findings from previous reviews and can guide practitioners in designing ISs in the ED.

Visual Analytics for Data-Driven Understanding of the Substance Use Disorder Epidemic

The substance use disorder epidemic has emerged as a serious public health crisis, presenting complex challenges. Visual analytics offers a unique approach to address this complexity and facilitate effective interventions. This paper details the development of an innovative visual analytics dashboard, aimed at enhancing our understanding of the substance use disorder epidemic. By employing record linkage techniques, we integrate diverse data sources to provide a comprehensive view of the epidemic. Adherence to responsive, open, and user-centered design principles ensures the dashboard's usefulness and usability. Our approach to data and design encourages collaboration among various stakeholders, including researchers, politicians, and healthcare practitioners. Through illustrative outputs, we demonstrate how the dashboard can deepen our understanding of the epidemic, support intervention strategies, and evaluate the effectiveness of implemented measures. The paper concludes with a discussion of the dashboard's use cases and limitations.

Machine Learning-Enabled Clinical Information Systems Using Fast Healthcare Interoperability Resources Data Standards: Scoping Review

Background

Machine learning-enabled clinical information systems (ML-CISs) have the potential to drive health care delivery and research. The Fast Healthcare Interoperability Resources (FHIR) data standard has been increasingly applied in developing these systems. However, methods for applying FHIR to ML-CISs are variable.

Objective

This study evaluates and compares the functionalities, strengths, and weaknesses of existing systems and proposes guidelines for optimizing future work with ML-CISs.

Methods

Embase, PubMed, and Web of Science were searched for articles describing machine learning systems that were used for clinical data analytics or decision support in compliance with FHIR standards. Information regarding each system's functionality, data sources, formats, security, performance, resource requirements, scalability, strengths, and limitations was compared across systems.

Results

A total of 39 articles describing FHIR-based ML-CISs were divided into the following three categories according to their primary focus: clinical decision support systems (n=18), data management and analytic platforms (n=10), or auxiliary modules and application programming interfaces (n=11). Model strengths included novel use of cloud systems, Bayesian networks, visualization strategies, and techniques for translating unstructured or free-text data to FHIR frameworks. Many intelligent systems lacked electronic health record interoperability and externally validated evidence of clinical efficacy.

Conclusions

Shortcomings in current ML-CISs can be addressed by incorporating modular and interoperable data management, analytic platforms, secure interinstitutional data exchange, and application programming interfaces with adequate scalability to support both real-time and prospective clinical applications that use electronic health record platforms with diverse implementations.

Designing Interoperable Health Care Services Based on Fast Healthcare Interoperability Resources: Literature Review

BACKGROUND

With the advent of the digital economy and the aging population, the demand for diversified health care services and innovative care delivery models has been overwhelming. This trend has accelerated the urgency to implement effective and efficient data exchange and service interoperability, which underpins coordinated care services among tiered health care institutions, improves the quality of oversight of regulators, and provides vast and comprehensive data collection to support clinical medicine and health economics research, thus improving the overall service quality and patient satisfaction. To meet this demand and facilitate the interoperability of IT systems of stakeholders, after years of preparation, Health Level 7 formally introduced, in 2014, the Fast Healthcare Interoperability Resources (FHIR) standard. It has since continued to evolve. FHIR depends on the Implementation Guide (IG) to ensure feasibility and consistency while developing an interoperable health care service. The IG defines rules with associated documentation on how FHIR resources are used to tackle a particular problem. However, a gap remains between IGs and the process of building actual services because IGs are rules without specifying concrete methods, procedures, or tools. Thus, stakeholders may feel it nontrivial to participate in the ecosystem, giving rise to the need for a more actionable practice guideline (PG) for promoting FHIR's fast adoption.

OBJECTIVE

This study aimed to propose a general FHIR PG to facilitate stakeholders in the health care ecosystem to understand FHIR and quickly develop interoperable health care services.

METHODS

We selected a collection of FHIR-related papers about the latest studies or use cases on designing and building FHIR-based interoperable health care services and tagged each use case as belonging to 1 of the 3 dominant innovation feature groups that are also associated with practice stages, that is, data standardization, data management, and data integration. Next, we reviewed each group's detailed process and key techniques to build respective care services and collate a complete FHIR PG. Finally, as an example, we arbitrarily selected a use case outside the scope of the reviewed papers and mapped it back to the FHIR PG to demonstrate the effectiveness and generalizability of the PG.

RESULTS

The FHIR PG includes 2 core elements: one is a practice design that defines the responsibilities of stakeholders and outlines the complete procedure from data to services, and the other is a development architecture for practice design, which lists the available tools for each practice step and provides direct and actionable recommendations.

CONCLUSIONS

The FHIR PG can bridge the gap between IGs and the process of building actual services by proposing actionable methods, procedures, and tools. It assists stakeholders in identifying participants' roles, managing the scope of responsibilities, and developing relevant modules, thus helping promote FHIR-based interoperable health care services.

Combined Expert and User-Driven Usability Assessment of Trauma Decision Support Systems Improves User-Centered Design

BACKGROUND

Trauma clinical decision support systems improve adherence with evidence-based practice but suffer from poor usability and the lack of a user-centered design. The objective of this study was to compare the effectiveness of user and expert-driven usability testing methods to detect usability issues in a rib fracture clinical decision support system and identify guiding principles for trauma clinical decision support systems.

METHODS

A user-driven and expert-driven usability investigation was conducted using a clinical decision support system developed for patients with rib fractures. The user-driven usability evaluation was as follows: 10 clinicians were selected for simulation-based usability testing using snowball sampling, and each clinician completed 3 simulations using a video-conferencing platform. End-users participated in a novel team-based approach that simulated realistic clinical workflows. The expert-driven heuristic evaluation was as follows: 2 usability experts conducted a heuristic evaluation of the clinical decision support system using 10 common usability heuristics. Usability issues were identified, cataloged, and ranked for severity using a 4-level ordinal scale. Thematic analysis was utilized to categorize the identified usability issues.

RESULTS

Seventy-nine usability issues were identified; 63% were identified by experts and 48% by end-users. Notably, 58% of severe usability issues were identified by experts alone. Only 11% of issues were identified by both methods. Five themes were identified that could guide the design of clinical decision support systems-transparency, functionality and integration into workflow, automated and noninterruptive, flexibility, and layout and appearance. Themes were preferentially identified by different methods.

CONCLUSION

We found that a dual-method usability evaluation involving usability experts and end-users drastically improved detection of usability issues over single-method alone. We identified 5 themes to guide trauma clinical decision support system design. Performing usability testing via a remote video-conferencing platform facilitated multi-site involvement despite a global pandemic.

Electronic Health Record-Embedded, Behavioral Science-Informed System for Smoking Cessation for the Parents of Pediatric Patients

BACKGROUND

 Helping parents quit smoking is a public health priority. However, parents are rarely, if ever, offered tobacco use treatment through pediatric settings. Clinical decision support (CDS) systems developed for the workflows of pediatric primary care may support consistent screening, treatment, and referral.

OBJECTIVES

 This study aimed to develop a CDS system by using human-centered design (HCD) that identifies parents who smoke, provides motivational messages to quit smoking (informed by behavioral science), and supports delivery of evidence-based tobacco treatment.

METHODS

 Our multidisciplinary team applied a rigorous HCD process involving analysis of the work environment, user involvement in formative design, iterative improvements, and evaluation of the system's use in context with the following three cohorts: (1) parents who smoke, (2) pediatric clinicians, and (3) clinic staff. Participants from each cohort were presented with scenario-based, high-fidelity mockups of system components and then provided input related to their role in using the CDS system.

RESULTS

 We engaged 70 representative participants including 30 parents, 30 clinicians, and 10 clinic staff. A key theme of the design review sessions across all cohorts was the need to automate functions of the system. Parents emphasized a system that presented information in a simple way, highlighted benefits of quitting smoking, and allowed direct connection to treatment. Pediatric clinicians emphasized automating tobacco treatment. Clinical staff emphasized screening for parent smoking via several modalities prior to the patient's visit. Once the system was developed, most parents (80%) reported that it was easy to use, and the majority of pediatricians reported that they would use the system (97%) and were satisfied with it (97%).

CONCLUSION

 A CDS system to support parental tobacco cessation in pediatric primary care, developed through an HCD process, proved easy to use and acceptable to parents, clinicians, and office staff. This preliminary work justifies evaluating the impact of the system on helping parents quit smoking.