Bridging Communication Gaps Between Radiologists, Referring Physicians, and Patients Through Standardized Structured Cancer Imaging Reporting: The Experience with Female Pelvic MRI Assessment Using O-RADS and a Simulated Cohort Patient Group

RATIONALE AND OBJECTIVES

This study aimed to evaluate whether implementing structured reporting based on Ovarian-Adnexal Reporting and Data System (O-RADS) magnetic resonance imaging (MRI) in women with sonographically indeterminate adnexal masses improves communication between radiologists, referrers, and patients/caregivers and enhances diagnostic performance for determining adnexal malignancy.

MATERIALS AND METHODS

We retrospectively analyzed prospectively issued MRI reports in 2019-2022 performed for characterizing adnexal masses before and after implementing O-RADS MRI; 56 patients/caregivers and nine gynecologic oncologists ("referrers") were surveyed about report interpretability/clarity/satisfaction; responses for pre- and post-implementation reports were compared using Fisher's exact and Chi-squared tests. Diagnostic performance was assessed using receiver operating characteristic curves.

RESULTS

A total of 123 reports from before and 119 reports from after O-RADS MRI implementation were included. Survey response rates were 35.7% (20/56) for patients/caregivers and 66.7% (6/9) for referrers. For patients/caregivers, O-RADS MRI reports were clearer (p < 0.001) and more satisfactory (p < 0.001) than unstructured reports, but interpretability did not differ significantly (p = 0.14), as 28.0% (28/100) of postimplementation and 38.0% (38/100) of preimplementation reports were considered difficult to interpret. For referrers, O-RADS MRI reports were clearer, more satisfactory, and easier to interpret (p < 0.001); only 1.3% (1/77) were considered difficult to interpret. For differentiating benign from malignant adnexal lesions, O-RADS MRI showed area under the curve of 0.92 (95% confidence interval [CI], 0.85-0.99), sensitivity of 0.81 (95% CI, 0.58-0.95), and specificity of 0.91 (95% CI, 0.83-0.96). Diagnostic performance of reports before implementation could not be calculated due to many different phrases used to describe the likelihood of malignancy.

CONCLUSION

Implementing standardized structured reporting using O-RADS MRI for characterizing adnexal masses improved clarity and satisfaction for patients/caregivers and referrers. Interpretability improved for referrers but remained limited for patients/caregivers.

Older Adult Patients and Care Partners as Knowledge Brokers in Fragmented Health Care

OBJECTIVE

To describe older adult patients' and care partners' knowledge broker roles during emergency department (ED) visits.

BACKGROUND

Older adult patients are vulnerable to communication and coordination challenges during an ED visit, which can be exacerbated by the time and resource constrained ED environment. Yet, as a constant throughout the patient journey, patients and care partners can act as an information conduit, or knowledge broker, between fragmented care systems to attain high-quality, safe care.

METHODS

Participants included 14 older adult patients (≥ 65 years old) and their care partners (e.g., spouse, adult child) who presented to the ED after having experienced a fall. Human factors researchers collected observation data from patients, care partners and clinician interactions during the patient's ED visit. We used an inductive content analysis to determine the role of patients and care partners as knowledge brokers.

RESULTS

We found that patients and care partners act as knowledge brokers by providing information about diagnostic testing, medications, the patient's health history, and care accommodations at the disposition location. Patients and care partners filled the role of knowledge broker proactively (i.e. offer information) and reactively (i.e. are asked to provide information by clinicians or staff), within-ED work system and across work systems (e.g., between the ED and hospital), and in anticipation of future knowledge brokering.

CONCLUSION

Patients and care partners, acting as knowledge brokers, often fill gaps in communication and participate in care coordination that assists in mitigating health care fragmentation.

Usability of a Human Factors-based Clinical Decision Support in the Emergency Department: Lessons Learned for Design and Implementation

OBJECTIVE

To evaluate the usability and use of human factors (HF)-based clinical decision support (CDS) implemented in the emergency department (ED).

BACKGROUND

Clinical decision support can improve patient safety; however, the acceptance and use of CDS has faced challenges. Following a human-centered design process, we designed a CDS to support pulmonary embolism (PE) diagnosis in the ED. We demonstrated high usability of the CDS during scenario-based usability testing. We implemented the HF-based CDS in one ED in December 2018.

METHOD

We conducted a survey of ED physicians to evaluate the usability and use of the HF-based CDS. We distributed the survey via Qualtrics, a web-based survey platform. We compared the computer system usability questionnaire scores of the CDS between those collected in the usability testing to use of the CDS in the real environment. We asked physicians about their acceptance and use of the CDS, barriers to using the CDS, and areas for improvement.

RESULTS

Forty-seven physicians (56%) completed the survey. Physicians agreed that diagnosing PE is a major problem and risk scores can support the PE diagnostic process. Usability of the CDS was reported as high, both in the experimental setting and the real clinical setting. However, use of the CDS was low. We identified several barriers to the CDS use in the clinical environment, in particular a lack of workflow integration.

CONCLUSION

Design of CDS should be a continuous process and focus on the technology's usability in the context of the broad work system and clinician workflow.

Team Cognition in Handoffs: Relating System Factors, Team Cognition Functions and Outcomes in Two Handoff Processes

OBJECTIVE

This study investigates how team cognition occurs in care transitions from operating room (OR) to intensive care unit (ICU). We then seek to understand how the sociotechnical system and team cognition are related.

BACKGROUND

Effective handoffs are critical to ensuring patient safety and have been the subject of many improvement efforts. However, the types of team-level cognitive processing during handoffs have not been explored, nor is it clear how the sociotechnical system shapes team cognition.

METHOD

We conducted this study in an academic, Level 1 trauma center in the Midwestern United States. Twenty-eight physicians (surgery, anesthesia, pediatric critical care) and nurses (OR, ICU) participated in semi-structured interviews. We performed qualitative content analysis and epistemic network analysis to understand the relationships between system factors, team cognition in handoffs and outcomes.

RESULTS

Participants described three team cognition functions in handoffs-(1) information exchange, (2) assessment, and (3) planning and decision making; information exchange was mentioned most. Work system factors influenced team cognition. Inter-professional handoffs facilitated information exchange but included large teams with diverse backgrounds communicating, which can be inefficient. Intra-professional handoffs decreased team size and role diversity, which may simplify communication but increase information loss. Participants in inter-professional handoffs reflected on outcomes significantly more in relation to system factors and team cognition (p < 0.001), while participants in intra-professional handoffs discussed handoffs as a task.

CONCLUSION

Handoffs include team cognition, which was influenced by work system design. Opportunities for handoff improvement include a flexibly standardized process and supportive tools/technologies. We recommend incorporating perspectives of the patient and family in future work.

Work system barriers and facilitators of a team health information technology

Designing health IT aimed at supporting team-based care and improving patient safety is difficult. This requires a work system (i.e., SEIPS) evaluation of the technology by care team members. This study aimed to identify work system barriers and facilitators to the use of a team health IT that supports care transitions for pediatric trauma patients. We conducted an analysis on 36 interviews - representing 12 roles - collected from a scenario-based evaluation of T3. We identified eight dimensions with both barriers and facilitators in all five work system elements: person (experience), task (task performance, workload/efficiency), technology (usability, specific features of T3), environment (space, location), and organization (communication/coordination). Designing technology that meets every role's needs is challenging; in particular, when trade-offs need to be managed, e.g., additional workload for one role or divergent perspectives regarding specific features. Our results confirm the usefulness of a continuous work system approach to technology design and implementation.

Satisfaction of Older Patients With Emergency Department Care: Psychometric Properties and Construct Validity of the Consumer Emergency Care Satisfaction Scale

BACKGROUND

Patient satisfaction is an important indicator of quality of care, but its measurement remains challenging. The Consumer Emergency Care Satisfaction Scale (CECSS) was developed to measure patient satisfaction in the emergency department (ED). Although this is a valid and reliable tool, several aspects of the CECSS need to be improved, including the definition, dimension, and scoring of scales.

PURPOSE

The purpose of this study was to examine the construct validity of the CECSS and make suggestions on how to improve the tool to measure overall satisfaction with ED care.

METHODS

We administered 2 surveys to older adults who presented with a fall to the ED and used electronic health record data to examine construct validity of the CECSS and ceiling effects.

RESULTS

Using several criteria, we improved construct validity of the CECSS, reduced ceiling effects, and standardized scoring.

CONCLUSION

We addressed several methodological issues with the CECSS and provided recommendations for improvement.

Evaluating the Usability of an Emergency Department After Visit Summary: Staged Heuristic Evaluation

BACKGROUND

Heuristic evaluations, while commonly used, may inadequately capture the severity of identified usability issues. In the domain of health care, usability issues can pose different levels of risk to patients. Incorporating diverse expertise (eg, clinical and patient) in the heuristic evaluation process can help assess and address potential negative impacts on patient safety that may otherwise go unnoticed. One document that should be highly usable for patients-with the potential to prevent adverse outcomes-is the after visit summary (AVS). The AVS is the document given to a patient upon discharge from the emergency department (ED), which contains instructions on how to manage symptoms, medications, and follow-up care.

OBJECTIVE

This study aims to assess a multistage method for integrating diverse expertise (ie, clinical, an older adult care partner, and health IT) with human factors engineering (HFE) expertise in the usability evaluation of the patient-facing ED AVS.

METHODS

We conducted a three-staged heuristic evaluation of an ED AVS using heuristics developed for use in evaluating patient-facing documentation. In stage 1, HFE experts reviewed the AVS to identify usability issues. In stage 2, 6 experts of varying expertise (ie, emergency medicine physicians, ED nurses, geriatricians, transitional care nurses, and an older adult care partner) rated each previously identified usability issue on its potential impact on patient comprehension and patient safety. Finally, in stage 3, an IT expert reviewed each usability issue to identify the likelihood of successfully addressing the issue.

RESULTS

In stage 1, we identified 60 usability issues that violated a total of 108 heuristics. In stage 2, 18 additional usability issues that violated 27 heuristics were identified by the study experts. Impact ratings ranged from all experts rating the issue as "no impact" to 5 out of 6 experts rating the issue as having a "large negative impact." On average, the older adult care partner representative rated usability issues as being more significant more of the time. In stage 3, 31 usability issues were rated by an IT professional as "impossible to address," 21 as "maybe," and 24 as "can be addressed."

CONCLUSIONS

Integrating diverse expertise when evaluating usability is important when patient safety is at stake. The non-HFE experts, included in stage 2 of our evaluation, identified 23% (18/78) of all the usability issues and, depending on their expertise, rated those issues as having differing impacts on patient comprehension and safety. Our findings suggest that, to conduct a comprehensive heuristic evaluation, expertise from all the contexts in which the AVS is used must be considered. Combining those findings with ratings from an IT expert, usability issues can be strategically addressed through redesign. Thus, a 3-staged heuristic evaluation method offers a framework for integrating context-specific expertise efficiently, while providing practical insights to guide human-centered design.

Managing multiple perspectives in the collaborative design process of a team health information technology

We need to design technologies that support the work of health care teams; designing such solutions should integrate different clinical roles. However, we know little about the actual collaboration that occurs in the design process for a team-based care solution. This study examines how multiple perspectives were managed in the design of a team health IT solution aimed at supporting clinician information needs during pediatric trauma care transitions. We focused our analysis on four co-design sessions that involved multiple clinicians caring for pediatric trauma patients. We analyzed design session transcripts using content analysis and process coding guided by Détienne's (2006) co-design framework. We expanded upon Détienne (2006) three collaborative activities to identify specific themes and processes of collaboration between care team members engaged in the design process. The themes and processes describe how team members collaborated in a team health IT design process that resulted in a highly usable technology.

A Sociotechnical Systems Framework for the Application of Artificial Intelligence in Health Care Delivery

In the coming years, artificial intelligence (AI) will pervade almost every aspect of the health care delivery system. AI has the potential to improve patient safety (e.g. diagnostic accuracy) as well as reduce the burden on clinicians (e.g. documentation-related workload); however, these benefits are yet to be realized. AI is only one element of a larger sociotechnical system that needs to be considered for effective AI application. In this paper, we describe the current challenges of integrating AI into clinical care and propose a sociotechnical systems (STS) approach for AI design and implementation. We demonstrate the importance of an STS approach through a case study on the design and implementation of a clinical decision support (CDS). In order for AI to reach its potential, the entire work system as well as clinical workflow must be systematically considered throughout the design of AI technology.

A cross-sector systematic review and synthesis of knowledge on telemedicine interventions in chronic wound management-Implications from a system perspective

Based on initially identified needs for further telemedicine (TM) and chronic wound management research, the objective of this article is twofold: to conduct a systematic review of existing knowledge on TM interventions in chronic wound management-including barriers and opportunities-across the specialist and primary care sectors, and to incorporate the review findings into a system framework that can be further developed and validated through empirical data. We conclude that there is a pressing need for broader and more comprehensive empirical explorations into quality improvement and integration of TM in chronic wound management, including using system frameworks that can capture cross-sector system perspectives and associated implications. Of practical consideration, we suggest that the design and execution of TM improvement interventions and associated research projects should be conducted in close cooperation with managers and practitioners knowledgeable about barriers and opportunities that can influence the implementation of important interventions within chronic wound management.

A Systematic Review of the Consumer Emergency Care Satisfaction Scale (CECSS)

BACKGROUND

Patient experience is receiving increasing attention in the context of patient-centered care. However, there are relatively few instruments that measure patient experience that are valid and reliable.

OBJECTIVE

In this study, we systematically review the literature on the Consumer Emergency Care Satisfaction Scale (CECSS) and examine its psychometric properties.

METHODS

We conducted a systematic literature search in the Cumulative Index to Nursing and Allied Health Literature, PubMed, PsycINFO, and Web of Science databases on articles that contain information on the CECSS. The review followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines.

RESULTS

Our systematic literature search resulted in 28 articles in which the CECSS was used.

CONCLUSIONS

Results of our literature review show that from a psychometric perspective, the CECSS is a valid and reliable instrument. However, the results of our study also show that the CECSS has several weaknesses. We have made recommendations to improve the CECSS.

Human-centered design of team health IT for pediatric trauma care transitions

BACKGROUND

As problems of acceptance, usability and workflow integration continue to emerge with health information technologies (IT), it is critical to incorporate human factors and ergonomics (HFE) methods and design principles. Human-centered design (HCD) provides an approach to integrate HFE and produce usable technologies. However, HCD has been rarely used for designing team health IT, even though team-based care is expanding.

OBJECTIVE

To describe the HCD process used to develop a usable team health IT (T3 or Teamwork Transition Technology) that provides cognitive support to pediatric trauma care teams during transitions from the emergency department to the operating room and the pediatric intensive care unit.

METHODS

The HCD process included seven steps in three phases of analysis, design activities and feedback.

RESULTS

The HCD process involved multiple perspectives and clinical roles that were engaged in inter-related activities, leading to design requirements, i.e., goals for the technology, a set of 47 information elements, and a list of HFE design principles applied to T3. Results of the evaluation showed a high usability score for T3.

CONCLUSIONS

HFE can be integrated in the HCD process through a range of methods and design principles. That design process can produce a usable technology that provides cognitive support to a large diverse team involved in pediatric trauma care transitions. Future research should continue to focus on HFE-based design of team health IT.

Collaborative design and implementation of a clinical decision support system for automated fall-risk identification and referrals in emergency departments

Of the 3 million older adults seeking fall-related emergency care each year, nearly one-third visited the Emergency Department (ED) in the previous 6 months. ED providers have a great opportunity to refer patients for fall prevention services at these initial visits, but lack feasible tools for identifying those at highest-risk. Existing fall screening tools have been poorly adopted due to ED staff/provider burden and lack of workflow integration. To address this, we developed an automated clinical decision support (CDS) system for identifying and referring older adult ED patients at risk of future falls. We engaged an interdisciplinary design team (ED providers, health services researchers, information technology/predictive analytics professionals, and outpatient Falls Clinic staff) to collaboratively develop a system that successfully met user requirements and integrated seamlessly into existing ED workflows. Our rapid-cycle development and evaluation process employed a novel combination of human-centered design, implementation science, and patient experience strategies, facilitating simultaneous design of the CDS tool and intervention implementation strategies. This included defining system requirements, systematically identifying and resolving usability problems, assessing barriers and facilitators to implementation (e.g., data accessibility, lack of time, high patient volumes, appointment availability) from multiple vantage points, and refining protocols for communicating with referred patients at discharge. ED physician, nurse, and patient stakeholders were also engaged through online surveys and user testing. Successful CDS design and implementation required integration of multiple new technologies and processes into existing workflows, necessitating interdisciplinary collaboration from the onset. By using this iterative approach, we were able to design and implement an intervention meeting all project goals. Processes used in this Clinical-IT-Research partnership can be applied to other use cases involving automated risk-stratification, CDS development, and EHR-facilitated care coordination.

Implementation of An Antibiotic Stewardship Intervention to Reduce Prescription of Fluoroquinolones: A Human Factors Analysis in Two Intensive Care Units

Antibiotic use is often the target of interventions in health care organizations that aim to decrease healthcare-associated infections (HAI) such as Clostridioides difficile (CDI); this is particularly important for fluoroquinolones (FQ), which are frequently used in critical care settings. In this study, using a multiple case study research approach, we conduct an in-depth analysis of an intervention aimed at limiting ICU prescriber access to FQ in two ICUs of two hospitals. The data collection and analysis were guided by a human factors engineering approach based on the SEIPS (Systems Engineering Initiative for Patient Safety) model and evidence-based implementation principles. Our results show some differences in the implementation of the FQ intervention between the two ICUs, such as level and method of FQ restriction, and training and communication with physicians and pharmacists. In both ICUs, several organizational learning mechanisms helped to quickly identify problems with the intervention and ensure that changes were made in a just-in-time manner (e.g. just-in-time training, removal of FQ in order set for pneumonia). Despite their organizational differences, both sites developed strategies to successfully implement the FQ intervention.

Care transition of trauma patients: Processes with articulation work before and after handoff

While care transitions influence quality of care, less work studies transitions between hospital units. We studied care transitions from the operating room (OR) to pediatric and adult intensive critical care units (ICU) using Systems Engineering Initiative for Patient Safety (SEIPS)-based process modeling. We interviewed twenty-nine physicians (surgery, anesthesia, pediatric critical care) and nurses (OR, ICU) and administered the AHRQ Hospital Survey on Patient Safety Culture items about handoffs, care transitions and teamwork. Care transitions are complex, spatio-temporal processes and involve work during the transition (i.e., handoff and transport) and preparation and follow up activities (i.e., articulation work). Physicians defined the transition as starting earlier and ending later than nurses. Clinicians in the OR to adult ICU transition without a team handoff reported significantly less information loss and better cooperation, despite positive interview data. A team handoff and supporting articulation work should increase awareness, improving quality and safety of care transitions.

Scenario-Based Evaluation of Team Health Information Technology to Support Pediatric Trauma Care Transitions

BACKGROUND

Clinicians need health information technology (IT) that better supports their work. Currently, most health IT is designed to support individuals; however, more and more often, clinicians work in cross-functional teams. Trauma is one of the leading preventable causes of children's death. Trauma care by its very nature is team based but due to the emergent nature of trauma, critical clinical information is often missed in the transition of these patients from one service or unit to another. Teamwork transition technology can help support these transitions and minimize information loss while enhancing information gathering and storage. In this study, we created a large screen technology to support shared situational awareness across multiple clinical roles and departments.

OBJECTIVES

This study aimed to examine if the Teamwork Transition Technology (T3) supports teams and team cognition.

METHODS

We used a scenario-based mock-up methodology with 36 clinicians and staff from the different units and departments who are involved in pediatric trauma to examine T3.

RESULTS

Results of the evaluation show that most participants agreed that the technology helps achieve the goals set out in the design phase. Respondents thought that T3 organizes and presents information in a different way that was helpful to them.

CONCLUSION

In this study, we examined a health IT (T3) that was designed to support teams and team cognition. The results of our evaluation show that participants agreed that T3 does support them in their work and increases their situation awareness.

Usability barriers and facilitators of a human factors engineering-based clinical decision support technology for diagnosing pulmonary embolism

BACKGROUND

Health IT, such as clinical decision support (CDS), has the potential to improve patient safety. However, poor usability of health IT continues to be a major concern. Human factors engineering (HFE) approaches are recommended to improve the usability of health IT. Limited evidence exists on the actual impact of HFE methods and principles on the usability of health IT.

OBJECTIVE

To identify and describe the usability barriers and facilitators of an HFE-based CDS prior to implementation in the emergency department (ED).

METHODS

We conducted debrief interviews with 32 emergency medicine physicians as a part of a scenario-based simulation study evaluating the usability of the HFE-based CDS. We performed a deductive content analysis of the interviews using the usability criteria of Scapin and Bastien as a framework.

RESULTS

We identified 271 occurrences of usability barriers (94) and facilitators (177) of the HFE-based CDS. For instance, we found a facilitator relating to the usability criteria prompting as the PE Dx helps the physician order diagnostic tests following the risk assessment. We found the most facilitators relating to the criteria, minimal actions, e.g. as the PE Dx automatically populates vitals signs (e.g., heart rate) from the chart into the CDS. The majority of the usability barriers related to the usability criteria, compatibility (i.e., workflow integration), which was not explicitly considered in the HFE design of the CDS. For example, the CDS did not support resident and attending physician teamwork in the PE diagnostic process.

CONCLUSION

The systematic use of HFE principles in the design of CDS improves the usability of these technologies. In order to further reduce usability barriers, workflow integration should be explicitly considered in the design of health IT.

"The Invisible Staff": A Qualitative Analysis of Environmental Service Workers' Perceptions of the VA Clostridium difficile Prevention Bundle Using a Human Factors Engineering Approach

OBJECTIVES

Using a novel human factors engineering approach, the Systems Engineering Initiative for Patient Safety model, we evaluated environmental service workers' (ESWs) perceptions of barriers and facilitators influencing adherence to the nationally mandated Department of Veterans Affairs Clostridium difficile infection (CDI) prevention bundle.

METHODS

A focus group of ESWs was conducted. Qualitative analysis was performed employing a visual matrix display to identify barrier/facilitator themes related to Department of Veterans Affairs CDI bundle adherence using the Systems Engineering Initiative for Patient Safety work system as a framework.

RESULTS

Environmental service workers reported adequate cleaning supplies/equipment and displayed excellent knowledge of CDI hand hygiene requirements. Environmental service workers described current supervisory practices as providing an acceptable amount of time to clean CDI rooms, although other healthcare workers often pressured ESWs to clean rooms more quickly. Environmental service workers reported significant concern for CDI patients' family members as well as suggesting uncertainty regarding the need for family members to follow infection prevention practices. Small and cluttered patient rooms made cleaning tasks more difficult, and ESW cleaning tasks were often interrupted by other healthcare workers. Environmental service workers did not feel comfortable asking physicians for more time to finish cleaning a room nor did ESWs feel comfortable pointing out lapses in physician hand hygiene.

CONCLUSIONS

Multiple work system components serve as barriers to and facilitators of ESW adherence to the nationally mandated Department of Veterans Affairs CDI bundle. Environmental service workers may represent an underappreciated resource for hospital infection prevention, and further efforts should be made to engage ESWs as members of the health care team.

Workflow integration analysis of a human factors-based clinical decision support in the emergency department

Numerous challenges with the implementation, acceptance, and use of health IT are related to poor usability and a lack of integration of the technologies into clinical workflow, and have, therefore, limited the potential of these technologies to improve patient safety. We propose a definition and conceptual model of health IT workflow integration. Using interviews of 12 emergency department (ED) physicians, we identify 134 excerpts of barriers and facilitators to workflow integration of a human factors (HF)-based clinical decision support (CDS) implemented in the ED. Using data on these 134 barriers and facilitators, we distinguish 25 components of workflow integration of the CDS, which are described according to four dimensions of workflow integration: time, flow, scope of patient journey, and level. The proposed definition and conceptual model of workflow integration can be used to inform health IT design; this is the purpose of the proposed checklist that can help to ensure consideration of workflow integration during the development of health IT.

Disparate perspectives: Exploring healthcare professionals' misaligned mental models of older adults' transitions of care between the emergency department and skilled nursing facility

Care transitions that occur across healthcare system boundaries represent a unique challenge for maintaining high quality care and patient safety, as these systems are typically not aligned to perform the care transition process. We explored healthcare professionals' mental models of older adults' transitions between the emergency department (ED) and skilled nursing facility (SNF). We conducted a thematic analysis of interviews with ED and SNF healthcare professionals and identified three themes: 1) ED and SNF healthcare professionals had misaligned mental models regarding communication processes and tools used during care transitions, 2) ED and SNF healthcare professionals had misaligned mental models regarding healthcare system capability, and 3) Misalignments led to individual and organizational consequences. Overall, we found that SNF and ED healthcare professionals are part of the same process but have different perceptions of the process. Future work must take steps to redesign and realign these distinct work systems such that those involved conceptualize themselves as part of a joint process.

Health Care 4.0: A Vision for Smart and Connected Health Care

Industry 4.0 has transformed manufacturing industry into a new paradigm. In a manner similar to manufacturing, health care delivery is at the dawn of a foundational change into the new era of smart and connected health care, referred to as Health Care 4.0. In this paper, we discuss the historical evolution of Health Care 1.0 to 4.0, describe the characteristics of smart and connected care in Health Care 4.0, identify multiple research challenges and opportunities of Health Care 4.0 in terms of data, model, dynamics, and integration, and outline the implications of people, process, system and health outcomes. Finally, conclusions and recommendations are presented in the areas of (1) involvement of multiple disciplines and perspectives, (2) development of technologies and methodologies with combination of quantitative and qualitative approaches, (3) closed-loop integration of sociotechnical system, and (4) design of person-centered system with specific attention to human needs and health equity.

Moving toward a sociotechnical systems approach to continuous health information technology design: the path forward for improving electronic health record usability and reducing clinician burnout

Based on our analysis of descriptions provided by four EHR vendors on their EHR usability efforts, we provide three recommendations aimed at improving the usability of health information technology and reducing clinician burnout. First, EHR vendors need to dedicate increased attention to the design of the entire sociotechnical (work) system, including the EHR technology and its usability as well as the interactions of the technology with other system elements. Second, EHR vendors need to deepen and broaden their understanding of the work of clinicians and care teams by using diverse and mixed method. Third, in collaboration with health care organizations, EHR vendors should engage in cycles of continuous design and learning in order to improve the usability of health IT.

Physical distancing for care delivery in health care settings: Considerations and consequences

As health care systems explore new ways of delivering care for patients with and without COVID-19, they must consider how to maintain physical distancing among health care workers and patients. Physical distancing in high complexity systems such as health care is particularly challenging and may benefit from a human factors and systems engineering perspective. We discuss challenges to implementing and maintaining physical distancing in health care settings and present possible solutions from a human factors and systems engineering perspective.

Medication Safety in Two Intensive Care Units of a Community Teaching Hospital After Electronic Health Record Implementation: Sociotechnical and Human Factors Engineering Considerations

OBJECTIVE

The aim of the study was to assess the impact of Electronic Health Record (EHR) implementation on medication safety in two intensive care units (ICUs).

METHODS

Using a prospective pre-post design, we assessed 1254 consecutive admissions to two ICUs before and after an EHR implementation. Each medication event was evaluated with regard to medication error (error type, medication-management stage) and impact on patient (severity of potential or actual harm).

RESULTS

We identified 4063 medication-related events either pre-implementation (2074 events) or post-implementation (1989 events). Although the overall potential for harm due to medication errors decreased post-implementation only 2 of the 3 error rates were significantly lower post-implementation. After EHR implementation, we observed reductions in rates of medication errors per admission at the stages of transcription (0.13-0, P < 0.001), dispensing (0.49-0.16, P < 0.001), and administration (0.83-0.56, P = 0.011). Within the ordering stage, 4 error types decreased post-implementation (orders with omitted information, error-prone abbreviations, illegible orders, failure to renew orders) and 4 error types increased post-implementation (orders of wrong drug, orders containing a wrong start or stop time, duplicate orders, orders with inappropriate or wrong information). Within the administration stage, we observed a reduction of late administrations and increases in omitted administrations and incorrect documentation.

CONCLUSIONS

Electronic Health Record implementation in two ICUs was associated with both improvement and worsening in rates of specific error types. Further safety improvements require a nuanced understanding of how various error types are influenced by the technology and the sociotechnical work system of the technology implementation. Recommendations based on human factors engineering principles are provided for reducing medication errors.

Reducing Fall-related Revisits for Elderly Diabetes Patients in Emergency Departments: A Transition Flow Model

This paper introduces a transition flow model to study fall-related emergency department (ED) revisits for elderly patients with diabetes. Five diabetes classes are used to classify patients at discharge, within 7-day revisits, and between 8 and 30-day revisits. Analytical formulas to evaluate patient revisiting risks are derived. To reduce revisits, sensitivity analysis is introduced to identify the most critical, i.e., dominant, factors whose changes can lead to the largest reduction in revisits. In addition, a case study at University of Wisconsin (UW) Hospital ED is described to illustrate the applicability of the model.

Decreasing ICU-associated Clostridioides difficile infection through fluoroquinolone restriction, the FIRST trial: a study protocol

INTRODUCTION

Clostridioides difficile infection (CDI) is one of the most common healthcare-associated infections in the USA, having high incidence in intensive care units (ICU). Antibiotic use increases risk of CDI, with fluoroquinolones (FQs) particularly implicated. In healthcare settings, antibiotic stewardship (AS) and infection control interventions are effective in CDI control, but there is little evidence regarding the most effective AS interventions. Preprescription authorisation (PPA) restricting FQs is a potentially promising AS intervention to reduce CDI. The FQ Restriction for the Prevention of CDI (FIRST) trial will evaluate the effectiveness of an FQ PPA intervention in reducing CDI rates in adult ICUs compared with preintervention care, and evaluate implementation effectiveness using a human-factors and systems engineering model.

METHODS AND ANALYSIS

This is a multisite, stepped-wedge, cluster, effectiveness-implementation clinical trial. The trial will take place in 12 adult medical-surgical ICUs with ≥10 beds, using Epic as electronic health record (EHR) and pre-existing AS programmes. Sites will receive facilitated implementation support over the 15-month trial period, succeeded by 9 months of follow-up. The intervention comprises a clinical decision support system for FQ PPA, integrated into the site EHRs. Each ICU will be considered a single site and all ICU admissions included in the analysis. Clinical data will be extracted from EHRs throughout the trial and compared with the corresponding pretrial period, which will constitute the baseline for statistical analysis. Outcomes will include ICU-onset CDI rates, FQ days of therapy (DOT), alternative antibiotic DOT, average length of stay and hospital mortality. The study team will also collect implementation data to assess implementation effectiveness using the Systems Engineering Initiative for Patient Safety model.

ETHICS AND DISSEMINATION

The trial was approved by the Institutional Review Board at the University of Wisconsin-Madison (2018-0852-CP015). Results will be made available to participating sites, funders, infectious disease societies, critical care societies and other researchers.

TRIAL REGISTRATION NUMBER

NCT03848689.

Implementing daily chlorhexidine gluconate (CHG) bathing in VA settings: The human factors engineering to prevent resistant organisms (HERO) project

BACKGROUND

Daily use of chlorhexidine gluconate (CHG) has been shown to reduce risk of healthcare-associated infections. We aimed to assess moving CHG bathing into routine practice using a human factors approach. We evaluated implementation in non-intensive care unit (ICU) settings in the Veterans Health Administration.

METHODS

Our multiple case study approach included non-ICU units from 4 Veterans Health Administration settings. Guided by the Systems Engineering Initiative for Patient Safety, we conducted focus groups and interviews to capture barriers and facilitators to daily CHG bathing. We measured compliance using observations and skin CHG concentrations.

RESULTS

Barriers to daily CHG include time, concern of increasing antibiotic resistance, workflow and product concerns. Facilitators include engagement of champions and unit shared responsibility. We found shortfalls in patient education, hand hygiene and CHG use on tubes and drains. CHG skin concentration levels were highest among patients from spinal cord injury units. These units applied antiseptic using 2% CHG impregnated wipes vs 4% CHG solution/soap.

DISCUSSION

Non-ICUs implementing CHG bathing must consider human factors and work system barriers to ensure uptake and sustained practice change.

CONCLUSIONS

Well-planned rollouts and a unit culture promoting shared responsibility are key to compliance with daily CHG bathing. Successful implementation requires attention to staff education and measurement of compliance.

Remembering Ben-Tzion Karsh's scholarship, impact, and legacy

Dr. Ben-Tzion (Bentzi) Karsh was a mentor, collaborator, colleague, and friend who profoundly impacted the fields of human factors and ergonomics (HFE), medical informatics, patient safety, and primary care, among others. In this paper we honor his contributions by reflecting on his scholarship, impact, and legacy in three ways: first, through an updated simplified bibliometric analysis in 2020, highlighting the breadth of his scholarly impact from the perspective of the number and types of communities and collaborators with which and whom he engaged; second, through targeted reflections on the history and impact of Dr. Karsh's most cited works, commenting on the particular ways they impacted our academic community; and lastly, through quotes from collaborators and mentees, illustrating Dr. Karsh's long-lasting impact on his contemporaries and students.

Physician Perceptions of Disposition Decision-making for Older Adults in the Emergency Department: A Preliminary Analysis

Disposition decision-making in the emergency department (ED) is critical to patient safety and quality of care. Disposition decision-making has particularly important implications for older adults who comprise a significant portion of ED visits annually and are vulnerable to suboptimal outcomes throughout ED care transitions. We conducted a secondary inductive content analysis of interviews with ED physicians (N= 11) to explore their perceptions of who they involve in disposition decision-making and what information they use to make disposition decisions for older adults. ED physicians cited 7 roles (5 types of clinicians, patients and families) and 11 information types, both clinical (e.g. test/lab results) and non-clinical (e.g. family's preference). Our preliminary findings represent a key first step toward the development of interventions that promote patient safety and quality of care for older adults in the ED by supporting the cognitive and communicative aspects of disposition decision-making.

Human factors and ergonomics systems approach to the COVID-19 healthcare crisis

A human factors and ergonomics (HFE) systems approach offers a model for adjusting work systems and care processes in response to a healthcare crisis such as COVID-19. Using the Systems Engineering Initiative for Patient Safety (SEIPS) model of work system and patient safety, we describe various work system barriers and facilitators experienced by healthcare workers during the COVID-19 crisis. We propose a set of five principles based on this HFE systems approach related to novel pandemic: (i) deferring to local expertise, (ii) facilitating adaptive behaviors, (iii) enhancing interactions between system elements and levels along the patient journey, (iv) re-purposing existing processes and (v) encouraging dynamic continuous learning.

A Markov Chain Model for Transient Analysis of Handoff Process in Emergency Departments

Transfer of care between multiple units or facilities is of significant importance for patient safety, care quality, and operation efficiency. Such transfers are often referred to as handoffs in hospitals, which need to be carried out timely, safely, and smoothly with accurate information. This paper introduces a Markov chain model to study the transients of handoff process in hospital emergency departments. The handoff process is modeled by a stochastic process with unavailability of service, which characterizes the constraints in bed capacity, staff shortage, and coordination issues, etc. For systems only allowing one transfer request waiting, the transient performance is obtained through Laplace transform and its inverse transform. Such a result is then used as a building block to study the systems allowing multiple requests waiting through an iteration process, which can reduce the computation complexity substantially. Numerical studies show that such a method can provide estimates of transient performance in the handoff process with acceptable accuracy.

Work system barriers and facilitators in inpatient care transitions of pediatric trauma patients

Hospital-based care of pediatric trauma patients includes transitions between units that are critical for quality of care and patient safety. Using a macroergonomics approach, we identify work system barriers and facilitators in care transitions. We interviewed eighteen healthcare professionals involved in transitions from emergency department (ED) to operating room (OR), OR to pediatric intensive care unit (PICU) and ED to PICU. We applied the Systems Engineering Initiative for Patient Safety (SEIPS) process modeling method and identified nine dimensions of barriers and facilitators - anticipation, ED decision making, interacting with family, physical environment, role ambiguity, staffing/resources, team cognition, technology and characteristic of trauma care. For example, handoffs involving all healthcare professionals in the OR to PICU transition created a shared understanding of the patient, but sometimes included distractions. Understanding barriers and facilitators can guide future improvements, e.g., designing a team display to support team cognition of healthcare professionals in the care transitions.

SEIPS 3.0: Human-centered design of the patient journey for patient safety

The Systems Engineering Initiative for Patient Safety (SEIPS) and SEIPS 2.0 models provide a framework for integrating Human Factors and Ergonomics (HFE) in health care quality and patient safety improvement. As care becomes increasingly distributed over space and time, the "process" component of the SEIPS model needs to evolve and represent this additional complexity. In this paper, we review different ways that the process component of the SEIPS models have been described and applied. We then propose the SEIPS 3.0 model, which expands the process component, using the concept of the patient journey to describe the spatio-temporal distribution of patients' interactions with multiple care settings over time. This new SEIPS 3.0 sociotechnical systems approach to the patient journey and patient safety poses several conceptual and methodological challenges to HFE researchers and professionals, including the need to consider multiple perspectives, issues with genuine participation, and HFE work at the boundaries.

Application of human factors to improve usability of clinical decision support for diagnostic decision-making: a scenario-based simulation study

OBJECTIVE

In this study, we used human factors (HF) methods and principles to design a clinical decision support (CDS) that provides cognitive support to the pulmonary embolism (PE) diagnostic decision-making process in the emergency department. We hypothesised that the application of HF methods and principles will produce a more usable CDS that improves PE diagnostic decision-making, in particular decision about appropriate clinical pathway.

MATERIALS AND METHODS

We conducted a scenario-based simulation study to compare a HF-based CDS (the so-called CDS for PE diagnosis (PE-Dx CDS)) with a web-based CDS (MDCalc); 32 emergency physicians performed various tasks using both CDS. PE-Dx integrated HF design principles such as automating information acquisition and analysis, and minimising workload. We assessed all three dimensions of usability using both objective and subjective measures: effectiveness (eg, appropriate decision regarding the PE diagnostic pathway), efficiency (eg, time spent, perceived workload) and satisfaction (perceived usability of CDS).

RESULTS

Emergency physicians made more appropriate diagnostic decisions (94% with PE-Dx; 84% with web-based CDS; p<0.01) and performed experimental tasks faster with the PE-Dx CDS (on average 96 s per scenario with PE-Dx; 117 s with web-based CDS; p<0.001). They also reported lower workload (p<0.001) and higher satisfaction (p<0.001) with PE-Dx.

CONCLUSIONS

This simulation study shows that HF methods and principles can improve usability of CDS and diagnostic decision-making. Aspects of the HF-based CDS that provided cognitive support to emergency physicians and improved diagnostic performance included automation of information acquisition (eg, auto-populating risk scoring algorithms), minimisation of workload and support of decision selection (eg, recommending a clinical pathway). These HF design principles can be applied to the design of other CDS technologies to improve diagnostic safety.

Assessing workflow of emergency physicians in the use of clinical decision support

The emergency department (ED) is a complex environment where diagnoses must often be made quickly, based on incomplete information. Pulmonary embolism (PE) is an especially challenging diagnosis that is frequently delayed or missed due to its non-specific symptoms, and can be life-threatening when not treated. Clinical decision supports (CDS) have the potential to improve these difficult decisions; however, previous efforts to implement CDS in the ED have faced challenges due to poor usability and lack of workflow integration. The objective of this study is to identify potential barriers to workflow integration from the technology’s implementation and inform the CDS design; this is achieved by analyzing ED physicians’ workflow during a usability evaluation of two different CDS, a web-based risk scoring CDS and a CDS designed using an human-centered design (HCD) process and human factors (HF) design principles. The number of cases matching the guideline-based workflow and the percent of correct diagnostic decisions increased from the use of the HF-based CDS, but varied depending on the patient scenario. We identified three workflow variations, which had both positive and negative implications for the CDS design and implementation. The workflow analysis can be used to inform the CDS design and improve the technology’s usability and integration in physician workflow prior to implementation.

Care coordination for chronically ill patients: Identifying coordination activities and interdependencies

Care coordination is important for chronically ill patients who need assistance from a variety of healthcare professionals especially when they transition through different care settings. There has not been a clear definition of care coordination and its associated activities. This paper provides a two-dimension framework of care coordination for chronically ill patients: 1) coordination activities (i.e. communication and monitoring) and 2) interdependencies (i.e. flow, shared resources, simultaneity). We used this framework in a qualitative content analysis of 12 interviews with healthcare professionals involved in coordinating care of chronically ill patients. We identified a total of 258 care coordination activities and developed categories and sub-categories using the constant comparative method. The first category of care coordination activities involves communication with flow or shared resources interdependencies or both. This category includes arranging services and equipment for the patient, exchanging information about patient transition to different care settings, reporting errors and resolving them, and helping the patient with appointments and transportation. The second category involves monitoring, sometimes combined with communication, with flow or shared resources interdependencies or both. This category includes reviewing medications and services and detecting errors, reviewing patient symptoms and following up if needed, and scheduling follow-up to review patient status. The last category involves communication with simultaneity interdependency. This category involves talking in the same location and developing a plan of care, people exchanging information at the same time, and scheduling delivery of medications/services to correspond with patient arrival home. Finally, we identified characteristics of health information technology that can support these various care coordination activities.

The Design of PE Dx, a CDS to Support Pulmonary Embolism Diagnosis in the ED

Designing and implementing clinical decision support (CDS) in health care has been challenging. Attempts have been made to design and implement CDS to support clinical procedures, but many of these CDSs have met user resistance. One possible explanation for the lack of acceptability can be the poor design of the CDS. In this study, we describe the design of PE Dx, a CDS built to support the diagnosis of pulmonary embolism (PE) in the emergency department (ED) using human factors methods.

Human Factors in Health(care) Informatics: Toward Continuous Sociotechnical System Design

Developing structures and processes for continuous sociotechnical system design is key to sustaining human factors (HF) knowledge in the context of rapid health care changes and technological innovations. Two research studies illustrate how to embed HF in organizational learning processes and structures. We need to develop innovative HF methods for continuous sociotechnical system design.

Complexity of the pediatric trauma care process: Implications for multi-level awareness

Trauma is the leading cause of disability and death in children and young adults in the US. While much is known about the medical aspects of inpatient pediatric trauma care, not much is known about the processes and roles involved in in-hospital care. Using human factors engineering (HFE) methods, we combine interview, archival document and trauma registry data to describe how intra-hospital care transitions affect process and team complexity. Specifically, we identify the 53 roles directly involved in patient care in each hospital unit and describe the 3324 total transitions between hospital units and the 69 unique pathways, from arrival to discharge, experienced by pediatric trauma patients. We continue the argument to shift from eliminating complexity to coping with it and propose supporting three levels of awareness to enhance the resilience and adaptation necessary for patient safety in health care, i.e. safety in complex systems. We discuss three levels of awareness (individual, team and organizational) and describe challenges and potential sociotechnical solutions for each. For example, one challenge to individual awareness is high time pressure. A potential solution is clinical decision support of information perception, integration and decision making. A challenge to team awareness is inadequate "non-technical" skills, e.g., leadership, communication, role clarity; simulation or another form of training could improve these. The complex, distributed nature of this process is a challenge to organizational awareness; a potential solution is to develop awareness of the process and the roles and interdependencies within it, by using process modeling or simulation.

Information flow during pediatric trauma care transitions: things falling through the cracks

Pediatric trauma is one of the leading causes of morbidity and mortality in children in the USA. Every year, nearly 10 million children are evaluated in emergency departments (EDs) for traumatic injuries, resulting in 250,000 hospital admissions and 10,000 deaths. Pediatric trauma care in hospitals is distributed across time and space, and particularly complex with involvement of large and fluid care teams. Several clinical teams (including emergency medicine, surgery, anesthesiology, and pediatric critical care) converge to help support trauma care in the ED; this co-location in the ED can help to support communication, coordination and cooperation of team members. The most severe trauma cases often need surgery in the operating room (OR) and are admitted to the pediatric intensive care unit (PICU). These care transitions in pediatric trauma can result in loss of information or transfer of incorrect information, which can negatively affect the care a child will receive. In this study, we interviewed 18 clinicians about communication and coordination during pediatric trauma care transitions between the ED, OR and PICU. After the interview was completed, we surveyed them about patient safety during these transitions. Results of our study show that, despite the fact that the many services and units involved in pediatric trauma cooperate well together during trauma cases, important patient care information is often lost when transitioning patients between units. To safely manage the transition of this fragile and complex population, we need to find ways to better manage the information flow during these transitions by, for instance, providing technological support to ensure shared mental models.

Human Factors and Usability for Health Information Technology: Old and New Challenges

OBJECTIVES

Despite national mandates, incentives, and other programs, the design of health information technology (IT) remains problematic and usability problems continue to be reported. This paper reviews recent literature on human factors and usability of health IT, with a specific focus on research aimed at applying human factors methods and principles to improve the actual design of health IT, its use, and associated patient and clinician outcomes.

METHODS

We reviewed recent literature on human factors and usability problems of health IT and research on human-centered design of health IT for clinicians and patients.

RESULTS

Studies continue to show usability problems of health IT experienced by multiple groups of health care professionals (e.g., physicians and nurses) as well as patients. Recent research shows that usability is influenced by both designers (e.g., IT vendors) and implementers in health care organizations, and that the application of human-centered design practices needs to be further improved and extended. We welcome emerging research on the design of health IT for teams as team-based care is increasingly implemented throughout health care.

CONCLUSIONS

Progress in the application of human factors methods and principles to the design of health IT is occurring, with important information provided on their actual impact on care processes and patient outcomes. Future research should examine the work of health IT designers and implementers, which would help to develop strategies for further embedding human factors engineering in IT design processes.

Technology barriers and strategies in coordinating care for chronically ill patients

Care managers who coordinate care for chronically ill patients in hospitals and outpatient settings use multiple health information technologies for accessing, processing, documenting, and communicating patient-related information. Using a combination of 41 interviews and observations of 15 care managers, we identified a range of technology-related barriers experienced by care managers (total of 163 occurrences). The barriers are related to (lack of) access to information, inadequate information, limited usefulness and usability of the technologies, challenges associated with using multiple health IT, and technical problems. In 43% of the occurrences, care managers describe strategies to deal with the technology barriers; these fit in three categories: nothing/delay (9 occurrences), work-arounds (32 occurrences), and direct action at the individual, team, and organization levels (29 occurrences). Our data show the adaptive capacity of care managers who develop various strategies to deal with technology barriers and are, therefore, able to care for chronically ill patients. This information can be used as input to work system redesigns.

Role network measures to assess healthcare team adaptation to complex situations: the case of venous thromboembolism prophylaxis

Hospitals are complex environments that rely on clinicians working together to provide appropriate care to patients. These clinical teams adapt their interactions to meet changing situational needs. Venous thromboembolism (VTE) prophylaxis is a complex process that occurs throughout a patient's hospitalisation, presenting five stages with different levels of complexity: admission, interruption, re-initiation, initiation, and transfer. The objective of our study is to understand how the VTE prophylaxis team adapts as the complexity in the process changes; we do this by using social network analysis (SNA) measures. We interviewed 45 clinicians representing 9 different cases, creating 43 role networks. The role networks were analysed using SNA measures to understand team changes between low and high complexity stages. When comparing low and high complexity stages, we found two team adaptation mechanisms: (1) relative increase in the number of people, team activities, and interactions within the team, or (2) relative increase in discussion among the team, reflected by an increase in reciprocity.   Practitioner Summary: The reason for this study was to quantify team adaptation to complexity in a process using social network analysis (SNA). The VTE prophylaxis team adapted to complexity by two different mechanisms, by increasing the roles, activities, and interactions among the team or by increasing the two-way communication and discussion throughout the team. We demonstrated the ability for SNA to identify adaptation within a team.

Physician Perceptions of the Electronic Problem List in Pediatric Trauma Care

OBJECTIVE

To describe physician perceptions of the potential goals, characteristics, and content of the electronic problem list (PL) in pediatric trauma.

METHODS

We conducted 12 semistructured interviews with physicians involved in the pediatric trauma care process, including residents, fellows, and attendings from four services: emergency medicine, surgery, anesthesia, and pediatric critical care. Using qualitative content analysis, we identified PL goals, characteristics, and patient-related information from these interviews and the hospital's PL etiquette document of guideline.

RESULTS

We identified five goals of the PL (to document the patient's problems, to make sense of the patient's problems, to make decisions about the care plan, to know who is involved in the patient's care, and to communicate with others), seven characteristics of the PL (completeness, efficiency, accessibility, multiple users, organized, created before arrival, and representing uncertainty), and 22 patient-related information elements (e.g., injuries, vitals). Physicians' suggested criteria for a PL varied across services with respect to goals, characteristics, and patient-related information.

CONCLUSION

Physicians involved in pediatric trauma care described the electronic PL as ideally more than a list of a patient's medical diagnoses and injuries. The information elements mentioned are typically found in other parts of the patient's electronic record besides the PL, such as past medical history and labs. Future work is needed to evaluate the optimal design of the PL so that users with emergent cases, such as pediatric trauma, have access to key information related to the patient's immediate problems.