Decision-centred design in healthcare: The process of identifying a decision support tool for airway management

Executive Summary of the Spanish Society of Anesthesiology, Reanimation and Pain Therapy (SEDAR) Spanish Society of Emergency and Emergency Medicine (SEMES) and Spanish Society of Otolaryngology, Head and Neck Surgery (SEORL-CCC) Guideline for difficult airway management

The Airway section of the Spanish Society of Anesthesiology, Reanimation and Pain Therapy (SEDAR), Spanish Society of Emergency and Emergency Medicine (SEMES) and Spanish Society of Otolaryngology, Head and Neck Surgery (SEORL-CCC) present the Guidelines for the integral management of difficult airway in adult patients. This document provides recommendations based on current scientific evidence, theoretical-educational tools and implementation tools, mainly cognitive aids, applicable to the treatment of the airway in the field of anesthesiology, critical care, emergencies and prehospital medicine. Its principles are focused on the human factors, cognitive processes for decision-making in critical situations and optimization in the progression of the application of strategies to preserve adequate alveolar oxygenation in order to improve safety and quality of care.

Spanish Society of Anesthesiology, Reanimation and Pain Therapy (SEDAR), Spanish Society of Emergency and Emergency Medicine (SEMES) and Spanish Society of Otolaryngology, Head and Neck Surgery (SEORL-CCC) Guideline for difficult airway management. Part I

The Airway Management section of the Spanish Society of Anesthesiology, Resuscitation, and Pain Therapy (SEDAR), the Spanish Society of Emergency Medicine (SEMES), and the Spanish Society of Otorhinolaryngology and Head and Neck Surgery (SEORL-CCC) present the Guide for the comprehensive management of difficult airway in adult patients. Its principles are focused on the human factors, cognitive processes for decision-making in critical situations, and optimization in the progression of strategies application to preserve adequate alveolar oxygenation in order to enhance safety and the quality of care. The document provides evidence-based recommendations, theoretical-educational tools, and implementation tools, mainly cognitive aids, applicable to airway management in the fields of anesthesiology, critical care, emergencies, and prehospital medicine. For this purpose, an extensive literature search was conducted following PRISMA-R guidelines and was analyzed using the GRADE methodology. Recommendations were formulated according to the GRADE methodology. Recommendations for sections with low-quality evidence were based on expert opinion through consensus reached via a Delphi questionnaire.

Identifying firefighters' situation awareness requirements for fire and non-fire emergencies using a goal-directed task analysis

A firefighter's situation awareness (SA) is considered crucial to making effective tactical decisions and actions at the scene. Despite the importance of the firefighter's SA, there have been limited research efforts to understand what cues and information firefighters use to assess ongoing situations and predict future conditions. In addition to fire events, contemporary firefighters respond to an increasing volume of non-fire incidents. Thus, this study aims to identify firefighters' SA during three fire incidents (single house fire, vehicle fire, and passenger aircraft fire) and three non-fire incidents (medical emergency, hazardous materials, and urban search and rescue). A goal-directed task analysis was conducted via focus group discussions with eight career firefighters. Findings indicate that firefighters build their SA by processing various cues from hazards (e.g., fire, ignition source), humans (e.g., occupants, bystanders, drivers, passengers), spatial elements (e.g., building structure, location of hazards), and surrounding conditions (e.g., traffic, weather). Our findings provide insights into SA measurement, SA-oriented work processes, training for SA, and designing technologies to support firefighters' SA during all-hazard responses.

Using extended reality (XR) for medical training and real-time clinical support during deep space missions

Medical events can affect space crew health and compromise the success of deep space missions. To successfully manage such events, crew members must be sufficiently prepared to manage certain medical conditions for which they are not technically trained. Extended Reality (XR) can provide an immersive, realistic user experience that, when integrated with augmented clinical tools (ACT), can improve training outcomes and provide real-time guidance during non-routine tasks, diagnostic, and therapeutic procedures. The goal of this study was to develop a framework to guide XR platform development using astronaut medical training and guidance as the domain for illustration. We conducted a mixed-methods study-using video conference meetings (45 subject-matter experts), Delphi panel surveys, and a web-based card sorting application-to develop a standard taxonomy of essential XR capabilities. We augmented this by identifying additional models and taxonomies from related fields. Together, this "taxonomy of taxonomies," and the essential XR capabilities identified, serve as an initial framework to structure the development of XR-based medical training and guidance for use during deep space exploration missions. We provide a schematic approach, illustrated with a use case, for how this framework and materials generated through this study might be employed.

Decision-centered design of a clinical decision support system for acute management of pediatric congenital heart disease

Background and Objectives

Children with congenital heart disease (CHD), have fragile hemodynamics and can deteriorate due to common childhood illnesses and the natural progression of their disease. During these acute periods of deterioration, these children often present to their local emergency departments (ED) where expertise in CHD is limited, and appropriate intervention is crucial to their survival. Previous studies identified that determining the appropriate intervention for CHD patients can be difficult for ED physicians, particularly since key components of effective decision making are not being met. Although key components of effective decision making for ED physicians have been identified, they have yet to be transformed into actionable guidance. We used decision centered design (DCD) to translate key components of decision making into decision requirements and associated design concepts, that we subsequently incorporated into a prototype clinical decision support system (CDSS).

Methods

Using framework analysis, transcripts from Critical Decision Method interviews of CHD experts and ED physicians were inductively coded to identify key decision requirements for ED physicians that are currently not well supported, and their associated design concepts. A design workshop was held to refine the identified key decision requirements and design concepts as well as to sketch information that would satisfy the identified requirements. These were iteratively incorporated into a prototype CDSS.

Results

Three decision requirements: (1) distinguish the patient's unique physiology based on their unique cardiac anatomy, (2) explicitly consider CHD specific differential diagnoses to allow a more structured reflection of diagnosis, and (3) select CHD appropriate interventions for each patient, were identified. These requirements along with design concepts and information needs identified through the design workshop were incorporated into the CDSS prototype.

Conclusion

We identified key decision requirements and associated design concepts, that informed the design of a CDSS to provide actionable guidance for ED physicians when managing CHD patients. Meeting ED physicians' decision components with a CDSS requires the translation of their key decision requirements in its design. If not, we risk creating designs that interfere with clinician performance.

Understanding the systemic influences on maritime pilot decision-making

Maritime incidents occurring during pilotage are of international concern. Maritime pilots control most pilotage operations worldwide, yet despite the safety criticality of their role, research examining pilot decision-making processes during these complex and dynamic operations is scarce. This article describes the findings from two studies that utilised an integrated systems thinking framework to understand how pilots make decisions and what factors are perceived to influence their decisions. Interviews were held with 22 pilots (Study 1) and 17 maritime safety stakeholders (Study 2) in the New Zealand maritime context. The findings illustrate the challenges pilots face during pilotage and provide insights into their decision-making processes and the systemic factors that can be addressed to improve maritime safety. Given the multiple causal pathways to incidents occurring during pilotage identified by this research, it is suggested that multiple systems-wide interventions are needed, which is likely to require a long-term, strategic approach.

Revisiting concepts of evidence in implementation science

Background

Evidence, in multiple forms, is a foundation of implementation science. For public health and clinical practice, evidence includes the following: type 1 evidence on etiology and burden; type 2 evidence on effectiveness of interventions; and type 3: evidence on dissemination and implementation (D&I) within context. To support a vision for development and use of evidence in D&I science that is more comprehensive and equitable (particularly for type 3 evidence), this article aims to clarify concepts of evidence, summarize ongoing debates about evidence, and provide a set of recommendations and tools/resources for addressing the “how-to” in filling evidence gaps most critical to advancing implementation science.

Main text

Because current conceptualizations of evidence have been relatively narrow and insufficiently characterized in our opinion, we identify and discuss challenges and debates about the uses, usefulness, and gaps in evidence for implementation science. A set of questions is proposed to assist in determining when evidence is sufficient for dissemination and implementation. Intersecting gaps include the need to (1) reconsider how the evidence base is determined, (2) improve understanding of contextual effects on implementation, (3) sharpen the focus on health equity in how we approach and build the evidence-base, (4) conduct more policy implementation research and evaluation, and (5) learn from audience and stakeholder perspectives. We offer 15 recommendations to assist in filling these gaps and describe a set of tools for enhancing the evidence most needed in implementation science.

Conclusions

To address our recommendations, we see capacity as a necessary ingredient to shift the field’s approach to evidence. Capacity includes the “push” for implementation science where researchers are trained to develop and evaluate evidence which should be useful and feasible for implementers and reflect community or stakeholder priorities. Equally important, there has been inadequate training and too little emphasis on the “pull” for implementation science (e.g., training implementers, practice-based research). We suggest that funders and reviewers of research should adopt and support a more robust definition of evidence. By critically examining the evolving nature of evidence, implementation science can better fulfill its vision of facilitating widespread and equitable adoption, delivery, and sustainment of scientific advances.

The use of cognitive task analysis in clinical and health services research — a systematic review

Background

At times, clinical case complexity and different types of uncertainty present challenges to less experienced clinicians or the naive application of clinical guidelines where this may not be appropriate. Cognitive task analysis (CTA) methods are used to elicit, document and transfer tacit knowledge about how experts make decisions.

Methods

We conducted a methodological review to describe the use of CTA methods in understanding expert clinical decision-making. We searched MEDLINE, EMBASE and PsycINFO from inception to 2019 for primary research studies which described the use of CTA methods to understand how qualified clinicians made clinical decisions in real-world clinical settings.

Results

We included 81 articles (80 unique studies) from 13 countries, published from 1993 to 2019, most commonly from surgical and critical care settings. The most common aims were to understand expert decision-making in particular clinical scenarios, using expert decision-making in the development of training programmes, understanding whether decision support tools were warranted and understanding procedural variability and error identification or reduction. Critical decision method (CDM) and CTA interviews were most frequently used, with hierarchical task analysis, task knowledge structures, think-aloud protocols and other methods less commonly used. Studies used interviews, observation, think-aloud exercises, surveys, focus groups and a range of more CTA-specific methodologies such as the systematic human error reduction and prediction approach. Researchers used CTA methods to investigate routine/typical (n = 64), challenging (n = 13) or more uncommon, rare events and anomalies (n = 3).

Conclusions

In conclusion, the elicitation of expert tacit knowledge using CTA has seen increasing use in clinical specialties working under challenging time pressures, complexity and uncertainty. CTA methods have great potential in the development, refinement, modification or adaptation of complex interventions, clinical protocols and practice guidelines.

Registration

PROSPERO ID CRD42019128418.

Supplementary Information

The online version contains supplementary material available at 10.1186/s40814-022-01002-6.

Understanding Clinician Macrocognition to Inform the Design of a Congenital Heart Disease Clinical Decision Support System

Background and Objectives

Children with congenital heart disease (CHD) are at risk of deterioration in the face of common childhood illnesses, and their resuscitation and acute treatment requires guidance of CHD experts. Many children with CHD, however, present to their local emergency departments (ED) with gastrointestinal and respiratory symptoms that closely mimic symptoms of CHD related heart failure. This can lead to incorrect or delayed diagnosis and treatment where CHD expertise is limited. An understanding of the differences in cognitive decision-making processes between CHD experts and ED physicians can inform how best to support ED physicians when treating CHD patients.

Methods

Cardiac intensivists (CHD experts) and pediatric emergency department physicians (ED physicians) in a major academic cardiac center were interviewed using the critical decision method. Interview transcripts were coded deductively based on Schubert and Klein's macrocognitive frameworks and inductively to allow for new or modified characterization of dimensions.

Results

In total, 6 CHD experts and 7 ED physicians were interviewed for this study. Although both CHD experts and ED physicians spent a lot of time sensemaking, their approaches to sensemaking differed. CHD experts reported readily recognizing the physiology of complex congenital heart disease and focused primarily on ruling out cardiac causes for the presenting illness. ED physicians reported a delay in attributing the signs and symptoms of the presenting illness to congenital heart disease, because these clinical findings were often non-specific, and thus explored different diagnoses. CHD experts moved quickly to treatment and more time anticipating potential problems and making specific contingency plans, while ED physicians spent more time gathering a range of data prior to arriving at a diagnosis. These findings were then applied to develop a prototype web-based decision support application for patients with CHD.

Conclusion

There are differences in the cognitive processes used by CHD experts and ED physicians when managing CHD patients. An understanding of differences in the cognitive processes used by CHD experts and ED physicians can inform the development of potential interventions, such as clinical decision support systems and training pathways, to support decision making pertaining to the acute treatment of pediatric CHD patients.

Application of Human Factors Methods to Understand Missed Follow-up of Abnormal Test Results

OBJECTIVE

This study demonstrates application of human factors methods for understanding causes for lack of timely follow-up of abnormal test results ("missed results") in outpatient settings.

METHODS

We identified 30 cases of missed test results by querying electronic health record data, developed a critical decision method (CDM)-based interview guide to understand decision-making processes, and interviewed physicians who ordered these tests. We analyzed transcribed responses using a contextual inquiry (CI)-based methodology to identify contextual factors contributing to missed results. We then developed a CI-based flow model and conducted a fault tree analysis (FTA) to identify hierarchical relationships between factors that delayed action.

RESULTS

The flow model highlighted barriers in information flow and decision making, and the hierarchical model identified relationships between contributing factors for delayed action. Key findings including underdeveloped methods to track follow-up, as well as mismatches, in communication channels, timeframes, and expectations between patients and physicians.

CONCLUSION

This case report illustrates how human factors-based approaches can enable analysis of contributing factors that lead to missed results, thus informing development of preventive strategies to address them.

Application of human factors to improve usability of clinical decision support for diagnostic decision-making: a scenario-based simulation study

OBJECTIVE

In this study, we used human factors (HF) methods and principles to design a clinical decision support (CDS) that provides cognitive support to the pulmonary embolism (PE) diagnostic decision-making process in the emergency department. We hypothesised that the application of HF methods and principles will produce a more usable CDS that improves PE diagnostic decision-making, in particular decision about appropriate clinical pathway.

MATERIALS AND METHODS

We conducted a scenario-based simulation study to compare a HF-based CDS (the so-called CDS for PE diagnosis (PE-Dx CDS)) with a web-based CDS (MDCalc); 32 emergency physicians performed various tasks using both CDS. PE-Dx integrated HF design principles such as automating information acquisition and analysis, and minimising workload. We assessed all three dimensions of usability using both objective and subjective measures: effectiveness (eg, appropriate decision regarding the PE diagnostic pathway), efficiency (eg, time spent, perceived workload) and satisfaction (perceived usability of CDS).

RESULTS

Emergency physicians made more appropriate diagnostic decisions (94% with PE-Dx; 84% with web-based CDS; p<0.01) and performed experimental tasks faster with the PE-Dx CDS (on average 96 s per scenario with PE-Dx; 117 s with web-based CDS; p<0.001). They also reported lower workload (p<0.001) and higher satisfaction (p<0.001) with PE-Dx.

CONCLUSIONS

This simulation study shows that HF methods and principles can improve usability of CDS and diagnostic decision-making. Aspects of the HF-based CDS that provided cognitive support to emergency physicians and improved diagnostic performance included automation of information acquisition (eg, auto-populating risk scoring algorithms), minimisation of workload and support of decision selection (eg, recommending a clinical pathway). These HF design principles can be applied to the design of other CDS technologies to improve diagnostic safety.

Mapping the territory of renal care: a formative analysis of the cognitive work involved in managing acute kidney injury

The design and evaluation of healthcare work systems requires an understanding of the cognitive work involved in healthcare tasks. Previous studies suggest that a formative approach would be particularly useful to examine healthcare activities for this purpose. In the present study, methods from cognitive work analysis and cognitive task analysis are combined in a formative examination of managing acute kidney injury, an activity that occurs across primary and secondary healthcare settings. The analyses are informed by interviews with healthcare practitioners and a review of practice guidelines. The findings highlight ways in which the task setting influenced practitioners' activity, and ways in which practitioners approached the activity (for example, how they used data to make decisions). The approach taken provided a rich understanding of the cognitive work involved, as well as generating suggestions for the design of work systems to support the clinical task. Practitioner summary: Healthcare tasks often require decision-making in complex and dynamic circumstances, potentially involving collaboration across different practitioner roles and locations. We demonstrate the use of a formative analysis to understand the cognitive work in managing a clinical syndrome across primary and secondary care settings, and consider the implications for work design.