Checklist for Early Recognition and Treatment of Acute Illness (CERTAIN): evolution of a content management system for point-of-care clinical decision support

A novel multimodal needs assessment to inform the longitudinal education program for an international interprofessional critical care team

BACKGROUND

The current global pandemic has caused unprecedented strain on critical care resources, creating an urgency for global critical care education programs. Learning needs assessment is a core element of designing effective, targeted educational interventions. In theory, multimodal methods are preferred to assess both perceived and unperceived learning needs in diverse, interprofessional groups, but a robust design has rarely been reported. Little is known about the best approach to determine the learning needs of international critical care professionals.

METHOD

We conducted multimodal learning needs assessment in a pilot group of critical care professionals in China using combined quantitative and qualitative methods. The assessments consisted of three phases: 1) Twenty statements describing essential entrustable professional activities (EPAs) were generated by a panel of critical care education experts using a Delphi method. 2) Eleven Chinese critical care professionals participating in a planned education program were asked to rank-order the statements according to their perceived learning priority using Q methodology. By-person factor analysis was used to study the typology of the opinions, and post-ranking focus group interviews were employed to qualitatively explore participants' reasoning of their rankings. 3) To identify additional unperceived learning needs, daily practice habits were audited using information from medical and nursing records for 3 months.

RESULTS

Factor analysis of the rank-ordered statements revealed three learning need patterns with consensual and divergent opinions. All participants expressed significant interest in further education on organ support and disease management, moderate interest in quality improvement topics, and relatively low interest in communication skills. Interest in learning procedure/resuscitation skills varied. The chart audit revealed suboptimal adherence to several evidence-based practices and under-perceived practice gaps in patient-centered communication, daily assessment of antimicrobial therapy discontinuation, spontaneous breathing trial, and device discontinuation.

CONCLUSIONS

We described an effective mixed-methods assessment to determine the learning needs of an international, interprofessional critical care team. The Q survey and focus group interviews prioritized and categorized perceived learning needs. The chart audit identified additional practice gaps that were not identified by the learners. Multimodal methods can be employed in cross-cultural scenarios to customize and better target medical education curricula.

Enhancing Diagnosis Through Technology: Decision Support, Artificial Intelligence, and Beyond

Patient care in intensive care environments is complex, time-sensitive, and data-rich, factors that make these settings particularly well-suited to clinical decision support (CDS). A wide range of CDS interventions have been used in intensive care unit environments. The field needs well-designed studies to identify the most effective CDS approaches. Evolving artificial intelligence and machine learning models may reduce information-overload and enable teams to take better advantage of the large volume of patient data available to them. It is vital to effectively integrate new CDS into clinical workflows and to align closely with the cognitive processes of frontline clinicians.

Impact of Checklist for Early Recognition and Treatment of Acute Illness on Treatment of Critically Ill Septic Patients in a Low-Resource Medical Intensive Care Unit

Introduction: Treatment of sepsis and septic shock can be a challenge even for intensive care units (ICUs) in high income countries, but it is especially difficult for ICUs with limited resources. Aim: To evaluate the impact of CERTAIN on treatment of critically ill septic patients in low-resource medical ICU. Materials and Methods: In a before-and-after study design, we compared clinical outcomes, processes, and complications (hospital acquired infections) 1 year before and 2 years after (2016 and 2017) introduction of CERTAIN. Results: A total of 125 patients with sepsis were prospectively identified for a 3-year period. Mean patient age, gender distribution, number of patients on mechanical ventilation (33 [76.7%] vs. 42 [84%] vs. 24 [75%]) and vasopressor use (23 [53.5%] vs. 34 [68%] vs. 24 [75%]) were similar before (2015) and 2 years after (2016 and 2017) the implementation of CERTAIN. Severity of illness (Simplified Acute Physiology Score II [SAPS II score]) was higher after the implementation. The checklist was incorporated in the daily practice with 100% adherence to its use. The duration of mechanical ventilation (5.3 ± 5.3 vs. 4.2 ± 3.6 vs. 3.7 ± 5.5), antibiotic treatment (8.2 ± 5.4 vs. 6.9 ± 4.1 vs. 5.8 ± 5.6), central venous catheter use (6.2 ± 5.7 vs. 5.7 ± 4.6 vs. 4.2 ± 6.1), ICU stay (8.4 ± 5.4 vs. 7.1 ± 4.1 vs. 5.8 ± 5.6), and the incidence of nosocomial infection (33.3% vs. 30% vs. 12.5%) decreased in the period after the onset of the intervention, but the results did not reach statistical significance. When adjusted for baseline characteristics, CERTAIN was not associated with hospital mortality (odds ratio 0.88, 0.38-2.04). Conclusion: CERTAIN was readily adopted in the ICU workflow and was associated with improvement in treatment of critically ill patients with sepsis.

Checklist for Early Recognition and Treatment of Acute Illness and Injury: An Exploratory Multicenter International Quality-Improvement Study in the ICUs With Variable Resources

Supplemental Digital Content is available in the text.

OBJECTIVES:

To determine whether the “Checklist for Early Recognition and Treatment of Acute Illness and Injury” decision support tool during ICU admission and rounding is associated with improvements in nonadherence to evidence-based daily care processes and outcomes in variably resourced ICUs.

DESIGN, SETTINGS, PATIENTS:

This before-after study was performed in 34 ICUs (15 countries) from 2013 to 2017. Data were collected for 3 months before and 6 months after Checklist for Early Recognition and Treatment of Acute Illness and Injury implementation.

INTERVENTIONS:

Checklist for Early Recognition and Treatment of Acute Illness and Injury implementation using remote simulation training.

MEASUREMENTS AND MAIN RESULTS:

The coprimary outcomes, modified from the original protocol before data analysis, were nonadherence to 10 basic care processes and ICU and hospital length of stay. There were 1,447 patients in the preimplementation phase and 2,809 patients in the postimplementation phase. After adjusting for center effect, Checklist for Early Recognition and Treatment of Acute Illness and Injury implementation was associated with reduced nonadherence to care processes (adjusted incidence rate ratio [95% CI]): deep vein thrombosis prophylaxis (0.74 [0.68–0.81), peptic ulcer prophylaxis (0.46 [0.38–0.57]), spontaneous breathing trial (0.81 [0.76–0.86]), family conferences (0.86 [0.81–0.92]), and daily assessment for the need of central venous catheters (0.85 [0.81–0.90]), urinary catheters (0.84 [0.80–0.88]), antimicrobials (0.66 [0.62–0.71]), and sedation (0.62 [0.57–0.67]). Analyses adjusted for baseline characteristics showed associations of Checklist for Early Recognition and Treatment of Acute Illness and Injury implementation with decreased ICU length of stay (adjusted ratio of geometric means [95% CI]) 0.86 [0.80–0.92]), hospital length of stay (0.92 [0.85–0.97]), and hospital mortality (adjusted odds ratio [95% CI], 0.81 (0.69–0.95).

CONCLUSIONS:

A quality-improvement intervention with remote simulation training to implement a decision support tool was associated with decreased nonadherence to daily care processes, shorter length of stay, and decreased mortality.

Testing the effects of checklists on team behaviour during emergencies on general wards: An observational study using high-fidelity simulation

INTRODUCTION

Clinical teams struggle on general wards with acute management of deteriorating patients. We hypothesized that the Crisis Checklist App, a mobile application containing checklists tailored to crisis-management, can improve teamwork and acute care management.

METHODS

A before-and-after study was undertaken in high-fidelity simulation centres in the Netherlands, Denmark and United Kingdom. Clinical teams completed three scenarios with a deteriorating patient without checklists followed by three scenarios using the Crisis Checklist App. Teamwork performance as the primary outcome was assessed by the Mayo High Performance Teamwork scale. The secondary outcomes were the time required to complete all predefined safety-critical steps, percentage of omitted safety-critical steps, effects on other non-technical skills, and users' self-assessments. Linear mixed models and a non-parametric survival test were conducted to assess these outcomes.

RESULTS

32 teams completed 188 scenarios. The Mayo High Performance Teamwork scale mean scores improved to 23.4 out of 32 (95% CI: 22.4-24.3) with the Crisis Checklist App compared to 21.4 (20.4-22.3) with local standard of care. The mean difference was 1.97 (1.34-2.6; p < 0.001). Teams that used the checklists were able to complete all safety-critical steps of a scenario in more simulations (40/95 vs 21/93 scenarios) and these steps were completed faster (stratified log-rank test χ² = 8.0; p = 0.005). The self-assessments of the observers and users showed favourable effects after checklist usage for other non-technical skills including situational awareness, decision making, task management and communication.

CONCLUSIONS

Implementation of a novel mobile crisis checklist application among clinical teams was associated in a simulated general ward setting with improved teamwork performance, and a higher and faster completion rate of predetermined safety-critical steps.

Optimizing respiratory management in resource-limited settings

PURPOSE OF REVIEW

This review focuses on the emerging body of literature regarding the management of acute respiratory failure in low- and middle-income countries (LMICs). The aim is to abstract management principles that are of relevance across a variety of settings where resources are severely limited.

RECENT FINDINGS

Mechanical ventilation is an expensive intervention associated with considerable mortality and a high rate of iatrogenic complications in many LMICs. Recent case series report crude mortality rates for ventilated patients of between 36 and 72%. Measures to avert the need for invasive mechanical ventilation in LMICs are showing promise: bubble continuous positive airway pressure has been demonstrated to decrease mortality in children with acute respiratory failure and trials suggest that noninvasive ventilation can be conducted safely in settings where resources are low.

SUMMARY

The management of patients with acute respiratory failure in LMICs should focus on avoiding intubation where possible, improving the safety of mechanical ventilation and expediting weaning. Future directions should involve the development and trialing of robust and context-appropriate respiratory support technology.

Implementation and Evaluation of a Web-Based Distribution System For Anesthesia Department Guidelines and Standard Operating Procedures: Qualitative Study and Content Analysis

BACKGROUND

Digitization is spreading exponentially in medical care, with improved availability of electronic devices. Guidelines and standard operating procedures (SOPs) form an important part of daily clinical routine, and adherence is associated with improved outcomes.

OBJECTIVE

This study aimed to evaluate a digital solution for the maintenance and distribution of SOPs and guidelines in 2 different anesthesiology departments in Switzerland.

METHODS

A content management system (CMS), WordPress, was set up in 2 tertiary-level hospitals within 1 year: the Department of Anesthesiology and Pain Medicine at the Kantonsspital Lucerne in Lucerne, Switzerland, as an open-access system, followed by a similar system for internal usage in the Department of Anaesthesiology and Pain Medicine of the Inselspital, Bern University Hospital, in Bern, Switzerland. We analyzed the requirements and implementation processes needed to successfully set up these systems, and we evaluated the systems' impact by analyzing content and usage.

RESULTS

The systems' generated exportable metadata, such as traffic and content. Analysis of the exported metadata showed that the Lucerne website had 269 pages managed by 44 users, with 88,124 visits per month (worldwide access possible), and the Bern website had 341 pages managed by 35 users, with 1765 visits per month (access only possible from within the institution). Creation of an open-access system resulted in third-party interest in the published guidelines and SOPs. The implementation process can be performed over the course of 1 year and setup and maintenance costs are low.

CONCLUSIONS

A CMS, such as WordPress, is a suitable solution for distributing and managing guidelines and SOPs. Content is easily accessible and is accessed frequently. Metadata from the system allow live monitoring of usage and suggest that the system be accepted and appreciated by the users. In the future, Web-based solutions could be an important tool to handle guidelines and SOPs, but further studies are needed to assess the effect of these systems.

Critical care outcomes in resource-limited settings

PURPOSE OF REVIEW

The burden of critical illness in low-income and middle-income countries (LMICs) is substantial. A better understanding of critical care outcomes is essential for improving critical care delivery in resource-limited settings. In this review, we provide an overview of recent literature reporting on critical care outcomes in LMICs. We discuss several barriers and potential solutions for a better understanding of critical care outcomes in LMICs.

RECENT FINDINGS

Epidemiologic studies show higher in-hospital mortality rates for critically ill patients in LMICs as compared with patients in high-income countries (HICs). Recent findings suggest that critical care interventions that are effective in HICs may not be effective and may even be harmful in LMICs. Little data on long-term and morbidity outcomes exist. Better outcomes measurement is beginning to emerge in LMICs through decision support tools that report process outcome measures, studies employing mobile health technologies with community health workers and the development of context-specific severity of illness scores.

SUMMARY

Outcomes from HICs cannot be reliably extrapolated to LMICs, so it is important to study outcomes for critically ill patients in LMICs. Specific challenges to achieving meaningful outcomes studies in LMICs include defining the critically ill population when few ICU beds exist, the resource-intensiveness of long-term follow-up, and the need for reliable severity of illness scores to interpret outcomes. Although much work remains to be done, examples of studies overcoming these challenges are beginning to emerge.

Impact of weekly case-based tele-education on quality of care in a limited resource medical intensive care unit

Background

Limited critical care subspecialty training and experience is available in many low- and middle-income countries, creating barriers to the delivery of evidence-based critical care. We hypothesized that a structured tele-education critical care program using case-based learning and ICU management principles is an efficient method for knowledge translation and quality improvement in this setting.

Methods and interventions

Weekly 45-min case-based tele-education rounds were conducted in the recently established medical intensive care unit (MICU) in Banja Luka, Bosnia and Herzegovina. The Checklist for Early Recognition and Treatment of Acute Illness (CERTAIN) was used as a platform for structured evaluation of critically ill cases. Two practicing US intensivists fluent in the local language served as preceptors using a secure two-way video communication platform. Intensive care unit structure, processes, and outcomes were evaluated before and after the introduction of the tele-education intervention.

Results

Patient demographics and acuity were similar before (2015) and 2 years after (2016 and 2017) the intervention. Sixteen providers (10 physicians, 4 nurses, and 2 physical therapists) evaluated changes in the ICU structure and processes after the intervention. Structural changes prompted by the intervention included standardized admission and rounding practices, incorporation of a pharmacist and physical therapist into the interprofessional ICU team, development of ICU antibiogram and hand hygiene programs, and ready access to point of care ultrasound. Process changes included daily sedation interruption, protocolized mechanical ventilation management and liberation, documentation of daily fluid balance with restrictive fluid and transfusion strategies, daily device assessment, and increased family presence and participation in care decisions. Less effective (dopamine, thiopental, aminophylline) or expensive (low molecular weight heparin, proton pump inhibitor) medications were replaced with more effective (norepinephrine, propofol) or cheaper (unfractionated heparin, H2 blocker) alternatives. The intervention was associated with reduction in ICU (43% vs 27%) and hospital (51% vs 44%) mortality, length of stay (8.3 vs 3.6 days), cost savings ($400,000 over 2 years), and a high level of staff satisfaction and engagement with the tele-education program.

Conclusions

Weekly, structured case-based tele-education offers an attractive option for knowledge translation and quality improvement in the emerging ICUs in low- and middle-income countries.

Electronic supplementary material

The online version of this article (10.1186/s13054-019-2494-6) contains supplementary material, which is available to authorized users.

Reliability and Validity of the Checklist for Early Recognition and Treatment of Acute Illness and Injury as a Charting Tool in the Medical Intensive Care Unit

Background:

Resuscitation of critically ill patients is complex and potentially prone to diagnostic errors and therapeutic harm. The Checklist for early recognition and treatment of acute illness and injury (CERTAIN) is an electronic tool that aims to provide decision-support, charting, and prompting for standardization. This study sought to evaluate the validity and reliability of CERTAIN in a real-time Intensive Care Unit (ICU).

Materials and Methods:

This was a prospective pilot study in the medical ICU of a tertiary care medical center. A total of thirty patient encounters over 2 months period were charted independently by two CERTAIN investigators. The inter-observer recordings and comparison to the electronic medical records (EMR) were used to evaluate reliability and validity, respectively. The primary outcome was reliability and validity measured using Cohen's Kappa statistic. Secondary outcomes included time to completion, user satisfaction, and learning curve.

Results:

A total of 30 patients with a median age of 59 (42–78) years and median acute physiology and chronic health evaluation III score of 38 (23–50) were included in this study. Inter-observer agreement was very good (κ = 0.79) in this study and agreement between CERTAIN and the EMR was good (κ = 0.5). CERTAIN charting was completed in real-time that was 121 (92–150) min before completion of EMR charting. The subjective learning curve was 3.5 patients without differences in providers with different levels of training.

Conclusions:

CERTAIN provides a reliable and valid method to evaluate resuscitation events in real time. CERTAIN provided the ability to complete data in real-time.