Variability in Nursing Documentation Patterns across Patients' Hospital Stays

This study explores the variability in nursing documentation patterns in acute care and ICU settings, focusing on vital signs and note documentation, and examines how these patterns vary across patients' hospital stays, documentation types, and comorbidities. In both acute care and critical care settings, there was significant variability in nursing documentation patterns across hospital stays, by documentation type, and by patients' comorbidities. The results suggest that nurses adapt their documentation practices in response to their patients' fluctuating needs and conditions, highlighting the need to facilitate more individualized care and tailored documentation practices. The implications of these findings can inform decisions on nursing workload management, clinical decision support tools, and EHR optimizations.

The Communicating Narrative Concerns Entered by Registered Nurses (CONCERN) Clinical Decision Support Early Warning System: Protocol for a Cluster Randomized Pragmatic Clinical Trial

Background

Every year, hundreds of thousands of inpatients die from cardiac arrest and sepsis, which could be avoided if those patients’ risk for deterioration were detected and timely interventions were initiated. Thus, a system is needed to convert real-time, raw patient data into consumable information that clinicians can utilize to identify patients at risk of deterioration and thus prevent mortality and improve patient health outcomes. The overarching goal of the COmmunicating Narrative Concerns Entered by Registered Nurses (CONCERN) study is to implement and evaluate an early warning score system that provides clinical decision support (CDS) in electronic health record systems. With a combination of machine learning and natural language processing, the CONCERN CDS utilizes nursing documentation patterns as indicators of nurses’ increased surveillance to predict when patients are at the risk of clinical deterioration.

Objective

The objective of this cluster randomized pragmatic clinical trial is to evaluate the effectiveness and usability of the CONCERN CDS system at 2 different study sites. The specific aim is to decrease hospitalized patients’ negative health outcomes (in-hospital mortality, length of stay, cardiac arrest, unanticipated intensive care unit transfers, and 30-day hospital readmission rates).

Methods

A multiple time-series intervention consisting of 3 phases will be performed through a 1-year period during the cluster randomized pragmatic clinical trial. Phase 1 evaluates the adoption of our algorithm through pilot and trial testing, phase 2 activates optimized versions of the CONCERN CDS based on experience from phase 1, and phase 3 will be a silent release mode where no CDS is viewable to the end user. The intervention deals with a series of processes from system release to evaluation. The system release includes CONCERN CDS implementation and user training. Then, a mixed methods approach will be used with end users to assess the system and clinician perspectives.

Results

Data collection and analysis are expected to conclude by August 2022. Based on our previous work on CONCERN, we expect the system to have a positive impact on the mortality rate and length of stay.

Conclusions

The CONCERN CDS will increase team-based situational awareness and shared understanding of patients predicted to be at risk for clinical deterioration in need of intervention to prevent mortality and associated harm.

Trial Registration

ClinicalTrials.gov NCT03911687; https://clinicaltrials.gov/ct2/show/NCT03911687

International Registered Report Identifier (IRRID)

DERR1-10.2196/30238

Nursing Documentation Variation Across Different Medical Facilities Within an Integrated Healthcare System

The purpose of this study was to demonstrate nursing documentation variation based on electronic health record design and its relationship with different levels of care by reviewing how various flowsheet measures, within the same electronic health record across an integrated healthcare system, are documented in different types of medical facilities. Flowsheet data with information on patients who were admitted to academic medical centers, community hospitals, and rehabilitation centers were used to calculate the frequency of flowsheet entries documented. We then compared the distinct flowsheet measures documented in five flowsheet templates across the different facilities. We observed that each type of healthcare facility appeared to have distinct clinical care foci and flowsheet measures documented differed within the same template based on facility type. Designing flowsheets tailored to study settings can meet the needs of end users and increase documentation efficiency by reducing time spent on unrelated flowsheet measures. Furthermore, this process can save nurses time for direct patient care.

Mining clinical phrases from nursing notes to discover risk factors of patient deterioration

OBJECTIVE

Early identification and treatment of patient deterioration is crucial to improving clinical outcomes. To act, hospital rapid response (RR) teams often rely on nurses' clinical judgement typically documented narratively in the electronic health record (EHR). We developed a data-driven, unsupervised method to discover potential risk factors of RR events from nursing notes.

METHODS

We applied multiple natural language processing methods, including language modelling, word embeddings, and two phrase mining methods (TextRank and NC-Value), to identify quality phrases that represent clinical entities from unannotated nursing notes. TextRank was used to determine the important word-sequences in each note. NC-Value was then used to globally rank the locally-important sequences across the whole corpus. We evaluated our method both on its accuracy compared to human judgement and on the ability of the mined phrases to predict a clinical outcome, RR event hazard.

RESULTS

When applied to 61,740 hospital encounters with 1,067 RR events and 778,955 notes, our method achieved an average precision of 0.590 to 0.764 (when excluding numeric tokens). Time-dependent covariates Cox model using the phrases achieved a concordance index of 0.739. Clustering the phrases revealed clinical concepts significantly associated with RR event hazard.

DISCUSSION

Our findings demonstrate that our minimal-annotation, unsurprised method can rapidly mine quality phrases from a large amount of nursing notes, and these identified phrases are useful for downstream tasks, such as clinical outcome predication and risk factor identification.

Identifying nurses' concern concepts about patient deterioration using a standard nursing terminology

OBJECTIVES

Nurse concerns documented in nursing notes are important predictors of patient risk of deterioration. Using a standard nursing terminology and inputs from subject-matter experts (SMEs), we aimed to identify and define nurse concern concepts and terms about patient deterioration, which can be used to support subsequent automated tasks, such as natural language processing and risk predication.

METHODS

Group consensus meetings with nurse SMEs were held to identify nursing concerns by grading Clinical Care Classification (CCC) system concepts based on clinical knowledge. Next, a fundamental lexicon was built placing selected CCC concepts into a framework of entities and seed terms to extend CCC granularity.

RESULTS

A total of 29 CCC concepts were selected as reflecting nurse concerns. From these, 111 entities and 586 seed terms were generated into a fundamental lexicon. Nursing concern concepts differed across settings (intensive care units versus non-intensive care units) and unit types (medicine versus surgery units).

CONCLUSIONS

The CCC concepts were useful for representing nursing concern as they encompass a nursing-centric conceptual framework and are practical in lexicon construction. It enabled the codification of nursing concerns for deteriorating patients at a standardized conceptual level. The boundary of selected CCC concepts and lexicons were determined by the SMEs. The fundamental lexicon offers more granular terms that can be identified and processed in an automated fashion.

Unsupervised Machine Learning of Topics Documented by Nurses about Hospitalized Patients Prior to a Rapid-Response Event

BACKGROUND

In the hospital setting, it is crucial to identify patients at risk for deterioration before it fully develops, so providers can respond rapidly to reverse the deterioration. Rapid response (RR) activation criteria include a subjective component ("worried about the patient") that is often documented in nurses' notes and is hard to capture and quantify, hindering active screening for deteriorating patients.

OBJECTIVES

We used unsupervised machine learning to automatically discover RR event risk/protective factors from unstructured nursing notes.

METHODS

In this retrospective cohort study, we obtained nursing notes of hospitalized, nonintensive care unit patients, documented from 2015 through 2018 from Partners HealthCare databases. We applied topic modeling to those notes to reveal topics (clusters of associated words) documented by nurses. Two nursing experts named each topic with a representative Systematized Nomenclature of Medicine-Clinical Terms (SNOMED CT) concept. We used the concepts along with vital signs and demographics in a time-dependent covariates extended Cox model to identify risk/protective factors for RR event risk.

RESULTS

From a total of 776,849 notes of 45,299 patients, we generated 95 stable topics, of which 80 were mapped to 72 distinct SNOMED CT concepts. Compared with a model containing only demographics and vital signs, the latent topics improved the model's predictive ability from a concordance index of 0.657 to 0.720. Thirty topics were found significantly associated with RR event risk at a 0.05 level, and 11 remained significant after Bonferroni correction of the significance level to 6.94E-04, including physical examination (hazard ratio [HR] = 1.07, 95% confidence interval [CI], 1.03-1.12), informing doctor (HR = 1.05, 95% CI, 1.03-1.08), and seizure precautions (HR = 1.08, 95% CI, 1.04-1.12).

CONCLUSION

Unsupervised machine learning methods can automatically reveal interpretable and informative signals from free-text and may support early identification of patients at risk for RR events.

CONCERN Factorial Design Survey (FDS) Methods Test: Using REDCap as a Survey Platform

We assessed the feasibility of using REDCap as a factorial design survey (FDS) platform. REDCap lacks randomization and automation functionality, requiring the development of a workaround. A template survey was created containing all vignettes, copied for each survey instance and edited to hide unwanted content. REDCap configuration required three hours for forty-two surveys. The utilized "copy-and-hide" workaround was successful, providing quasi-automation and reasonable labor-time. Additional strategies are planned using REDCap's Data Dictionary and other survey software.