Validation of "nine equivalents of nursing manpower use score" on an independent data sample

Weak Correlation Between Perceived and Measured Intensive Care Unit Nursing Workload: An Observational Study

BACKGROUND

Efficient management of nursing workload in the intensive care unit (ICU) is essential for patient safety, care quality, and nurse well-being. Current ICU-specific workload assessment scores lack comprehensive coverage of nursing activities and perceived workload.

PURPOSE

The purpose of this study was to assess the correlation between ICU nurses' perceived workload and the Nine Equivalents of Nursing Manpower Use Score (NEMS).

METHODS

In a 45-bed adult ICU at a tertiary academic hospital, nurses' perceived shift workload (measured with an 11-point Likert scale) was correlated with the NEMS, calculated manually and electronically.

RESULTS

The study included 1734 observations. The perceived workload was recorded for 77.6% of observations. A weak positive correlation was found between perceived and objectively measured workload.

CONCLUSION

Findings indicate a need to consider the multifaceted nature of nursing activities and individual workload perceptions in the ICU.

Prone positioning in COVID-19 patients with acute respiratory distress syndrome and invasive mechanical ventilation

OBJECTIVE

To identify adverse events related to prone positioning in COVID-19 patients with severe disease and acute respiratory distress syndrome, to analyze the risk factors associated with the development of anterior pressure ulcers, to determine whether the recommendation of prone positioning is associated with improved clinical outcomes.

METHODS

Retrospective study performed in 63 consecutive patients with COVID-19 pneumonia admitted to intensive care unit on invasive mechanical ventilation and treated with prone positioning between March and April 2020. Association between prone-related pressure ulcers and selected variables was explored by the means of logistic regression.

RESULTS

A total of 139 proning cycles were performed. The mean number of cycles were 2 [1-3] and the mean duration per cycle was of 22h [15-24]. The prevalence of adverse events this population was 84.9 %, being the physiologic ones (i.e., hypo/hypertension) the most prevalent. 29 out of 63 patients (46%) developed prone-related pressure ulcers. The risk factors for prone-related pressure ulcers were older age, hypertension, levels of pre-albumin <21mg/dl, the number of proning cycles and severe disease. We observed a significant increase in the PaO₂/FiO₂ at different time points during the prone positioning, and a significant decrease after it.

CONCLUSIONS

There is a high incidence of adverse events due to PD, with the physiological type being the most frequent. The identification of the main risk factors for the development of prone-related pressure ulcers will help to prevent the occurrence of these lesions during the prone positioning. Prone positioning offered an improvement in the oxygenation in these patients.

Decúbito prono en pacientes COVID-19 con síndrome de distrés respiratorio agudo y ventilación mecánica invasiva

Objetivos: Identificar eventos adversos secundarios al decúbito prono (DP) en pacientes con COVID-19 con síndrome de distrés respiratorio agudo (SDRA) moderado/severo, analizar los factores de riesgo para el desarrollo de úlceras por presión (UPP) en DP y describir la evolución oximétrica de estos pacientes durante el DP.

Método: Estudio descriptivo retrospectivo realizado sobre 63 pacientes ingresados en la UCI de un hospital de segundo nivel, con neumonía por SARS-CoV-2, SDRA moderado/severo, ventilación mecánica invasiva, que precisaron maniobras de DP, durante marzo y abril de 2020. Se usó un muestreo no probabilístico consecutivo y se analizaron las variables seleccionadas a través de una regresión logística.

Resultados: Se realizaron un total de 139 sesiones de pronación. La mediana de sesiones fue de 2 [1-3] y la duración de 22 horas [15-24] por sesión. La aparición de eventos adversos ocurrió en un 84,9% de los casos, siendo las fisiológicas (ej. hiper/hipotensión) las más frecuentes. Al comparar pacientes pronados que mantuvieron la integridad cutánea (34 de 63 pacientes, un 54%) versus los que desarrollaron UPP (29 de 63, un 46%), estos últimos presentaron los siguientes factores de riesgo: mayor edad, ser hipertensos, pre-albúmina <21mg/dl, mayor número de sesiones de prono y mayor gravedad al ingreso. Se observó un incremento significativo entre la PaO₂/FiO₂ previa al DP y en los diferentes cortes temporales durante el prono, además de una caída significativa tras despronar.

Conclusiones: Existe una alta incidencia de eventos adversos debidos al DP, siendo los de tipo fisiológico los más frecuentes. La identificación de varios factores de riesgo para el desarrollo de UPP ayudará a prevenir la aparición de estas lesiones durante la pronación. La terapia de DP en pacientes COVID-19 con SDRA moderado/severo ha demostrado una mejora en los parámetros de oxigenación.

External validation of a prognostic model for intensive care unit mortality: a retrospective study using the Ontario Critical Care Information System

PURPOSE

To externally validate an intensive care unit (ICU) mortality prediction model that was created using the Ontario Critical Care Information System (CCIS), which includes the Multiple Organ Dysfunction Score (MODS).

METHODS

We applied the Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD) recommendations to a prospective longitudinal cohort of patients discharged between 1 July 2015 and 31 December 31 2016 from 90 adult level-3 critical care units in Ontario. We used multivariable logistic regression with measures of discrimination, calibration-in-the-large, calibration slope, and flexible calibration plots to compare prediction model performance of the entire data set and for each ICU subtype.

RESULTS

Among 121,201 CCIS records with ICU mortality of 11.3%, the C-statistic for the validation data set was 0.805. The C-statistic ranged from 0.775 to 0.846 among the ICU subtypes. After intercept recalibration to adjust the baseline risk, the mean predicted risk of death matched actual ICU mortality. The calibration slope was close to 1 with all CCIS data and ICU subtypes of cardiovascular and community hospitals with low ventilation rates. Calibration slopes significantly less than 1 were found for ICUs in teaching hospitals and community hospitals with high ventilation rates whereas coronary care units had a calibration slope significantly higher than 1. Calibration plots revealed over-prediction in high risk groups to a varying degree across all cohorts.

CONCLUSIONS

A risk prediction model primarily based on the MODS shows reproducibility and transportability after intercept recalibration. Risk adjusting models that use existing and feasible data collection can support performance measurement at the individual ICU level.

A novel method to assess data quality in large medical registries and databases

BACKGROUND

There is no gold standard to assess data quality in large medical registries. Data auditing may be impeded by data protection regulations.

OBJECTIVE

To explore the applicability and usefulness of funnel plots as a novel tool for data quality control in critical care registries.

METHOD

The Swiss ICU-Registry from all 77 certified adult Swiss ICUs (2014 and 2015) was subjected to quality assessment (completeness/accuracy). For the analysis of accuracy, a list of logical rules and cross-checks was developed. Type and number of errors (true coding errors or implausible data) were calculated for each ICU, along with noticeable error rates (>mean + 3 SD in the variable's summary measure, or >99.8% CI in the respective funnel-plot).

RESULTS

We investigated 164 415 patient records with 31 items each (37 items: trauma diagnosis). Data completeness was excellent; trauma was the only incomplete item in 1495 of 9871 records (0.1%, 0.0%-0.6% [median, IQR]). In 15 572 patients records (9.5%), we found 3121 coding errors and 31 265 implausible situations; the latter primarily due to non-specific information on patients' provenance/diagnosis or supposed incoherence between diagnosis and treatments. Together, the error rate was 7.6% (5.9%-11%; median, IQR).

CONCLUSIONS

The Swiss ICU-Registry is almost complete and data quality seems to be adequate. We propose funnel plots as suitable, easy to implement instrument to assist in quality assurance of such a registry. Based on our analysis, specific feedback to ICUs with special-cause variation is possible and may promote such ICUs to improve the quality of their data.

Validation of the burn intervention score in a National Burn Centre

The Linköping burn score has been used for two decades to calculate the cost to the hospital of each burned patient. Our aim was to validate the Burn Score in a dedicated Burn Centre by analysing the associations with burn-specific factors: percentage of total body surface area burned (TBSA%), cause of injury, patients referred from other (non-specialist) centres, and survival, to find out which of these factors resulted in higher scores. Our second aim was to analyse the variation in scores of each category of care (surveillance, respiration, circulation, wound care, mobilisation, laboratory tests, infusions, and operation). We made a retrospective analysis of all burned patients admitted during the period 2000-15. Multivariable regression models were used to analyse predictive factors for an increased daily burn score, the cumulative burn score (the sum of the daily burn scores for each patient) and the total burn score (total sum of burn scores for the whole group throughout the study period) in addition to sub-analysis of the different categories of care that make up the burn score. We retrieved 22301 daily recordings for inpatients. Mobilisation and care of the wound accounted for more than half of the total burn score during the study. Increased TBSA% and age over 45 years were associated with increased cumulative (model R² 0.43, p<0.001) and daily (model R² 0.61, p<0.001) burn scores. Patients who died had higher daily burn scores, while the cumulative burn score decreased with shorter duration of hospital stay (p<0.001). To our knowledge this is the first long term analysis and validation of a system for scoring burn interventions in patients with burns that explores its association with the factors important for outcome. Calculations of costs are based on the score, and it provides an indicator of the nurses' workload. It also gives important information about the different dimensions of the care provided from thorough investigation of the scores for each category.

Outcome Rating Scales for Pediatric Head Injury

Intensivists, surgeons, neurologists, and others involved in pediatric intensive care units (PICUs) have an important investment in both short-and long-term outcomes of children and adolescents with head injury who are treated under their care. Outcomes are most often documented by either single-or multiple-item rating scales and are implemented both during and after hospital care. For this review, the authors have organized the content of rating scales into 6 general classes: (1) mortality prediction, (2) severity, (3) global recovery, (4) activity restrictions, (5) secondary adverse conditions, and (6) limitations in participation, quality of life, and health status. Rating scales that describe the outcomes of children and adolescents after head injury are used to monitor medical and functional recovery, guide clinical management, drive quality assurance initiatives, and conduct clinical research. The authors restrict their selective review to rating scales that describe child outcomes (vs family) and that have been reported and applied in the outcome literature. Although head injury is a major cause of mortality and short-and long-term morbidity in children and adolescents, there is no consensus on which rating scales are optimal for hospital care or community follow-up. Major considerations for clinical use are feasibility, type of outcome information needed, content breadth across multiple ages and levels of recovery, and utility in determining the short-term impact of PICU care on long-term outcome.

To develop a regional ICU mortality prediction model during the first 24 h of ICU admission utilizing MODS and NEMS with six other independent variables from the Critical Care Information System (CCIS) Ontario, Canada

Background

Intensive care unit (ICU) scoring systems or prediction models evolved to meet the desire of clinical and administrative leaders to assess the quality of care provided by their ICUs. The Critical Care Information System (CCIS) is province-wide data information for all Ontario, Canada level 3 and level 2 ICUs collected for this purpose. With the dataset, we developed a multivariable logistic regression ICU mortality prediction model during the first 24 h of ICU admission utilizing the explanatory variables including the two validated scores, Multiple Organs Dysfunctional Score (MODS) and Nine Equivalents Nursing Manpower Use Score (NEMS) followed by the variables age, sex, readmission to the ICU during the same hospital stay, admission diagnosis, source of admission, and the modified Charlson Co-morbidity Index (CCI) collected through the hospital health records.

Methods

This study is a single-center retrospective cohort review of 8822 records from the Critical Care Trauma Centre (CCTC) and Medical-Surgical Intensive Care Unit (MSICU) of London Health Sciences Centre (LHSC), Ontario, Canada between 1 Jan 2009 to 30 Nov 2012. Multivariable logistic regression on training dataset (n = 4321) was used to develop the model and validate by bootstrapping method on the testing dataset (n = 4501). Discrimination, calibration, and overall model performance were also assessed.

Results

The predictors significantly associated with ICU mortality included: age (p < 0.001), source of admission (p < 0.0001), ICU admitting diagnosis (p < 0.0001), MODS (p < 0.0001), and NEMS (p < 0.0001). The variables sex and modified CCI were not significantly associated with ICU mortality. The training dataset for the developed model has good discriminating ability between patients with high risk and those with low risk of mortality (c-statistic 0.787). The Hosmer and Lemeshow goodness-of-fit test has a strong correlation between the observed and expected ICU mortality (χ² = 5.48; p > 0.31). The overall optimism of the estimation between the training and testing data set ΔAUC = 0.003, indicating a stable prediction model.

Conclusions

This study demonstrates that CCIS data available after the first 24 h of ICU admission at LHSC can be used to create a robust mortality prediction model with acceptable fit statistic and internal validity for valid benchmarking and monitoring ICU performance.

Electronic supplementary material

The online version of this article (doi:10.1186/s40560-016-0143-6) contains supplementary material, which is available to authorized users.

[Analysis of the workload and the use of the nursing resources in an intensive care unit]

OBJECTIVE

To evaluate and assess the nursing workload (NW) scales by means of three scales and to determine the theoretical and real nurse/patient relationship in a polyvalent ICU.

METHODOLOGY

Cross-sectional descriptive study between July 2012 and June 2013 in patients over 18 years old, for which 3 nurses quantified, in randomized days, the NW by the Nursing Activities Score (NAS), Nine Equivalents Manpower Score (NEMS) and Valoración de Cargas de Trabajo y Tiempos de Enfermería (VACTE). Efficiency parameters of nursing resources were calculated: "work utilization ratio" (WUR), "level of care" operative (LOCop) and planned (LOCp). Data on demographics, length of stay and number of nurses were collected.

RESULTS

720 records were collected. The mean age was 64 (13.6) years. 73% were male and the median of length of stay was 3 (1-12) days. 60% were admitted for medical causes. The average total score was: NAS: 696.8 (111.6), NEMS: 311.8 (55.3) and VACTE: 4,978 (897.7). The required number of nurses according to NAS was 7 and 6,7 according to NEMS and VACTE. The actual average was 5.5. On all 3 scales the WUR was >1 and LOCop was 1.6 pacients/nurse. The LOCp was 2 patients/nurse.

CONCLUSION

Assessing NW allows to know the reality of each unit. According to the scales and efficiency parameters of the nursing resources used, there is a shortage of nurses in relation to the work generated. NAS reflects more parameters of NW.

[Validating the Spanish version of the Nursing Activities Score]

INTRODUCTION

Validating workload scores ensures that they are appropriate for the purpose for which they were developed.

OBJECTIVE

To validate the Nursing Activities Score (NAS) Spanish version.

METHODOLOGY

Observational and prospective study. 1,045 patients who were admitted to a medical-surgical unit and a serious burns unit in 2006 were included. The nurse in charge assessed patient workloads by Nine Equivalent of Nursing Manpower use Score and NAS. To assess the internal consistency of the measurements of NAS, item-test correlations, Cronbach's α and Cronbach's α corrected by omitting each of the items were calculated. The intraobserver and interobserver reliability were assessed with the intraclass correlation coefficient by viewing recordings and Kappa (interobserver reliability) was estimated. For the analysis of internal validity, a factorial principal components analysis was performed. Convergent validity was assessed using the Spearman correlation coefficient values obtained from the Nine Equivalent of Nursing Manpower use Score and Spanish-NAS scales.

RESULTS

For internal consistency, 164 questionnaires were analysed and a Cronbach's α of 0.373 was calculated. The intraclass correlation coefficient for intraobserver reliability estimate was 0.837 (95% IC: 0.466-0.950) and 0.662 (95% IC: 0.033-0.882) for interobserver reliability. The estimated kappa was 0.371. For internal validity, exploratory factor analysis showed that the first item explained 58.9% of the variance of the questionnaire. For convergent validity 1006 questionnaires were included and a Spearman correlation coefficient of 0.746 was observed.

CONCLUSIONS

The psychometric properties of Spanish-NAS are acceptable.

Emotional exhaustion and workload predict clinician-rated and objective patient safety

AIMS

To investigate the role of clinician burnout, demographic, and organizational characteristics in predicting subjective and objective indicators of patient safety.

BACKGROUND

Maintaining clinician health and ensuring safe patient care are important goals for hospitals. While these goals are not independent from each other, the interplay between clinician psychological health, demographic and organizational variables, and objective patient safety indicators is poorly understood. The present study addresses this gap.

METHOD

Participants were 1425 physicians and nurses working in intensive care. Regression analysis (multilevel) was used to investigate the effect of burnout as an indicator of psychological health, demographic (e.g., professional role and experience) and organizational (e.g., workload, predictability) characteristics on standardized mortality ratios, length of stay and clinician-rated patient safety.

RESULTS

Clinician-rated patient safety was associated with burnout, trainee status, and professional role. Mortality was predicted by emotional exhaustion. Length of stay was predicted by workload. Contrary to our expectations, burnout did not predict length of stay, and workload and predictability did not predict standardized mortality ratios.

CONCLUSION

At least in the short-term, clinicians seem to be able to maintain safety despite high workload and low predictability. Nevertheless, burnout poses a safety risk. Subjectively, burnt-out clinicians rated safety lower, and objectively, units with high emotional exhaustion had higher standardized mortality ratios. In summary, our results indicate that clinician psychological health and patient safety could be managed simultaneously. Further research needs to establish causal relationships between these variables and support to the development of managerial guidelines to ensure clinicians' psychological health and patients' safety.

Development of a Subjective Workload Assessment for Nurses: A Human Factors Approach

Background and Purpose: Research has revealed nurses’ perception that traditional workload measures do not adequately capture the complexity of workload. Using a human factors approach to address the multiple and complex dimensions from the subjective perception of the worker, the Subjective Workload Assessment for Nurses (SWAN) was developed. Methods: Survey data from 188 medical-surgical registered nurses were used to establish the instrument’s psychometric properties. Results: SWAN Sections 1, 2, and 3; General Information Form Section 1; and the Nursing Texas Load Index demonstrated internal consistency with this sample. Findings supported interrelationships between activity complexity, performance circumstances, and individual characteristics described in the literature. Conclusion: Further study is needed to refine the SWAN and to establish psychometric properties with nurses in other practice areas.

SwissScoring--a nationwide survey of NEMS assessing practices and its accuracy

BACKGROUND

The nine equivalents of nursing manpower use score (NEMS) is used to evaluate critical care nursing workload and occasionally to define hospital reimbursements. Little is known about the caregivers' accuracy in scoring, about factors affecting this accuracy and how validity of scoring is assured.

METHODS

Accuracy in NEMS scoring of Swiss critical care nurses was assessed using case vignettes. An online survey was performed to assess training and quality control of NEMS scoring and to collect structural and organizational data of participating intensive care units (ICUs). Aggregated structural and procedural data of the Swiss ICU Minimal Data Set were used for matching.

RESULTS

Nursing staff from 64 (82%) of the 78 certified adult ICUs participated in this survey. Training and quality control of scoring shows large variability between ICUs. A total of 1378 nurses scored one out of 20 case vignettes: accuracy ranged from 63.7% (intravenous medications) to 99.1% (basic monitoring). Erroneous scoring (8.7% of all items) was more frequent than omitted scoring (3.2%). Mean NEMS per case was 28.0 ± 11.8 points (reference score: 25.7 ± 14.2 points). Mean bias was 2.8 points (95% confidence interval: 1.0-4.7); scores below 37.1 points were generally overestimated. Data from units with a greater nursing management staff showed a higher bias.

CONCLUSION

Overall, nurses assess the NEMS score within a clinically acceptable range. Lower scores are generally overestimated. Inaccurate assessment was associated with a greater size of the nursing management staff. Swiss head nurses consider themselves motivated to assure appropriate scoring and its validation.

Correlation between the TISS-28 and NEMS indicators in an intensive care unit

Cross-sectional study aimed to analyse and compare the correlation between the Therapeutic Intervention Scoring System (TISS)-28 and Nine Equivalents of Nursing Manpower Use (NEMS) indicators with a sample of 725 patients, for which data was collected from the computerized system of a university hospital. The findings of the present study well demonstrated a strong correlation between the TISS-28 and NEMS, both at the time of patient admission and discharge (0.888 and 0.885; P < 0.001), although there is a dispersion of 21% in the data and established cut-off points to discriminate with greater power the death and no death scenarios. Further research is still necessary to confirm the possibility of replacing the TISS-28 scoring instrument with NEMS.

Validação Concorrente de Escores de Enfermagem (NEMS e TISS-28) em terapia intensiva pediátrica

OBJETIVO: Examinar a validade concorrente do escore Nine Equivalents of Nursing Manpower Use Score (NEMS) em comparação ao Therapeutic Intervention Scoring System-28 (TISS-28) em uma Unidade de Terapia Intensiva Pediátrica (UTIP). MÉTODOS: Estudo de coorte prospectivo observacional, realizado na UTIP de um hospital universitário brasileiro, no período de dois anos, com uma amostra de 816 pacientes. Foram realizadas 7.702 observações de cada um dos escores. RESULTADOS: A média da pontuação máxima do NEMS foi 26,6±9,2 e do TISS-28 21,3±8,2. Em todas as médias, o TISS-28 foi inferior ao NEMS (p<0,001). Houve uma boa correlação entre eles (r²=0,704 para todas as observações). A concordância entre o TISS-28 e o NEMS foi boa, apresentando apenas 6,2% de diferença entre os escores. CONCLUSÃO: Os resultados mostraram boa correlação e concordância entre o TISS-28 e o NEMS, permitindo validar o NEMS nessa população de pacientes pediátricos.

MEASURING WORKLOAD OF ICU NURSES WITH A QUESTIONNAIRE SURVEY: THE NASA TASK LOAD INDEX (TLX)

High workload of nurses in Intensive Care Units (ICUs) has been identified as a major patient safety and worker stress problem. However, relative little attention has been dedicated to the measurement of workload in healthcare. The objectives of this study are to describe and examine several methods to measure workload of ICU nurses. We then focus on the measurement of ICU nurses' workload using a subjective rating instrument: the NASA TLX.We conducted secondary data analysis on data from two, multi-side, cross-sectional questionnaire studies to examine several instruments to measure ICU nurses' workload. The combined database contains the data from 757 ICU nurses in 8 hospitals and 21 ICUs.Results show that the different methods to measure workload of ICU nurses, such as patient-based and operator-based workload, are only moderately correlated, or not correlated at all. Results show further that among the operator-based instruments, the NASA TLX is the most reliable and valid questionnaire to measure workload and that NASA TLX can be used in a healthcare setting. Managers of hospitals and ICUs can benefit from the results of this research as it provides benchmark data on workload experienced by nurses in a variety of ICUs.

Clinical review: scoring systems in the critically ill

General illness severity scores are widely used in the ICU to predict outcome, characterize disease severity and degree of organ dysfunction, and assess resource use. In this article we review the most commonly used scoring systems in each of these three groups. We examine the history of the development of the initial major systems in each group, discuss the construction of subsequent versions, and, when available, provide recent comparative data regarding their performance. Importantly, the different types of scores should be seen as complementary, rather than competitive and mutually exclusive. It is possible that their combined use could provide a more accurate indication of disease severity and prognosis. All these scoring systems will need to be updated with time as ICU populations change and new diagnostic, therapeutic and prognostic techniques become available.

Patient-level analysis of outcomes using structured labor and delivery data

This paper presents methods for identifying and analyzing associations among nursing care processes, patient attributes, and patient outcomes using unit-level and patient-level representations of care derived from computerized nurse documentation. The retrospective, descriptive analysis included documented nursing events for 900 Labor and Delivery patients at three hospitals over the 2-month period of January and February 2006. Two models were used to produce quantified measurements of nursing care received by each patient. The first model considered only the hourly census of nurses and patients. The second model considered the size of nurses' patient loads as represented by computerized nurse-entered documentation. Significant relationships were identified between durations of labor and nursing care scores generated by the second model. In addition to the clinical associations identified, the study demonstrated an approach with global application for representing the amount of nursing care received at the individual patient level in analyses of patient outcomes.

Health-related quality of life as a prognostic factor of survival in critically ill patients

OBJECTIVE

To evaluate whether health-related quality of life prior to admission into an intensive care unit (ICU) is a prognostic factor of hospital and 1 year mortality.

DESIGN

Prospective cohort study.

SETTING

Fourteen-bed medical-surgical ICU.

PATIENTS

A total of 377 patients admitted to the ICU for more than 24 h with 1-year follow-up after discharge from the hospital.

INTERVENTION

A health-related quality of life (HRQoL) survey was conducted, using the questionnaire developed by the "Project for the Epidemiological Analysis of Critical Care Patients", to assess patient's quality of life 1 month before ICU hospitalization.

RESULTS

Hospital mortality was independently associated with severity assessed by APACHE II, odds ratio (OR) 1.14 [95% confidence interval (CI) 1.08-1.2; P < 0.001], high workload assessed by Nine Equivalents of Nursing Manpower Score > 30 OR 3.6 (95% CI 1.4-9.0; P = 0.006), hospital length of stay prior to ICU admission of more than 2 days OR 2.6 (95% CI 1.3-5.4; P = 0.008), and bad quality of life prior to ICU admission assessed by a HRQoL score > or = 8 points OR 2.2 (95% CI 1.03-4.5; P = 0.04). Patients who scored > or =8 on the HRQoL survey presented a risk of demise 12 months after discharge almost twofold that of those who had good previous HRQoL (0-2 points), Hazard Ratio 1.9 (95% CI 1.3-2.8; P = 0.001).

CONCLUSION

Bad quality of life is associated with hospital mortality and survival 12 months after hospital discharge.

Predictors of nursing workload in elderly patients admitted to intensive care units

The age of patients is a controversial issue in admission to intensive care unit (ICU). The aim of this study was to compare severity and nursing workload of elderly patients with 60-69, 70-79, and e"80 years of age and to identify predictors of nursing workload in elderly patients. A cross sectional study was performed with a sample of 71 elderly patients admitted to three ICU in the city of Sao Paulo, Brazil from October to November 2004. Data were prospectively collected using Nursing Activities Score (NAS) and Simplified Acute Physiology Score II (SAPS II). There was no significant difference in nursing workload among the elderly patients age subgroups (p=0.84). Multiple regression analysis indicated that the independent risk factors of high nursing workload were severity, age e"70 years, and to be a surgical ICU patient. Age as an isolated factor should not be discriminative for elderly patients admission to ICU.

Modeling the distribution of Nursing Effort using structured Labor and Delivery documentation

Our study objectives included the development and evaluation of models for representing the distribution of shared unit-wide nursing care resources among individual Labor and Delivery patients using quantified measurements of nursing care, referred to as Nursing Effort. The models were intended to enable discrimination between the amounts of care delivered to patient subsets defined by attributes such as patient acuity. For each of five proposed models, scores were generated using an analysis set of 686,402 computerized nurse-documented events associated with 1093 patients at three hospitals during January and February 2006. Significant differences were detected in Nursing Effort scores according to patient acuity, care facility, and in scores generated during shift change versus non-shift change hours. The development of nursing care quantification strategies proposed in this study supports outcomes analysis by establishing a foundation for measuring the effect of patient-level nursing care on individual patient outcomes.

Sedation and weaning from mechanical ventilation: effects of process optimization outside a clinical trial

PURPOSE

We studied the effects of reorganization and changes in the care process, including use of protocols for sedation and weaning from mechanical ventilation, on the use of sedative and analgesic drugs and on length of respiratory support and stay in the intensive care unit (ICU).

MATERIALS AND METHODS

Three cohorts of 100 mechanically ventilated ICU patients, admitted in 1999 (baseline), 2000 (implementation I, after a change in ICU organization and in diagnostic and therapeutic approaches), and 2001 (implementation II, after introduction of protocols for weaning from mechanical ventilation and sedation), were studied retrospectively.

RESULTS

Simplified Acute Physiology Score II (SAPS II), diagnostic groups, and number of organ failures were similar in all groups. Data are reported as median (interquartile range). Time on mechanical ventilation decreased from 18 (7-41) (baseline) to 12 (7-27) hours (implementation II) (P = .046), an effect which was entirely attributable to noninvasive ventilation, and length of ICU stay decreased in survivors from 37 (21-71) to 25 (19-63) hours (P = .049). The amount of morphine (P = .001) and midazolam (P = .050) decreased, whereas the amount of propofol (P = .052) and fentanyl increased (P = .001). Total Therapeutic Intervention Scoring System-28 (TISS-28) per patient decreased from 137 (99-272) to 113 (87-256) points (P = .009). Intensive care unit mortality was 19% (baseline), 8% (implementation I), and 7% (implementation II) (P = .020).

CONCLUSIONS

Changes in organizational and care processes were associated with an altered pattern of sedative and analgesic drug prescription, a decrease in length of (noninvasive) respiratory support and length of stay in survivors, and decreases in resource use as measured by TISS-28 and mortality.

Costes de la calidad en Medicina Intensiva. Guía para gestores clínicos

OBJECTIVE

This article reviews the utility and applicability of available systems in order to calculate general and quality costs in clinical services settings.

METHODS

Review of techniques to calculate costs in Intensive Care Units (ICUs) according to analytical accounting approaches.

RESULTS

The methodological development is complemented with the results of its application in the ICU of the Miracle's Hospital showing the structure of costs and the results obtained with this methodology when analyzing the costs of activities related to quality improvement.

CONCLUSIONS

The effort to implement systems focused to analyze general and quality costs will result in a benefit of those participating in the healthcare system: citizens, professionals, managers, and "financials" since that which is only a legitimate demand today will be a inexcuseable commitment of the healthcare professionals from the society tomorrow.

A human factors engineering conceptual framework of nursing workload and patient safety in intensive care units

In this paper, we review the literature on nursing workload in intensive care units (ICUs) and its impact on patient safety and quality of working life of nurses. We then propose a conceptual framework of ICU nursing workload that defines causes, consequences and outcomes of workload. We identified four levels of nursing workload (ICU/unit level, job level, patient level, and situation level), and discuss measures associated with each of the four levels. A micro-level approach to ICU nursing workload at the situation level is proposed and recommended in order to reduce workload and mitigate its negative impact. Performance obstacles are conceptualized as causes of ICU nursing workload at the situation level.

Does ICU length of stay influence quality of life?

BACKGROUND

Patients with prolonged stay in the intensive care unit (ICU) use a disproportionate share of resources. However, it is not known if such treatment results in impaired quality of life (QOL) as compared to patients with a short length of stay (LOS) when taking into account the initial severity of illness.

METHODS

Prospective, observational case-control study in a university hospital surgical and trauma adult ICU. All patients admitted to the ICU during a 1-year period were included. Patients with a cumulative LOS in the ICU > 7 days, surviving up to 1 year after ICU admission and consenting were identified (group L, n = 75) and matched to individuals with a shorter stay (group S). Matching criteria were diagnostic group and severity of illness. Health-related quality of life (HRQOL) was assessed 1 year after admission using the short-form 36 (SF-36) and was compared between groups and to the general population. Further, overall QOL was estimated using a visual analogue scale (VAS) and willingness to consent to future intensive care, and was compared between groups L and S.

RESULTS

Based on ANCOVA, a significant difference between groups L and S was noted for two out of eight scales: role physical (P = 0.033) and vitality (P = 0.041). No differences were found for the physical component summary (P = 0.065), the mental component summary (P = 0.267) or the VAS (P = 0.316). Further, there was no difference in expectation to consent to future intensive care (P = 0.149). As compared to the general population, we found similar scores for the mental component summary and for three of eight scales in group L and five of eight scales in group S.

CONCLUSIONS

When taking into account severity of illness, HRQOL 1 year after intensive care is comparable between patients with a short and a long LOS in the ICU. Thus, prolonged stay in the ICU per se must not be taken as an indicator of future poorer HRQOL. However, as compared to the general population, significant differences, mostly in physical aspects of QOL, were found for both groups of patients.

Multicentre study of validity and interrater reliability of the modified Nursing Care Recording System (NCR11) for assessment of workload in the ICU

BACKGROUND

Reliable assessment of nursing workload is necessary for the quantitative approach to staffing of intensive care units. The Nursing Care Recording System (NCR11) scores both the nursing contribution to patient care and those related to medical procedures. The purpose of the present work was to compare NCR11 scoring with the Therapeutic Intervention Scoring System (TISS) and Nine Equivalents of Nurse Manpower use Score (NEMS) and to examine the interrater reliability of NCR11 scoring.

METHODS

Bias and precision of workload scores (NCR11 vs. TISS or NEMS) were assessed for 6126 consecutive admissions (23910 ICU-days) at three intensive care units. Inter-rater reliability was analyzed by having nurses at nine ICUs score workload using NCR11 for three dummy intensive care patient cases presented over a 3-year period. Variability in scoring was analyzed using the coefficient of variation.

RESULTS

Agreement between NCR11 and TISS or NEMS was poor and limits of agreement were wide. Linear relationships between NCR11 and TISS or NEMS scores differed between units. Variability in NCR11 scoring decreased significantly from 10.4% to 5.9% between dummy cases 1 and 2 and remained low for patient case 3.

CONCLUSION

The NCR11 does not measure the same elements of workload in the ICU as do TISS and NEMS. Inter-rater reliability with NCR11 is good, showing little variation in scoring between nurses.

Can the impact of bed closure in intensive care units be reliably monitored?

OBJECTIVE

To assess the properties of various indicators aimed at monitoring the impact on the activity and patient outcome of a bed closure in a surgical intensive care unit (ICU).

DESIGN

Comparison before and after the intervention.

SETTING

A surgical ICU at a university hospital.

PATIENTS

All patients admitted to the unit over two periods of 10 months.

INTERVENTION

Closure of one bed out of 17.

MEASUREMENTS AND RESULTS

Activity and outcome indicators in the ICU and the structures upstream from it (emergency department, operative theater, recovery room) and downstream from it (intermediate care units). After the bed closure, the monthly medians of admitted patients and ICU hospital days increased from 107 (interquartile range 94-112) to 113 (106-121, P=0.07) and from 360 (325-443) to 395 (345-436, P=0.48), respectively, along with the linear trend observed in our institution. All indicators of workload, patient severity, and outcome remained stable except for SAPS II score, emergency admissions, and ICU readmissions, which increased not only transiently but also on a mid-term basis (10 months), indicating that the process of patient care delivery was no longer predictable.

CONCLUSIONS

Health care systems, including ICUs, are extraordinary flexible, and can adapt to multiple external constraints without altering commonly used activity and outcome indicators. It is therefore necessary to set up multiple indicators to be able to reliably monitor the impact of external interventions and intervene rapidly when the system is no longer under control.

Development of a comprehensive scoring system to measure multifaceted nursing workloads in ICU

A new scoring system, the comprehensive nursing intervention score (CNIS), was developed to quantify the overall workload of diverse nursing activities in the intensive care unit (ICU). A total of 88 nursing items were listed. With the cooperation of 20 skilled ICU nurses, a three-round Delphi survey was conducted to assign a four-grade workload score to each item from five aspects: number of nurses required, muscular exertion, mental stress, skill, and intensity. After the survey, 15 unnecessary items were deleted. Appropriateness of the assigned scores was confirmed by surveying 118 nurses in other ICU. Within-individual reproducibility, examined in 44 nurses, was summarized as a mean kappa-coefficient of 0.65. Time required for each job was recorded and added as the sixth aspect of the workload. Thus, final CNIS gave six subscores (0-3) plus one overall score (3-18) to each of the 73 job items. The CNIS was confirmed as truly representing overall nursing workload by applying it to the daily care of 107 patients.

Resource use in the ICU: short- vs. long-term patients

BACKGROUND

Intensive care medicine uses a disproportionate share of medical resources, and little is known about the distribution of resources between different patient groups.

METHODS

In this prospective observational study, all patients admitted between 1 January 1998 and 31 December 1999 to our medical-surgical university's ICU were assigned to one of two groups according to length of stay (LOS): patients staying more than 7 days in the unit (group L) and those staying a maximum of 7 days (group S). Resource use was estimated using TISS-28, number of nursing shifts, use of mechanical ventilation, and use of renal replacement therapy. Further, SAPS II and ICU and hospital mortalities were recorded.

RESULTS

Of 5481 patients, 583 (10.6%) were in group L and 4898 in group S (89.4%). Patients in group L were more severely sick upon admission than those in group S. Patients in group L stayed a total of 9726 days in the ICU (52.5% of the total LOS). In group L, 69.2% of all shifts with respiratory support and 80.1% of all shifts with renal replacement were used. Further, group L patients consumed 53.4% (909225) of all TISS points provided. The ICU-mortality rates were 14.4% in group L and 7.2% in group S, and the hospital mortality rates were 19.9% and 9.8%, respectively. A mean of 1898 TISS points was used per patient surviving the hospital stay in group L compared with 190 points in group S.

CONCLUSIONS

In this university-based, medical-surgical adult ICU, 11% of all patients stayed more than 7 days in the unit and consumed more than 50% of all resources. Thus, a highly disproportionate amount of resources were used per survivor in group L compared with those in group S.

[Utilization of the nine equivalents of nursing manpower use score (NEMS) in a pediatric intensive care unit]

In 1994, sponsored by the European Communities Commission and the FRICE (Foundation for Research on Intensive Care in Europe), the EURICUS proyect was born, which, among other objectives, sets out to know objectively the work loads of the nursing staff in the intensive medicine services. As a consequence, the FRICE developed and validated a new therapeutic index, the nine equivalents of nursing manpower use score, NEMS. This scale (NEMS) can determine the therapeutic effort required by critically ill patients in a simple way and only using nine therapeutic variables. The objectives of this study are: to know if the NEMS scale reflects the therapeutic effort of the pediatric critical patients and validate if the NEMS scale measures the health care effect of the nursing staff in a pediatric intensive care unit (PICU). The study was performed in the Pediatrics Intensive Care Unit of the Hospital Sant Joan de Déu in Barcelona. The population studied was made up by the patients admitted to the PICU during a three week period (January 17 to February 6, 2001). Eight nurses from the unit having different shifts participated in the data collection. The NEMS scale was measured at 7 am.m. and 7 p.m. respectively in all the patients and then a qualitative assessment of the data obtained was performed. During this period, there were 50 admissions in the unit: 2.2 admissiions per day. The occupancy rate during the days of the study was 75%. A total of 389 measurements were performed, obtaining a mean value of 26.1 on the NEMS scale. Principal contributions of the nurses participating in the study were:They believe that use of the health care effort scales is useful in the intensive care units. The NEMS scale is easy to use and requires little time to be filled out. The NEMS scale reflects the therapeutic effort of the pediatric critically ill patients, but does not reflect the nursing staff cares. In a pediatric ICU, the age of the patient who is hospitalized influences the requirements of the nursing staff. Depending on at what time the scale is measured, not all the nursing activity is reflected, due to the high number of daily admissions and discharges. The NEMS scale is simple to use and reflects the therapeutic effort of the patients admitted to a PICU; however it only measures those cares delegated from therapeutic intervention and does not reflect the basic nursing cares.

[Frecuency of adverse events during the hygiene of the critical care patient]

The hygiene of the patient in critical condition is a common nursing technique in the intensive care unit, which does not mean that doing it is exempt of risk for the patient's state. We carry out a study to measure the frequency of the appearance of certain adverse events during the hygiene care and their clinical repercussion.Hygiene of the critical patients was monitored, measuring the appearance of certain events at the time of hygiene and until one hour after to assess if the complications were at the moment or had a greater repercussion on the state of the patient.During the study period, some adverse event appeared in 48% (CI 95%: 43-52) of the hygiene performed while none appeared in 52% (CI 95%: 48-56) of it. The events that appeared most frequently were: desaturation in 18% (CI 95%: 15-21) of the hygiene performed, the deadaptation of the mechanical ventilation in 11% (CI 95%: 9-14), arterial hypertension in 21% (CI 95%: 18-25) and arterial hypotension in 11% (CI 95%: 9-14). The intracranial hypertension appeared in 42% (CI 95%: 26-61) of the hygiene performed to patients who were carriers of intraventricular catheter, 9% (CI 95%: 2-25) continued with elevated values 1 hour after concluding the hygiene. The rest of the events monitored presented a lower frequency, although the appearance of one episode of cardiorespiratory arrest and two of auricular fibrillation with rapid ventricular response, one of which required cardioversion, stand out. We conclude that it is an essential job of the nursing staff to correctly assess the risks that the performance of hygiene means for the critical patient, so that the technique should be applied rationally and under strict monitoring and control.

[Analysis of the use of nursing personnel in a general intensive care unit. Situation in other european ICUs]

Nursing workloads form the basis for the appropriate provision of nursing personnel. In this study we used the nine equivalents of nursing manpower use score (NEMS) to determine and evaluate the use of nursing staff in our unit. In the first phase we determined the actual workload in the various shifts and diagnostic areas. Statistically significant differences were found among diagnostic areas but not among shifts. Then, to compare our situation with that of other European intensive care units (ICUs), dynamic parameters of the management and efficiency of the use of nursing staff were analyzed following the multicentric EURICUS-I study, which was performed over 4 months in 100 ICUs in 12 European countries. For the comparison, indexes such as the work utilization ratio (WUR), the level of care planned (LOC p) and the level of care operative (LOC op) were used. The results obtained reveal that although our workload is equivalent to the European average, efficiency is greater. Thus, the situation in our unit differs from the downward trend of the data obtained in other European countries.

Intensive Care Nursing Scoring System Part 2: nursing interventions and nursing outcomes

Different medical classifications and scoring systems have been developed to measure and compare intensive care outcomes in international contexts. Many of them, however, do not include outcome variables to describe autonomous nursing and its effects on the patient's experiences and restrictions as a result of the onset and process of illness, or relatives' or significant others' distress in the intensive care environment. The Intensive Care Nursing Scoring System (ICNSS) is a new instrument to describe and highlight nurses' work and its effects on the patients and their relatives in a way not allowed by medical classifications and scoring systems. ICNSS can be used to evaluate a single intensive care nursing process from admission to discharge or to compare patients in different intensive care units for certain variables. ICNSS can also be used to measure nurses' workload. The classification of nursing diagnoses was described in a previous article. This paper describes nursing outcomes and nursing interventions as well as the use of ICNSS in a computer-based information management system in three adult intensive care units in the Oulu University Hospital.

Scoring systems for assessing organ dysfunction and survival

Sepsis is an ongoing disease process carrying a high risk of organ failure and death. Scoring systems to determine disease severity and risk of mortality may be useful in patient management and clinical trial enrollment, although the role of either type of score in the determination of admission or discharge criteria or in decisions relating to the continuation or withholding of treatment remains controversial. General scoring systems have been developed to quantify the severity of illness and the risk of mortality in ICU patients. Ideally, these should be customized before use in patients with septic shock, but in general noncustomized models are used, and this potential limitation should be acknowledged. Prognostic scores are remarkably reliable at predicting outcome in groups of patients and give an indication of severity of disease on admission, but they are unable to provide detail on how a patient is responding to treatment or on the disease progression. Organ function scores, however, can be assessed repeatedly and used to define a patient's progress. This approach can thus be used to evaluate individual patient care, to identify patients for enrollment in clinical trials or epidemiologic analyses, and to assess morbidity measures in clinical trials of new interventions. Organ dysfunction scores are just that, descriptors of organ dysfunction, and although high values correlate well with mortality, prognostication is not their prime aim; organ dysfunction scores and outcome prediction scores should rather be viewed as complementary systems in the description of ICU populations.