Reliability of the Canadian emergency department triage and acuity scale: interrater agreement

Prehospital Application of the Canadian Triage and Acuity Scale by Emergency Medical Services

OBJECTIVES

Triage is fundamental to emergency patient assessment. Effective triage systems accurately prioritize patients and help predict resource utilization. CTAS is a validated five-level triage score utilized in Emergency Departments (EDs) across Canada and internationally. Historically CTAS has been applied by triage nurses in EDs. Observational evidence suggests that the CTAS might be implemented reliably by paramedics in the prehospital setting. This is the first system-wide assessment of CTAS interrater reliability between paramedics and triage nurses during clinical practice.

METHODS

Variables were extracted from hospital and EMS databases. EMS providers determined CTAS on-scene, CTAS pre-transport, and CTAS on-arrival at hospital for each patient (N=14,378). The hospital arrival EMS CTAS (CTAS arrival ) score was compared to the initial nursing CTAS score (CTAS initial ) and the final nursing CTAS score (CTAS final ) incuding nursing overrides. Interrater reliability between ED CTAS initial and EMS CTAS arrival scores was assessed. Interrater reliability between ED CTAS final and EMS CTAS arrival scores, as well as proportion of patient encounters with perfect or near-perfect agreement, were evaluated.

RESULTS

Our primary outcome, interrater reliability [kappa=0.437 (p<0.001, 95% CI 0.421-0.452)], indicated moderate agreement. EMS CTAS arrival and ED CTAS initial scores had an exact or within one point match 84.3% of the time. The secondary interrater reliability outcome between hospital arrival EMS CTAS (CTAS arrival ) score and the final ED triage CTAS score (CTAS final ) showed moderate agreement with kappa =0.452 (p<0.001, 95% CI 0.437-0.466).

CONCLUSIONS

Interrater reliability of CTAS scoring between triage nurses and paramedics was moderate in this system-wide implementation study.

Pediatric Canadian Triage and Acuity Scale (PaedsCTAS) as a Measure of Injury Severity

This research explored whether the pediatric version of the Canadian Triage Acuity Scale (PaedsCTAS) represented a valid alternative indicator for surveillance of injury severity. Every patient presenting in a Canadian emergency department is assigned a CTAS or PaedsCTAS score in order to prioritize access to care and to predict the nature and scope of care that is likely to be required. The five-level PaedsCTAS score ranges from I (resuscitation) to V (non-urgent). A total of 256 children, 0 to 17-years-old, who attended a pediatric hospital for an injury were followed longitudinally. Of these children, 32.4% (n = 83) were hospitalized and 67.6% (n = 173) were treated in the emergency department and released. They completed the PedsQL(TM), a validated measure of health related quality of life, at baseline (pre-injury status), one-month, four- to six-months, and 12-months post-injury. In this secondary data analysis, PaedsCTAS was found to be significantly associated with hospitalization and length of stay, sensitive to the differences between PaedsCTAS II and III, and related to physical but not psychosocial HRQoL. The findings suggest that PaedsCTAS may be a useful proxy measure of injury severity to supplement or replace hospitalization status and/or length of stay, currently proxy measures.

Correlates of Attempted Suicide from the Emergency Room of 2 General Hospitals in Montreal, Canada

Introduction:

The epidemiology of attempted suicide has not been well characterized because of lack of national data or an International Classification of Diseases (ICD) code for suicide attempts. We conducted a retrospective chart review in 2 adult general hospitals (tertiary and community) in Montreal, Canada, in 2009-2010 to 1) describe the characteristics of men and women who presented to the emergency department (ED) and/or were hospitalized following a suicide attempt, 2) identify factors associated with attempts requiring hospitalizations, and 3) validate the use of International Classification of Diseases, 10th Revision (ICD-10) codes for “intentional self-harm” as a method to detect suicide attempts from hospital abstract summary records.

Method:

All potential suicide attempts were identified from hospital abstract summary records and ED nursing triage file using ICD-10 codes and keywords suggestive of suicide attempts. All identified charts were examined, and those with confirmed suicide attempts were fully reviewed.

Results:

Of the 5746 identified charts, 369 were fully reviewed. Of these, 176 were for suicide attempters treated in the ED and 193 for hospitalized attempters, of whom 46% had an ICD-10 code for intentional self-harm. Poisoning (46%) was the most frequent method of suicide used. Half of attempters were younger than 34 years, 53% were female, and 75% had a history of mental disorders.

Conclusion:

About half of individuals who seek medical care for attempted suicide are admitted to hospital. About half of attempters use poisoning as a method of suicide, and a quarter do not have a history of mental disorders. Intentional self-harm codes capture only about half of hospitalized attempters.

Reliability of the Canadian Triage and Acuity Scale: interrater and intrarater agreement from a community and an academic emergency department

OBJECTIVES

The Canadian Triage and Acuity Scale (CTAS) is a five-level triage tool that is used to help prioritize the order in which emergency department (ED) patients should be seen. The objectives of this study were to determine the interrater and intrarater agreement of the 2008 CTAS guideline revisions by triage nurses and to compare agreement between triage nurses working in a small community ED and an academic ED.

METHODS

Seventy-eight triage nurses assigned CTAS scores and free-text presenting complaints for 10 paper-based case scenarios. For five scenarios, the CTAS score should have remained unchanged from previous guidelines, whereas the other five scenarios should have been triaged differently based on the 2008 CTAS first-order modifiers. Thirty-three participants repeated the questionnaire 90 days later, and intrarater agreement was measured.

RESULTS

There was a higher level of agreement (κ  =  0.73; 95% CI 0.68-0.79) for the five case scenarios, which relied on the older 2004 guidelines compared to the scenarios where the 2008 guidelines would have suggested a different triage level (κ  =  0.50; 95% CI 0.42-0.59). For the 10 case scenarios analyzed, the free-text presenting complaints matched the Canadian Emergency Department Information System (CEDIS) list 90.1% of the time (κ  =  0.80; 95% CI 0.76-0.84).

CONCLUSION

The reliability of CTAS scoring by academic and community ED nurses was relatively good; however, the application of the 2008 CTAS revisions appears less reliable than the 2004 CTAS guidelines. These results may be useful to develop educational materials to strengthen reliability and validity for triage scoring using the 2008 CTAS guideline revisions.

Canadian Triage and Acuity Scale: testing the mental health categories

PURPOSE

The study tested the inter-rater reliability and accuracy of triage nurses' assignment of urgency ratings for mental health patient scenarios based on the 2008 Canadian Triage and Acuity Scale (CTAS) guidelines, using a standardized triage tool. The influence of triage experience, educational preparation, and comfort level with mental health presentations on the accuracy of urgency ratings was also explored.

METHODS

Study participants assigned urgency ratings to 20 mental health patient scenarios in randomized order using the CTAS. The scenarios were developed using actual triage notes and were reviewed by an expert panel of emergency and mental health clinicians for face and content validity.

RESULTS

The overall Fleiss' kappa, the measure of inter-rater reliability for this sample of triage nurses (n=18), was 0.312, representing only fair albeit statistically significant (P<0.0001) agreement. Kendall's coefficient of concordance for the sample was calculated to be 0.680 (P<0.0001), which signifies moderate agreement. Although the sample reported high levels of education, comfort with mental health presentations, and experience, accuracy in urgency ratings measured by the percentage of correct responses ranged from 0.05% to 94% (mean: 54%). Greater accuracy in urgency ratings was recorded for triage nurses who used second-order modifiers and avoided the use of override.

CONCLUSION

Specific focus on the use of second-order modifiers in orientation and ongoing education of triage nurses may improve the reliability and validity of the CTAS when used to assign urgency ratings to mental health presentations.

Attempted Suicide Among Students and Young Adults in Montreal, Quebec, Canada: A Retrospective Cross-Sectional Study of Hospitalized and Nonhospitalized Suicide Attempts Based on Chart Review

OBJECTIVE

We conducted a chart review to identify postsecondary students and nonstudents in the same age range who presented to the emergency department following a suicide attempt to (1) compare demographic characteristics and suicide risk factors and (2) determine factors associated with more serious attempts requiring hospitalizations.

METHOD

The study was conducted in 1 tertiary trauma hospital and 1 community hospital affiliated with McGill University, Montreal, Quebec, Canada, between January 1, 2009, and March 31, 2010. Charts of patients with potential suicide attempts were identified from medical records using ICD-10 codes that indicated traumatic injury, intentional self-harm, poisoning, and psychiatric or perception/cognition disorders and from the emergency department triage file using keywords that indicated suicidality or self-harm at presentation.

RESULTS

In multivariable logistic regression models (odds ratio, 95% CI), students were younger (per 5-year increase: 0.22, 0.12-0.41), less likely to be born in Canada (0.17, 0.06-0.44), and more likely to use less violent methods (laceration, poisoning, other, multiple methods) versus more violent methods (collision, jump, fire burns, firearm, hanging) in their attempt. Fewer students had a history of substance abuse (0.12, 0.02-0.94) but were not different from nonstudents on history of other mental disorders. Less students attempted suicide in the winter/spring (January-April) versus fall (September-December) semester (0.32, 0.11-0.91). Students who attempted suicide were more likely to have family/social support. Those who attempted suicide in the previous year were more likely to require hospitalization for their current suicide attempt.

CONCLUSIONS

Knowledge of specific factors associated with suicide attempts in young people can help inform and guide suicide prevention efforts in both academic and community settings. Specific to the findings of this study regarding the method of suicide attempt used, for example, limiting access to dangerous substances or large quantities of medications may help prevent or reduce suicide attempts in this population.

The Reliability of the Canadian Triage and Acuity Scale: Meta-analysis

Background:

Although the Canadian Triage and Acuity Scale (CTAS) have been developed since two decades ago, the reliability of the CTAS has not been questioned comparing to moderating variable.

Aims:

The study was to provide a meta-analytic review of the reliability of the CTAS in order to reveal to what extent the CTAS is reliable.

Materials and Methods:

Electronic databases were searched to March 2014. Only studies were included that had reported samples size, reliability coefficients, adequate description of the CTAS reliability assessment. The guidelines for reporting reliability and agreement studies (GRRAS) were used. Two reviewers independently examined abstracts and extracted data. The effect size was obtained by the z-transformation of reliability coefficients. Data were pooled with random-effects models and meta-regression was done based on method of moments estimator.

Results:

Fourteen studies were included. Pooled coefficient for the CTAS was substantial 0.672 (CI 95%: 0.599-0.735). Mistriage is less than 50%. Agreement upon the adult version, among nurse-physician and near countries is higher than pediatrics version, other raters and farther countries, respectively.

Conclusion:

The CTAS showed acceptable level of overall reliability in the emergency department but need more development to reach almost perfect agreement.

Reliability of Canadian Emergency Department Triage and Acuity Scale (CTAS) in Saudi Arabia

Background

The Canadian Emergency Department Triage and Acuity Scale (CTAS) is an integral part of the Canadian emergency medicine triaging system. There is growing interest and implementation of CTAS worldwide. However, little is known about its reliability outside Canada. The aim of this study was to determine the reliability agreement of CTAS in a tertiary care emergency center in Saudi Arabia.

Methods

Ten triage nurses (five senior and five junior nurses) utilized CTAS guidelines to independently assign a triage level for 160 real case-based scenarios. Quadratic weighted kappa statistics were used to measure raters’ agreements.

Results

Raters provided 1600 triage category assignments to case scenarios for analysis. Intra-rater agreement was similar for both senior and junior nurses; for senior nurses (SN1) kappa 0.871 95 % CI (0.840–0.897), and for junior nurses (SN2) kappa 0.871 95 % CI (0.839–0.898). Inter-rater agreement for the SN1 versus SN2 nurses had statistically meaningful agreement across different triage levels (weighted kappa = 0.770) 95 % CI (0.742–0.797).

Conclusions

CTAS has good reliability among emergency department (ED) triage nurses in King Abdulaziz Medical City (KAMC), Saudi Arabia. The findings suggest that CTAS might be a reliable instrument when applied in countries outside Canada.

Speed and accuracy of mobile BlackBerry Messenger to transmit chest radiography images from a small community emergency department to a geographically remote referral center

BACKGROUND

Small emergency departments (EDs) may rely on radiologists at remote centers for interpretations of chest radiographs (CXRs). We investigated systematic transmission of CXR images from a small ED to a geographically remote referral center using the mobile BlackBerry Messenger (BBM) application.

METHODS

Investigators obtained de-identified CXR images of consecutive ED patients via mobile phone camera. Each CXR image, along with a brief clinical history, was sent via BBM to an emergency physician located at a remote referral site, and the receiving physician replied via BBM to confirm reception. All communications, image generation, and image analysis was conducted on mobile phones. The primary outcome was the proportion of BBMs received within two minutes of sending; the secondary outcome was the proportion of BBM replies to the sending physician within five minutes. Image accuracy-comparing the radiologist's interpretation with the receiving emergency physician's interpretation-was estimated using predefined criteria.

RESULTS

Of 1281 consecutive ED patients, 231 (18.0 %) had CXRs obtained, 320 CXRs were analyzed and 611 BBMs sent. All BBMs (100.0%, 95% confidence interval (CI) 99.4-00.0) arrived within two minutes; 595 BBMs (97.4%, 95% CI 95.8-98.4) were replied to within five minutes. Of the 58 CXRs with abnormalities requiring intervention, there were 55 concordances (overall agreement 94.2%, 95% CI 85.9-98.3; kappa 0.95, 95% CI 0.89-1.0) CONCLUSION: Systematic transmission of CXR images from a small ED to a remote large center using mobile phones may be a safe and effective strategy to rapidly communicate important patient information.

Ruralizing the Canadian Triage and Acuity Scale

L’échelle canadienne de triage et de gravité (ÉTG) a été introduite dans les années 90 et est rapidement en voie de devenir la norme canadienne de triage. Mais depuis 1997, moment où l’Institut canadien d’information sur la santé a commencé à promouvoir l’ÉTG, certains médecins de campagne ont manifesté leurs préoccupations, signalant l’existence de d’autres systèmes de triage et mettant en doute l’efficacité de l’ÉTG dans les milieux ruraux.

Les médecins des milieux ruraux soulèvent divers points: une perception de la complexité de l’ÉTG, un délai de réponse apparemment court pour l’évaluation par le médecin (et les ramifications médico-légales de la définition de ces délais), et une validation inadéquate de l’ÉTG dans les milieux ruraux. Le présent article explore l’historique de cette controverse et ébauche des solutions possibles. Les auteurs concluent que l’ÉTG est un outil malléable qui peut être «adapté» aux milieux ruraux et qu’il permettra par la suite d’améliorer les soins aux patients et les conditions de travail des infirmières et des médecins de ces milieux.

Physician workload and the Canadian Emergency Department Triage and Acuity Scale: the Predictors of Workload in the Emergency Room (POWER) Study

Introduction:

The Canadian Emergency Department Triage and Acuity Scale (CTAS) is a 5-level triage tool used to determine the priority by which patients should be treated in Canadian emergency departments (EDs). To determine emergency physician (EP) workload and staffing needs, many hospitals in Ontario use a case-mix formula based solely on patient volume at each triage level. The purpose of our study was to describe the distribution of EP time by activity during a shift in order to estimate the amount of time required by an EP to assess and treat patients in each triage category and to determine the variability in the distribution of CTAS scoring between hospital sites.

Methods:

Research assistants directly observed EPs for 592 shifts and electronically recorded their activities on a moment-by-moment basis. The duration of all activities associated with a given patient were summed to derive a directly observed estimate of the amount of EP time required to treat the patient.

Results:

We observed treatment times for 11 716 patients in 11 hospital-based EDs. The mean time for physicians to treat patients was 73.6 minutes (95% confidence interval [CI] 63.6–83.7) for CTAS level 1, 38.9 minutes (95% CI 36.0–41.8) for CTAS-2, 26.3 minutes (95% CI 25.4–27.2) for CTAS-3, 15.0 minutes (95% CI 14.6–15.4) for CTAS-4 and 10.9 minutes (95% CI 10.1–11.6) for CTAS-5. Physician time related to patient care activities accounted for 84.2% of physicians' ED shifts.

Conclusion:

In our study, EPs had very limited downtime. There was significant variability in the distribution of CTAS scores between sites and also marked variation in EP time related to each triage category. This brings into question the appropriateness of using CTAS alone to determine physician staffing levels in EDs.

The effect of training on nurse agreement using an electronic triage system

Objectives:

Emergency department (ED) triage prioritizes patients based on urgency of care, and the Canadian Triage and Acuity Scale (CTAS) is the national standard. We describe the inter-rater agreement and manual overrides of nurses using a CTAS-compliant web-based triage tool (eTRIAGE) for 2 different intensities of staff training.

Methods:

This prospective study was conducted in an urban tertiary care ED. In phase 1, eTRIAGE was deployed after a 3-hour training course for 24 triage nurses who were asked to share this knowledge during regular triage shifts with colleagues who had not received training (n = 77). In phase 2, a targeted group of 8 triage nurses underwent further training with eTRIAGE. In each phase, patients were assessed first by the duty triage nurse and then by a blinded independent study nurse, both using eTRIAGE. Inter-rater agreement was calculated using kappa (weighted κ) statistics.

Results:

In phase 1, 569 patients were enrolled with 513 (90.2%) complete records; 577 patients were enrolled in phase 2 with 555 (96.2%) complete records. Inter-rater agreement during phase 1 was moderate (weighted κ = 0.55; 95% confidence interval [CI] 0.49–0.62); agreement improved in phase 2 (weighted κ = 0.65; 95% CI 0.60–0.70). Manual overrides of eTRIAGE scores were infrequent (approximately 10%) during both periods.

Conclusions:

Agreement between study nurses and duty triage nurses, both using eTRIAGE, was moderate to good, with a trend toward improvement with additional training. Triage overrides were infrequent. Continued attempts to refine the triage process and training appear warranted.

Prospective time study derivation of emergency physician workload predictors

Background:

A reliable emergency department (ED) workload measurement tool would provide a method of quantifying clinical productivity for performance evaluation and physician incentive programs; it would enable health administrators to measure ED outputs; and it could provide the basis for an equitable formula to estimate ED physician staffing requirements. Our objectives were to identify predictors that correlate with physician time needed to treat patients and to develop a multivariable model to predict physician workload.

Methods:

During 31 day, evening, night and weekend shifts, a research assistant (RA) shadowed 20 emergency physicians, documenting time spent performing clinical and non-clinical functions for 585 patient visits. The RA recorded key predictors including patient gender, age, vital signs and Glasgow Coma Scale (GCS) score, and the mode of arrival, triage level assigned, comorbidity and procedures performed. Multiple linear regression was used to describe the associations between predictor variables and total physician time per patient visit (TPPV), and to derive an equation for physician workload. Model derivation was based on 16 shifts and 314 patient visits; model validation was based on 15 shifts and 271 additional patient visits.

Results:

The strongest predictor variables were: procedure required, triage level, arrival by ambulance, GCS, age, any comorbidity, and number of prior visits. The derived regression equation is: TPPV = 29.7 + 8.6 (procedure required [Yes]) – 3.8 (triage level [1–5]) + 7.1 (ambulance arrival) – 1.1 (GCS [3–15]) + 0.1 (age in years) – 0.05 (n of previous visits) + 3.1 (any comorbidity). This model predicted 31.3% of the variance in physician TPPV (F [12, 29] = 13.2; p &lt; 0.0001).

Conclusions:

This study clarifies important determinants of emergency physician workload. If validated in other settings, the predictive formula derived and internally validated here is a potential alternative to current simplistic models based solely on patient volume and perceived acuity. An evidence-based workload estimation tool like that described here could facilitate ED productivity measurement, benchmarking, physician performance evaluation, and provide the substrate for an equitable formula to estimate ED physician staffing requirements.

Revisions to the Canadian Emergency Department Triage and Acuity Scale Implementation Guidelines

There has been widespread implementation of the Canadian Emergency Department Triage and Acuity Scale (CTAS) across Canada since it was introduced in 1999. This consensus document, developed by the CTAS National Working Group (NWG) of nurse and physician leaders in emergency department (ED) triage, continues to be viewed as a dynamic document that requires modification over time as experience is gained in its application. This article presents the first major modification to the CTAS.

Interrater agreement of Canadian Emergency Department Triage and Acuity Scale scores assigned by base hospital and emergency department nurses

Objective:

We sought to assess the applicability of the Canadian Emergency Department Triage and Acuity Scale (CTAS) in the prehospital setting by comparing CTAS scores assigned during ambulance transportation by base hospital (BH) nurses with CTAS scores given by emergency department (ED) nurses on patients' arrival.

Methods:

We recruited a prospective sample of consecutive patients who were transported to the ED by ambulance between December 2006 and March 2007 for whom a contact was made with the BH. Patients were triaged by the BH nurse with online communication and vital signs transmission. On arrival, patients were blindly triaged again by the ED nurse. We used the quadratic weighted κ statistic to measure the agreement between the 2 CTAS scores.

Results:

Ninety-four patients were triaged twice by 2 nursing teams (9 nurses at the BH and 39 nurses in the ED). The agreement obtained on prehospital and ED CTAS scores was moderate (κ = 0.50; 95% confidence interval 0.37–0.63).

Conclusion:

The moderate interrater agreement we obtained may be a result of the changing conditions of patients during transport or may indicate that CTAS scoring requires direct contact to produce reliable triage scores. Our study casts a serious doubt on the appropriateness of BH nurses performing triage with CTAS in the prehospital setting.

Inter-observer agreement using the Canadian Emergency Department Triage and Acuity Scale

Objective:

To determine the inter-observer agreement on triage assignment by first-time users with diverse training and background using the Canadian Emergency Department Triage and Acuity Scale (CTAS).

Methods:

Twenty emergency care providers (5 physicians, 5 nurses, 5 Basic Life Support paramedics and 5 Advanced Life Support paramedics) at a large urban teaching hospital participated in the study. Observers used the 5-level CTAS to independently assign triage levels for 42 case scenarios abstracted from actual emergency department patient presentations. Case scenarios consisted of vital signs, mode of arrival, presenting complaint and verbatim triage nursing notes. Participants were not given any specific training on the scale, although a detailed one-page summary was included with each questionnaire. Kappa values with quadratic weights were used to measure agreement for the study group as a whole and for each profession.

Results:

For the 41 case scenarios analyzed, the overall agreement was significant (quadratic-weighted κ = 0.77, 95% confidence interval, 0.76–0.78). For all observers, modal agreement within one triage level was 94.9%. Exact modal agreement was 63.4%. Agreement varied by triage level and was highest for Level I (most urgent). A reasonably high level of intra- and inter-professional agreement was also seen.

Conclusions:

Despite minimal experience with the CTAS, inter-observer agreement among emergency care providers with different backgrounds was significant.

Emergency physician workload modeling

Background:

A variety of models are used by hospitals, provincial governments, and departments of emergency medicine to “predict” the number of physician hours of coverage necessary to staff emergency departments. These models have arisen to meet specific requirements—some for the purpose of determining hourly rates of compensation, others to determine the amount of funding that will be provided to “purchase” physician coverage, and others to determine the number of hours of coverage necessary to maintain patient waits within “acceptable” limits. All such models have their strengths and weaknesses and have been criticized as not reflecting the “real” needs of any given department.

Objective:

In the article that follows, a review of existing models is presented, annotating their strengths and weaknesses to derive the characteristics of an “ideal” workload model.

Conclusion:

None of the models currently used to measure emergency department workload can be relied on to accurately predict the number of staffed hours necessary. Models that may achieve this objective are suggested.

Development and validation of a prediction rule for early discharge of low-risk emergency department patients with potential ischemic chest pain

Objectives:

Current guidelines emphasize that emergency department (ED) patients at low risk for potential ischemic chest pain cannot be discharged without extensive investigations or hospitalization to minimize the risk of missing acute coronary syndrome (ACS). We sought to derive and validate a prediction rule that permitted 20 to 30% of ED patients without ACS safely to be discharged within 2 hours without further provocative cardiac testing.

Methods:

This prospective cohort study enrolled 1,669 chest pain patients in two blocks in 2000–2003 (development cohort) and 2006 (validation cohort). The primary outcome was 30-day ACS diagnosis. A recursive partitioning model incorporated reliable and predictive cardiac risk factors, pain characteristics, electrocardiographic findings, and cardiac biomarker results.

Results:

In the derivation cohort, 165 of 763 patients (21.6%) had a 30-day ACS diagnosis. The derived prediction rule was 100.0% sensitive and 18.6% specific. In the validation cohort, 119 of 906 patients (13.1%) had ACS, and the prediction rule was 99.2% sensitive (95% CI 95.4–100.0) and 23.4% specific (95% CI 20.6–26.5). Patients have a very low ACS risk if arrival and 2-hour troponin levels are normal, the initial electrocardiogram is nonischemic, there is no history of ACS or nitrate use, age is &lt; 50 years, and defined pain characteristics are met. The validation of the rule was limited by the lack of consistency in data capture, incomplete follow-up, and lack of evaluation of the accuracy, comfort, and clinical sensibility of this clinical decision rule.

Conclusion:

The Vancouver Chest Pain Rule may identify a cohort of ED chest pain patients who can be safely discharged within 2 hours without provocative cardiac testing. Further validation across other centres with consistent application and comprehensive and uniform follow-up of all eligible and enrolled patients, in addition to measuring and reporting the accuracy of and comfort level with applying the rule and the clinical sensibility, should be completed prior to adoption and implementation.

Dynamic patient grouping and prioritization: a new approach to emergency department flow improvement

The demand on emergency departments (ED) is variable and ever increasing, often leaving them overcrowded. Many hospitals are utilizing triage algorithms to rapidly sort and classify patients based on the severity of their injury or illness, however, most current triage methods are prone to over- or under-triage. In this paper, the group technology (GT) concept is applied to the triage process to develop a dynamic grouping and prioritization (DGP) algorithm. This algorithm identifies most appropriate patient groups and prioritizes them according to patient- and system-related information. Discrete event simulation (DES) has been implemented to investigate the impact of the DGP algorithm on the performance measures of the ED system. The impact was studied in comparison with the currently used triage algorithm, i.e., emergency severity index (ESI). The DGP algorithm outperforms the ESI algorithm by shortening patients' average length of stay (LOS), average time to bed (TTB), time in emergency room, and lowering the percentage of tardy patients and their associated risk in the system.

Time trends in medically serious suicide-related behaviours in boys and girls

OBJECTIVE

To determine whether emergency department (ED) presentations for suicide-related behaviours (SRBs) in boys and girls were identified as more clinically acute in the ED in the period after the regulatory warnings against prescribing antidepressants and during the global economic recession, and to characterize the medical severity of SRBs among boys and girls to aid surveillance activities.

METHOD

Among Ontario boys and girls (aged 12 to 17 years) presenting to the ED with an incident (index) ED SRB event between fiscal years (FYs) 2002 to 2010, we compared the number of high (compared with lower) acuity events in FYs 2005 to 2010 to those in FYs 2002 to 2004. We described the SRB method by its acuity and tested the linearity of varying trends in the SRB method in boys and girls.

RESULTS

In both boys and girls, high acuity events were 50% greater after FY 2004 than before, regardless of subsequent admission, and most common among boys and girls who self-poisoned. In girls, opposing linear trends before and after FY 2004 were observed in the proportion of self-poisonings and cut (or) pierce SRB methods. Throughout the study period, there was a linear decline in the proportion of boys presenting to the ED with other methods.

CONCLUSIONS

The previously reported increase in hospital admissions after the warnings and during the recession is unlikely artifactual. An equivalent increase in high acuity events was also evident among those not subsequently admitted. The reasons for varying responses in boys and girls by SRB method warrant further study.

Evaluating the effect of emergency department crowding on triage destination

Background

Emergency Department (ED) crowding has been studied for the last 20 years, yet many questions remain about its impact on patient care. In this study, we aimed to determine if ED crowding influenced patient triage destination and intensity of investigation, as well as rates of unscheduled returns to the ED. We focused on patients presenting with chest pain or shortness of breath, triaged as high acuity, and who were subsequently discharged home.

Methods

This pilot study was a health records review of 500 patients presenting to two urban tertiary care EDs with chest pain or shortness of breath, triaged as high acuity and subsequently discharged home. Data extracted included triage time, date, treatment area, time to physician initial assessment, investigations ordered, disposition, and return ED visits within 14 days. We defined ED crowding as ED occupancy greater than 1.5. Data were analyzed using descriptive statistics and the χ² and Fisher exact tests.

Results

Over half of the patients, 260/500 (52.0%) presented during conditions of ED crowding. More patients were triaged to the non-monitored area of the ED during ED crowding (65/260 (25.0%) vs. 39/240 (16.3%) when not crowded, P = 0.02). During ED crowding, mean time to physician initial assessment was 132.0 minutes in the non-monitored area vs. 99.1 minutes in the monitored area, P <0.0001. When the ED was not crowded, mean time to physician initial assessment was 122.3 minutes in the non-monitored area vs. 67 minutes in the monitored area, P = 0.0003. Patients did not return to the ED more often when triaged during ED crowding: 24/260 (9.3%) vs. 29/240 (12.1%) when ED was not crowded (P = 0.31). Overall, when triaged to the non-monitored area of the ED, 44/396 (11.1%) patients returned, whereas in the monitored area 9/104 (8.7%) patients returned, P = 0.46.

Conclusions

ED crowding conditions appeared to influence triage destination in our ED leading to longer wait times for high acuity patients. This did not appear to lead to higher rates of return ED visits amongst discharged patients in this cohort. Further research is needed to determine whether these delays lead to adverse patient outcomes.

Increased emergency room visits or hospital admissions in females after 12-month MMR vaccination, but no difference after vaccinations given at a younger age

BACKGROUND

Previous studies have suggested that a child's sex may be a predictor of vaccine reactions.

METHODS

We used a self-controlled case series design, an extension of retrospective cohort methodology which controls for fixed confounders using a conditional Poisson modeling approach. We compared a risk period immediately following vaccination to a control period farther removed from vaccination in each child and estimated the relative incidence of emergency room visits and/or hospital admissions following the 2-, 4-, 6-, and 12-month vaccinations to investigate the effect of sex on relative incidence. All infants born in Ontario, Canada between April 1, 2002 and March 31, 2009 were eligible for study inclusion.

RESULTS

In analyses combining immunizations at 2, 4 and 6 months and examining these vaccinations separately, there was no significant relationship between the relative incidence of an event and sex of the child. At 12 months, we observed a significant effect of sex, with female sex being associated with a significantly higher relative incidence of events (P=0.0027). The relative incidence ratio (95% CI) comparing females to males following the 12-month vaccination was 1.08 (1.03 to 1.14), which translates to 192 excess events per 100,000 females vaccinated compared to the number of events that would have occurred in 100,000 males vaccinated.

CONCLUSIONS

As the MMR vaccine is given at 12 months of age in Ontario, our findings suggest that girls may have an increased reactogenicity to the MMR vaccine which may be indicative of general sex differences in the responses to the measles virus.

Priority setting in neurosurgery as exemplified by an everyday challenge

BACKGROUND

The allocation of limited healthcare resources poses a constant challenge for clinicians. One everyday example is the prioritization of elective neurosurgical operating room (OR) time in circumstances where cancellations may be encountered. The bioethical framework, Accountability for Reasonableness (A4R) may inform such decisions by establishing conditions that should be met for ethically-justifiable priority setting.

OBJECTIVE

Here, we describe our experience in implementing A4R to guide decisions regarding elective OR prioritization.

METHODS

The four primary expectations of the A4R process are: (1) relevance, namely achieved by support for the process and criteria for decisions amongst all stakeholders; (2) publicity, satisfied by the effective communication of the results of the deliberation; (3) challengeability through a fair appeals process; and (4) Oversight of the process to ensure that opportunities for its improvement are available.

RESULTS

A4R may be applied to inform OR time prioritization, with benefits to patients, surgeons and the institution itself. We discuss various case-, patient-, and surgeon-related factors that may be incorporated into the decision-making process. Furthermore, we explore challenges encountered in the implementation of this process, including the need for timely neurosurgical decision-making and the presence of hospital-based power imbalances.

CONCLUSION

The authors recommend the implementation of a fair, deliberative process to inform priority setting in neurosurgery, as demonstrated by the application of the A4R framework to allocate limited OR time.

Critically ill patients in emergency department may be characterized by low amplitude and high variability of amplitude of pulse photoplethysmography

Background

The aim of the present pilot study was to determine if pulse photoplethysmography amplitude (PPGA) could be used as an indicator of critical illness and as a predictor of higher need of care in emergency department patients.

Methods

This was a prospective observational study. We collected vital signs and one minute of pulse photoplethysmograph signal from 251 consecutive patients admitted to a university hospital emergency department. The patients were divided in two groups regarding to the modified Early Warning Score (mEWS): > 3 (critically ill) and ≤ 3 (non-critically ill). Photoplethysmography characteristics were compared between the groups.

Results

Sufficient data for analysis was acquired from 212 patients (84.5%). Patients in critically ill group more frequently required intubation and invasive hemodynamic monitoring in the ED and received more intravenous fluids. Mean pulse photoplethysmography amplitude (PPGA) was significantly lower in critically ill patients (median 1.105 [95% CI of mean 0.9946-2.302] vs. 2.476 [95% CI of mean 2.239-2.714], P = 0.0257). Higher variability of PPGA significantly correlated with higher amount of fluids received in the ED (r = 0.1501, p = 0.0296).

Conclusions

This pilot study revealed differences in PPGA characteristics between critically ill and non-critically ill patients. Further studies are needed to determine if these easily available parameters could help increase accuracy in triage when used in addition to routine monitoring of vital signs.

The impact of unstable housing on emergency department use in a cohort of HIV-positive people in a Canadian setting

The social-structural challenges experienced by people living with HIV (PHA) have been shown to contribute to increased use of the emergency department (ED). This study identified factors associated with frequent and nonurgent ED use within a cohort of people accessing antiretroviral therapy (ART) in a Canadian setting. Interviewer-administered surveys collected socio-demographic information; clinical variables were obtained through linkages with the provincial drug treatment registry; and ED admission data were abstracted from the Department of Emergency Medicine database. Multivariate logistic regression was used to compute odds of frequent and nonurgent ED use. Unstable housing was independently associated with ED use (adjusted odds ratio [AOR] =1.94, 95% confidence interval [CI] 1.24-3.04]), having three or more ED visits within 6 months of the interview date [AOR: 2.03 (95% CI: 1.07-3.83)] and being triaged as nonurgent (AOR = 2.71, 95% CI: 1.19-6.17). Frequent and nonurgent use of the ED in this setting is associated with conditions requiring interventions at the social-structural level. Supportive housing may contribute to decreased health-care costs and improved health outcomes amongst marginalized PHA.

Real-Time Scalable Resource Tracking Framework (DIORAMA) for Mass Casualty Incidents

DIORAMA system which is using rapid information collection and accurate resource tracking can assist incident commanders in their attempt to bring order to the chaos as they direct rescue operations for Mass Casualty Incidents (MCI). This system makes use of active Radio Frequency Identification (RFID) tags to identify the location and status of the patients and responders involved in a MCI. The authors introduce DIORAMA’s hardware and software architecture as well as the trials they conducted with up to 40 human subjects. The authors show that the DIORAMA system can significantly reduce the patient’s evacuation time compared to paper triage, consequently reducing the patients’ mortality. Moreover, the evacuation completeness of the DIORAMA based evacuation is always 100% as opposed to the paper-based evacuation where a number of patients are left behind. The information provided by the DIORAMA system can improve the coordination of the response to better match supply (care providers, ambulances, medical equipment) with demand (number of patients, level of acuity).

The oncology acuity tool: a reliable, valid method for measuring patient acuity for nurse assignment decisions

BACKGROUND AND PURPOSE

Matching nurse assignments with patient acuity has critical implications for providing safe, effective, and efficient care. Despite this, we lack well-established methods for accurate assessment of acuity. This study aimed to evaluate the reliability and validity of the Oncology Acuity Tool (OAT), which is used for determining nurse assignments.

METHODS

Inter-rater reliability and concurrent validity were assessed via surveys of current users of the tool. Content validity data were collected from expert oncology nurses. Predictive validity was assessed by tracking patients who sustained either of two acute events.

RESULTS

Findings included high inter-rater reliability, moderately strong concurrent validity, and moderate content validity. Acuity significantly predicted rapid response team consults but not falls.

CONCLUSIONS

The OAT demonstrated sufficient reliability and validity for measuring acuity prospectively in this population.

Safety and efficiency of calcium channel blockers versus beta-blockers for rate control in patients with atrial fibrillation and no acute underlying medical illness

OBJECTIVES

Many patients with atrial fibrillation (AF) are not candidates for rhythm control and may require rate control, typically with beta-blocking (BB) or calcium channel blocking (CCB) agents. Although these patients appear to have a low 30-day rate of stroke or death, it is unclear if one class of agent is safer or more effective. The objective was to determine whether BBs or CCBs would have a lower hospital admission rate and to measure 30-day safety outcomes including stroke, death, and emergency department (ED) revisits.

METHODS

This retrospective cohort study used a database from two urban EDs to identify consecutive patients with ED discharge diagnoses of AF from April 1, 2006, to March 31, 2010. Comorbidities, rhythms, management, and immediate outcomes were obtained by manual chart review, and patients with acute underlying medical conditions were excluded by predefined criteria. Patients managed only with rate control agents were eligible for review, and patients receiving BB agents were compared to those receiving CCB agents. The primary outcome was the proportion of patients requiring hospital admission; secondary outcomes included the ED length of stay (LOS), the proportion of patients having adverse events, the proportion of patients returning within 7 or 30 days, and the number of patients having a stroke or dying within 30 days.

RESULTS

A total of 259 consecutive patients were enrolled, with 100 receiving CCBs and 159 receiving BBs. Baseline demographics and comorbidities were similar. Twenty-seven percent of BB patients were admitted, and 31.0% of CCB patients were admitted (difference = 4.0%, 95% confidence interval [CI] = -7.7% to 16.1%), and there were no significant differences in ED LOS, adverse events, or 7- or 30-day ED revisits. One patient who received metoprolol had a stroke, and one patient who received diltiazem died within 30 days.

CONCLUSIONS

In this cohort of ED patients with AF and no acute underlying medical illness who underwent rate control only, patients receiving CCBs had similar hospital admission rates to those receiving BBs, while both classes of medications appeared equally safe at 30 days. Both CCBs and BBs are acceptable options for rate control.

Emergency department presentations for self-harm among Ontario youth

OBJECTIVES

Self-harm is an important public health issue among youth, including as a major risk factor for suicide (a leading cause of death in this age group). This study used population-based emergency department data to describe clinical and demographic characteristics of emergency department presentations for self-harm among youth (12-17 year-olds) in the province of Ontario, Canada.

METHODS

Administrative data capturing every emergency department visit in Ontario between April 1, 2002 and March 31, 2009 were used to identify and describe self-harm presentations.

RESULTS

Over the 7-year period between 2002/03 and 2008/09, there were 16,835 self-harm presentations by 12,907 youth. Two thirds of self-harm presentations were self-poisonings (almost always with medicinal agents), followed by self-cutting, which accounted for about one quarter. Incidence rates were higher in girls than boys, increased with age, were inversely related to neighbourhood income and were highest in rural areas. Self-harm accounted for about 1 in 100 emergency department presentations by youth, but also a disproportionate number of presentations triaged as high acuity or admitted to hospital (about 1 in 20).

CONCLUSION

Self-harm is an important public health issue, requiring a comprehensive approach to prevention. Ontario has useful data with which to study emergency department presentations for self-harm, and the similarities between self-harm presentations among Ontario youth and those reported from the United States and Europe suggest generalizability of results between populations. Further research is needed to address the reasons for the geographic differences in frequency of self-harm.

Racial disparity in emergency department triage

BACKGROUND

Previous reports of lower triage acuity scores and longer Emergency Department (ED) wait times for African Americans compared to Caucasians had insufficient information to determine if this was due to bias or appropriately based on medical history and clinical presentation.

OBJECTIVE

(1) Determine if African Americans are assigned lower triage acuity scores (TAS) after adjusting for a number of demographic and clinical variables likely to affect triage scores. (2) Determine if lower TAS translate into clinically significant longer wait times to assignment to a treatment area.

METHODS

This was a retrospective matched cohort design analysis of de-identified data extracted from the ED electronic medical record system, which included demographic and clinical information, as well as TAS, and ED process times. Triage scores were assigned using a 5-point scale (ESI), with 1 being most urgent and 5 being least urgent. Mean TAS and wait times to a treatment area for specific chief complaints were compared by race; after adjusting for age, gender, insurance status, time of day, day of week, presence of co-morbidities, and abnormal vital signs using a 1:1 matched case analysis.

RESULTS

The overall mean TAS for African Americans was 2.97 vs. 2.81 for Caucasians (difference of 0.18; p<0.001), translating to a lower acuity rating. African Americans had a significantly longer wait time to a treatment area compared to case-matched Caucasians (10.9min; p<0.001), with much larger differences in wait times noted within certain specific chief complaint categories.

CONCLUSION

Our current study supports the hypothesis that racial bias may influence the triage process.

Association between socioeconomic status and adverse events following immunization at 2, 4, 6 and 12 months

Using a population-based self-controlled case series design, we examined data on children born between the years 2002 and 2009 in the province of Ontario, Canada. We specifically examined how socioeconomic status (SES) influences rates of adverse events following immunization (AEFI), defined as emergency room visits and / or hospital admissions. For vaccination at 2, 4 and 6 mo combined, the relative incidence of AEFI (95% CI) in the first 72 h after vaccination was 0.69 (0.67 to 0.71). For all three vaccinations combined, we observed no relationship between the relative incidence of an event and quintile of socioeconomic status (p = 0.1433). For the 12-mo vaccination alone, the relative incidence of events (95% CI) on days 4 to 12 following immunization was 1.35 (1.31 to 1.38). We observed a significant relationship between socioeconomic status and vaccination at 12 mo, with lower SES being associated with a higher relative incidence of events (p = 0.0075). When the lowest 2 quintiles of income combined were compared with the highest 3 quintiles, the relative incidence ratio (95% CI) was 0.94 (0.89 to 0.99, p = 0.02). These results translate to 150 additional adverse events in the lower SES quintiles as compared with the higher SES quintiles for every 100,000 children vaccinated, or 1 additional event for every 666 individuals vaccinated. Future studies should explore potential explanations for this observation.

Unscheduled return visits to the emergency department: consequences for triage

OBJECTIVES

The objective was to conduct a survey of unscheduled revisits (URs) to the emergency department (ED) within 8 days of a prior visit, to test the hypothesis that patients making these URs are disproportionately likely to suffer short-term mortality or manifest a need for any admission to the hospital (adverse events [AEs]) at the time of the UR, compared to patients triaged at the same level who did not have an unscheduled ED revisit within 8 days.

METHODS

This was a 1-year retrospective study of patients with an UR to the ED of an urban, 1,600-bed tertiary care center and teaching hospital. The criteria for inclusion as an UR were: 1) making an emergency visit to our adult ED during 2008, without being admitted to our hospital nor being transferred to another hospital; and 2) subsequently making an UR to the same ED within 8 days following the first one. Patients who were contacted by members of our staff and specifically asked to make return visits to our ED (such as those who returned for wound care follow-up visits), and those who made more than five visits to our ED during 2008, were excluded. AEs were defined as death or hospitalization within 8 days of the second visit.

RESULTS

During 2008, there were 946 patients with URs (2% of patients treated and released after the first ED visit), and 931 were analyzed (n = 15 missing values). Associated with the second visit, an AE was noted for 276 (30%) patients. Eight variables were significantly associated with AE: age ≥ 65 years, previously diagnosed cancer, previously diagnosed cardiac disease, previously diagnosed psychiatric disease, presence of a relative at the time of the UR, arrival with a letter from a general practitioner at the time of the UR, a higher level of severity assigned at triage for the UR than for the first ED visit, and having had blood sample analysis performed during the first visit. The median triage score for the UR was not significantly different from that group's median triage score for the first ED visit, whereas the proportion of admissions to the hospital (29%) or to the intensive care unit (ICU; 2%) was greater overall in the UR group than in the patients making their first ED visit.

CONCLUSIONS

The authors observed that 2% of patients had an UR. This UR population was at greater risk of AE at the time of their URs compared to their initial visits, but the median triage nurse score was not significantly different between the first visit and the UR. This suggests that the triage score should be systematically upgraded for UR patients.

During and beyond the triage encounter: chronically ill elderly patients' experiences throughout their emergency department attendances

BACKGROUND

Chronically ill elderly patients are frequent users of care in emergency departments (EDs). Due to their presenting symptoms, these patients are often assessed on a low urgency level of priority by the triage nurse.

AIM

The aim of the study was to explore and describe the experiences of a group of chronically ill elderly patients' during their triage encounter and subsequent ED stay.

METHOD

The data consisted of 14 open-ended interviews with chronically ill patients aged between 71 and 90years. A lifeworld approach was used in order to describe the essence of patient experiences. The study was carried out with a descriptive phenomenological research perspective.

CONCLUSION

The visit to the ED was experienced as contradictory. The triage encounter fostered confidence and set promising expectations, but during the rest of the visit, the patient felt abandoned and considered the staff to be uncommitted and reluctant. These ambiguous experiences of their ED visits indicate a need for exploring possible ways of improving the situation for the chronically ill older person in ED.

Using a theory to understand triage decision making

The purpose of this discussion is to present triage decision making research within the context of the Revised Cognitive Continuum Theory. Triage is an essential clinical skill in emergency nursing. Understanding the best way to facilitate this skill is vital when educating new nurses or providing continuing education to practicing nurses. Delineating research evidence within a theory allows clinical educators to understand practices that foster successful triage skills and permits the grounding of educational strategies within a theoretical framework.

Classification of patients by severity grades during triage in the emergency department using data mining methods

OBJECTIVE

To test the feasibility of classifying emergency department patients into severity grades using data mining methods.

DESIGN

Emergency department records of 402 patients were classified into five severity grades by two expert physicians. The Naïve Bayes and C4.5 algorithms were applied to produce classifiers from patient data into severity grades. The classifiers' results over several subsets of the data were compared with the physicians' assessments, with a random classifier, and with a classifier that selects the maximal-prevalence class.

MEASUREMENTS

Positive predictive value, multiple-class extensions of sensitivity and specificity combinations, and entropy change.

RESULTS

The mean accuracy of the data mining classifiers was 52.94 ± 5.89%, significantly better (P < 0.05) than the mean accuracy of a random classifier (34.60 ± 2.40%). The entropy of the input data sets was reduced through classification by a mean of 10.1%. Allowing for classification deviations of one severity grade led to mean accuracy of 85.42 ± 1.42%. The classifiers' accuracy in that case was similar to the physicians' consensus rate. Learning from consensus records led to better performance. Reducing the number of severity grades improved results in certain cases. The performance of the Naïve Bayes and C4.5 algorithms was similar; in unbalanced data sets, Naïve Bayes performed better.

CONCLUSIONS

It is possible to produce a computerized classification model for the severity grade of triage patients, using data mining methods. Learning from patient records regarding which there is a consensus of several physicians is preferable to learning from each physician's patients. Either Naïve Bayes or C4.5 can be used; Naïve Bayes is preferable for unbalanced data sets. An ambiguity in the intermediate severity grades seems to hamper both the physicians' agreement and the classifiers' accuracy.

Improving vital sign documentation at triage: an emergency department quality improvement project

BACKGROUND

Improving the quality and safety of patients seen in an emergency department (ED) has become a priority in Italy. The Tuscan Regional Health Ministry has supported quality improvement projects in several Tuscan EDs in cooperation with Harvard Medical International and Harvard Medical School.

OBJECTIVE

To improve the triage process, we assessed the completeness of documenting the vital signs of patients seen at triage in the ED of the University Hospital Santa Chiara, Pisa, Italy. At the University Hospital of Pisa's ED, triage is based on 5 categories, each identified by a color: white (lowest priority), blue, green, yellow, and red (highest priority). For patients triaged as "yellow," blood pressure, heart rate, and oxygen saturation are considered mandatory vital signs and important components of a complete patient record. The aims of this project were as follows: 1) to assess the percentage of patients seen during ED triage in whom vital signs were recorded in the clinical record, 2) to analyze the reasons for missing vital sign data, and 3) to design and implement a strategy to improve the percentage of patients in whom vital signs were recorded.

METHODS

This project began in November 2005 with the identification of a multidisciplinary ED Quality Team. Faculty from Harvard Medical School provided a 2-day training course on the methods and tools of clinical quality improvement. After the training, the team defined their improvement project. The clinical quality improvement project followed a Plan-Do-Study-Act cycle. Preintervention and postintervention data collection consisted of a retrospective analysis of one-third of all patients triaged in the "yellow" category who were admitted to the ED during 1 month, randomly selected using a computer-generated list.

RESULTS

A total of 245 clinical records in the preintervention (March 2006) and 251 (April-May 2007) during the postintervention were included. We found that in 77.9% (191/245) of these records, vital signs were correctly recorded during the preintervention period. Patients with limb trauma and those with abdominal complaints represented the vast majority of patients in whom vital sign data were missing. The postintervention data revealed an improvement in the documentation of mandatory vital signs from 77.9% to 87.9%.

CONCLUSIONS

Creating a multidisciplinary team and implementing a formal quality improvement project improved vital sign documentation at triage for a group of patients seen during ED triage in 1 Italian hospital.