Triage nurses' decisions using the National Triage Scale for Australian emergency departments

Assessing the precision of artificial intelligence in ED triage decisions: Insights from a study with ChatGPT

BACKGROUND

The rise in emergency department presentations globally poses challenges for efficient patient management. To address this, various strategies aim to expedite patient management. Artificial intelligence's (AI) consistent performance and rapid data interpretation extend its healthcare applications, especially in emergencies. The introduction of a robust AI tool like ChatGPT, based on GPT-4 developed by OpenAI, can benefit patients and healthcare professionals by improving the speed and accuracy of resource allocation. This study examines ChatGPT's capability to predict triage outcomes based on local emergency department rules.

METHODS

This study is a single-center prospective observational study. The study population consists of all patients who presented to the emergency department with any symptoms and agreed to participate. The study was conducted on three non-consecutive days for a total of 72 h. Patients' chief complaints, vital parameters, medical history and the area to which they were directed by the triage team in the emergency department were recorded. Concurrently, an emergency medicine physician inputted the same data into previously trained GPT-4, according to local rules. According to this data, the triage decisions made by GPT-4 were recorded. In the same process, an emergency medicine specialist determined where the patient should be directed based on the data collected, and this decision was considered the gold standard. Accuracy rates and reliability for directing patients to specific areas by the triage team and GPT-4 were evaluated using Cohen's kappa test. Furthermore, the accuracy of the patient triage process performed by the triage team and GPT-4 was assessed by receiver operating characteristic (ROC) analysis. Statistical analysis considered a value of p < 0.05 as significant.

RESULTS

The study was carried out on 758 patients. Among the participants, 416 (54.9%) were male and 342 (45.1%) were female. Evaluating the primary endpoints of our study - the agreement between the decisions of the triage team, GPT-4 decisions in emergency department triage, and the gold standard - we observed almost perfect agreement both between the triage team and the gold standard and between GPT-4 and the gold standard (Cohen's Kappa 0.893 and 0.899, respectively; p < 0.001 for each).

CONCLUSION

Our findings suggest GPT-4 possess outstanding predictive skills in triaging patients in an emergency setting. GPT-4 can serve as an effective tool to support the triage process.

Factors affecting the triage decision-making ability of emergency nurses in Northern China: A multi-center descriptive survey

INTRODUCTION

The quality of triage decision-making is a prerequisite for priority treatment of critically ill patients and effective utilization of medical resources. Figuring out how to improve triage decision-making is still a topic around the global emergency department. Hence, this study aims to promote an understanding of triage priority care and clarify the elements influencing triage decision-making ability, offering reference for the future to improve the quality of triage decision-making.

METHOD

A total of 404 emergency nurses from 11 tertiary hospitals in northern China were surveyed by questionnaire, of which 371 valid questionnaires were submitted (effective rate = 91.83 %). One hospital distributed the questionnaire face-to-face, and the other ten used online form.

RESULT

Prior to occupying triage jobs, only a quarter of participants(25.30 %)were qualified. Less than half of emergency nurses (46.60 %) reported taking part in the triage training program. The emergency nurses' triage decision-making ability score was 166.50 ± 26.90(95 %CI 163.75,169.24) in northern China. Gender(P = 0.003), case discussion(P = 0.024), secondary assessment(P = 0.020)and knowledge of triage consensus(P = 0.027) are independent factors influencing triage decision-making ability.

CONCLUSION

Emergency triage practices are less implemented in northern China. The triage decision-making ability of emergency nurses in northern China is at a low level. Providing emergency nurses with diverse opportunities to develop their triage skills, finding effective triage training content, form, and frequency, strengthening implement triage consensus, and wisely managing triage nurse resources would improve triage decision-making.

Validation of a five-level triage system in pediatric trauma and the effectiveness of triage nurse modification: A multi-center cohort analysis

INTRODUCTION

Triage is one of the most important tasks for nurses in a modern emergency department (ED) and it plays a critical role in pediatric trauma. An appropriate triage system can improve patient outcomes and decrease resource wasting. However, triage systems for pediatric trauma have not been validated worldwide. To ensure clinical reliability, nurses are allowed to override the acuity level at the end of the routine triage process. This study aimed to validate the Taiwan Triage and Acuity Scale (TTAS) for pediatric trauma and evaluate the effectiveness of triage nurse modification.

METHODS

This was a multicenter retrospective cohort study analyzing triage data of all pediatric trauma patients who visited six EDs across Taiwan from 2015 to 2019. Each patient was triaged by a well-trained nurse and assigned an acuity level. Triage nurses can modify their acuity based on their professional judgment. The primary outcome was the predictive performance of TTAS for pediatric trauma, including hospitalization, ED length of stay, emergency surgery, and costs. The secondary outcome was the accuracy of nurse modification and the contributing factors. Multivariate regression was used for data analysis. The Akaike information criterion and C-statistics were utilized to measure the prediction performance of TTAS.

RESULTS

In total, 45,364 pediatric patients were included in this study. Overall mortality, hospitalization, and emergency surgery rates were 0.17, 5.4, and 0.76%, respectively. In almost all cases (97.48%), the triage nurses agreed upon the original scale. All major outcomes showed a significant positive correlation with the upgrade of acuity levels in TTAS in pediatric trauma patients. After nurse modification, the Akaike information criterion decreased and C-statistics increased, indicating better prediction performance. The factors contributing to this modification were being under 6 years of age, heart rate, respiratory rate, and primary location of injuries.

CONCLUSION

The TTAS is a reliable triage tool for pediatric trauma patients. Modification by well-experienced triage nurses can enhance its prediction performance. Younger age, heart rate, respiratory rate, and primary location of injuries contributed to modifications of the triage nurse. Further external validation is required to determine its role in pediatric trauma worldwide.

A longitudinal, retrospective registry-based validation study of RETTS©, the Swedish adult ED context version

Background

Triage and triage related work has been performed in Swedish Emergency Departments (EDs) since the mid-1990s. The Rapid Emergency Triage and Treatment System (RETTS©), with annual updates, is the most applied triage system. However, the national implementation has been performed despite low scientific foundation for triage as a method, mainly related to the absence of adjustment to age and gender. Furthermore, there is a lack of studies of RETTS© in Swedish ED context, especially of RETTS© validity. Hence, the aim the study was to determine the validity of RETTS©.

Methods

A longitudinal retrospective register study based on cohort data from a healthcare region comprising two EDs in southern Sweden. Two editions of RETTS© was selected; year 2013 and 2016, enabling comparison of crude data, and adjusted for age-combined Charlson comorbidity index (ACCI) and gender. All patients ≥ 18 years visiting either of the two EDs seeing a physician, was included. Primary outcome was ten-day mortality, secondary outcome was admission to Intensive Care Unit (ICU). The data was analysed with descriptive, and inferential statistics.

Results

Totally 74,845 patients were included. There was an increase in patients allocated red or orange triage levels (unstable) between the years, but a decrease of admission, both to general ward and ICU. Of all patients, 1031 (1.4%) died within ten-days. Both cohorts demonstrated a statistically significant difference between the triage levels, i.e. a higher risk for ten-day mortality and ICU admission for patients in all triage levels compared to those in green triage level. Furthermore, significant statistically differences were demonstrated for ICU admission, crude as well as adjusted, and for adjusted data ten-day mortality, indicating that ACCI explained ten-day mortality, but not ICU admission. However, no statistically significant difference was found for the two annual editions of RETTS© considering ten-day mortality, crude data.

Conclusion

The annual upgrade of RETTS© had no statistically significant impact on the validity of the triage system, considering the risk for ten-day mortality. However, the inclusion of ACCI, or at least age, can improve the validity of the triage system.

Graphical Abstract

Effects of environmental distractors on nurse emergency triage accuracy: a pilot study protocol

Background

The clinical decisions of emergency department triage nurses need to be of the highest accuracy. However, studies have found repeatedly that these nurses over- or underestimate the severity of patient health conditions. This has major consequences for patient safety and patient flow management. Workplace distractors such as noise and task interruptions have been pointed to as factors that might explain this inaccuracy. The use of a serious game reproducing the work environment during triage affords the opportunity to explore the impact of these distractors on nurse emergency triage accuracy, in a safe setting.

Methods/design

A pilot study with a factorial design will be carried out to test the acceptability and feasibility of a serious game developed specifically to simulate the triage process in emergency departments and to explore the primary effects of distractors on nurse emergency triage accuracy. Eighty emergency nurses will be randomized into four groups: three groups exposed to different distractors (A, noise; B, task interruptions; C, noise and task interruptions) and one control group. All nurses will have to complete 20 clinical vignettes within 2 h. For each vignette, a gold standard assessment will be determined by experts. Pre-tests will be conducted with clinicians and certified emergency nurses to evaluate the appeal of the serious game.

Discussion

Study results will inform the design of large-scale investigations and will help identify teaching, training, and research areas that require further development.

Converging perspectives of providers and student users on extending a patient portal into a university-based mental health service: A qualitative study

BACKGROUND

Patient portals have the potential to increase access to mental health services. However, a lack of research is available to guide practices on extending patient portals into mental health services. This study explored stakeholder (student service users' and health providers') expectations and perceptions of extending patient portals into a New Zealand university-based mental health service.

MATERIALS AND METHODS

This qualitative study explored the perspectives of 17 students and staff members at a university-based health and counselling service on an Internet-based patient portal through a software demonstration, two focus groups and 13 interviews. Data were analyzed thematically.

RESULTS

Staff and students perceived the patient portal as useful, easy to use and expected it to help make mental health care more accessible. Staff were most concerned with the portal's ability to support their triage processes and that it might enable students to 'counselor hop' (see multiple counselors). Staff recommended extension into services that do not require triage. Most students expected the portal to enhance patient-counselor contact and rapport, through continuity of care. Students were concerned with appointment waiting times, the stigmatization of poor mental health and their capacity to seek help. They considered the portal might assist with this. Students recommended extension into all services, including urgent appointments. After viewing findings from initial student and staff groups, staff concluded that extending a patient portal into their counseling services should be prioritized.

CONCLUSION

This research suggests that there is value in extending patient portals into mental health care, especially into low-risk services. Future research should explore opportunities to support triage and appointment-making processes for mental health services, via patient portals.

Development and preliminary testing of an online software system to facilitate assessment of accuracy and consistency in applying the Australasian Triage Scale

PURPOSE

The aim of this project was to design and evaluate an online software system to facilitate the assessment of triage decision accuracy and consistency in applying the Australasian Triage Scale.

BACKGROUND

Triage is a critical component of emergency nursing practice, which affects patient access to emergency care. Accurate and consistent triage decisions are vital to ensuring patient safety, timely access to care and ED operation. Presently, there is no standard process to examine triage decisions, measure current performance and support department and individual performance development activities to improve patient safety and quality of emergency care.

METHOD

An iterative design guided by a human factors development approach was used to develop a retrospective, focus-based analysis system to evaluate triage decision accuracy and consistency, and enable the exploration of service gaps and opportunities for practice change and professional development.

RESULTS

Triage decision accuracy and consistency, including areas for improvement are detectable and quantifiable. Findings generated may aid in departmental performance and professional development of triage nurses.

CONCLUSION

This is the first system developed to assess decision accuracy and consistency in applying the Australasian Triage Scale. This paper has described the development and preliminary testing of a user-centred design process and implementation of a web-based system to evaluate triage decision accuracy and consistency.

Accuracy and interrater reliability of paediatric emergency department triage

OBJECTIVE

To determine the accuracy and reliability of triage of children in public hospital EDs using the Australasian Triage Scale (ATS). This is the first study to examine these issues in paediatric triage following the 2007 development of the Emergency Triage Education Kit (ETEK) to foster accurate and consistent application of the ATS.

METHODS

A convenience sample of 167 triage nurses working at three general hospitals and one speciality paediatric hospital in greater metropolitan Melbourne assigned triage ratings for nine paediatric clinical scenarios using the ATS. Scenarios were derived from the ETEK or from other published sources. Kappa was used to assess interrater reliability within and between hospitals.

RESULTS

Triage nurses correctly assigned triage scores to an average of 5.3 of nine paediatric clinical scenarios. Accuracy in specific hospitals ranged from a low of 15% on one scenario, to 100% accuracy on a different scenario at a different hospital. Interrater reliability within and across the EDs studied was found to be kappa = 0.27. Both accuracy and interrater reliability were marginally higher at the speciality paediatric hospital.

CONCLUSIONS

Our findings demonstrate inconsistencies in the accuracy and reliability in which sick children presenting to EDs receive triage scores both within and across hospitals. These results suggest the need for improvements either in current triage nurse training or training resources. Use of the ETEK alone has not resulted in high levels of paediatric triage accuracy or reliability.

The accuracy and consistency of rural, remote and outpost triage nurse decision making in one Western Australia Country Health Service Region

BACKGROUND

The Australasian Triage Scale aims to ensure that the triage category allocated, reflects the urgency with which the patient needs medical assistance. This is dependent on triage nurse accuracy in decision making. The Australasian Triage Scale also aims to facilitate triage decision consistency between individuals and organisations. Various studies have explored the accuracy and consistency of triage decisions throughout Australia, yet no studies have specifically focussed on triage decision making in rural health services. Further, no standard has been identified by which accuracy or consistency should be measured. Australian emergency departments are measured against a set of standard performance indicators, including time from triage to patient review, and patient length of stay. There are currently no performance indicators for triage consistency.

METHODS

An online questionnaire was developed to collect demographic data and measure triage accuracy and consistency. The questionnaire utilised previously validated triage scenarios.(1) Triage decision accuracy was measured, and consistency was compared by health site type using Fleiss' kappa.

RESULTS

Forty-six triage nurses participated in this study. The accuracy of participants' triage decision-making decreased with each less urgent triage category. Post-graduate qualifications had no bearing on triage accuracy. There was no significant difference in the consistency of decision-making between paediatric and adult scenarios. Overall inter-rater agreement using Fleiss' kappa coefficient, was 0.4. This represents a fair-to-good level of inter-rater agreement.

CONCLUSIONS

A standard definition of accuracy and consistency in triage nurse decision making is required. Inaccurate triage decisions can result in increased morbidity and mortality. It is recommended that emergency department performance indicator thresholds be utilised as a benchmark for national triage consistency.

The effect of supportive emergency department nursing care on pain reduction of patients with Red Sea marine wildlife injuries

INTRODUCTION

The emergency department at Yoseftal hospital in Eilat is on the shore of the Red Sea, and it is visited by patients with marine wildlife injuries. The purpose of this study was to examine the effects of supportive nursing care on the pain level of patients with Red Sea marine wildlife injuries.

METHOD

A prospective quantitative study including 102 patients admitted to the emergency department. The study included a study group (N = 50) and a control group (N = 52). Both groups rated their pain level on the VAS before and after receiving treatment. The control group received the usual treatment, and the study group received the usual nursing treatment along with structured patient guidance and support.

RESULTS

There was a significant difference in the level of pain after the intervention between the control and the study group. In the study group, the level of pain was significantly reduced compared with the control group (p < 0.001).

DISCUSSION

Nursing training and patient guidance contributed to increasing cooperation with patients and pain reduction. Therefore, training interventions should be structured and assimilated as an integral part of nursing practice.

Expanding emergency department capacity: a multisite study

OBJECTIVES

The aims of the present study were to identify predictors of admission and describe outcomes for patients who arrived via ambulance to three Australian public emergency departments (EDs), before and after the opening of 41 additional ED beds within the area.

METHODS

The present study was a retrospective comparative cohort study using deterministically linked health data collected between 3 September 2006 and 2 September 2008. Data included ambulance offload delay, time to see doctor, ED length of stay (LOS), admission requirement, access block, hospital LOS and in-hospital mortality. Logistic regression analysis was undertaken to identify predictors of hospital admission.

RESULTS

Almost one-third of all 286037 ED presentations were via ambulance (n=79196) and 40.3% required admission. After increasing emergency capacity, the only outcome measure to improve was in-hospital mortality. Ambulance offload delay, time to see doctor, ED LOS, admission requirement, access block and hospital LOS did not improve. Strong predictors of admission before and after increased capacity included age >65 years, Australian Triage Scale (ATS) Category 1-3, diagnoses of circulatory or respiratory conditions and ED LOS >4h. With additional capacity, the odds ratios for these predictors increased for age >65 years and ED LOS >4h, and decreased for ATS category and ED diagnoses.

CONCLUSIONS

Expanding ED capacity from 81 to 122 beds within a health service area impacted favourably on mortality outcomes, but not on time-related service outcomes such as ambulance offload time, time to see doctor and ED LOS. To improve all service outcomes, when altering (increasing or decreasing) ED bed numbers, the whole healthcare system needs to be considered.

Beat the clock! Wait times and the production of 'quality' in emergency departments

Emergency care in large urban hospitals across the country is in the midst of major redesign intended to deliver quality care through improved access, decreased wait times, and maximum efficiency. The central argument in this paper is that the conceptualization of quality including the documentary facts and figures produced to substantiate quality emergency care is socially organized within a powerful ruling discourse that inserts the interests of politics and economics into nurses' work. The Canadian Triage and Acuity Scale figures prominently in the analysis as a high-level organizer of triage work and knowledge production that underpins the way those who administer the system define, measure and evaluate emergency care processes, and then use this information for restructuring. Managerial targets and thinking not only dominate the way emergency work is understood, determined, and controlled but also subsume the actual work of health-care providers in spaces called 'wait times', where it is systematically rendered 'unknowable'. The analysis is supported with evidence from an extensive institutional ethnography that shows what nurses actually do to manage the safe passage of patients through their emergency care process starting with the work of triage nurses.

Triage: an investigation of the process and potential vulnerabilities

AIM

To explore and describe the triage process in the Emergency Department to identify problems and potential vulnerabilities that may affect the triage process.

BACKGROUND

Triage is the first step in the patient journey in the Emergency Department and is often the front line in reducing the potential for errors and mistakes.

DESIGN

A fieldwork study to provide an in-depth appreciation and understanding of the triage process.

METHODS

Fieldwork included unstructured observer-only observation, field notes, informal and formal interviews that were conducted over the months of June, July and August 2012. Over 170 hours of observation were performed covering day, evening and night shifts, 7 days of the week. Sixty episodes of triage were observed; 31 informal interviews and 14 formal interviews were completed. Thematic analysis was used.

FINDINGS

Three themes were identified from the analysis of the data and included: 'negotiating patient flow and care delivery through the Emergency Department'; 'interdisciplinary team communicating and collaborating to provide appropriate and safe care to patients'; and 'varying levels of competence of the triage nurse'. In these themes, vulnerabilities and problems described included over and under triage, extended time to triage assessment, triage errors, multiple patients arriving simultaneously, emergency department and hospital overcrowding.

CONCLUSION

Findings suggest that vulnerabilities in the triage process may cause disruptions to patient flow and compromise care, thus potentially impacting nurses' ability to provide safe and effective care.

Daily life dialogue assessment in psychiatric care-face validity and inter-rater reliability of a tool based on the International Classification of Functioning, Disability and Health

This article describes the development of an assessment tool based on the International Classification of Functioning Disability and Health (ICF) adapted to a psychiatric nursing context where both the patient and the nurse assess the patient's ability to participate in various spheres of life. The aim was to test psychometric properties, focusing on face validity and inter-rater reliability. Three Swedish expert groups participated. Analysis of inter-rater reliability was conducted through simulated patient cases. The results of an unweighted kappa value of 0.38, a linear weighted kappa value of 0.65 and a quadratic weighted kappa value of 0.73 were considered as acceptable when using simulated patient cases.

The cognitive processes underpinning clinical decision in triage assessment: a theoretical conundrum?

High quality clinical decision-making (CDM) has been highlighted as a priority across the nursing profession. Triage nurses, in the Accident and Emergency (A&E) department, work in considerable levels of uncertainty and require essential skills including: critical thinking, evaluation and decision-making. The content of this paper aims to promote awareness of how triage nurses make judgements and decisions in emergency situations. By exploring relevant literature on clinical judgement and decision-making theory, this paper demonstrates the importance of high quality decision-making skills underpinning the triage nurse's role. Having an awareness of how judgements and decisions are made is argued as essential, in a time where traditional nurse boundaries and responsibilities are never more challenged. It is hoped that the paper not only raises this awareness in general but also, in particular, engages the triage nurse to look more critically at how they make their own decisions in their everyday practice.

Reducing uncertainty in triaging mental health presentations: examining triage decision-making

Little is known about how emergency department (ED) nurses make decisions and even less is known about triage nurses' decision-making. There is compelling motivation to better understand the processes by which triage nurses make decisions, particularly with complex patient populations such as those with frequently emotive mental health and illness issues. While accuracy and reliability of triage decisions generally have been improved through the introduction of standardised triage scales and instruments, other factors such as lack of knowledge or confidence related to mental health issues, past experiences that may elicit transference and countertransference, judgments about individuals based on their behavioural presentations may impact on decisions made at triage. In this paper, we review the current research regarding the effectiveness of triage tools particularly with mental health presentations, present a theoretical framework that may guide research in understanding how triage nurses approach decision-making, and apply that framework to thinking about research in mental health-related triage. Developing a better understanding of how triage nurses make decisions, particularly in situations where issues related to mental health and illness may raise the levels of uncertainty, is crucial to ensure that they have the skills and tools they need to provide the most effective, sensitive, and compassionate care possible.

A review of the quality assurance processes for the Australasian Triage Scale (ATS) and implications for future practice

Triage is a critical component in the delivery of time-sensitive emergency care. Decision-making and the activity of the triage nurse affect patient access to care and allocation of emergency department (ED) resources. It is important to be able to evaluate decision-making at triage to ensure patient safety, and to identify opportunities for professional and service development. At present, there is no standard approach to retrospective examination of triage decisions using the Australasian Triage Scale. The aim of this literature review is to identify the quality control strategies used in triage and the factors that appear to influence triage decisions in relation to the Australasian Triage Scale.

Atividades do enfermeiro nos sistemas de triagem/classificação de risco nos serviços de urgência: revisão integrativa

Objetivou-se identificar e avaliar as evidências disponíveis na literatura sobre as atividades do enfermeiro na classificação de risco nos serviços de urgência. Realizou-se uma revisão integrativa, com busca nas bases de dados Science Direct, Cumulative Index to Nursing and Allied Health Literature (CINAHL), Medical Literature Analysis and Retrievel System Online (MEDLINE), Literatura Latino-Americana e do Caribe em Ciências da Saúde (LILACS) e Scientific Electronic Library Online (SCIELO). Foram selecionados 22 artigos que atenderam aos critérios de inclusão. Os resultados evidenciaram que as principais atribuições deste profissional são a avaliação do estado de saúde do usuário e a tomada de decisão, processo que necessita de conhecimento clínico e de tempo de experiência. O enfermeiro tem a capacidade de organizar o fluxo dos usuários conforme a prioridade do atendimento e a demanda dos serviços, sendo um profissional de excelência na execução da triagem/classificação de risco nos serviços de urgência.

Emergency department triage scales and their components: a systematic review of the scientific evidence

Emergency department (ED) triage is used to identify patients' level of urgency and treat them based on their triage level. The global advancement of triage scales in the past two decades has generated considerable research on the validity and reliability of these scales. This systematic review aims to investigate the scientific evidence for published ED triage scales. The following questions are addressed: 1. Does assessment of individual vital signs or chief complaints affect mortality during the hospital stay or within 30 days after arrival at the ED?2. What is the level of agreement between clinicians' triage decisions compared to each other or to a gold standard for each scale (reliability)? 3. How valid is each triage scale in predicting hospitalization and hospital mortality? A systematic search of the international literature published from 1966 through March 31, 2009 explored the British Nursing Index, Business Source Premier, CINAHL, Cochrane Library, EMBASE, and PubMed. Inclusion was limited to controlled studies of adult patients (≥ 15 years) visiting EDs for somatic reasons. Outcome variables were death in ED or hospital and need for hospitalization (validity). Methodological quality and clinical relevance of each study were rated as high, medium, or low. The results from the studies that met the inclusion criteria and quality standards were synthesized applying the internationally developed GRADE system. Each conclusion was then assessed as having strong, moderately strong, limited, or insufficient scientific evidence. If studies were not available, this was also noted.We found ED triage scales to be supported, at best, by limited and often insufficient evidence.The ability of the individual vital signs included in the different scales to predict outcome is seldom, if at all, studied in the ED setting. The scientific evidence to assess interrater agreement (reliability) was limited for one triage scale and insufficient or lacking for all other scales. Two of the scales yielded limited scientific evidence, and one scale yielded insufficient evidence, on which to assess the risk of early death or hospitalization in patients assigned to the two lowest triage levels on a 5-level scale (validity).

Calculating kappas from adjusted data improved the comparability of the reliability of triage systems: a comparative study

OBJECTIVES

It is difficult to compare the reliability of triage systems with the kappa statistic. In this article, a method for comparing triage systems was developed and applied to previously conducted triage reliability studies.

STUDY DESIGN AND SETTING

From simulations with theoretical distributions, the minimum, normal, and maximum weighted kappa for 3- to 5-level triage systems were computed. To compare the reliability of triage systems in previously conducted triage reliability studies, the normal kappa was calculated. Furthermore, the reported quadratically weighted kappas were compared with the minimum, normal, and maximum weighted kappa to characterize the degree and direction of skewness of the data.

RESULTS

The normal kappa was higher in 3-level triage systems (median: κ=0.84) compared with 4-level (median: κ=0.37) and 5-level (median: κ=0.57) systems. In 3-level triage systems, the percentages observed agreement were unequally distributed, which resulted in small quadratically weighted kappas. In 4- and 5-level systems, the percentages observed agreement were more equally distributed compared with 3-level systems, which resulted in higher quadratically weighted kappa values.

CONCLUSION

When comparing triage systems with different numbers of categories, one should report both the normal and quadratically weighted kappa. Calculating normal kappas from previously conducted triage reliability studies revealed substantial theoretical differences in interrater reliability of triage systems than previously reported.

Patient experience of the triage encounter in a Swedish emergency department

Emergency department triage is a prerequisite for the rapid identification of critically ill patients and for allocation of the correct acuity level which is pivotal for medical safety. The patient's first encounter with a medical professional in the emergency department is often with the triage nurse.

OBJECTIVES

To identify patient experience of the triage encounter.

METHODS

A questionnaire focusing on the patient-triage nurse relationship in terms of satisfaction with the medical and administrative information, privacy and confidentiality in the triage area as well as triage nurse competence and attitude was answered by 146 participating patients.

RESULTS

The majority of patients perceived that while they were triaged immediately upon arrival to the emergency department, they were often given limited information about the waiting time. Although almost a quarter of the patients did not wish to have information about their medical condition from the triage nurse, 97% of the patients considered the triage nurse to be medically competent for the triage task.

CONCLUSIONS

Patients were generally satisfied with the reception and care given by the triage nurses, but less satisfied about information about expected waiting time. We suggest therefore, that patients should be routinely informed about their estimated waiting time to be seen by the doctor in addition to their triage level.

Patient journeys: the process of clinical redesign

*Clinical process redesign is a successful improvement method that has been used to increase access to health services in 60 public hospitals across New South Wales, and at Flinders Medical Centre (FMC) in South Australia. *The method focuses on the patient journey as the primary improvement locus, and uses process mapping to identify the value-adding steps in that journey; it involves redesign teams identifying and eliminating non-value-adding steps to improve flow and reduce delays in access to emergency and elective care. *The method engages clinicians, managers, patients and carers, and delivers real gains in health care delivery. *This article outlines the clinical process redesign programs being used by NSW Health and at FMC.

Do knowledge and experience have specific roles in triage decision-making?

Accuracy of triage decisions is a major influence on patient outcomes. Triage nurses' knowledge and experience have been cited as influential factors in triage decision-making. The aim of this article is to examine the independent roles of factual knowledge and experience in triage decisions. All of the articles cited in this review were research papers that examined the relationship between triage decisions and knowledge and/or experience of triage nurses. Numerous studies have shown that factual knowledge is an important factor in improving triage decisions. Although a number of studies have examined the role of experience as an independent influence on triage decisions, none have found a significant relationship between experience and triage decision-making. Factual knowledge appears to be more important than years of emergency nursing or triage experience in triage decision accuracy. Many triage education programs are underpinned by the assumption that knowledge acquisition will result in improved triage decisions. A better understanding of the relationships between clinical decisions, knowledge, and experience is pivotal for the rigorous evaluation of education programs.

Effect of an evidence-based paediatric fever education program on emergency nurses’ knowledge

INTRODUCTION

This study examined the effect of an educational intervention of factual knowledge on emergency nurses' knowledge and clinical decisions related to paediatric fever.

METHOD

A prospective pre-test/post-test design was used. Emergency nurses' factual knowledge was measured by parallel multiple choice questions and the intervention for the study was an educational intervention consisting of two tutorials. Pre-test data were collected in early June 2005 and post-test data were collected during August 2005.

RESULTS

Thirty-one emergency nurses completed the pre and post-test multiple choice questions. Emergency nurses' knowledge increased following the tutorials. Pre-test score was positively correlated with knowledge acquisition. Self-reports of independent decisions related to fever management were influenced by experience, hours of employment, level of appointment, postgraduate qualifications and pre-test score.

DISCUSSION

High levels of variability in knowledge and knowledge acquisition suggest a review of undergraduate and postgraduate curricula is warranted. Although this study identified associations between independent fever management decisions and participant characteristics, further research is pivotal to better understanding these relationships.

Predictive values of triage temperature and pulse for antibiotic administration and hospital admission in elderly patients with potential infection

To determine how well triage temperature and pulse abnormalities in elderly patients with potential infections predict antibiotic administration and hospital admission. Data from the National Hospital Ambulatory Care Survey (2001-2002), a sample of US emergency departments, were used. Patients (>or=65 years) with a reason for visit suggesting potential infection were included. Of 10,586 patients 65 years or older, 32% had reasons for visit suggesting potential infection. The negative predictive value for predicting intensive care unit admission (n = 154) for triage hyperthermia (temperature >or=38 degrees C) was 96% (95% confidence interval, 95%-96%); hypothermia (temperature <or=36 degrees C), 95% (95%-96%); pulse higher than 90, 97% (96%-98%); both pulse higher than 90 and hypothermia or hyperthermia, 96% (95%-96%); and either pulse higher than 90 or hypothermia or hyperthermia, 96% (95%-97%). The negative predictive value for the combined outcome of hospital admission and antibiotic administration (n = 432) for hyperthermia was 90% (88%-91%); hypothermia, 87% (86%-88%); pulse higher than 90, 90% (89%-92%); for both pulse higher than 90 and hypothermia or hyperthermia, 89% (88%-90%); and for either pulse higher than 90 or hypothermia or hyperthermia, 91% (90%-93%). Although the absence of pulse and temperature abnormalities in elderly patients with potential infection is predictive of not being admitted to the intensive care unit and the combined outcome of admission and hospitalization, this information should not be used alone to determine the presence or absence of a potentially time-sensitive infection.

Emergency department triage: is there a link between nurses' personal characteristics and accuracy in triage decisions?

INTRODUCTION

A common task of registered nurses is to perform emergency department triage, often using an especially designed triage scale in their assessment. However, little information is available about the factors that promote the quality of these decisions. This study investigated personal characteristics of registered nurses and the accuracy in their acuity ratings of patient scenarios.

METHODS

Using the Canadian Triage and Acuity Scale (CTAS), 423 registered nurses from 48 (62%) Swedish emergency departments individually triaged 18 patient scenarios.

RESULTS

The registered nurses' percentage of accurate acuity ratings was 58%, with a range from 22% to 89% accurate acuity ratings per registered nurse. In total, 60.3% of the registered nurses accurately triaged the scenarios in 50-69% of the cases. No relationship was found between personal characteristics of the registered nurses and their ability to triage.

DISCUSSION

The lack of a relationship between personal characteristics of registered nurses and their ability to triage suggests that there might be intrapersonal characteristics, particularly the decision-making strategies used which can partly explain this dispersion. Future research that focuses on decision-making is likely to contribute in identifying and describing essential nursing characteristics for successful emergency department triage.

Accuracy and concordance of nurses in emergency department triage

In the emergency department (ED) Registered Nurses (RNs) often perform triage, i.e. the sorting and prioritizing of patients. The allocation of acuity ratings is commonly based on a triage scale. To date, three reliable 5-level triage scales exist, of which the Canadian Triage and Acuity Scale (CTAS) is one. In Sweden, few studies on ED triage have been conducted and the organization of triage has been found to vary considerably with no common triage scale. The aim of this study was to investigate the accuracy and concordance of emergency nurses acuity ratings of patient scenarios in the ED setting. Totally, 423 RNs from 48 (62%) Swedish EDs each triaged 18 patient scenarios using the CTAS. Of the 7,550 triage ratings, 57.6% were triaged in concordance with the expected outcome and no scenario was triaged into the same triage level by all RNs. Inter-rater agreement for all RNs was kappa = 0.46 (unweighted) and kappa = 0.71 (weighted). The fact that the kappa-values are only moderate to good and the low concordance between the RNs call for further studies, especially from a patient safety perspective.

An exploration of accident and emergency nurse experiences of triage decision making in Hong Kong

This study used a descriptive qualitative design to explore emergency nurse experiences of decision making about triage in Hong Kong. Seven experienced nurses who were working in three different accident and emergency departments participated in the study. Unstructured interviews were used to provide the nurses with opportunities to describe their experiences. The findings fall into three main categories, including the experience of triage decision making, the use of information in the triage decision-making process, and the factors that influence triage decision making. Although the experience of triage was generally positive, the nurses felt frustrated and uncertain in some circumstances. In addition, triage decision making was influenced by a series of factors that occur in daily practice. The findings of this study have implications for the development of formal triage training and triage decision-making protocols in accident and emergency nursing. They also provide positive reinforcement and support to triage nurses that will enhance their ability to make decisions about triage. Avenues for further research in the area are recommended.

Triage nurse perceptions of the use, reliability and acceptability of the Toowoomba Adult Triage Trauma Tool (TATTT)

OBJECTIVE

The 'Toowoomba Adult Triage Trauma Tool' (TATTT) is a computerised clinical decision support tool developed to provide an evidence-based, valid and consistent method of triage assessment and categorisation. The objective of this study was to determine the most appropriate training and testing strategy for implementing the TATTT and to evaluate its acceptability for assisting in the triage prioritization process.

METHODS

Triage nurses (15) from two hospitals underwent training in the TATTT and were tested on its application. Semi-structured interviews gathered their perceptions of the training, the methods for testing and the acceptability of the TATTT for assisting in triage.

RESULTS

The TATTT was viewed positively by all but one of the nurses. Participants believed that it provided clear direction in the triage assessment process, increased their confidence in reaching a decision and would be comfortable in adopting the TATTT in clinical practice.

CONCLUSIONS

The study has shown that the TATTT is acceptable to users and is viewed as a viable alternative to current triage practice.

The Australasian Triage Scale: Examining emergency department nurses' performance using computer and paper scenarios

STUDY OBJECTIVE

The purpose of this study is to examine emergency nurses' performance using triage scenarios characterized by type of patient population (adult versus pediatric) and mode of delivery (paper versus computer).

METHODS

A combination of paper-based (script alone) and computer-based (script plus still photographs) triage scenarios were used. Of the 28 scenarios used, half were written and half were computer based. Within each subgroup, there were 7 adult and 7 pediatric scenarios. Participants were asked to allocate an Australasian Triage Scale category for each triage scenario.

RESULTS

One hundred sixty-seven participants completed a total of 2,349 adult scenarios, and 161 participants completed 2,265 pediatric scenarios. Sixty-one percent of the triage decisions made by the nurses were "expected" triage decisions, 18% were "undertriage," decisions, and 21% were "overtriage" decisions. Nurse triage allocation decisions for the scenarios containing still photographs delivered by computer demonstrated a higher average agreement percentage of 66.2% (kappa=0.56; tau b =0.77; P <.0001) compared with the average agreement percentage of 55.4% (kappa=0.42; tau b =0.75; P <.0001) using paper-based (text-only) scenarios.

CONCLUSION

The mode of delivery appeared to have an effect on the nurses' triage performance. It is unclear whether the use of simple still photographs used in the computer mode of delivery resulted in a higher incidence of expected triage decisions and, thus, improved performance. The use of cues such as photographs and video footage to enhance the fidelity of triage scenarios may be useful not only for the education of triage nurses but also the conduct of research into triage decisionmaking. However, further exploration and research in this area are warranted.

Reliability and validity of the Toowoomba adult trauma triage tool: a Queensland, Australia study

INTRODUCTION

In Australia a nationally adopted five tiered triage scale called the Australasian triage scale (ATS) is used for the purpose of differentiating patient acuity levels for all patients that present to an emergency department (ED). The scale was formulated with the aim of promoting a standardized approach to triage. Numerous studies now suggest that the ATS has not been successful in achieving this intention. The Toowoomba adult trauma triage tool (TATTT) seeks to address this deficiency by providing an evidence based, reproducible, reliable and valid method of triage categorisation, albeit in a select group of patients.

METHOD

Ten triage nurses from Toowoomba health service (THS) and five from Princess Alexandra Hospital in Queensland, Australia were enrolled in the study. Each participant rated five written simulations before receiving training in the TATTT. Each participant then rated nine written scenarios, five simulated scenarios on video and one computer simulated scenario with the TATTT. Parallel triaging of actual adult injury based presentations to THS ED was also undertaken.

RESULTS

The overall percentage agreement for all simulations for which data were available was 87%. The overall kappa statistic was 0.82 with a 95% confidence interval from 0.76 to 0.88. The overall percentage agreement between the triage category assigned using existing triage practices and the triage category assigned by the TATTT was approximately 47% with an estimated kappa of kappa(') = 0.19 (95% confidence interval [-0.02,0.40]).

CONCLUSION

Evidence from this study suggests that the TATTT provides systematically different results compared to current triage practices utilising the ATS. This provided evidence that triage practices did not reflect current evidence or available descriptors. Additionally TATTT has greater reliability than current triage practices.

Measuring the quality of judgement and decision-making in nursing

AIM

This paper discusses measurement of the quality of judgement and decision-making in nursing research. It examines theoretical and research issues surrounding how to measure judgement accuracy as a component of evaluating decision-making in nursing practice.

DISCUSSION

Judgement accuracy is discussed with reference to different methods of measurement, including comparing judgements with independent criteria and inter-judge approaches. Existing research on how judgement accuracy has been measured in nursing practice is examined. Evaluation of decisions is then discussed, including consideration of the process of decision-making and evaluating decision outcomes. Finally, existing research on decision-making in nursing is assessed and the strengths and limitations of different types of measurement discussed.

CONCLUSION

We suggests that researchers examining the quality of judgement and decision-making in nursing need to be aware of both the strengths and limitations of existing methods of measurement. We also suggest that researchers need to use a number of different methods, including normative approaches such as Bayes' Theorem and Subjective Expected Utility Theory.

Development of physiological discriminators for the Australasian Triage Scale

The Consistency of Triage in Victoria's Emergency Departments Project (2001), funded by the Victorian Department of Human Services, aimed to improve the consistency of application of the Australasian (National) Triage Scale (ATS). One of the major objectives of the project was the development of an education strategy to promote a consistent approach to triage education, leading to the development of the Adult Physiological Discriminators (APDs) for the ATS and Paediatric Physiological Discriminators (PPDs) for the ATS. The guidelines and physiological discriminators were developed in consultation with the Emergency Nurses' Association of Victoria (ENA Vic.) and clinical nurse educators, lecturers, nurse unit managers and clinicians from a wide variety of Emergency Departments (EDs) across Victoria. Numerous studies have identified varying degrees of inconsistency in the application of the ATS. A number of factors associated with inconsistency in the application of the ATS have also been alluded to in the literature. These range from the wide variation in the experiential and educational requirements of Victorian triage nurses to the specific clinical characteristics of the patient identified by the triage nurse. However, a consistent approach to triage education and uniform triage guidelines has been repeatedly identified as a key factor in improving the consistency of application of the ATS. Physiological data demonstrates the highest degree of objectivity and consistency and research has shown that physiological observations are useful and measurable indicators of clinical urgency and patient safety. This paper will discuss the development of these discriminators as part of the educational strategy including a critique of other approaches to triage decision-making and a review of the consultative processes used to facilitate consensus amongst triage nurses, ED Nurse Managers and ED Nurse Educators. The physiological discriminators developed by this project are also presented.

Current triage practice and influences affecting clinical decision-making in emergency departments in NSW, Australia

In Australia, as elsewhere, the nature of triage decision making, patient referral, investigations, physical resources, triage policies, educational requirements and clinical expertise is often unclear and differs between organizations (Gerdtz & Bucknell 2000; Standen 1998). The study described here was undertaken in order to explore current triage practices throughout New South Wales (NSW) and to describe the range of clinical reasoning tasks performed by nurses.

Clinical decisions using the National Triage Scale: how important is postgraduate education?

Triage is the formal nursing assessment of all patients who present to an Emergency Department (ED). The National Triage Scale (NTS) is used in most Australian EDs. Triage decision making involves the allocation of every patients presenting to an ED to one of the five NTS categories. The NTS directly relates a triage category to illness or injury severity and need for emergency care. Triage nurses' decisions not only have the potential to impact on the health outcomes of ED patients, they are also used, in part, to evaluate ED performance and allocate components of ED funding. This study was a correlational study that used survey methods. Triage decisions were classified as 'expected triage', 'overtriage' or 'undertriage' decisions. Participant's qualifications were allocated to five categories: 'nil'; 'emergency nursing'; 'critical care nursing'; 'midwifery'; and 'tertiary' qualifications. There was no correlation between triage decisions and length of experience in emergency nursing or triage. 'Expected triage' decisions were more common when the predicted triage category was Category 3 (P < 0.001) and 'overtriage' decisions were less common when the predicted triage category was Category 2 (P < 0.0010). The frequency of 'undertriage' decisions decreased significantly when the predicted triage category was Category 3 (P < 0.001) or Category 4 (P < 0.001). There was no correlation between triage decisions and qualifications in the 'nil', 'emergency nursing' or 'critical care nursing' categories. A midwifery qualification demonstrated a positive correlation with 'expected triage' decisions (P = 0.048) and a negative correlation with 'undertriage' decisions (P = 0.012). There was also a positive correlation between a tertiary qualification and 'expected triage' decisions (P = 0.012).