Do different types of nurses give different triage decisions in NHS Direct? A mixed methods study

Clinical decision support system in emergency telephone triage: A scoping review of technical design, implementation and evaluation

OBJECTIVES

Emergency department overcrowding could be improved by upstream telephone triage. Emergency telephone triage aims at managing and orientating adequately patients as early as possible and distributing limited supply of staff and materials. This complex task could be improved with the use of Clinical decision support systems (CDSS). The aim of this scoping review was to identify literature gaps for the future development and evaluation of CDSS for Emergency telephone triage.

MATERIALS AND METHODS

We present here a scoping review of CDSS designed for emergency telephone triage, and compared them in terms of functional characteristics, technical design, health care implementation and methodologies used for evaluation, following the PRISMA-ScR guidelines.

RESULTS

Regarding design, 19 CDSS were retrieved: 12 were knowledge based CDSS (decisional algorithms built according to guidelines or clinical expertise) and 7 were data driven (statistical, machine learning, or deep learning models). Most of them aimed at assisting nurses or non-medical staff by providing patient orientation and/or severity/priority assessment. Eleven were implemented in real life, and only three were connected to the Electronic Health Record. Regarding evaluation, CDSS were assessed through various aspects: intrinsic characteristics, impact on clinical practice or user apprehension. Only one pragmatic trial and one randomized controlled trial were conducted.

CONCLUSION

This review highlights the potential of a hybrid system, user tailored, flexible, connected to the electronic health record, which could work with oral, video and digital data; and the need to evaluate CDSS on intrinsic characteristics and impact on clinical practice, iteratively at each distinct stage of the IT lifecycle.

The Effect of an Electronic Medical Record-Based Clinical Decision Support System on Adherence to Clinical Protocols in Inflammatory Bowel Disease Care: Interrupted Time Series Study

Background

Clinical decision support systems (CDSSs) embedded in electronic medical records (EMRs), also called electronic health records, have the potential to improve the adoption of clinical guidelines. The University of Alberta Inflammatory Bowel Disease (IBD) Group developed a CDSS for patients with IBD who might be experiencing disease flare and deployed it within a clinical information system in 2 continuous time periods.

Objective

This study aims to evaluate the impact of the IBD CDSS on the adherence of health care providers (ie, physicians and nurses) to institutionally agreed clinical management protocols.

Methods

A 2-period interrupted time series (ITS) design, comparing adherence to a clinical flare management protocol during outpatient visits before and after the CDSS implementation, was used. Each interruption was initiated with user training and a memo with instructions for use. A group of 7 physicians, 1 nurse practitioner, and 4 nurses were invited to use the CDSS. In total, 31,726 flare encounters were extracted from the clinical information system database, and 9217 of them were manually screened for inclusion. Each data point in the ITS analysis corresponded to 1 month of individual patient encounters, with a total of 18 months of data (9 before and 9 after interruption) for each period. The study was designed in accordance with the Statement on Reporting of Evaluation Studies in Health Informatics (STARE-HI) guidelines for health informatics evaluations.

Results

Following manual screening, 623 flare encounters were confirmed and designated for ITS analysis. The CDSS was activated in 198 of 623 encounters, most commonly in cases where the primary visit reason was a suspected IBD flare. In Implementation Period 1, before-and-after analysis demonstrates an increase in documentation of clinical scores from 3.5% to 24.1% (P<.001), with a statistically significant level change in ITS analysis (P=.03). In Implementation Period 2, the before-and-after analysis showed further increases in the ordering of acute disease flare lab tests (47.6% to 65.8%; P<.001), including the biomarker fecal calprotectin (27.9% to 37.3%; P=.03) and stool culture testing (54.6% to 66.9%; P=.005); the latter is a test used to distinguish a flare from an infectious disease. There were no significant slope or level changes in ITS analyses in Implementation Period 2. The overall provider adoption rate was moderate at approximately 25%, with greater adoption by nurse providers (used in 30.5% of flare encounters) compared to physicians (used in 6.7% of flare encounters).

Conclusions

This is one of the first studies to investigate the implementation of a CDSS for IBD, designed with a leading EMR software (Epic Systems), providing initial evidence of an improvement over routine care. Several areas for future research were identified, notably the effect of CDSSs on outcomes and how to design a CDSS with greater utility for physicians. CDSSs for IBD should also be evaluated on a larger scale; this can be facilitated by regional and national centralized EMR systems.

Identifying key items to be addressed by non-clinical operators to manage out-of-hours telephone triage services for older adults seeking non-urgent unplanned care in Belgium: an e-Delphi study

BACKGROUND

This study aimed to achieve expert consensus regarding key items to be addressed by non-clinical operators using computer-software integrated medical dispatch protocols to manage out-of-hours telephone triage (OOH-TT) services for calls involving older adults seeking non-urgent unplanned care across Belgium.

METHODS

A three-part classic e-Delphi study was conducted. A purposive sample of experts specialized in out-of-hours unplanned care and/or older persons across Belgium were recruited as panelists. Eligibility criteria included experts with at least 2 years of relevant experience. Level of consensus was defined to be reached when at least 70% of the panelists agreed or disagreed regarding the value of each item proposed within a survey for the top 10 most frequently used protocols for triaging older adults. Responses were analyzed over several rounds until expert consensus was found. Descriptive and thematic analyses were used to aggregate responses.

RESULTS

N = 12 panelists agreed that several important missing protocol topics were not covered by the existing OOH-TT service. They also agreed about the nature of use (for the top 10 most frequently used protocols) but justified that some modifications should be made to keywords, interrogation questions, degree of urgency and/or flowcharts used for the algorithms to help operators gain better comprehensive understanding patient profiles, medical habits and history, level of support from informal caregivers, known comorbidities and frailty status. Furthermore, panelists also stressed the importance of considering feasibility in implementing protocols within the real-world setting and prioritizing the right type of training for operators which can facilitate the delivery of high-quality triage. Overall, consensus was found for nine of the top 10 most frequently used protocols for triaging older adults with no consensus found for the protocol on triaging patients unwell for no apparent reason.

CONCLUSION

Our findings show that overall, a combination of patient related factors must be addressed to provide high quality triage for adults seeking non-urgent unplanned care over the telephone (in addition to age). However, further elements such as appropriate operator training and feasibility of implementing more population-specific protocols must also be considered. This study presents a useful step towards identifying key items which must be targeted within the larger scope of providing non-urgent out-of-hours telephone triage services for older adults seeking non-urgent unplanned care.

Consistency of decision support software-integrated telephone triage and associated factors: a systematic review

Background

In the recent decades, the use of computerized decision support software (CDSS)-integrated telephone triage (TT) has become an important tool for managing rising healthcare demands and overcrowding in the emergency department. Though these services have generally been shown to be effective, large gaps in the literature exist with regards to the overall quality of these systems. In the current systematic review, we aim to document the consistency of decisions that are generated in CDSS-integrated TT. Furthermore, we also seek to map those factors in the literature that have been identified to have an impact on the consistency of generated triage decisions.

Methods

As part of the TRANS-SENIOR international training and research network, a systematic review of the literature was conducted in November 2019. PubMed, Web of Science, CENTRAL, and the CINAHL database were searched. Quantitative articles including a CDSS component and addressing consistency of triage decisions and/or factors associated with triage decisions were eligible for inclusion in the current review. Studies exploring the use of other types of digital support systems for triage (i.e. web chat, video conferencing) were excluded. Quality appraisal of included studies were performed independently by two authors using the Methodological Index for Non-Randomized Studies.

Results

From a total of 1551 records that were identified, 39 full-texts were assessed for eligibility and seven studies were included in the review. All of the studies (n = 7) identified as part of our search were observational and were based on nurse-led telephone triage. Scientific efforts investigating our first aim was very limited. In total, two articles were found to investigate the consistency of decisions that are generated in CDSS-integrated TT. Research efforts were targeted largely towards the second aim of our study—all of the included articles reported factors related to the operator- (n = 6), patient- (n = 1), and/or CDSS-integrated (n = 2) characteristics to have an influence on the consistency of CDSS-integrated TT decisions.

Conclusion

To date, some efforts have been made to better understand how the use of CDSS-integrated TT systems may vary across settings. In general, however, the evidence-base surrounding this field of literature is largely inconclusive. Further evaluations must be prompted to better understand this area of research.

Protocol registration

The protocol for this study is registered in the PROSPERO database (registration number: CRD42020146323).

Supplementary Information

The online version contains supplementary material available at 10.1186/s12911-021-01472-3.

Implementing remote triage in large health systems: A qualitative evidence synthesis

Remote triage (RT) allows interprofessional teams (e.g., nurses and physicians) to assess patients and make clinical decisions remotely. RT use has developed widespread interest due to the COVID-19 pandemic, and has future potential to address the needs of a rapidly aging population, improve access to care, facilitate interprofessional team care, and ensure appropriate use of resources. However, despite rapid and increasing interest in implementation of RT, there is little research concerning practices for successful implementation. We conducted a systematic review and qualitative evidence synthesis of practices that impact the implementation of RT for adults seeking clinical care advice. We searched MEDLINE®, EMBASE, and CINAHL from inception through July 2018. We included 32 studies in this review. Our review identified four themes impacting the implementation of RT: characteristics of staff who use RT, influence of RT on staff, considerations in selecting RT tools, and environmental and contextual factors impacting RT. The findings of our systemic review underscore the need for a careful consideration of (a) organizational and stakeholder buy-in before launch, (b) physical and psychological workplace environment, (c) staff training and ongoing support, and (d) optimal metrics to assess the effectiveness and efficiency of implementation. Our findings indicate that preimplementation planning, as well as evaluating RT by collecting data during and after implementation, is essential to ensuring successful implementation and continued adoption of RT in a health care system.

Implementation of a Standardized Initial Assessment for Demand Management in Outpatient Emergency Care in Germany: Early Qualitative Process Evaluation

BACKGROUND

Inadequate assessment of the severity and urgency of medical problems is one of the factors contributing to unnecessary emergency department (ED) visits. The implementation of a software-based instrument for standardized initial assessment-Standardisierte medizinische Ersteinschätzung in Deutschland (SmED) (Standardized medical Initial Assessment in Germany in English)-aims to support health care professionals and steer patients toward the right health care provider. This study aimed to explore the implementation process of SmED from a user perspective.

OBJECTIVE

This study aims to evaluate the overall perception of SmED by health care professionals using the software, to examine to what extent SmED influences the workload and work routines of health care professionals, and to determine which factors are associated with the use of SmED.

METHODS

An early qualitative process evaluation on the basis of interviews was carried out alongside the implementation of SmED in 26 outpatient emergency care services within 11 federal states in Germany. Participants were 30 health care professionals who work with SmED either at the joint central contact points of the outpatient emergency care service and the EDs of hospitals (ie, the Joint Counter; Gemeinsamer Tresen in German) or at the initial telephone contact points of the outpatient emergency care service (phone number 116117). Matrix-based framework analysis was applied to analyze the interview data.

RESULTS

Health care professionals perceived that workload increased initially, due to additional time needed per patient. When using SmED more frequently and over a longer time period, its use became more routine and the time needed per call, per patient, decreased. SmED was perceived to support decision making regarding urgency for medical treatment, but not all types of patients were eligible. Technical problems, lack of integration with other software, and lack of practicability during peak times affected the implementation of SmED.

CONCLUSIONS

Initial experiences with SmED were positive, in general, but also highlighted organizational issues that need to be addressed to enhance sustainability.

TRIAL REGISTRATION

German Clinical Trials Register DRKS00017014; https://www.drks.de/drks_web/navigate.do?navigationId=trial.HTML&TRIAL_ID=DRKS00017014.

Factors affecting emergency nurses' perceptions of the triage systems

Background: Emergency services use a triage system to prioritize patients according to their level of diagnosis. Triage is one of the mandated skills to be owned by an emergency unit nurse. This research aims to identify factors affecting emergency nurses’ perceptions of the triage systems.

Design and Methods: 90 nurses were chosen based on quota sampling. Data were analyzed using Chi Square test (α 0.05) and logistic regression analysis.

Results: The results show that nurses perceptions were influenced by knowledge (p = 0.017), working experience (p = 0.023), and training (p = 0.041). The factor that had the strongest influence in the formation of nurses’ perceptions was knowledge (p = 0.020 and OR = 3.19).

Conclusions: It can be concluded that knowledge, working experience and training influenced emergency nurses’ perceptions on triage systems.

Optimisation of telephone triage of callers with symptoms suggestive of acute cardiovascular disease in out-of-hours primary care: observational design of the Safety First study

INTRODUCTION

In the Netherlands, the 'Netherlands Triage Standard' (NTS) is frequently used as digital decision support system for telephone triage at out-of-hours services in primary care (OHS-PC). The aim of the NTS is to guarantee accessible, efficient and safe care. However, there are indications that current triage is inefficient, with overestimation of urgency, notably in suspected acute cardiovascular disease. In addition, in primary care settings the NTS has only been validated against surrogate markers, and diagnostic accuracy with clinical outcomes as the reference is unknown. In the Safety First study, we address this gap in knowledge by describing, understanding and improving the diagnostic process and urgency allocation in callers with symptoms suggestive of acute cardiovascular disease, in order to improve both efficiency and safety of telephone triage in this domain.

METHODS AND ANALYSIS

An observational study in which 3000 telephone triage recordings (period 2014-2016) will be analysed. Information is collected from the recordings including caller and symptom characteristics and urgency allocation. The callers' own general practitioners are contacted for the final diagnosis of each contact. We included recordings of callers with symptoms suggestive of acute coronary syndrome (ACS) or transient ischaemic attack (TIA)/stroke. With univariable and multivariable logistic regression analyses the diagnostic accuracy of caller and symptom characteristics will be analysed in terms of predictive values with urgency level, and ACS and TIA/stroke as outcomes, respectively. To further improve our understanding of the triage process at OHS-PC, we will carry out additional studies applying both quantitative and qualitative methods: (i) case-control study on serious adverse events (SAE), (ii) conversation analysis study and (iii) interview study with triage nurses.

ETHICS AND DISSEMINATION

The Medical Ethics Committee Utrecht, the Netherlands endorsed this study (National Trial Register identification: NTR7331). Results will be disseminated at scientific conferences, regional educational sessions and publication in peer-reviewed journals.

Beyond guidelines: discretionary practice in face-to-face triage nursing

This article draws on ethnographic data from a Norwegian emergency primary care clinic (EPCC) to explore nurses' discretionary application of guidelines. Specifically, it analyses nurses' discretionary use of the Manchester Triage System (MTS) when performing face-to-face triage, that is, assessing the urgency of patients' complaints. The analysis shows how nurses assessed patients at odds with MTS prescriptions by collecting supplementary data, engaging in differential diagnostic and holistic reasoning, relying on emotion and intuition, and allowing colleagues and patients to influence their reasoning. The findings also show how nurses' reasoning led them to override guidelines both overtly and covertly. Based on this evidence, it is argued that nurses' assessments relied more on internalised 'triage mindlines' than on codified triage guidelines, although the MTS did function as a support system, checklist and system for supervisory control. The study complements existing research on standardisation in nursing by providing an in-depth analysis of nurses' methods for navigating guidelines and by detailing how deviations from those guidelines spring from their clinical reasoning. The challenges of imposing a managerial logic on professional labour are also highlighted, which is of particular relevance in light of the drive towards standardisation in modern healthcare.

Advice given by NHS Direct in Wales: do deprived patients get more urgent decisions? Study of routine data

BACKGROUND

In the UK, National Health Service Direct Wales (NHSDW) uses computerised decision support software to advise patients on appropriate care. However, the effect of deprivation on the advice given is not known. We aimed to estimate the effect of deprivation on advice given by nurses in NHSDW adjusting for confounding variables.

METHODS

We included 400 000 calls to NHSDW between January 2002 and June 2004. We used logistic regression to model the effect of deprivation on advice given by nurses in response to calls seeking advice or information. We analysed two outcomes: receiving advice to phone 999 emergency care rather than to seek other care and receiving advice to seek care face to face rather than self-care.

RESULTS

After adjustment for covariates, an increase in deprivation from one-fifth of the distribution to the next fifth increased by 13% the probability that those calling for advice rather than information received advice to phone 999 (OR 1.127; 95% CI from 1.113 to 1.143). Deprivation increased the corresponding probability of being advised to seek care face to face rather than self-care by 5% (OR 1.049; 95% CI from 1.041 to 1.058) within advice calls and by 3% (OR 1.034; 95% CI from 1.022 to 1.047) within information calls.

CONCLUSIONS

Deprivation increased the chance of receiving more urgent advice, particularly advice to call 999. While our dataset may underestimate the 'need' of deprived patients, it yields no evidence of major inequity in advice given to these patients.

The inter-rater reliability of the Risk Instrument for Screening in the Community

Predicting risk of adverse healthcare outcomes is important to enable targeted delivery of interventions. The Risk Instrument for Screening in the Community (RISC), designed for use by public health nurses (PHNs), measures the 1-year risk of hospitalisation, institutionalisation and death in community-dwelling older adults according to a five-point global risk score: from low (score 1,2) to medium (3) to high (4,5). We examined the inter-rater reliability (IRR) of the RISC between student PHNs (n=32) and expert raters using six cases (two low, medium and high-risk), scored before and after RISC training. Correlations increased for each adverse outcome, statistically significantly for institutionalisation (r=0.72 to 0.80, p=0.04) and hospitalisation (r=0.51 to 0.71, p<0.01) but not death. Training improved accuracy for low-risk but not all high-risk cases. Overall, the RISC showed good IRR, which increased after RISC training. That reliability fell for some high-risk cases suggests that the training programme requires adjustment to improve IRR further.

Telephone triage by GPs in out-of-hours primary care in Denmark: a prospective observational study of efficiency and relevance

BACKGROUND

In the UK, telephone triage in out-of-hours primary care is mostly managed by nurses, whereas GPs perform triage in Denmark.

AIM

To describe telephone contacts triaged to face-to-face contacts, GP-assessed relevance, and factors associated with triage to face-to-face contact.

DESIGN AND SETTING

A prospective observational study in Danish out-of-hours primary care, conducted from June 2010 to May 2011.

METHOD

Information on patients was collected from the electronic patient administration system and GPs completed electronic questionnaires about the contacts. The GPs conducting the face-to-face contacts assessed relevance of the triage to face-to-face contacts. The authors performed binomial regression analyses, calculating relative risk (RR) and 95% confidence intervals.

RESULTS

In total, 59.2% of calls ended with a telephone consultation. Factors associated with triage to a face-to-face contact were: patient age >40 years (40-64: RR = 1.13; >64: RR = 1.34), persisting problem for 12-24 hours (RR = 1.15), severe problem (RR = 2.60), potentially severe problem (RR = 5.81), and non-severe problem (RR = 2.23). Face-to-face contacts were assessed as irrelevant for 12.7% of clinic consultations and 11.7% of home visits. A statistically significantly higher risk of irrelevant face-to-face contact was found for a persisting problem of >24 hours (RR = 1.25), contact on weekday nights (RR = 1.25), and contact <2 hours before the patient's own GP's opening time (RR = 1.80).

CONCLUSION

Around 12% of all face-to-face consultations in the study are assessed as irrelevant by GP colleagues, suggesting that GP triage is efficient. Knowledge of the factors influencing triage can provide better education for GPs, but future studies are needed to investigate other quality aspects of GP telephone triage.

The effect of nurses' preparedness and nurse practitioner status on triage call management in primary care: A secondary analysis of cross-sectional data from the ESTEEM trial

Background

Nurse-led telephone triage is increasingly used to manage demand for general practitioner consultations in UK general practice. Previous studies are equivocal about the relationship between clinical experience and the call outcomes of nurse triage. Most research is limited to investigating nurse telephone triage in out-of-hours settings.

Objective

To investigate whether the professional characteristics of primary care nurses undertaking computer decision supported software telephone triage are related to call disposition.

Design

Questionnaire survey of nurses delivering the nurse intervention arm of the ESTEEM trial, to capture role type (practice nurse or nurse practitioner), prescriber status, number of years’ nursing experience, graduate status, previous experience of triage, and perceived preparedness for triage.

Our main outcome was the proportion of triaged patients recommended for follow-up within the practice (call disposition), including all contact types (face-to-face, telephone or home visit), by a general practitioner or nurse.

Settings

15 general practices and 7012 patients receiving the nurse triage intervention in four regions of the UK.

Participants

45 nurse practitioners and practice nurse trained in the use of clinical decision support software.

Methods

We investigated the associations between nursing characteristics and triage call disposition for patient ‘same-day’ appointment requests in general practice using multivariable logistic regression modelling.

Results

Valid responses from 35 nurses (78%) from 14 practices: 31/35 (89%) had ≥10 years’ experience with 24/35 (69%) having ≥20 years. Most patient contacts (3842/4605; 86%) were recommended for follow-up within the practice. Nurse practitioners were less likely to recommend patients for follow-up odds ratio 0.19, 95% confidence interval 0.07; 0.49 than practice nurses. Nurses who reported that their previous experience had prepared them less well for triage were more likely to recommend patients for follow-up (OR 3.17, 95% CI 1.18–5.55).

Conclusion

Nurse characteristics were associated with disposition of triage calls to within practice follow-up. Nurse practitioners or those who reported feeling ‘more prepared’ for the role were more likely to manage the call definitively. Practices considering nurse triage should ensure that nurses transitioning into new roles feel adequately prepared. While standardised training is necessary, it may not be sufficient to ensure successful implementation.

Telephone triage in general practices: A written case scenario study in the Netherlands

OBJECTIVE

General practices increasingly use telephone triage to manage patient flows. During triage, the urgency of the call and required type of care are determined. This study examined the organization and adequacy of telephone triage in general practices in the Netherlands.

DESIGN

Cross-sectional observational study using a web-based survey among practice assistants including questions on background characteristics and triage organization. Furthermore, practice assistants were asked to assess the required type of care of written case scenarios with varying health problems and levels of urgency. To determine the adequacy of the assessments, a comparison with a reference standard was made. In addition, the association between background characteristics and triage organization and the adequacy of triage was examined.

SETTING

Daytime general practices.

SUBJECTS

Practice assistants.

MAIN OUTCOME MEASURES

Over- and under-estimation, sensitivity, specificity.

RESULTS

The response rate was 41.1% (n = 973). The required care was assessed adequately in 63.6% of cases, was over-estimated in 19.3%, and under-estimated in 17.1%. The sensitivity of identifying patients with a highly urgent problem was 76.7% and the specificity was 94.0%. The adequacy of the assessments of the required care was higher for more experienced assistants and assistants with fixed daily work meetings with the GP. Triage training, use of a triage tool, and authorization of advice were not associated with adequacy of triage.

CONCLUSION

Triage by practice assistants in general practices is efficient (high specificity), but potentially unsafe in highly urgent cases (suboptimal sensitivity). It is important to train practice assistants in identifying highly urgent cases.

KEY POINTS

General practices increasingly use telephone triage to manage patient flows, but little is known about the organization and adequacy of triage in daytime practices. Telephone triage by general practice assistants is efficient, but potentially unsafe in highly urgent cases. The adequacy of triage is higher for more experienced assistants and assistants with fixed daily work meetings with the general practitioner.

What evidence is there on the effectiveness of different models of delivering urgent care? A rapid review

Background

In 2013 NHS England set out its strategy for the development of an emergency and urgent care system that is more responsive to patients’ needs, improves outcomes and delivers clinically excellent and safe care. Knowledge about the current evidence base on models for provision of safe and effective urgent care, and the gaps in evidence that need to be addressed, can support this process.

Objective

The purpose of the evidence synthesis is to assess the nature and quality of the existing evidence base on delivery of emergency and urgent care services and identify gaps that require further primary research or evidence synthesis.

Data sources

MEDLINE, EMBASE, The Cochrane Library, the Cumulative Index to Nursing and Allied Health Literature (CINAHL) and the Web of Science.

Methods

We have conducted a rapid, framework-based, evidence synthesis approach. Five separate reviews linked to themes in the NHS England review were conducted. One general and five theme-specific database searches were conducted for the years 1995–2014. Relevant systematic reviews and additional primary research papers were included and narrative assessment of evidence quality was conducted for each review.

Results

The review was completed in 6 months. In total, 45 systematic reviews and 102 primary research studies have been included across all five reviews. The key findings for each review are as follows: (1) demand – there is little empirical evidence to explain increases in demand for urgent care; (2) telephone triage – overall, these services provide appropriate and safe decision-making with high patient satisfaction, but the required clinical skill mix and effectiveness in a system is unclear; (3) extended paramedic roles have been implemented in various health settings and appear to be successful at reducing the number of transports to hospital, making safe decisions about the need for transport and delivering acceptable, cost-effective care out of hospital; (4) emergency department (ED) – the evidence on co-location of general practitioner services with EDs indicates that there is potential to improve care. The attempt to summarise the evidence about wider ED operations proved to be too complex and further focused reviews are needed; and (5) there is no empirical evidence to support the design and development of urgent care networks.

Limitations

Although there is a large body of evidence on relevant interventions, much of it is weak, with only very small numbers of randomised controlled trials identified. Evidence is dominated by single-site studies, many of which were uncontrolled.

Conclusions

The evidence gaps of most relevance to the delivery of services are (1) a requirement for more detailed understanding and mapping of the characteristics of demand to inform service planning; (2) assessment of the current state of urgent care network development and evaluation of the effectiveness of different models; and (3) expanding the current evidence base on existing interventions that are viewed as central to delivery of the NHS England plan by assessing the implications of increasing interventions at scale and measuring costs and system impact. It would be prudent to develop a national picture of existing pilot projects or interventions in development to support decisions about research commissioning.

Funding

The National Institute for Health Research Health Services and Delivery Research Programme.

Nurse telephone triage: good quality associated with appropriate decisions

BACKGROUND

Triage at out-of-hours GP cooperatives (GPCs) is aimed at determining medical urgency and guiding decisions. Both medical knowledge and communication skills are required for this complex task.

OBJECTIVE

To explore the impact of quality of consultation and estimated urgency on the appropriateness of decisions.

METHODS

We performed a secondary analysis of telephone triage consultations by nurses at 29 Dutch GPCs. Consultations were taped and assessed by trained observers, using a validated instrument. Measures concerned quality of consultation, nurse-estimated urgency (four levels) and appropriateness of decisions (urgency, follow-up advice and timing). Bivariate analyses and logistic multilevel regression analyses were used to explore the impact of quality of consultation (controlling for urgency) on appropriateness of decisions.

RESULTS

The sample included 6739 telephone contacts, most of which (90%) were non-urgent. The majority of decisions were appropriate (91% for urgency, 96% for follow-up advice and 95% for timing). In bivariate analyses, appropriateness of decisions was positively related to higher quality of consultation. Estimated urgency was negatively associated with quality of consultation. Logistic multilevel analysis showed that higher quality of consultation was related to a more appropriate estimation of urgency [odds ratio (OR) = 1.82; 95% confidence interval (CI): 1.69-1.95], follow-up advice (OR = 2.69; 95% CI: 2.41-3.01) and timing of decisions (OR = 2.41; 95% CI: 2.20-2.63).

CONCLUSIONS

High quality of consultation has a positive, but small, impact on the appropriateness of decisions. Quality of consultation needs to be targeted in training and support of triage nurses, especially when it concerns highly urgent contacts.

Telephone triage by nurses in primary care out-of-hours services in Norway: an evaluation study based on written case scenarios

Background

The use of nurses for telephone-based triage in out-of-hours services is increasing in several countries. No investigations have been carried out in Norway into the quality of decisions made by nurses regarding our priority degree system. There are three levels: acute, urgent and non-urgent.

Methods

Nurses working in seven casualty clinics in out-of-hours districts in Norway (The Watchtowers) were all invited to participate in a study to assess priority grade on 20 written medical scenarios validated by an expert group. 83 nurses (response rate 76%) participated in the study. A one-out-of-five sample of the nurses assessed the same written cases after 3 months (n=18, response rate 90%) as a test–retest assessment.

Results

Among the acute, urgent and non-urgent scenarios, 82%, 74% and 81% were correctly classified according to national guidelines. There were significant differences in the proportion of correct classifications among the casualty clinics, but neither employment percentage nor profession or work experience affected the triage decision. The mean intraobserver variability measured by the Cohen kappa was 0.61 (CI 0.52 to 0.70), and there were significant differences in kappa with employment percentage. Casualty clinics and work experience did not affect intrarater agreement.

Conclusion

Correct classification of acute and non-urgent cases among nurses was quite high. Work experience and employment percentage did not affect triage decision. The intrarater agreement was good and about the same as in previous studies performed in other countries. Kappa increased significantly with increasing employment percentage.

An evaluation of the appropriateness of advice and healthcare contacts made following calls to NHS Direct Wales

Background

An evaluation of NHS Direct Wales (NHSDW), a national telephone-based healthcare advice and information service, was undertaken. A key objective was to describe the actions of callers and assess the appropriateness of advice and healthcare contacts made following calls, results of which are reported here.

Methods

Postal questionnaires were sent to consecutive callers to NHSDW in May 2002 and February 2004 to determine 1) callers' actions following calls and 2) their views about the appropriateness of: advice given; and when to seek further care. An independent clinical panel agreed and applied a set of rules about healthcare sites where examinations, investigations, treatments and referrals could be obtained. The rules were then applied to the subsequent contacts to healthcare services reported by respondents and actions were classified in terms of whether they had been necessary and sufficient for the care received.

Results

Response rates were similar in each survey: 1033/1897 (54.5%); 606/1204 (50.3%), with 75% reporting contacting NHSDW. In both surveys, nearly half of all callers reported making no further healthcare contact after their call to NHSDW. The most frequent subsequent contacts made were with GPs.

More than four fifths of callers rated the advice given - concerning any further care needed and when to seek it - as appropriate (further care needed: survey 1: 673/729, 82.3%; survey 2: 389/421, 92.4%; when to seek further care - survey 1: 462/555, 83.2%; survey 2: n = 295/346, 85.3%). A similar proportion of cases was also rated through the rule set and backed up by the clinical panel as having taken necessary and sufficient actions following their calls to NHSDW (survey 1: 624/729, 80.6%; survey 2: 362/421, 84.4%), with more unnecessary than insufficient actions identified at each survey (survey 1: unnecessary 132/729, 17.1% versus insufficient 11/729, 1.4%; survey 2: unnecessary 47/421, 11.0% versus insufficient 14/421, 3.3%).

Conclusion

Based on NHSDW caller surveys responses and applying a transparent rule set to caller actions a large majority of subsequent actions were assessed as appropriate, with insufficient contacts particularly infrequent. The challenge for NHSDW is to reduce the number of unnecessary contacts made following calls to the service, whilst maintaining safety.

Nurses' use of computerised clinical decision support systems: a case site analysis

AIMS AND OBJECTIVES

To explore how nurses use computerised clinical decision support systems in clinical practice and the factors that influence use.

BACKGROUND

There is limited evidence for the benefits of computerised clinical decision support systems in nursing, with the majority of existing research focusing on nurses' use of decision support for telephone triage. Research has suggested that several factors including nurses' experience, features of the technology system and organisational factors may influence how decision support is used in practice.

DESIGN

A multiple case site study.

METHODS

Four case sites were purposively selected to provide variation in staff experience, technology used and decisions supported by the technology. Data were collected in each case site using non-participant observation of nurse/patient consultations (n = 115) and interviews with nurses (n = 55). Data were analysed using thematic content analysis.

RESULTS

Computerised decision support systems were used in a variety of ways by nurses, including recording information, monitoring patients' progress and confirming decisions that had already been made. Nurses' experience with the decision and the technology affected how they used a decision support system and whether or not they over-rode recommendations made by the system. The ability of nurses to adapt the technology also affected its use.

CONCLUSIONS

How nurses use computerised decision support appears to be the result of an interaction between a nurses' experience and their ability to adapt the technology to 'fit' with local clinical practice.

RELEVANCE TO CLINICAL PRACTICE

One of the stated aims of introducing computerised decision support systems to assist nursing practice is to reduce variation and/or the number of errors associated with clinical practice. The study found unanticipated uses in such systems such as the routine over-riding of recommendations which could lead to an increase rather than a decrease in variation or errors.

Effects of algorithm for diagnosis of active labour: cluster randomised trial

OBJECTIVE

To compare the effectiveness of an algorithm for diagnosis of active labour in primiparous women with standard care in terms of maternal and neonatal outcomes.

DESIGN

Cluster randomised trial.

SETTING

Maternity units in Scotland with at least 800 annual births.

PARTICIPANTS

4503 women giving birth for the first time, in 14 maternity units. Seven experimental clusters collected data from a baseline sample of 1029 women and a post-implementation sample of 896 women. The seven control clusters had a baseline sample of 1291 women and a post-implementation sample of 1287 women.

INTERVENTION

Use of an algorithm by midwives to assist their diagnosis of active labour, compared with standard care. Main outcomes Primary outcome: use of oxytocin for augmentation of labour.

SECONDARY OUTCOMES

medical interventions in labour, admission management, and birth outcome.

RESULTS

No significant difference was found between groups in percentage use of oxytocin for augmentation of labour (experimental minus control, difference=0.3, 95% confidence interval -9.2 to 9.8; P=0.9) or in the use of medical interventions in labour. Women in the algorithm group were more likely to be discharged from the labour suite after their first labour assessment (difference=-19.2, -29.9 to -8.6; P=0.002) and to have more pre-labour admissions (0.29, 0.04 to 0.55; P=0.03).

CONCLUSIONS

Use of an algorithm to assist midwives with the diagnosis of active labour in primiparous women did not result in a reduction in oxytocin use or in medical intervention in spontaneous labour. Significantly more women in the experimental group were discharged home after their first labour ward assessment.

TRIAL REGISTRATION

Current Controlled Trials ISRCTN00522952.

Tracking the spatial diffusion of influenza and norovirus using telehealth data: a spatiotemporal analysis of syndromic data

BACKGROUND

Telehealth systems have a large potential for informing public health authorities in an early stage of outbreaks of communicable disease. Influenza and norovirus are common viruses that cause significant respiratory and gastrointestinal disease worldwide. Data about these viruses are not routinely mapped for surveillance purposes in the UK, so the spatial diffusion of national outbreaks and epidemics is not known as such incidents occur. We aim to describe the geographical origin and diffusion of rises in fever and vomiting calls to a national telehealth system, and consider the usefulness of these findings for influenza and norovirus surveillance.

METHODS

Data about fever calls (5- to 14-year-old age group) and vomiting calls (> or = 5-year-old age group) in school-age children, proxies for influenza and norovirus, respectively, were extracted from the NHS Direct national telehealth database for the period June 2005 to May 2006. The SaTScan space-time permutation model was used to retrospectively detect statistically significant clusters of calls on a week-by-week basis. These syndromic results were validated against existing laboratory and clinical surveillance data.

RESULTS

We identified two distinct periods of elevated fever calls. The first originated in the North-West of England during November 2005 and spread in a south-east direction, the second began in Central England during January 2006 and moved southwards. The timing, geographical location, and age structure of these rises in fever calls were similar to a national influenza B outbreak that occurred during winter 2005-2006. We also identified significantly elevated levels of vomiting calls in South-East England during winter 2005-2006.

CONCLUSION

Spatiotemporal analyses of telehealth data, specifically fever calls, provided a timely and unique description of the evolution of a national influenza outbreak. In a similar way the tool may be useful for tracking norovirus, although the lack of consistent comparison data makes this more difficult to assess. In interpreting these results, care must be taken to consider other infectious and non-infectious causes of fever and vomiting. The scan statistic should be considered for spatial analyses of telehealth data elsewhere and will be used to initiate prospective geographical surveillance of influenza in England.

Real nursing? The development of telenursing

AIM

This paper is a report of a study to understand the impact of telenursing from the perspective of nurses involved in its provision, and in more traditional roles.

BACKGROUND

Nurse-led telephone helplines have recently been introduced across the United Kingdom, a major step in the development of nursing practice.

METHOD

A structured questionnaire was sent to all nurses working in the NHS Direct (National Health Service Direct) Wales telephone service (n = 111). Ninety-two completed questionnaires were returned (response rate 83 per cent). Two focus groups were conducted: one with telephone service nurses (n = 8) and one with other nurses (n = 5). The data were collected in 2002.

FINDINGS

Respondents represented a highly educated workforce from a range of healthcare specialties. They reported that they joined the telephone service for improved salary and flexible working. Two-thirds reported improved job satisfaction. All focus group participants reported that the development of nursing skills was affected by the use of decision support software and the remote nature of the consultation. Participants reported opportunities for skill development, although the role could be stressful. All agreed that the service was popular with callers, but the nurses from outside raised concerns about whether telenursing was 'real' nursing and about the evidence base for the service and access by disadvantaged groups.

CONCLUSION

Differences between the groups reflect policy tensions between the need to develop new nursing skills, including the use of technology, to improve efficiency and recognition of the worth of hands-on nursing. These tensions must be addressed for the telephone service to function as part of an integrated healthcare system.

The effect of attitude to risk on decisions made by nurses using computerised decision support software in telephone clinical assessment: an observational study

Background

There is variation in the decisions made by telephone assessment nurses using computerised decision support software (CDSS). Variation in nurses' attitudes to risk has been identified as a possible explanatory factor. This study was undertaken to explore the effect of nurses' attitudes to risk on the decisions they make when using CDSS. The setting was NHS 24 which is a nationwide telephone assessment service in Scotland in which nurses assess health problems, mainly on behalf of out-of-hours general practice, and triage calls to self care, a service at a later date, or immediate contact with a service.

Methods

All NHS 24 nurses were asked to complete a questionnaire about their background and attitudes to risk. Routine data on the decisions made by these nurses was obtained for a six month period in 2005. Multilevel modelling was used to measure the effect of nurses' risk attitudes on the proportion of calls they sent to self care rather than to services.

Results

The response rate to the questionnaire was 57% (265/464). 231,112 calls were matched to 211 of these nurses. 16% (36,342/231,112) of calls were sent to self care, varying three fold between the top and bottom deciles of nurses. Fifteen risk attitude variables were tested, including items on attitudes to risk in clinical decision-making. Attitudes to risk varied greatly between nurses, for example 27% (71/262) of nurses strongly agreed that an NHS 24 nurse "must not take any risks with physical illness" while 17% (45/262) disagreed. After case-mix adjustment, there was some evidence that nurses' attitudes to risk affected decisions but this was inconsistent and unconvincing.

Conclusion

Much of the variation in decision-making by nurses using CDSS remained unexplained. There was no convincing evidence that nurses' attitudes to risk affected the decisions made. This may have been due to the limitations of the instrument used to measure risk attitude.

Computer-supported telephone nurse triage: an evaluation of medical quality and costs

AIM

To evaluate a telephone nurse triage model in terms of appropriateness of referrals to the appropriate level of care, patient's compliance with given advice and costs.

BACKGROUND

A key concern in each telephonic consultation is to evaluate if appropriate.

METHOD

An evaluative design in primary health care with consecutive patients (N = 362) calling telephone nurse triage between November 2002 and February 2003.

RESULTS

The advice was considered adequate in 325 (97.6%) cases. The patients' compliance with self-care was 81.3%, to primary health care 91.1% and to Accident and Emergency department 100%. The nurses referred self-care cases (64.7%) and Accident and Emergency cases (29.6%) from a less adequate to an appropriate level of care. The cost saving per call leading to a recommendation of self-care was euro 70.3, to primary health care euro 24.3 and to Accident and Emergency department euro 22.2.

CONCLUSIONS

The telephone nurse triage model showed adequate guidance for the patients concerning level of care and released resources for the benefit of both patients and the health care system.

Nurse telephone triage in out-of-hours GP practice: determinants of independent advice and return consultation

BACKGROUND

Nowadays, nurses play a central role in telephone triage in Dutch out-of-hours primary care. The percentage of calls that is handled through nurse telephone advice alone (NTAA) appears to vary substantially between GP cooperatives. This study aims to explore which determinants are associated with NTAA and with subsequent return consultations to the GP.

METHODS

For the ten most frequently presented problems, a two-week follow-up cohort study took place in one cooperative run by 25 GPs and 8 nurses, serving a population of 62,291 people. Random effects logistic regression analysis was used to study the determinants of NTAA and return consultation rates. The effect of NTAA on hospital referral rates was also studied as a proxy for severity of illness.

RESULTS

The mean NTAA rate was 27.5%--ranging from 15.5% to 39.4% for the eight nurses. It was higher during the night (RR 1.63, CI 1.48-1.76) and lower with increasing age (RR 0.96, CI 0.93-0.99, per ten years) or when the patient presented >2 problems (RR 0.65; CI 0.51-0.83). Using cough as reference category, NTAA was highest for earache (RR 1.49; CI 1.18-1.78) and lowest for chest pain (RR 0.18; CI 0.06-0.47). After correction for differences in case mix, significant variation in NTAA between nurses remained (p < 0.001). Return consultations after NTAA were higher after nightly calls (RR 1.23; CI 1.04-1.40). During first return consultations, the hospital referral rate after NTAA was 1.5% versus 3.8% for non-NTAA (difference -2.2%; CI -4.0 to -0.5).

CONCLUSION

Important inter-nurse variability may indicate differences in perception on tasks and/or differences in skill to handle telephone calls alone. Future research should focus more on modifiable determinants of NTAA rates.