Human factors in anaesthesia: a narrative review

Healthcare relies on high levels of human performance, as described by the 'human as the hero' concept. However, human performance varies and is recognised to fall in high-pressure situations, meaning that it is not a reliable method of ensuring safety. Other safety-critical industries embed human factors principles into all aspects of their organisations to improve safety and reduce reliance on exceptional human performance; there is potential to do the same in anaesthesia. Human factors is a broad-based scientific discipline which aims to make it as easy as possible for workers to do things correctly. The human factors strategies most likely to be effective are those which 'design out' the chance of an error or adverse event occurring. When errors or adverse events do happen, barriers are in place to trap them and reduce the risk of progression to patient and/or worker harm. If errors or adverse events are not trapped by these barriers, mitigations are in place to minimise the consequences. Non-technical skills form an important part of human factors barriers and mitigation strategies and include: situation awareness; decision-making; task management; and team working. Human factors principles are not a substitute for proper investment and appropriate staffing levels. Although applying human factors science has the potential to save money in the long term, its proper implementation may require investment before reward can be reaped. This narrative review describes what is known about human factors in anaesthesia to date.

Implementing human factors in anaesthesia: guidance for clinicians, departments and hospitals: Guidelines from the Difficult Airway Society and the Association of Anaesthetists: Guidelines from the Difficult Airway Society and the Association of Anaesthetists

Human factors is an evidence-based scientific discipline used in safety critical industries to improve safety and worker well-being. The implementation of human factors strategies in anaesthesia has the potential to reduce the reliance on exceptional personal and team performance to provide safe and high-quality patient care. To encourage the adoption of human factors science in anaesthesia, the Difficult Airway Society and the Association of Anaesthetists established a Working Party, including anaesthetists and operating theatre team members with human factors expertise and/or interest, plus a human factors scientist, an industrial psychologist and an experimental psychologist/implementation scientist. A three-stage Delphi process was used to formulate a set of 12 recommendations: these are described using a 'hierarchy of controls' model and classified into design, barriers, mitigations and education and training strategies. Although most anaesthetic knowledge of human factors concerns non-technical skills, such as teamwork and communication, human factors is a broad-based scientific discipline with many other additional aspects that are just as important. Indeed, the human factors strategies most likely to have the greatest impact are those related to the design of safe working environments, equipment and systems. While our recommendations are primarily provided for anaesthetists and the teams they work with, there are likely to be lessons for others working in healthcare beyond the speciality of anaesthesia.

Characterising the nature of the beast: Challenges associated with understanding patient safety within community-based mental health services

Introduction

Patient safety problems stemming from healthcare represent a significant cause of morbidity and mortality globally. The evidence base on safety in mental healthcare, particularly regarding community-based mental health services, has long fallen behind that of physical healthcare, with fewer research publications, developed primarily in isolation from the wider improvement science discipline. This disconnect both yields, and stems from, conceptual and practical challenges which must be surmounted in order to advance the science and improvement of safety in mental healthcare.

Objectives

The objectives of this research were to conduct a narrative review to provide an overview of conceptual issues in this area, their origins, and implications for patient safety science and clinical care. We also sought to identify approaches to overcoming these issues.

Methods

We examined theoretical and empirical evidence from the fields of patient safety, mental health, and improvement science to address this knowledge gap.

Results

We identified challenges with defining safety in the context of community mental healthcare, ascertaining what constitutes a ‘preventable’ safety problem requiring intervention, and in finding relevant research evidence. The research indicated that risk management has taken precedence over proactive safety promotion in mental healthcare. This positions service users as the origin of safety risks, with iatrogenic harm and latent system hazards associated with mental healthcare widely overlooked.

Conclusions

We propose a broader conceptualisation of safety to advance the field and outline potential next steps for the integration and uptake of different sources of ‘safety intelligence’ within community mental health services.

Disclosure

NS is the director of London Safety and Training Solutions Ltd, which offers training in patient safety, implementation solutions and human factors to healthcare organisations and the pharmaceutical industry. The other authors have no competing interests.

Patient safety problems in community-based mental health services: A qualitative exploration

Introduction

Existing research has seldom examined patient safety problems experienced by service users accessing community mental healthcare, with the growing evidence base focusing largely on safety in psychiatric inpatient settings. Accordingly, there is poor understanding of safety issues in community-based mental health services as perceived by service users, carers, and healthcare professionals.

Objectives

This study aims to explore safety problems in adult community-based mental health services, their causation, and priority areas for improving the safety of care provided in these services.

Methods

In-depth, semi-structured interviews and focus groups were conducted with users of community-based mental health services, carers, and healthcare professionals employed within these settings. Interview topic guides were designed jointly with stakeholders from these groups (N=7) and piloted (N=3). Interviews and focus groups will be transcribed, coded, and analysed using an inductive thematic analysis approach. Illustrative quotes will be extracted and used to describe the key themes that emerge from the analysis and their inter-relationships.

Results

This presentation will provide an outline of patient safety as understood and experienced by key stakeholder groups. Study findings will explicate safety issues, healthcare system factors underpinning their causation, as well as practices which could improve safety in this context.

Conclusions

This research will help to advance understanding of the nature of patient safety problems in community-based mental healthcare services for adults, based on the experiences of service users, carers, and healthcare professionals within these services. The research will address key evidence gaps and represents an important step towards identifying areas which warrant intervention to improve patient safety.

Disclosure

NS is the director of London Safety and Training Solutions Ltd, which offers training in patient safety, implementation solutions and human factors to healthcare organisations and the pharmaceutical industry. The other authors have no competing interests.

Patient safety in community-based mental healthcare: A systematic scoping review

Introduction

There is limited existing research about patient safety issues in mental healthcare. A lack of evidence is particularly pronounced in relation to safety in community-based mental health services, where the majority of care is provided. To date, reviews of mental health patient safety literature have focused primarily on inpatient care settings.

Objectives

This systematic scoping review will aim to identify and synthesise literature about the types of patient safety problems in adult community-based mental health settings, the causes of these problems, and evaluated safety interventions in this care context.

Methods

A systematic search was conducted on 19^th June 2020 and refreshed on 23^rd October 2021, across five databases: Medline, Embase, PsycINFO, Health Management Information Consortium, and Cumulative Index to Nursing and Allied Health Literature. The search strategy focused on three key elements: ‘mental health’, ‘patient safety’ and ‘community-based mental health services’. Retrieved articles were screened at title, abstract and subject heading level, followed by full-text screen of longlisted articles.

Results

In this presentation, the findings of this systematic scoping review will be described, based on synthesised literature about safety incidents, broader care delivery problems, their causes, and evaluated patient safety interventions to address these issues.

Conclusions

This study will offer learning opportunities about the safety problems, contributory factors, and safety interventions in adult community-based mental health services, as described in the evidence base. Review findings will also help to ascertain gaps in existing research, which should be addressed in future studies.

Disclosure

NS is the director of London Safety and Training Solutions Ltd, which offers training in patient safety, implementation solutions and human factors to healthcare organisations and the pharmaceutical industry. The other authors have no competing interests.

COVID-19 vaccination acceptability in the UK at the start of the vaccination programme: a nationally representative cross-sectional survey (CoVAccS - wave 2)

Objectives

Investigate factors associated with the intention to have the COVID-19 vaccination following initiation of the UK national vaccination programme.

Study design

An online cross-sectional survey completed by 1500 adults (13th–15th January 2021).

Methods

Linear regression analyses were used to investigate associations between intention to be vaccinated for COVID-19 and sociodemographic factors, previous influenza vaccination, attitudes and beliefs about COVID-19 and COVID-19 vaccination and vaccination in general. Participants’ main reasons for likely vaccination (non-)uptake were also solicited.

Results

73.5% of participants (95% CI 71.2%, 75.7%) reported being likely to be vaccinated against COVID-19, 17.3% (95% CI 15.4%, 19.3%) were unsure, and 9.3% (95% CI 7.9%, 10.8%) reported being unlikely to be vaccinated. The full regression model explained 69.8% of the variance in intention. Intention was associated with: having been/intending to be vaccinated for influenza last winter/this winter; stronger beliefs about social acceptability of a COVID-19 vaccine; the perceived need for vaccination; adequacy of information about the vaccine; and weaker beliefs that the vaccine is unsafe. Beliefs that only those at serious risk of illness should be vaccinated and that the vaccines are just a means for manufacturers to make money were negatively associated with vaccination intention.

Conclusions

Most participants reported being likely to get the COVID-19 vaccination. COVID-19 vaccination attitudes and beliefs are a crucial factor underpinning vaccine intention. Continued engagement with the public with a focus on the importance and safety of vaccination is recommended.

123 Supporting A Learning System in Paediatric Emergency Pathways; Using Organisational Comparisons, Serious Incidents and Near Miss Events To Improve The Diagnosis And Treatment Of Testicular Torsion

Introduction

Scrotal pain is a common presentation to the emergency department requiring prompt investigation and management to identify testicular torsion. Using national data we aim to identify key suboptimal areas in the acute diagnosis and management of testicular torsion with a view to improving outcomes.

Method

A freedom of information request was made to all Trusts in England that manage testicular torsion. Serious Incidents (SI's) were analysed to see if those with Paediatric Emergency Departments fared better than those without. In addition, a qualitative thematic analysis of the NHS England Strategic Executive Information System database from 2007-2019 was undertaken, identifying common themes associated with orchidectomies and ‘near miss’ events in children.

Results

304 serious incidents were returned with 62 Orchidectomies and 242 Near Miss Events. Misdiagnosis of symptomatic testicle was not significant when comparing ED to specialists (OR = 1.46, p = 0.3842). Atypical presentation resulting in orchidectomy was significant when comparing ED to specialists (OR = 6, p = 0.0355). Near miss events are due to a variety of factors. There was no statistical significance in incidents when comparing ED's caring for all ages with Paediatric EDs U = 807.5, z = -1.124, p = 0.261.

Conclusions

There's a need for education in ED about atypical presentation of testicular torsion and examination of scrotum in cases of lower abdominal pain. It's also vital that specialist teams are cognisant of the standard operating procedures relevant to scrotal pain. Finally, there should be a drive for annual audit in Urology and ED units with regards to testicular torsion as SI's may be under-reported.

A user-centered approach to developing a new tool measuring the behavioural and social drivers of vaccination

BACKGROUND

Children around the world remain under-vaccinated for many reasons. To develop effective vaccine delivery programmes and monitor intervention impact, vaccine programme implementers need to understand reasons for under-vaccination within their local context. The World Health Organization (WHO) Working Group on the Behavioural and Social Drivers of Vaccination (BeSD) is developing standardised tools for assessing childhood vaccine acceptance and uptake that can be used across regions and countries. The tools will include: (1) a validated survey; (2) qualitative interview guides; and (3) corresponding user guidance. We report a user-centred needs assessment of key end-users of the BeSD tools.

METHODS

Twenty qualitative interviews (Apr-Aug 2019) with purposively sampled vaccine programme managers, partners and stakeholders from UNICEF and WHO country and regional offices. The interviews assessed current systems, practices and challenges in data utilisation and reflections on how the BeSD tools might be optimised. Framework analysis was used to code the interviews.

RESULTS

Regarding current practices, participants described a variety of settings, data systems, and frequencies of vaccination attitude measurement. They reported that the majority of data used is quantitative, and there is appetite for increased use of qualitative data. Capacity for conducting studies on social/behavioural drivers of vaccination was high in some jurisdictions and needed in others. Issues include barriers to collecting such data and variability in sources. Reflecting on the tools, participants described the need to explore the attitudes and practices of healthcare workers in addition to parents and caregivers. Participants were supportive of the proposed mixed-methods structure of the tools and training in their usage, and highlighted the need for balance between tool standardisation and flexibility to adapt locally.

CONCLUSIONS

A user-centred approach in developing the BeSD tools has given valuable direction to their design, bringing the use of behavioural and social data to the heart of programme planning.

Development and Validation of a Short Version of the Metric for the Observation of Decision-Making in Multidisciplinary Tumor Boards: MODe-Lite

Background

Evidence-based tools are necessary for scientifically improving the way MTBs work. Such tools are available but can be difficult to use. This study aimed to develop a robust observational assessment tool for use on cancer multidisciplinary tumor boards (MTBs) by health care professionals in everyday practice.

Methods

A retrospective cross-sectional observational study was conducted in the United Kingdom from September 2015 to July 2016. Three tumor boards from three teaching hospitals were recruited, with 44 members overall. Six weekly meetings involving 146 consecutive cases were video-recorded and scored using the validated MODe tool. Data were subjected to reliability and validity analysis in the current study to develop a shorter version of the MODe.

Results

Phase 1, a reduction of the original items in the MODe, was achieved through two focus group meetings with expert assessors based on previous research. The 12 original items were reduced to 6 domains, receiving full agreement by the assessors. In phase 2, the six domains were subjected to item reliability, convergent validation, and internal consistency testing against the MODe-Lite global score, the MODe global score, and the items of the MODe. Significant positive correlations were evident across all domains (p < 0.01), indicating good reliability and validity. In phase 3, feasibility and high inter-assessor reliability were achieved by two clinical assessors. Six domains measuring clinical input, holistic input, clinical collaboration, pathology, radiology, and management plan were integrated into MODe-Lite.

Conclusions

As an evidence-based tool for health care professionals in everyday practice, MODe-Lite gives cancer MTBs insight into the way they work and facilitates improvements in practice.

Supplementary Information

The online version contains supplementary material available at 10.1245/s10434-021-09989-7.

Systematic literature review of learning curves for colorectal polyp resection techniques in lower gastrointestinal endoscopy

AIM

The performance of therapeutic procedures in lower gastrointestinal endoscopy (LGI) can be challenging and carries an increased risk of adverse events. There is increasing demand for the training of endoscopists in these procedures, but limited guidelines exist concerning procedural competency. The aim of this study was to assess the learning curves for LGI polypectomy, colorectal endoscopic mucosal resection (EMR) and colorectal endoscopic submucosal dissection (ESD).

METHOD

A systematic review of electronic databases between 1946 and September 2019 was performed. Citations were included if they reported learning curve data. Outcome measures that defined the success of procedural competency were also recorded.

RESULTS

A total of 34 out of 598 studies met the inclusion criteria of which 28 were related to ESD, three to polypectomy and three to EMR. Outcome measures for polypectomy competency (en bloc resection, delayed bleeding and independent polypectomy rate) were achieved after completion of between 250 and 400 polypectomies and after 300 colonoscopies. EMR outcome measures, including complete resection and recurrence, were achieved variably between 50 and 300 procedures. Outcome measures for ESD included efficiency (resection rates and procedural speed) and safety (adverse events). En bloc resection rates of over 80% and R0 resection rates of over 70% were achieved at 20-40 cases and procedural speed increased after 30 ESD cases. Competency in safety metrics was variably achieved at 20-200 cases.

CONCLUSION

There is a paucity of data on learning curves in LGI polypectomy, EMR and ESD. Despite limited evidence, we have identified relevant outcome measures and threshold numbers for the most common LGI polyp resection techniques for potential inclusion in training programmes/credentialing guidelines.

Building resilient and responsive research collaborations to tackle antimicrobial resistance-Lessons learnt from India, South Africa, and UK

Research, collaboration, and knowledge exchange are critical to global efforts to tackle antimicrobial resistance (AMR). Different healthcare economies are faced with different challenges in implementing effective strategies to address AMR. Building effective capacity for research to inform AMR-related strategies and policies is recognised as an important contributor to success. Interdisciplinary, intersector, as well as international collaborations are needed to span global to local efforts to tackle AMR. The development of reciprocal, long-term partnerships between collaborators in high-income and in low- and middle-income countries (LMICs) needs to be built on principles of capacity building. Using case studies spanning local and international research collaborations to codesign, implement, and evaluate strategies to tackle AMR, we have evaluated and build upon the ESSENCE criteria for capacity building in LMICs. The first case study describes the local codesign and implementation of antimicrobial stewardship (AMS) in the state of Kerala in India. The second case study describes an international research collaboration investigating AMR surgical patient pathways in India, the UK, and South Africa. We describe the steps undertaken to develop robust, agile, and flexible AMS research and implementation teams. Notably, investing in capacity building ensured that the programmes described in these case studies were sustained through the current severe acute respiratory syndrome coronavirus pandemic. Describing the strategies adopted by a local and an international collaboration to tackle AMR, we provide a model for capacity building in LMICs that can support sustainable and agile AMS programmes.

Impact of a quality improvement project to reduce the rate of obstetric anal sphincter injury: a multicentre study with a stepped-wedge design

Objective

To evaluate the impact of a care bundle (antenatal information to women, manual perineal protection and mediolateral episiotomy when indicated) on obstetric anal sphincter injury (OASI) rates.

Design

Multicentre stepped‐wedge cluster design.

Setting

Sixteen maternity units located in four regions across England, Scotland and Wales.

Population

Women with singleton live births between October 2016 and March 2018.

Methods

Stepwise region by region roll‐out every 3 months starting January 2017. The four maternity units in a region started at the same time. Multi‐level logistic regression was used to estimate the impact of the care bundle, adjusting for time trend and case‐mix factors (age, ethnicity, body mass index, parity, birthweight and mode of birth).

Main outcome measures

Obstetric anal sphincter injury in singleton live vaginal births.

Results

A total of 55 060 singleton live vaginal births were included (79% spontaneous and 21% operative). Median maternal age was 30 years (interquartile range 26–34 years) and 46% of women were primiparous. The OASI rate decreased from 3.3% before to 3.0% after care bundle implementation (adjusted odds ratio 0.80, 95% CI 0.65–0.98, P = 0.03). There was no evidence that the effect of the care bundle differed according to parity (P = 0.77) or mode of birth (P = 0.31). There were no significant changes in caesarean section (P = 0.19) or episiotomy rates (P = 0.16) during the study period.

Conclusions

The implementation of this care bundle reduced OASI rates without affecting caesarean section rates or episiotomy use. These findings demonstrate its potential for reducing perineal trauma during childbirth.

Tweetable abstract

OASI Care Bundle reduced severe perineal tear rates without affecting caesarean section rates or episiotomy use.

OASI Care Bundle reduced severe perineal tear rates without affecting caesarean section rates or episiotomy use.

Implementation and evaluation of nationwide scale-up of the Surgical Safety Checklist

Background

The WHO Surgical Safety Checklist improves surgical outcomes, but evidence and theoretical frameworks for successful implementation in low‐income countries remain lacking. Based on previous research in Madagascar, a nationwide checklist implementation in Benin was designed and evaluated longitudinally.

Methods

This study had a longitudinal embedded mixed‐methods design. The well validated Consolidated Framework for Implementation Research (CFIR) was used to structure the approach and evaluate the implementation. Thirty‐six hospitals received 3‐day multidisciplinary training and 4‐month follow‐up. Seventeen hospitals were sampled purposively for evaluation at 12–18 months. The primary outcome was sustainability of checklist use at 12–18 months measured by questionnaire. Secondary outcomes were CFIR‐derived implementation outcomes, measured using the WHO Behaviourally Anchored Rating Scale (WHOBARS), safety questionnaires and focus groups.

Results

At 12–18 months, 86·0 per cent of participants (86 of 100) reported checklist use compared with 31·1 per cent (169 of 543) before training and 88·8 per cent (158 of 178) at 4 months. There was high‐fidelity use (median WHOBARS score 5·0 of 7; use of basic safety processes ranged from 85·0 to 99·0 per cent), and high penetration shown by a significant improvement in hospital safety culture (adapted Human Factors Attitude Questionnaire scores of 76·7, 81·1 and 82·2 per cent before, and at 4 and 12–18 months after training respectively; P < 0·001). Acceptability, adoption, appropriateness and feasibility scored 9·6–9·8 of 10. This approach incorporated 31 of 36 CFIR implementation constructs successfully.

Conclusion

This study shows successfully sustained nationwide checklist implementation using a validated implementation framework.

Implementation works

Accuracy of surgical complication rate estimation using ICD-10 codes

Background

The ICD‐10 codes are used globally for comparison of diagnoses and complications, and are an important tool for the development of patient safety, healthcare policies and the health economy. The aim of this study was to investigate the accuracy of verified complication rates in surgical admissions identified by ICD‐10 codes and to validate these estimates against complications identified using the established Global Trigger Tool (GTT) methodology.

Methods

This was a prospective observational study of a sample of surgical admissions in two Norwegian hospitals. Complications were identified and classified by two expert GTT teams who reviewed patients' medical records. Three trained reviewers verified ICD‐10 codes indicating a complication present on admission or emerging in hospital.

Results

A total of 700 admissions were drawn randomly from 12 966 procedures. Some 519 possible complications were identified in 332 of 700 admissions (47·4 per cent) from ICD‐10 codes. Verification of the ICD‐10 codes against information from patients' medical records confirmed 298 as in‐hospital complications in 141 of 700 admissions (20·1 per cent). Using GTT methodology, 331 complications were found in 212 of 700 admissions (30·3 per cent). Agreement between the two methods reached 83·3 per cent after verification of ICD‐10 codes. The odds ratio for identifying complications using the GTT increased from 5·85 (95 per cent c.i. 4·06 to 8·44) to 25·38 (15·41 to 41·79) when ICD‐10 complication codes were verified against patients' medical records.

Conclusion

Verified ICD‐10 codes strengthen the accuracy of complication rates. Use of non‐verified complication codes from administrative systems significantly overestimates in‐hospital surgical complication rates.

Code correctly

Opportunities for system level improvement in antibiotic use across the surgical pathway

Optimizing antibiotic prescribing across the surgical pathway (before, during, and after surgery) is a key aspect of tackling important drivers of antimicrobial resistance and simultaneously decreasing the burden of infection at the global level. In the UK alone, 10 million patients undergo surgery every year, which is equivalent to 60% of the annual hospital admissions having a surgical intervention. The overwhelming majority of surgical procedures require effectively limited delivery of antibiotic prophylaxis to prevent infections. Evidence from around the world indicates that antibiotics for surgical prophylaxis are administered ineffectively, or are extended for an inappropriate duration of time postoperatively. Ineffective antibiotic prophylaxis can contribute to the development of surgical site infections (SSIs), which represent a significant global burden of disease. The World Health Organization estimates SSI rates of up to 50% in postoperative surgical patients (depending on the type of surgery), with a particular problem in low- and middle-income countries, where SSIs are the most frequently reported healthcare-associated infections. Across European hospitals, SSIs alone comprise 19.6% of all healthcare-acquired infections. Much of the scientific research in infection management in surgery is related to infection prevention and control in the operating room, surgical prophylaxis, and the management of SSIs, with many studies focusing on infection within the 30-day postoperative period. However it is important to note that SSIs represent only one of the many types of infection that can occur postoperatively. This article provides an overview of the surgical pathway and considers infection management and antibiotic prescribing at each step of the pathway. The aim was to identify the implications for research and opportunities for system improvement.

Realistic evaluation of Situation Awareness for Everyone (SAFE) on paediatric wards: study protocol

INTRODUCTION

Evidence suggests that health outcomes for hospitalised children in the UK are worse than other countries in Europe, with an estimated 1500 preventable deaths in hospital each year. It is presumed that some of these deaths are due to unanticipated deterioration, which could have been prevented by earlier intervention, for example, sepsis. The Situation Awareness For Everyone (SAFE) intervention aims to redirect the 'clinical gaze' to encompass a range of prospective indicators of risk or deterioration, including clinical indicators and staff concerns, so that professionals can review relevant information for any given situation. Implementing the routine use of huddles is central to increasing situation awareness in SAFE.

METHODS AND ANALYSIS

In this article, we describe the realistic evaluation framework within which we are evaluating the SAFE programme. Multiple methods and data sources are used to help provide a comprehensive understanding of what mechanisms for change are triggered by an intervention and how they have an impact on the existing social processes sustaining the behaviour or circumstances that are being targeted for change.

ETHICS AND DISSEMINATION

Ethics approval was obtained from London-Dulwich Research Ethics Committee (14/LO/0875). It is anticipated that the findings will enable us to understand what the important elements of SAFE and the huddle are, the processes by which they might be effective and-given the short timeframes of the project-initial effects of the intervention on outcomes. The present research will add to the extant literature by providing the first evidence of implementation of SAFE and huddles in paediatric wards in the UK.

Innovative tools for quality assessment: integrated quality criteria for review of multiple study designs (ICROMS)

OBJECTIVES

With the aim to facilitate a more comprehensive review process in public health including patient safety, we established a tool that we have termed ICROMS (Integrated quality Criteria for the Review Of Multiple Study designs), which unifies, integrates and refines current quality criteria for a large range of study designs including qualitative research.

STUDY DESIGN

Review, pilot testing and expert consensus.

METHODS

The tool is the result of an iterative four phase process over two years: 1) gathering of established criteria for assessing controlled, non-controlled and qualitative study designs; 2) pilot testing of a first version in two systematic reviews on behavioural change in infection prevention and control and in antibiotic prescribing; 3) further refinement and adding of additional study designs in the context of the European Centre for Disease Prevention and Control funded project 'Systematic review and evidence-based guidance on organisation of hospital infection control programmes' (SIGHT); 4) scrutiny by the pan-European expert panel of the SIGHT project, which had the objective of ensuring robustness of the systematic review.

RESULTS

ICROMS includes established quality criteria for randomised studies, controlled before-and-after studies and interrupted time series, and incorporates criteria for non-controlled before-and-after studies, cohort studies and qualitative studies. The tool consists of two parts: 1) a list of quality criteria specific for each study design, as well as criteria applicable across all study designs by using a scoring system; 2) a 'decision matrix', which specifies the robustness of the study by identifying minimum requirements according to the study type and the relevance of the study to the review question. The decision matrix directly determines inclusion or exclusion of a study in the review. ICROMS was applied to a series of systematic reviews to test its feasibility and usefulness in the appraisal of multiple study designs. The tool was applicable across a wide range of study designs and outcome measures.

CONCLUSION

ICROMS is a comprehensive yet feasible appraisal of a large range of study designs to be included in systematic reviews addressing behaviour change studies in patient safety and public health. The tool is sufficiently flexible to be applied to a variety of other domains in health-related research. Beyond its application to systematic reviews, we envisage that ICROMS can have a positive effect on researchers to be more rigorous in their study design and more diligent in their reporting.

A systematic review of patient preference elicitation methods in the treatment of colorectal cancer

AIM

This systematic review aimed to assess the use of patient preference in colorectal cancer treatment. Eliciting patient preference is important for shared decision-making in colorectal cancer treatment. The introduction of newer treatments, which balance quality of life and overall survival, makes this an important future focus.

METHOD

A systematic search strategy of MEDLINE, Embase, PsycINFO, CINAHL and the Cochrane Database for Systematic Reviews was undertaken to obtain relevant articles. Information regarding the type of patients included, preference instruments, study settings, outcomes and limitations was extracted.

RESULTS

The eight articles comprising this review each described an empirical study using a validated instrument to define patient preference for an aspect of colorectal cancer treatment. The evidence suggests that patients are prepared to trade significant reductions in life expectancy to avoid certain complications of colorectal surgery, particularly stoma formation. In the adjuvant setting, patients are prepared to risk significant treatment side effects to gain small potential increases in life expectancy and chance of survival. Where neoadjuvant or adjuvant treatment risks worsening function, however, patients generally forgo any potential increase in survival to improve bowel function and therefore quality of life. The only predictors of preference were tertiary education and previous cancer treatment.

CONCLUSION

Most patients judge a moderate survival benefit to be sufficient to make adjuvant therapy for colorectal cancer worthwhile, but they are willing to trade a potential reduction in life expectancy and survival to avoid certain unwanted surgical sequelae.

Implementation of an endoscopy safety checklist

Patient safety and quality improvement are increasingly prioritised across all areas of healthcare. Errors in endoscopy are common but often inconsequential and therefore go uncorrected. A series of minor errors, however, may culminate in a significant adverse event. This is unsurprising given the rising volume and complexity of cases coupled with shift working patterns. There is a growing body of evidence to suggest that surgical safety checklists can prevent errors and thus positively impact on patient morbidity and mortality. Consequently, surgical checklists are mandatory for all procedures. Many UK hospitals are mandating the use of similar checklists for endoscopy. There is no guidance on how best to implement endoscopy checklists nor any measure of their usefulness in endoscopy. This article outlines lessons learnt from innovating service delivery in our unit.

Team training in ruptured EVAR

Ruptured abdominal aortic aneurysms are almost always a fatal condition. The incidence of ruptured aortic aneurysms (rAAA) is declining, the number of teams is increasing and there is an increased focus on patient safety resulting in limited real life training opportunities to maintain or improve the technical and human factor skills required to manage this acute aortic pathology. The availability and experience of the multidisciplinary team together with accessibility of appropriate resuscitation and efficient logistics all influence the modality of rAAA repair. A standardised patient's pathway for rAAA management and reliable multidisciplinary team are the keys to improve patient outcomes. Whole rEVAR team training using high fidelity simulation may be the one answer to allow clinicians to learn, practice, rehearse, improve and maintain team-based knowledge, technical and human factor skills and team attitudes to manage this challenging pathology.

Understanding the determinants of antimicrobial prescribing within hospitals: the role of "prescribing etiquette"

Prescribing etiquette is an important determinant of antimicrobial prescribing behaviors. Prescribing etiquette recognizes clinical decision-making autonomy and the role of hierarchy in influencing practice. Existing clinical groups and clinical leadership should be utilized to influence antimicrobial prescribing behaviors.

Background. There is limited knowledge of the key determinants of antimicrobial prescribing behavior (APB) in hospitals. An understanding of these determinants is required for the successful design, adoption, and implementation of quality improvement interventions in antimicrobial stewardship programs.

Methods. Qualitative semistructured interviews were conducted with doctors (n = 10), pharmacists (n = 10), and nurses and midwives (n = 19) in 4 hospitals in London. Interviews were conducted until thematic saturation was reached. Thematic analysis was applied to the data to identify the key determinants of antimicrobial prescribing behaviors.

Results. The APB of healthcare professionals is governed by a set of cultural rules. Antimicrobial prescribing is performed in an environment where the behavior of clinical leaders or seniors influences practice of junior doctors. Senior doctors consider themselves exempt from following policy and practice within a culture of perceived autonomous decision making that relies more on personal knowledge and experience than formal policy. Prescribers identify with the clinical groups in which they work and adjust their APB according to the prevailing practice within these groups. A culture of “noninterference” in the antimicrobial prescribing practice of peers prevents intervention into prescribing of colleagues. These sets of cultural rules demonstrate the existence of a “prescribing etiquette,” which dominates the APB of healthcare professionals. Prescribing etiquette creates an environment in which professional hierarchy and clinical groups act as key determinants of APB.

Conclusions. To influence the antimicrobial prescribing of individual healthcare professionals, interventions need to address prescribing etiquette and use clinical leadership within existing clinical groups to influence practice.

Impact of the World Health Organization's Surgical Safety Checklist on safety culture in the operating theatre: a controlled intervention study

Background

Positive changes in safety culture have been hypothesized to be one of the mechanisms behind the reduction in mortality and morbidity after the introduction of the World Health Organization's Surgical Safety Checklist (SSC). We aimed to study the checklist effects on safety culture perceptions in operating theatre personnel using a prospective controlled intervention design at a single Norwegian university hospital.

Methods

We conducted a study with pre- and post-intervention surveys using the intervention and control groups. The primary outcome was the effects of the Norwegian version of the SSC on safety culture perceptions. Safety culture was measured using the validated Norwegian version of the Hospital Survey on Patient Safety Culture. Descriptive characteristics of operating theatre personnel and checklist compliance data were also recorded. A mixed linear regression model was used to assess changes in safety culture.

Results

The response rate was 61% (349/575) at baseline and 51% (292/569) post-intervention. Checklist compliance ranged from 77% to 85%. We found significant positive changes in the checklist intervention group for the culture factors ‘frequency of events reported’ and ‘adequate staffing’ with regression coefficients at −0.25 [95% confidence interval (CI), −0.47 to −0.07] and 0.21 (95% CI, 0.07–0.35), respectively. Overall, the intervention group reported significantly more positive culture scores—including at baseline.

Conclusions

Implementation of the SSC had rather limited impact on the safety culture within this hospital.

Communication strategies in acute health care: evaluation within the context of infection prevention and control

BACKGROUND

Communication in healthcare settings has recently received significant attention in the literature. However, there continues to be a large gap in current understanding of the effectiveness of different communication channels used in acute healthcare settings, particularly in the context of infection prevention and control (IPC).

AIM

To explore and evaluate the main communication channels used within hospitals to communicate with healthcare workers (HCWs) and to propose practical recommendations.

METHODS

Critical review of the main communication channels used within acute health care to communicate information to HCWs, and analysis of their impact on practice.

FINDINGS

The analysis covers verbal communications, standardization via guidelines, education and training, electronic communications and marketing strategies. Traditional communication channels have not been successful in changing and sustaining best practice in IPC, but newer approaches (electronic messages and marketing) also have pitfalls.

CONCLUSION

A few simple recommendations are made in relation to the development, implementation and evaluation of communications to HCWs; top-down vs bottom-up communications; and the involvement of HCWs, particularly ward personnel.

Patient involvement in patient safety: How willing are patients to participate?

BACKGROUND

Despite growing recognition internationally that patients can help to promote their own safety, little evidence exists on how willing patients are to take on an active role.

OBJECTIVES

To investigate medical and surgical patients' perceived willingness to participate in different safety-related behaviours and the potential impact of doctors'/nurses' encouragement on patients' willingness levels.

DESIGN

Cross-sectional exploratory study using a survey that addressed willingness to participate in different behaviours recommended by current patient safety initiatives. Interactional behaviours (asking factual or challenging questions, notifying doctors or nurses of errors or problems) and non-interactional behaviours (choosing a hospital based on the safety record, bringing medicines and a list of allergies into hospital, and reporting an error to a national reporting system) were assessed.

PARTICIPANTS

80 medical and surgical patients from an inner city London teaching hospital. Findings Patients' perceived willingness to participate was affected (p<0.05) by the action required by the patient and (for interactional behaviours) whether the patient was engaging in the specific action with a doctor or nurse. Patients were less willing to participate in challenging behaviours. Doctors' and nurses' encouragement appeared to increase patient-reported willingness to ask challenging questions, but no other consistent findings were observed.

CONCLUSION

Patients do not view involvement in a range of safety-related behaviours uniformly. Particular efforts are needed to encourage patients to participate in novel or challenging behaviours as these are behaviours where patients appear less inclined to take on an active role.

Developing and testing TEAM (Team Evaluation and Assessment Measure), a self-assessment tool to improve cancer multidisciplinary teamwork

BACKGROUND

Cancer multidisciplinary teams (MDTs) are well established worldwide and are an expensive resource yet no standardised tools exist to measure performance. We aimed to develop and test an MDT self-assessment tool underpinned by literature review and consensus from over 2000 UK MDT members about the "characteristics of an effective MDT."

METHODS

Questionnaire items relating to all characteristics of MDTs (particularly Leadership and Chairing; Teamworking and Culture; Patient-centred care; Clinical decision-making process; and Organisation and administration during meetings) were developed by an expert panel. Acceptability, feasibility and psychometric properties were tested by online completion of the questionnaire by 23 MDTs from 4 UK NHS Trusts followed by interviews with 74 team members including members from all teams and nonresponders. 10 of the MDTs also completed questionnaires that directly translated each characteristic to an item (for the five domains above) to test content validity.

RESULTS

A total of 47 items were created, each rated for agreement on a 5-point scale. A total of 329 (52 %) of 637 team members completed the questionnaire, including representation from medical, nursing and clerical MDT members. Responses correlated well with domain-specific questionnaires (r > 0.67, p = 0.01), most domain-scales had acceptable internal consistency (Cronbach alpha > 0.60), and good item discrimination (majority of items r < 0.20). Team members were positive about its value.

CONCLUSIONS

Self-assessment of team performance using this tool may support MDT development.

Multidisciplinary team working across different tumour types: analysis of a national survey

BACKGROUND

Using data from a national survey, this study aimed to address whether the current model for multidisciplinary team (MDT) working is appropriate for all tumour types.

PATIENTS AND METHODS

Responses to the 2009 National Cancer Action Team national survey were analysed by tumour type. Differences indicate lack of consensus between MDT members in different tumour types.

RESULTS

One thousand one hundred and forty-one respondents from breast, gynaecological, colorectal, upper gastrointestinal, urological, head and neck, haematological and lung MDTs were included. One hundred and sixteen of 136 statements demonstrated consensus between respondents in different tumour types. There were no differences regarding the infrastructure for meetings and team governance. Significant consensus was seen for team characteristics, and respondents disagreed regarding certain aspects of meeting organisations and logistics, and patient-centred decision making. Haematology MDT members were outliers in relation to the clinical decision-making process, and lung MDT members disagreed with other tumour types regarding treating patients with advanced disease.

CONCLUSIONS

This analysis reveals strong consensus between MDT members from different tumour types, while also identifying areas that require a more tailored approach, such as the clinical decision-making process, and preparation for and the organisation of MDT meetings. Policymakers should remain sensitive to the needs of health care teams working in individual tumour types.

Development and evaluation of a checklist to support decision making in cancer multidisciplinary team meetings: MDT-QuIC

BACKGROUND

The quality of decision-making in cancer multidisciplinary team (MDT) meetings is variable, which can result in suboptimal clinical decision making. We developed MDT-QuIC, an evidence-based tool to support clinical decision making by MDTs, which was evaluated by key users.

METHODS

Following a literature review, factors important for high-quality clinical decision making were listed and then converted into a preliminary checklist by clinical and safety experts. Attitudes of MDT members toward the tool were evaluated via an online survey, before adjustments were made giving rise to a final version: MDT-QuIC.

RESULTS

The checklist was evaluated by 175 MDT members (surgeons = 38, oncologists = 40, specialist nurses = 62, and MDT coordinators = 35). Attitudes toward the checklist were generally positive (P < 0.001, 1-sample t test), although nurses were more positive than other groups regarding whether the checklist would improve their contribution in MDT meetings (P < 0.001, Mann-Whitney U test). Participants thought that the checklist could be used to prepare cases for MDT meetings, to structure and guide case discussions, or as a record of MDT discussion. Regarding who could use the checklist, 70% thought it should be used by the MDT chair, 54% by the MDT coordinator, and 38% thought all MDT members should use it.

CONCLUSION

We have developed and validated an evidence-based tool to support the quality of MDT decision making. MDT members were positive about the checklist and felt it may help to structure discussion, improve inclusivity, and patient centeredness. Further research is needed to assess its effect on patient care and outcomes.

Predictors of hospitalized patients' intentions to prevent healthcare harm: a cross sectional survey

BACKGROUND

Patients can play an important role in reducing healthcare harm but little is known about the factors that may affect patients' willingness to participate. In order to encourage the 'active' patient it is critical that we gain a deeper understanding of the antecedents of safety-relevant behaviours. Doing this will enable the implementation of effective interventions aimed at supporting patients to work with healthcare professionals in ensuring safe care.

OBJECTIVE

To examine predictors of patients' intentions to engage in two safety behaviours: (1) reminding healthcare staff to wash their hands and; (2) notifying healthcare staff if they are not wearing a hospital identification bracelet.

DESIGN

Cross-sectional survey study.

PARTICIPANTS

A purposive sampling method was employed to recruit 80 medical and surgical hospital inpatients aged 18-80 (mean 48) from one inner city London teaching hospital.

METHODS

A 42 item survey that measured the extent that patients' control beliefs, behavioural beliefs, normative beliefs and perceived susceptibility and severity towards a hospital-acquired infection or a misidentification error could predict their intentions to ask doctors/nurses about their hand washing compliance or notify doctors/nurses if they are not wearing a hospital identification bracelet. Data was analysed using multiple regression analysis.

RESULTS

Control beliefs, normative beliefs and perceived severity were the strongest predictors of patients' intentions to participate in both behaviours. The regression models accounted for a smaller percentage of the variance in patients' intentions to ask doctors/nurses if they have washed their hands (42%/37%) than notifying staff if they were not wearing an identification bracelet (54%/56%).

CONCLUSIONS

If patients understand why a behaviour is beneficial, they perceive it as acceptable to participate in and that they have control over the decision to engage in the behaviour, we hypothesise that more patients will intend to participate in that behaviour. When designing interventions aimed at encouraging the participation of patients in promoting their own safety, consideration should be given to the potential influence of patients' control beliefs, normative beliefs and perceived severity of errors on their intentions to participate.

Quality improvement in multidisciplinary cancer teams: an investigation of teamwork and clinical decision-making and cross-validation of assessments

PURPOSE

Teamworking and clinical decision-making are important in multidisciplinary cancer teams (MDTs). Our objective is to assess the quality of information presentation and MDT members' contribution to decision-making via expert observation and self-report, aiming to cross-validate the two methods and assess the insight of MDT members into their own team performance.

MATERIALS AND METHODS

Behaviors were scored using (i) a validated observational tool employing Likert scales with objective anchors, and (ii) a 29-question online self-report tool. Data were collected from observation of 164 cases in five MDTs, and 47 surveys from MDT members (response rate 70%). Presentation of information (case history, radiological, pathological, comorbidities, psychosocial, and patients' views) and quality of contribution to decision-making of MDT members (surgeons, oncologists, radiologists, pathologists, nurses, and MDT coordinators) were analyzed via descriptive statistics and the Jonckheere-Terpstra test. Correlation between observational and self-report assessments was assessed with Spearman's correlations.

RESULTS

Quality of information presentation: Case histories and radiology information rated highest; patients' views and comorbidities/psychosocial issues rated lowest (observed: Z = 14.80, P ≤ 0.001; self-report: Z = 3.70, P < 0.001). Contribution to decision-making: Surgeons and oncologists rated highest, nurses and MDT coordinators rated lowest, and others in between (observed: Z = 20.00, P ≤ 0.001; self-report: Z = 8.10, P < 0.001). Correlations between observational and self-report assessments: Median Spearman's rho = 0.74 (range = 0.66-0.91; P < 0.05).

CONCLUSIONS

The quality of teamworking and clinical decision-making in MDTs can reliably be assessed using observational and self-report metrics. MDT members have good insight into their own team performance. Such robust assessment methods could provide the basis of a toolkit for MDT team evaluation and improvement.

Observational Skill-based Clinical Assessment tool for Resuscitation (OSCAR): development and validation

Aim

The aim of the study reported here was to address the need to assess and train teamwork and non-technical skills in the context of Resuscitation. Specifically, we sought to develop a tool that is feasible to use and psychometrically sound to assess team behaviours during cardiac arrest resuscitation attempts.

Methods

To ensure validity, reliability, and feasibility, the Observational Skill based Clinical Assessment tool for Resuscitation (OSCAR) was developed in 3 phases. A review of the literature leading to initial tool development was followed by an assessment of face and content validity, and finally a thorough reliability assessment, using Cronbach's α to assess internal consistency and intraclass correlation to assess inter-rater reliability.

Results

OSCAR was developed methodically, and tested for face and content validity. Cronbach's α results ranged from 0.736 to 0.965 demonstrating high internal consistency, and intraclass correlation results ranged from 0.652 to 0.911, all of which are strongly significant and indicate good inter-rater reliability.

Conclusion

On the basis of our results, we conclude that OSCAR is psychometrically robust, scientifically sound, and clinically relevant. We have developed the Observational Skill-based Clinical Assessment tool for Resuscitation (OSCAR) for the assessment of non-technical skills in Resuscitation teams. We propose the use of this tool in simulation and real Cardiac Arrest Resuscitation attempts to assess, guide and train non-technical skills to team members, to improve patient safety and maximise the chances of successful resuscitation.