Are emergency department junior doctors becoming less experienced in performing common practical procedures?

Five-Year results of a multi-specialty induction course for surgical training

Background

The Essential Surgical Skills Course (ESSC) is a multi-specialty induction "boot camp" style course that has been run successfully for five years. The aim of the current paper is to create an accurate guide for the replication of the course by other teams and assess the course's fitness for purpose, through the survey feedback provided by trainees.

Methods

The course's fitness for purpose was assessed through cumulative five-year survey feedback from trainees. This observational study describes the design and process of content adjustment according to feedback.

Results

The course its five-year span offered twelve different procedural skills in four different specialties. Feedback for each session was persistently >8/10. Key themes identified as beneficial include teacher-to-trainee ratio (often 1:1), teaching style, course structure and responsiveness.

Conclusions

The ESSC was found to be fit for purpose for the induction of trainees into surgical training. The key factors contributing to the success of the course include the structured method of curriculum design, outstanding teaching delivery methods, teacher-to-trainee ratio, the availability of appropriate faculty and infrastructure and the willingness to learn from trainee feedback and adjust the content of the course accordingly. It acts as a paradigm for courses aimed to prepare surgical trainees for a "step-up" in their careers.

Closing five Emergency Departments in England between 2009 and 2011: the closED controlled interrupted time-series analysis

Background

In recent years, a number of emergency departments (EDs) have closed or have been replaced by another facility such as an urgent care centre. With further reorganisation of EDs expected, this study aimed to provide research evidence to inform the public, the NHS and policy-makers when considering local closures.

Objective

To understand the impact of ED closures/downgrades on populations and emergency care providers.

Design

A controlled interrupted time series of monthly data to assess changes in the patterns of mortality in local populations and changes in local emergency care service activity and performance, following the closure of type 1 EDs.

Setting

The populations of interest were in the resident catchment areas of five EDs that closed between 2009 and 2011 (in Newark, Hemel Hempstead, Bishop Auckland, Hartlepool and Rochdale) and of five control areas.

Main outcome measures

The primary outcome measures were ambulance service incident volumes and times, the number of emergency and urgent care attendances at EDs, the number of emergency hospital admissions, mortality, and case fatality ratios.

Data sources

Data were sourced from the Office for National Statistics, Hospital Episode Statistics (HES) accident and emergency, HES admitted patient care and ambulance service computer-aided dispatch records.

Results

There was significant heterogeneity among sites in the results for most of the outcome measures, but the overall findings were as follows: there is evidence of an increase, on average, in the total number of incidents attended by an ambulance following 999 calls, and those categorised as potentially serious emergency incidents; there is no statistically reliable evidence of changes in the number of attendances at emergency or urgent care services or emergency hospital admissions; there is no statistically reliable evidence of any change in the number of deaths from a set of emergency conditions following the ED closure in any site, although, on average, there was a small increase in an indicator of the ‘risk of death’ in the closure areas compared with the control areas.

Limitations

Unavailable or unreliable data hindered some of the analysis regarding ED and ambulance service performance.

Conclusions

Overall, across the five areas studied, there was no statistically reliable evidence that the reorganisation of emergency care was associated with an increase in population mortality. This suggests that any negative effects caused by increased journey time to the ED can be offset by other factors; for example, if other new services are introduced and care becomes more effective than it used to be, or if the care received at the now-nearest hospital is more effective than that provided at the hospital where the ED closed. However, there may be implications of reorganisation for NHS emergency care providers, with ambulance services appearing to experience a greater burden.

Future work

Understanding why effects vary between sites is necessary. It is also necessary to understand the impact on patient experience. Economic evaluation to understand the cost implications of such reorganisation is also desirable.

Funding

The National Institute for Health Research Health Services and Delivery Research programme.

Evaluation of the utility of teaching joint relocations using cadaveric specimens

BACKGROUND

Like other procedural skills, the ability to relocate a joint is an important aspect of junior doctor education. Changes in the approach to teaching and learning from the traditional apprenticeship-style model have made the teaching of practical skills more difficult logistically. Workshops utilising cadaveric specimens offer a solution to this problem.

METHODS

One hundred forty-six fourth year medical students were randomly divided into 5 groups. Each group received a different teaching intervention based on ankle, patella and hip relocation. The interventions consisted of online learning modules, instructional cards and workshops using skeleton models and cadaveric dislocation models. Following the intervention students were given a test containing multiple choice and true/false style questions. A 13-item 5-point Likert scale questionnaire was also delivered before and after the intervention. The data was analysed using one-way analysis of variance (ANOVA) and the Bonferroni post-hoc test.

RESULTS

Compared to the instructional cards group, the other 4 groups showed a 10.8-19.2% improvement in total test score (p < 0.01) and an 18.4-25.3% improvement in self-reported understanding and confidence in performing joint relocations (P < 0.01). There was no significant difference in total test scores between groups exposed to cadaveric instruction on the relocation of one-, two- or all three- joints, nor any significant difference between all the cadaveric dislocation groups and the group receiving instruction on the skeleton model.

CONCLUSION

The results of the present study suggest that workshops utilising cadaveric dislocation models are effective in teaching joint relocation. In addition, the finding that lower fidelity models may be of equal utility may provide institutions with flexibility of delivery needed to meet financial and resource constraints.

The effectiveness of the internship in meeting established learning objectives: A qualitative study

OBJECTIVE

To identify and explore variations in intern (Postgraduate Year 1 doctors) exposure to clinical activities defined by an established early postgraduate curriculum within the contemporary health service environment.

METHODS

A mixed methods study was undertaken in seven health services comprising (1) a questionnaire regarding interns' exposure to a range of clinical activities within a two-year early post-graduate curriculum and (2) group interviews with intern supervisors and managers to explore barriers and facilitators of interns' clinical exposure.

RESULTS

One hundred and eleven interns completed the questionnaire and seventeen intern supervisors and managers participated in group interviews. Interns' exposure to early postgraduate curriculum activities varied significantly, with participation in patient emergency management and procedures being undertaken less frequently than interns wished. These findings were consistent across different regional settings. Of three mandatory terms, exposure to curriculum activities was greater in medicine and emergency medicine than in surgery.

CONCLUSIONS

Junior doctors' participation within the complex contemporary health service environment is constrained by barriers relating to clinical governance frameworks and health system performance, particularly in high-risk clinical activities. Solutions will require structural approaches to internship reform to ensure that placements provide the necessary safe clinical experiences required for intern training.

A longitudinal study of well-being, confidence and competence in junior doctors and the impact of emergency medicine placements

Objectives

To measure levels of, and change in junior doctor well-being, confidence and self-reported competence over their second postgraduate training year and the impact of emergency department (ED) placements on these outcomes.

Design

A longitudinal study using an online survey administered at four time points (2010–2011).

Setting

28 Acute Hospital Trusts, drawn from nine participating Postgraduate Deaneries in England.

Participants

Junior doctors who had a placement in an ED as part of their second postgraduate training year.

Main outcome measures

Levels of anxiety, depression, motivation, job satisfaction, confidence and self-reported competence, collected at four time points spread over the period of the doctor's second training year (F2).

Results

217 junior doctors were recruited to the study. Over the year there was a significant increase in their overall job satisfaction, confidence and self-reported competence. Junior doctors also reported significantly increased levels of motivation and anxiety, and significantly decreased levels of extrinsic job satisfaction when working in ED compared with other specialties. There were also significant increases in both junior doctor confidence and self-reported competence after their placement in ED relative to other specialties.

Conclusions

While elements of junior doctor well-being worsened in their ED placement compared with their time spent in other specialties, the increased levels of anxiety and reduced extrinsic job satisfaction were within the normal range for other healthcare workers. These deficits were also balanced by greater improvements in motivation, confidence in managing common acute clinical conditions and perceived competence in performing acute procedures compared with benefits offered by placements in other specialties.

An evaluation of foundation doctor training: a mixed-methods study of the impact on workforce well-being and patient care [the Evaluating the Impact of Doctors in Training (EDiT) study]

Background

A major reform of junior doctor training was undertaken in 2004–5, with the introduction of foundation training (FT) to address perceived problems with work structure, conditions and training opportunities for postgraduate doctors. The well-being and motivation of junior doctors within the context of this change to training (and other changes such as restrictions in working hours of junior doctors and increasing demand for health care) and the consequent impact upon the quality of care provided is not well understood.

Objectives

This study aimed to evaluate the well-being of foundation year 2 (F2) doctors in training. Phase 1 describes the aims of delivering foundation training with a focus on the role of training in supporting the well-being of F2 doctors and assesses how FT is implemented on a regional basis, particularly in emergency medicine (EM). Phase 2 identifies how F2 doctor well-being and motivation are influenced over F2 and specifically in relation to EM placements and quality of care provided to patients.

Methods

Phase 1 used semistructured interviews and focus groups with postgraduate deanery leads, training leads (TLs) and F2 doctors to explore the strategic aims and implementation of FT, focusing on the specialty of EM. Phase 2 was a 12-month online longitudinal study of F2 doctors measuring levels of and changes in well-being and motivation. In a range of specialties, one of which was EM, data from measures of well-being, motivation, intention to quit, confidence and competence and job-related characteristics (e.g. work demands, task feedback, role clarity) were collected at four time points. In addition, we examined F2 doctor well-being in relation to quality of care by reviewing clinical records (criterion-based and holistic reviews) during the emergency department (ED) placement relating to head injury and chronic obstructive pulmonary disease (COPD).

Results

Phase 1 of the study found that variation exists in how successfully FT is implemented locally; F2 lacks a clearly defined end point; there is a minimal focus on the well-being of F2 doctors (only on the few already shown to be ‘in difficulty’); the ED presented a challenging but worthwhile learning environment requiring a significant amount of support from senior ED staff; and disagreement existed about the performance and confidence levels of F2 doctors. A total of 30 EDs in nine postgraduate medical deaneries participated in phase 2 with 217 foundation doctors completing the longitudinal study. F2 doctors reported significantly increased confidence in managing common acute conditions and undertaking practical procedures over their second foundation year, with the biggest increase in confidence and competence associated with their ED placement. F2 doctors had levels of job satisfaction and anxiety/depression that were comparable to or better than those of other NHS workers, and adequate quality and safety of care are being provided for head injury and COPD.

Conclusions

There are ongoing challenges in delivering high-quality FT at the local level, especially in time-pressured specialties such as EM. There are also challenges in how FT detects and manages doctors who are struggling with their work. The survey was the first to document the well-being of foundation doctors over the course of their second year, and average scores compared well with those of other doctors and health-care workers. F2 doctors are benefiting from the training provided as we found improvements in perceived confidence and competence over the year, with the ED placement being of most value to F2 doctors in this respect. Although adequate quality of care was demonstrated, we found no significant relationships between well-being of foundation doctors and the quality of care they provided to patients, suggesting the need for further work in this area.

Funding

The National Institute for Health Research Health Services and Delivery Research programme.

Using a simulated surgical skills station to assess laceration management by surgical and nonsurgical residents

OBJECTIVE

To assess laceration management performance among surgical and nonsurgical postgraduate year-1 (PGY-1) residents objectively and to test for interval improvement.

METHODS

From 2006 to 2008, 106 PGY-1 residents from 10 medical specialties were evaluated with a simulated surgical skills station using pigs' feet before and after internship. Subjects were given 11 minutes to choose the proper suture, prepare and close the wound, and answer laceration management questions. Trainees were classified as surgical (emergency medicine, general surgery, obstetrics and gynecology, orthopedics, and otolaryngology) and nonsurgical (family medicine, internal medicine, neurology, pediatrics, and transitional year). An objective checklist was used to assess performance.

RESULTS

A total of 106 PGY-1 residents (age range, 25-44 years; mean, 28.7 years) participated, consisting of 41 surgical (39%) and 65 nonsurgical residents (61%). Surgical group scores improved from 78.4% to 87.7% (P < .001). Nonsurgical scores improved from 67.2% to 73.1% (P < .001). There was similar improvement between groups (surgical, 9.4%; nonsurgical, 5.9%; P  =  .21). Surgical residents outscored nonsurgical residents before (P < .001) and after (P < .001) internship.

CONCLUSION

Surgical residents outperformed nonsurgical residents before and after the PGY-1 year with similar score improvements. A simulated surgical skills station can be used to evaluate procedure performance objectively and to test for interval improvement. A simulated surgical skills station may serve as a useful adjunct to apprenticeship in assessing procedure competence.

Evaluation of a new needle catching instrument for suturing simple wounds in the Emergency Department

OBJECTIVES

The Needlecatcher comprises a tissue forceps at one end, with a 'piston and barrel' system, which acts as a needle grasper, at the other end of the instrument. It minimizes exposure of the needle during suturing, potentially reducing risk of injury. We evaluate its effect on operator safety during simple wound closure.

METHODS

Video analysis of 10 clinicians (six junior doctors and four advanced nurse practitioners) closing a standard simulated wound using their normal technique was performed. They were trained in the use of the Needlecatcher, and used it for 10 weeks closing simple wounds in the Emergency Department. Video analysis of wound closure was repeated, using the new instrument. Clinicians filled out a questionnaire for each episode of wound closure, which assessed how they perceived their safety was affected by the device.

RESULTS

Video analysis of clinicians showed that the needle was secured in an instrument and thus unexposed for an average of 60% of the duration of the procedure by standard technique, compared with 95% using the Needlecatcher, with a change of 35% [95% confidence interval (CI): 14-58%, P = 0.005]. Episodes where the needle was grasped by an operator's finger were reduced by 50% (95% CI: 15-85%, P = 0.028). In the questionnaire study of 53 episodes of wound closure, operators perceived their safety to be increased in 38 (71.7%, 95% CI: 66.2-77.2%) episodes, were neutral in 10, and felt their safety was reduced in five.

CONCLUSION

The Needlecatcher showed the potential to reduce the risk of needlestick injury while suturing.