A qualitative analysis of junior doctors' journeys to preparedness in acute care

Exploring preparedness transitions in medicine and pharmacy: a qualitative longitudinal study to inform multiprofessional learning opportunities

Despite extensive preparedness literature, existing studies fail to adequately explore healthcare graduates' feelings of preparedness longitudinally across new graduate transition journeys, nor do they compare different healthcare professions to ascertain what opportunities exist for multiprofessional transition interventions. Therefore, this Australian study, underpinned by temporal theory, explores the preparedness transitions of medicine and pharmacy graduates. Our 6-month qualitative longitudinal study involved 12 medicine and 7 pharmacy learners after purposive sampling. They participated in an entrance interview before starting internship, longitudinal audio-diaries during their first three months of internship, and an exit interview. Framework analysis explored patterns in the data cross-sectionally and longitudinally for the whole cohort (thinking over time), with pen portraits illustrating individuals' journeys (thinking through time). Preparedness and unpreparedness narratives involved practical skills and tasks, interpersonal skills, knowledge, and professional practice for medicine and pharmacy. However, narratives for practical skills and tasks, and professional practice were dominant amongst medicine graduates, while narratives for interpersonal skills and knowledge were dominant amongst pharmacy graduates. We found numerous cohort changes in feelings of preparedness over time, but the illustrative pen portraits demonstrated the complexities and nuances through time, including feelings of preparedness before internship becoming unpreparedness during internship (e.g., cannulas), improving preparedness through time (e.g., cover shifts), and persistent feelings of unpreparedness (e.g., patient interactions). While our cross-sectional findings are reasonably consistent with existing research, our comparative and longitudinal findings are novel. We recommend that educators build learners' preparedness through uniprofessional transition interventions involving practical skills and tasks, and professional practice in medicine, and interpersonal skills and knowledge in pharmacy. More importantly, we recommend multiprofessional transition interventions for medicine and pharmacy learners before internship focusing on knowledge, and during internship focusing on practical skills and tasks.

Implementation and Analysis of a Fully Immersive Virtual Reality-Based Emergency Training in a Surgical Curriculum

Introduction

Due to the changing demands in medical education, there is a necessity to increase the extent and quality of practical teaching. Virtual Reality (VR) enforces learning from simulated experience due to its immersive and interactive environment.

Methods

VR-based training sessions were implemented as the last module before medical students were entering their clerkship. 84 students were enrolled in this study. 24 of them were active users in complex VR-based emergency scenarios (AU) while the other 60 students were observers (OBS). A questionnaire was completed pre - and post intervention to evaluate motion sickness, intuitive use, immersive experience, subjective learning and perceived competence.

Results

Overall, the implementation into the surgical curriculum was feasible. The technical aspects of the program, particularly regarding usability, were generally well-rated by the AU. The degree of immersion and the subjective learning success were reported higher by AU compared to OBS. In the pre/post comparison, a nuanced picture emerged with a significant increase in competence in diagnostic reasoning and initiation of a treatment algorithm, while other competency facets showed no change.

Conclusion

VR can be seen as a good teaching tool in medical education as it improved the subjective learning experience and perceived competence of students. However, for complex clinical emergencies, prior knowledge is usually required, which is why such scenarios are preferably implemented in later stages of the curriculum.

Needs assessment of surgical skills of interns: a qualitative study in metropolitan Melbourne, Australia

INTRODUCTION

Upon graduation, newly qualified doctors are expected to manage complex and unwell patients, and adapt their prior learning to navigate an often-nuanced healthcare workplace environment. Surgical rotations can bring a unique set of learning curves and challenges to this already demanding transitional period. The aim of this study was to identify the training needs of medical students and early-career doctors in surgical skills, incorporating viewpoints from all stakeholder groups to provide a holistic insight into the provision of surgical education currently, and how it can be optimized to improve work preparedness.

METHODS

Final-year medical students, interns and clinical educators from five clinical schools affiliated with the University of Melbourne were recruited for semi-structured interviews. Following transcription, multi-phased thematic analysis was performed to identify key themes.

RESULTS

Thirty-seven participants were interviewed (18 students, 8 interns and 11 clinical educators). Outside of commonly utilized procedural skills, different emphases were placed on non-technical skills by students and interns, compared to clinical educators. Increased hands-on learning and structured teaching were thought to be key to increasing confidence and work preparedness.

CONCLUSION

This qualitative study interviewed key stakeholders to identify important skills in order to help newly qualified interns to thrive in a surgical rotation. These skills in particular included more supervised hands-on practical teaching. Future studies involving graduates from other medical schools may provide a better understanding of surgical education in the wider Australian context.

Tailoring support following summative assessments: a latent profile analysis of student outcomes across five medical specialities

Summative assessments are often underused for feedback, despite them being rich with data of students' applied knowledge and clinical and professional skills. To better inform teaching and student support, this study aims to gain insights from summative assessments through profiling students' performance patterns and identify those students missing the basic knowledge and skills in medical specialities essential for their future career. We use Latent Profile Analysis to classify a senior undergraduate year group (n = 295) based on their performance in applied knowledge test (AKT) and OSCE, in which items and stations are pre-classified across five specialities (e.g. Acute and Critical Care, Paediatrics,…). Four distinct groups of students with increasing average performance levels in the AKT, and three such groups in the OSCE are identified. Overall, these two classifications are positively correlated. However, some students do well in one assessment format but not in the other. Importantly, in both the AKT and the OSCE there is a mixed group containing students who have met the required standard to pass, and those who have not. This suggests that a conception of a borderline group at the exam-level can be overly simplistic. There is little literature relating AKT and OSCE performance in this way, and the paper discusses how our analysis gives placement tutors key insights into providing tailored support for distinct student groups needing remediation. It also gives additional information to assessment writers about the performance and difficulty of their assessment items/stations, and to wider faculty about student overall performance and across specialities.

Ward-Based Staff Perspectives on Their Preparedness to Recognize Patient Deterioration: An Interpretive Description Study

BACKGROUND

Despite an overall decline in serious adverse events in hospitalized patients, approximately one third of inpatient mortality continues to relate to adverse events impacting patients on general wards. The preparedness of nurses, midwives, and nursing assistants (collectively referred to as ward-based staff) to recognize patient deterioration is therefore seen as critical.

PURPOSE

The aim of this study was to explore ward-based staff perspectives regarding their preparedness to recognize patient deterioration.

METHODS

An interpretive description approach was utilized to interview 16 participants from a single-center regional hospital. The participants included nurses, midwives, and nursing assistants who worked exclusively on wards. The participants were purposely selected to complete semistructured interviews. Data were analyzed using a six-step thematic analysis, and the study followed the Standards for Reporting Qualitative Research checklist.

RESULTS

Three main themes (with subthemes) were identified: (a) feeling prepared (experience, intuitive awareness, early warning systems), (b) promoting preparedness (multimodal education, debriefing, collegial support), and (c) being unprepared (undergraduate education, knowledge deficit, staffing related concerns, psychological response to incident, unforeseen barriers).

CONCLUSIONS/IMPLICATIONS FOR PRACTICE

The findings suggest strategies for increasing knowledge and confidence in all ward-based staff, allowing them to feel better prepared to recognize clinical deterioration. Moreover, based on the results, ward-based staff strongly perceive experience, clinical shortfalls in undergraduate education, collegial support networks, mentorship, psychological response to incidents, and multimodal education to be key contributors to preparedness.

Can I Phone a Friend? Exploring the Use of Digital Devices in Clinical Exams

BACKGROUND

Objective structured clinical examinations (OSCEs) are used globally to assess health professional learners' clinical skills and applied knowledge. Despite innovations with simulated participants, manikin technology and real patient involvement, there remains a gap between 'real-life' practice and 'OSCE experience'. For example, although mobile phone use is increasingly common in clinical practice; however, it would represent a significant disruption to established assessment practices in OSCEs. We aimed to explore student use of mobile phones during OSCE assessment, with a focus on exam security, equity and relevance to practice.

METHODS

Cultural Historical Activity Theory (CHAT) allows us to conceptualise and analyse complex systems such as those of OSCE assessment. We recruited a range of stakeholders in a UK medical school setting to participate in focus group interviews exploring our stated aim. Transcripts were analysed using CHAT as a theoretical lens to construct an activity system of assessment and identify emerging tensions around the use of a potentially disruptive technology: students' own mobile phones.

FINDINGS

Seven examiners, 13 medical students, and two simulated participants participated in three focus groups. Three sources of tension were identified: between the tools of assessment and practice, of exam security and exam relevance, and of medical students as people and professionals.

DISCUSSION AND CONCLUSION

This study exemplifies how a seemingly small disruption in a complex system (introducing a mobile phone-a tool used in everyday practice) can help us understand and describe the unwritten rules of assessment.

Student advanced trauma management and skills (SATMAS): a validation study

INTRODUCTION

Despite trauma accounting 9% of global mortality, it has been demonstrated that undergraduate trauma teaching is inadequate nationally and worldwide. With COVID-19 exacerbating this situation, a scalable, accessible, and cost-effective undergraduate trauma teaching is required.

METHODS

Our Continual Professional Development United Kingdom (CPUDK)-accredited University Hospitals Birmingham (UHB) Major Trauma Service (MTS) affiliated programme consisted of seven biweekly pre-recorded sessions that were delivered online through the Moodle educational platform to University of Birmingham students. Pre- and post-randomised session-specific multiple-choice questions (MCQs) and anonymous feedback forms were administered.

RESULTS

There were 489 student responses, with 63 students completing all seven sessions. On an 8-point scale, students' objective knowledge scores increased by a mean of 1.2 (p < 0.001). Using a 5-point Likert scale, students also showed improvement in subjective outcomes including their confidence in assessing trauma patient (absolute difference (AD) 1.38, p < 0.001), advising initial investigations and formulating initial management plans (AD 1.78, p < 0.001) and thereby their confidence to manage a trauma patient overall (AD 1.98, p < 0.001). A total of 410 student responses endorsed the online delivery of SATMAS through Moodle and recommended SATMAS to future medical students.

CONCLUSION

SATMAS has demonstrated positive student feedback and extensive recruitment from only one centre, demonstrating that our programme can be an indispensable low-cost learning resource that prepares undergraduate medical students for their trauma exams and informs the implementation of clinical skills required by all doctors. We publish our pilot study findings to encourage similar teaching programmes to be adopted at other universities nationally and internationally, to synergistically benefit students, tutors, and ultimately patients, on a larger scale.

Using Virtual Reality Head-Mounted Displays to Assess Skills in Emergency Medicine: Validity Study

BACKGROUND

Many junior doctors must prepare to manage acutely ill patients in the emergency department. The setting is often stressful, and urgent treatment decisions are needed. Overlooking symptoms and making wrong choices may lead to substantial patient morbidity or death, and it is essential to ensure that junior doctors are competent. Virtual reality (VR) software can provide standardized and unbiased assessment, but solid validity evidence is necessary before implementation.

OBJECTIVE

This study aimed to gather validity evidence for using 360-degree VR videos with integrated multiple-choice questions (MCQs) to assess emergency medicine skills.

METHODS

Five full-scale emergency medicine scenarios were recorded with a 360-degree video camera, and MCQs were integrated into the scenarios to be played in a head-mounted display. We invited 3 groups of medical students with different experience levels to participate: first- to third-year medical students (novice group), last-year medical students without emergency medicine training (intermediate group), and last-year medical students with completed emergency medicine training (experienced group). Each participant's total test score was calculated based on the number of correct MCQ answers (maximum score of 28), and the groups' mean scores were compared. The participants rated their experienced presence in emergency scenarios using the Igroup Presence Questionnaire (IPQ) and their cognitive workload with the National Aeronautics and Space Administration Task Load Index (NASA-TLX).

RESULTS

We included 61 medical students from December 2020 to December 2021. The experienced group had significantly higher mean scores than the intermediate group (23 vs 20; P=.04), and the intermediate group had significantly higher scores than the novice group (20 vs 14; P<.001). The contrasting groups' standard-setting method established a pass-or-fail score of 19 points (68% of the maximum possible score of 28). Interscenario reliability was high, with a Cronbach α of 0.82. The participants experienced the VR scenarios with a high degree of presence with an IPQ score of 5.83 (on a scale from 1-7), and the task was shown to be mentally demanding with a NASA-TLX score of 13.30 (on a scale from 1-21).

CONCLUSIONS

This study provides validity evidence to support using 360-degree VR scenarios to assess emergency medicine skills. The students evaluated the VR experience as mentally demanding with a high degree of presence, suggesting that VR is a promising new technology for emergency medicine skills assessment.

Experience of enhanced near-peer support for new medical graduates of an Irish university: a phenomenological study

CONTEXT

Factors contributing to the stressful transition from student to doctor include issues with preparedness for practice, adjusting to new status and responsibility, and variable support. Existing transitional interventions provide inconsistent participation, responsibility and legitimacy in the clinical environment. Enhanced support by near peers for new doctors may ease the transition. Irish medical graduates of 2020 commenced work early, creating an unprecedented period of overlap between new graduates and the cohort 1 year ahead.

OBJECTIVE

To explore the experience of commencing practice for these new doctors with this increased near-peer support.

DESIGN

We used interpretive phenomenological analysis as our methodological approach, informed by the cognitive apprenticeship model, to explore the experience of enhanced near-peer support at the transition to practice. Participants recorded audio diaries from their commencement of work, and a semistructured interview was conducted with each, after 3 months, concerning their experience of their overlap with the previous year's interns.

SETTING

University College Cork, one of six medical schools in Ireland.

PARTICIPANTS

Nine newly qualified medical doctors.

MAIN OUTCOME MEASURES

An exploration of their experience of transition to clinical practice, in the context of this enhanced near-peer support, will inform strategies to ease the transition from student to doctor.

RESULTS

Participants felt reassured by having a near-peer in the same role and safe to seek their support. This empowered them to gradually assume increasing responsibility and to challenge themselves to further their learning. Participants perceived that commencing work before the annual change-over of other grades of doctor-in-training enhanced their professional identities and improved patient safety.

CONCLUSIONS

Enhanced near-peer support for new doctors offers a potential solution to the stressful transition to practice. Participants were legitimate members of the community of practice, with the status and responsibility of first-year doctors. Furthermore, this study reinforces the benefit of asynchronous job change-over for doctors-in-training.

The clinical task force: Improving quality of medical students' internship

Background

Up to 40% of young medical doctors feel that the internships prepared them insufficiently for the clinical work. This study investigated whether a Clinical Task Force (CTF) could improve internship quality.

Methods

The CTF visited internship departments with a triple-targeted approach: first, departments pre-filled a self-evaluating questionnaire; secondly, CTF visited departments to discuss the self-evaluation and previous student evaluations; and thirdly, CTF and departments agreed on several quality-improving focus points to work on after the meeting. Focus points were followed-up after three and 12 months. The impact on internship quality was assessed with departments' student evaluation scores, number of completed focus points, and the effect of completed focus points on a range of learning parameters. The CTF learned several things along the way, that potentially could affect the quality of internships. A shortlist of these was provided to illustrate unmeasurable benefits.

Results

The CTF met with 53 out of 60 eligible departments. The CTF and departments agreed upon 197 focus points of which 64% were completed. The three most frequent categories of focus points were Introduction of the students, The departments' evaluation percentage, and The departments' function as an educational site. The mean student evaluation scores did not change significantly, but the individual evaluation parameters changed significantly in two categories. It decreased in the category regarding the students' satisfaction with the clinical lecturers and the scheduled teaching and increased in the category regarding the percentage of students evaluating the department.

Conclusion

The CTF's triple-targeted approach did not increase the mean student evaluation score significantly. For departments that completed the agreed focus points, one category increased and another decreased. However, the unmeasurable benefits illustrated that CTF was a good viable linking element between the faculty, departments, and students with the potential of improving other aspects of the quality of internships.

Out-of-hours task allocation: implications for foundation training and practice

Introduction

The role of foundation year-1 (FY1) doctors during the out-of-hours (OOHs) period was explored, identifying areas to improve their training.

Methods

Data were retrospectively collected for 1 year of foundation training (2018-2019) from an electronic task system between 17:00 to 08:00, Monday to Sunday, in a 798-bed teaching hospital in Exeter, UK.

Results

Thirty-two thousand, two hundred and sixty OOHs jobs were requested with 21,816 (67.6%) assigned to FY1 doctors and the clinical site practitioner. Jobs were distributed with 12,044 (55.2%) for FY1 medicine, 5,739 (26.3%) for FY1 surgery and 4,033 (18.5%) for the clinical site practitioner. The three most common jobs requested were prescribing (31.1%), patient reviews (17.9%), and interpreting or taking bloods (11.6%). Procedural jobs accounted for 22.2% of all jobs. Prescribing and patient review jobs were further categorised into commonly encountered themes.

Conclusion

This study describes the nature of jobs performed by FY1 doctors working OOHs and identifies three areas to focus foundation doctor training. First, improving the preparedness of new graduates as guided by commonly identified jobs. Second, monitoring the appropriateness of performed jobs. Third, ensuring the evolving roles of allied health professionals and foundation doctors are clearly understood in relation to one another.

Exploring new-graduate physiotherapists' preparedness for, and experiences working within, Australian acute hospital settings

BACKGROUND

New-graduate physiotherapists experience a steep learning curve when transitioning from student to clinician. The acute hospital setting is known to present unique challenges for health clinicians, however, the preparedness of new-graduate physiotherapists for working within this setting remains unclear.

PURPOSE

The aim of this study was to investigate new-graduate physiotherapists' experiences of working in acute hospital settings and their perceptions toward how their pre-professional training prepared them for this setting.

METHODS

A qualitative study with a general inductive approach was used. Semi-structured interviews with new-graduate physiotherapists working in acute hospital settings were undertaken (n = 14). Interview data were subject to thematic analysis.

RESULTS

Four themes were generated from the data: 1) multifactorial and high-pressure nature; 2) managing relationships; 3) realizing responsibility; and 4) constructing realistic experiences.

CONCLUSION

The acute hospital setting presents unique obstacles and additional challenges when transitioning from student to clinician. New-graduates value the role of pre-professional training in their preparation for this context, however, new-graduates reflected on being sheltered from some areas of practice as students. Recommendations are suggested for education providers to adapt pre-professional training, and for employers to implement workplace strategies, which may support new-graduate physiotherapists in the acute hospital setting.

Perspectives of Clinical Teaching Fellows on preparedness for practice: a mixed-methods exploration of what needs to change

Supporting medical students in their transition to newly qualified doctor is an important educational priority. Clinical Teaching Fellows (CTFs), as both recent graduates and trained educators, are uniquely positioned to suggest curricular enhancements to support preparedness for practice. Our mixed-methods approach involved CTFs across eight UK teaching hospitals. We conducted five activity-oriented focus groups to explore what CTFs felt needed to change to increase preparedness for practice. We analysed these focus groups to create a dataset of their suggestions followed by a survey. The survey invited CTFs to rate and rank these suggestions in relation to their own self-rated preparedness for practice, with qualitative insights into their choices. We explored commonalities and differences between high and low confidence participants, with findings qualitatively illuminated. 24 CTFs attended focus groups from which we identified 28 curriculum items and 10 curriculum agendas. We collected 23 complete survey responses. All confidence groups rated communicating with colleagues and managing working life as unmet needs, whereas core clinical competencies such as history and examination were well met. Participants with low confidence identified more complex clinical competencies including clinical decision making, task prioritisation and end-of-life care as unmet needs, with decision making and prioritisation being the most important. Confident graduates rated higher professional competencies such as quality improvement, career planning and education as unmet needs but of low importance. Graded transition of responsibility was the highest ranked curriculum agenda. Qualitative insights included suggestions for how learning in clinical environments could be enhanced. Our findings suggest that transitioning from student to newly qualified doctor could be supported by graded entrustment and enhanced shadowing opportunities. Other recommendations include prioritising more complex clinical competencies, identifying wellbeing as part of preparedness for practice, equipping students to communicate with colleagues and aligning higher professional competencies with learners' needs.

Understanding junior doctors' experiences of teaching on the acute take: a qualitative study

BACKGROUND

New medical graduates are significantly unprepared to manage acutely unwell patients due to limited first-hand clinical exposure in the undergraduate curriculum. Supporting undergraduate learning in the acute setting can be challenging for junior doctors when balancing teaching and clinical responsibilities. Our aim was to explore junior doctors' first-hand experiences of supporting undergraduate education in the acute admissions environment(take).

METHODS

Fourteen junior doctors in one teaching hospital in South West England took part in semi-structured focus groups (4-6 participants in each) which were audio-recorded, transcribed, and thematically analysed.

RESULTS

Junior doctors described their educational role as comprising: teaching, demonstrating, coaching, and supervising. They perceived the acute take as a highly variable, unpredictable setting that offered a broad scope for learning. Tensions between doctors' clinical and educational roles were described, influenced by internal and external factors. Clinical work was prioritised over teaching and participants lacked confidence in supervisory and clinical skills. Doctors felt pressured to meet students' expectations and lacked understanding of their educational needs. Senior colleagues were highly influential in establishing an educational culture and were often a source of pressure to deliver timely clinical care. Organisations were perceived not to value teaching due to the lack of provision of dedicated teaching time and prioritisation of limited resources towards patient care. Participants managed tensions by attempting to formally separate roles, demoting students to passive observers, and they sought greater continuity in placements to better understand students' abilities and expectations.

CONCLUSIONS

Educational opportunities for undergraduate students on the acute take are varied and highly valuable. This study provides insight into the provision of workplace education and its challenges from junior doctors' perspectives. We highlight areas for improvement of relevance to educational providers.

Whole consultation simulation in undergraduate surgical education: a breast clinic case study

BACKGROUND

Safe and effective clinical outcomes (SECO) clinics enable medical students to integrate clinical knowledge and skills within simulated environments. This realistic format may better prepare students for clinical practice. We aimed to evaluate how simulated surgical clinics based on the SECO framework aligned with students' educational priorities in comparison with didactic tutorials.

METHODS

We delivered two breast surgery SECO-based simulated clinics to Year 3 students during their surgical attachments at a London teaching hospital. All students attended a didactic breast surgery tutorial the previous week. Pre- and post-session surveys and post-session debriefs were used to explore learning gain, processes, preferences and impacts on motivation to learn. Data were analysed using inductive thematic analysis to categorise student views into themes.

RESULTS

Seventeen students enrolled in the simulated clinics and debriefs. Students expressed that passing examinations was a key extrinsic motivating factor, although the SECO-based format appeared to shift their motivation for learning towards aspiring to be clinically competent. Self-reported confidence in clinical skills such as history taking and examination improved significantly. Active learning methods were valued. Students expressed a preference for simulated clinics to complement, but not replace, tutorial-based learning.

CONCLUSION

The SECO-based simulated clinic promoted a shift towards intrinsic motivation for learning by allowing students to recognise the importance of preparing for clinical practice in addition to passing examinations. Integration of surgical simulated clinics into the undergraduate curriculum could facilitate acquisition of clinical skills through active learning, a method highly valued by students.

The evolution of medical students' preparedness for clinical practice during the transition of graduation: a longitudinal study from the undergraduate to postgraduate periods

BACKGROUND

Graduating from medical school and beginning independent practice appears to be a major transition for medical students across the world. It is often reported that medical graduates are underprepared for independent practice. Most previous studies on undergraduates' preparedness are cross-sectional. This study aimed to characterize the development and trend of medical students' preparedness and its association with other objective and subjective indicators from the undergraduate to postgraduate periods.

METHODS

This was a prospective cohort study. The participants were recruited and followed from two years before graduation to the postgraduate period. The preparedness for independent practice, professional identity, and teamwork experience were biannually measured using previously validated questionnaires. The participants' basic demographic information, clinical learning marks from the last two years, and national board exam scores were also collected.

RESULTS

A total of 85 participants completed 403 measurements in the 5 sequential surveys. The mean age at recruitment was 23.6, and 58 % of participants were male. The overall total preparedness score gradually increased from 157.3 (SD=21.2) at the first measurement to 175.5 (SD=25.6) at the fifth measurement. The serial individual preparedness scores revealed both temporal differences within the same learner and individual differences across learners. Despite the variations, a clear, steady increase in the overall average score was observed. Participants were least prepared in the domain of patient management at first, but the score increased in the subsequent measurements. The participants with better final preparedness had better professional identity (p<0.01), better teamwork experience (p < 0.01), and higher average clinical rotation marks (p<0.05).

CONCLUSIONS

The preparedness for practice of medical students from the undergraduate to postgraduate periods is associated with their professional identity, teamwork experience, and objective clinical rotation endpoint. Although preparedness generally increases over time, educators must understand that there are temporal fluctuations and individual differences in learners' preparedness.

A foundation interim year 1 sequential simulation experience and analysis of preparedness to practice early

This project involved the implementation of a simulation session followed by interviews to assess and improve foundation interim year 1 (FiY1) preparedness. The session focused on the interpretation of investigations, clinical examinations, the implementation of management plans and appropriate escalation. Preparedness was measured quantitatively using Likert-type scales and qualitatively using interviews. Following the simulation, there was a significant increase in median preparedness for giving treatment (3 vs 4; p=0.04), paperwork (2 vs 4; p=0.03) and independent, responsible working (3 vs 4.5; p=0.03), before and after, respectively. Following the FiY1 period, participants demonstrated significant improvement in median preparedness for giving treatment (3 vs 4.5; p=0.01), paperwork (2 vs 5; p=0.01), independent, responsible working (3 vs 4.5; p=0.02), and communication and teamworking (4 vs 5; p=0.01), before and after, respectively. This simulation and the FiY1 period increased preparedness. This study suggests that future medical apprenticeships should provide the same opportunities and responsibilities as the FiY1 programme.

The Effectiveness of a Foundation Year 1 Doctor Preparation Course for Final Year Medical Students

BACKGROUND

Starting work as a junior doctor can be daunting for any medical student. There are numerous aspects of the hidden curriculum which many students fail to acquire during their training.

OBJECTIVES

To evaluate the effectiveness of a novel foundation year one (FY1) doctor preparation course focusing on certain core topics, practical tips and components of the hidden curriculum. The primary objective was to improve the confidence level and knowledge of final year medical students transitioning to FY1 doctors.

METHOD

A 2-day, practical course titled 'Preparation 2 Practice' delivering hands-on, small-group and lecture-based teaching, covering core medical student undergraduate curriculum topics in medicine and surgery. The course content spanned therapeutics, documentation skills and managing acute clinical tasks encountered by FY1 doctors during an on-call shift. A pre- and post-course survey and knowledge assessment were carried out to assess the effectiveness of the course. The assessment was MCQ-based, derived from topics covered within our course. The 20-question test and a short survey were administered electronically.

RESULTS

Twenty students from a single UK medical school attended the course. 100% participation was observed in the pre- and post-course test and survey. The median post-course test result was 22 (IQR 20.25-23.75) which was higher than the median pre-course test score of 18.75 (IQR 17-21.75). A Wilcoxon sign rank test revealed a statistically significant difference between the pre- and post-course test results (P = .0003). The self-reported confidence score of delegates on starting work as a junior doctor was also significantly higher following the course (P = .004).

CONCLUSION

The results show a significant improvement in perceived confidence and knowledge on core curriculum topics amongst final year medical students having attended our FY1 doctor preparation course. We conclude that there is scope for similar supplementary courses as an adjunct to the undergraduate medical curriculum.

Barriers to obtaining reliable results from evaluations of teaching quality in undergraduate medical education

BACKGROUND

Medical education is characterized by numerous features that are different from other higher education programmes, and evaluations of teaching quality are an integral part of medical education. Although scholars have made extensive efforts to enhance the quality of teaching, various issues unrelated to teaching that interfere with the accuracy of evaluation results remain. The purpose of this study is to identify the barriers that prevent objective and reliable results from being obtained during the evaluation process.

METHODS

This study used mixed methods (3 data sources) to collect opinions from different stakeholders. Based on purposive sampling, 16 experts familiar with teaching management and 12 s- and third-year students were invited to participate in interviews and discussions, respectively. Additionally, based on systematic random sampling, 74 teachers were invited to complete a questionnaire survey. All qualitative data were imported into NVivo software and analysed using thematic analysis in chronological order and based on grounded theory. Statistical analyses of the questionnaire results were conducted using SPSS software.

RESULTS

Sixty-nine valid questionnaires (93.24%) were recovered. A total of 29 open codes were extracted, and 14 axial codes were summarized and divided into four selective codes: evaluation preparation, the index system, the operation process, and the consequences of evaluation. The main barriers to obtaining reliable evaluation results included inadequate attention, unreasonable weighting, poor teaching facilities, an index without pertinence and appropriate descriptions, bad time-points, incomplete information on the system, lagged feedback, and disappointing result application. Almost all participants suggested lowering the weight of students as subjects, with a weight of 50-60% being appropriate. Students showed dissatisfaction with evaluation software, and the participants disagreed over the definition of good teaching and the management of student attendance.

CONCLUSIONS

This study reveals the difficulties and problems in current evaluations of teaching in medical education. Collecting data from multiple stakeholders helps in better understanding the evaluation process. Educators need to be aware of various issues that may affect the final results when designing the evaluation system and interpreting the results. More research on solutions to these problems and the development of a reasonable evaluation system is warranted.