Competence and confidence with basic procedural skills: the experience and opinions of fourth-year medical students at a single institution

Evaluation of the effectiveness of using flipped classroom in puncture skills teaching

BACKGROUND

The effectiveness of flipped classroom (FC) on puncture skills in medical education is still uncertain. This study aimed to assess the role of the FC model in puncture skills and investigate the acceptance and approval of FC among medical students and instructors.

METHODS

A mixed research approach of quasi-experimental research design and descriptive qualitative research was conducted in September 2022 for one month, using an FC teaching method that combined instructional videos and group learning. The study participants were 71 fifth-year medical students from two classes at a Chinese medical school and four instructors. The medical students were randomly divided into two groups: the traditional classroom (TC) group (Group A) and the FC group (Group B). For teaching, Group B used FC, and Group A used PowerPoint-based TC. The effectiveness of the two teaching models was assessed with Objective Structured Clinical Examination (OSCE), and questionnaires were distributed to the medical students and instructors after the assessment. Two independent sample t-tests were used to analyse the differences in demographic data and the OSCE scores of the two groups of medical students.

RESULTS

Group B scored higher in puncture skills than Group A, especially regarding abdominal puncture (p = 0.03), thoracentesis (p < 0.001), bone marrow puncture (p < 0.001) and average performance of puncture skills (p < 0.001). For lumbar puncture, no difference in skill scores was observed between groups A and B (p > 0.409). The medical students thought that the FC improved their self-learning ability and helped them acquire knowledge. Regarding the OSCE of their skills, most medical students thought that it was more innovative and objective than traditional examinations and that it was better for assessing their overall abilities. Both the FC and OSCE were supported by the medical students. The instructors were also satisfied with the students' performance in the FC and supported the teaching model, agreeing to continue using it.

CONCLUSIONS

This study shows that FC teaching that combines instructional videos and group learning is a reliable and well-received teaching method for puncture skills, which supplements and expands existing teaching methods in the medical field.

First-Person Point-of-View Instructional Video on Lumbar Puncture Procedure

OBJECTIVES

Tutorial videos filmed from a first-person point of view (FP-POV) are generally well received. Pediatric residents are expected to be competent in performing the lumbar puncture (LP). The educational effectiveness of a FP-POV in lumbar puncture procedure training for resident physicians has yet to be evaluated. We compared a FPPOV LP video with a standard in-person demonstration of the LP.

METHODS

We designed an assigned cohort study to compare a FP-POV procedural instructional video of a simulated pediatric LP to the standard in-person procedure demonstration.After the intervention, residents completed an LP observed by one of two blinded reviewers who assessed the procedure using a modified, published assessment tool.Participants completed preintervention and postintervention surveys to rate self-confidence and usefulness of the FP-POV educational method. The data was analyzed using a Wilcoxon Rank sum test. z Scores were calculated on the raw assessment scores.

RESULTS

Eighteen first year pediatric residents participated, nine in each group. The median modified assessment tool score was 17 in the FP-POV group (min, 14; max, 17; IQR:, 1.5) and 14 in the standard demonstration group (min, 6; max, 17; IQR, 4.5), with the higher score being more successful. There was a statistical difference between the assessment scores between the 2 groups (z score = 2.18, P = 0.04). Postintervention survey data demonstrated relative satisfaction with the FPPOV educational method.

CONCLUSIONS

This study supports the educational effectiveness of a FP-POV procedure tutorial.Future studies with a larger sample size are needed.

Pre-clerkship procedural training in venipuncture: a prospective cohort study on skills acquisition and durability

BACKGROUND

The effectiveness of simulation-based training for skill acquisition is widely recognized. However, the impact of simulation-based procedural training (SBPT) on pre-clerkship medical students and the retention of procedural skills learned through this modality are rarely investigated.

METHODS

A prospective cohort study was conducted among pre-clerkship medical students. Learners underwent SBPT in venipuncture in the skills laboratory. Assessments were conducted at two main points: 1) immediate assessment following the training and 2) delayed assessment one year after training. Learner self-assessments, independent assessor assessments for procedural competency, and communication skills assessments were conducted in both instances. The students were assessed for their competency in performing venipuncture by an independent assessor immediately following the training in the simulated setting and one-year post-training in the clinical setting, using the Integrated Procedural Protocol Instrument (IPPI). The student's communication skills were assessed by standardized patients (SP) and actual patients in the simulated and clinical settings, respectively, using the Communication Assessment Tool (CAT).

RESULTS

Fifty-five pre-clerkship medical students were recruited for the study. A significant increase was observed in self-confidence [mean: 2.89 SD (Standard Deviation) (0.69)] and self-perceived competency [mean: 2.42 SD (0.57)] in performing venipuncture, which further improved at the delayed assessment conducted in the clinical setting (p < 0.001). Similarly, the IPPI ratings showed an improvement [immediate assessment: mean: 2.25 SD (1.62); delayed assessment: mean: 2.78 SD (0.53); p < 0.01] in venipuncture skills when assessed by an independent assessor blinded to the study design. A significant difference (p < 0.01) was also observed in doctor-patient communication when evaluated by SPs [mean: 2.49 SD (0.57)] and patients [mean: 3.76 SD (0.74)].

CONCLUSION

Simulation-based venipuncture training enabled students to perform the procedure with confidence and technical accuracy. Improved rating scores received at a one-year interval denote the impact of clinical training on skills acquisition. The durability of skills learned via SBPT needs to be further investigated.

An assessment of the simulated performance of basic clinical procedures by junior doctors during the first year of clinical practice

BACKGROUND

Upon entering the healthcare system, junior doctors may lack the skills required to care for patients, and feel unprepared for their role, with considerable variation in the level of proficiency in the performance of particular clinical procedures.

OBJECTIVE

To compare the performance and proficiency (self-report and observed) of the performance of nine basic clinical procedures.

METHODS

Seventeen interns were observed performing nine clinical procedures in a simulated setting in June 2021 (Assessment 1) and January 2022 (Assessment 2). The observers identified whether each step in the procedure was performed correctly, and provided an overall assessment of proficiency. The participants also rated their own level proficiency.

RESULTS

At Assessment 1 the number of steps performed correctly ranged from a mean of 41.9-83.5%. At Assessment 2 the number of steps performed correctly ranged from a mean of 41.9-97.8%. The most common median proficiency rating for Assessment 1 was 'close supervision', and was 'indirect supervision' at Assessment 2. There was a significant and large effect size in the improvement in performance from Assessment 1 to Assessment 2. Low correlations were found between observer and self-reported proficiency in performance of the procedures.

CONCLUSIONS

The large improvement in performance across the two assessments is encouraging. However, there is a need to address the variability in performance on graduation from medical school, and to ensure that any assessment of proficiency is not only reliant on self-report.

Does the Degree Matter? MD and DO Students Who Match Into OB/GYN Report Different Experiences in US Undergraduate Medical Education

Background

Although allopathic (MD) and osteopathic (DO) students have similar curricular requirements, little is known about differences in MD and DO preparedness for obstetrics and gynecology (OB/GYN) residency.

Objective

To assess differences in experiences and confidence of MD vs DO students who matched to OB/GYN.

Methods

This cross-sectional survey study was open to all fourth-year medical students who matched to OB/GYN in the United States in April 2021. The survey included demographic data, clinical experiences, confidence (5-point sliding scale), and a 11-item knowledge test. Survey responses were compared to assess for disparities in experiences and confidence.

Results

Survey response rate was 72.0% (1057 of 1469) students matched to OB/GYN postgraduate year 1 positions. Of the 871 MD and 175 DO responding students, MDs were more likely to have clerkships ≥6 weeks (78.1% vs 15.4%; P<.001) and a home sub-internship (92.0% vs 53.4%; P<.001). DOs reported more hands-on experiences with procedures (MD median=35 [20-35] vs DO median=40 [25-65]; P=.002). There was no difference in self-reported confidence in knowledge, technical skills, or having a realistic sense of internship, and no difference in baseline knowledge test scores. DOs felt less confident about their medical school preparation (aOR 0.40; 95% CI 0.25-0.66; P<.001) and were more likely to perceive inequity of residency preparation (aOR 1.88; 95% CI 1.18-3.00; P=.002).

Conclusions

MD students matched to US OB/GYN residency programs reported longer clerkship and more home sub-internships, while DO students reported more hands-on experiences. Despite reporting similar confidence in knowledge and skills, DO students felt less prepared for internship.

Assessing Gender Differences in Technical Skills and Confidence in Orthopaedic Surgery Residency Applicants

INTRODUCTION

Variations in confidence for procedural skills have been demonstrated when comparing male and female medical students in surgical training. This study investigates whether differences in technical skill and self-reported confidence exist between male and female medical students applying to orthopaedic residency.

METHODS

All medical students (2017 to 2020) invited to interview at a single orthopaedic residency program were prospectively evaluated on their technical skills and self-reported confidence. Objective evaluation of technical skill included scores for a suturing task as evaluated by faculty graders. Self-reported confidence in technical skills was assessed before and after completing the assigned task. Scores for male and female students were compared by age, self-identified race/ethnicity, number of publications at the time of application, athletic background, and US Medical Licensing Examination Step 1 score.

RESULTS

Two hundred sixteen medical students were interviewed, of which 73% were male (n = 158). No gender differences were observed in suture task technical skill scores or mean difference in simultaneous visual task scores. The mean change from pre-task and post-task self-reported confidence scores was similar between sexes. Although female students trended toward lower post-task self-reported confidence scores compared with male students, this did not achieve statistical significance. Lower self-reported confidence was associated with a higher US Medical Licensing Examination score and with attending a private medical school.

DISCUSSION

No difference in technical skill or confidence was found between male and female applicants to a single orthopaedic surgery residency program. Female applicants trended toward self-reporting lower confidence than male applicants in post-task evaluations. Differences in confidence have been shown previously in surgical trainees, which may suggest that differences in skill and confidence may develop during residency training.

Development and assessment of a vaccine administration training course for medical students

BACKGROUND

Vaccine administration skills are very important for physicians, especially in the era of global pandemics. However, medical students have reported that practical sessions to develop these skills are insufficient. Therefore, the aim of our study was to develop a vaccination training course for medical students. We also examined its educational effectiveness.

METHODS

5th- and 6th-year medical students at the University of Tokyo were recruited to attend the vaccine administration training course in 2021. These students were our study participants. Our course consisted of an orientation part, which included a lecture on the indications, adverse events, and vaccination techniques of flu vaccines and practice on a simulator, and a main part in which the staff of the University of Tokyo Hospital were actually vaccinated. Before and after the main part of the course, study participants completed an online questionnaire that assessed their confidence in vaccine administration technique through a five-point Likert scale. We also surveyed their feedback about the course content and process. At the beginning and end of the main part, their technical competence in vaccination was assessed by two independent doctors. These doctors used a validated checklist scale (ranging from 16 to 80) and a global rating scale (ranging from 0 to 10). We used their mean scores for analysis. The quantitative data were analyzed through the Wilcoxon signed-rank test. For the qualitative data of the questionnaire, thematic analysis was conducted.

RESULTS

All 48 course participants participated in our study. Participants' confidence in vaccination technique (Z = -5.244, p < 0.05) and vaccination skill significantly improved (checklist rating: Z = -5.852, p < 0.05; global rating: Z = -5.868, p < 0.05). All participants rated the course as, "overall educational." Our thematic analysis identified four emerging themes: interest in medical procedures, efficacy of supervision and feedback, efficacy of "near-peer" learning, and very instructive course.

CONCLUSIONS

In our study, we developed a vaccine administration course for medical students, assessed their vaccination techniques and confidence in those techniques, and investigated their perceptions of the course. Students' vaccination skills and confidence improved significantly after the course, and they positively evaluated the course based on a variety of factors. Our course will be effective in educating medical students about vaccination techniques.

Volume, Distribution, and Inequities by Race and Gender of Clinical Experiences Reported by Medical Students Entering Obstetrics and Gynecology Residencies

OBJECTIVE

To assess for inequities by race and gender of fourth year medical students' (MS4s) self-reported clinical experience in obstetrics and gynecology (Ob/Gyn).

DESIGN

This was a voluntary, cross-sectional survey. Participants provided demographic data, information regarding their preparation for residency, and self-reported numbers of hands-on clinical experiences. Responses were compared across demographic categories to assess for disparity in pre-residency experiences.

SETTING

The survey was open to all MS4s matched to Ob/Gyn internships in the United States in 2021.

PARTICIPANTS

The survey was distributed primarily via social media. Eligibility was verified by participants supplying the names of their medical school of origin and their matched residency program prior to completing the survey. 1057/1469 (71.9%) MS4s entering Ob/Gyn residencies participated. Respondent characteristics were not different from nationally available data.

RESULTS

Median clinical experience numbers were calculated for hysterectomies (10; IQR 5-20), suturing opportunities (15; IQR 8-30), and vaginal deliveries (5.5; IQR 2-12). Non-White students had fewer hands-on experiences with hysterectomy, suturing, and cumulative clinical experiences when compared to White MS4s (p values <0.001). Female students had fewer hands-on experiences with hysterectomies (p < 0.04), vaginal delivery (p < 0.03), and cumulative experiences (p < 0.002) than male students. When assessed by quartiles, non-White students and female students were less likely to be in the top quartile for experience and more likely to be in the bottom quartile for experience than their White and male counterparts, respectively.

CONCLUSIONS

A significant number of medical students entering Ob/Gyn residency have minimal hands-on clinical experience with foundational procedures. Additionally, there are racial and gender disparities in clinical experiences of MS4s matching to Ob/Gyn internships. Future work should identify how biases in medical education may affect the access to clinical experience in medical school, and potential interventions to mitigate inequities in procedures and confidence prior to residency.

Delirium education and post-anaesthetics care unit nurses' knowledge on recognising and managing delirium in older patients

BACKGROUND

Postoperative delirium (POD) is a major complication following a surgical procedure. There is evidence that improving knowledge about POD could enhance POD care and patient outcomes.

AIM

The study aimed to evaluate whether the amount of delirium education among registered nurses working in post-anaesthetics care units (PACU) impacts on their self-reported confidence and competence in recognising and managing delirium as well as prior knowledge on factors that influence the risk of delirium onset for older people.

METHOD

The current study utilised an online survey on delirium care practice among registered nurses in PACUs. The survey consisted of 27 items. There were questions about confidence and competence in delirium care, knowledge about delirium risk factors, and ranked responses to two case scenario questions to evaluate the application of POD care. There were also demographic questions, including previous experience with delirium care education.

RESULTS

A total of 336 responses were generated from registered nurses working in PACU. Our findings found substantial variability among the respondents about their delirium care education. The amount of delirium education did not influence the PACU registered nurses' confidence or competence in delirium care. In addition, previous education did not have an impact on their knowledge about delirium risk factors.

DISCUSSION AND CONCLUSION

These findings suggested that the quantity of prior education about delirium did not improve the confidence, competence, knowledge, or case scenario questions of PACU registered nurses. Thus, delirium care education needs to be transformed to ensure it has a positive effect on delirium care clinical practice by registered nurses in PACU.

Practice Doesn't Make Perfect: Clinical Experience With Procedures Does Not Correlate Well With Competence in Third-Year Medical Students

OBJECTIVE

There is limited data available about factors which promote competence with procedures in medical students. Specifically, the relationship between procedural clinical experience and performance on an assessment is unclear. We sought to determine whether a correlation exists between the amount and type of clinical experience with a procedure and student performance on a standardized assessment of that procedure.

DESIGN

Faculty performed standardized assessments of third-year medical students on ten procedures using simulation. We prospectively surveyed students about 3 types of experience (performed, observed, and simulated) with these procedures during their clerkships. We then analyzed whether a correlation exists between student experience and their competency assessment scores using Pearson's correlation.

SETTING/PARTICIPANTS

Third-year medical students at the University of Kentucky College of Medicine.

RESULTS

In 2018 to 2019, 131 students were assessed on procedural competency with 10 failures. One hundred and twenty students (91.6%) completed the clinical experience survey. Correlations between types of experience and competency scores were small to moderate, with only 5 of 40 being significant. We found no correlation between experience having performed a procedure and competency score.

CONCLUSIONS

Overall, we did not find convincing evidence of a correlation between experience with procedures during clerkships and performance on a competency assessment. This suggests other factors may be contributing to procedural competence, which has implications for how educators should develop procedural competence in students.

Near-Peer Teaching in Conjunction with Flipped Classroom to Teach First-Year Medical Students Basic Surgical Skills

BACKGROUND

There is increasing evidence that students are completing medical school with insufficient surgical education. Near-peer tutoring and flipped classroom formatting may be used to enhance learning while simultaneously relieving faculty burden of teaching. Here, we qualitatively evaluate a 3-month course that integrates the use of near-peer teaching and flipped classroom formatting, with the goal of increasing first-year medical students' self-perceived confidence in performing basic sutures and knot-ties as well as interest in surgery.

METHODS

Twenty-one first-year medical students participated in a suturing and knot-tying course led by senior medical students. The course consisted of 2-h sessions held every 2 weeks for a total of five sessions. Students were sent publicly available videos prior to each session by which to learn the upcoming techniques and received live feedback from instructors during sessions. Questionnaires were completed pre-course and post-course.

RESULTS

Compared to pre-course ratings, post-course ratings of self-perceived confidence to perform various knot-ties and sutures all increased significantly (p < 0.05). All students stated that the course strengthened their desire to pursue a career in surgery. Student feedback of the course was overall positive.

CONCLUSIONS

Near-peer teaching can be used in conjunction with flipped classroom to increase first-year medical students' self-perceived confidence in surgical suturing and knot-tying as well as interest in surgery. This curriculum may serve as an outline for student-led courses at other institutions.

Extracurricular work experience and its association with training and confidence in emergency medicine procedures among medical students: a cross-sectional study from a Norwegian medical school

OBJECTIVE

Proficiency in basic emergency procedures is important for junior doctors, but the amount of practical exposure may vary. We studied the association between students' extracurricular healthcare-related (ECHR) work experience and self-reported practical training and confidence in selected emergency medicine procedures.

STUDY DESIGN

Cross-sectional study.

MATERIALS AND METHODS

Medical students and first-year graduates answered a Likert-based questionnaire probing self-reported amount of exposure to ('training amount') and confidence with selected emergency medicine procedures. Participants also reported ECHR work experience, year of study, previous healthcare-related education, military medic training and participation in the local student association for emergency medicine (Tromsø Acute Medicine Students' Association (TAMS)). Differences within variables were analysed with independent samples t-tests, and correlation between training amount and confidence was calculated. Analysis of covariance and mixed models were applied to study associations between training amount and confidence, and work experience (primary outcomes) and the other reported factors (secondary outcomes), respectively.

RESULTS

539 participants responded (70%). Among these, 81% had ECHR work experience. There was a strong correlation (r=0.878) between training amount and confidence. Work experience accounted for 5.9% and 3.5% of the total variance in training amount and confidence (primary outcomes), and respondents with work experience scored significantly higher than respondents without work experience. Year of study, previous education, military medic training and TAMS participation accounted for 49.3%, 8.7%, 6.8% and 23.6%, and 58.5%, 5.1%, 4.7% and 12.3% of the total variance in training amount and confidence, respectively (secondary outcomes). Cohen's D was 0.48 for training amount and 0.32 for confidence level, suggesting medium and weak medium-sized associations with work experience, respectively.

CONCLUSION

ECHR work experience is common among medical students and was associated with more training amount and higher confidence in the procedures. Year of study, previous relevant education and TAMS participation, but not military medic training, were also significantly associated with training amount and confidence.

Procedural Fundamentals for Medical Students: Institutional Outcomes of a Novel Multimodal Course

RATIONALE AND OBJECTIVES

There is a gap in current medical student education pertaining to procedural skills' exposure and acquisition. The aim of this study is to evaluate the institutional experience of a novel medical student procedural course and its impact on procedural confidence.

MATERIALS AND METHODS

This is a single-center prospective study performed at a public medical school and its associated tertiary care medical center between June 2020 and January 2021. This study was deemed exempt by our Institutional Review Board and was performed with participant consent. The multimodal course developed by the radiology department consisted of four didactic lectures, four simulation sessions, and a minimum of 16 clinical rotation hours with the department's vascular access team. Primary outcomes were assessed by comparing participant pre and post course surveys including twenty-five 5-point Likert scaled questions.

RESULTS

Twenty-five self-selected students completed the course in its entirety. The curriculum and the corresponding survey analysis were stratified into sections by procedure modality. An increase in participant confidence to a moderate or greater level was observed when comparing pre and post course survey data for each procedure: vascular access (4% vs 52%, p < 0.01), thoracentesis (8% vs 48%, p < 0.01), paracentesis (8% vs 72%, p < 0.01), lumbar puncture (4% vs 44%, p < 0.01), and bone marrow biopsy (0% vs 48%, p < 0.01).

CONCLUSIONS

The creation of a medical-student-centric procedural course is feasible and fills a potential gap in undergraduate medical education. This study demonstrated that a comprehensive multimodal course, designed to include didactic, simulation and clinical experiences, increases participant exposure to, participation with, and confidence in bedside procedural performance abilities.

Combining virtual reality and 3D-printed models to simulate patient-specific dental operative procedures-A study exploring student perceptions

INTRODUCTION

Students face a number of challenges in translating the skills acquired in pre-clinical simulation environments to the delivery of real patient care. These are particularly emphasised for complex operative procedures such as tooth preparations for indirect restorations. This paper reports student perceptions of a novel approach designed to improving student confidence when undertaking operative procedures on patients for the first time, by providing patient-specific simulation using virtual reality (VR) and 3D-printed models of the student's real clinical case.

MATERIALS AND METHODS

Students practised on patient-specific models, in the presence of a clinical tutor, firstly using VR simulation then with 3D-printed models in a clinical skills laboratory. The students then carried out the operative procedure on their patients, on the third occasion of practice. After providing the treatment for their patients, students attended a semi-structured interview to discuss their experiences. The qualitative data were analysed using two forms of inductive analysis.

RESULTS

Students most frequently cited: the value of the educator, increased confidence and efficiency during the clinical procedure, improved patient confidence and the complementary benefits of the two simulation modalities. Thematic analysis of participants' responses uncovered five key themes: The value of virtual reality dental simulators The value of clinical skills laboratory simulation with 3D-printed models The value of educator engagement The impact on the clinical procedure and the patient The VR and clinical skills laboratory balance CONCLUSION: This paper reports the early findings of an intervention that improves dental student confidence through the use of patient-specific VR exercises and 3D-printed models. These provided an incremental learning experience for an operative clinical procedure, prior to treatment of the live patient. Early results suggest this is a positive experience for the students, providing a valuable contribution to their confidence and preparedness.

Core procedural skills competencies and the maintenance of procedural skills for medical students: a Delphi study

BACKGROUND

It is well recognised that medical students need to acquire certain procedural skills during their medical training, however, agreement on the level and acquisition of competency to be achieved in these skills is under debate. Further, the maintenance of competency of procedural skills across medical curricula is often not considered. The purpose of this study was to identify core procedural skills competencies for Australian medical students and to establish the importance of the maintenance of such skills.

METHODS

A three-round, online Delphi method was used to identify consensus on competencies of procedural skills for graduating medical students in Australia. In Round 1, an initial structured questionnaire was developed using content identified from the literature. Respondents were thirty-six experts representing medical education and multidisciplinary clinicians involved with medical students undertaking procedural skills, invited to rate their agreement on the inclusion of teaching 74 procedural skills and 11 suggested additional procedures. In Round 2, experts re-appraised the importance of 85 skills and rated the importance of maintenance of competency (i.e., Not at all important to Extremely important). In Round 3, experts rated the level of maintenance of competence (i.e., Observer, Novice, Competent, Proficient) in 46 procedures achieving consensus.

RESULTS

Consensus, defined as > 80% agreement, was established with 46 procedural skills across ten categories: cardiovascular, diagnostic/measurement, gastrointestinal, injections/intravenous, ophthalmic/ENT, respiratory, surgical, trauma, women's health and urogenital procedures. The procedural skills that established consensus with the highest level of agreement included cardiopulmonary resuscitation, airway management, asepsis and surgical scrub, gown and gloving. The importance for medical students to demonstrate maintenance of competency in all procedural skills was assessed on the 6-point Likert scale with a mean of 5.03.

CONCLUSIONS

The findings from the Delphi study provide critical information about procedural skills for the Clinical Practice domain of Australian medical curricula. The inclusion of experts from medical faculty and clinicians enabled opportunities to capture a range of experience independent of medical speciality. These findings demonstrate the importance of maintenance of competency of procedural skills and provides the groundwork for further investigations into monitoring medical students' skills prior to graduation.

Using virtual reality in lumbar puncture training improves students learning experience

BACKGROUND

Lumbar puncture (LP) is a commonly performed medical procedure in a wide range of indications. Virtual reality (VR) provides a stimulating, safe and efficient learning environment. We report the design and the evaluation of a three dimensions (3D) video for LP training.

METHODS

We recorded a stereoscopic 180-degrees 3D video from two LPs performed in clinical settings in Fernand Widal Lariboisière University Hospital, Paris, France. The video was administered to third-year medical students as well as to a residents and attendings group during LP simulation-based training sessions.

RESULTS

On 168 participants (108 novice third-year medical students, and 60 residents and attendings with prior LP experience), satisfaction after video exposure was high (rated 4.7 ± 0.6 on a 5-point scale). No significant discomfort was reported (comfort score graded 4.5 ± 0.8 on 5). LP-naive students displayed higher satisfaction and perceived benefit than users with prior LP experience (overall, P < 0.05). Trainees evaluated favorably the 3D feature and supported the development of similar tutorials for other medical procedures (respectively, 3.9 ± 1.1 and 4.4 ± 0.9 on 5).

CONCLUSION

We report our experience with a 3D video for LP training. VR support could increase knowledge retention and skill acquisition in association to LP simulation training.

A Statewide Collaboration to Deliver and Evaluate a Pediatric Critical Care Simulation Curriculum for Emergency Medical Services

OBJECTIVE

Care of the critically ill child is a rare but stressful event for emergency medical services (EMS) providers. Simulation training can improve resuscitation care and prehospital outcomes but limited access to experts, simulation equipment, and cost have limited adoption by EMS systems. Our objective was to form a statewide collaboration to develop, deliver, and evaluate a pediatric critical care simulation curriculum for EMS providers.

METHODS

We describe a statewide collaboration between five academic centers to develop a simulation curriculum and deliver it to EMS providers. Cases were developed by the collaborating PEM faculty, reviewed by EMS regional directors, and based on previously published EMS curricula, a statewide needs assessment, and updated state EMS protocols. The simulation curriculum was comprised of 3 scenarios requiring recognition and acute management of critically ill infants and children. The curriculum was implemented through 5 separate education sessions, led by a faculty lead at each site, over a 6 month time period. We evaluated curriculum effectiveness with a prospective, interventional, single-arm educational study using pre-post assessment design to assess the impact on EMS provider knowledge and confidence. To assess the intervention effect on knowledge scores while accounting for nested data, we estimated a mixed effects generalized regression model with random effects for region and participant. We assessed for knowledge retention and self-reported practice change at 6 months post-curriculum. Qualitative analysis of participants' written responses immediately following the curriculum and at 6 month follow-up was performed using the framework method.

RESULTS

Overall, 78 emergency medical technicians (EMTs) and 109 paramedics participated in the curriculum over five separate sessions. Most participants were male (69%) and paramedics (58%). One third had over 15 years of clinical experience. In the regression analysis, mean pediatric knowledge scores increased by 9.8% (95% CI: 7.2%, 12.4%). Most (93% [95% CI: 87.2%, 96.5%]) participants reported improved confidence caring for pediatric patients. Though follow-up responses were limited, participants who completed follow up surveys reported they had used skills acquired during the curriculum in clinical practice.

CONCLUSION

Through statewide collaboration, we delivered a pediatric critical care simulation curriculum for EMS providers that impacted participant knowledge and confidence caring for pediatric patients. Follow-up data suggest that knowledge and skills obtained as part of the curriculum was translated into practice. This strategy could be used in future efforts to integrate simulation into EMS practice.

Start here- principles of effective undergraduate training

Obstetric and gynaecology undergraduate training is an intense time for learners as they encounter various health conditions related to women's health and also learn about pregnancy care and birth. The experience is directed to familiarise students with basic clinical management of gynaecological conditions, also develop communication and related core examination and procedural skills. Similarly, midwifery training encompasses independent care of low-risk pregnant women and assist in care of high-risk pregnancy in partnership with obstetricians. Although its necessary to acquaint most learners with core clinical skills in obstetrics and gynaecology, learning opportunities on patients can be limited, due to the intrusive nature of women's health examination. Simulation Based Education (SBE) can facilitate learning hands-on clinical examination and procedural skills, using realistic part-task and high-fidelity simulators prior to approaching patients. This can apply to both medical and midwifery undergraduate training, further creating opportunities for professional interaction and shared learning space to facilitate interprofessional education. IPE has been shown to improve professional relationships in practicing clinicians. This learning pedagogy can be applied in the undergraduate setting as well, to decrease risk of conflict and appreciate roles of other interprofessional staff in future clinical practice. In this chapter we highlight some challenges faced by medical and midwifery undergraduates in their learning from a global perspective. We also describe some teaching and learning initiatives that can be applicable across various settings of obstetrics, gynaecology medical undergraduate and midwifery teaching with relevant case studies to facilitate new graduates preparedness for practice.

A pre-clerkship simulation-based procedural skills curriculum: decreasing anxiety and improving confidence of procedural skill performance

INTRODUCTION

Pre-clerkship procedural skills training is not yet a standard across Canadian medical school curricula, resulting in limited exposure to procedures upon entering clerkship. While simulated skills training has been documented in the literature to improve performance in technical ability, anxiety and confidence have yet to be investigated despite their documented impact on performance and learning. This study therefore aims to evaluate the effect of pre-clerkship procedural skills training on medical student anxiety and confidence.

METHODS

A procedural skills training program was designed based on an evidence-based near-peer, flipped classroom model of education. Ninety-two second-year medical students volunteered for the study. Fifty-six were randomized to the training group, and 36 were randomized to the control group. Students in the training group attended seven procedural skills tutorials over seven months. The control group represented the average medical school student without standardized procedural training. Student anxiety and confidence were assessed at the beginning and end of the program using the State Trait Anxiety Inventory and Confidence Questionnaires.

RESULTS

Students who participated in the procedural skills program demonstrated greater reductions in their state anxiety and greater improvements in confidence compared to the control group.

CONCLUSION

Longitudinal procedural skills training in the simulation setting has demonstrated improvements in anxiety and confidence among pre-clerkship medical students. These added benefits to training have the potential to ease medical students' transition into clerkship, while also contributing to a safer and more effective clinical experience. Therefore, future integration of standardized pre-clerkship procedural skills training within medical school curricula should be considered.

A flipped classroom, same-level peer-assisted learning approach to clinical skill teaching for medical students

Background

Clinical procedural skills are vital components of medical education. Increased student intake and limited capacity of medical schools necessitate more efficient ways to deliver clinical skill teaching. This study employed a flipped classroom, peer-assisted learning approach to deliver clinical skill teaching. It aimed to determine the influence of pre-class demonstration video watching and in-class student-student interactions on clinical skill acquisition.

Methods

In 2017, a cohort of 205 medical students in their penultimate year of undergraduate medical study were recruited, and they learned bag mask ventilation and intravenous cannulation during this study. The participants watched a demonstration video before class, and then underwent self-directed practice as triads. Afterwards, each participant video-recorded their skill performance and completed post-class questionnaires. The videos were evaluated by two blinded assessors.

Results

A hundred and thirty-one participants (63.9%) completed the questionnaire. For bag mask ventilation, participants who claimed to have watched the corresponding demonstration video before class achieved higher performance scores (those who watched before class: 7.8 ± 1.0; those who did not: 6.3 ± 1.7; p < 0.01). For intravenous cannulation, while there is no significant difference in performance scores (those who watched before class: 14.3 ± 1.3; those who did not: 14.1 ± 1.4; p = 0.295), those who watched the video before class received less interventions from their peers during triad practice (those who watched before class: 2.9 ± 1.8; those who did not: 4.3 ± 2.9; p < 0.05). The questionnaire results showed that most participants preferred the new approach of clinical skill teaching and perceived it to be useful for skill acquisition.

Conclusion

The flipped classroom, same-level peer-assisted learning model is potentially an effective way to address the current challenges and improve the efficiency of clinical procedural skill teaching in medical schools.

Medical Student Comfort With Procedural Skills Performance Based on Elective Experience and Career Interest

Introduction

Despite increased efforts, studies suggest that exposure to procedural skills in undergraduate medical training is insufficient. As medical students have low self-reported competence in many skills, a significant concern is that medical students are underprepared for a clerkship. Furthermore, pre-clerkship electives selected based on student career interests can provide students with additional skills learning opportunities. The impact of career interest and elective choice on student comfort with procedural skills is unclear. This study examines the relationship between student procedural skills comfort, career interest, and elective choices.

Materials and methods

An evidence-based questionnaire was synthesized following a literature search using PubMed, Embase, and Google Scholar. Surveys were completed by second-year medical students. A Likert scale was used to evaluate students’ exposure, comfort, and motivation to learn common procedural skills. Descriptive, Pearson’s chi-square and Spearman’s rho correlation coefficient analyses were performed to evaluate the relationship between career interests, elective exposure, and procedural skills.

Results

Medical students (>60%) reported poor comfort levels for most skills, despite >80% of students displaying high motivation to learn. Elective choice impacted student comfort levels as students who completed electives in anesthesiology were more comfortable with performing intubation (23% vs 10%, p = 0.026) and IV insertion (38% vs 13%, p = 0.002). Those with surgical career interests were less comfortable performing Foley catheter insertion in males (7% vs 5%, p = 0.033) and in females (7% vs 5%, p = 0.008).

Conclusions

This study supports that medical students feel low levels of comfort with performing procedural skills despite high motivation for learning. Comfort was influenced by both career interest and elective experience. Programs aiming to increase students’ comfort levels in performing procedural skills should adapt curricula toward increasing early exposure to these skills.

Development of a pilot procedural skills training course for preclerkship medical students

OBJECTIVE

Despite procedural skills being recognized as an important component of medical school education, medical students are not confident in their ability to carry out a range of medical procedures. We conducted an institutional needs assessment and used the results to inform the creation of a procedure-based preclinical elective for first- and second-year students.

METHODS

We surveyed second-, third-, and fourth-year medical students at Alpert Medical School as well as select program directors to guide selection of a list of procedures to be taught in the elective. We then created an extracurricular 10-week procedural skills course for preclerkship medical students utilizing a hands-on, flipped classroom practice model.  Volunteer preceptors were recruited from the Department of Emergency Medicine to participate with a student-to-faculty ratio not exceeding 5:1. Knowledge and skill acquisition were assessed using a multiple-choice knowledge exam and 4-station practical exam, respectively. Pre- and post-course online surveys were used to assess self-perceived confidence for all procedures.

RESULTS

We implemented our procedural skills training course for first- and second-year medical students in the fall of 2015. Forty-four students applied for the first iteration of the course and 15 students were selected to participate. Fourteen students ultimately completed the elective as well as the subsequent course surveys, multiple-choice exam, and practical exam. Students who participated in the elective had increased levels of self-reported confidence at the conclusion of the elective and performed better on a practical exam and multiple-choice exam compared to students who participated in only the standard curriculum.

CONCLUSION

A longitudinal preclerkship procedural course early during medical school is a feasible method of teaching procedural skills to a cohort of learners. A number of adjustments could be made to the course in order to scale up and include a larger cohort of students at our own or another institution.

Can We Use Peer-Assisted Learning to Teach Basic Surgical Skills?

Background

It is reported that medical students do not receive adequate opportunities to learn surgical skill and are at risk of being unable to perform simple surgical procedures safely. The usefulness of peer-assisted learning (PAL) as a tool to assist in delivering surgical skills training is worth exploring.

Methods

This is a randomised single blinded controlled trial. Fourth-year students from the university’s Surgical Society were asked to volunteer as peer tutors and those in 3rd-year were asked to undertake surgical skills training. A cohort of 35 students were selected and randomised to receive basic surgical skills training conducted either by faculty members or peers. The students’ performance of basic suturing skills was assessed using a checklist, through directly observed procedural skills (DOPS) technique. The assessment was conducted by faculty blinded to the training. Students’ perception to surgical skills training was assessed using a questionnaire survey.

Results

The suturing and knotting skills of students learned from their peers was comparable to that acquired from faculty. The students’ perceived that their peers could conduct surgical skills training similar to their faculty.

Conclusion

PAL approach for basic surgical skills training is as effective as faculty-led training. PAL has the potential to optimise the delivery of surgical skills training in undergraduate medical education.

Predicting risk of underconfidence following maternity leave

OBJECTIVE

To determine what factors affect paediatric trainee confidence on return to work after maternity leave.

DESIGN

Information was collected anonymously via an online survey from trainees who had taken maternity leave.

SETTING

The survey was distributed centrally to each UK deanery.

MAIN OUTCOME MEASURES

Trainee confidence was rated retrospectively using self-assessment.

RESULTS

146 paediatric trainees from 12 out of 13 deaneries completed the survey. 96% of trainees experienced an initial lack of confidence, with 36% requiring 3 months or longer for their confidence to return. Prolonged lack of confidence was associated with longer time out of training, training stage, returning part-time, less frequent engagement with educational activities and lack of recognition by supervising consultant.

CONCLUSION

We propose a scoring system using the above risk factors, the MoTHER score (Months out, Training stage, Hours worked on return, Educational activities, Recognition by consultant), which can be used to identify trainees who are at higher probability of experiencing reduced confidence on return to work.

A 3D printed suturing trainer for medical students

BACKGROUND

Medical students must be able to suture competently upon graduation. To learn suturing technique, students must have access to practice materials. The purpose of this pilot study was to develop a novel suturing trainer and to evaluate its ability to provide realistic and accessible suturing practice. A cohort of senior students at one institution compared the device with standard suture-training media (porcine feet and sponges).

METHODS

Using 3D printing and silicone casting, a novel suturing trainer was developed and a cohort of senior medical students trialed the device in a standardised suturing workshop. Participants evaluated the novel suturing trainer, porcine feet and sponges for simulating human tissue with regard to: (i) tissue layers; (ii) tissue texture; (iii) ability to perform interrupted suturing; (iv) running subcuticular suturing; and (v) knot tying.

RESULTS

Compared with porcine feet and sponges, the suturing trainer had significantly higher mean scores (p < 0.001) for the simulation of human tissue layers and texture, as well as for the ability to facilitate the practice of interrupted suturing, running suturing and knot tying. All (n = 32) participants identified the silicone trainer as the best tool upon which to practice suturing, and 92% (n = 23) responded that their suturing skills would improve if the silicone trainer replaced porcine feet and sponges.

DISCUSSION

The silicone suturing device provides a more realistic and accessible suture learning experience than porcine feet and sponges. Further validation is required to assess its long-term effectiveness in medical education.

IM, Akram A. Evaluation of basic surgical skill workshop at undergraduate level in the discipline of surgery

OBJECTIVE

To evaluate the effectiveness of basic surgical skill workshop at under graduate level.

METHODS

This was randomized controlled study (cross-over design) conducted at Al-Nafees Medical College and hospital from 1st January to November 30th 2017. Undergraduate medical students of Year-5 MBBS were randomized into two groups to undergo surgical skills training. One was workshop or interventional Group-A, other was traditional teaching or control Group-B. Online random sampling calculator was used for randomization. Both groups were given a pretest and post-test in the form of two OSATS station.

RESULTS

Total 49 students were enrolled in the study; Group-A had 25 whereas Group-B had 24 students. There was significant difference (p=0.000) in mean post-test scores of Group-A (36.28±6.75) and Group-B (24.17±5.09) out of 53 on OSATS station-1. Significant statistical difference (p=0.000) in the mean score of post-tests of Group-A (26.08±18.34) and Group-B (14.42±9.24) out of 37 was also noted on OSATS station-2. There was no significant difference in mean pretest scores on both stations in both groups.

CONCLUSIONS

This study has suggestions in development of curriculum as it provides a quantitative substantiation indicating that workshop teaching as a learning strategy can essentially augment traditional teaching of technical skills to undergraduate medical students.

Surgery clerkship offers greater entrustment of medical students with supervised procedures than other clerkships

BACKGROUND

Medical student procedural participation is increasingly limited, creating concerns over poor preparation for internship. Inadequate experiences may also compromise patient safety. This study explores variances in procedural entrustment of medical students between core clerkships during the first clinical year.

METHODS

Students completing their first clinical year were surveyed on procedure participation. Holistic entrustment decisions are complex, thus participation was used as an objective proxy for entrustment.

RESULTS

138 students responded (66% response rate); 89% (123/138) wished they had performed more procedures. Students had higher participation rates during procedural clerkships (surgery, obstetrics/gynecology). Entrustment was highest during surgery, and lowest during pediatrics. Surgery gave statistically significantly higher entrustment for subcuticular suturing (compared to obstetrics/gynecology) and nasogastric tube removal (compared to internal medicine). Entrustment was generally inversely proportional to procedure complexity within each specialty.

CONCLUSIONS

Students encounter higher entrustment during procedural clerkships, especially surgery. Targeted areas for increased procedural involvement can be identified in all specialties.

Senior-Year Curriculum in U.S. Medical Schools: A Scoping Review

Phenomenon: Many U.S. medical schools have responded to the adoption of competency-based medical education (CBME) frameworks by renewing their final-year curricula and including internship preparatory courses. The purpose of this scoping review was to map the published literature regarding the final year to discern how medical schools have responded to this paradigm change. Approach: A structured 5-step approach was used to conduct this scoping review. Electronic searches of PubMed, ERIC, Scopus, MedEdPortal, and 8 medical education journals were conducted to identify relevant articles published from 2006 to 2016. Four authors screened articles for inclusion using standardized eligibility criteria; interrater agreement was discussed and calculated. Authors extracted data elements, and a consensus-based approach was used to categorize, sort, and structure information gathered. Findings: Among 6,485 articles retrieved, 817 articles were included in the study. From 2007-2011 to 2012-2016, articles addressing the final year of medical school increased 93%, whereas articles describing internship preparatory courses increased 218%. The majority of articles did not reference a CBME framework (572/817; 70%), the frequency of mentions increased 268% from 2007-2011 to 2012-2016. Nearly three fourths of preparatory course-related papers reference a CBME framework (37/50; 74%). Insights: Our findings may reflect a movement in U.S. medical schools toward using shared assessment metrics to support 4th-year medical students' preparation for their postgraduate medical education. Despite an increased reference to CBME, there is relatively little use of competency-based assessment frameworks to evaluate learning outcomes. This review also found a substantial increase in the frequency of articles referencing senior-year preparatory courses in U.S. medical schools. Articles tended to describe institution-specific research or experiences. Opportunities likely exist for multi-institutional and organizational collaboration in determining the structure of the final year of medical school.

Self-reported confidence and anxiety over endodontic procedures in undergraduate students-Quantitative and qualitative study

PURPOSE

The current literature shows a growing interest to assess the feelings and perceptions of students associated with the performance of elective endodontic procedures. This study aimed to evaluate the students' anxiety and self-perceptions related to performing such treatments.

METHODS

Forty-five students participated in the research (G1 = 22 beginners students; G2 = 23 senior students). Demographic data, STAI-State and Numerical Rating Scale (NRS) for pre-operative anxiety were completed before the appointment with patient. The STAI-Trait; NRS for post-operative anxiety; previous experiences in endodontics; and level of confidence in each stage of endodontic treatments were collected after appointment. Focal groups for qualitative data collection were performed on separate occasion.

RESULTS

Both groups showed higher scores in STAI-State than for STAI-Trait scale. G1 showed higher levels of anxiety in the pre-operative, compared with post-operative moment in the NRS scale. G2 reported feeling more confidence to insert intracanal medication and to restore teeth between appointments than G1. In both focus groups, participants reported insecurity in performing endodontic procedures due to difficulty in visualisation and to anatomic complexities. G1 reported that all the confidence they had was based in pre-clinical experience, and G2 mentioned concern about the end of graduation.

CONCLUSION

The participants' anxiety diminishes as they gain more experience in performing endodontic procedures. However, as they approach the end of the course anxiety levels increase. Greater availability of elective courses in endodontics could be a valuable alternative to provide students with more exposure to and experience with these procedures.

Introduction of an interprofessional gynaecology surgical skills workshop for undergraduate medical and nursing students

BACKGROUND

Medical and nursing students may feel under-prepared to perform basic surgical and gynaecology procedural skills. There also remains scope within undergraduate programs to integrate interprofessional education, and better prepare students for interprofessional collaboration to improve patient care.

AIMS

A simulation-based gynaecology surgical skills workshop program was introduced for undergraduate medical and nursing students. The aim of this study was to explore students' perceptions of a simulation-based interprofessional gynaecological skills program, using students' pre- and post-workshop confidence in taught skills reported in a post-workshop questionnaire as an outcome measure.

MATERIALS AND METHODS

One hundred and sixty undergraduate medical (n = 133) and nursing (n = 27) students attended the workshop program at a tertiary university in Melbourne, Australia. A survey was completed by all students immediately after the workshop, addressing students' perceptions of surgical education, the four skill-stations (gowning/gloving, suturing, intrauterine device insertion, and urethral catheterisation), and interprofessional education. A Wilcoxon signed-rank test was performed to compare students' pre- and post-workshop confidence scores.

RESULTS

Most medical and nursing students (86%) agreed their course should provide more structured surgical education. There was a statistically significant increase in post-workshop self-reported confidence scores for medical and nursing students in all four taught skills. Confidence in interprofessional behaviours also improved in both cohorts, but the improvement in nursing students did not reach statistical significance.

CONCLUSIONS

Simulation-based, interprofessional, gynaecological surgery skills workshops are practical and valuable additions to undergraduate medical and nursing curricula. Further research should explore long-term retention of procedural skills and changes in interprofessional attitudes in clinical practice.

Perceived Barriers to the Development of Technical Skill Proficiency in Surgical Clerkship

OBJECTIVE

Medical students are expected to achieve proficiency in a prescribed set of technical skills during surgical clerkship. However, available literature indicates students routinely report a lack of confidence and proficiency in these skills. Our study aims to identify barriers to technical skill development encountered by medical students during surgical clerkship with the goal of developing interventions to address these barriers.

DESIGN

Three hundred and forty two medical students were surveyed about their experience learning and performing technical skills during surgical clerkship. Students reported confidence in skill performance and subjective barriers to achieving competency using forced-choice and free-text responses. Multivariate regression models identified factors independently associated with specific barriers and more frequent technical skills performance.

SETTING

Main and satellite campuses of a Medical Council of Canada accredited Canadian academic medical center.

PARTICIPANTS

All third-year medical students.

RESULTS

A total of 253 students (74%) responded to the survey. Following surgical clerkship, the only technical skills participants felt confident performing independently were sterile technique (96%) and basic suturing (52%). Interest in a surgical career, observership experience, gender, and medical campus site were independently associated with the frequency of skill performance. With respect to developing technical proficiency, commonly cited barriers included lack of suitable cases for student participation (35.0%), time constraints (33.4%), and lack of opportunities provided by both consultants (29.1%) and residents (24.7%). Female gender was independently associated with decreased resident instruction, decreased confidence in skill performance, and fewer opportunities to perform requisite skills. Students at satellite campuses reported fewer barriers.

CONCLUSIONS

We identified (1) lack of suitable cases, (2) time constraints, and (3) failure to provide students opportunities as the most common barriers to technical skill proficiency. Female gender increased the perception of barriers, while there were fewer barriers perceived by students at satellite campuses. Skill-specific simulation training and other interventions may improve skill development in medical students given obstacles to developing proficiency in the clinical setting.

Self-Confidence in Endotracheal Intubation Among Pediatric Interns: Associations With Gender, Experience, and Performance

BACKGROUND AND OBJECTIVE

Supervisors' decisions regarding procedural readiness are influenced by resident confidence. Confidence is a valuable metric if we understand how it correlates with trainee characteristics and procedural competence. Our objective was to evaluate the relationship between self-reported confidence in endotracheal intubation (ETI) and pediatric interns' characteristics (gender, prior intubation experience) and performance (airway management knowledge, demonstrated skills on airway trainers).

METHODS

This was a secondary analysis of a randomized, controlled trial of an airway management curriculum. Gender and prior intubation experience were reported on a preparticipation questionnaire. Interns' performance was measured 1) using a 14-item knowledge-based assessment of airway management and 2) as time to successful intubation across 4 simulated intubation scenarios. After completing the curriculum and assessment, interns reported retrospective precurriculum and current postcurriculum confidence with ETI using a 10-point Likert scale.

RESULTS

Forty-nine interns participated, of whom 16 (33%) were male. Eleven (22%) had ≥1 previous successful intubation. Median [interquartile range] pre- and postcurriculum confidence scores were 3 [2, 5] and 6 [5, 8], respectively. Male interns reported higher precurriculum confidence than females (median difference: 2.0; 95% confidence interval: 0.1, 3.9); postcurriculum confidence among males was also higher but not statistically significant. There was no correlation between self-reported precurriculum confidence and prior experience. There was no correlation between pre- or postcurriculum self-reported confidence and performance on the knowledge-based assessment or time to successful intubation on airway trainers.

CONCLUSIONS

Male pediatric interns self-report higher initial confidence in ETI compared to females. Self-reported confidence did not correlate with prior experience, airway management knowledge, or intubation performance on airway trainers.

Opinion and Special Articles: Stress when performing the first lumbar puncture may compromise patient safety

OBJECTIVE

To quantify physician stress levels when performing lumbar puncture (LP) and explore operator stress effect on patient outcomes.

METHODS

This was a cross-sectional, multicenter study. Novices, intermediates, and experts in performing LP were recruited from 4 departments of neurology and emergency medicine. Stress was measured before and during performance of the LP using cognitive appraisal (CA), State-Trait Anxiety Inventory-Short (STAI-S) questionnaire, and the heart rate variability measure low frequency/high frequency index (LF/HF ratio). Patient-related outcomes were pain, confidence in the operator, and postdural puncture headache (PDPH).

RESULTS

Forty-six physicians were included in the study: 22 novices, 12 intermediates, and 12 experts. Novices had the highest stress level and experts the lowest measured by cognitive appraisal and STAI-S before and during LP performance (p < 0.001 for all comparisons). Novices had the highest sympathetic tonus indicated by the highest LF/HF ratio before (p = 0.004) and during (p = 0.056) LP performance. Physician stress level was not significantly related to patients' pain. However, there was a significant relationship between STAI-S during the procedure and patient confidence in the operator (regression coefficient = -0.034, p = 0.008). High physician heart rate during the procedure significantly increased the odds of PDPH (odds ratio = 1.17, p = 0.036).

CONCLUSION

Novice stress levels were high before and during performance of LP. Stress was significantly related to patient confidence in the operator and risk of PDPH. Simulation-based training should be considered to reduce novice residents' stress levels and increase patient safety.

Medical students' attitudes toward lumbar puncture-And how to change

OBJECTIVE

To survey medical students on the lumbar puncture (LP) procedure in terms of their existing knowledge, practical experience and attitudes, and to determine whether the completion of a single standardized seminar that includes practical training on phantoms can alter these parameters.

METHODS

The survey was completed by medical students undertaking the curricular neurology course. Students were asked to describe their practical experience in different bedside procedures, and document how they perceive LP in terms of their own knowledge, confidence and attitude. Students then participated in a newly designed 90-min seminar that included practical training on phantoms and placed special emphasis both on the patients' point of view during the procedure and the benefits of an atraumatic approach. All students who completed the seminar were required to complete the survey for a second time.

RESULTS

Among the 153 participants, LP was associated with the lowest baseline levels of experience and confidence compared to other bedside procedures. Attitudes, knowledge, and confidence related to the various aspects of LP all showed significant improvement after the seminar.

CONCLUSION

A single standardized LP seminar with simulation training alters medical students' attitudes toward LP through improving their level of knowledge and confidence. This may have important implications in doctors-to-be on their stance toward LP and resultant advice to future patients regarding this important procedure.

Comparison of knot-tying proficiency and knot characteristics for square and reversing half hitch alternating-post surgical knots in a simulated deep body cavity among notice medical students

BACKGROUND

Proficiency-based knot-tying curricula have been developed for square knots for medical students, but, to our knowledge, no such curriculum exists for the reverse half hitch alternating-post (RHAP) knot. We aimed to compare medical students' knot-tying proficiency, knot-tying self-confidence and final knot characteristics for RHAP and square knots in a simulated deep body cavity.

METHODS

We performed a within-subject prospective crossover study of novice medical students who received 30 minutes of training in tying both RHAP and square knots. Participant performance was assessed via a knot-tying checklist, and knot configuration, tensile strength, tightness (loop circumference) and mechanism of failure were also assessed. Participants' self-reported confidence in knot tying was captured.

RESULTS

Twenty-one students participated in the study. Mean scores on the knot-tying checklist were significantly higher for RHAP knots than for square knots (6.9 [standard deviation (SD) 2.1] v. 5.2 [SD 2.3], p < 0.01), and RHAP knots were significantly tighter than square knots (46.8 mm [SD 0.4 mm] v. 49.3 mm [SD 0.7 mm], p < 0.05). There were no differences between RHAP and square knots in correct knot configuration, breaking strength or mechanism of failure. Reverse half hitch alternating-post knots were easier to tie within a deep-body cavity, whereas square knots were easier to learn.

CONCLUSION

Novice medical students were more proficient in tying RHAP knots than square knots in a simulated deep body cavity. Students were able to construct RHAP knots more securely and reported increased confidence in tying RHAP knots at depth compared to square knots.

Development of a short and universal learning self-efficacy scale for clinical skills

Background

Learning self-efficacy, defined as learners’ confidence in their capability to learn specific subjects, is crucial for the enhancement of academic progress, because it is positively correlated with academic achievements and effective learning strategy use. In this study, we developed a universal scale called the Learning Self-Efficacy Scale (L-SES) for Clinical Skills for undergraduate medical students and validated it through item analysis and content validity index (CVI) calculation.

Design

The L-SES was developed based on the framework of Bloom’s taxonomy, and the questions were generated through expert consensus and CVI calculation. A pilot version of the L-SES was administered to 235 medical students attending a basic clinical skills course. The collected data were then examined through item analysis.

Results

The first draft of the L-SES comprised 15 questions. After expert consensus and CVI calculation, 3 questions were eliminated; hence, the pilot version comprised 12 questions. The CVI values of the 12 questions were between .88 and 1, indicating high content validity. Moreover, the item analysis indicated that the quality of L-SES reached the qualified threshold. The results showed that the L-SES scores were unaffected by gender (t = −0.049; 95% confidence interval [−.115, .109], p > .05).

Conclusion

The L-SES is a short, well-developed scale that can serve as a generic assessment tool for measuring medical students’ learning self-efficacy for clinical skills. Moreover, the L-SES is unaffected by gender differences. However, additional analyses in relevant educational settings are needed.

Self-confidence and clinical skills: the case of students who study medicine in English in a non-English speaking setting

BACKGROUND

An increasing number of international students has been enrolling in medical studies in the English language offered by the countries of Eastern Europe. Development of practical skills is likely more challenging when students learn in the English language, while their patients are non-English speaking persons.

AIMS

To evaluate self-perception of practical skills of medical students in the English language program.

METHODS

From December 2016 to December 2017, a total of 52 students from the Studies in English program of two universities in Serbia were included in the study. Data were obtained by a previously validated questionnaire.

RESULTS

Participants were most confident when measuring blood pressure, checking the arterial pulse, and taking history. Students were the least confident when placing urinary catheters, performing rectal examinations, and suturing wounds. Male students reported higher confidence in "Major interventions" compared to females (p = 0.004), and no difference between male and female students was found in the total skill score of "knowledge of Serbian language" (p = 0.339). Adjusted analysis showed that a higher grade point average remains associated with a more confident perception of one's practical skills (B 26.48, 95% confidence interval 8.98-43.98). Rasch analysis showed that because the scores were distributed around the mean value between "not confident at all" and "quite confident," the majority of students had similar perceptions of their skills.

CONCLUSION

Active supervision by teaching staff is also recommended in an attempt to rectify the lack of confidence at performing a range of clinical procedures which is present among international students.

Core versus specialty rotations do not affect students' surgical development

BACKGROUND

Research is scarce on how the diversity of surgical rotations affects students. We sought to assess the effect of core rotations compared to specialty rotations on students' development.

METHODS

Students were given a suturing workshop at the beginning of their surgical clerkship along with a questionnaire. They performed both a simple and a complex suturing task at the beginning and end of the 2-month clerkship. The students were divided into 2 groups based on their surgical rotations. Technical skill and exam scores were compared.

RESULTS

Thirty-eight students were included in the study. Objective scores increased for the simple task (14.2, standard deviation 4.5 vs 16.4, standard deviation 4.2, P = .04) and the complex task (12.9, standard deviation 5.3 vs 16.5, standard deviation 4.1, P < .01). Times decreased for the simple task (5.1, standard deviation 1.8 vs 4.1, standard deviation 1.3, min, P < .01) and the complex task (7.9, standard deviation 2.7 vs 6.3, standard deviation 1.5, min, P < .01). Using multivariate analysis, we found that reported hours in the operating room per week and previous hands-on experience affected proficiency of the simple suturing task only. Sixteen students had predominantly core surgical rotations. When compared to the 22 students with more specialty rotations, the only difference was gender (87.5% male vs 50.0% male, P = 0.02). There was no significant difference in the completion times (P = .96, .82), the objective scores (P = .06, .120), the written exam scores (P = .57), or the oral exam scores (P = .89).

CONCLUSION

In this small study, it was found that the type of students' rotations does not affect surgical skill or knowledge acquisition.

Long-Term Skills Retention Following a Randomized Prospective Trial on Adaptive Procedural Training

OBJECTIVE

Cumulative sum (CuSum) is a real-time proficiency-monitoring tool adapted for simulation-based training. This study's objective was to investigate long-term outcomes of a double blinded, randomized control trial conducted with medical students assessing CuSum-guided curriculum against volume-based standards. The trial found a nearly 20% reduction in practice time to reach proficiency using the CuSum curriculum but long-term effects of decreased practice volume on proficiency is unknown.

DESIGN

Prior participants completed a survey assessing confidence, exposure, and feedback at 12 to 18 months following trial completion. They underwent retention testing of suturing, intubation, and central venous catheter placement (CVC), which was video-recorded and assessed by an expert evaluator. Baseline characteristics among repeat subjects were compared using chi-squared tests. Retention and initial trial outcome were compared using paired parametric statistical methods.

SETTING

The study was conducted at a major tertiary care center and training hospital.

PARTICIPANTS

Medical students, which completed the initial randomized control trial were eligible for enrollment. A total of 30/46(65%) responded to the survey, whereas 33/46(72%) completed retention testing.

RESULTS

Average scores and decay in procedural tasks over time for suturing, intubation and CVC were 91.6% (-4.7%), 86.1% (-4.1%), and 76.2% (-14.8%), respectively. Compared to the control group, the CuSum group mean difference in retention evaluation scores was -5.6% (p = 0.12). Confidence was not associated with initial or retention testing performance in any procedural task. Higher confidence was associated with additional exposure to the procedural task in suturing and intubation (p = 0.03 and p = 0.02, respectively). For intubation, higher confidence was reported by participants who received positive feedback (p = 0.01), and those assigned to the volume-based training arm (p = 0.03).

CONCLUSION

CuSum-guided training was equivalent to conventional training for suturing, intubation, and CVC. These findings importantly suggest medical students can retain competency in invasive surgical tasks with modest decay in proficiency over time regardless of initial training method.

Early and prolonged opportunities to practice suturing increases medical student comfort with suturing during clerkships: Suturing during cadaver dissection

Medical students are expected to perform common procedures such as suturing on patients during their third-year clerkships. However, these experiences are often viewed by medical students as stressors rather than opportunities for learning. The source of this stress is the lack of instruction on common procedures prior to being asked to observe or perform the procedure on a patient. First-time exposures to procedures in stressful environments may result in decreased confidence in medical students and decrease the frequency with which they perform these procedures in the future. The authors sought to change this paradigm by: (1) introducing a suturing module to first-year medical students in the context of the anatomy dissection laboratory and (2) measuring its effects on student attitudes and behavior over the course of their third-year clerkships when they encounter patients. The authors found that early and prolonged introduction to suturing was associated with increased student confidence relative to suturing a patient. Participation in the suturing module was associated with increased student confidence in identifying suturing instruments (P < 0.001) and suturing patients (P = 0.013). Further it positively affected their behavior as demonstrated by increased performance of suturing events from students exposed to the suturing module. (P < 0.001) This study demonstrates that early and prolonged opportunities to practice a procedural skill in a low-stress environment increases student confidence during patient interactions and alters student behavior.

Out-of-hospital endotracheal intubation experience, confidence and confidence-associated factors among Northern Japanese emergency life-saving technicians: a population-based cross-sectional study

OBJECTIVE

Clinical procedural experience and confidence are both important when performing complex medical procedures. Since out-of-hospital endotracheal intubation (ETI) is a complex intervention, we sought to clarify clinical ETI experience among prehospital rescuers as well as their confidence in performing ETI and confidence-associated factors.

DESIGN

Population-based cross-sectional study conducted from January to September 2017.

SETTING

Northern Japan, including eight prefectures.

PARTICIPANTS

Emergency life-saving technicians (ELSTs) authorised to perform ETI.

OUTCOME MEASURES

Annual ETI exposure and confidence in performing ETI, according to a five-point Likert scale. To determine factors associated with ETI confidence, differences between confident ELSTs (those scoring 4 or 5 on the Likert scale) and non-confident ELSTs were evaluated.

RESULTS

Questionnaires were sent to 149 fire departments (FDs); 140 agreed to participate. Among the 2821 ELSTs working at responding FDs, 2620 returned the questionnaire (response rate, 92.9%); complete data sets were available for 2567 ELSTs (complete response rate, 91.0%). Of those 2567 respondents, 95.7% performed two or fewer ETI annually; 46.6% reported lack of confidence in performing ETI. Multivariable logistic regression analysis showed that years of clinical experience (adjusted OR (AOR) 1.09; 95% CI 1.05 to 1.13), annual ETI exposure (AOR 1.79; 95% CI 1.59 to 2.03) and the availability of ETI skill retention programmes including regular simulation training (AOR 1.31; 95% CI 1.02 to 1.68) and operating room training (AOR 1.44; 95% CI 1.14 to 1.83) were independently associated with confidence in performing ETI.

CONCLUSIONS

ETI is an uncommon event for most ELSTs, and nearly half of respondents did not have confidence in performing this procedure. Since confidence in ETI was independently associated with availability of regular simulation and operating room training, standardisation of ETI re-education that incorporates such methods may be useful for prehospital rescuers.

Instituting a Surgical Skills Competition Increases Technical Performance of Surgical Clerkship Students Over Time

INTRODUCTION

Surgical skills training varies greatly between institutions and is often left to students to approach independently. Although many studies have examined single interventions of skills training, no data currently exists about the implementation of surgical skills assessment as a component of the medical student surgical curriculum. We created a technical skills competition and evaluated its effect on student surgical skill development.

METHODS

Second-year medical students enrolled in the surgery clerkship voluntarily participated in a surgical skills competition consisting of knot tying, laparoscopic peg transfer, and laparoscopic pattern cut. Winning students were awarded dinner with the chair of surgery and a resident of their choice. Individual event times and combined times were recorded and compared for students who completed without disqualification. Disqualification included compromising cutting pattern, dropping a peg out of the field of vision, and incorrect knot tying technique. Timed performance was compared for 2 subsequent academic years using Mann-Whitney U test.

RESULTS

Overall, 175 students competed and 71 students met qualification criteria. When compared by academic year, 2015 to 2016 students (n = 34) performed better than 2014 to 2015 students (n = 37) in pattern cut (133s vs 167s, p = 0.040), peg transfer (66s vs 101s, p < 0.001), knot tying (28s vs 30s, p = 0.361), and combined time (232s vs 283s, p = 0.009). The best time for each academic year also improved (105s vs 110s). Fundamentals of Laparoscopic Surgery proficiency standards for examined tasks were achieved by 70% of winning students.

CONCLUSIONS

Implementation of an incentivized surgical skills competition improves student technical performance. Further research is needed regarding long-term benefits of surgical competitions for medical students.

Technology-enhanced surgical education: attitudes and perceptions of the endoscopic surgery community in Turkey

The education programme of surgery has unique problems. In this study, first, a literature review is conducted to cover the studies found in the literature reporting on the problems of surgical education. Additionally, a survey study is conducted with 31 participants, who are either currently enrolled in endoscopic surgery education programmes in Turkey or are experts in the field. Supportively semistructured individual interviews are also conducted with five participants. These data are collected to better understand the instructional methods being used, their problems and the participants’ preferred methods to be used. Additionally, the participants’ attitudes are also investigated regarding the use of new technologies to enhance the current education programmes. The results indicate that, in Turkey, surgical education programmes are still mostly offered in traditional ways while other educational methods are used in an extremely limited manner. In general, the authors emphasise that more research needs to be conducted to better understand the characteristics of the medical students and develop standards for surgical education programmes, educational tools specific for related surgical domains and guidelines for the curriculum integration. The results of this study aimed to guide the instructional system designers for the endoscopic surgery education programmes.

Competence, confidence and knowledge retention in undergraduate nursing students - A mixed method study

A primary goal of nursing programs is to ensure that graduates can successfully enter into professional practice. This paper examines the relationship between competence, confidence, and knowledge retention in undergraduate nursing students. The study involved a three test quantitative component as well as a qualitative component. The quantitative component comprised a pretest, posttest immediately following the intervention, posttest three month design. The intervention was comprised of an intensive one day advanced cardiac skills knowledge and simulation activity. The three tests measured competence, confidence, and knowledge retention. The results of the study demonstrated the intervention was effective in improving perceptions of competence and confidence both immediately and at a three month timeframe. Knowledge retention also was statistically significant at a three month timeframe. This study demonstrates the value of advanced knowledge and skill for undergraduate nursing students. Despite the policy enforced reality that participants were not able to use the knowledge and skill in clinical practice, the motivational benefit of the advanced knowledge had significant positive effects on participants.

Prioritization in medical school simulation curriculum development using survey tools and desirability function: a pilot experiment

BACKGROUND

In Italy, there is no framework of procedural skills that all medical students should be able to perform autonomously at graduation. The study aims at identifying (1) a set of essential procedural skills and (2) which abilities could be potentially taught with simulation. Desirability score was calculated for each procedure to determine the most effective manner to proceed with simulation curriculum development.

METHODS

A web poll was conducted at the School of Medicine in Novara, looking at the level of expected and self-perceived competency for common medical procedures. Three groups were enrolled: (1) faculty, (2) junior doctors in their first years of practice, and (3) recently graduated medical students. Level of importance of procedural skills for independent practice expressed by teachers, level of mastery self-perceived by learners (students and junior doctors) and suitability of simulation training for the given technical skills were measured. Desirability function was used to set priorities for future learning.

RESULTS

The overall mean expected level of competency for the procedural skills was 7.9/9. Mean level of self reported competency was 4.7/9 for junior doctors and 4.4/9 for recently graduated students. The highest priority skills according to the desirability function were urinary catheter placement, nasogastric tube insertion, and incision and drainage of superficial abscesses.

CONCLUSIONS

This study identifies those technical competencies thought by faculty to be important and assessed the junior doctors and recent graduates level of self-perceived confidence in performing these skills. The study also identifies the perceived utility of teaching these skills by simulation. The study prioritizes those skills that have a gap between expected and observed competency and are also thought to be amenable to teaching by simulation. This allows immediate priorities for simulation curriculum development in the most effective manner. This methodology may be useful to researchers in other centers to prioritize simulation training.

Are Graduating Pediatric Residents Prepared to Perform Infant Lumbar Punctures?: A Multi-Institutional Descriptive Study

OBJECTIVES

Few published studies describe graduating pediatric residents' procedural skills or success rates. This information would help guide supervisors' decisions about graduating residents' preparedness, training, and supervision needs. This study aimed to measure success rates for graduating pediatric residents performing infant lumbar puncture (LP) during the final months of their training and to describe their experiences performing and supervising infant LPs during the course of their training.

METHODS

This survey-based study was conducted at 10 academic medical institutions in 2013. The survey consisted of 4 domains: (1) demographics, (2) exposure to infant LP training as an intern, (3) number of LPs performed and supervised during residency, and (4) specific information on the most recent clinical infant LP.

RESULTS

One hundred ninety-eight (82%) of 242 eligible graduating residents responded to the survey. A 54% success rate was noted for graduating residents when they were the first provider performing the infant LPs. Success rates were 24% if they were not the first provider to attempt the LP. Overall, graduating residents were supervised on 29% of their LPs, used anesthesia for 29%, and used the early stylet removal technique for 63%. The graduating residents performed a median of 12 infant LPs and supervised others on a median of 5 infant LPs throughout their residency. The vast majority reported feeling confident and prepared to perform this procedure.

CONCLUSIONS

At the end of residency, graduating pediatric residents were rarely supervised and had low infant LP success rates despite confidence in their skills. However, graduating residents frequently supervised others performing this procedure.

A Qualitative Analysis of Attending Physicians' Use of Shared Decision-Making: Implications for Resident Education

BACKGROUND

Physicians need to rapidly and effectively facilitate patient-centered, shared decision-making (SDM) conversations, but little is known about how residents or attending physicians acquire this skill.

OBJECTIVE

We explored emergency medicine (EM) attending physicians' use of SDM in the context of their experience as former residents and current educators and assessed the implications of these findings on learning opportunities for residents.

METHODS

We used semistructured interviews with a purposeful sample of EM physicians. Interviews were transcribed verbatim, and 3 research team members performed iterative, open coding of transcripts, building a provisional codebook as work progressed. We analyzed the data with a focus on participants' acquisition and use of skills required for SDM and their use of SDM in the context of resident education.

RESULTS

Fifteen EM physicians from academic and community practices were interviewed. All reported using SDM techniques to some degree. Multiple themes noted had negative implications for resident acquisition of this skill: (1) the complex relationships among patients, residents, and attending physicians; (2) residents' skill levels; (3) the setting of busy emergency departments; and (4) individual attending factors. One theme was noted to facilitate resident education: the changing culture-with a cultural shift toward patient-centered care.

CONCLUSIONS

A constellation of factors may diminish opportunities for residents to acquire and practice SDM skills. Further research should explore residents' perspectives, address the modifiable obstacles identified, and examine whether these issues generalize to other specialties.

Optimizing Residents' Performance of Lumbar Puncture: An RCT Comparing the Effect of Preparatory Interventions on Performance and Self-Confidence

BACKGROUND

Lumbar puncture is often associated with uncertainty and limited experience on the part of residents; therefore, preparatory interventions can be essential. There is growing interest in the potential benefit of videos over written text. However, little attention has been given to whether the design of the videos impacts on subsequent performance.

OBJECTIVE

To investigate the effect of different preparatory interventions on learner performance and self-confidence regarding lumbar puncture (LP).

DESIGN

Randomized controlled trial in which participants were randomly assigned to one of three interventions as preparation for performing lumbar puncture: 1) goal- and learner-centered video (GLV) presenting procedure-specific process goals and learner-centered information; 2) traditional video (TV) providing expert-driven content, but no process goals; and 3) written text (WT) with illustrations.

PARTICIPANTS AND MAIN MEASURES

Participants were PGY-1 doctors without LP experience. After the preparatory intervention, participants performed an LP in a simulated setting with a standardized patient and an assistant. Two content experts, blinded to participant group allocation, assessed video recordings of the performance using the Lumbar Puncture Assessment Tool (LumPAT) and an overall global rating. Participants rated their self-confidence immediately prior to performing the procedure. The primary outcome was the difference in LumPAT scores among groups.

KEY RESULTS

A total of 110 PGY-1 doctors were included. Results demonstrated significant differences in LumPAT mean scores among the three groups: GLV, 42.8; TV, 40.6; WT, 38.1 (p = 0.01). The global rating scores were highest in the GLV group (p = 0.026). Self-confidence scores differed significantly among the three groups (p = 0.003), with the TV group scoring the highest. There were no significant correlations between self-confidence scores and performance scores in any of the groups.

CONCLUSION

A video designed with procedure-specific process goals and learner-centered information resulted in better subsequent LP performance than a traditionally designed video or written text. Participants' self-confidence was not predictive of their actual performance.