Learn, see, practice, prove, do, maintain: an evidence-based pedagogical framework for procedural skill training in medicine

Curated collections for educators: Six key papers on teaching procedural skills

BACKGROUND

Competence in teaching procedural skills is required for faculty in all specialties. Regardless of involvement in undergraduate medical education (UME) versus graduate medical education (GME), faculty will likely be involved in teaching procedures to novice learners at some point, with the goal of having the learner achieve graduated independence and technical competence in a skill set. A large body of literature exists addressing the best practices for teaching and maintaining procedural skills. We searched for articles that describe the best practices for teaching procedural skills to all levels of learners.

METHODS

We conducted a literature search for papers on procedural skills training and teaching. We also made a call for papers on social media from members of the online #MedEd and #FOAMed communities. Once a list of the articles was compiled, we conducted a three-round modified Delphi process to identify those illustrating best practices for teaching procedural skills by both junior and senior faculty.

RESULTS

We identified 98 relevant articles on the topic of procedural skills training. Six articles were deemed to be highly relevant after three rounds of the modified Delphi. Best practices included using an established educational framework when designing procedural skills teaching sessions, providing positive feedback to learners with opportunities for improvement, and demonstrating the procedure to the learners.

CONCLUSIONS

Medical educators should employ evidence-based practices when designing and delivering procedural skills sessions. Educational frameworks provide faculty developers and facilitators with an organized approach to teaching these sessions. Maintenance of procedural skills over time is key; faculty can utilize simulation-based procedural training and deliberate practice to prevent decay of learned skills.

Mastery learning improves simulated central venous catheter insertion by emergency medicine teaching faculty

OBJECTIVES

Routine competency assessments of procedure skills, such as central venous catheter (CVC) insertion, do not occur beyond residency training. Evidence suggests variable, suboptimal attending physician procedure skills. Our study aimed to assess CVC insertion skill by academic emergency physicians, determine whether a simulation-based mastery learning (SBML) intervention improves performance and investigate for variables that predict competence.

METHODS

This is a pretest-posttest study that evaluated simulated CVC insertion by emergency medicine (EM) faculty physicians. We assessed 44 volunteer participants at a large academic medical center over a 1-month period using a published 29-item checklist. Our primary outcome was the difference in assessment score before and after a SBML intervention. A secondary analysis evaluated predictors of pretest performance.

RESULTS

A total of 44 subjects participated. Only four of 44 (9.1%) of subjects met a predefined minimum passing score on pretest. Mean assessment scores increased by 21.5% following the SBML intervention (95% confidence interval [CI] of the difference = 18.1% to 24.8%, p < 0.001). In a regression model, pretest scores increased by 10.8% (95% CI = 2.9 to 18.7%, p = 0.009) if subjects completed postgraduate training within 5 years. Frequency of CVC insertion did not predict performance, but 25 of 44 (56.8%) faculty members had no documented performance or supervision of a CVC insertion within 1 year of assessment.

CONCLUSIONS

SBML is a promising method to assess and improve CVC insertion performance by EM faculty physicians. Recent completion of postgraduate training was a significant predictor of CVC insertion performance. Our results require validation in larger cohorts of EM physicians across other academic institutions.

Learner-centered education: ICU residents' expectations of teaching style and supervision level

BACKGROUND

If the education of intensive care unit (ICU) residents focuses on individual learning behavior, the faculty's style of teaching and level of supervision need to be adapted accordingly. The aim of this study was to delineate the associations between residents' perceived learning behavior, experience, and demographics and their expectations with regard to teaching style and supervision levels.

METHODS

This multicenter survey obtained data on ICU residents' base specialty, duration of ICU training, individual postgraduate year, gender, and number of repetitions of ICU skills. Using 4-point Likert scales, residents assessed perceived learning behavior, expected teaching style, and supervision level for respective skills. Multivariate regression analysis was used to evaluate associations between assessed variables.

RESULTS

Among 109 residents of four interdisciplinary ICUs, 63 (58%) participated in the survey and 95% (60/63) questionnaires were completed. The residents' perceived learning behavior was associated with number of skill repetitions (p < 0.0001), internal medicine as base specialty (p = 0.02), and skill type (p < 0.0001). Their expected teaching style was associated with learning behavior (p < 0.0001) and skill type (p < 0.0001). Their expected supervision level was associated with skill repetitions (p < 0.0001) and skill type (p < 0.0001).

CONCLUSION

For effective learner-centered education, it appears useful to recognize how the residents' learning behavior is affected by the number of skill repetitions and the skill type. Hence, faculty may wish to take into account the residents' learning behavior, driven mainly by skill complexity and the number of skill repetitions, to deliver the appropriate teaching style and supervision level.

Use of Hand-motion Analysis to Assess Competence and Skill Decay for Cardiac and Lung Point-of-care Ultrasound

OBJECTIVES

Assessment of competence in technical skills, including point-of-care ultrasound (POCUS), is required before a novice can safely perform the skill independently. Ongoing assessment of competence is also required because technical skills degrade over time, especially when they are infrequently performed or complex. Hand-motion analysis (HMA) is an objective assessment tool that has been used to evaluate competency in many technical skills. The purpose of this study was to demonstrate the feasibility and validity of HMA as an assessment tool for competence in both simple and complex technical skills as well as skill degradation over time.

METHODS

This prospective cohort study included 36 paramedics with no POCUS experience and six physicians who were fellowship trained in POCUS. The novices completed a 4-hour didactic and hands-on training program for cardiac and lung POCUS. HMA measurements, objective structured clinical examinations (OSCE), and written examinations were collected for novices immediately before and after training as well as 2 and 4 months after training. Expert HMA metrics were also recorded.

RESULTS

Expert HMA metrics for cardiac and lung POCUS were significantly better than those of novices. After completion of the training program, the novices improved significantly in all HMA metrics, knowledge test scores, and OSCE scores. Novices showed skill degradation in cardiac POCUS based on HMA metrics and OSCE scores while lung POCUS image acquisition skills were preserved. Novices deemed competent by OSCE score performed significantly better in HMA metrics than those not deemed competent.

CONCLUSION

We have demonstrated that HMA is a feasible and valid tool for assessment of competence in technical skills and can also evaluate skill degradation over time. Skill degradation appears more apparent in complex skills, such as cardiac POCUS. HMA may provide a more efficient and reliable assessment of technical skills, including POCUS, when compared to traditional assessment tools.

Experience Level Influences Users' Interactions With and Expectations For Online Surgical Videos: A Mixed-Methods Study

PURPOSE

Upper-extremity surgeons and trainees widely use online surgical videos, and the use of these videos can assist with procedural learning. The purpose of this study was to characterize online video use and understand the role videos play in the learning process of orthopedic residents and practicing surgeons. We hypothesized that the use of surgical videos and video content desired among orthopedic learners differs based on their experience level.

METHODS

Four focus groups were conducted to discuss online surgical videos and their role in the learning process of orthopedic learners. Participants were separated based on their experience level. Three reviewers qualitatively analyzed the transcripts of the focus groups using constant comparative methods to identify overarching themes and categories. Findings regarding the participants' desires for video content and production quality were translated into a survey. The survey results were analyzed to assess their associations with experience level.

RESULTS

The focus group analysis helped identify 4 overarching themes that reflected users' interactions with videos: prewatching experience, choosing a video, video use, and video design, with the users' comments differing based on their experience level. The survey results showed that the median ideal length for a video was 10 minutes and that all users, regardless of their experience level, ranked showing the surgical procedure as the most important part of a video. Junior residents more frequently desired background information and a written outline of surgical steps, whereas more senior learners placed greater emphasis on advanced surgical decision-making and the use of particular implants/devices.

CONCLUSIONS

Experience level influences users' interactions with videos, including how they are chosen and used, and their expectations in terms of content and production.

CLINICAL RELEVANCE

Video creators should specify their targeted audience's experience level and adjust content to meet users' needs. Our results can provide video creators and hosts a checklist for appropriate content and production standards.

Development of a Rigorously Designed Procedural Checklist for Assessment of Emergency Medicine Resident Performance of Temporary Transvenous Cardiac Pacing

OBJECTIVES

Temporary transvenous cardiac pacing (TVP) is a potentially lifesaving intervention included in the list of essential core procedures for emergency medicine (EM) training; however, opportunities to perform TVP during residency cannot be guaranteed. EM graduates report feeling subjectively underprepared for this procedure, but objective performance data are lacking. Checklist-based simulated assessment is an increasing focus of competency-based medical education, particularly for invasive procedures like TVP. The objectives of this paper were as follows: first, to enlist a multidisciplinary team of experts to create an assessment tool for TVP using best practices in checklist development; second, to determine the reliability of checklist scoring; and third, to assess EM residents' baseline ability to perform TVP using a dedicated task trainer.

METHODS

This study was conducted at a single 4-year EM residency. A panel of emergency physicians and cardiologists designed a TVP checklist using a modified Delphi approach. After consensus was achieved on a final checklist, EM residents were assessed using a dedicated TVP task trainer. Inter-rater reliability was determined using Cohen's kappa coefficient. Resident performance was determined by number of correctly performed checklist items.

RESULTS

The expert panel achieved consensus on a 30-item checklist after three rounds of revisions. The Cohen's kappa coefficient for the overall checklist score was 0.87, with individual checklist items ranging from 0.63 to 1.00. In total, 58 residents were assessed with a mean score of 13.5 of 30 checklist items. Scores increased with each year of training.

CONCLUSIONS

This study details the rigorous development of a TVP checklist designed by a multidisciplinary team of experts. Checklist scores demonstrated strong inter-rater reliability. The overall poor performance of this cohort suggests the current approach to TVP training does not provide sufficient preparation for EM residents. Competency-based techniques, such as simulation-based mastery learning, should be explored.

The Key Parts of Hip Arthroscopy for Femoroacetabular Impingement Syndrome: Implications for the Learning Curve

Background:

Hip arthroscopy is a rapidly growing surgical approach to treat femoroacetabular impingement (FAI) syndrome with a significant learning curve pertaining to complication risk, reoperation rate, and total hip arthroplasty conversion. Hip arthroscopy is more frequently being taught in residency and fellowship training. The key, or critical, parts of the technique have not yet been defined.

Purpose:

To identify the key components required to perform arthroscopic treatment of FAI syndrome.

Study Design:

Consensus statement.

Methods:

A 3-question survey comprising questions on hip arthroscopy for FAI was sent to a convenience sample of 101 high-volume arthroscopic hip surgeons in the United States. Surgeon career length (years) and maintenance volume (cases per year) were queried. Hip arthroscopy was divided into 10 steps using a Delphi technique to achieve a convergence of expert opinion. A step was considered “key” if it could (1) avoid complications, (2) reduce risk of revision arthroscopy, (3) reduce risk of total hip arthroplasty conversion, or (4) optimize patient-reported outcomes. Based on previous literature, steps with >90% of participants were defined as key. Descriptive and correlation statistics were calculated.

Results:

A total of 64 surgeons (63% response rate) reported 5.6 ± 2.1 steps as key (median, 6; range, 1-9). Most surgeons (56.3%) had been performing hip arthroscopy for >5 years. Most surgeons (71.9%) had performed >100 hip arthroscopy procedures per year. Labral treatment (97% agreement) and cam correction (91% agreement) were the 2 key steps of hip arthroscopy for FAI. Pincer/subspine correction (86% agreement), dynamic examination before capsular closure (63% agreement), and capsular management/closure (63% agreement) were selected by a majority of respondents but did not meet the study definition of key. There was no significant correlation between surgeon experience and designation of certain steps as key.

Conclusion:

Based on a Delphi technique and expert opinion survey of high-volume surgeons, labral treatment and cam correction are the 2 key parts of hip arthroscopy for FAI syndrome.

Engaging Future Healthcare Professionals as Caregivers to Hospice Patients in Comfort Care Homes

Most people wish to die at home yet significant barriers exist in accessing care in one's home, especially for individuals with caregiver and/or housing instability. Across the U.S., residential homes for the dying are opening to address gaps in end-of-life care by recruiting community members to serve as caregivers to hospice patients during their final days. This paper describes a blended-experiential training program, informed by both an evidence-based educational framework and transformative learning theory, that trains undergraduate students to serve as surrogate family members to hospice patients in residential care homes. This study analyzed data from a sample of undergraduate students (n = 35) who participated in an 8-week program. Applying Kirkpatrick's evaluation model, study results indicate the program provided essential knowledge and skills in end-of-life care, benefiting both student learning outcomes and resident care.

Cadaveric Simulation Training Improves Residents' Knowledge and Confidence in Performing Fluoroscopic Guided Joint Injections

RATIONALE AND OBJECTIVE

Simulation training has been strongly encouraged to enhance radiology trainees' procedural competency. We aimed to assess whether a cadaveric simulation training session was effective in improving radiology residents' subjective technical ability, knowledge and confidence in performing fluoroscopic-guided joint injections.

METHODS

As part of the residency program's procedural training curriculum, first year radiology resident participated in a cadaveric, musculoskeletal injection training session including a didactic lecture followed by a practical hands-on component. Trainees performed fluoroscopic guided hip and shoulder injections on fresh cadavers, supervised by two fellowship-trained musculoskeletal radiologists. Trainees' knowledge on indications, contraindications, preprocedural care, complications, and technical ability in performing the procedures, as well as their rating of overall session experience were evaluated with pre- and post-session questionnaires (5 point Likert-scale). The mean residents' scores for pre- and post-session questionnaire items were calculated and compared using paired t-test. The magnitude of difference between mean pre- and post-session scores was compared between the items using analysis of variance.

RESULTS

Results Over a 5-year period, 27 trainees participated in the joint injection simulation session. The mean pre- and post-session scores were significantly higher in the post session questionnaire for all five items pertaining to knowledge of indications, contraindications, preprocedural care, complications, and technical ability (all p < 0.0001). The magnitude of improvement was not different between the items (p = 0.45). Most of the participants rated the training facilities, contents, hands-on experience, teaching quality, and session organization as very good or excellent.

CONCLUSIONS

Cadaveric joint injection simulation training significantly improved trainees' subjective knowledge, confidence, and technical ability in performing joint injections.

Early procedural training increases anesthesiology residents' clinical production: a comparative pre-post study of the payoff in clinical training

BACKGROUND

Competency-based education has been shown to enhance clinical skills, improve patient care, and reduce number of complications resulting in a better return on investments. Residents constitute an important workforce at many hospitals. Yet, the effect of training on residents' contribution to production in patient care is scarcely studied. This study evaluated the effects of early competency-based procedural training on residents' contribution to patient care in central venous catheterization and spinal and epidural anesthesia.

METHODS

The design was a non-randomized cohort study of first-year anesthesiology residents. The intervention group received additional early focused skills training while three control groups received traditional competency-based education. The residents' contributions to patient care were compared between the intervention group (n = 20), a historical control group (n = 19), and between a contemporary control group (n = 7) and a historical control group (n = 7) from different departments. The residents' vs specialists' procedural production share was compared between years within each study group. We calculated specialist time saved compared to the time spent providing additional skills training in the intervention group.

RESULTS

We found statistically significant increases in residents' vs specialists' share of total production after the intervention for epidural anesthesia: 2015: 0.51 (0.23, 0.70) to 2017: 0.94 (0.78, 1.05), p = 0.011 and central venous catheterization: 2015: 0.30 (0.23, 0.36) to 2016: 0.46 (0.35, 0.55), p = .008; and to 2017: 0.64 (0.50, 0.79), p = 0.008. Comparison between residents and specialists on production of the three procedures before and after the intervention showed a surplus of 21 h of freed specialist time per year.

CONCLUSIONS

Early procedural training results in more productive residents and freed specialist time for additional supervision, other clinical tasks or research. This provides empirical support for a positive correlation between early focused training and increased independent production among residents.

See One, Do One, Forget One: Early Skill Decay After Paracentesis Training

INTRODUCTION

Internal medicine residents perform paracentesis, but programs lack standard methods for assessing competence or maintenance of competence and instead rely on number of procedures completed. This study describes differences in resident competence in paracentesis over time.

METHODS

From 2016 to 2017, internal medicine residents (n = 118) underwent paracentesis simulation training. Competence was assessed using the Paracentesis Competency Assessment Tool (PCAT), which combines a checklist, global scale, and entrustment score. The PCAT also delineates two categorical cut-point scores: the Minimum Passing Standard (MPS) and the Unsupervised Practice Standard (UPS). Residents were randomized to return to the simulation lab at 3 and 6 months (group A, n = 60) or only 6 months (group B, n = 58). At each session, faculty raters assessed resident performance. Data were analyzed to compare resident performance at each session compared with initial training scores, and performance between groups at 6 months.

RESULTS

After initial training, all residents met the MPS. The number achieving UPS did not differ between groups: group A = 24 (40%), group B = 20 (34.5%), p = 0.67. When group A was retested at 3 months, performance on each PCAT component significantly declined, as did the proportion of residents meeting the MPS and UPS. At the 6-month test, residents in group A performed significantly better than residents in group B, with 52 (89.7%) and 20 (34.5%) achieving the MPS and UPS, respectively, in group A compared with 25 (46.3%) and 2 (3.70%) in group B (p < .001 for both comparison).

DISCUSSION

Skill in paracentesis declines as early as 3 months after training. However, retraining may help interrupt skill decay. Only a small proportion of residents met the UPS 6 months after training. This suggests using the PCAT to objectively measure competence would reclassify residents from being permitted to perform paracentesis independently to needing further supervision.

LIVE FM (lecture improvised with video elements in forensic medicine): does a video worth a thousand pictures? A comparative study in medical education

Forensic education should be fully conversant with a scientific theory of how students learn. By and large, the traditional model of education is widely accepted. 'Difficult-to-learn' areas in forensic medicine are the challenges to students as well as teachers. An innovative modality 'lectures improvised with video elements' was used by authors in the undergraduate medical education program of Forensic Medicine in order to facilitate active learning. Evaluation of this approach has established a positive impact on student's spatial ability, reasoning ability, and memory skills. Intrinsic cognitive load on working memory was reduced to a certain extent. With compare to the static pictures, video usage significantly helps to comprehend the difficult content of the learning. Students found the experience interesting and very ardent to use it again.

Procedural Competency Among Hospitalists: A Literature Review and Future Considerations

BACKGROUND

As general internists practicing in the inpatient setting, hospitalists at many institutions are expected to perform invasive bedside procedures, as defined by professional standards. In reality, hospitalists are doing fewer procedures and increasingly are referring to specialists, which threatens their ability to maintain procedural skills. The discrepancy between expectations and reality, especially when hospitalists may be fully credentialed to perform procedures, poses significant risks to patients because of morbidity and mortality associated with complications, some of which derive from practitioner inexperience.

METHODS

We performed a structured search of the peer-reviewed literature to identify articles focused on hospitalists performing procedures.

RESULTS

Our synthesis of the literature characterizes contributors to hospitalists' procedural competency and discusses: (1) temporal trends for procedures performed by hospitalists and their associated referral patterns, (2) data comparing use and clinical outcomes of procedures performed by hospitalists compared with specialists, (3) the lack of nationwide standardization of hospitalist procedural training and credentialing, and (4) the role of medical procedure services, although limited in supportive evidence, in concentrating procedural skill and mitigating risk in the hands of a few well-trained hospitalists.

CONCLUSION

We conclude with recommendations for hospital medicine groups to ensure the safety of hospitalized patients undergoing bedside procedures.

Assessment Practices of Student’s Clinical Competences in Nurse Education

Background:

Clinical competence in nursing practices includes all the theoretical and clinical knowledge used by the student in a clinical setting. It also involves psychomotor as well as problem-solving skills. The assessment focuses on evaluating the student's ability to provide both safe and competent care for the patients. However, it requires the use of several assessment methods that must be varied according to the components of the clinical competence.

Several studies have revealed that the evaluation of this competency is mostly limited to knowledge testing or the acquisition of technical skills verification.

Aims:

This study has two objectives. Firstly, it aims to analyze the assessment practices related to clinical competence and adopted by teachers in higher institutes of nursing and health technology in Morocco. Secondly, it seeks to identify the difficulties faced by them in using a variety of appropriate assessment tools to target all the components of clinical competence.

Methods:

Based on the theoretical model adapted from the Miller’s pyramid by Mehay and Burns in 2009, relating to the assessment of clinical competence, a self-administered questionnaire was shared with 129 nursing teachers.

Results:

The results indicate that 98.06% of participants use a given tool to assess clinical competence; however, using the appropriate tools to evaluate all its components is limited, and the assessment tools are not characterized by variety.

Conclusion:

Reflecting on the evaluation of clinical competences, a clinical assessment model could be proposed to be in accordance with the theoretical model and to measure its impact on nursing students' learning.

Can we improve teaching and learning of percutaneous dilatational tracheostomy's bronchoscopic guidance?

Percutaneous dilatational tracheostomy has become the technique of choice in multiple intensive care units. Among innovations to improve procedural safety and success, bronchoscopic guidance of percutaneous dilatational tracheostomy has been advocated and successfully implemented by multiple groups. Most published literature focuses on the percutaneous dilatational tracheostomy operator, with scarce descriptions of the bronchoscopic particularities of the procedure. In this article, we provide 10 suggestions to enhance specific procedural aspects of bronchoscopic guidance of percutaneous dilatational tracheostomy, and strategies to optimize its teaching and learning, in order to promote learners' competence acquisition and increase patient safety.

The performance and confidence of clinicians in training in the analysis of ophthalmic images within a work-integrated teaching model

PURPOSE

A fundamental clinical skill is the recognition of artefacts within the outputs of advanced imaging modalities. However, current teaching programmes of healthcare practitioners are becoming increasingly challenged to provide practical exposure within an already crowded curriculum. This study evaluates the impact of a novel work-integrated teaching model on the confidence and competence of clinicians in the use of optical coherence tomography (OCT) and the recognition of its artefacts. The outcomes were then used to develop a model to predict performance and guide teaching strategies.

METHODS

We prospectively evaluated a 6-week clinical placement for final year optometry students within a diagnostic eye clinic in 2018-2020. Participants completed a quiz on the identification of common OCT artefacts and rated their confidence levels on key areas of OCT application using a five-point Likert scale. Both were completed before (pre-rotation) and after (post-rotation) the placement. The cohort was divided into two groups; the first group was used to assess the impact of the placement and derive the prediction model for post-placement performance, which was then validated against the second group.

RESULTS

A significant improvement in detecting OCT imaging artefacts was seen upon completion of the placement, which was greater in participants with lower entry level performance. Across all OCT artefact subtypes, there was an improvement in detecting segmentation error, delineation error and media opacities. A model predicting post-placement student performance was developed using entry level knowledge base as the key dependent variable. Self-rated confidence improved across all domains of OCT application but was not found to be a direct predictor of actual performance.

CONCLUSIONS

These results highlight the benefit of a work-integrated learning programme on both academic performance and confidence whilst identifying entry level knowledge base as the key variable predicting improvement. Tailored teaching incorporating entering knowledge is the best predictor of improvement during clinical placements. Integrating clinicians into a work-integrated setting with tailored teaching and comprehensive practical exposure can be an effective method for training future or current healthcare professionals.

Rapid degradation of psychomotor memory causes poor quality chest compressions in frequent cardiopulmonary resuscitation providers and feedback devices can only help to a limited degree: A crossover simulation study

Studies report a decline in the psychomotor memory of cardiopulmonary resuscitation (CPR) providers within months of training, but they are prone to subject bias. We hypothesized that this degradation is faster and more prevalent in real world practice. The aims of our study were to 1. assess the quality of chest compressions (CC) delivered routinely by CPR-certified clinicians who are not primed by study conditions, and 2. investigate if psychomotor memory degrades if feedback devices are removed. Forty anaesthetists and intensivists participated in a voluntary, half-day, randomized crossover study using case-based simulation. Participants were paired and randomly assigned into 2 groups; each receiving automated feedback either in the first or second cycle of CPR. Two cycles of CC and defibrillation (ACLS protocol) were administered on a manikin. CC parameters including overall quality were measured by a feedback device. The median proportion of good quality CC was poor at baseline but improved with feedback; 38.2% (IQR 27.7, 58.7) to 57.7% (IQR 38.0, 68.7), P < .05. The median proportion of good quality CC fell after feedback withdrawal; 50.5% (IQR 24.5, 67.7) to 25.6% (9, 37.6), P < .05. No carryover effect was observed. Treatment effect and period effect were detected. Baseline quality of CC amongst frequent CPR providers is poor, and can be improved partly by feedback devices. As psychomotor memory of good quality CCs degrades rapidly after removal of feedback, a multimodal approach is required for CPR skill retention. Future research on the optimal frequency of CPR training, including the use of feedback devices in clinical practice should be explored.

How supervision and educational supports impact medical students' preparation for future learning of endotracheal intubation skills: a non-inferiority experimental trial

BACKGROUND

Professional education cannot keep pace with the rapid advancements of knowledge in today's society. But it can develop professionals who can. 'Preparation for future learning' (PFL) has been conceptualized as a form of transfer whereby learners use their previous knowledge to learn about and adaptively solve new problems. Improved PFL outcomes have been linked to instructional approaches targeting learning mechanisms similar to those associated with successful self-regulated learning (SRL). We expected training that includes evidence-based SRL-supports would be non-inferior to training with direct supervision using the outcomes of a 'near transfer' test, and a PFL assessment of simulated endotracheal intubation skills.

METHOD

This study took place at the University of Toronto from October 2014 to August 2015. We randomized medical students and residents (n = 54) into three groups: Unsupervised, Supported; Supervised, Supported; and Unsupervised, Unsupported. Two raters scored participants' test performances using a Global Rating Scale with strong validity evidence. We analyzed participants' near transfer and PFL outcomes using two separate mixed effects ANCOVAs.

RESULTS

For the Unsupervised, Supported group versus the Supervised, Supported group, we found that the difference in mean scores was 0.20, with a 95% Confidence Interval (CI) of - 0.17 to 0.57, on the near transfer test, and was 0.09, with a 95% CI of - 0.28 to 0.46, on the PFL assessment. Neither mean score nor their 95% CIs exceeded the non-inferiority margin of 0.60 units. Compared to the two Supported groups, the Unsupervised, Unsupported group was non-inferior on the near transfer test (differences in mean scores were 0.02 and - 0.22). On the PFL assessment, however, the differences in mean scores were 0.38 and 0.29, and both 95% CIs crossed the non-inferiority margin.

CONCLUSIONS

Training with SRL-supports was non-inferior to training with a supervisor. Both interventions appeared to impact PFL assessment outcomes positively, yet inconclusively when compared to the Unsupervised and Unsupported group, By contrast, the Unsupervised, Supported group did not score well on the near transfer test. Based on the observed sensitivity of the PFL assessment, we recommend researchers continue to study how such assessments may measure learners' SRL outcomes  during structured learning experiences.

Less-Invasive Surfactant Administration for Neonatal Respiratory Distress Syndrome: A Consensus Guideline

INTRODUCTION

Less-invasive surfactant administration (LISA) is a method of surfactant delivery to preterm infants for treating respiratory distress syndrome (RDS), which can reduce the composite risk of death or bronchopulmonary dysplasia and the time on mechanical ventilation.

METHODS

A systematic literature search of studies published up to April 2021 on minimally invasive catheter surfactant delivery in preterm infants with RDS was conducted. Based on these studies, with parental feedback sought via an online questionnaire, 9 UK-based specialists in neonatal respiratory disease developed their consensus for implementing LISA. Recommendations were developed following a modified, iterative Delphi process using a questionnaire employing a 9-point Likert scale and an a priori level of agreement/disagreement.

RESULTS

Successful implementation of LISA can be achieved by training the multidisciplinary team and following locally agreed guidance. From the time of the decision to administer surfactant, LISA should take <30 min. The comfort of the baby and requirements to maintain non-invasive respiratory support are important. While many infants can be managed without requiring additional sedation/analgesia, fentanyl along with atropine may be considered. Parents should be provided with sufficient information about medication side effects and involved in treatment discussions.

CONCLUSION

LISA has the potential to improve outcomes for preterm infants with RDS and can be introduced as a safe and effective part of UK-based neonatal care with appropriate training.

Intern Orthopedic Rotation Versus Emergency Medicine Procedure Month: Which one Derives More Opportunity?

INTRODUCTION

The American College of Graduate Medical Education (ACGME) defines 18 "key procedures" as requirements in emergency medicine (EM) residency programs. The post-graduate year-1 (PGY-1) curriculum provides an early foundation for EM trainees to gain procedural experience, but traditional PGY-1 rotations may not provide robust procedural opportunities. Our objective was to replace a traditional orthopedic rotation with a 4-week rotation that emphasized EM procedure acquisition and comprehension. Although all residents met ACGME procedural requirements before the curricular modification, the purpose of this month was to increase overall procedure numbers. The block contained dedicated procedure shifts in the emergency department as well as an asynchronous, self-directed learning course. We sought to compare the number of procedures performed by PGY-1 residents during their orthopedic rotation (the year before implementation), to the number of procedures performed during their procedure rotation (the year after implementation).

METHODS

The total number of procedures performed and logged by PGY-1 residents during the traditional orthopedic rotation (during the year prior to implementation of the new procedure rotation) were compared to the total number of procedures by the first class to undergo the new procedure rotation the following year. Thirty resident logs were reviewed (15 per class). Data were analyzed using SAS NPAR1WAY; Z < 0.05 was considered significant.

RESULTS

When compared to the orthopedic rotation, the procedure rotation had statistically significant higher numbers of procedures per resident (22, standard deviation [SD] 12, vs 11.4, SD 7.6; Z = 0.0177). A wide variety of nonorthopedic procedures accounted for the increased numbers, (13.6, SD 10.3, vs 0.9, SD 0.9; Z < 0.001). While the average number of orthopedic procedures was slightly less on the procedure rotation, there was no statistical difference (orthopedic rotation 10.13, procedure rotation 8.26; Z = 0.4605). Notably, fewer procedures were performed when 2 residents were on the procedure rotation at the same time (21 vs 10.1).

CONCLUSION

This analysis demonstrated a larger number and a wider variety of procedures performed by PGY-1 residents during a dedicated procedure rotation compared to a traditional orthopedic rotation. Furthermore, exposure to orthopedic procedures did not decline significantly. Limitations of the study include a modest number of subjects. Data may be limited by the consistency of procedure logging by individual residents. Further studies may assess procedural competency after PGY-1 year of training.

Metodologias ativas no cateterismo periférico venoso: desenvolvimento de habilidades com simulador de baixo custo

RESUMO Objetivo Conhecer a percepção de estudantes de enfermagem sobre a contribuição do uso do simulador de baixo custo no desenvolvimento de habilidades técnicas para o cateterismo periférico venoso. Método Estudo descritivo de abordagem qualitativa, realizado em universidade pública do sul do Brasil com 25 estudantes de enfermagem. Os dados foram coletados em 2019, por meio de questionário acerca do cateterismo periférico venoso, desenvolvido com apoio de simulador de baixo custo. Para análise, seguiu-se a proposta operativa de Minayo. Resultados A partir dos dados, surgiram duas categorias. 1) Desenvolvimento de habilidades para cateterismo periférico venoso: os estudantes apontaram que o uso do simulador possibilita compreender cada etapa do procedimento e identificar onde precisam aperfeiçoar a técnica, preparando-os para o contato com o paciente. 2) Dificuldades encontradas na utilização do simulador de baixo custo. Os estudantes destacaram a baixa fidelidade do simulador e a limitação do treinamento por simulação sem comunicação. Conclusões e implicações para a prática Os estudantes percebem o simulador de baixo custo como uma relevante ferramenta para o desenvolvimento de habilidades do cateterismo periférico venoso, sugerem seu aperfeiçoamento para aumentar a fidelidade e a incorporação da comunicação no momento da punção para o maior realismo da experiência simulada.

Simulation training for emergency skills: effects on ICU fellows' performance and supervision levels

BACKGROUND

The application of manual emergency skills is essential in intensive care medicine. Simulation training on cadavers may be beneficial. The aim of this study was to analyze a skill-training aiming to enhance ICU-fellows´ performance.

METHODS

A skill-training was prepared for chest tube insertion, pericardiocentesis, and cricothyroidotomy. Supervision levels (SL) for entrustable professional activities (EPA) were applied to evaluate skill performance. Pre- and post-training, SL and fellows´ self- versus consultants´ external assessment was compared. Time on skill training was compared to conventional training in the ICU-setting.

RESULTS

Comparison of pre/post external assessment showed reduced required SL for chest tube insertion, pericardiocentesis, and cricothyroidotomy. Self- and external assessed SL did not significantly correlate for pre-training/post-training pericardiocentesis and post-training cricothyroidotomy. Correlations were observed for self- and external assessment SL for chest tube insertion and pre-assessment for cricothyroidotomy. Compared to conventional training in the ICU-setting, chest tube insertion training may further be time-saving.

CONCLUSIONS

Emergency skill training separated from a daily clinical ICU-setting appeared feasible and useful to enhance skill performance in ICU fellows and may reduce respective SL. We observed that in dedicated skill-training sessions, required time resources would be somewhat reduced compared to conventional training methods.

Tips for teaching procedural skills

The teaching of procedural skills required for clinical practice remains an ongoing challenge in healthcare education. Health professionals must be competent to perform a wide range of clinical skills, and are also regularly required to teach these clinical skills to their peers, junior staff, and students. Teaching of procedural skills through the use of frameworks, observation and provision of feedback, with opportunities for repeated practice assists in the learners' acquisition and retention of skills. With a focus on the teaching of non-complex skills, this paper explores how skills are learned; ways to improve skill performance; determining competency; and the provision of effective feedback.

Procedural frequency: Results from 18 academic, community and freestanding emergency departments

BACKGROUND

Emergency physicians must maintain procedural skills, but clinical opportunities may be insufficient. We sought to determine how often practicing emergency physicians in academic, community and freestanding emergency departments (EDs) perform 4 procedures: central venous catheterization (CVC), tube thoracostomy, tracheal intubation, and lumbar puncture (LP).

METHODS

This was a retrospective study evaluating emergency physician procedural performance over a 12-month period. We collected data from the electronic records of 18 EDs in one healthcare system. The study EDs included higher and lower volume, academic, community and freestanding, and trauma and non-trauma centers. The main outcome measures were median number of procedures performed. We examined differences in procedural performance by physician years in practice, facility type, and trauma status.

RESULTS

Over 12 months, 182 emergency physicians performed 1582 of 2805 procedures (56%) and supervised (resident, nurse practitioner or physician assistant) an additional 1223 of the procedures they did not perform (43%). Median (interquartile range) physician performance for each procedure was CVC 0 [0, 2], tube thoracostomy 0 [0, 0], tracheal intubation 3 [0.25, 8], and LP 0 [0, 2]. The percentage of emergency physicians who did not perform at least one of each procedure during the 1-year time frame ranged from 25.3% (tracheal intubation) to 76.4% (tube thoracostomy). Physicians who work at high-volume EDs (>50,000 visits per year) performed nearly twice as many tracheal intubations, CVCs, and LPs than those at low-volume EDs or freestanding EDs when normalized per 1000 visits. Years out of training were inversely related to total number of procedures performed. Emergency physicians at trauma centers performed almost 3 times as many tracheal intubations and almost 4 times as many CVCs compared to non-trauma centers.

CONCLUSION

In a large healthcare system, regardless of ED type, emergency physicians infrequently performed the 4 procedures studied. Physicians in high-volume EDs, trauma centers, and recent graduates performed more procedures. Our study adds to a growing body of research that suggests clinical frequency alone may be insufficient for all emergency physicians to maintain competency.

Simulation in Neonatal-Perinatal Medicine Fellowship Programs

OBJECTIVE

This study aimed to investigate the use of simulation in neonatal-perinatal medicine (NPM) fellowship programs.

STUDY DESIGN

This was a cross-sectional survey of program directors (PDs) and simulation educators in Accreditation Council for Graduate Medical Education (ACGME) accredited NPM fellowship programs.

RESULTS

Responses were received from 59 PDs and 52 simulation educators, representing 60% of accredited programs. Of responding programs, 97% used simulation, which most commonly included neonatal resuscitation (94%) and procedural skills (94%) training. The time and scope of simulation use varied significantly. The majority of fellows (51%) received ≤20 hours of simulation during training. The majority of PDs (63%) wanted fellows to receive >20 hours of simulation. Barriers to simulation included lack of faculty time, experience, funding, and curriculum.

CONCLUSION

While the majority of fellowship programs use simulation, the time and scope of fellow exposure to simulation experiences are limited. The creation of a standardized simulation curriculum may address identified barriers to simulation.

Assessing competency using simulation: the SimZones approach

Introduction

Competency-based medical education (CBME) is a system of medical training that focuses on a structured approach to developing the clinical abilities of medical education graduates and practicing physicians. CBME requires a robust and multifaceted system of assessment in order to both measure and guide the progress of learners toward pre-established goals. Simulation has been proposed as one method for assessing competency in healthcare workers. However, a longitudinal framework for assessing competency using simulation has not been developed.

Methods

Conjecture mapping methodology was used to map Miller's framework for competency assessment-'knows', 'knows how', 'shows how', and 'does'-to the five SimZones described by Roussin and Weinstock. The SimZones describe a system of organising the development and delivery of simulation-based education and offer a foundation for both guiding and organising assessment in a simulation context.

Results

A conceptualised alignment of the SimZones with Miller's pyramid of assessment was developed, as well as a detailed conjecture map. SimZone 0 (auto-feedback) and SimZone 1 (foundational instruction) mapped to 'knows' and 'knows how'. SimZone 2 (acute care instruction) mapped to 'shows how'. SimZone 3 (team and system development) mapped to 'shows how'. SimZone 4 (real-life debriefing and development) mapped to 'does'.

Conclusion

The SimZones system of competency assessment offers a robust, flexible, and multifaceted system to guide both formative and summative assessment in CBME. The SimZones approach adds to the many methods of competency assessment available to educators. Adding SimZones to the vocabulary of CBME may be helpful for the full deployment of CBME.

Maintaining competence in airway management

BACKGROUND

Airway management is a defining skill for anaesthesiologists. Anaesthesiologists must maintain and update these crucial skills throughout their career, but how this is best achieved remains unclear. This study aimed to clarify anaesthesiologists' procedural volume, confidence in airway management and their current and preferred future educational strategies.

METHODS

A questionnaire was developed consisting of 28 items exploring essential skills in airway management. All anaesthesiologists in the Capital Region of Denmark were invited to participate.

RESULTS

The response rate was 84% (240/285). Most anaesthesiologists felt competent to a high or very high degree in basic airway management. Anaesthesiologists from anaesthesia felt confident to a significantly higher degree than those working in the intensive care unit (ICU) regarding the practical aspects of airway management in both the anticipated difficult airway (93% vs 73%, P < .001) and the unanticipated difficult airway (81% vs 61%, P = .002). Both groups performed most of the key advanced techniques ≤4 times yearly, whereas anaesthesiologists from the ICU had a lower and less diverse procedural volume than those working in anaesthesia. The anaesthesiologists preferred training through their daily clinical work, hands-on workshops, and scenario-based simulation training. However, a large discrepancy was identified between the current and the desired level of training.

CONCLUSION

The anaesthesiologists felt competent to a high or very high degree in basic airway management but the current procedural volume in advanced airway management causes concern for skill maintenance. Furthermore, we found a gap between the current and the desired level of supplemental training.

A Mastery Learning Module on Sterile Technique to Prepare Graduating Medical Students for Internship

INTRODUCTION

Sterile technique is a basic technical skill used for a number of bedside procedures. Proper use of sterile technique improves patient safety by reducing infection risk.

METHODS

We applied the principles of mastery learning to develop a simulation-based mastery learning module for sterile technique that was used as part of a 2-week internship preparatory course for fourth-year medical students. Forty-one medical students entering surgical or emergency medicine internships completed the module. Learners demonstrated baseline skills with a pretest, watched a didactic online video, participated in supervised deliberate practice sessions, and then completed a posttest. Physicians evaluated performance using a nine-item mastery checklist validated by a multispecialty panel of board-certified physicians. Learners who did not demonstrate mastery by correctly performing all nine checklist items received formative feedback and repeated the posttest as needed until mastery was achieved.

RESULTS

No learners demonstrated mastery of sterile technique during pretesting. A total of 100% of learners demonstrated mastery of sterile technique during either their first or second attempt of the posttest. The learners reported statistically significantly higher levels of confidence at the end of the module.

DISCUSSION

Our module highlights the skills gap that exists in the transition from undergraduate to graduate medical education and offers a cheap, effective, and easily reproducible curriculum for sterile technique that could be widely adopted for many learner populations.

Evaluating Resident Procedural Skills: Faculty Assess a Scoring Tool

Background and Objective

Procedural skills assessment is critical in residency training. The Council of Academic Family Medicine recommends the Procedural Competency Assessment Tool (PCAT) for assessing procedure competence of family medicine residents. We sought to evaluate the reliability of the PCAT and to better identify its strengths and limitations.

Methods

In this mixed-methods study conducted in 2017, 18 faculty members of an academic family medicine residency program watched a video of one of the authors performing a simulated shave biopsy with intentional errors. Faculty scored the procedure using the shave biopsy PCAT, then participated in a focus group discussion of the rationale for the scores given. Qualitative analysis assessed perceived benefits and challenges of the PCAT. Following the discussion, faculty scored the same procedure again, using a PCAT modified with additional objective criteria.

Results

On the original PCAT, 40% of respondents rated the physician as competent. This dropped to 21.4% on the modified PCAT (P=.035). Respondents scored competent even though procedure components were scored as novice. Score variability decreased with the checklist-based PCAT. Qualitative analysis revealed that the PCAT is subjective and interpretation of the tool varies widely.

Conclusions

Further studies regarding PCAT validity and reliability are needed. The PCAT may require further norming with additional objective criteria to improve reliability. Residencies may train faculty on using the PCAT to improve interobserver agreement, or decide to use a more intuitive checklist evaluation tool.

Developing strategies to improve fidelity of delivery of, and engagement with, a complex intervention to improve independence in dementia: a mixed methods study

BACKGROUND

It is important to evaluate fidelity of delivery and engagement during feasibility trials. However, there is little guidance on how to systematically develop strategies to improve implementation if problems arise. We aimed to: 1) Assess fidelity of delivery and engagement, 2) Identify factors influencing fidelity of delivery and engagement, and 3) Develop strategies to improve fidelity of delivery of, and engagement with, a complex intervention to improve independence in dementia, within a feasibility trial.

METHODS

A mixed methods evaluation of an intervention that aimed to improve independence in dementia. To assess fidelity of delivery and engagement, observation and self-report methods were used: 60% of audio-recorded intervention sessions were transcribed and reliably rated for fidelity. Providers (n = 12) and people with dementia/supporters (n = 34) were asked to complete checklists after each session. Descriptive statistics were used to analyse the data. To identify factors influencing fidelity and engagement, one-to-one semi-structured interviews were conducted with providers (n = 8), people with dementia (n = 7) and supporters (n = 7). Thematic analysis and content analysis were used to analyse data. To develop strategies, we followed four steps proposed by the authors of the Behaviour Change Wheel (1. Understanding the behaviour, 2. Identifying intervention functions, 3. Specifying intervention content, 4. Identifying mode of delivery).

RESULTS

Researcher ratings indicated moderate fidelity and provider/participant ratings indicated high fidelity of delivery. Knowledge, providers' attributes, ease of adaptation of the intervention in relation to participants' needs and logistical considerations influenced fidelity. We developed four strategies to improve fidelity of delivery of PRIDE: 1) showing a video, 2) giving an instruction sheet, 3) giving time to practice and 4) providing continued support. Participants reported high levels of engagement. Participants' attributes, capability and opportunity influenced engagement. We developed four strategies to improve engagement with PRIDE: 1) a session summary document, 2) clear instructions, 3) time to practice activity and 4) providing regular compulsory telephone support.

CONCLUSION

Fidelity of delivery and engagement are complex behaviours. This manuscript provides an example of how the Behaviour Change Wheel can be used during a feasibility trial to systematically develop strategies to improve implementation of complex interventions.

The role of online videos in teaching procedural skills to post-graduate medical learners: A systematic narrative review

Objective: Online videos are commonly used in medical education. The aim of this review was to investigate the role of online instructional videos in teaching procedural skills to postgraduate medical learners.Methods: This systematic narrative review was conducted according to the PRISMA guidelines. MEDLINE, Cochrane Central Register of Controlled Trials, EMBASE, ERIC and Google Scholar were searched. Full texts that applied to online videos, postgraduate medical learners and procedural skills were included without language restrictions. The methodological quality of the studies was evaluated using a validated tool. A thematic analysis of the studies was carried out using a general inductive approach.Results: A total of 785 articles were retrieved and the full text was reviewed for 66 articles that met the inclusion and exclusion criteria of the study. Twenty papers that were relevant to the role of online videos in postgraduate medical education of procedural skills were used for this review. They were heterogenous in the outcomes collected and the evidence was of variable quality. There was strong evidence for the use of online videos for procedural skill knowledge acquisition and retention. Online videos were used for various purposes, such as supervision, assessment, postoperative debriefing, providing feedback, and promoting reflection.Conclusion: Online videos are a valuable educational tool especially for procedural skill knowledge acquisition and retention. Future research needs to be carried out on the appropriate use of platforms in disseminating and using online videos, identifying the factors surrounding the learners, video characteristics, and data protection.

Bridging the Gap Between "Do One" and "Teach One": Impact of a Procedural Objective Structured Teaching Encounter on Resident Procedural Teaching Proficiency

PROBLEM

Minimal formal training exists in teaching invasive bedside procedures during Internal Medicine (IM) residency despite the large role trainees have in instructing junior colleagues.

OBJECTIVE AND METHODS

We investigated if using a Procedural Objective Structured Teaching Encounter (PrOSTE) to disseminate a novel method for teaching procedures would improve supervising residents' (n = 7) ability to teach ultrasound-guided peripheral IV's (USGIV) to incoming interns (n = 67) at a single, large academic IM residency. Supervising residents were assigned to receive the PrOSTE training versus standard procedure training, and then, both groups instructed incoming interns. The impact of the PrOSTE was measured by participant surveys, observed changes in teacher behavior, and performance of incoming interns on a USGIV blinded assessment station.

MEASUREMENT AND MAIN RESULTS

PrOSTE-trained residents reported high levels of satisfaction with the session and demonstrated increased desirable behaviors when teaching procedures. There was no statistical difference in incoming intern performance when placing USGIVs between intervention and standard groups (81.0% vs 74.8% items correct; difference 6.2; SD = 12.4; p = 0.22).

CONCLUSION

The PrOSTE is a feasible, well-received tool for training supervising residents in our novel teaching framework, as demonstrated in this pilot study. Despite not showing a difference in learner performance, qualitative data suggests the impact of the PrOSTE would be even greater in a more controlled teaching environment. Using a PrOSTE to deliver this teaching framework has broad applicability to any IM residency, and the tenets can be used with any bedside invasive procedure with an effective task trainer.

Do professionals change their communication behaviours following a training in hypnosis-derived communication? A feasibility study in pediatric oncology

OBJECTIVES

The purpose of this study was to test the feasibility of a training in hypnotic communication techniques (HCTech) for pediatric nurses to prevent procedural pain and distress in children during venipunctures. Specifically, this study aimed to (1) assess nurses' mastery of HCTech and (2) nurses' experience regarding the training program.

METHODS

Participants were 6 female pediatric nurses and 33 of their cancer patients. Nurses took part in a 4-day theoretical and practical training in HCTech. Venipuncture procedures were video-recorded and assessed to evaluate nurses' mastery of HCTech using a standardized scale. Pre-training use of HCTech was compared with post-training and follow-up for the entire nurse sample and across nurses with the same patients (109 nurse-patient interactions). After the follow-up, nurses were questioned about their experience in regards to the training and activities (themes and practice).

RESULTS

Results showed medium pre-post changes in hypnotic communication behaviours (pre-post d = 0.74), with changes maintaining at follow-up (pre-follow-up d = 0.97). Interviews transcripts' analyses revealed moderate levels of motivation and satisfaction regarding the training content and format. Nurses suggested to emphasize on the practice of HCTech in a noisy outpatient clinic as well as offer more practical exercises.

CONCLUSION

A 4-day training in hypnotic communication techniques translated into the use of HCTech by nurses practicing in pediatric oncology when comparing the same dyads at baseline, post-training and follow-up. Results support further refinement and suggest nurses could be trained to prevent pain and distress with hypnosis-derived communication strategies.

Characteristics of Effective Teachers of Invasive Bedside Procedures: A Multi-institutional Qualitative Study

BACKGROUND

Faculty supervision of invasive bedside procedures (IBPs) in the ICU may enhance procedural education and ensure patient safety. However, there is limited research on teaching effectiveness in the ICU, and there are no best teaching practices regarding the supervision of IBPs.

RESEARCH QUESTION

We conducted a multi-institutional qualitative study of pulmonary and critical care medicine faculty and fellows to better understand characteristics of effective IBP teachers.

STUDY DESIGN AND METHODS

Separate focus groups (FGs) were conducted with fellows and faculty at four large academic institutions that were geographically distributed across the United States. FGs were facilitated by a trained investigator, audio-recorded, and transcribed verbatim for analysis. Themes were identified inductively and compared with constructs from social and situated learning theories. Data were analyzed between and across professional groups. Qualitative research software (NVivo; QSR International) was used to facilitate data organization and create an audit trail of the analysis. A multidisciplinary research team was engaged to minimize interpretive bias.

RESULTS

Thirty-three faculty and 30 fellows participated. Inductive analysis revealed three categories of themes among successful IBP teachers: traits, behaviors, and context. Traits included calm demeanor, trust, procedural competence, and effective communication. Behaviors included leading preprocedure huddles to assess learners' experiences and define expectations; debriefing to provide feedback; and allowing appropriate autonomy. Context included learning climate, levels of distraction, patient acuity, and institutional culture.

INTERPRETATION

We identified specific traits and behaviors of effective IBP teachers that intersect with the practice environment, which highlights the challenge of teaching IBPs. Notably, FG participants emphasized interpersonal, more than technical, aspects of successful IBP teachers. These findings should inform future curricula on teaching IBPs in the ICU, standardize IBP teaching for pulmonary and critical care medicine fellows, and reduce patient injury from procedural complications.

Cohort study of neonatal resuscitation skill retention in frontline healthcare facilities in Bihar, India, after PRONTO simulation training

BACKGROUND

Use of simulation in neonatal resuscitation (NR) training programmes has increased throughout low-income and middle-income countries. Many of such programmes have demonstrated a positive impact on NR knowledge and skill acquisition along with reduction of early neonatal mortality and fresh stillbirth rates. However, NR skill retention after simulation programmes remains a challenge.

METHODS

This study assessed facility level NR skill retention after PRONTO International's simulation training in Bihar, India. Training was conducted within CARE India's statewide in-job, on-site Apatkaleen Matritva evam Navjat Tatparta mentoring programme as part of a larger quality improvement and health systems strengthening initiative. Public sector facilities were initially offered training, facilitated by trained nursing graduates, during 8-month phases between September 2015 and January 2017. Repeat training began in February 2018 and was facilitated by peers. NR skills in simulated resuscitations were assessed at the facility level at the midpoint and endpoint of initial training and prior to and at the midpoint of repeat training.

RESULTS

Facilities administering effective positive pressure ventilation and assessing infant heart rate increased (31.1% and 13.1%, respectively, both p=0.03) from midinitial to postinitial training (n=64 primary health centres (PHCs) and 192 simulations). This was followed by a 26.2% and 20.9% decline in these skills respectively over the training gap (p≤0.01). A significant increase (16.1%, p=0.04) in heart rate assessment was observed by the midpoint of repeat training with peer facilitators (n=45 PHCs and 90 simulations). No significant change was observed in other skills assessed.

CONCLUSIONS

Despite initial improvement in select NR skills, deterioration was observed at a facility-level post-training. Given the technical nature of NR skills and the departure these skills represent from traditional practices in Bihar, refresher trainings at shorter intervals are likely necessary. Very limited evidence suggests peer simulation facilitators may enable such increased training frequency, but further study is required.

Current training in percutaneously inserted central catheter (PICC) placement and maintenance for neonatal-perinatal medicine fellows

OBJECTIVE

To describe the current educational status of percutaneously inserted central catheter (PICC) insertion/ maintenance training for neonatal-perinatal medicine (NPM) fellows in the United States.

STUDY DESIGN

A cross-sectional 34-question survey was electronically distributed to NPM fellowship training program directors (PDs) in the United States.

RESULTS

The response rate was 81.8% (81/99 PD). Most PDs (68.5%) reported that their neonatal intensive care unit has a PICC team. Fellows were PICC team members in 72%. Only 52% of programs offer formal training in PICC placement to fellows; 61.5% of these utilize a standardized curriculum. Dedicated PICC team existence was negatively associated with formal training for PICC insertion and maintenance for fellows (42.0% with PICC team vs. 73.91% without, p = 0.01).

CONCLUSIONS

Wide variation exists in fellow's exposure, education, and competency assessment in PICC-related activities nationally. Development of a standardized curriculum would be beneficial.

Interprofessional Procedure Training for Medicine and Nursing Students

Introduction

Recognizing the need for interprofessional education for trainees, the University of Kansas Schools of Nursing (SON) and Medicine (SOM) created interprofessional procedure workshops to foster collaboration, communication, and learning with and from other disciplines. The first workshop focused on venipuncture and peripheral intravenous catheter (PIV) insertion.

Methods

An interprofessional work group including SON and SOM faculty developed a PIV procedure training workshop based on the "learn, see, practice, prove, do, maintain" framework. SON faculty and graduate nursing students provided support and mentoring during the training sessions. Nursing students acted as peer coaches for their medical student colleagues with the help of an evidence-based, standardized, deliberate practice guide. The document broke the procedure into phases-planning, preparation, insertion, and postinsertion care-and provided scaffolding for the beginner through assessment.

Results

On survey, most students felt the program was beneficial and met the learning objectives. After the sessions, medical students completed a PIV assessment, and nursing students completed a reflection on the experience. These postsession assignments for each group confirmed that the learning objectives had been met.

Discussion

The interprofessional PIV workshop was one module in a longitudinal interprofessional curriculum providing training for SON and SOM learners. One goal of this curriculum was to achieve higher graduate competencies in procedural skills and interprofessional practice. Additionally, in developing the workshop, a deliberate practice guide was created that provided an educationally sound and best-practice procedure to be standardized to all university learners on campus.

Pediatric airway management education and training

Education in medicine, informed by research findings, is moving away from the traditional apprenticeship model and increasingly embraces new, active learning methodologies. In this article, we will review these methodologies along with adult learning theories; we explore the available evidence on acquisition and maintenance of pediatric airway management skills, including technical and nontechnical skills. We recall the elements of a competency-based curriculum and how they can be applied in pediatric airway skill training and suggest mapping strategies based on research evidence. We propose future directions in education and educational research in the field.

Physician Versus Nonphysician Instruction: Evaluating an Expert Curriculum-Competent Facilitator Model for Simulation-Based Central Venous Catheter Training

INTRODUCTION

Healthcare simulation supports educational opportunities while maintaining patient safety. To reduce costs and increase the availability of training, a randomized controlled study evaluated central venous catheter (CVC) insertion training in the simulation laboratory with nonphysician competent facilitators (NPCFs) as instructors.

METHOD

A group of learners naive to central line placement participated in a blended curriculum consisting of interactive online materials and simulation-based training. Learners were randomized to training with NPCFs or attending physician faculty. The primary outcome was simulated CVC insertion task performance, graded with a validated checklist by blinded physician reviewers. Learner knowledge and satisfaction were also evaluated. Analysis was conducted using noninferiority testing.

RESULTS

Eighty-five students, 11 attending physicians, and 7 NPCFs voluntarily participated. Noninferiority testing of the difference in CVC insertion performance between NPCF-trained learners versus physician-trained learners found no significant difference [rejecting the null hypothesis of inferiority using an 8% noninferiority margin (P < 0.01)]. In addition, there was no difference found between the 2 groups on pre/post knowledge scores, self-reported learner comfort, course satisfaction, or instructor satisfaction.

CONCLUSIONS

An introductory CVC curriculum can be taught to novice learners by carefully trained and supported NPCFs and achieve skill and knowledge outcomes similar to learners taught by physicians.

Applying Educational Theory and Best Practices to Solve Common Challenges of Simulation-based Procedural Training in Emergency Medicine

OBJECTIVES

Procedural competency is an essential prerequisite for the independent practice of emergency medicine. Multiple studies demonstrate that simulation-based procedural training (SBPT) is an effective method for acquiring and maintaining procedural competency and preferred over traditional paradigms ("see one, do one, teach one"). Although newer paradigms informing SBPT have emerged, educators often face circumstances that challenge and undermine their implementation. The goal of this paper is to identify and report on best practices and theory-supported solutions to some of these challenges as derived using a process of expert consensus building and reviews of the existing literature on SBPT.

METHODS

The Society for Academic Emergency Medicine (SAEM) Simulation Academy SBPT Workgroup convened approximately 8 months prior to the 2019 SAEM Annual Meeting to perform a review of the literature and participate in a consensus-building process to identify solutions (in the form of best practices and educational theory) to these challenges faced by educators engaging in SBPT.

RESULTS AND ANALYSIS

Thirteen distinct educational challenges to SBPT emerged from the expert group's primary literature reviews and consensus-building processes. Three domains emerged upon further analysis of the 13 challenges: learner, educator, and curriculum. Six challenges within the "learner" domain were selected for comprehensive discussion in this paper, as they were deemed representative of the most common and most significant threats to ideal SBPT. Each of the six challenges aligns with one of the following themes: 1) maximizing active learning, 2) maintaining learner engagement, 3) embracing learner diversity, 4) optimizing cognitive load, 5) promoting mindfulness and reflection, and 6) emphasizing deliberate practice for mastery learning. Over 20 "special treatments" for mitigating the impact of the 13 challenges were derived from the secondary literature search and consensus-building process prior to and during the preconference workshop; 11 of these that best address the six learner-centered challenges are explored, including implications for educators involved in SBPT.

CONCLUSIONS/IMPLICATIONS FOR EDUCATORS

We propose multiple consensus-generated solutions (in the form of best practices and applied educational theory) that we believe are suitable and well aligned to overcome commonly encountered learner-centered challenges and threats to optimal SBPT.

A simulation procedure curriculum to increase pediatric resident exposure to procedures rarely performed in clinical practice

BACKGROUND

Pediatrics residents are expected by the Accreditation Council for Graduate Medical Education to competently perform 13 procedures. However, residents are graduating with poor self-perceived competency for these procedures.

OBJECTIVE

We developed a curriculum using simulation training at the beginning of internship and 'refresher' workshops throughout the year in order to increase procedure exposure and improve self-perceived competency.

DESIGN

Procedural workshops were taught during intern orientation and to all pediatrics residents throughout the academic year. Residents provided a quantitative competency self-assessment before and after each workshop; interns provided an additional self-assessment at the end of the intern year.

RESULTS

The curriculum was well-liked and led to more procedural experience. Mean competency self-assessment scores improved immediately after almost every procedure workshop. Mean scores were retained at the end of intern year for most procedures. However, end-of-year mean competency self-assessment and procedural experience on actual patients were similar to interns from a previous year that had not participated in the curriculum.

CONCLUSIONS

A pre-internship procedure workshop coupled with longitudinal workshops is a feasible way to improve intern exposure to pediatric procedural training. However, it was not sufficient to improve mean competency self-assessments compared to a traditional model of bedside procedural training.