Deliberate practice and acquisition of expert performance: a general overview

Novel cricothyrotomy assessment tool for attending physicians: A multicenter study of an error avoidance checklist

BACKGROUND

This study used existing literature and expert feedback to develop and pilot a novel error-avoidance checklist tool for cricothyrotomy in attending physicians. Prior literature has not focused on expert cricothyrotomy performance. While published checklists teach a specific procedural method, ideal for novice learners, this may hinder expert learners.

OBJECTIVES

We endeavored to create a succinct error-avoidance checklist for cricothyrotomy. We hypothesized that such a checklist would prove feasible and acceptable to attending physicians.

METHODS

This is a multicenter prospective checklist creation, evaluation, and feasibility study. Multiple experts pursued an iterative process to reach consensus on a 7-item error-avoidance checklist. The checklist was trialed for feasibility in pilot sessions at two sites by 45 attending emergency physicians who used the checklist for peer performance assessment and provided feedback.

RESULTS

During the pilot implementation, 94% of respondents completed the procedure within the allotted 120 s. Greater than 85% of respondents agreed that four of the five procedural errors on the checklist were very or somewhat critical to avoid, including cutting >2 cm from midline, creating a false passage, failing to continuously maintain an object in the trachea, and injuring oneself during the procedure. Only 66% of participants felt severing the cricoid cartilage was critical. Successful breath administration and time under 120 s were critical for 100% and 95% of participants, respectively. The checklist was rated "easy" or "very easy" to use by 93% of participants, and 95% found this checklist reasonable for evaluating attending physicians.

CONCLUSIONS

We present the multicenter development and implementation of a novel error-avoidance checklist tool for use in expert cricothyrotomy performance. Attending emergency medicine (EM) physicians rated our tool easy to use and agreed that most of the proposed errors were critical. Participants overwhelmingly agreed this tool would be reasonable for evaluation of cricothyrotomy performance among attending EM physicians.

Validation of an Automated System for Identifying Complications of Serious Pediatric Emergencies

BACKGROUND

Illness complications are condition-specific adverse outcomes. Detecting complications of pediatric illness in administrative data would facilitate widespread quality measurement, however the accuracy of such detection is unclear.

METHODS

We conducted a cross-sectional study of patients visiting a large pediatric emergency department. We analyzed those <22 years old from 2012 to 2019 with 1 of 14 serious conditions: appendicitis, bacterial meningitis, diabetic ketoacidosis (DKA), empyema, encephalitis, intussusception, mastoiditis, myocarditis, orbital cellulitis, ovarian torsion, sepsis, septic arthritis, stroke, and testicular torsion. We applied a method using disposition, diagnosis codes, and procedure codes to identify complications. The automated determination was compared with the criterion standard of manual health record review by using positive predictive values (PPVs) and negative predictive values (NPVs). Interrater reliability of manual reviews used a κ.

RESULTS

We analyzed 1534 encounters. PPVs and NPVs for complications were >80% for 8 of 14 conditions: appendicitis, bacterial meningitis, intussusception, mastoiditis, myocarditis, orbital cellulitis, sepsis, and testicular torsion. Lower PPVs for complications were observed for DKA (57%), empyema (53%), encephalitis (78%), ovarian torsion (21%), and septic arthritis (64%). A lower NPV was observed in stroke (68%). The κ between reviewers was 0.88.

CONCLUSIONS

An automated method to measure complications by using administrative data can detect complications in appendicitis, bacterial meningitis, intussusception, mastoiditis, myocarditis, orbital cellulitis, sepsis, and testicular torsion. For DKA, empyema, encephalitis, ovarian torsion, septic arthritis, and stroke, the tool may be used to screen for complicated cases that may subsequently undergo manual review.

The competency-based medical education evolution of Canadian emergency medicine specialist training

Canadian specialist emergency medicine (EM) residency training is undergoing the most significant transformation in its history. This article describes the rationale, process, and redesign of EM competency-based medical education. The rationale for this evolution in residency education includes 1) improved public trust by increasing transparency of the quality and rigour of residency education, 2) improved fiscal accountability to government and institutions regarding specialist EM training, 3) improved assessment systems to replace poor functioning end-of-rotation assessment reports and overemphasis on high-stakes, end-of-training examinations, and 4) and tailored learning for residents to address individualized needs. A working group with geographic and stakeholder representation convened over a 2-year period. A consensus process for decision-making was used. Four key design features of the new residency education design include 1) specialty EM-specific outcomes to be achieved in residency; 2) designation of four progressive stages of training, linked to required learning experiences and entrustable professional activities to be achieved at each stage; 3) tailored learning that provides residency programs and learner flexibility to adapt to local resources and learner needs; and 4) programmatic assessment that emphasizes systematic, longitudinal assessments from multiple sources, and sampling sentinel abilities. Required future study includes a program evaluation of this complex education intervention to ensure that intended outcomes are achieved and unintended outcomes are identified.

Isolating steps instead of learners: Use of deliberate practice and validity evidence in coronavirus disease (COVID)-era procedural assessment

Background

In surgical training, assessment tools based on strong validity evidence allow for standardized evaluation despite changing external circumstances. At a large academic institution, surgical interns undergo a multimodal curriculum for central line placement that uses a 31-item binary assessment at the start of each academic year. This study evaluated this practice within increased in-person learning restrictions. We hypothesized that external constraints would not affect resident performance nor assessment due to a robust curriculum and assessment checklist.

Methods

From 2018 to 2020, 81 residents completed central line training and assessment. In 2020, this curriculum was modified to conform to in-person restrictions and social distancing guidelines. Resident score reports were analyzed using multivariate analyses to compare performance, objective scoring parameters, and subjective assessments among “precoronavirus disease” years (2018 and 2019) and 2020.

Results

There were no significant differences in average scores or objective pass rates over 3 years. Significant differences between 2020 and precoronavirus disease years occurred in subjective pass rates and in first-time success for 4 checklist items: patient positioning, draping, sterile ultrasound probe cover placement, and needle positioning before venipuncture.

Conclusion

Modifications to procedural training within current restrictions did not adversely affect residents’ overall performance. However, our data suggest that in 2020, expert trainers may not have ensured learner acquisition of automated procedural steps. Additionally, although 2020 raters could have been influenced by logistical barriers leading to more lenient grading, the assessment tool ensured training and assessment integrity.

Discharge Communication: A Multi-Institutional Survey of Internal Medicine Residents' Education and Practices

PURPOSE

To characterize residents' practices around hospital discharge communication and their exposure to transitions-of-care instruction in graduate medical education (GME).

METHOD

In 2019, internal medicine residents at 7 academic medical centers completed a cross-sectional survey reporting the types of transitions-of-care instruction they experienced during GME training and the frequency with which they performed 6 key discharge communication practices. The authors calculated a mean discharge communication score for each resident, and, using multiple logistic regression, they analyzed the relationship between exposure to types of educational experiences and discharge communication practices residents reported they performed frequently (> 60% of time). The authors used content analysis to explore factors that motivated residents to change their discharge practices.

RESULTS

The response rate was 63.5% (613/966). Resident discharge communication practices varied. Notably, only 17.0% (n = 104) reported routinely asking patients to "teach-back" or explain their understanding of the discharge plans. The odds of frequently performing key discharge communication practices were greater if residents received instruction based on observation of and feedback regarding their communication (adjusted odds ratio 1.73; 95% confidence interval [CI], 1.07-2.81) or if they received explicit on-rounds teaching (adjusted OR 1.46; 95% CI, 1.04-2.23). In open-ended comments, residents reported that experiencing adverse patient events at some point in the postdischarge continuum was a major impetus for practice change.

CONCLUSIONS

This study exposes gaps in hospital discharge communication with patients, highlights the benefits of workplace-based instruction on discharge communication skills, and reveals the influence of adverse events as a source of hidden curricula. The results suggest that developing faculty to incorporate transitions-of-care instruction in their rounds teaching and integrating experiences across the postdischarge continuum into residents' education may foster physicians-in-training who are champions of effective transitions of care within the fragmented health care system.

Direct Observation Tools in Emergency Medicine: A Systematic Review of the Literature

OBJECTIVES

Direct observation is important for assessing the competency of medical learners. Multiple tools have been described in other fields, although the degree of emergency medicine-specific literature is unclear. This review sought to summarize the current literature on direct observation tools in the emergency department (ED) setting.

METHODS

We searched PubMed, Scopus, CINAHL, the Cochrane Central Register of Clinical Trials, the Cochrane Database of Systematic Reviews, ERIC, PsycINFO, and Google Scholar from 2012 to 2020 for publications on direct observation tools in the ED setting. Data were dual extracted into a predefined worksheet, and quality analysis was performed using the Medical Education Research Study Quality Instrument.

RESULTS

We identified 38 publications, comprising 2,977 learners. Fifteen different tools were described. The most commonly assessed tools included the Milestones (nine studies), Observed Structured Clinical Exercises (seven studies), the McMaster Modular Assessment Program (six studies), Queen's Simulation Assessment Test (five studies), and the mini-Clinical Evaluation Exercise (four studies). Most of the studies were performed in a single institution, and there were limited validity or reliability assessments reported.

CONCLUSIONS

The number of publications on direct observation tools for the ED setting has markedly increased. However, there remains a need for stronger internal and external validity data.

Should attendance for preclinical simulation and clinical education be mandatory?

Mandatory attendance, particularly in didactic settings, is a highly debated topic in higher education, including dental education. Within dental education, a large portion of education occurs in preclinical laboratories and clinical environments. There is little to no research on attendance in these settings in dental schools. This point/counterpoint paper examines the pros and cons of mandatory attendance in these highly specialized educational settings. With the backdrop of the COVID-19 pandemic that began in March 2020 and continues to impact dental education at the time of publication, this topic has become even more relevant. Viewpoint 1 claims that attendance should be mandatory because a greater exposure to preclinical and clinical environments helps foster better clinical hand skills, critical thinking, decision-making, problem-solving skills, and an overall sense of professional identity. It goes on further to suggest that there may be a link between attendance and performance in exams and that attendance is part of the dental school's responsibility. Viewpoint 2 argues that the rationale for attendance is complex, and that creating learning environments that are psychologically safe will incentivize students to attend, even without mandatory attendance policies. Furthermore, it explains that technological advances have allowed dental schools to think creatively about asynchronous learning, which by its very nature does not require attendance at a given time. The authors of both viewpoints conclude that the preclinical and clinical education and experience are critical dental education and that dental school leaders should focus on improving the quality of these experiences.

Cochlear implant surgery: Learning curve in virtual reality simulation training and transfer of skills to a 3D-printed temporal bone - A prospective trial

OBJECTIVE

Mastering Cochlear Implant (CI) surgery requires repeated practice, preferably initiated in a safe - i.e. simulated - environment. Mastoidectomy Virtual Reality (VR) simulation-based training (SBT) is effective, but SBT of CI surgery largely uninvestigated. The learning curve is imperative for understanding surgical skills acquisition and developing competency-based training. Here, we explore learning curves in VR SBT of CI surgery and transfer of skills to a 3D-printed model.

METHODS

Prospective, single-arm trial. Twenty-four novice medical students completed a pre-training CI inserting test on a commercially available pre-drilled 3D-printed temporal bone. A training program of 18 VR simulation CI procedures was completed in the Visual Ear Simulator over four sessions. Finally, a post-training test similar to the pre-training test was completed. Two blinded experts rated performances using the validated Cochlear Implant Surgery Assessment Tool (CISAT). Performance scores were analyzed using linear mixed models.

RESULTS

Learning curves were highly individual with primary performance improvement initially, and small but steady improvements throughout the 18 procedures. CI VR simulation performance improved 33% (p < 0.001). Insertion performance on a 3D-printed temporal bone improved 21% (p < 0.001), demonstrating skills transfer.

DISCUSSION

VR SBT of CI surgery improves novices' performance. It is useful for introducing the procedure and acquiring basic skills. CI surgery training should pivot on objective performance assessment for reaching pre-defined competency before cadaver - or real-life surgery. Simulation-based training provides a structured and safe learning environment for initial training.

CONCLUSION

CI surgery skills improve from VR SBT, which can be used to learn the fundamentals of CI surgery.

Implicit Bias Recognition and Management: Tailored Instruction for Faculty

BACKGROUND

Implicit bias instruction is becoming more prevalent across the continuum of medical education. Little guidance exists for faculty on recognizing and debriefing about implicit bias during routine clinical encounters.

OBJECTIVE

To assess the impact and feasibility of single seminars on implicit bias and the approach to its management in clinical settings.

METHODS

Between September 2016 and November 2017, the authors delivered five departmental/divisional grand rounds across three different academic medical centers in New York, USA. Instruction provided background information on implicit bias, highlighted its relevance to clinical care, and discussed proposed interventions. To evaluate the impact of instruction participants completed a twelve-item retrospective pre-intervention/post-intervention survey. Questions related to comfort and confidence in recognizing and managing implicit bias, debriefing with learners, and role-modeling behaviors. Participants identified strategies for recognizing and managing potentially biased events through free text prompts. Authors qualitatively analyzed participants' identified strategies.

RESULTS

We received 116 completed surveys from 203 participants (57% response rate). Participants self-reported confidence and comfort increased for all questions. Qualitative analysis resulted in three themes: looking inward, looking outward, and taking action at individual and institutional levels.

CONCLUSION

After a single session, respondents reported increased confidence and comfort with the topic. They identified strategies relevant to their professional contexts which can inform future skills-based interventions. For healthcare organizations responding to calls for implicit bias training, this approach has great promise. It is feasible and can reach a wide audience through usual grand rounds programming, serving as an effective early step in such training.

Can hospital adult code-teams and individual members perform high-quality CPR? A multicenter simulation-based study incorporating an educational intervention with CPR feedback

Aims

A multicenter simulation-based research study to assess the ability of interprofessional code-teams and individual members to perform high-quality CPR (HQ-CPR) at baseline and following an educational intervention with a CPR feedback device.

Methods

Five centers recruited ten interprofessional teams of AHA-certified adult code-team members with a goal of 200 participants. Baseline testing of chest compression (CC) quality was measured for all individuals. Teams participated in a baseline simulated cardiac arrest (SCA) where CC quality, chest compression fraction (CCF), and peri-shock pauses were recorded. Teams participated in a standardized HQ-CPR and abbreviated TeamSTEPPS® didactic, then engaged in deliberate practice with a CPR feedback device. Individuals were assessed to determine if they could achieve ≥80% combined rate and depth within 2020 AHA guidelines. Teams completed a second SCA and CPR metrics were recorded. Feedback was disabled for assessments except at one site where real-time CPR feedback was the institutional standard. Linear regression models were used to test for site effect and paired t-tests to evaluate significant score changes. Logistic univariate regression models were used to explore characteristics associated with the individual achieving competency.

Results

Data from 184 individuals and 45 teams were analyzed. Baseline HQ-CPR mean score across all sites was 18.5% for individuals and 13.8% for teams. Post-intervention HQ-CPR mean score was 59.8% for individuals and 37.0% for teams. There was a statistically significant improvement in HQ-CPR mean scores of 41.3% (36.1, 46.5) for individuals and 23.2% (17.1, 29.3) for teams (p < 0.0001). CCF increased at 3 out of 5 sites and there was a mean 5-s reduction in peri-shock pauses (p < 0.0001). Characteristics with a statistically significant association were height (p = 0.01) and number of times performed CPR (p = 0.01).

Conclusion

Code-teams and individuals struggle to perform HQ-CPR but show improvement after deliberate practice with feedback as part of an educational intervention. Only one site that incorporated real-time CPR feedback devices routinely achieved ≥80% HQ-CPR.

Helping the Surgeon Recover: Peer-to-Peer Coaching after Bile Duct Injury

BACKGROUND

Bile duct injury sustained during laparoscopic cholecystectomy is associated with high morbidity and mortality, and can be a devastating complication for a general surgeon. We introduce a novel, individualized surgical coaching program for surgeons who recently injured a bile duct in laparoscopic cholecystectomy. We aim to explore the perception of coaching among these surgeons and to assess surgeons' experiences in the coaching program.

STUDY DESIGN

Six general surgeons who injured a bile duct at an emergency laparoscopic cholecystectomy participated in a 1-on-1 coaching session with a hepatopancreatobiliary surgeon. The session focused on debriefing the index case with video feedback, and discussion of strategies for safe laparoscopic cholecystectomy. The pilot program ran from March to November 2020. Exit interviews were then conducted. Themes covering perception of surgical training, perception of complications, and experience in the coaching program were explored.

RESULTS

Surgeons were generally accepting of the coaching program, especially when the goals aligned with their self-identified areas of development. One-on-1 sessions with a local expert in the area, and the use of video feedback created a unique and interactive coaching opportunity. Peer coaching was identified as a valuable resource in helping surgeons regain confidence and maintain well-being after a bile duct injury. Maintaining a collegial, nonjudgmental relationship is critical in establishing positive coaching experiences.

CONCLUSIONS

An individualized surgical coaching program creates a unique opportunity for professional development and may help promote safe laparoscopic cholecystectomy.

Using Virtual Patients to Explore the Clinical Reasoning Skills of Medical Students: Mixed Methods Study

BACKGROUND

Improving clinical reasoning skills-the thought processes used by clinicians to formulate appropriate questions and diagnoses-is essential for reducing missed diagnostic opportunities. The electronic Clinical Reasoning Educational Simulation Tool (eCREST) was developed to improve the clinical reasoning of future physicians. A feasibility trial demonstrated acceptability and potential impacts; however, the processes by which students gathered data were unknown.

OBJECTIVE

This study aims to identify the data gathering patterns of final year medical students while using eCREST and how eCREST influences the patterns.

METHODS

A mixed methods design was used. A trial of eCREST across 3 UK medical schools (N=148) measured the potential effects of eCREST on data gathering. A qualitative think-aloud and semistructured interview study with 16 medical students from one medical school identified 3 data gathering strategies: Thorough, Focused, and Succinct. Some had no strategy. Reanalysis of the trial data identified the prevalence of data gathering patterns and compared patterns between the intervention and control groups. Patterns were identified based on 2 variables that were measured in a patient case 1 month after the intervention: the proportion of Essential information students identified and the proportion of irrelevant information gathered (Relevant). Those who scored in the top 3 quartiles for Essential but in the lowest quartile for Relevant displayed a Thorough pattern. Those who scored in the top 3 quartiles for Relevant but in the lowest quartile for Essential displayed a Succinct pattern. Those who scored in the top 3 quartiles on both variables displayed a Focused pattern. Those whose scores were in the lowest quartile on both variables displayed a Nonspecific pattern.

RESULTS

The trial results indicated that students in the intervention group were more thorough than those in the control groups when gathering data. The qualitative data identified data gathering strategies and the mechanisms by which eCREST influenced data gathering. Students reported that eCREST promoted thoroughness by prompting them to continuously reflect and allowing them to practice managing uncertainty. However, some found eCREST to be less useful, and they randomly gathered information. Reanalysis of the trial data revealed that the intervention group was significantly more likely to display a Thorough data gathering pattern than controls (21/78, 27% vs 6/70, 9%) and less likely to display a Succinct pattern (13/78, 17% vs 20/70, 29%; χ²₃=9.9; P=.02). Other patterns were similar across groups.

CONCLUSIONS

Qualitative data suggested that students applied a range of data gathering strategies while using eCREST and that eCREST encouraged thoroughness by continuously prompting the students to reflect and manage their uncertainty. Trial data suggested that eCREST led students to demonstrate more Thorough data gathering patterns. Virtual patients that encourage thoroughness could help future physicians avoid missed diagnostic opportunities and enhance the delivery of clinical reasoning teaching.

Simulated airway drills as a tool to measure and guide improvements in endotracheal intubation preparation in the paediatric emergency department

Introduction

Emergent paediatric intubation is an infrequent but high-stakes procedure in the paediatric emergency department (PED). Successful intubations depend on efficient and accurate preparation. The aim of this study was to use airway drills (brief in-situ simulations) to identify gaps in our paediatric endotracheal intubation preparation process, to improve on our process and to demonstrate sustainability of these improvements over time in a new staff cohort.

Method

This was a single-centre, simulation-based improvement study. Baseline simulated airway drills were used to identify barriers in our airway preparation process. Drills were scored for time and accuracy on an iteratively developed 16-item rubric. Interventions were identified and their impact was measured using simulated airway drills. Statistical analysis was performed using unpaired t-tests between the three data collection periods.

Results

Twenty-five simulated airway drills identified gaps in our airway preparation process and served as our baseline performance. The main problem identified was that staff members had difficulty locating essential airway equipment. Therefore, we optimised and implemented a weight-based airway cart. We demonstrated significant improvement and sustainability in the accuracy of obtaining essential airway equipment from baseline to postintervention (62% vs 74%; p=0.014), and postintervention to sustainability periods (74% vs 77%; p=0.573). Similarly, we decreased and sustained the time (in seconds) required to prepare for a paediatric intubation from baseline to postintervention (173 vs 109; p=0.001) and postintervention to sustainability (109 vs 103; p=0.576).

Conclusions

Simulated airway drills can be used as a tool to identify process gaps, measure and improve paediatric intubation readiness.

Do team and task performance improve after training situation awareness? A randomized controlled study of interprofessional intensive care teams

Background

When working in complex environments with critically ill patients, team performance is influenced by situation awareness in teams. Moreover, improved situation awareness in the teams will probably improve team and task performance. The aim of this study is to evaluate an educational programme on situation awareness for interprofessional teams at the intensive care units using team and task performance as outcomes.

Method

Twenty interprofessional teams from the northern part of Sweden participated in this randomized controlled intervention study conducted in situ in two intensive care units. The study was based on three cases (cases 0, 1 and 2) with patients in a critical situation. The intervention group (n = 11) participated in a two-hour educational programme in situation awareness, including theory, practice, and reflection, while the control group (n = 9) performed the training without education in situation awareness. The outcomes were team performance (TEAM instrument), task performance (ABCDE checklist) and situation awareness (Situation Awareness Global Assessment Technique (SAGAT)). Generalized estimating equation were used to analyse the changes from case 0 to case 2, and from case 1 to case 2.

Results

Education in situation awareness in the intervention group improved TEAM leadership (p = 0.003), TEAM task management (p = 0.018) and TEAM total (p = 0.030) when comparing cases 1 and 2; these significant improvements were not found in the control group. No significant differences were observed in the SAGAT or the ABCDE checklist.

Conclusions

This intervention study shows that a 2-h education in situation awareness improved parts of team performance in an acute care situation. Team leadership and task management improved in the intervention group, which may indicate that the one or several of the components in situation awareness (perception, comprehension and projection) were improved. However, in the present study this potential increase in situation awareness was not detected with SAGAT. Further research is needed to evaluate how educational programs can be used to increase situation awareness in interprofessional ICU teams and to establish which components that are essential in these programs.

Trial registration

This randomized controlled trial was not registered as it does not report the results of health outcomes after a health care intervention on human participants.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13049-021-00878-2.

Deliberate practice and mastery learning in resuscitation education: A scoping review

STUDY AIM

To summarize the current state of knowledge of deliberate practice and mastery learning (DP and/or ML) as teaching methods for resuscitation education.

METHODS

A scoping review of PubMed, Scopus, and Embase was conducted through March 1, 2021. Studies examining the effect of the incorporation of either deliberate practice and/or mastery learning during resuscitation education were eligible for inclusion. Included studies were dichotomized into studies comparing deliberate practice and/or mastery learning to other training methods (randomized controlled trials) and studies examining before and after impact of deliberate practice and/or mastery learning alone (observational studies). Studies and findings were tabulated and summarized using the scoping review methodology published by Arksey and O'Malley.

RESULTS

63 published studies were screened; sixteen studies met all inclusion criteria (4 randomized controlled trials and 12 observational studies). One randomized controlled trial and eleven observational studies demonstrated improvement in skill and/or knowledge following educational interventions using deliberate practice and/or mastery learning. Significant variability between studies with regard to research designs, learner groups, comparators, and outcomes of interest made quantitative summarization of findings difficult.

CONCLUSIONS

The incorporation of deliberate practice and/or mastery learning in resuscitation education may be associated with improved educational outcomes and less skill decay than other educational methods. Current literature on DP and ML suffers from a lack of consistency in research methodology, subjects, and outcomes. Future research should employ uniform definitions for deliberate practice and mastery learning, follow research design that isolates its effect, and examine generalizable and translatable outcomes.

Comparison of Self-Directed and Instructor-Led Practice Sessions for Teaching Clinical Skills in Food Animal Reproductive Medicine

While the use of simulator-based clinical skill training has become increasingly popular in veterinary education in recent years, little research has been done regarding optimal implementation of such tools to maximize student learning in veterinary curricula. The objective of this study was to compare the effects of supervised and unsupervised deliberate practice on clinical skills development in veterinary medicine students. A total of 150 veterinary students took part in instructor-led practice (supervised) or self-directed practice (unsupervised) at a selection of four learning stations in a veterinary skills laboratory. Each learning station consisted of a teaching simulator, materials required to complete the task, and a standard operating procedure detailing how to execute the task. Students used Likert scales to self-evaluate their clinical skills before and after practice sessions, in addition to evaluating their motivation to practice a given task. An objective structured clinical examination (OSCE) was used to compare participants' clinical skills performance between learning stations. We were able to show that practice had a significant positive effect on OSCE scores at three out of six available learning stations. Motivation ratings varied between learning stations and were positively correlated with an increase in self-perceived clinical skills. At an instructor-to-student ratio of approximately 1:8, supervision had no effect on OSCE scores at four out of six learning stations. At the remaining two learning stations, self-directed practice resulted in better learning outcomes than instructor-led practice.

Child maltreatment online education for healthcare and social service providers: Implications for the COVID-19 context and beyond

Evidence indicates that healthcare and social service providers (HSSPs) receive inadequate education related to recognizing and responding to child maltreatment. This is despite the fact HSSPs are identified as an important factor in the primary, secondary, and tertiary prevention of this childhood exposure. The need for online education for HSSPs' is highlighted during the COVID-19 pandemic restrictions and will continue to be relevant afterward. The objective of this commentary is to provide an overview of: (a) educational interventions for HSSPs' related to recognizing and responding to child maltreatment; (b) the development of VEGA (Violence, Evidence, Guidance, Action), which is an online platform of educational resources to support HSSPs to recognize and respond to child maltreatment; and (c) the RISE (Researching the Impact of Service provider Education) project, which is an ongoing multi-province evaluation of VEGA in Canada. It is important to consider ongoing ways that HSSPs can receive education related to recognizing and responding to child maltreatment. The virtual implementation of VEGA and the RISE Project provide a necessary opportunity to continue to increase the capacity of Canada's HSSPs to adequately and safely recognize and respond to child maltreatment, while simultaneously advancing education scholarship for the field of child maltreatment and which will have relevance for the COVID-19 context and beyond.

Before the scalpel: Exploring surgical residents' preoperative preparatory strategies

OBJECTIVE

This study sought to increase understanding of preoperative preparatory strategies utilised by senior surgical residents and identify how social and material forces come together to shape practice.

SUMMARY/BACKGROUND DATA

Preoperative preparation can play a powerful role in operative learning. Residents rarely receive guidance, feedback, or explicit expectations on how to prepare for the OR. Understanding current practice and how to support preoperative preparation represents an important gap in our efforts to improve surgical training.

METHODS

Constructivist grounded theory with sensitizing concepts from sociomateriality guided data collection and analysis. Fifteen senior surgical residents from a range of surgical disciplines were purposefully sampled and participated in an in-depth individual interview. Two return-of-finding focus groups followed with seven residents. Rigor was enhanced through constant comparison, theoretical sampling, pursuit of discrepant data, and investigator triangulation.

RESULTS

Residents utilised a range of strategies addressing four areas of focus: develop technical skills, improve procedural knowledge, enhance patient-specificity, and know surgical preferences. However, residents also described receiving limited guidance on what it means to 'be prepared' and experience significant challenges in achieving preparedness. A mix of social and material things that enabled or constrained preparatory efforts influenced individual strategies. These included rotation structure, relationships, the OR list, and time.

CONCLUSIONS

Our findings offer possible solutions by elaborating on preparatory variability and considerations for residents, faculty, and programs to improve practice. As a first step, we suggest programs begin to engage in explicit dialogue and reflection with their residents, faculty, and residency program committees.

Developing Academic Leadership From a Distance: A Health Professions Education Practicum Course

PROBLEM

Leadership skills are fundamental to the successful practice of health professions education (HPE), but HPE degree programs struggle with providing meaningful leadership instruction from a distance.

APPROACH

The leaders of the HPE program at the Uniformed Services University of the Health Sciences developed a practicum course to give learners guided experiences in their daily leadership roles and responsibilities from a distance. The ongoing practicum course, started in fall 2018 and broadly framed by the principles of deliberate practice and self-directed learning, involves a 6-step process where learners: (1) identify leadership competency/ies to develop, (2) identify roles and responsibilities in their own work settings that involve elements of leadership, (3) develop a learning agreement that identifies personal leadership goals for the practicum activity, (4) are assigned expert preceptors by practicum directors, (5) initiate regular meetings with their preceptors to receive feedback and expert advice, and (6) end the practicum activity with a debriefing reflection between themselves and their preceptors. Practicum activity timelines are flexible and preceptors work with learners through the lifespan of the project. Learners can participate in multiple practicum activities as they improve different leadership competencies.

OUTCOMES

Since fall 2018, 36 learners have participated in 83 practicum activities, 45 (54%) of which have been completed. The practicum activities show that leadership competencies are most often embedded within other activities and are unique to every situation. Reflecting on practice, collaborating in teams, and negotiating and resolving conflict are the most commonly identified leadership competencies learners want to improve. Feedback on the practicum from learners has been positive.

NEXT STEPS

This practicum course provides a model that can be applied in various organizational contexts. In the future, the authors plan to collect data from both learners and preceptors about their experiences and solicit feedback from learners' employers and supervisors.

Whole consultation simulation in undergraduate surgical education: a breast clinic case study

BACKGROUND

Safe and effective clinical outcomes (SECO) clinics enable medical students to integrate clinical knowledge and skills within simulated environments. This realistic format may better prepare students for clinical practice. We aimed to evaluate how simulated surgical clinics based on the SECO framework aligned with students' educational priorities in comparison with didactic tutorials.

METHODS

We delivered two breast surgery SECO-based simulated clinics to Year 3 students during their surgical attachments at a London teaching hospital. All students attended a didactic breast surgery tutorial the previous week. Pre- and post-session surveys and post-session debriefs were used to explore learning gain, processes, preferences and impacts on motivation to learn. Data were analysed using inductive thematic analysis to categorise student views into themes.

RESULTS

Seventeen students enrolled in the simulated clinics and debriefs. Students expressed that passing examinations was a key extrinsic motivating factor, although the SECO-based format appeared to shift their motivation for learning towards aspiring to be clinically competent. Self-reported confidence in clinical skills such as history taking and examination improved significantly. Active learning methods were valued. Students expressed a preference for simulated clinics to complement, but not replace, tutorial-based learning.

CONCLUSION

The SECO-based simulated clinic promoted a shift towards intrinsic motivation for learning by allowing students to recognise the importance of preparing for clinical practice in addition to passing examinations. Integration of surgical simulated clinics into the undergraduate curriculum could facilitate acquisition of clinical skills through active learning, a method highly valued by students.

Introduction of robotic surgery does not negatively affect cardiothoracic surgery resident experience

The objective of this study was to evaluate the educational impact following the implementation of a robotic thoracic surgery program on cardiothoracic (CT) surgery trainees. We hypothesized that the introduction of a robotic thoracic surgery program would adversely affect the CT surgery resident experience, decreasing operative involvement and subsequent competency of surgical procedures. CT surgery residents and thoracic surgery attendings from a single academic institution were administered a recurring, electronic survey from September 2019 to September 2020 following each robotic thoracic surgery case. Surveys evaluated resident involvement and operative performance. This study was exempt from review by our Institutional Review Board. Attendings and residents completed surveys for 86 and 75 cases, respectively. Residents performed > 50% of the operation independently at the surgeon console in 66.2 and 73.3% of cases according to attending and resident responses, respectively. The proportion of trainees able to perform > 75% of the operation increased with each increasing year in training (p = 0.002). Based on the Global Evaluative Assessment of Robotic Skills grading tool, third-year residents averaged higher scores compared to first-year residents (22.9 versus 17.4 out of 30 possible points, p < 0.001), indicating that more extensive prior operative experience could shorten the learning curve of robotic thoracic surgery. CT surgery residents remain actively involved in an operative role during the establishment of a robotic thoracic surgery program. The transition to a robotic thoracic surgery platform appears feasible in a large academic setting without jeopardizing the educational experience of resident trainees.

Oncology boot camp: A preparatory curriculum for advanced pharmacy practice experience students

INTRODUCTION

The primary objective of this study was to evaluate the effectiveness of an autonomous oncology boot camp on Advanced Pharmacy Practice Experience (APPE) student knowledge. Secondary objectives included assessing student perception of the virtual learning experience and overall comfort level with the material.

METHODS

APPE students rotating through our institution between November 2019 and March 2020 were voluntarily enrolled in a 4-hour oncology-focused boot camp, which included five PlayPosit (Denver, CO, USA) interactive video lectures embedded with case-based application questions followed by one comprehensive web-based Quandary (Victoria, BC, Canada) action-maze case. Student learning was measured by a pre- and post-intervention exam. A web survey tool (Qualtrics, Provo, UT, USA) collected student perceptions evaluating their comfort with oncology-specific drug knowledge and APPE rotations tasks.

RESULTS

Fifty students enrolled in the oncology boot camp, with 100% completing the pre- and post-intervention assessments. Overall, pre-intervention exam scores (mean: 55.4%, SD: 21.8%) improved by 23.2% following the boot camp (mean: 78.6%, SD: 19.2%; p < 0.001). Students performed better on all 10 exam questions, with 6 questions showing a statistically significant improvement (p < 0.05). Forty-five students (90%) completed the perception surveys. Of those, 93% agreed that it effectively reinforced important oncology knowledge, 91% supported the autonomous design, and 82% would recommend the oncology boot camp for future students.

CONCLUSION

The boot camp proved to be a beneficial educational tool that enhanced student knowledge and confidence in navigating common oncology concepts. Students valued the ability to independently complete the activities and supported its continuation.

Theoretical knowledge and skill retention 3 and 6 months after a European Newborn Life Support provider course

INTRODUCTION

The European Resuscitation Council Newborn Life Support Course (ERC- NLS) aims at training healthcare professionals, involved in perinatal care, in order to intervene efficiently and promptly to assist transition or resuscitate neonates who require help at birth. However, limited data exists for the retention of the theoretical knowledge and practical skills provided by the course. This study aims to evaluate the degree of knowledge and skill retention 3 and 6 months after the ERC-NLS provider course.

METHODS

This is a prospective study. Theoretical knowledge was evaluated using the ERC-approved NLS written test (50 True/False questions). Evaluation of technical skills included performance, on an Advanced Life Support neonatal maniquin (LAERDAL), of airway management, ventilation and support of circulation (21 detailed skills). The effect of certain factors on theoretical skill retention was also evaluated.

RESULTS

One hundred and sixteen (n = 116) participants were initially recruited in the study (12 males and 104 females). Theoretical knowledge was evaluated in 113 participants (3 participants missed follow-up appointments) and technical skills in 80 participants. The mean score for theoretical knowledge was 86.24% ± 5.3, 80.88% ± 7.43 and 80.04% ± 7.04 at baseline, at 3 and 6 months, respectively. This difference was significant among the three time points (baseline vs 3 months: p < 0.001; baseline vs 6 months: p < 0.001; 3 month's vs 6 months: p = 0.034). Although gender did not have an effect, doctors and participants of higher education yielded higher score of success. Regarding technical skills, 9 skills showed a continuous decline of performance from baseline to 6 months, while no difference existed for 12 skills.

CONCLUSIONS

Healthcare professionals after the NLS provider course retain satisfactory levels of theoretical knowledge and technical skills even at 6 months post-training, although, there is a decline compared to baseline. Further research is needed in order to establish the proper time and type of refreshment course in order to improve outcomes.

Otoskills training during covid-19 pandemic: a before-after study

BACKGROUND

The ongoing COVID-19 pandemic has disrupted the surgical training of residents. There is a real concern that trainees will not be able to meet their training requirements. Low-fidelity surgical simulation appears to be an alternative for surgical training. The educational benefits of repeating ossiculoplasty simulations under a microscope have never been evaluated. With this study we aimed to evaluate the differences in performance scores and on a global rating scale before and after training on an ossiculoplasty simulator.

METHODS

In this quasi-experimental, prospective, single-centre, before-after study with blinded rater evaluation, residents performed five microscopic ossiculoplasty tasks with a difficulty gradient (sliding beads onto rods, the insertion of a partial prosthesis, the insertion of a total prosthesis, and the insertion of a stapedotomy piston under microscopic or endoscopic surgery) before and after training on the same simulator. Performance scores were defined for each task, and total performance scores (score/min) were calculated. All data were collected prospectively.

RESULTS

Six out of seven intermediate residents and 8/9 novices strongly agreed that the simulator was an effective training device and should be included in the ENT residency program. The mean effect of training was a significant increase in the total performance score (+ 0.52 points/min, [95 % CI, 0.40-0.64], p < 0.001), without a significant difference between novice and intermediate residents.

CONCLUSIONS

This preliminary study shows that techniques for middle-ear surgery can be acquired using a simulator, avoiding any risk for patients, even under lockdown measures.

Development and implementation of a novel, mandatory competency-based medical education simulation program for pediatric emergency medicine faculty

Background

Maintaining acute care physician competence is critically important. Current maintenance of certification (MOC) programs has started to incorporate simulation-based education (SBE). However, competency expectations have not been defined. This article describes the development of a mandatory annual SBE, competency-based simulation program for technical and resuscitation skills for pediatric emergency medicine (PEM) physicians.

Methods

The competency-based medical education (CBME) program was introduced in 2016. Procedural skill requirements were based on a needs assessment derived from Royal College PEM training guidelines. Resuscitation scenarios were modified versions of pre-existing in-situ mock codes or critical incident cases. All full-time faculty were required to participate annually in both sessions. Delivery of educational content included a flipped classroom website, deliberate practice, and stop-pause debriefing. All stations required competency checklists and global rating scales.

Results

Between 2016 and 2018, 40 physicians and 48 registered nurses attended these courses. Overall course evaluations in 2018 were 4.92/5 and 4.93/5. Barriers to implementation include the need for many simulation education experts, time commitment, and clinical scheduling during course events.

Conclusion

We have developed a mandatory simulation-based, technical, and resuscitation CBME program for PEM faculty. This simulation-based CBME program could be adapted to other acute care disciplines. Further research is required to determine if these skills are enhanced both in a simulated and real environment and if there is an impact on patient outcomes.

Supplementary Information

The online version contains supplementary material available at 10.1186/s41077-021-00170-4.

LIVES for families psychological first aid training programme to address COVID-19 psychological distress: a mixed methods acceptability and feasibility protocol

INTRODUCTION

Best practice approaches for addressing COVID-19-related psychological distress among young people (<25 years) and their families remain unclear. Psychological first aid (PFA) is promoted by public health authorities to provide psychological support in the context of extreme events; however, there is limited evidence for its effectiveness. As a prerequisite to conducting a randomised controlled trial to examine programme effectiveness, this project is evaluating the acceptability and feasibility of implementing and evaluating a PFA training programme ('LIVES for Families') for mental health (MH) practitioners to improve their ability to recognise and respond to COVID-19-related psychological distress among their clients.

METHODS AND ANALYSIS

We are using a triangulation mixed methods research design; complementary strands of quantitative and qualitative data are being collected in parallel and will be merged at the interpretation phase of the project. The quantitative strand uses a repeated measures design; a consecutive sample of MH practitioners (n=80) providing MH support to young people or their families are being recruited to participate in the LIVES for Families PFA training programme and complete quantitative measures at baseline (pretraining), 2-week and 6-month follow-up time points. The qualitative strand uses fundamental description and semistructured interviews with a subset of practitioners (n=30), as well as managers of MH agencies (n=20). A mixed methods joint display and associated narrative will generate a comprehensive understanding regarding acceptability and feasibility.

ETHICS AND DISSEMINATION

The Hamilton Integrated Research Ethics Board approved the study (project number: 11295). Results will be shared broadly with the policy and practice community through publications, presentations and public webinars. As a brief, evidence-informed intervention, the LIVES for Families PFA training programme is suitable in its mode of delivery across care settings. The outcomes of this study could have international implications for mitigating the MH impacts of viral pandemics.

Comparing the Effects of Reading Intervention Versus Reading and Mindset Intervention for Upper Elementary Students With Reading Difficulties

The primary purpose of this study was to examine the effects of providing mindset intervention in addition to reading intervention compared with only reading intervention for fourth graders with reading difficulties. Reading intervention was provided daily in 45 min sessions throughout the school year. Mindset intervention occurred in small groups for 24-30 min lessons. Multilevel structural equation modeling (SEM) via n-level SEM was used to account for the latent variable representation of constructs, and the complex nesting and cross-classification structure of the data. Students in the reading intervention plus mindset condition significantly outperformed the business as usual condition on nonword reading (d = 0.35) as did students in the reading intervention condition (d = 0.20), who also outperformed the business as usual condition on phonological processing (d = 0.28). There were no significant differences among students in the three conditions on nonword reading, word reading, phonological processing, reading comprehension, or growth mindset. Initial reading achievement, mindset, and problem behavior did not generally moderate these findings.

Achievement of effective cardiopulmonary trauma surgical skills training throughout the incorporation of a low-cost and easy to implement pulsatile simulation model

OBJECTIVES

. In the last decade, concern regarding the preparedness of general surgery graduates to effectively manage thoracic trauma cases has been raised. However, due to limited availability and elevated costs, access to cardiopulmonary trauma simulation models is limited. This article describes our experience implementing a low-cost blended ex vivo tissue-based simulation model using animal by-products that incorporates pump perfusion and ventilation.

DESIGN

. Firstly, for validation purposes 8 junior residents, 8 recently graduated general surgeons, and 3 cardiothoracic surgery attendings from Pontificia Universidad Católica de Chile Clinical Hospital were recruited. Proficiency in performing a pulmonary tractotomy and a myocardial injury repair was assessed with global and specific rating scales. Secondly, to evaluate the effectiveness of the model as a learning tool, 16 general surgery residents from different programs across the country were recruited receiving intensive, personalized training on the models. Proficiency was measured before and after the training.

RESULTS

. For the validation phase, significant differences among groups according to the previous level of expertise were shown, and therefore construct validity was established. The results of the second phase showed a significant overall improvement in participant's performance.

CONCLUSION

. Effective training and assessment for advanced surgical skills in cardiothoracic trauma can be achieved using a low-cost pulsatile simulation model.

Survey of trainee attitudes to skill development and simulation training in trauma and orthopaedics

Background

Simulation training in surgery is widespread and allows surgeons to practise novel operative techniques and acquaint themselves with unfamiliar surgical procedures. The use of box or virtual reality simulators in many surgical specialities is established; however, its use within trauma and orthopaedics (T&O) in the UK and the attitudes of trainee towards it are not known. The aim of this study is to explore the experiences and opinions of T&O trainees towards simulation training.

Methods

An electronic survey consisting of 11 questions on the experiences of simulation training and attitudes towards it was sent to all T&O speciality trainees in London.

Results

Fewer than 10% of the responders had used or had ready access to simulators to prepare for unfamiliar operations, with almost 90% preferring to read about them in a journal or watch them on an online video site. Over half had only seen simulators on courses or been aware of them. Over 75% of the responders believed that simulators should be available for trainees, but most did not feel that they should be used as part of formal assessments.

Conclusions

Methods for preparing for new operations have expanded over the past 20 years, yet the use of simulator machines is not widespread. Many trainees believe current machines are not widely available nor realistic enough to be useful, with most preferring online videos and operative technique books for preparing for an unfamiliar operation.

Impact of Initial Emotional States and Self-Efficacy Changes on Nursing Students' Practical Skills Performance in Simulation-Based Education

Training through simulation has shown to increase relevant and specific skills sets across a wide range of areas in nursing and related professions. Increasing skills has a reciprocal relation to the development of self-efficacy. A study was conducted to assess changes in the development of self-efficacy in simulation training for 2nd year nursing students. Initial emotional states, pre and post self-efficacy, and expert ratings of simulation performance were assessed. Results show that students who displayed an increase in self-efficacy as a result of simulation training were also judged to perform better by expert ratings. The effect of simulation on self-efficacy could be influenced by initial states of physiological activation and over control. Results also showed that initial emotional states did not moderate self-efficacy development on outcome measures. These findings improve our understanding on the relationship between students’ self-efficacy and performance of practical skills and inform pedagogical designs and targeted interventions in relation to feedback and supervision in nursing education.

Leveraging Videoconferencing Technology to Augment Surgical Training During a Pandemic

Our objective was to review the use of videoconferencing as a practical tool for remote surgical education and to propose a model to overcome the impact of a pandemic on resident training.

Summary Background Data

In response to the coronavirus disease 2019 pandemic, most institutions and residency programs have been restructured to minimize the number of residents in the hospital as well as their interactions with patients and to promote physical distancing measures. This has resulted in decreased resident operative exposure, responsibility, and autonomy, hindering their educational goals and ability to achieve surgical expertise necessary for independent practice.

Methods

We conducted a narrative review to explore the use of videoconferencing for remote broadcasting of surgical procedures, telecoaching using surgical videos, telesimulation for surgical skills training, and establishing a didactic lecture series.

Results and Conclusions

We present a multimodal approach for using practical videoconferencing tools that provide the means for audiovisual communication to help augment residents' operative experience and limit the impact of self-isolation, redeployment, and limited operative exposure on surgical training.

Design and evaluation of a simulated wound management course for postgraduate year one surgery residents

Background

It is vital to cover wound management knowledge and operations in the early stages of resident training. With this in mind, a simulated wound management course for postgraduate year one surgery residents (PGY1s) was designed and its effectiveness was evaluated.

Methods

A retrospective quasi-experimental method was used. PGY1s in 2014 constituted the control group, and PGY1s in 2015 and 2016 constituted the intervention group. The course given to the control group comprised didactic teaching followed by deliberate practice plus immediate personalized feedback. The newly designed course given to the intervention group was reconstructed and disassembled into four components according to the simulation-based mastery learning model, which were baseline test, interactive learning, basic skills practice, and reflective learning. The same performance assessments were used in the control and intervention group, including process measurement and outcome measurement.

Results

The process measurement showed that the intervention group’s scores were significantly higher in the “dissociation of subcutaneous tissue” and “quality of suturing and knots”. The outcome measurement showed that the accuracy of debridement was greatly improved and both key and total suture numbers were significantly higher in the intervention group.

Conclusions

Simulation-based mastery learning was incorporated into our proposed course framework, promoting the learning outcome of PGY1s. It has the potential to be adapted for other surgical training sites for residents in China.

First year medical student experiences with a clinical skills seminar emphasizing sexual and gender minority population complexity

PURPOSE

Patients identifying as sexual and gender minorities (SGMs) face healthcare barriers. This problem is partly due to medical training.¹ We evaluated first year medical student experiences during a novel four-hour seminar, in which students answered discussion questions, participated in peer role-plays, and interviewed two standardized patients.

METHOD

A constructivist qualitative design employed audio-recorded and transcribed student focus groups. Using generic content analysis, transcripts were iteratively coded, emergent categories identified, sensitizing concepts applied, and a thematic framework created.

RESULTS

Thirty-five students (71% female) participated in five focus groups. Two themes were developed: SGM bias (faculty, standardized patients [SPs], students, curriculum), and Adaptive Expertise in Clinical Skills (case complexity, learner support, skill development). SPs identifying as SGM brought authenticity and lived experience to their roles. Preceptor variability impacted student learning. Students were concerned when a lack of faculty SGM knowledge accompanied negative biases. Complex SP cases promoted cognitive integration and preparation for clinical work.

CONCLUSIONS

These students placed importance on the lived experiences of SGM community members. Persistent prejudices amongst faculty negatively influenced student learning. Complex SP cases can promote student adaptive expertise, but risk unproductive learning failures. The lessons learned have implications for clinical skills teaching, learning about minority populations, and medical and health professions education in general.

Howzat! Expert umpires use a gaze anchor to overcome the processing demands of leg before wicket decisions

Cricket umpires are required to make high-pressure, match-changing decisions based on multiple complex information sources under severe temporal constraints. The aim of this study was to examine the decision-making and perceptual-cognitive differences between expert and novice cricket umpires when judging leg before wicket (LBW) decisions. Twelve expert umpires and 19 novice umpires were fitted with an eye-tracker before viewing video-based LBW appeals. Dependent variables were radial error (cm), number of fixations, average fixation duration (ms), final fixation duration (ms), and final fixation location (%). Expert umpires were significantly more accurate at adjudicating on all aspects of the LBW law, compared to the novice umpires (p < .05). The expert umpires' final fixation prior to ball-pad contact was directed significantly more towards the stumps (p < .05), whereas the novice umpires directed their final fixation significantly more towards a good length (p < .05). These data suggest that expert umpires utilize specialized perceptual-cognitive skills, consisting of a gaze anchor on the stumps in order to overcome the processing demands of the task. These data have implications for the training of current and aspiring umpires in order to enhance the accuracy of LBW decision-making across all levels of the cricketing pyramid.

Variability in Mammography Quality Assessment After Implementation of Enhancing Quality Using the Inspection Program (EQUIP)

OBJECTIVE

Analyze mammography quality and deficiencies, including variability in quality assessment among subspecialized breast radiologists, after implementing the Enhancing Quality Using the Inspection Program (EQUIP).

METHODS

After IRB approval, this single institution study retrospectively queried data prospectively entered into our automated reporting software after implementing EQUIP (October 2017-March 2019). Screening and diagnostic combination (digital mammography with tomosynthesis) mammograms were reviewed by seven breast radiologists. Quality was assessed as excellent, good, adequate, or problems found. Of those with problems found, the deficiency and corrective action were evaluated. The interpreting radiologist, EQUIP radiologist, and performing technologist were recorded. P values were calculated using Fisher exact test and chi-square analyses.

RESULTS

Of 17 312 mammograms, 529 (3%) underwent EQUIP review. Of 43 (8%) with problems found, 23 (53%) did not include sufficient tissue, 9 (21%) had motion degradation, 3 (7%) had artifacts, 2 each (4.7% each) had the nipple not in profile or skin folds, and 4 (9%) were categorized as "other." Nine (9/529, 1.7%) required recall for repeat imaging. The lead interpreting physician (LIP) was more likely to categorize mammograms as technically inadequate compared to other radiologists (P < 0.00001), and there were also statistically significant differences in how the remaining radiologists stratified cases (P < 0.00001) even when excluding the LIP.

CONCLUSION

Insufficient tissue was the most common problem identified in the EQUIP-reviewed mammograms with deficiencies. Significant variability was present among radiologist EQUIP designations. Ongoing review of clinical image quality with EQUIP allows for opportunities to provide corrective feedback.

Can we improve teaching and learning of percutaneous dilatational tracheostomy's bronchoscopic guidance?

Percutaneous dilatational tracheostomy has become the technique of choice in multiple intensive care units. Among innovations to improve procedural safety and success, bronchoscopic guidance of percutaneous dilatational tracheostomy has been advocated and successfully implemented by multiple groups. Most published literature focuses on the percutaneous dilatational tracheostomy operator, with scarce descriptions of the bronchoscopic particularities of the procedure. In this article, we provide 10 suggestions to enhance specific procedural aspects of bronchoscopic guidance of percutaneous dilatational tracheostomy, and strategies to optimize its teaching and learning, in order to promote learners' competence acquisition and increase patient safety.

Real-world virtual patient simulation to improve diagnostic performance through deliberate practice: a prospective quasi-experimental study

OBJECTIVES

Diagnostic errors are pervasive in medicine and most often caused by clinical reasoning failures. Clinical presentations characterized by nonspecific symptoms with broad differential diagnoses (e.g., dizziness) are especially prone to such errors.

METHODS

We hypothesized that novice clinicians could achieve proficiency diagnosing dizziness by training with virtual patients (VPs). This was a prospective, quasi-experimental, pretest-posttest study (2019) at a single academic medical center. Internal medicine interns (intervention group) were compared to second/third year residents (control group). A case library of VPs with dizziness was developed from a clinical trial (AVERT-NCT02483429). The approach (VIPER - Virtual Interactive Practice to build Expertise using Real cases) consisted of brief lectures combined with 9 h of supervised deliberate practice. Residents were provided dizziness-related reading and teaching modules. Both groups completed pretests and posttests.

RESULTS

For interns (n=22) vs. residents (n=18), pretest median diagnostic accuracy did not differ (33% [IQR 18-46] vs. 31% [IQR 13-50], p=0.61) between groups, while posttest accuracy did (50% [IQR 42-67] vs. 20% [IQR 17-33], p=0.001). Pretest median appropriate imaging did not differ (33% [IQR 17-38] vs. 31% [IQR 13-38], p=0.89) between groups, while posttest appropriateness did (65% [IQR 52-74] vs. 25% [IQR 17-36], p<0.001).

CONCLUSIONS

Just 9 h of deliberate practice increased diagnostic skills (both accuracy and testing appropriateness) of medicine interns evaluating real-world dizziness 'in silico' more than ∼1.7 years of residency training. Applying condensed educational experiences such as VIPER across a broad range of common presentations could significantly enhance diagnostic education and translate to improved patient care.

Improving Child Neurology Residents' Communication Skills Through Objective Structured Clinical Exams

INTRODUCTION

Child neurology has unique challenges in communication due to complex disorders with a wide array of prognoses and treatments. Effective communication is teachable through deliberate practice and coaching. Objective structured clinical exams (OSCEs) are one method of providing practice while assessing communication skills. Yet OSCEs have not been reported for child neurology residents.

METHODS

We developed simulated clinical cases centering on communication skills for child neurology residents, all with challenging clinical scenarios (e.g., disclosure of a medical error, psychogenic nonepileptic events). Standardized patients (SPs) portrayed the parents of pediatric patients and, in some scenarios, an adolescent patient. We used a modified Gap-Kalamazoo Communication Skills Assessment Form to assess communication skills. The assessment was completed by faculty, SPs, and the resident, and we measured agreement among raters. Residents were surveyed afterward regarding their experience.

RESULTS

Nine cases were developed and piloted. A total of 27 unique resident-case encounters with 16 individual trainees occurred over three annual implementations. Scores on the 360-degree assessment of communication skills showed that residents overwhelmingly underassessed their skills compared to other rater groups. Among 18 responses on the post-OSCE survey, the majority (77%) found the experience useful to their education and felt that the feedback from the SPs was helpful (61%) and the case portrayals were realistic (89%).

DISCUSSION

We implemented simulated cases for assessment and formative feedback on communication skills for child neurology residents. We provide a blueprint to develop this educational activity in other programs.

Respiratory Auscultation Lab Using a Cardiopulmonary Auscultation Simulation Manikin

INTRODUCTION

Mastery of respiratory auscultation skills is fundamental for clinicians to develop. We created a case-based educational session utilizing a high-fidelity simulator to teach lung sound auscultation to medical students at our institution. We employed a hypothesis-driven approach and deliberate practice to enhance students' learning experience and retention of acquired skills.

METHODS

We developed the session to teach second-year medical students how to discriminate between normal and pathological respiratory sounds within the context of clinical vignettes. Faculty facilitators, in conjunction with near-peer educators, made use of a high-fidelity auscultation manikin to guide students through case-based problem sets. Students were given the opportunity to auscultate the manikin while being observed and receiving feedback from the faculty.

RESULTS

We introduced the manikin in 2016, with a total of 759 second-year medical students from four class years having participated in the session since then. Students evaluated the session through an end-of-the-week and end-of-unit survey. The survey showed an overall improvement in learner satisfaction over previous years. Survey results and feedback were used to make adjustments to the session.

DISCUSSION

Our respiratory auscultation session was well received overall. Proper faculty development is crucial for implementing the session. Because of the focus on deliberate practice, adequate time must be allotted to hold the session. This program is reproducible with similar high-fidelity simulators.

Impact of deliberate practice on evidence-based medicine attitudes and behaviours of health care professionals

INTRODUCTION

Although evidence-based medicine (EBM) teaching activities may improve short-term EBM knowledge and skills, they have little long-term impact on learners' EBM attitudes and behaviour. This study examined the effects of learning EBM through stand-alone workshops or various forms of deliberate EBM practice.

METHODS

We assessed EBM attitudes and behaviour with the evidence based practice inventory questionnaire, in paediatric health care professionals who had only participated in a stand-alone EBM workshop (controls), participants with a completed PhD in clinical research (PhDs), those who had completed part of their paediatric residency at a department (Isala Hospital) which systematically implemented EBM in its clinical and teaching activities (former Isala residents), and a reference group of paediatric professionals currently employed at Isala's paediatric department (current Isala participants).

RESULTS

Compared to controls (n = 16), current Isala participants (n = 13) reported more positive EBM attitudes (p < 0.01), gave more priority to using EBM in decision making (p = 0.001) and reported more EBM behaviour (p = 0.007). PhDs (n = 20) gave more priority to using EBM in medical decision making (p < 0.001) and reported more EBM behaviour than controls (p = 0.016).

DISCUSSION

Health care professionals exposed to deliberate practice of EBM, either in the daily routines of their department or by completing a PhD in clinical research, view EBM as more useful and are more likely to use it in decision making than their peers who only followed a standard EBM workshop. These findings support the use of deliberate practice as the basis for postgraduate EBM educational activities.

Performance Improvement With Implementation of a Surgical Skills Curriculum

OBJECTIVE

To assess the efficacy of an intern surgical skills curriculum involving a boot camp for core open and laparoscopic skills, self-guided practice with positive and negative incentives, and semiannual performance evaluations.

DESIGN

Longitudinal cohort study.

SETTING

Academic tertiary care center.

PARTICIPANTS

Intervention group (n = 15): residents who completed the intern surgical skills curriculum and had performance evaluations in fall of intern year, spring of intern year, and fall of second year. Control group (n = 8): second-year residents who were 1 year ahead of the intervention group in the same residency program, did not participate in the curriculum, and had performance evaluations in fall of second year.

RESULTS

In fall of second year of residency, the intervention group had better performance (presented as median values with interquartile ranges) than the control group on one-hand ties (left hand: 9.1 [6.3-10.1] vs 14.6 [13.5-15.4] seconds, p = 0.007; right hand: 8.7 [8.5-9.6] vs 11.5 [9.9-16.8] seconds, p = 0.039). The intervention group also had better performance on all open suturing skills, including mattress suturing (vertical: 33.4 [30.0-40.0] vs 55.8 [50.0-67.6] seconds, p = 0.001; horizontal: 28.7 [27.3-39.9] vs 52.7 [40.7-57.8] seconds, p = 0.003), and a water-filled glove clamp, divide, and ligate task (28.0 [25.0-31.0] vs 59.1 [53.0-93.0] seconds, p < 0.001). Finally, the intervention group had better performance on all laparoscopic skills, including peg transfer (66.0 [59.0-82.0] vs 95.2 [87.5-101.5] seconds, p = 0.018), circle cut (82.0 [69.0-124.0] seconds vs 191.8 [155.5-231.5] seconds, p = 0.002), and intracorporeal suturing (195.0 [117.0-200.0] seconds vs 359.5 [269.0-450.0] seconds, p = 0.002).

CONCLUSIONS

Implementation of a comprehensive surgical skills curriculum was associated with improved performance on core open and laparoscopic skills. Further research is needed to understand and optimize motivational factors for deliberate practice and surgical skill acquisition.

Pediatric Hospitalists' Performance and Perceptions of Script Concordance Testing for Self-Assessment

OBJECTIVES

The cognitive expertise of Pediatric Hospitalists (PH) lies not in standard knowledge but in making decisions under conditions of uncertainty. To maintain expertise, PH should engage in deliberate practice via self-assessments that promote higher-level cognitive processes necessary to address problems with missing or ambiguous information. Higher levels of cognition are purported with Script Concordance Test (SCT) questions compared to Multiple Choice Questions (MCQ). To determine if PH use higher levels of cognition when answering SCT versus MCQ questions and to analyze participants' perceptions of the utility of using SCT self-assessment for deliberate practice in addressing clinical problems encountered in daily practice.

METHODS

This is a mixed methods study comparing the cognitive level expressed according to Bloom's Taxonomy by PH answering MCQ versus SCT questions using a "think aloud" (TA) exercise, followed by qualitative analysis of interviews conducted afterward.

RESULTS

A significantly greater percentage of comments were coded as higher cognitive processes (apply, analyze, evaluate, and create) for SCT versus MCQ (74% vs 19%) compared with lower order (remember, understand); chi-square P < .00001. Analysis of interviews revealed 6 themes.

CONCLUSION

SCT questions elicited higher level cognition essential to clinical reasoning compared to MCQ questions. PH-indicated MCQ questions measure standard knowledge, while SCT questions better measure decision-making under conditions of uncertainty. PH-perceived SCT could be useful for deliberate practice in Pediatric Hospital Medicine decision-making if they could compare their rationale in answering questions with that of experts.

Patients Are Knowledge Workers in the Clinical Information Space

BACKGROUND

Limited research exists on patient knowledge/cognition or "getting inside patients' heads." Because patients possess unique and privileged knowledge, clinicians need this information to make patient-centered and coordinated treatment planning decisions. To achieve patient-centered care, we characterize patient knowledge and contributions to the clinical information space.

METHODS AND OBJECTIVES

In a theoretical overview, we explore the relevance of patient knowledge to care provision, apply historical perspectives of knowledge acquisition to patient knowledge, propose a representation of patient knowledge types across the continuum of care, and include illustrative vignettes about Mr. Jones. We highlight how the field of human factors (a core competency of health informatics) provides a perspective and methods for eliciting and characterizing patient knowledge.

CONCLUSION

Patients play a vital role in the clinical information space by possessing and sharing unique knowledge relevant to the clinical picture. Without a patient's contributions, the clinical picture of the patient is incomplete. A human factors perspective informs patient-centered care and health information technology solutions to support clinical information sharing.

Effectiveness of the Ophthalmological Training Component of the STOMP (Simulation Training for Operational Medical Providers) Curriculum

INTRODUCTION

Simulation has been used in medicine to train clinicians to manage a variety of clinical scenarios. A key adaptation of the use of simulation in military healthcare occurred in 2015 with the development of the STOMP (Simulation Training for Operational Medical Providers) curriculum, a specific curriculum designed for the intern (PGY-1) trained physicians being sent into the military to practice primary care. Despite showing the curriculum's influence on self-perceived comfort scores, no study has determined whether simulation is an effective means of improving general medical officer (GMO) physicians' skills compared to other traditional styles of education. Specifically, this study sought to determine whether simulation-based education (SBE) of ophthalmologic skills improves GMO physicians' clinical performance, as compared to traditional didactic-based instruction.

METHODS

The study, conducted at Naval Medical Center Portsmouth, included GMO physicians who were enrolled in the 2019 STOMP class. Following a brief overview of the study, GMO physicians who elected to participate in the study were randomized to either SBE or lecture-based training for three commonly used ophthalmological procedures: slit lamp exam, tonometry, and corneal foreign body removal. After completing the simulation and lecture-based education training sessions, participants' procedural performance was evaluated utilizing a locally developed performance checklist, and completion time for each of the three procedures was recorded. Data were analyzed using the t-test and Mann-Whitney test. A significance level of 0.05 was considered to be statistically significant.

RESULTS

Of the 50 consented participants, 46 completed the study. The mean overall completion scores for the performance checklists were significantly higher for the SBE group (n=26) compared to the lecture group (n=20) [80% (95% CI 78-82%) vs 41% (95% CI 35-47%), respectively]. Time to completion of the individual tasks was also significantly shorter for the SBE group compared to the lecture group (with mean differences ranging from 27 to 126 seconds, all p<.05).

CONCLUSIONS

Simulation-based training appeared to be more effective at teaching three ophthalmological procedures (slit lamp exam, tonometry, and corneal foreign body removal) to GMO physicians compared to didactic-based instruction alone.