Deliberate practice and acquisition of expert performance: a general overview

Focused Critical Care Echocardiography: Development and Evaluation of an Image Acquisition Assessment Tool

OBJECTIVES

Little attention has been placed on assessment tools to evaluate image acquisition quality for focused critical care echocardiography. We designed a novel assessment tool to objectively evaluate the image acquisition skills of critical care trainees learning focused critical care echocardiography and examined the tool for evidence of validity.

DESIGN

Prospective observational study.

SETTING

Medical-surgical ICUs at a tertiary care teaching hospital.

SUBJECTS

Trainees in our critical care medicine fellowship program.

INTERVENTIONS

Six trainees completed a focused critical care echocardiography training curriculum followed by performing 20 transthoracic echocardiograms on patients receiving invasive mechanical ventilation. At three assessment intervals (the 1st and 2nd examinations, 10th and 11th examinations, and 19th and 20th examinations), echocardiograms performed by trainees were compared with those of critical care physicians certified in echocardiography and scored according to the focused critical care echocardiography assessment tool. The primary outcome was an efficiency score (overall assessment tool score divided by examination time). Differences in mean efficiency scores between echocardiographers of differing skill levels and changes in trainees' mean efficiency scores with increasing focused critical care echocardiography experience were compared by using t tests.

MEASUREMENTS AND MAIN RESULTS

On the initial assessment, mean efficiency scores (SD) for trainees and experienced physicians were 1.55 (0.95) versus 2.78 (1.38), respectively (p = 0.02), and for the second and third assessments, the corresponding efficiency ratings for trainees and experienced physicians were 2.48 (0.97) versus 4.55 (1.32) (p < 0.01) and 2.61 (1.37) versus 4.17 (2.12) (p = 0.04), respectively.

CONCLUSIONS

Trainees' efficiency in focused critical care echocardiography image acquisition improved quickly in the first 10 studies, yet, it could not match with the performance of experienced physicians after 20 focused critical care echocardiography studies. The focused critical care echocardiography assessment tool demonstrated evidence of validity and could discern changes in trainees' image acquisition performance with increasing experience.

Is it possible to enhance the confidence of student dietitians prior to professional placements? A design-based research model

BACKGROUND

Student confidence is an important contributor to a successful professional placement experience. The present study aimed to evaluate a placement preparation program for student dietitians and to assess the impact on self-rated confidence with respect to commencing placements.

METHODS

The present study is part of a design-based research approach that involves students in a cyclic enquiry to evaluate and improve curricula. Nutrition and Dietetics students at an Australian university participated in a 1-week mandatory workshop - Pre-Placement week (PrePW), N = 98 students: in 2015 (n = 54) and 2016 (n = 44). An online survey was conducted before and after PrePW using a five-point Likert scale (1 = not confident; 5 = very confident) to assess self-rated confidence to commence placements. Mean (SD) scores were calculated. Paired and independent t-tests evaluated within- and between-group differences, respectively.

RESULTS

Before PrePW, the mean (SD) for student confidence to commence placements overall (in all areas of practise) was 'somewhat confident' [2.9 (0.6) in 2015 and 3.0 (0.7) in 2016]. Students were least confident to commence Clinical Practice [2015: 2.5 (0.6); 2016: 2.8 (0.6)] compared to Food Service Management (FSM) [2015: 3.2 (0.9); 2016: 3.1 (0.9)] and Community and Public Health Nutrition (CPHN) [2015: 3.3 (0.9); 2016: 3.2 (0.8)]. Student feedback from PrePW 2015 was used to change the curriculum and PrePW program. The 2016 students reported significantly greater confidence within all areas of practice: Clinical Practice [3.4 (0.6)], FSM [3.7 (0.6)] and CPHN [3.8 (0.6)], including confidence to commence placements overall [3.6 (0.6)] (P < 0.05).

CONCLUSIONS

Design-based research provides a useful framework for improvement to curricula and, in this case, was successful in enhancing student confidence in preparation for professional placement.

Mindfulness Reduces Reactivity to Food Cues: Underlying Mechanisms and Applications in Daily Life

PURPOSE OF REVIEW

Mindfulness-based interventions are becoming increasingly popular as a means to facilitate healthy eating. We suggest that the decentering component of mindfulness, which is the metacognitive insight that all experiences are impermanent, plays an especially important role in such interventions. To facilitate the application of decentering, we address its psychological mechanism to reduce reactivity to food cues, proposing that it makes thoughts and simulations in response to food cues less compelling. We discuss supporting evidence, applications, and challenges for future research.

RECENT FINDINGS

Experimental and correlational studies consistently find that the adoption of a decentering perspective reduces subjective cravings, physiological reactivity such as salivation, and unhealthy eating.

SUMMARY

We suggest that the decentering perspective can be adopted in any situation to reduce reactivity to food cues. Considering people's high exposure to food temptations in daily life, this makes it a powerful tool to empower people to eat healthily.

Training the next generation of surgeons in robotic surgery

Context

Robotic surgery has been used with rapidly increasing frequency within urology and across many other surgical specialties. A standardized curriculum for the training and credentialing of robotic surgeons has unfortunately trailed far behind the adoption of this surgical technology.

Objective

To review the current available surgical skills training models, assessments, and curricula for the purpose of training resident, fellow, and practicing surgeons in an effort to promote surgical skill proficiency and mastery and to minimize the risk of patient harm.

Evidence acquisition

We performed a thorough review of available literature through a PubMed database search in February 2015.

Evidence synthesis

In this article, we compiled and scrutinized the available relevant literature regarding past and present robotic surgical training techniques and credentialing criteria. This review details the basic surgical skills (both technical and nontechnical) that are necessary for individuals and teams to be successful in the operative setting. We go on to discuss the role of current robotic surgical training techniques including dry lab and virtual simulators. Finally, we offer current validated training curricula, the Global Evaluative Assessment of Robotic Skills and Fundamentals of Robotic Surgery models, which have laid the groundwork for a future standardized model that could be applied on a national and international level and across several surgical subspecialties. The ultimate goal of the review is to provide a foundation from which a future standardized training and credentialing curriculum could be based.

Conclusion

There is currently a great need for a standardized curriculum to be developed and employed for the use of training and credentialing future and current robotic surgeons.

Rapid Cycle Deliberate Practice in Medical Education - a Systematic Review

Rapid Cycle Deliberate Practice (RCDP) is a novel simulation-based education model that is currently attracting interest, implementation, exploration and research in medical education. In RCDP, learners rapidly cycle between deliberate practice and directed feedback within the simulation scenario until mastery is achieved. The objective of this systematic review is to examine the literature and summarize the existing knowledge on RCDP in simulation-based medical education. Fifteen resources met inclusion criteria; they were diverse and heterogeneous, such that we did not perform a quantitative synthesis or meta-analysis but rather a narrative review on RCDP. All resources described RCDP in a similar manner. Common RCDP implementation strategies included: splitting simulation cases into segments, micro debriefing in the form of 'pause, debrief, rewind and try again' and providing progressively more challenging scenarios. Variable outcome measures were used by the studies including qualitative assessments, scoring tools, procedural assessment using checklists or video review, time to active skills and clinical reports. Results were limited and inconsistent. There is an absence of data on retention after RCDP teaching, on RCDP, with learners from specialties other than pediatrics, on RCDP for adult resuscitation scenarios and if RCDP teaching translates into practice change in the clinical realm. We have identified important avenues for future research on RCDP.

Assessing residents' operative skills for external ventricular drain placement and shunt surgery in pediatric neurosurgery

OBJECTIVE The authors previously demonstrated the use of a validated Objective Structured Assessment of Technical Skills (OSATS) tool for evaluating residents' operative skills in pediatric neurosurgery. However, no benchmarks have been established for specific pediatric procedures despite an increased need for meaningful assessments that can either allow for early intervention for underperforming trainees or allow for proficient residents to progress to conducting operations independently with more passive supervision. This validated methodology and tool for assessment of operative skills for common pediatric neurosurgical procedures-external ventricular drain (EVD) placement and shunt surgery- was applied to establish its procedure-based feasibility and reliability, and to document the effect of repetition on achieving surgical skill proficiency in pediatric EVD placement and shunt surgery. METHODS A procedure-based technical skills assessment for EVD placements and shunt surgeries in pediatric neurosurgery was established through the use of task analysis. The authors enrolled all residents from 3 training programs (Baylor College of Medicine, Houston Methodist Hospital, and University of Texas-Medical Branch) who rotated through pediatric neurosurgery at Texas Children's Hospital over a 26-month period. For each EVD placement or shunt procedure performed with a resident, the faculty and resident (for self-assessment) completed an evaluation form (OSATS) based on a 5-point Likert scale with 7 categories. Data forms were then grouped according to faculty versus resident (self) assessment, length of pediatric neurosurgery rotation, postgraduate year level, and date of evaluation ("beginning of rotation," within 1 month of start date; "end of rotation," within 1 month of completion date; or "middle of rotation"). Descriptive statistical analyses were performed with the commercially available SPSS statistical software package. A p value < 0.05 was considered statistically significant. RESULTS Five attending evaluators (including 2 fellows who acted as attending surgeons) completed 260 evaluations. Twenty house staff completed 269 evaluations for self-assessment. Evaluations were completed in 562 EVD and shunt procedures before the surgeons left the operating room. There were statistically significant differences (p < 0.05) between overall attending (mean 4.3) and junior resident (self; mean 3.6) assessments, and between overall attending (mean 4.8) and senior resident (self; mean 4.6) assessment scores on general performance and technical skills. The learning curves produced for the residents demonstrate a stereotypical U- or V-shaped curve for acquiring skills, with a significant improvement in overall scores at the end of the rotation compared with the beginning. The improvement for junior residents (Δ score = 0.5; p = 0.002) was larger than for senior residents (Δ score = 0.2; p = 0.018). CONCLUSIONS The OSATS is an effective assessment tool as part of a comprehensive evaluation of neurosurgery residents' performance for specific pediatric procedures. The authors observed a U-shaped learning curve, contradicting the idea that developing one's surgical technique and learning a procedure represents a monotonic, cumulative process of repetitions and improvement.

R2C2 in Action: Testing an Evidence-Based Model to Facilitate Feedback and Coaching in Residency

BACKGROUND

Feedback is increasingly seen as a collaborative conversation between supervisors and learners, where learners are actively and reflectively engaged with feedback and use it to improve. Based on this, and through earlier research, we developed an evidence- and theory-informed, 4-phase model for facilitating feedback and practice improvement-the R2C2 model (relationship, reaction, content, coaching).

OBJECTIVE

Our goal was to explore the utility and acceptability of the R2C2 model in residency education, specifically for engaging residents in their feedback and in using it to improve, as well as the factors influencing its use.

METHODS

This qualitative study used the principles of design research. We recruited residents and their supervisors in 2 programs, internal medicine and pediatrics. We prepared supervisors to use the R2C2 model during their regular midrotation and/or end-of-rotation feedback sessions with participating residents to discuss their progress and assessment reports. We conducted debriefing interviews with supervisors and residents after each session. We analyzed transcripts as a team using template and content analysis.

RESULTS

Of 61 residents, 7 residents (11%) participated with their supervisors (n = 5). Schedules and sensitivity to feedback prevented broader enrollment. Supervisors found the structured R2C2 format useful. Residents and supervisors reported that the coaching phase was novel and helpful, and that the R2C2 model engaged both groups in collaborative, reflective, goal-oriented feedback discussions.

CONCLUSIONS

Participants found that using the R2C2 model enabled meaningful feedback conversations, identification of goals for improvement, and development of strategies to meet those goals.

Engagement and learning in simulation: recommendations of the Simnovate Engaged Learning Domain Group

Background

Health professions education (HPE) is based on deliberate learning activities and clinical immersion to achieve clinical competence. Simulation is a tool that helps bridge the knowledge-to-action gap through deliberate learning. This paper considers how to optimally engage learners in simulation activities as part of HPE.

Methods

The Simnovate Engaged Learning Domain Group undertook 3 teleconferences to survey the current concepts regarding pervasive learning. Specific attention was paid to engagement in the learning process, with respect to fidelity, realism and emotions, and the use of narratives in HPE simulation.

Results

This paper found that while many types of simulation exist, the current ways to categorise the types of simulation do not sufficiently describe what a particular simulation will entail. This paper introduces a novel framework to describe simulation by deconstructing a simulation activity into 3 core characteristics (scope, modality and environment). Then, the paper discusses how engagement is at the heart of the learning process, but remained an understudied phenomenon with respect to HPE simulation. Building on the first part, a conceptual framework for engaged learning in HPE simulation was derived, with potential use across all HPE methods.

Discussion

The framework considers how the 3 characteristics of simulation interplay with the dimensions of fidelity (physical, conceptual and emotional), and how these can be conveyed by and articulated through beauty (as a proxy for efficiency) as coexisting factors to drive learner engagement. This framework leads to the translation of deliberately taught knowledge, skills and attitudes into clinical competence and subsequent performance.

What are the associations between the quantity of faculty evaluations and residents' perception of quality feedback?

Objectives

To determine if there is a correlation between the numbers of evaluations submitted by faculty and the perception of the quality of feedback reported by trainees on a yearly survey.

Method

147 ACGME-accredited training programs sponsored by a single medical school were included in the analysis. Eighty-seven programs (49 core residency programs and 38 advanced training programs) with 4 or more trainees received ACGME survey summary data for academic year 2013–2014. Resident ratings of satisfaction with feedback were analyzed against the number of evaluations completed per resident during the same period. R-squared correlation analysis was calculated using a Pearson correlation coefficient.

Results

177,096 evaluations were distributed to the 87 programs, of which 117,452 were completed (66%). On average, faculty submitted 33.9 evaluations per resident. Core residency programs had a greater number of evaluations per resident than fellowship programs (39.2 vs. 27.1, respectively, p = 0.15). The average score for the “satisfied with feedback after assignment” survey questions was 4.2 (range 2.2–5.0). There was no overall correlation between the number of evaluations per resident and the residents' perception of feedback from faculty based on medical, surgical or hospital-based programs.

Conclusions

Resident perception of feedback is not correlated with number of faculty evaluations. An emphasis on faculty summative evaluation of resident performance is important but appears to miss the mark as a replacement for on-going, data-driven, structured resident feedback. Understanding the difference between evaluation and feedback is a global concept that is important for all medical educators and learners.

•

Residents and fellows do not perceive that regular evaluations are the same as feedback.

•

The quantity of faculty evaluations does not correlate the resident perception of quality feedback.

•

A greater emphasis is necessary to instruct faculty on providing regular, timely and data-driven feedback to residents and fellows with specific comments on performance.

•

Faculty summative evaluation of resident performance is important but this is not a replacement for structured feedback.

An unembalmed cadaveric preparation for simulating pleural effusion: A pilot study of chest percussion involving medical students

Cadaveric simulations are an effective way to add clinical context to an anatomy course. In this study, unembalmed (fresh) cadavers were uniquely prepared to simulate pleural effusion to teach chest percussion and review thoracic anatomy. Thirty first-year medical students were assigned to either an intervention (Group A) or control group (Group B). Group A received hands-on training with the cadaveric simulations. They were instructed on how to palpate bony landmarks for identifying the diaphragm and lobes of the lungs, as well as on how to properly perform chest percussion to detect abnormal fluid in the pleural space. Students in Group B practiced on each other. Students in Group A benefited from the training in several ways. They had more confidence in their percussive technique (A = mean 4.3/5.0, B = 2.9/5.0), ability to count the ribs on an intact body (A = mean 4.0/5.0, B = 3.0/5.0), and ability to identify the lobes of the lungs on an intact body (A = mean 3.8/5.0, B = 2.3/5.0). They also demonstrated a greater ability to locate the diaphragm on an intact body (A = 100%, B = 60%) and detect abnormal pleural fluid (A = 93%, B = 53%) with greater confidence (A = mean 3.7/5.0, B = 2.5/5.0). Finally, the hands-on training with the unembalmed cadavers created more excitement around learning in Group A compared with Group B. This study shows that simulating pleural effusion in an unembalmed cadaver is a useful way to enhance anatomy education. Anat Sci Educ 10: 160-169. © 2016 American Association of Anatomists.

Evaluation of Procedural Simulation as a Training and Assessment Tool in General Surgery-Simulating a Laparoscopic Appendectomy

BACKGROUND

Laparoscopic appendectomy is a commonly performed surgical procedure, but few training models have been described for it. We examined a virtual reality module for practising a laparoscopic appendectomy.

METHODS

A prospective cohort study with the following 3 groups of surgeons (n = 45): novices (0 procedures), intermediates (10-50 procedures), and experienced (>100 procedures). After being introduced to the simulator and 1 familiarization attempt on the procedural module, the participants practiced the module 20 times. Movements, task time, and procedure-specific parameters were compared over time.

RESULTS

The time and movement parameters were significantly different during the first attempt, and more experienced surgeons used fewer movements and less time than novices (p < 0.01), although only 2 parameters were significantly different between novices and intermediates. All 3 groups improved significantly over 20 attempts (p < 0.0001). The intraclass correlation coefficient varied between 0.55 and 0.68 and did not differ significantly between the 3 groups (p > 0.05). When comparing novices with experienced surgeons, novices had a higher risk of burn damage to cecum (odds ratio [OR] = 3.0 [95% CI: 1.3; 7.0] p = 0.03), pressure damage to appendix (OR = 3.1 [95% CI: 2.0; 4.9] p < 0.0001), and grasping of the appendix (OR = 2.9 [95% CI: 1.8; 4.7] p < 0.0001). The risk of causing a perforation was not significantly different among the different experience levels (OR = 1.9 [95% CI: 0.9; 3.8] p = 0.14). Only 3 out of 5 error parameters differed significantly when comparing novices and experienced surgeons. Similarly, when comparing intermediates and novices, it was only 2 of the parameters that differed.

DISCUSSION

The simulator module for practising laparoscopic appendectomy may be useful as a training tool, but further development is required before it can be used for assessment purposes. Procedural simulation may demonstrate more variation for movement parameters, and future research should focus on developing better procedure-specific parameters.

Child Neurology Education for Pediatric Residents

The aim of this study was to evaluate whether the current state of child neurology education during pediatric residency provides adequate preparation for pediatric practice. A survey was sent to recent graduates from 3 pediatric residency programs to assess graduate experience, perceived level of competence, and desire for further education in child neurology. Responses from generalists versus subspecialists were compared. The response rate was 32%, half in general pediatric practice. Only 22% feel very confident in approaching patients with neurologic problems. This may represent the best-case scenario as graduates from these programs had required neurology experiences, whereas review of Accreditation Council of Graduate Medical Education-accredited residency curricula revealed that the majority of residencies do not. Pediatric neurologic problems are common, and pediatric residency graduates do encounter such problems in practice. The majority of pediatricians report some degree of confidence; however, some clear areas for improvement are apparent.

Performance curves of medical researchers during their career: analysis of scientific production from a retrospective cohort

OBJECTIVES

To establish the pattern of change in individual scientific production over the career of medical researchers.

DESIGN

Retrospective cohort based on prospectively collected data in a hospital information system.

SETTING

Multicentre university hospital in France.

PARTICIPANTS

Two distinct populations of 1835 researchers (full professors vs non-academic physicians) having produced 44 723 publications between 1995 and 2014.

MAIN OUTCOME MEASURES

Annual number of publications referenced in Medline/PubMed with a sensitivity analysis based on publications as first/last author and in high impact journals. The individual volume of publications was modelled by age using generalised estimating equations adjusted for birth cohort, biomedical discipline and academic position of researchers.

RESULTS

Averaged over the whole career, the annual number of publications was 5.28 (95% CI 4.90 to 5.69) among professors compared to 0.82 (95% CI 0.76 to 0.89) among non-academic physicians (p<0.0001). The performance curve of professors evolved in three successive phases, including an initiation phase with a sharp increase in scientific production between 25 and 35 years (adjusted incidence rate ratio 102.20, 95% CI 60.99 to 171.30), a maturation phase with a slower increase from 35 to 50 years (2.10, 95% CI 1.75 to 2.51) until a stabilisation phase with constant production followed by a potential decline at the end of career (0.90, 95% CI 0.77 to 1.06). The non-academic physicians experienced a slower pace of learning curve at the beginning of their careers (42.38, 95% CI 25.37 to 70.81) followed by a smaller increase in the annual number of publications (1.29, 95% CI 1.11 to 1.51).

CONCLUSIONS

Compared to full professors, non-academic physicians had a poor capacity to publish, indicating a low productivity when medical doctors have limited time or little interest in undertaking research. This finding highlights the potential for rethinking the missions of medical doctors towards an enlargement of scientific prerogatives in favour of progress in global knowledge.

Socio-demographic and academic correlates of clinical reasoning in a dental school in South Africa

INTRODUCTION

There are no empirical studies that describe factors that may influence the development of integrated clinical reasoning skills in dental education. Hence, this study examines the association between outcomes of clinical reasoning in relation with differences in instructional design and student factors.

MATERIALS AND METHODS

Progress test scores, including diagnostic and treatment planning scores, of fourth and fifth year dental students (2009-2011) at the University of Pretoria, South Africa served as the outcome measures in stepwise linear regression analyses. These scores were correlated with the instructional design (lecture-based teaching and learning (LBTL = 0) or case-based teaching and learning (CBTL = 1), students' grades in Oral Biology, indicators of socio-economic status (SES) and gender.

RESULTS

CBTL showed an independent association with progress test scores. Oral Biology scores correlated with diagnostic component scores. Diagnostic component scores correlated with treatment planning scores in the fourth year of study but not in the fifth year of study. 'SES' correlated with progress test scores in year five only, while gender showed no correlation.

CONCLUSION

The empirical evidence gathered in this study provides support for scaffolded inductive teaching and learning methods to develop clinical reasoning skills. Knowledge in Oral Biology and reading skills may be important attributes to develop to ensure that students are able to reason accurately in a clinical setting.

Developing Nutrition Label Reading Skills: A Web-Based Practice Approach

Background

Nutrition labels offer the information needed to follow Dietary Guidelines for Americans, yet many individuals use labels infrequently or ineffectively due to limited comprehension and the effort required to use them.

Objective

The objective of our study was to develop and test a Web-based label-reading training tool to improve individuals’ ability to use labels to select more healthful foods. We were particularly interested in determining whether practice can lead to increased accuracy using labels as well as decreased effort, together reflecting greater efficiency. We compared a basic and an enhanced, prior-knowledge version of the tool that contained an additional component, a brief nutrition tutorial.

Methods

Participants were 140 college students with an average age of 20.7 (SD 2.1) years and education 14.6 (SD 1.2) years, who completed 3 sets of practice that were designed to teach them, through repetition and feedback, how to use nutrition labels to select more healthful products. Prior to training, participants in the prior-knowledge group viewed a multimedia nutrition presentation, which those in the basic group did not receive. Mixed-effects models tested for improvement in accuracy and speed with practice, and whether improvements varied by group.

Results

The training led to significant increases in average accuracy across the 3 practice sets (averaging 79% [19/24 questions], 92% [22/24], 96% [23/24] respectively, P<.001), as well as decreases in time to complete with mean (SD) values of 8.7 (2.8), 4.6 (1.8), and 4.1 (1.7) seconds, respectively. In block 3, the odds of a correct answer for the prior-knowledge group were 79% higher (odds ratio, OR=1.79, 95% CI 1.1-2.9) than those for the basic group (P=.02). There was no significant difference between the groups in block 2 (P=.89).

Conclusions

Practice led to improvements in nutrition label reading skills that are indicative of early stages of automatic processing. To the extent that automatic processes are at the core of healthy habit change, this may be an efficient way to improve dietary decision-making.

Validation of a new ENT emergencies course for first-on-call doctors

BACKGROUND

First-on-call ENT cover is often provided by junior doctors with limited ENT experience; yet, they may have to manage life-threatening emergencies. An intensive 1-day simulation course was developed to teach required skills to junior doctors.

METHODS

A prospective, single-blinded design was used. Thirty-seven participants rated their confidence before the course, immediately following the course and after a two-month interval. Blinded assessors scored participant performance in two video-recorded simulated scenarios before and after the course.

RESULTS

Participant self-rated confidence was increased in the end-of-course survey (score of 27.5 vs 53.0; p < 0.0001), and this was maintained two to four months after the course (score of 50.5; p < 0.0001). Patient assessment and management in video-recorded emergency scenarios was significantly improved following course completion (score of 9.75 vs 18.75; p = 0.0093).

CONCLUSION

This course represents an effective method of teaching ENT emergency management to junior doctors. ENT induction programmes benefit from the incorporation of a simulation component.

Improving clerkship preparedness: a hospital medicine elective for pre-clerkship students

BACKGROUND

Medical students often struggle to apply their nascent clinical skills in clerkships. While transitional clerkships can orient students to new roles and logistics, students may benefit from developing clinical skills in inpatient environments earlier in their curriculum to improve readiness for clerkships.

INTERVENTION

Our four- to six-session elective provides pre-clerkship students with individualized learning in the inpatient setting with the aim of improving clerkship preparedness. Students work one-on-one with faculty who facilitate individualized learning through mentoring, deliberate practice, and directed feedback. Second-year medical students are placed on an attending-only, traditionally 'non-teaching' service in the hospital medicine division of a Veterans Affairs (VA) hospital for half-day sessions. Most students self-select into the elective following a class-wide advertisement. The elective also accepts students who are referred for remediation of their clinical skills.

OUTCOME

In the elective's first two years, 25 students participated and 47 students were waitlisted. We compared participant and waitlisted (non-participant) students' self-efficacy in several clinical and professional domains during their first clerkship. Elective participants reported significantly higher clerkship preparedness compared to non-participants in the areas of physical exam, oral presentation, and formulation of assessments and plans.

CONCLUSIONS

Students found the one-on-one feedback and personalized attention from attending physicians to be a particularly useful aspect of the course. This frequently cited benefit points to students' perceived needs and the value they place on individualized feedback. Our innovation harnesses an untapped resource - the hospital medicine 'non-teaching' service - and serves as an attainable option for schools interested in enhancing early clinical skill-building for all students, including those recommended for remediation.

ABBREVIATIONS

A&P: Assessment and plan; H&P: History and physical; ILP: Individual learning plan.

Preparedness of pediatric residents for fellowship: a survey of US neonatal-perinatal fellowship program directors

OBJECTIVE

To evaluate the preparedness of pediatric residents entering accredited neonatal-perinatal medicine (NPM) fellowships in the United States.

STUDY DESIGN

A multi-domain, validated survey was distributed to Program Directors (PDs) of US NPM fellowship programs. The 47-item survey explored 5 domains: professionalism, independent practice, psychomotor ability, clinical evaluation, and academia. A systematic, qualitative analysis on free-text comments was also performed.

RESULTS

Sixty-one PDs completed the survey, for a response rate of 62% (61/98). For entering fellows, PDs assessed performance in professionalism positively, including 76% as communicating effectively with parents and 90% treating residents/house-staff with respect. In contrast, most PDs rated performance in psychomotor abilities negatively, including 59% and 79% as deficient in bag-and-mask ventilation and neonatal endotracheal intubation, respectively. Although 62% of PDs assessed entering fellows positively for genuine interest in academic projects, fewer than 10% responded positively that entering fellows understood research protocol design, basic statistics, or were capable of writing a cohesive manuscript well. Thematic clustering of qualitative data revealed deficits in psychomotor ability and academia/scholarship.

CONCLUSIONS

On the basis of the perspective of front line educators, graduating pediatric residents are underprepared for subspecialty fellowship training in NPM. To provide the best preparation for pediatric graduates who pursue advanced training, changes to residency education to address deficiencies in these important competencies are warranted.

An Analysis of the Top-cited Articles in Emergency Medicine Education Literature

Introduction

Dissemination of educational research is critical to improving medical education, promotion of faculty and ultimately patient care. The objective of this study was to identify the top 25 cited education articles in the emergency medicine (EM) literature and the top 25 cited EM education articles in all journals, as well as report on the characteristics of the articles.

Methods

Two searches were conducted in the Web of Science in June 2016 using a list of education-related search terms. We searched 19 EM journals for education articles as well as all other literature for EM education-related articles. Articles identified were reviewed for citation count, article type, journal, authors, and publication year.

Results

With regards to EM journals, the greatest number of articles were classified as articles/reviews, followed by research articles on topics such as deliberate practice (cited 266 times) and cognitive errors (cited 201 times). In contrast in the non-EM journals, research articles were predominant. Both searches found several simulation and ultrasound articles to be included. The most common EM journal was Academic Emergency Medicine (n = 18), and Academic Medicine was the most common non-EM journal (n=5). A reasonable number of articles included external funding sources (6 EM articles and 13 non-EM articles.)

Conclusion

This study identified the most frequently cited medical education articles in the field of EM education, published in EM journals as well as all other journals indexed in Web of Science. The results identify impactful articles to medical education, providing a resource to educators while identifying trends that may be used to guide EM educational research and publishing efforts.

Simulation in neonatal transport medicine

The safe transport of infants in critical condition requires highly reliable inter-professional transport teams that are equipped with the expertise to provide neonatal care in unfamiliar and resource-limited environments. Increasingly, transport teams are comprised of health professionals from various disciplines. Providing didactic and experiential learning alone is insufficient to fully prepare teams that have limited exposure to rare events. Simulation-based training supplements and reinforces knowledge, skills, and the experiences of team members. This article presents the current use of simulation in the training of neonatal transport teams and critically reviews how simulation methodologies may be further incorporated into curricula and quality improvement to achieve high-reliability teams.

Using wise interventions to motivate deliberate practice

Deliberate practice leads to world-class excellence across domains. In the current investigation, we examined whether psychologically "wise" interventions targeting expectancies and values-stock antecedents of ordinary effortful behaviors-could motivate nonexperts to engage in deliberate practice and improve their achievement. As a preliminary, we developed and validated a novel task measure of deliberate practice and confirmed its association with (a) expectancy-value beliefs, and (b) achievement in the nonexpert setting (Study 1). Next, across 4 longitudinal, randomized-controlled, field experiments, we intervened. Among lower-achievers, wise deliberate practice interventions improved math performance for 5th and 6th graders (Study 2), end-of-semester grades for undergraduates (Study 3), and end-of-quarter grades for 6th graders (Study 4); the same pattern of results emerged in end-of-quarter grades for 7th graders (Study 5). Following the intervention, expectancy-value beliefs and deliberate practice improved for 1 month (Study 4), but not 4 (Study 5). Treatment proved beneficial over and above 2 control conditions: 1 that taught standard study skills (Studies 2 and 3), and 1 that discussed deep interests, generalized motivation, and high achievement (Studies 4 and 5). Collectively, these findings provide preliminary support for the heretofore untested hypothesis that deliberate practice submits to the same laws that govern typical forms of effortful behavior, and that wise interventions that tap into these laws can spur short-term gains in adaptive beliefs, deliberate practice, and objectively measured achievement. (PsycINFO Database Record

The Resident-Run Minor Surgery Clinic: A Pilot Study to Safely Increase Operative Autonomy

OBJECTIVE

General surgery training has evolved to align with changes in work hour restrictions, supervision regulations, and reimbursement practices. This has culminated in a lack of operative autonomy, leaving residents feeling inadequately prepared to perform surgery independently when beginning fellowship or practice. A resident-run minor surgery clinic increases junior resident autonomy, but its effects on patient outcomes have not been formally established. This pilot study evaluated the safety of implementing a resident-run minor surgery clinic within a university-based general surgery training program.

DESIGN

Single institution case-control pilot study of a resident-run minor surgery clinic from 9/2014 to 6/2015. Rotating third-year residents staffed the clinic once weekly. Residents performed operations independently in their own procedure room. A supervising attending surgeon staffed each case prior to residents performing the procedure and viewed the surgical site before wound closure. Postprocedure patient complications and admissions to the hospital because of a complication were analyzed and compared with an attending control cohort.

SETTING

Massachusetts General Hospital General in Boston, MA; an academic tertiary care general surgery residency program.

PARTICIPANTS

Ten third-year general surgery residents.

RESULTS

Overall, 341 patients underwent a total of 399 procedures (110 in the resident clinic vs. 289 in the attending clinic). Minor surgeries included soft tissue mass excision (n = 275), abscess incision and drainage (n = 66), skin lesion excision (n = 37), skin tag removal (n = 15), and lymph node excision (n = 6). There was no significant difference in the overall rate of patients developing a postprocedure complication within 30 days (3.6% resident vs. 2.8% attending; p = 0.65); which persisted on multivariate analysis. Similar findings were observed for the rate of hospital admission resulting from a complication. Resident evaluations overwhelmingly supported the rotation, citing increased operative autonomy as the greatest strength.

CONCLUSIONS

Implementation of a resident-run minor surgery clinic is a safe and effective method to increase trainee operative autonomy. The rotation is well suited for mid-level residents, as it provides an opportunity for realistic self-evaluation and focused learning that may enhance their operative experience during senior level rotations.

Pathology Resident Perspectives on Feedback and a Proposed Trainee Curriculum on Giving Feedback

OBJECTIVES

Receiving and reflecting on feedback is a critical skill in medicine. Learning how to provide effective feedback is important in assessment and engendering performance improvement.

METHODS

We outline a curriculum for laboratory medicine trainees on providing effective feedback. A group of trainees (26/30 attendees) was surveyed regarding their perspectives on effective feedback and impressions of an educational session focused on how to give effective feedback.

RESULTS

The curriculum involved a 1-hour session focused on how to provide useful feedback. The two presenters used role-plays, group discussion, and didactic talk to present the material. Most attendees (n = 22/26) indicated that regular or frequent effective feedback was important to their learning. When asked, "What makes feedback effective for you?" the most frequent responses were being specific (n = 11) and being balanced (ie, presenting both positives and negative) (n = 10). On a Likert scale (1 = poor; 7 = excellent), attendees rated their ability to give feedback higher after the session (mean, 5.2) vs before the session (mean, 3.8).

CONCLUSIONS

Feedback is an important component of assessment and reflective practice. Pathology trainees believe that being specific and balanced were characteristics of effective feedback. It is important to provide training on giving effective feedback to pathology trainees.

Objective Assessment of General Surgery Residents Followed by Remediation

OBJECTIVE

Surgical training programs often lack objective assessment strategies. Complicated scheduling characteristics frequently make it difficult for surgical residents to undergo formal assessment; actually having the time and opportunity to remediate poor performance is an even greater problem. We developed a novel methodology of assessment for residents and created an efficient remediation system using a combination of simulation, online learning, and self-assessment options.

DESIGN

Postgraduate year (PGY) 2 to 5 general surgery (GS) residents were tested in a 5 station, objective structured clinical examination style event called the Surgical X-Games. Stations were 15 minutes in length and tested both surgical knowledge and technical skills. Stations were scored on a scale of 1 to 5 (1 = Fail, 2 = Mediocre, 3 = Pass, 4 = Good, and 5 = Stellar). Station scores ≤ 2 were considered subpar and required remediation to a score ≥ 4. Five remediation sessions allowed residents the opportunity to practice the stations with staff surgeons. Videos of each skill or test of knowledge with clear instructions on how to perform at a stellar level were offered. Trainees also had the opportunity to checkout take-home task trainers to practice specific skills. Residents requiring remediation were then tested again in-person or sent in self-made videos of their performance.

SETTING

Academic medical center.

PARTICIPANTS

PGY2, 3, 4, and 5 GS residents at Mayo Clinic in Rochester, MN.

RESULTS

A total of, 35 residents participated in the Surgical X-Games in the spring of 2015. Among all, 31 (89%) had scores that were deemed subpar on at least 1 station. Overall, 18 (58%) residents attempted remediation. All 18 (100%) achieved a score ≥ 4 on the respective stations during a makeup attempt. Overall X-Games scores and those of PGY2s, 3s, and 4s were higher after remediation (p < 0.05). No PGY5s attempted remediation.

CONCLUSIONS

Despite difficulties with training logistics and busy resident schedules, it is feasible to objectively assess most GS trainees and offer opportunities to remediate if performance is poor. Our multifaceted remediation methodology allowed 18 residents to achieve good or stellar performance on each station after deliberate practice. Enticing chief residents to participate in remediation efforts in the spring of their final year of training remains a work in progress.

The role of diagnosis in delirium

Delirium is common and is commonly misdiagnosed, chiefly in being missed (Bhat and Rockwood, 2007). The consequences of misdiagnosis are often severe and wide ranging, affecting patients, caregivers, health professionals, and hospitals (Inouye et al., 2014). Many an older hospitalized person with delirium is trapped in the interface between psychiatry and the rest of medicine, and can too easily be caught in the tendentious battles between treating teams. Both researchers and policymakers have sought to improve this unacceptable state of affairs (Young et al., 2010; Tieges et al., 2015).

Incentivising practice with take-home laparoscopic simulators in two UK Core Surgical Training programmes

Introduction

Practice using simulators has been validated as a mean for surgical trainees to improve basic laparoscopic skills and free their attention for higher cognitive functions. However, mere provision of equipment does not result in frequent practice. This study assesses one approach to incentivising practice within core surgical training programmes and leads to further recommendations.

Methods

30 core surgical trainees (CST) starting laparoscopic-based specialties were recruited from East and West of Scotland CST programmes and given take-home laparoscopic simulators, with six training modules. Attainment of target metric scores generated an eCertificate, to be rewarded by progression in the live theatre. Questionnaires assessed confounding variables and explored CSTs’ anxieties about laparoscopy.

Results

27 trainees (90%) agreed to participate (mean age 28 years, range 24–25; 17 males). 13 CSTs (48%) were in the first year of surgical training. 11 (41%) had no previous simulation experience and 7 (32%) CSTs played video games >3 hours/week. 12 of 27 trainees (44%) completed ≥1 task and 7 completed all (26%).

Performances improved in some participants, but overall engagement with the programme was poor. Reasons given included poor internet connectivity, busy rotations and examinations. CSTs who engaged in the study significantly reduced their anxiety (mean 4.96 vs 3.56, p<0.05).

Conclusions

The provision of take-home laparoscopic simulators with accompanying targets did not successfully incentivise CSTs to practise. However, the subgroup who did engage with the project reported performance improvements and significantly reduced anxiety. Proposals to overcome barriers to practising in simulation, including obligatory simulation-based assessments, are discussed.

Quality improvement utilizing in-situ simulation for a dual-hospital pediatric code response team

OBJECTIVE

Given the rarity of in-hospital pediatric emergency events, identification of gaps and inefficiencies in the code response can be difficult. In-situ, simulation-based medical education programs can identify unrecognized systems-based challenges. We hypothesized that developing an in-situ, simulation-based pediatric emergency response program would identify latent inefficiencies in a complex, dual-hospital pediatric code response system and allow rapid intervention testing to improve performance before implementation at an institutional level.

METHODS

Pediatric leadership from two hospitals with a shared pediatric code response team employed the Institute for Healthcare Improvement's (IHI) Breakthrough Model for Collaborative Improvement to design a program consisting of Plan-Do-Study-Act cycles occurring in a simulated environment. The objectives of the program were to 1) identify inefficiencies in our pediatric code response; 2) correlate to current workflow; 3) employ an iterative process to test quality improvement interventions in a safe environment; and 4) measure performance before actual implementation at the institutional level.

RESULTS

Twelve dual-hospital, in-situ, simulated, pediatric emergencies occurred over one year. The initial simulated event allowed identification of inefficiencies including delayed provider response, delayed initiation of cardiopulmonary resuscitation (CPR), and delayed vascular access. These gaps were linked to process issues including unreliable code pager activation, slow elevator response, and lack of responder familiarity with layout and contents of code cart. From first to last simulation with multiple simulated process improvements, code response time for secondary providers coming from the second hospital decreased from 29 to 7 min, time to CPR initiation decreased from 90 to 15 s, and vascular access obtainment decreased from 15 to 3 min. Some of these simulated process improvements were adopted into the institutional response while others continue to be trended over time for evidence that observed changes represent a true new state of control.

CONCLUSIONS

Utilizing the IHI's Breakthrough Model, we developed a simulation-based program to 1) successfully identify gaps and inefficiencies in a complex, dual-hospital, pediatric code response system and 2) provide an environment in which to safely test quality improvement interventions before institutional dissemination.

Social worker assessment of bad news delivery by emergency medicine residents: a novel direct-observation milestone assessment

The skill of delivering bad news is difficult to teach and evaluate. Residents may practice in simulated settings; however, this may not translate to confidence or competence during real experiences. We investigated the acceptability and feasibility of social workers as evaluators of residents' delivery of bad news during patient encounters, and assessed the attitudes of both groups regarding this process. From August 2013 to June 2014, emergency medicine residents completed self-assessments after delivering bad news. Social workers completed evaluations after observing these conversations. The Assessment tools were designed by modifying the global Breaking Bad News Assessment Scale. Residents and social workers completed post-study surveys. 37 evaluations were received, 20 completed by social workers and 17 resident self-evaluations. Social workers reported discussing plans with residents prior to conversations 90 % of the time (18/20, 95 % CI 64.5, 97.8). Social workers who had previously observed the resident delivering bad news reported that the resident was more skilled on subsequent encounters 90 % of the time (95 % CI 42.2, 99). Both social workers and residents felt that prior training or experience was important. First-year residents valued advice from social workers less than advice from attending physicians, whereas more experienced residents perceived advice from social workers to be equivalent with that of attending physicians (40 versus 2.9 %, p = 0.002). Social worker assessment of residents' abilities to deliver bad news is feasible and acceptable to both groups. This formalized self-assessment and evaluation process highlights the importance of social workers' involvement in delivery of bad news, and the teaching of this skill. This method may also be used as direct-observation for resident milestone assessment.

Developing expert political judgment: The impact of training and practice on judgmental accuracy in geopolitical forecasting tournaments

The heuristics-and-biases research program highlights reasons for expecting people to be poor intuitive forecasters. This article tests the power of a cognitive-debiasing training module (“CHAMPS KNOW”) to improve probability judgments in a four-year series of geopolitical forecasting tournaments sponsored by the U.S. intelligence community. Although the training lasted less than one hour, it consistently improved accuracy (Brier scores) by 6 to 11% over the control condition. Cognitive ability and practice also made largely independent contributions to predictive accuracy. Given the brevity of the training tutorials and the heterogeneity of the problems posed, the observed effects are likely to be lower-bound estimates of what could be achieved by more intensive interventions. Future work should isolate which prongs of the multipronged CHAMPS KNOW training were most effective in improving judgment on which categories of problems.

All for knots: evaluating the effectiveness of a proficiency-driven, simulation-based knot tying and suturing curriculum for medical students during their third-year surgery clerkship

BACKGROUND

We evaluated the effectiveness of implementing a proficiency-driven, simulation-based knot tying and suturing curriculum for medical students during their 3rd-year surgery clerkship.

METHODS

Medical students on the 3rd-year surgical clerkship completed a proficiency-driven, simulation-based knot tying and suturing curriculum consisting of 6 tasks. The effectiveness was evaluated by comparing the initial presession scores to the final postsession scores on an 8-item self-efficacy scale and evaluating pass rates on end of clerkship skills testing. A paired t test was used to analyze data.

RESULTS

Sixty-five students had matched preintervention and postintervention questionnaires for analysis. Pass rates approached 100% by the 3rd attempt on all tasks. Significant gains on all 8 items of the self-efficacy questionnaire from pretraining to post-training were noted. Timing of the general surgery rotation did not impact results.

CONCLUSIONS

Implementation of a simulation-based training, proficiency-driven knot tying and suturing curriculum for 3rd-year medical students during the surgery clerkship is feasible and effective in improving student self-efficacy and objective proficiency toward performance of the tasks taught.

Retention of laryngoscopy skills in medical students: a randomised, cross-over study of the Macintosh, A.P. Advance(™) , C-MAC(®) and Airtraq(®) laryngoscopes

In addition to being effective and easy to learn how to use, the ideal laryngoscope should be associated with minimal reduction in skill performance during gaps in practice over time. We compared the time taken to intubate the trachea of a manikin by novice medical students immediately after training, and then after 1 month, with no intervening practice. We designed a two-period, four-group, randomised, cross-over trial to compare the Macintosh, Venner(™) A.P. Advance(™) with difficult airway blade, C-MAC(®) with D-Blade and Airtraq(®) with wireless video-viewer. A bougie was used to aid intubation with the Macintosh and the C-MAC. After training, there was no significant difference in median (IQR [range]) intubation time using the videolaryngoscopes compared with the Macintosh, which took 30 (26.5-35 [12-118])s. One month later, the intubation time was longer using the C-MAC (41 (29.5-52 [20-119])s; p = 0.002) and A.P. Advance (40 (28.5-57.5 [21-107])s; p = 0.0003)m compared with the Macintosh (27 (21-29 [16-90])s); there was no difference using the Airtraq (27 (20.5-32.5 [15-94])s; p = 0.258) compared with the Macintosh. While skill acquisition after a brief period of learning and practice was equal for each laryngoscope, performance levels differed after 1 month without practice. In particular, the consistency of performance using the C-MAC and A.P. Advance was worse compared with the Macintosh and the Airtraq. While the clinical significance of this is doubtful, we believe that reliable and consistent performance at laryngoscopy is desirable; for the devices that we tested, this requires regular practice.

Surgical Simulation and Competency

Simulation in surgical training is playing an increasingly important role as postgraduate medical education programs navigate an environment of increasing costs of education, increased attention on patient safety, and new duty hour restrictions. In obstetrics and gynecology, simulation has been used to teach many procedures; however, it lacks a standardized curriculum. Several different simulators exist for teaching various routes and aspects of hysterectomy. This article describes how a formal framework of increasing levels of competencies can be applied to simulation in teaching the procedure of hysterectomy.

Clinical teaching as part of continuing professional development: Does teaching enhance clinical performance?

INTRODUCTION

Physicians identify teaching as a factor that enhances performance, although existing data to support this relationship is limited.

PURPOSE

To determine whether there were differences in clinical performance scores as assessed through multisource feedback (MSF) data based on clinical teaching.

METHODS

MSF data for 1831 family physicians, 1510 medical specialists, and 542 surgeons were collected from physicians' medical colleagues, co-workers (e.g., nurses and pharmacists), and patients and examined in relation to information about physician teaching activities including percentage of time spent teaching during patient care and academic appointment. Multivariate analysis of variance, partial eta squared effect sizes, and Tukey's HSD post hoc comparisons were used to determine between group differences in total MSF mean and subscale mean performance scores by teaching and academic appointment data.

RESULTS

Higher clinical performance scores were associated with holding any academic appointment and generally with any time teaching versus no teaching during patient care. This was most evident for data from medical colleagues, where these differences existed across all specialty groups.

CONCLUSION

More involvement in teaching was associated with higher clinical performance ratings from medical colleagues and co-workers. These results may support promoting teaching as a method to enhance and maintain high-quality clinical performance.