Deliberate practice and acquisition of expert performance: a general overview

The heart of the matter: years-saved from cardiovascular and cancer deaths in an elite athlete cohort with over a century of follow-up

To quantify the years of life saved from cardiovascular (CVD), cancer and overall deaths among elite athletes according to their main type of physiological effort performed in the Olympic Games. All French athletes participating in the Games from 1912 to 2012, with vital status validated and cause of death (if concerned) identified by the national registries were included (n = 2814, 455 died) and classified according to 6 groups of effort: POWER (continuous effort < 45 s); INTERMEDIATE (45 s ≤ continuous effort < 600 s); ENDURANCE (continuous effort ≥ 600 s); POLYVALENT (participating in different events entering different classifications), INTERMITTENT (intermittent effort, i.e. team sports); PRECISION (targeting events). The theoretical years-lost method was adapted to calculate gains in longevity (years-saved) according to specific-risks under the competing risks model and was implemented in R software. Considering overall-deaths, all groups significantly saved, on average, 6.5 years of life (95% CI 5.8-7.2) compared to the general population. This longevity advantage is mainly driven by a lower risk of cancer which, isolated, contributed to significantly save 2.3 years of life (95% CI 1.2-1.9) on average in each group. The risk of CVD-related mortality in the ENDURANCE and PRECISION groups is not significantly different from the general population. The other groups significantly saved, on average, 1.6 years of life (95% CI 1.2-1.9) from CVD death. The longevity benefits in elite athletes are associated with the type of effort performed during their career, mainly due to differences on the CVD-risk of death.

Decision support for using mobile Rapid DNA analysis at the crime scene

Mobile Rapid DNA technology is close to being incorporated into crime scene investigations, with the potential to identify a perpetrator within hours. However, the use of these techniques entails the risk of losing the sample and potential evidence, because the device not only consumes the inserted sample, it is also is less sensitive than traditional technologies used in forensic laboratories. Scene of Crime Officers (SoCOs) therefore will face a 'time/success rate trade-off' issue when making a decision to apply this technology. In this study we designed and experimentally tested a Decision Support System (DSS) for the use of Rapid DNA technologies based on Rational Decision Theory (RDT). In a vignette study, where SoCOs had to decide on the use of a Rapid DNA analysis device, participating SoCOs were assigned to either the control group (making decisions under standard conditions), the Success Rate (SR) group (making decisions with additional information on DNA success rates of traces), or the DSS group (making decisions supported by introduction to RDT, including information on DNA success rates of traces). This study provides positive evidence that a systematic approach for decision-making on using Rapid DNA analysis assists SoCOs in the decision to use the rapid device. The results demonstrated that participants using a DSS made different and more transparent decisions on the use of Rapid DNA analysis when different case characteristics were explicitly considered. In the DSS group the decision to apply Rapid DNA analysis was influenced by the factors "time pressure" and "trace characteristics" like DNA success rates. In the SR group, the decisions depended solely on the trace characteristics and in the control group the decisions did not show any systematic differences on crime type or trace characteristic. Guiding complex decisions on the use of Rapid DNA analyses with a DSS could be an important step towards the use of these devices at the crime scene.

Cross-Institutional Evaluation of a Mastoidectomy Assessment Instrument

OBJECTIVE

The objective of this work is to obtain validity evidence for an evaluation instrument used to assess the performance level of a mastoidectomy. The instrument has been previously described and had been formulated by a multi-institutional consortium.

DESIGN

Mastoidectomies were performed on a virtual temporal bone system and then rated by experts using a previously described 15 element task-based checklist. Based on the results, a second, similar checklist was created and a second round of rating was performed.

SETTING

Twelve otolaryngological surgical training programs in the United States.

PARTICIPANTS

In all, 65 mastoidectomy performances were evaluated coming from 37 individuals with a variety of temporal bone dissection experience, from medical students to attending physicians. Raters were attending surgeons from 12 different institutions.

RESULTS

Intraclass correlation scores varied greatly between items in the checklist with some being low and some being high. Percentage agreement scores were similar to previous rating instruments. There is strong evidence that a high score on the task-based checklist is necessary for a rater to consider a mastoidectomy to be performed at the level of an expert but a high score is not a sufficient condition.

CONCLUSIONS

Rewording of the instrument items to focus on safety does not result in increased reliability of the instrument. The strong result of the Necessary Condition Analysis suggests that going beyond simple correlation measures can give extra insight into grading results. Additionally, we suggest using a multiple point scale instead of a binary pass/fail question combined with descriptive mastery levels.

Cricothyroidotomy In Situ Simulation Curriculum (CRIC Study): Training Residents for Rare Procedures

INTRODUCTION

Technical skill acquisition for rare procedures can be challenging given the few real-life training opportunities. In situ simulation (ISS), a training technique that takes place in the actual workplace, is a promising method to promote environmental fidelity for rare procedures. This study evaluated a simulation-based technical skill curriculum for cricothyroidotomy using deliberate practice, followed by an ISS evaluation session.

METHODS

Twenty emergency medicine residents participated in a two-part curriculum to improve cricothryoidotomy performance. A pretest established participant baseline technical skill. The training session consisted of two parts, didactic teaching followed by deliberate practice using a task-training manikin. A posttest consisted of an unannounced, high-fidelity ISS, during an emergency department shift. The primary outcome was the mean performance time between the pretest and posttest sessions. Skill performance was also evaluated using a checklist scale and global rating scale.

RESULTS

Cricothyroidotomy performance time improved significantly from pretest to posttest sessions (mean difference, 59 seconds; P < 0.0001). Both checklist and global rating scales improved significantly from the pretest to the posttest with a mean difference of 1.82 (P = 0.002) and 6.87 (P = 0.0025), respectively. Postcourse survey responses were favorable for both the overall curriculum experience and the unannounced ISS.

CONCLUSIONS

This pilot study demonstrated that unannounced ISS is feasible and can be used to effectively measure cricothyroidotomy performance among EM residents. After a two-part training session consisting of didactic learning and deliberate practice, improved cricothyroidotomy skill performance was observed during an unannounced ISS in the emergency department. The integration of ISS in cricothyroidotomy training represents a promising approach; however, further study is needed to establish its role.

Prospective evaluation of cardiac ultrasound performance by general internal medicine physicians during a 6-month faculty development curriculum

Background

Point-of-care (POCUS) education is rapidly expanding within medical schools and internal medicine residency programs, but lack of trained faculty is a major barrier. While POCUS training can improve short-term outcomes, knowledge and skills rapidly decay without deliberate practice and feedback. The purpose of this study was to evaluate the performance of focused cardiac ultrasound (FCU) by volunteer general internal medicine (GIM) faculty participating in a longitudinal POCUS curriculum.

Methods

Participants: Nine GIM clinician-educators participated in a 6-month POCUS curriculum. Faculty performance was compared to three cardiology fellows. Three diagnostic cardiac sonographers (DCS) were also evaluated and served as the gold standard. Evaluation: the primary outcome was a FCU efficiency score, calculated by dividing image quality score by exam duration. FCU exams were conducted on three standardized patients after completion of an introductory workshop, at 3 months, and at 6 months. Two blinded cardiologists scored the exams. Analysis: mean efficiency scores were compared using a linear mixed effects model, followed by pairwise comparisons using Tukey’s test.

Results

GIM faculty’s FCU efficiency scores were maintained over the 6-month period (2.2, SE 1.0 vs. 3.8, SE 1.0, p = 0.076). Their scores at each session were similar to cardiology fellows (p > 0.69), but inferior to DCSs (p < 0.0001).

Conclusion

GIM faculty participating in a POCUS curriculum maintained their FCU performance over 6 months with efficiency scores comparable to experienced cardiology fellows.

Electronic supplementary material

The online version of this article (10.1186/s13089-018-0090-7) contains supplementary material, which is available to authorized users.

Simulation in paediatric urology and surgery. Part 1: An overview of educational theory

Surgical training has changed radically in the last few decades. The traditional Halstedian model of time-bound apprenticeship has been replaced with competency-based training. Advanced understanding of mastery learning principles has vastly altered educational methodology in surgical training, in terms of instructional design, delivery of educational content, assessment of learning, and programmatic evaluation. As part of this educational revolution, fundamentals of simulation-based education have been adopted into all levels and aspects of surgical training, requiring an understanding of concepts of fidelity and realism and the impact they have on learning. There are many educational principles and theories that can help clinical teachers understand the way that their trainees learn. In the acquisition of surgical expertise, concepts of mastery learning, deliberate practice, and experiential learning are particularly important. Furthermore, surgical teachers need to understand the principles of effective feedback, which is essential to all forms of skills learning. This article, the first of two papers, presents an overview of relevant learning theory for the busy paediatric surgeon and urologist. Seeking to introduce the concepts underpinning current changes in surgical education and training, providing practical tips to optimise teaching endeavours.

Assessment tool for the instructional design of simulation-based team training courses: the ID-SIM

Introduction

To achieve an expert performance of care teams, adequate simulation-based team training courses with an effective instructional design are essential. As the importance of the instructional design becomes ever more clear, an objective assessment tool would be valuable for educators and researchers. Therefore, we aimed to develop an evidence-based and objective assessment tool for the evaluation of the instructional design of simulation-based team training courses.

Methods

A validation study in which we developed an assessment tool containing an evidence-based questionnaire with Visual Analogue Scale (VAS) and a visual chart directly translating the results of the questionnaire. Psychometric properties of the assessment tool were tested using five descriptions of simulation-based team training courses. An expert-opinion-based ranking from poor to excellent was obtained. Ten independent raters assessed the five training courses twice, by using the developed questionnaire with an interval of 2 weeks. Validity and reliability analyses were performed by using the scores from the raters and comparing them with the expert’s ranking. Usability was assessed by an 11-item survey.

Results

A 42-item questionnaire, using VAS, and a propeller chart were developed. The correlation between the expert-opinion-based ranking and the evaluators’ scores (Spearman correlation) was 0.95, and the variance due to subjectivity of raters was 3.5% (VTraining*Rater). The G-coefficient was 0.96. The inter-rater reliability (intraclass correlation coefficient (ICC)) was 0.91 (95% CI 0.77 to 0.99), and intra-rater reliability for the overall score (ICC) was ranging from 0.91 to 0.99.

Conclusions

We developed an evidence-based and reliable assessment tool for the evaluation of the instructional design of a simulation-based team training: the ID-SIM. The ID-SIM is available as a free mobile application.

Creating an engaging and stimulating anatomy lecture environment using the Cognitive Load Theory-based Lecture Model: Students' experiences

OBJECTIVE

There is a need to create a standard interactive anatomy lecture that can engage students in their learning process. This study investigated the impact of a new lecturing guideline, the Cognitive Load Theory-based Lecture Model (CLT-bLM), on students' cognitive engagement and motivation.

METHODS

A randomised controlled trial involving 197 participants from three institutions was conducted. The control group attended a freestyle lecture on the gross anatomy of the heart, delivered by a qualified anatomist from each institution. The intervention group attended a CLT-bLM-based lecture on a similar topic, delivered by the same lecturer, three weeks thereafter. The lecturers had attended a CLT-bLM workshop that allowed them to prepare for the CLT-bLM-based lecture over the course of three weeks. The students' ratings on their cognitive engagement and internal motivation were evaluated immediately after the lecture using a validated Learners' Engagement and Motivation Questionnaire. The differences between variables were analysed and the results were triangulated with the focus group discussion findings that explored students' experience while attending the lecture.

RESULTS

The intervention group has a significantly higher level of cognitive engagement than the control group; however, no significant difference in internal motivation score was found. In addition, the intervention group reported having a good learning experience from the lectures.

CONCLUSION

The guideline successfully stimulated students' cognitive engagement and learning experience, which indicates a successful stimulation of students' germane resources. Stimulation of these cognitive resources is essential for successful cognitive processing, especially when learning a difficult subject such as anatomy.

Video-Enhanced Telemedicine Improves the Care of Acutely Injured Burn Patients in a Rural State

The acute care of burn patients is critical and can be a daunting experience for emergency personnel because of the scarcity of burn injuries. Telemedicine that incorporates a visual component can provide immediate expertise in the treatment and management of these injuries. The authors sought to evaluate the addition of video telemedicine to our current telephone burn transfer program. During a 2-year period, 282 patients, 59.4% of all burn patients transferred from outside hospitals, were enrolled in the study. In addition to the scripted call with the charge nurse (ChargeRN) and the accepting physician, nine hospitals also transmitted video images of the wounds before transfer as part of a store and forward telemedicine transfer program (77, 27.6%). The accuracy of burn size estimations (BSA burned) and management changes (fluid requirements, transfer mode, and final disposition) were analyzed between the telephones-only sites (T only) and the video-enhanced sites. Referringstaff participating in video-enhanced telemedicine were sent a Google survey assessing their experience the following day. The referring staff (Referringstaff) was correct in their burn assessment 20% of the time. Video assessment improved the ChargeRN BSA burned and resulted in more accurate fluid resuscitation (P = .030), changes in both transportation mode (P = .042), and disposition decisions (P = .20). The majority of the Referringstaff found that video-enhanced telemedicine helped them communicate with the burn staff more effectively (3.4 ± 0.37, scale 1-4). This study reports the successful implementation of video-enhanced telemedicine pilot project in a rural state. Video-enhanced telemedicine using a store and forward process improved burn size estimation and facilitated management changes. Although not quantitatively assessed, the low cost of the system coupled with the changes in transportation and disposition strongly suggests a decrease in healthcare costs associated with the addition of video to a telephone-only transfer program.

Use of Simulation in Performance Improvement

Human error and system failures continue to play a substantial role in preventable errors that lead to adverse patient outcomes or death. Many of these deaths are not the result of inadequate medical knowledge and skill, but occur because of problems involving communication and team management. Anesthesiologists pioneered the use of simulation for medical education in an effort to improve physician performance and patient safety. This article explores the use of simulation for performance improvement. Educational theories that underlie effective simulation programs are described as driving forces behind the advancement of simulation in performance improvement.

"The Early Specialised Bird Catches the Worm!" - A Specialised Sampling Model in the Development of Football Talents

Characteristics of learning activities in early sport participation play a key role in the development of the sporting talent. Therefore, pathways of specialisation or diversification/sampling are as well debated as the implementation of practice- or play-oriented activities. The related issues are currently perceived as a two-dimensional construct of domain specificity and performance orientation. In this context, it has been shown that early specialisation, with experiences in practice and play, has led to Swiss junior national team football players reaching higher success levels as adults. This study aimed to examine whether a similar approach improves chances of even being selected for junior national teams from a broader sample. Hence, 294 youth players answered retrospective questionnaires on their early sport participation when entering the Swiss football talent development programme. Using the person-oriented Linking of Clusters after removal of a Residue (LICUR) method, volumes of in-club practice, free play and activities besides football until 12 years of age were analysed along with age at initial club participation. According to the results, clusters of Football enthusiasts (p = 0.01) with the most free play and above average in-club practice and Club players (p = 0.02) with the most in-club practice and average free play had a greater chance of reaching junior national team level. Thus, high levels of domain-specific activities seem to increase the chances of junior national team participation. Furthermore, the most successful constellation (Football enthusiasts) may illustrate the relevance of domain-specific diversity, induced by several types of practice and play. In line with previous studies, specialising in football and sampling different experiences within this specific domain seems to be the most promising pathway. Therefore, we argue that the optimal model for the development of football talents is a specialised sampling model.

Toward a multifactorial model of expertise: beyond born versus made

The debate over the origins of individual differences in expertise has raged for over a century in psychology. The "nature" view holds that expertise reflects "innate talent"-that is, genetically determined abilities. The "nurture" view counters that, if talent even exists, its effects on ultimate performance are negligible. While no scientist takes seriously a strict nature-only view of expertise, the nurture view has gained tremendous popularity over the past several decades. This environmentalist view holds that individual differences in expertise reflect training history, with no important contribution to ultimate performance by innate ability ("talent"). Here, we argue that, despite its popularity, this view is inadequate to account for the evidence concerning the origins of expertise that has accumulated since the view was first proposed. More generally, we argue that the nature versus nurture debate in research on expertise is over-or certainly should be, as it has been in other areas of psychological research for decades. We describe a multifactorial model for research on the nature and nurture of expertise, which we believe will provide a progressive direction for future research on expertise.

Improving Performance of Mammographic Breast Positioning in an Academic Radiology Practice

OBJECTIVE

The purpose of this project was to achieve sustained improvement in mammographic breast positioning in our department.

MATERIALS AND METHODS

Between June 2013 and December 2016, we conducted a team-based performance improvement initiative with the goal of improving mammographic positioning. The team of technologists and radiologists established quantitative measures of positioning performance based on American College of Radiology (ACR) criteria, audited at least 35 mammograms per week for positioning quality, displayed performance in dashboards, provided technologists with positioning training, developed a supportive environment fostering technologist and radiologist communication surrounding mammographic positioning, and employed a mammography positioning coach to develop, improve, and maintain technologist positioning performance. Statistical significance in changes in the percentage of mammograms passing the ACR criteria were evaluated using a two-proportion z test.

RESULTS

A baseline mammogram audit performed in June 2013 showed that 67% (82/122) met ACR passing criteria for positioning. Performance improved to 80% (588/739; p < 0.01) after positioning training and technologist and radiologist agreement on positioning criteria. With individual technologist feedback, positioning further improved, with 91% of mammograms passing ACR criteria (p < 0.01). Seven months later, performance temporarily decreased to 80% but improved to 89% with implementation of a positioning coach. The overall mean performance of 91% has been sustained for 23 months. The program cost approximately $30,000 to develop, $42,000 to launch, and $25,000 per year to maintain. Almost all costs were related to personnel time.

CONCLUSION

Dedicated performance improvement methods may achieve significant and sustained improvement in mammographic breast positioning, which may better enable facilities to pass the recently instated Enhancing Quality Using the Inspection Program portion of a practice's annual Mammography Quality Standards Act inspections.

Integrating Scaffolding and Deliberate Practice Into Focused Cardiac Ultrasound Training: A Simulator Curriculum

INTRODUCTION

Focused cardiac ultrasound (FoCUS) is widely used for the point-of-care evaluation of basic cardiac pathology, and there is a need for efficient and consistent training in this modality. We designed a simulator-based FoCUS curriculum that integrates instructional scaffolding and deliberate practice to create a directed, self-regulated learning experience for novices. The goal of this strategy was to guide the novice's learning efforts more efficiently and moderate cognitive load while retaining the benefits of independent learning.

METHODS

The complex task of learning cardiac ultrasound is broken into discrete steps, with focused didactic information immediately followed by targeted simulator practice for each module. The practice complexity increases through successive modules, and learners ultimately apply their skills by completing unassisted simulator cases. Immediate visual and quantitative feedback is provided by the simulator whenever an ultrasound image was captured during practice. The entire curriculum is self-guided.

RESULTS

Sixteen nurse practitioners and resident physicians completed this FoCUS curriculum. In comparison to a previously validated, lecture-before-practice-style curriculum, the average time to completion decreased from 8.0 ± 2.5 hours to 4.7 ± 1.9 hours (p < .0001). There was no difference in posttraining cognitive or psychomotor outcomes between the curricula as measured by a simulator posttest.

DISCUSSION

A curriculum integrating scaffolding and deliberate practice provides a more efficient, but equally effective, means of teaching psychomotor and cognitive skills in FoCUS. These instructional design principles may translate to other operational learning tasks and allow novices to build skills and reach basic competency more rapidly.

Skills transfer to sinus surgery via a low-cost simulation-based curriculum

BACKGROUND

Surgical skill development outside the operating room aims to improve technique and subsequent patient safety. The purpose of this study was to evaluate the correlation between technical and cognitive skills with cadaveric endoscopic sinus surgery (ESS) performance and change in ESS performance before and after implementation of a dedicated ESS simulation-based and knowledge-based curriculum.

METHODS

A before-after study design was implemented among 10 medical students and 10 junior otolaryngology residents. Participants completed a knowledge-based, multiple-choice ESS pretest and watched an ESS prosection video. Participants performed 9 tasks on a previously validated low-cost, low-technology, nonbiologic sinus surgery task trainer followed by cadaveric maxillary antrostomy and anterior ethmoidectomy. Participants then completed a simulation-based and knowledge-based ESS curriculum followed by a repeat cadaveric maxillary antrostomy and anterior ethmoidectomy. Performance was graded with a 5-point global rating scale (GRS) and a 5-point ESS-specific checklist.

RESULTS

We observed a stronger correlation between the multiple-choice, knowledge-based, ESS pretest scores and cadaveric ESS GRS score (r = 0.73) than between task trainer performance and cadaveric ESS GRS score (r = 0.43). We also noted a significant increase in precurriculum vs postcurriculum mean ± standard deviation (SD) cadaveric ESS checklist scores for both medical students (1.18 ± 0.25 vs 2.58 ± 0.57; p = 0.0002) and residents (2.09 ± 0.78 vs 2.88 ± 0.54; p = 0.023). The greatest improvements for residents were in performance of uncinectomy, enlargement of maxillary os, and identification of the bulla.

CONCLUSION

These findings provide evidence supporting the use of ESS training curricula outside the operating room.

An Evaluation of an eHealth Tool Designed to Improve College Students' Label-Reading Skills and Feelings of Empowerment to Choose Healthful Foods

Objective

College students are at risk for poor dietary choices. New skills can empower individuals to adopt healthful behaviors, yet eHealth tools designed to develop food-choice skills, such as label-reading skills, are uncommon. We investigated the effects of web-based label-reading training on college students’ perceptions of healthful food-choice empowerment.

Methods

Students completed label-reading training in which they practiced selecting the more healthful food using nutrition labels. We examined improvements in label-reading accuracy (correct healthfulness decisions) and perceptions of empowerment, using a 6-item scale. Repeated measures ANOVAs and paired-samples t-tests were used to examine changes in accuracy and empowerment across the training session.

Results

In addition to increases in label-reading accuracy with training, we found increases in healthful food-choice empowerment scores. Specifically, the proportion of correct (i.e., more healthful) food choices increased across the three blocks of practice (p = 0.04) and food-choice empowerment scores were about 7.5% higher on average after training (p < 0.001).

Conclusion and implications

Label-reading training was associated with increased feelings of empowerment associated with making healthful food choices. Skill focused eHealth tools may offer an important avenue for motivating behavior change through skill development.

Prior Generic Arthroscopic Volume Correlates with Hip Arthroscopic Proficiency: A Simulator Study

BACKGROUND

Changing trends in surgical education and patient expectation are leading to proficiency models of progression and the use of simulators. Hip arthroscopy is increasingly performed and has a steep learning curve mainly addressed during fellowship training. The aim of this study was to assess the impact of previous generic arthroscopic experience on performance at a simulated hip arthroscopy task to both estimate the minimum case numbers that correlate with expert proficiency levels and help to guide selection for hip arthroscopy fellowships.

METHODS

Fifty-two participants were recruited to a cross-sectional study. Four consultants (expert hip arthroscopists), 28 trainees (residents and fellows), and 20 novices (interns and medical students) performed a standardized bench-top simulated hip arthroscopy task. A validated global rating scale (GRS) score and motion analysis were used to assess surgical performance. Prior arthroscopic experience was recorded from surgical electronic logbooks. Receiver operating characteristic (ROC) curve analyses were conducted to identify optimum cut-points for task proficiency at both expert and competent GRS levels.

RESULTS

There were significant differences (p < 0.05) between the arthroscopic ability of all experience groups based on GRS assessment and for all motion analysis metrics. There was a significant positive correlation between logbook numbers and GRS scores (p < 0.0001). ROC curve analysis demonstrated that a minimum of 610 prior arthroscopic procedures were necessary to achieve an expert GRS score, and 78 prior arthroscopic procedures were necessary for a competent score.

CONCLUSIONS

Performing a basic hip arthroscopy task competently requires substantial previous generic arthroscopic experience. The numbers identified in this study provide targets for residents. Program directors appointing to hip arthroscopy fellowship training posts may find these results useful as a guide during the selection process.

Modeling Learning in Surgical Practice

OBJECTIVE

Methods that model surgical learning curves are frequently descriptive and lack the mathematical rigor required to extract robust, meaningful, and quantitative information. We aimed to formulate a method to model learning that is tailored to dealing with the high variability seen in surgical data and can readily extract important quantitative information such as learning rate, length of learning, and learnt level of performance.

METHODS

We developed a method where progressively more complex models are fitted to learning data. These include novel models that split the learning data into 2 linear phases and fit adjoining lines using least squares regression. The models were compared and the least complex model was selected unless a more complex one was significantly better. Significance was tested by Fischer tests. We applied this method to total hip and knee replacements using imageless navigation, analyzing the operative time for a surgeon's first 50 and 60 operations, respectively. This method was then tested against 4 sets of simulated learning data.

RESULTS

The proposed method of progressive model complexity successfully modeled the learning curve among real operative data. It was also effective in deducing the underlying trends in simulated scenarios, created to represent typical situations that can practically arise in any learning process.

CONCLUSIONS

The novel modeling method can be used to extract meaningful and quantitative information from learning data displaying high variability seen in surgical practice. By using simple and intuitive models, the method is accessible to researchers and educators without the need for specialist statistical knowledge.

Experience Within the Emergency Department and Improved Productivity for First-Year Residents in Emergency Medicine and Other Specialties

Introduction

Resident productivity is an important educational and operational measure in emergency medicine (EM). The ability to continue effectively seeing new patients throughout a shift is fundamental to an emergency physician’s development, and residents are integral to the workforce of many academic emergency departments (ED). Our previous work has demonstrated that residents make gains in productivity over the course of intern year; however, it is unclear whether this is from experience as a physician in general on all rotations, or specific to experience in the ED.

Methods

This was a retrospective cohort study, conducted in an urban academic hospital ED, with a three-year EM training program in which first-year residents see new patients ad libitum. We evaluated resident shifts for the total number of new patients seen. We constructed a generalized estimating equation to predict productivity, defined as the number of new patients seen per shift, as a function of the week of the academic year, the number of weeks spent in the ED, and their interaction. Off-service residents’ productivity in the ED was analyzed in a secondary analysis.

Results

We evaluated 7,779 EM intern shifts from 7/1/2010 to 7/1/2016. Interns started at 7.16 (95% confidence interval [CI] [6.87 – 7.45]) patients per nine-hour shift, with an increase of 0.20 (95% CI [0.17 – 0.24]) patients per shift for each week in the ED, over 22 weeks, leading to 11.5 (95% CI [10.6 – 12.7]) patients per shift at the end of their training in the ED. The effects of the week of the academic year and its interaction with weeks in the ED were not significant. We evaluated 2,328 off-service intern shifts, in which off-service residents saw 5.43 (95% CI [5.02 – 5.84]) patients per nine-hour shift initially, with 0.46 additional patients per week in the ED (95% CI [0.25 – 0.68]). The weeks of the academic year were not significant.

Conclusion

Intern productivity in EM correlates with time spent training in the ED, and not with experience on other rotations. Accordingly, an EM intern’s productivity should be evaluated relative to their aggregate time in the ED, rather than the time in the academic year.

Landmark lecture on surgery: paediatric cardiothoracic surgery - training the next generation of congenital heart surgeons

Introduction Recent changes in surgical education have had an impact on our congenital training programmes. The mandate of the 8-hour workweek, a rapidly expanding knowledge base, and a host of other mandates has had an impact on the readiness of the fellows who are entering congenital programmes. To understand these issues completely, we interviewed the top congenital experts in the United States of America. The purpose of this paper is to share their insight and offer suggestions to address these challenges.

METHODS

We used a qualitative thematic analysis approach and performed phone interviews with the top five congenital experts in the United States of America.

RESULTS

Experts unanimously felt that duty-hour restrictions have negatively affected congenital training programmes in the following ways: current fellows do not seem as conditioned as fellows in the past, patient handoffs are not consistent with excellent performance, the mentor-mentee relationship has been affected by duty-hour restrictions, and fellows may be less prepared for real-world practice. Three positive themes emerged in response to duty-hour restrictions: fellows appear to be doing less menial task work, fellows are now better rested for learning, and we are attracting more individuals into the speciality. Experts agreed that congenital fellowships should be increased to 2 years. There was support for both the traditional and integrated residency pathways. Discussion We are in a new era of education and must work together to overcome the challenges that have arisen in recent years.

Perceptions of busyness in the emergency department: an opportunity to address a training gap through competency based education

None

Review article: Critical Care Airway Management eLearning modules

The Australasian College for Emergency Medicine (ACEM) has recently launched the Critical Care Airway Management eLearning modules to support emergency medicine trainees in developing their airway management skills in the ED. A team of emergency physicians and trainees worked collaboratively to develop the eLearning resources ensuring extensive stakeholder consultation. A comprehensive resource manual was written to provide learners with knowledge that underpins the modules. ACEM provided project coordination as well as administrative and technical team support to the production. Although specifically developed with early ACEM trainees in mind, it is envisaged the resources will be useful for all emergency clinicians. The project was funded by the Australian Commonwealth Department of Health.

A Comparison of Objective Assessment Data for the United States and International Medical Graduates in a General Surgery Residency

OBJECTIVE

To compare objective assessment scores between international medical graduates (IMGs) and United States Medical Graduates. Scores of residents who completed a preliminary year, who later matched into a categorical position, were compared to those who matched directly into a categorical position at the Mayo Clinic, Rochester.

DESIGN

Postgraduate year (PGY) 1 to 5 residents participate in a biannual multistation, OSCE-style assessment event as part of our surgical training program. Assessment data were, retrospectively, reviewed and analyzed from 2008 to 2016 for PGY-1 and from 2013 to 2016 for PGY 2 to 5 categorical residents.

SETTING

Academic medical center.

PARTICIPANTS

Categorical PGY 1 to 5 General Surgery (GS) residents at Mayo Clinic Rochester, MN.

RESULTS

A total of 86 GS residents were identified. Twenty-one residents (1 United States Medical Graduates [USMG] and 20 IMGs) completed a preliminary GS year, before matching into a categorical position and 68 (58 USMGs and 10 IMGs) residents, who matched directly into a categorical position, were compared. Mean scores (%) for the summer and winter multistation assessments were higher for PGY-1 trainees with a preliminary year than those without (summer: 59 vs. 37, p < 0.001; winter: 69 vs. 61, p = 0.05). Summer and winter PGY-2 scores followed the same pattern (74 vs. 64, p < 0.01; 85 vs. 71, p < 0.01). For the PGY 3 to 5 assessments, differences in scores between these groups were not observed. IMGs and USMGs scored equivalently on all assessments. Overall, junior residents showed greater score improvement between tests than their senior colleagues (mean score increase: PGY 1-2 = 18 vs. PGY 3-5 = 3, p < 0.001).

CONCLUSIONS

Residents with a previous preliminary GS year at our institution scored higher on initial assessments compared to trainees with no prior GS training at our institution. The scoring advantage of an added preliminary year decreased as trainees progressed through residency.

Moving from Novice to Expertise and Its Implications for Instruction

Objective: To address the stages of expertise development, what differentiates a novice from an expert, and how the development and differences impact how we teach our classes or design the curriculum. This paper will also address the downside of expertise and discuss the importance of teaching expertise relative to domain expertise. Summary: Experts develop through years of experience and by progressing from novice, advance beginner, proficient, competent, and finally expert. These stages are contingent on progressive problem solving, which means individuals must engage in increasingly complex problems, strategically aligned with the learner's stage of development. Thus, several characteristics differentiate experts from novices. Experts know more, their knowledge is better organized and integrated, they have better strategies for accessing knowledge and using it, and they are self-regulated and have different motivations.

Simulation-based training program with deliberate practice for ultrasound-guided jugular central venous catheter placement

BACKGROUND

Current evidence supports the utility of simulation training for bedside procedures such as ultrasound-guided jugular central venous catheter (CVC) insertion. However, a standardized methodology to teach procedural skills has not been determined yet. The aim of this study was to evaluate the effectiveness of a simulation-based training program for improving novice technical performance during ultrasound-guided internal jugular CVC placement.

METHODS

Postgraduate year 1 (PGY-1) residents from anesthesiology, emergency medicine, cardiology, ICU, and nephrology specialties were trained in four deliberate practice sessions. Learning objectives included principles of ultrasound (US), preparation (gown, glove, draping), procedural skills I (US scanning and puncture), and procedural skills II (catheter insertion). CVC technical proficiency was tested pre- and post-training using hand-motion analysis with the Imperial College Surgical Assessment Device (ICSAD) and a global rating scale (GRS).

RESULTS

Thirty-five PGY-1 residents successfully completed the program. These novices' GRS scores improved significantly after the training (P < 0.001). Total path length measured with the ICSAD decreased significantly after the training (P = 0.008). Procedural time decreased significantly after training from 387 (310-501) seconds to 200 (157-261) seconds (median and interquartile range) (P = 0.029).

CONCLUSION

This simulation-training program based on deliberate practice significantly increased the technical skills of residents in US-guided short-axis, out-of-plane internal jugular CVC placement. Data also confirm the validity of the ICSAD as an assessment tool for ultrasound-guided internal jugular CVC placement learning.

Deliberate acquisition of competence in physiological breech birth: A grounded theory study

PROBLEM

Research suggests that the skill and experience of the attendant significantly affect the outcomes of vaginal breech births, yet practitioner experience levels are minimal within many contemporary maternity care systems.

BACKGROUND

Due to minimal experience and cultural resistance, few practitioners offer vaginal breech birth, and many practice guidelines and training programmes recommend delivery techniques requiring supine maternal position. Fewer practitioners have skills to support physiological breech birth, involving active maternal movement and choice of birthing position, including upright postures such as kneeling, standing, squatting, or on a birth stool. How professionals learn complex skills contrary to those taught in their local practice settings is unclear.

QUESTION

How do professionals develop competence and expertise in physiological breech birth?

METHODS

Nine midwives and five obstetricians with experience facilitating upright physiological breech births participated in semi-structured interviews. Data were analysed iteratively using constructivist grounded theory methods to develop an empirical theory of physiological breech skill acquisition.

RESULTS

Among the participants in this research, the deliberate acquisition of competence in physiological breech birth included stages of affinity with physiological birth, critical awareness, intention, identity and responsibility. Expert practitioners operating across local and national boundaries guided less experienced practitioners.

DISCUSSION

The results depict a specialist learning model which could be formalised in sympathetic training programmes, and evaluated. It may also be relevant to developing competence in other specialist/expert roles and innovative practices.

CONCLUSION

Deliberate development of local communities of practice may support professionals to acquire elusive breech skills in a sustainable way.

Professional expertise amongst speech-language therapists: “willing to share”

Purpose

The current healthcare environment provides several challenges to the existing roles of healthcare professionals. The value of the professional expert is also under scrutiny. The purpose of this paper is to generate a construction of professional expertise amongst practitioners in the current healthcare environment. It used the speech-language therapy community in New Zealand (NZ) as an example.

Design/methodology/approach

Speech-language therapists currently practicing in NZ completed an online survey including qualitative and quantitative components. The range of experience and work settings of participants (n=119) was representative of the workforce.

Findings

Participants clearly identified being “highly experienced” and “having in-depth knowledge” as essential elements of professional expertise. Thematic analysis generated two interconnected themes of a professional expert being a personal leader and teacher, and a highly experienced, knowledgeable and skilful practitioner. Additionally, practitioners needed to be seen to contribute to the community in order to be known as experts. Clinical practice was valued differently from research generation.

Originality/value

This study is novel in exploring a construction of professional expertise amongst practitioners in a current healthcare community. Within that community, experts could be viewed as highly effective practitioners that visibly contribute to the professional community. The study draws attention to the role of reputation and the impacts of being a clinical teacher or leader compared with pursuing a research role. This could be particularly relevant in the promotion of evidence-based practice.

Learning in professionally 'distant' contexts: opportunities and challenges

The changing nature of healthcare education and delivery is such that clinicians will increasingly find themselves practicing in contexts that are physically and/or conceptually different from the settings in which they were trained, a practice that conflicts on some level with socio-cultural theories of learning that emphasize learning in context. Our objective was therefore to explore learning in 'professionally distant' contexts. Using paramedic education, where portions of training occur in hospital settings despite preparing students for out-of-hospital work, fifty-three informants (11 current students, 13 recent graduates, 16 paramedic program faculty and 13 program coordinators/directors) took part in five semi-structured focus groups. Participants reflected on the value and role of hospital placements in paramedic student development. All sessions were audio recorded, transcribed verbatim and analyzed using inductive thematic analysis. In this context six educational advantages and two challenges were identified when using professionally distant learning environments. Learning could still be associated with features such as (a) engagement through "authenticity", (b) technical skill development, (c) interpersonal skill development, (d) psychological resilience, (e) healthcare system knowledge and (f) scaffolding. Variability in learning and misalignment with learning goals were identified as potential threats. Learning environments that are professionally distant from eventual practice settings may prove meaningful by providing learners with foundational and preparatory learning experiences for competencies that may be transferrable. This suggests that where learning occurs may be less important than how the experience contributes to the learner's development and the meaning or value he/she derives from it.

A primer on the statistical modelling of learning curves in health professions education

Learning curves are a useful way of representing the rate of learning over time. Features include an index of baseline performance (y-intercept), the efficiency of learning over time (slope parameter) and the maximal theoretical performance achievable (upper asymptote). Each of these parameters can be statistically modelled on an individual and group basis with the resulting estimates being useful to both learners and educators for feedback and educational quality improvement. In this primer, we review various descriptive and modelling techniques appropriate to learning curves including smoothing, regression modelling and application of the Thurstone model. Using an example dataset we demonstrate each technique as it specifically applies to learning curves and point out limitations.

Development of a reliable simulation-based test for diagnostic abdominal ultrasound with a pass/fail standard usable for mastery learning

BACKGROUND

This study aimed to develop a test with validity evidence for abdominal diagnostic ultrasound with a pass/fail-standard to facilitate mastery learning.

METHOD

The simulator had 150 real-life patient abdominal scans of which 15 cases with 44 findings were selected, representing level 1 from The European Federation of Societies for Ultrasound in Medicine and Biology. Four groups of experience levels were constructed: Novices (medical students), trainees (first-year radiology residents), intermediates (third- to fourth-year radiology residents) and advanced (physicians with ultrasound fellowship). Participants were tested in a standardized setup and scored by two blinded reviewers prior to an item analysis.

RESULTS

The item analysis excluded 14 diagnoses. Both internal consistency (Cronbach's alpha 0.96) and inter-rater reliability (0.99) were good and there were statistically significant differences (p < 0.001) between all four groups, except the intermediate and advanced groups (p = 1.0). There was a statistically significant correlation between experience and test scores (Pearson's r = 0.82, p < 0.001). The pass/fail-standard failed all novices (no false positives) and passed all advanced (no false negatives). All intermediate participants and six out of 14 trainees passed.

CONCLUSION

We developed a test for diagnostic abdominal ultrasound with solid validity evidence and a pass/fail-standard without any false-positive or false-negative scores.

KEY POINTS

• Ultrasound training can benefit from competency-based education based on reliable tests. • This simulation-based test can differentiate between competency levels of ultrasound examiners. • This test is suitable for competency-based education, e.g. mastery learning. • We provide a pass/fail standard without false-negative or false-positive scores.