Resident Exposure and Involvement in Core Procedural Competencies within Pediatric Plastic Surgery

Introduction: The implementation of competency-based residency training in plastic surgery is underway. Key competencies in plastic surgery have been previously identified, however, within the domain of pediatrics, data suggest limited exposure throughout training for Canadian graduates. This study aims to identify the exposure and involvement of residents in core pediatric cases. Methods: We performed a retrospective, multicenter review of plastic surgery resident case logs (T-Res, POWER, New Innovations) across 10 Canadian, English-speaking training programs between 2004 and 2014. Case logs were coded according to the 8 core pediatric competencies previously identified by a modified Delphi technique. Results: A total of 3061 of 59 405 cases (5.2%) logged by 55 graduating residents were core pediatric procedures with an average of 55.6 ± 23.0 cases logged per resident. The top 3 most commonly logged procedures were cleft lip repair, cleft palate repair, and setback otoplasty. The number of cases per program varied widely with the most at 731 and least at 85 logged cases. Roles across procedures have wide variation and residents are most commonly identified as the assistant rather than surgeon or co-surgeon. Conclusion: These findings highlight variability both within and across residency programs with a paucity of exposure and involvement in pediatric plastic surgery cases. This may present a conflict between current recommendations for residency-specific procedural competencies and true clinical exposure. Further curriculum development and simulation may be of benefit.

Transferability of Technical Skills Across Robotic Surgery Platforms: A Scoping Review

As the application of robotic approaches to surgery continues to broaden, new consoles have been introduced to the market. Due to the global utilization of a single platform, previously validated curricula have not been assessed on new robotic systems. Surgery by its nature occurs in a high-stakes environment, potentially exacerbated by non-standardized robotic systems. The aim of this review is to critique the evidence available regarding the transferability of technical skills across robotic platforms. A scoping review utilizing the Medline (Pubmed) and Cochrane Databases was conducted. Full texts were reviewed and appraised. Selected articles were eligible for inclusion if they investigated the ability or implications of the transfer of skill across robotic platforms. Data was extracted, coded inductively, and themes synthesized. NVIVO software was used as an adjunct for this qualitative analysis. Following the removal of duplicates a total of 278 papers were screened according to the eligibility criteria. Fifty full-text articles were reviewed and four met the criterion for inclusion. Novices' performance across platforms was comparable. Increasing levels of prior robotic experience revealed an improvement in technical performance on a novel robotic platform. Safety metrics appear comparable across systems. Quantifying learning curves across robotic platforms and their implications for the robotic surgeon in training remains to be determined. Future research needs to address the gaps in the literature by clearly defining the extent of technical skills transfer between robotic platforms. These factors will guide the next iteration of surgical training curriculums and regulations for robotic surgery.

Lessons learned spanning 17 years of experience with three consecutive nationwide competency based medical education training plans

Introduction

Curricula for postgraduate medical education have transformed since the introduction of competency based medical education (CBME). Postgraduate training plans offer broader training with different competencies and an outcome-based approach, in addition to the medical technical aspects of training. However, CBME also has its challenges. Over the past years, critical views have been shared on the potential drawbacks of CBME, such as assessment burden and conflicts with practicality in the workplace. Recent studies identified a need for a better understanding of how the evolving concept of CBME has been translated to curriculum design and implemented in the practice of postgraduate training. The aim of this study was to describe the development of CBME translations to curriculum design, based on three consecutive postgraduate training programs spanning 17 years.

Method

We performed a document analysis of three consecutive Dutch gynecology and obstetrics training plans that were implemented in 2005, 2013, and 2021. We used template analysis to identify changes over time.

Results

Over time, CBME-based curriculum design changed in several domains. Assessment changed from a model with a focus on summative decision to one with an emphasis on formative, low-stakes assessments aimed at supporting learning. The training plans evolved in parallel to evolving educational insights, e.g., by placing increasing emphasis on personal development. The curricula focused on a competency-based concept by introducing training modules and personalized authorization based on feedback rather than on a set duration of internships. There was increasing freedom in personalized training trajectories in the training plans, together with increasing trust towards the resident.

Conclusion

The way CBME was translated into training plans has evolved in the course of 17 years of experience with CMBE-based education. The main areas of change were the structure of the training plans, which became increasingly open, the degree to which learning outcomes were mandatory or not, and the way these outcomes were assessed.

Need Assessment of Existing Mentorship Program Among Undergraduate Medical Students: Experience From a Medical College in Chhattisgarh, India

Introduction While mentoring students during regular medical education has a long-standing tradition in many developed countries' medical schools, it has yet to become a standard practice in the majority of medical institutions, especially in the developing world, such as India. In institutions where mentoring programs are sparsely implemented, there is a lack of data regarding their assessment. Methodology This qualitative study involved two groups of students - nine undergraduate medical students (five male and four female) and 10 undergraduate medical students (six male and four female) who had at least three years of experience in the existing mentorship program at a tertiary care teaching hospital. We conducted two focused group discussions (FGDs) with these two groups of students using a guide, with FGDs lasting 45 and 50 minutes, respectively. We recorded the audio and it was transcripted to text. Thematic analysis of the transcripts from the 2 FGDs was conducted using Atlasti (Version 7.1.8) software to assess perceptions of the mentorship program. Results The content analysis of the discussions revealed two broad themes, namely "Current Functioning of the Programme" and "Suggestions for Improvement." These themes were further divided into multiple domains and subdomains, providing a comprehensive overview of the study's findings. Although there is a consensus among students that the mentorship program is essential, the current operational framework still has limited confidence due to biases, fears, and misinformation among the students. Conclusion The ongoing medical curriculum imparts a vast amount of scientific knowledge within a limited timeframe, with practical application occurring primarily in the last three years of the academic curriculum and minimal emphasis on ethical practice, professionalism, effective communication, handling urgent health situations, and interacting with family members, underscores the genuine need for a structured mentorship curriculum for undergraduate medical students. To enhance the program's effectiveness, the active involvement of undergraduate students must address their specific needs.

Trainee Evaluations of Preparedness for Clinical Trials in Medical Oncology-A National Questionnaire

BACKGROUND

A standardized approach to the education of clinical trial investigators across Canadian medical oncology (MO) subspecialty training does not exist. With training programs transitioning to competency-based medical education (CBME), studies assessing education practices and competence are paramount to enhancing trainee education. This study aimed to determine whether current education practices in MO subspecialty training programs in Canada prepare trainees for participating in clinical trials as an investigator.

METHODS

From November 2021 to February 2022 a national, bilingual, online questionnaire to understand trainee experiences with self-perceived competence, preparedness, and willingness to participate in clinical trials as investigators was conducted. MO trainees, fellows, and new-to-practice physicians who completed an MO subspecialty training program in Canada were included.

RESULTS

A total of 41 responses were received (response rate: 15%). Formal training in how to participate in clinical trials as an investigator was reported by 73% of respondents. At the end of training, 65% of respondents rated competence in clinical trials as fair/poor and 74% rated preparedness in conducting clinical trials as fair/poor. Correlation analysis determined that in-clinic teaching in clinical trials trended toward improved self-evaluations of competence and preparedness (p > 0.05).

CONCLUSION

This is the first study in Canada to assess competencies in any residency training program since the establishment of CBME. Training in conducting clinical trials is highly variable across MO programs in Canada, with most trainees finding current practices not translating into self-perceived competence and preparedness. Further assessment into how to produce competent clinical trial investigators is warranted.

Assessment-Seeking Strategies: Navigating the Decision to Initiate Workplace-Based Assessment

Phenomenon: Competency-based medical education (CBME) relies on workplace-based assessment (WBA) to generate formative feedback (assessment for learning-AfL) and make inferences about competence (assessment of learning-AoL). When approaches to CBME rely on residents to initiate WBA, learners experience tension between seeking WBA for learning and for establishing competence. How learners resolve this tension may lead to unintended consequences for both AfL and AoL. We sought to explore the factors that impact both decisions to seek and not to seek WBA and use the findings to build a model of assessment-seeking strategy used by residents. In building this model we consider how the link between WBA and promotion or progression within a program impacts an individual's assessment-seeking strategy. Approach: We conducted 20 semi-structured interviews with internal medicine residents at Queen's University about the factors that influence their decision to seek or avoid WBA. Using grounded theory methodology, we applied a constant comparative analysis to collect data iteratively and identify themes. A conceptual model was developed to describe the interaction of factors impacting the decision to seek and initiate WBA. Findings: Participants identified two main motivations when deciding to seek assessments: the need to fulfill program requirements and the desire to receive feedback for learning. Analysis suggested that these motivations are often at odds with each other. Participants also described several moderating factors that impact the decision to initiate assessments, irrespective of the primary underlying motivation. These included resident performance, assessor factors, training program expectations, and clinical context. A conceptual framework was developed to describe the factors that lead to strategic assessment-seeking behaviors. Insights: Faced with the dual purpose of WBA in CBME, resident behavior in initiating assessment is guided by specific assessment-seeking strategies. Strategies reflect individual underlying motivations, influenced by four moderating factors. These findings have broad implications for programmatic assessment in a CBME context including validity considerations for assessment data used in summative decision-making including readiness for unsupervised practice.

Educators as Judges: Applying Judicial Decision-Making Principles to High-Stakes Education Assessment Decisions

Phenomenon: Programmatic assessment and competency-based education have highlighted the need to make robust high-stakes assessment decisions on learner performance from evidence of varying types and quality. Without guidance, lengthy deliberations by decision makers and competence committees can end inconclusively with unresolved concerns. These decisional dilemmas are heightened by their potential impacts. For learners, erroneous decisions may lead to an unjustified exit from a long-desired career, or premature promotion to clinical responsibilities. For educators, there is the risk of wrongful decision-making, leading to successful appeals and mistrust. For communities, ill-prepared graduates risk the quality and safety of care. Approaches such as psychometric analyses are limited when decision-makers are faced with seemingly contradictory qualitative and quantitative evidence about the same individual. Expertise in using such evidence to make fair and defensible decisions is well established in judicial practice but is yet to be practically applied to assessment decision-making. Approach: Through interdisciplinary exchange, we investigated medical education and judicial perspectives on decision-making to explore whether principles of decision-making in law could be applied to educational assessment decision-making. Using Dialogic Inquiry, an iterative process of scholarly and mutual critique, we contrasted assessment decision making in medical education with judicial practice to identify key principles in judicial decision-making relevant to educational assessment decisions. We developed vignettes about common but problematic high-stakes decision-making scenarios to test how these principles could apply. Findings: Over 14 sessions, we identified, described, and applied four principles for fair, reasonable, and transparent assessment decision-making. These were: The person whose interests are affected has a right to know the case against them, and to be heard.Reasons for the decision should be given.Rules should be transparent and consistently applied.Like cases should be treated alike and unlike cases treated differently.Reflecting our dialogic process, we report findings by separately presenting the medical educator and judicial perspectives, followed by a synthesis describing a preferred approach to decision-making in three vignettes. Insights: Judicial principles remind educators to consider both sides of arguments, to be consistent, and to demonstrate transparency when making assessment decisions. Dialogic Inquiry is a useful approach for generating interdisciplinary insights on challenges in medical education by critiquing difference (e.g., the meaning of objectivity) and achieving synthesis where possible (e.g., fairness is not equal treatment of all cases). Our principles and exemplars provide groundwork for promoting good practice and furthering assessment research toward fairer and more robust decisions that will assist learning.

Exploring the Irish general practice training community's perceptions on how an entrustable professional activities dashboard implementation could facilitate general practice training in Ireland

BACKGROUND

The Irish General Practitioner Training (GP) Programme is currently moving to Competency-Based Medical Education (CBME), facilitated by Programmatic Assessment (PA) and Entrustable Professional Activities (EPAs). These new assessment and feedback mechanisms may provide a rich and much sought-after dataset. However, given the possible number of feedback and assessment events, and the variety of modalities used, aggregating and interpreting these can be costly and difficult. Dashboard implementations (DI) have been purposed as a solution to bridge the gap between the large datasets and the training community at all levels.

AIMS

To explore the Irish GP training community's perceptions on how an EPAs DI could facilitate the delivery of GP training in Ireland.

METHODS

A qualitative approach was taken, using a focus group representative of different groups in the training community. Concurrently, an EPAs DI was developed. Focus group transcripts were analysed in an iterative fashion using Template Analysis to generate themes and subthemes.

RESULTS

Numerous advantages were seen in relation to the implementation of an EPAs DI around entrustment decisions, constructive alignment and summative decision-making. These advantages, however, need to be tempered with the realisation that the EPAs DI is not and should not be misinterpreted as being the learning analytic panacea for GP training.

CONCLUSION

This paper outlines the perceptions from a postgraduate medical education training community on an EPAs DI, which would be applicable to other training communities considering introducing similar mechanisms.

Looking back, moving forward: A practical guide to implementing the updated ACGME geriatric medicine Milestones 2.0

The Accreditation Council for Graduate Medical Education (ACGME) developed the Milestones as a tool to aid trainee assessment based on the framework of the six core competencies of practice. Variability in the interpretation and application of the original Milestones prompted the ACGME to convene work groups within the different specialties and subspecialties to update the Milestones. The Geriatric Medicine work group was convened in 2019 with the goal of clarifying and simplifying the language of the Milestones, revising content to be specific to geriatrics, and developing supplemental resources to aid in implementation and use. We suggest using a practical, four-step process to implement the updated Milestones, called the Milestones 2.0, in fellowship programs by: (1) training faculty in the use of the Milestones 2.0, including an overview of the background and updates, (2) mapping the Milestones 2.0 to existing assessments, (3) educating fellows about the Milestones 2.0 and (4) presenting and discussing the Milestones 2.0 at Clinical Competency Committee meetings. This systematic approach promotes the development of a shared mental model for trainee assessments.

The Early Effects of the COVID-19 Pandemic on Pediatric Resident Education: A National Assessment

PURPOSE

Residency programs must ensure resident competence for independent practice. The COVID-19 pandemic disrupted healthcare delivery, impacting pediatric residencies. This study examines the impact on pediatric resident education.

METHODS

The authors conducted a mixed methods national survey of pediatric residency program directors (PDs) from May- July 2020. Data analysis included descriptive statistics, χ², Wilcox rank sum tests. Multivariable modeling identified factors associated with resident preparation for more senior roles. Thematic analysis was performed on open-ended questions about PD COVID-19 pandemic recommendations to peers, Accreditation Council for Graduate Medical Education and American Board of Pediatrics.

RESULTS

Response rate was 55% (110/199). PDs reported the COVID-19 pandemic negatively affected inpatient (n= 86, 78.2%), and outpatient education (n=104, 94.5%), procedural competence (n=64; 58.2%), and resident preparation for more senior roles (n= 50, 45.5%). In bivariate analyses, increasingly negative impacts on inpatient and outpatient education were associated with an increasingly negative impact on resident preparation for more senior roles (p=0.03, p=0.008), these relationships held true in multivariable analysis. Qualitative analysis identified 4 themes from PD recommendations: 1) Clear communication from governing bodies and other leaders; 2) Flexibility within programs and from governing bodies; 3) Clinical exposure is key for competency development; 4) Online platforms are important for education, communication, and support.

CONCLUSIONS

The COVID-19 pandemic negatively impacted inpatient and outpatient education. When these were more negatively impacted, resident preparation for more senior roles was worse. Highlighting the importance of competency based medical education to tailor experiences ensuring each resident is competent for independent practice.

WHAT'S NEW

The COVID-19 pandemic negatively impacted inpatient and outpatient clinical education which negatively impacted resident preparation for more senior roles. This highlights the importance of competency based medical education to ensure each graduating resident is competent for independent practice.

Resident and Family Physician Perspectives on Billing: An Exploratory Study

INTRODUCTION

Within revenue cycle management, billing is an important activity for physicians with financial implications across remuneration models. We assessed the self-reported billing confidence of residents and attending physicians practicing at an academic family health team in a single payer setting.

METHODS

All residents and attending physicians working or who had worked at the team were invited to complete a 20-question electronic survey on their exposure to billing education and their self-reported confidence with various billing activities.

RESULTS

Twenty-five percent (n=40) of eligible physicians completed the survey. There were statistically significant differences between attending and resident physicians' billing experience (median 117.5 vs. 7.5 months). Analysis of free text comments revealed the positive impact of early billing exposure and opportunities for longitudinal feedback.

CONCLUSION

Despite the small sample size, findings suggest that early exposure of family medicine residents to billing with standardized training contributes to a more positive experience during residency.

Efficacy of Case-Based Learning in Anatomy

Introduction

In the present Competency-Based Medical Education (CBME), learning is more student-centered where the students take the responsibility for their learning. Anatomy is an important basic science that lays the foundation for clinical courses in the Bachelor of Medicine and Bachelor of Surgery (MBBS) curriculum. To make it interesting and clinically useful, several innovative teaching-learning methods like case-based learning (CBL) and problem-based learning (PBL) are introduced. The present study was taken up to know the effectiveness of CBL as a teaching-learning method in Anatomy in improving the knowledge and retention of acquired knowledge.

Material and Methods

This was an interventional cross-over study carried out at NRI Medical College and General Hospital, Guntur, Andhra Pradesh. Two hundred students studying in first-year MBBS were included in the study and divided into two batches. The batches - A and B - were exposed to CBL and didactic lecture, respectively, in the first month for Topic I, and then cross-over was done in the second month for Topic II. The knowledge of the students before and after the sessions was assessed by pre-session and post-session multiple-choice question (MCQ) tests. Knowledge retention was assessed by another MCQ test conducted four weeks after the post-session test.

Results

The average difference of the scores between pre-session and post-session tests in the CBL group for Topics I and II (4.01±1.17 and 3.8±1.6) are significantly more compared to the didactic lecture method (3.3±1.3 and 1.9±1.2). The average difference of the scores between the post-session tests and retention-tests in the CBL group (0.122±1.05 and 0.18±1.04) were further compared to the lecture method (0.016±0.95 and 0.09±0.8) for Topics I and II, respectively. There was a significant increase in the proportion of students with scores above 50% in the post-session test and retention test in the CBL group compared to the didactic lecture group.

Conclusion

Results from the pre-session tests, post-session tests, and retention tests for both the topics indicate that CBL as a teaching-learning method in Anatomy is a more effective method for improving and retention of knowledge.

Analyzing the Administrative Burden of Competency Based Medical Education

PURPOSE

Postgraduate residency programs in Canada are transitioning to a competency-based medical education (CBME) system. Within this system, resident performance is documented through frequent assessments that provide continual feedback and guidance for resident progression. An area of concern is the perception by faculty of added administrative burden imposed by the frequent evaluations. This study investigated the time spent in the documentation and submission of required assessment forms through analysis of quantitative data from the Queen's University Diagnostic Radiology program.

METHODS AND MATERIALS

Data regarding time taken to complete Entrustable Professional Activities (EPA) assessments was collected from 24 full-time and part-time radiologists over a period of 18 months. This data was analyzed using SPSS to determine mean time of completion by individuals, departments, and by experience with the assessment process.

RESULTS

The average time taken to complete an EPA assessment form was 3 minutes and 6 seconds. Assuming 3 completed EPA assessment forms per week for each resident (n = 12) and equal distribution among all staff, this averaged out to an additional 18 minutes of administrative burden per staff member over a 4 week block.

CONCLUSIONS

This study investigated the perception by faculty of additional administrative burden for assessment in the CBME framework. The data provided quantitative evidence of administrative burden for the documentation and submission of assessments. The data indicated that the added administrative burden may be reasonable given mandate for CBME implementation and the advantages of adoption for postgraduate medical education.

Implementing a Real-time Workplace-based Assessment Data Collection System Across an Entire Medical School's Clinical Learning Environment

This article was migrated. The article was marked as recommended. Background & Objectives: Workplace-based assessments (WBAs) are a vital aspect of medical student competency assessment for the core Entrustable Professional Activities (EPAs), but pose significant challenges since assessment must occur in real-time during the routine care of patients. We developed an online WBA system designed to overcome these challenges, and implemented it across an entire undergraduate medical education program to address the need for EPA competency assessment. We describe the development and implementation process, and present initial results from our inaugural medical student cohort. Methods: The WBA tool was designed to be student-driven, easy to use, and minimally disruptive to clinical care. Students trigger assessments by choosing the desired EPA to be assessed within a custom-built Qualtrics XM survey application. Their clinical assessor is prompted to select their level of involvement in the activity using the modified Ottawa co-activity scale and provide brief written feedback. Direct verbal feedback at time of discussion is encouraged. Results: 3,568 WBAs were completed. The mean number of assessments per student for all EPAs combined was 24.27 with a range of 1-103. All students completed at least one WBA. Over the course of 12 months, the mean number of EPAs recorded per student in this cohort was lowest for EPA 10 (Recognizing a Patient Requiring Urgent or Emergent Care and Initiate Evaluation and Management) (mean=0.36; range 0-4; n=53) and was highest for EPA 6 (Provide an Oral Presentation for a Clinical Encounter) (mean=5.46; range 1-17; n=803). The mean number of minutes it took to complete the assessments was 2.7 minutes with a standard deviation of 1.2 minutes (n=2,803). Conclusion: An electronic application-based survey collecting real-time WBAs to assess progress toward attaining competence in EPA performance resulted in increased assessment data within a medical school cohort.

Facilitating Learner-Centered Transition to Residency: A Scoping Review of Programs Aimed at Intrinsic Competencies

Phenomenon: There is currently a move to provide residency programs with accurate competency-based assessments of their candidates, yet there is a gap in knowledge regarding the role and effectiveness of interventions in easing the transition to residency. The impact of key stakeholder engagement, learner-centeredness, intrinsic competencies, and assessment on the efficacy of this process has not been examined. The objective of this scoping review was to explore the nature of the existing scholarship on programs that aim to facilitate the transition from medical school to residency. Approach: We searched MEDLINE and EMBASE from inception to April 2020. Programs were included if they were aimed at medical students completing undergraduate medical training or first year residents and an evaluative component. Two authors independently screened all abstracts and full text articles in duplicate. Data were extracted and categorized by type of program, study design, learner-centeredness, key stakeholder engagement, the extent of information sharing about the learner to facilitate the transition to residency, and specific program elements including participants, and program outcomes. We also extracted data on intrinsic (non-Medical Expert) competencies, as defined by the CanMEDS competency framework. Findings: Of the 1,006 studies identified, 55 met the criteria for inclusion in this review. The majority of the articles that were eligible for inclusion were from the United States (n = 31, 57%). Most of the studies (n = 47, 85%) employed quantitative, or mixed method research designs. Positive outcomes that were commonly reported included increased self-confidence, competence in being prepared for residency, and satisfaction with the transition program. While a variety of learner-centered programs that focus on specific intrinsic competencies have been implemented, many (n = 29, 52%) did not report engaging learners as key stakeholders in program development. Insights: While programs that aim to ease the transition from medical school to residency can enhance both Medical Expert and other intrinsic competencies, there is much room for novel transition programs to define their goals more broadly and to incorporate multiple areas of professional development. The existing literature highlights various gaps in approaches to easing the transition from medical school to residency, particularly with respect to key stakeholder engagement, addressing intrinsic CanMEDS competencies, and focusing on individual learners' needs.

Educational Impact Drives Feasibility of Implementing Daily Assessment in the Workplace

Construct: Authors investigated the perspectives of stakeholders on feasibility elements of workplace-based assessments (WBA) with varying designs. Background: In the transition to competency-based medical education, WBA are taking a more prominent role in assessment programs. However, the increased demand for WBA leads to new challenges for implementing suitable WBA tools with published validity evidence, while also being feasible and useful in practice. Despite the availability of published WBA tools, implementation does not necessarily occur; a more fulsome understanding of the perspectives of stakeholders who are ultimately the end-users of these tools, as well as the system factors that both deter or support their use, could help to explain why evidence-based assessment tools may not be incorporated into residency programs. Approach: We examined the perspectives of two groups of stakeholders, surgical teachers and resident learners, during an assessment intervention that varied the assessment tools while keeping the assessment process constant. We chose diverse exemplars from published assessment tools that each represented a different response format: global rating scales, step-by-step surgical rubrics, and an entrustability scale. The primary purpose was to investigate how stakeholders are impacted by WBA tools with varying response formats to better understand their feasibility for assessment of cataract surgery. Secondarily, we were able to explore the culture of assessment in cataract surgery education including stakeholders' perceptions of WBA unrelated to assessment form design. Semi-structured interviews with teachers and a focus group with the residents enabled discussion of their perspectives on dimensions of the tools such as acceptability, demand, implementation, practicality, adaptation, and integration. Findings: Three themes summarize teachers' and residents' experiences with the assessment tools: (1) Feedback is the priority; (2) Forms informing coaching; and (3) Forcing the conversation. The tools helped to facilitate the feedback conversation by serving as a reminder to initiate the conversation, a framework to structure the conversation, and a memory aid for providing detailed feedback. Surgical teachers preferred the assessment tool with a design that best aligned with their approach to teaching and how they wanted to provide feedback. Orientation to the tools, combined with established remediation pathways, may help preceptors to better use assessment tools and improve their ability to give critical feedback. Conclusions: Feedback, more so than assessment, dominated the comments provided by both teachers and residents after using the various WBA tools. Our typical assessment design efforts focus on the creation or selection of a robust assessment tool according to good design and measurement principles, but the current findings would encourage us to also prioritize the coaching relationship and include efforts to design WBA tools to function as a mediator to augment teaching, learning, and feedback exchange within that relationship in the workplace.

Goal-Setting on a Geriatric Medicine Rotation: A Pilot Study

BACKGROUND

Formal goal-setting has been shown to enhance performance and improve educational experiences. We initiated a standardized goal-setting intervention for all residents rotating through a Geriatric Medicine rotation.

OBJECTIVES

This study aims to describe the feasibility of a goal-setting intervention on a geriatric medicine rotation, the resources required, and the barriers to implementation. As well, this study aims to describe the learning goals residents created regarding content and quality.

METHODS

A pilot goal-setting intervention was initiated. A goal-setting form was provided at the beginning of their rotation and reviewed at the end of the rotation. Residents were invited to complete an anonymous online survey to gather feedback on the initiative. Goals were analysed for content and quality. Feedback from the survey results was incorporated into the goal-setting process.

RESULTS

Between March and December 2018, 26 of 44 residents completed the goal-setting initiative. Explanations for the poor adherence included limited protected time for faculty and residents to engage in coaching, its voluntary nature, and trainee absence during orientation. Reasons for difficulty in achieving goals included lack of faculty and trainee time and difficulty assisting residents in achieving goals when no clinical opportunities arose. Although only 59% of residents completed the intervention, if goal-setting took place, most of the goals were specific (71 of 77; 92%) and 35 of 77 (45.5%) goals were not related to medical knowledge.

CONCLUSIONS

This pilot study outlines the successes and barriers of a brief goal-setting intervention during a Geriatric Medicine rotation. Adherence was limited; however, of those who did complete the intervention, the creation of specific goals with a short, structured goal-setting form was possible. To enhance the intervention, goal-setting form completion should be enforced and efforts should be made to engage in mid-rotation check-ins and coaching.

Yes, but does medical education produce better doctors?

Medical education research and development's reason for existence is their contribution to producing better doctors. Arguably this is as. notion that nobody would disagree with. But, answering this question is not as straightforward as it may look. In this paper we describe six complexities that impact on such research and unfortunately contribute to the difficulties surrounding medical education knowledge translation to practice.

Unexpected result of competency-based medical education: 9-year application trends to enhanced skills programs by family medicine residents at a single institution in Canada

In Canada, family physicians may pursue extended training for added competence in areas such as Palliative Care or Emergency Medicine by applying to Enhanced Skills (ES) programmes. Despite the increasing popularity of ES programmes, there are no studies that examine trends in applications to ES programmes before and after the introduction of family medicine focused competency-based curricula at individual universities. Additionally, there is a scarcity of research examining factors common among applicants to ES programmes. We undertook a retrospective observational study using secondary data analysis of archived resident files from a large Canadian family medicine residency programme. The proportion of applicants to ES programmes decreased since implementation of a competency-based curriculum in the subject programme. Older, male, and Canadian medical graduates (CMGs) applied to ES programmes more often than their respective counterparts. Residents in a family medicine competency-based curriculum may be less inclined to extend their training by applying to ES programmes. This is remarkable considering that the Canadian residency programme is the shortest among high-income countries. Further studies are needed to investigate the role of competency-based medical education programmes in enabling shortening residency training around the world.

Qualitative study to identify the perception and challenges faced by the faculty of community medicine in the implementation of competency-based medical education for postgraduate students

Objectives

To identify perception about the key aspects of competency-based medical education (CBME) among community medicine faculty members and to ascertain the various challenges faced by them during its implementation.

Methods

A descriptive qualitative study of 2 months’ duration was conducted among the faculty members of the community medicine department. Non-probability purposive sampling was employed in the study. Free listing was done initially to elicit the views of faculty members to meet the intended objectives. Visual Anthropac software was used to identify the salient variables using Smith’s Salience Score, and then pile sorting was done to identify the association between the salient variables.

Results

Three faculty members participated in the free listing and pile sorting. A total of 20 responses were obtained pertaining to the key aspects of CBME, of which 12 were identified as the salient variables depending on the cut-off value of 0.125 (Smith’s Salience Score) and subjected to pile sorting. Similarly, eight challenges were identified in the implementation of the programme during the free listing, and all were included in the second stage of pile sorting. Cognitive maps were drawn to understand the relationship between the key aspects of CBME and involved challenges separately.

Conclusion

On employing the free listing and pile sorting methods, formulation of entrustable professional activities and their assessment using appropriate tools were the identified crucial areas in CBME, while the lack of sensitisation of stakeholders and inadequate planning were identified as the predominant challenges in the implementation of CBME.

Outcomes are what matter: Competency-based medical education gets us to our goal

This article was migrated. The article was marked as recommended. Health professions education is undergoing a major paradigm shift to competency-based medical education. When shifts in thinking are profound and result in transformations of existing paradigms, there is often an accompanying criticism. While competency-based medical education is an evidence guided change in approach to curriculum and assessment, it is not immune to critique and concerns. Some criticisms are valid, and must be addressed as competency-based medical education is implemented; other concerns raised about competency-based medical education highlight the importance of clarity in language and purpose when discussing new paradigms. In this commentary, we aim to offer a balanced view of competency-based medical education by presenting an overview of the origins and conceptual assumptions of competency-based medical education and acknowledging valid criticisms of the approach.

Competency based medical education in gastrointestinal motility

Traditional apprenticeship-based medical education methods focusing on subjective evaluations and case-volume requirements do not reliably produce clinicians that provide high-quality care in unsupervised practice. Consequently, training approaches are shifting towards competency based medical education, which incorporates robust assessment methods and credible standards of physician proficiency. However, current gastroenterology and hepatology training in the US continues to utilize procedural volume and global impressions without standardized criteria as markers of competence. In particular, efforts to optimize competency based training in gastrointestinal (GI) motility are not underway, even though GI motility disorders account for nearly half of outpatient gastroenterology visits. These deficiencies compromise the quality of patient care. Thus, there is a great need and opportunity to shift our focus in GI motility training towards a competency based approach. First, we need to clarify the variable rates of learning for individual diagnostic tests. We must develop integrated systems that standardize training and monitor physician competency for GI motility diagnostics. Finally, as a profession and society, we must create certification processes to credential competent physicians. These advances are critical to optimizing the quality of GI motility diagnostics in practice.

Defining competencies for the practice of telepsychiatry through an assessment of resident learning needs

BACKGROUND

A foundational assessment of learning needs is missing from previous reports of telepsychiatry curricula. We used an in-depth needs assessment to identify specific skills required for the practice of effective telepsychiatry, and provide an evidence base to guide the development of telepsychiatry curricula in postgraduate psychiatry training. Many of these skills set telepsychiatry apart from practice in traditional face-to-face clinical settings, or result from adaptations to clinical practice to meet the needs of a telepsychiatry interface in patient care.

METHODS

We used a qualitative, modified grounded theory approach to gain insight into areas of importance for telepsychiatry training in postgraduate psychiatry residency. 16 interviews of faculty and residents (9 and 7 interviews, respectively), allowed participants to reflect on their experiences in telepsychiatry. Data were then thematically analyzed.

RESULTS

Interview respondents identified important aspects of the context for telepsychiatry training; the skills required to competently practice telepsychiatry; and the desired teaching and learning methods for acquiring these skills. Specific domains of competency were identified: technical skills; assessment skills; relational skills and communication; collaborative and interprofessional skills; administrative skills; medico-legal skills; community psychiatry and community-specific knowledge; cultural psychiatry skills, including knowledge of Indigenous cultures; and, knowledge of health systems. The skills identified in this study map well to competency- based medical education frameworks.

CONCLUSIONS

Telepsychiatry is increasingly being adopted as a solution to health systems problems such as regional disparities in access to care, and it requires explicit competency development. Ensuring adequate and quality exposure to telepsychiatry during residency training could positively impact our health systems and health equity.