Envisioning a True Continuum of Competency-Based Medical Education, Training, and Practice

Graduating Residents' Readiness for Unsupervised Practice

OBJECTIVE

This study sought to determine whether graduating residents were deemed ready for unsupervised practice for each of the 17 general pediatrics entrustable professional activities (EPAs).

METHODS

At the end of the 2021-22, 2022-23, and 2023-24 academic years, the authors collected entrustment-supervision levels assigned by clinical competency committees for graduating residents from pediatric and medicine/pediatrics residency training programs to determine readiness for unsupervised practice at the time of graduation. They did this for each of the general pediatrics EPAs and examined the levels reported to determine the proportion of residents ready for unsupervised practice on each EPA and on all EPAs. They compared rates of readiness by academic year using a mixed-effects logistic regression model.

RESULTS

Across all EPAs, 33 190 total entrustment-supervision levels were reported for 2276 graduating pediatrics residents, and 2607 entrustment-supervision levels were reported for 168 graduating medicine/pediatrics residents. There were no EPAs in which programs reported more than 89% of residents as ready for unsupervised practice at the time of graduation. Only 31.3% of graduating residents with observations on all EPAs (414/1322) were deemed ready for unsupervised practice for all EPAs. Graduating medicine/pediatrics residents were more likely than pediatrics residents to be deemed ready for all EPAs (P = .002). Across study years, the rates of readiness at graduation for all EPAs rose from 18.0% to 38.5% (linear contrast P < .001).

CONCLUSION

While there are reasons beyond actual resident readiness that may contribute, this study highlights a gap in readiness for unsupervised practice at the time of graduation.

Stakeholder perceptions and experiences of competency-based training with entrustable professional activities (SPECTRE): protocol of a systematic review and thematic synthesis of qualitative research

BACKGROUND

Competency-Based Medical Education (CBME) aims to align educational outcomes with the demands of modern healthcare. Entrustable Professional Activities (EPAs) serve as key tools for feedback and professional development within CBME. With the growing body of literature on EPAs, there is a need to synthesize existing research on stakeholders' experiences and perceptions to enhance understanding of the implementation and impact of EPAs. In this synthesis, we will address the following research questions: How are Entrustable Professional Activities experienced and perceived by stakeholders in various healthcare settings, and what specific challenges and successes do they encounter during their implementation?

METHODS

Using Thomas and Harden's thematic synthesis method, we will systematically review and integrate findings from qualitative and mixed-methods research on EPAs. The process includes a purposive literature search, assessment of evidence quality, data extraction, and synthesis to combine descriptive and analytical themes.

DISCUSSION

This study aims to provide insights into the use of EPAs for competency-based education, reflecting diverse contexts and viewpoints, and identifying literature gaps. The outcomes will guide curriculum and policy development, improve educational practices, and set future research directions, ultimately aligning CBME with clinical realities.

TRIAL REGISTRATION

Not required.

Paediatric rotations in undergraduate medical education in Switzerland: Meeting students' expectations and the goals of the competency-based learning catalogue PROFILES

Introduction

The competency-based catalogue of learning objectives "Principal Relevant Objectives and Framework for Integrative Learning and Education in Switzerland" (PROFILES) based on Entrustable Professional Activities (EPAs) was newly introduced in 2018 in undergraduate medical education in Switzerland. Clerkships provide opportunities for students to train clinical skills and competencies within the curriculum. This study aims to assess the students' experiences during paediatric clerkships and whether they achieve the expected competency level of certain EPAs by the end of their training.

Methods

An online survey was conducted among all 316 students in their last year of medical school (3rd year master) enrolled at the University of Zurich. A total of 113 students who had completed a clerkship in paediatrics in different hospitals, were asked about their general expectations and experiences, and to rate their achievement of competency levels in 26 selected EPAs. An EPA was considered accomplished if a minimum of 2/3 of all students reached at least level 3.

Results

Paediatric clerkship was generally viewed as positive experience by most students. However, a desire for more integration into clinical teams, increased training in clinical skills, and feedback was expressed. The expected level 3 of competency (indirect supervision) was achieved in 14 out of 26 EPAs by at least 2/3 of students. Level 3 was however not reached for more specific EPAs such as neonatal examination, rating of psychomotor and pubertal development, and clinical reasoning.

Conclusion

Paediatric clerkships are regarded as valuable clinical training opportunities. To enhance the learning of competencies, integration into clinical teams and faculty training is crucial. The implementation of EPAs in the clinical context aligns with these goals.

Revision of the Essential Core Competencies: Domains of Competence and Associated Competencies for Pediatric Physical Therapy Professional Education

PURPOSE

The purpose of this Special Communication is to describe the processes of Education Summit III, sponsored by the Academy of Pediatric Physical Therapy, with an emphasis on the review, update, and integration of contemporary language and the Competency-Based Education framework into a revision of the Essential Core Competencies (ECCs).

SUMMARY OF KEY POINTS

The Academy of Pediatric Physical Therapy has consistently supported pediatric professional education, including sponsoring 3 Education Summits in 2012, 2016, and 2023. The most recent summit focused on a revision of the ECCs and the development of materials to support their implementation.

RECOMMENDATIONS FOR PRACTICE

These revised domains of competence and associated competencies will support and guide pediatric physical therapy education for professional students. Educators are encouraged to use their creativity and resources to integrate these into teaching and learning activities.

The Need for Competency-Based Education

OBJECTIVES

While pharmacy education updates learning as new information arises, changes to learning experiences can trail behind current practices and technology. There have been multiple calls for radical changes in how health professions education is delivered to ensure patients are receiving high-quality care. Competency-based education has been one way discussed in the literature for how to handle this need to develop students who have a willingness to learn and can problem-solve. The goal of this review is to examine whether competency-based education is needed to drive the profession of pharmacy forward.

FINDINGS

To address, we collaboratively identified stakeholder perspectives to evaluate the need. The following stakeholders achieved consensus among the committee members: patients/society, learners, workplace/profession, and academic institutions.

SUMMARY

Based on those perspectives, needs, and gaps to address those needs were identified and are presented in this review.

The 2022 European postgraduate (residency) programme in neurology in a historical and international perspective

BACKGROUND AND PURPOSE

Neurology residency programmes, which were first established at the beginning of the 20th century, have become mandatory all over Europe in the last 40-50 years. The first European Training Requirements in Neurology (ETRN) were published in 2005 and first updated in 2016. This paper reports the most recent revisions of the ETRN.

METHODS

Members of the EAN board performed an in depth revision of the ETNR 2016-version, which was reviewed by members of the European Board and Section of Neurology of the UEMS, the Education and Scientific Panels, the Resident and Research Fellow Section and the Board of the EAN, as well as the presidents of the 47 European National Societies.

RESULTS

The new (2022) ETRN suggest a 5-year training subdivided in three phases: a first phase (2 years) of general neurology training, a second phase (2 years) of training in neurophysiology/neurological subspecialties and a third phase (1 year) to expand clinical training (e.g., in other neurodisciplines) or for research (path for clinical neuroscientist). The necessary theoretical and clinical competences as well as learning objectives in diagnostic tests have been updated, are newly organized in four levels and include 19 neurological subspecialties. Finally, the new ETRN require, in addition to a programme director, a team of clinician-educators who regularly review the resident's progress. The 2022 update of the ETRN reflects emerging requirements for the practice of neurology and contributes to the international standardization of training necessary for the increasing needs of residents and specialists across Europe.

Modern medical schools curricula: Necessary innovations and priorities for change

Medical schools' curricula have expanded over the decades to incorporate important new medical breakthroughs and discoveries. Their current focus and overall structures remain, however, stubbornly captive of early 20th-century thinking, with changes having been undertaken in a piecemeal fashion. Indeed, since the notable Flexner reform in 1910, medical schools' study plans have suffered successive and typically always partial adjustments which have failed to keep up with scientific, technological and sociological change. This difficulty may be attributable to the well-known conservatism of medical schools, where updating study plans is a process that invariably encounters numerous barriers to change. These observations were afforded detailed attention some 15 years ago when de Oliveira wrote: 'it is now perfectly demonstrated that public medical schools have not been able to adapt their operation in depth and in due time to the new demands of teaching dictated by an explosive scientific and technological development'. Recent advances in communication and information technologies, as well as the introduction of new pedagogical techniques, have the potential to bring significant benefits to medical practice and healthcare systems, but these have not in the main become properly taught and utilized. The proposition that healthcare is evolving from reactive disease care to care that is predictive, preventive, personalized and participatory was initially regarded as highly speculative, yet systems approaches to biology and medicine are now beginning to provide experience of both health and disease at the molecular, cellular and organ levels. Medicine is a broad scientific field. In contrast to the 19th century, current medical 'sectarianism' is a positive by-product of rapid and gratifying medical progress, and the multiplicity of new models means that the lines of evidence legitimately bearing on practice and health policymaking are already highly diverse and likely to become ever more variegated over time. Put simply, most sound decisions, by definition, will be evidence-informed and not evidence-based, where divergence may be as informative as convergence. Here, the most enduring lesson of history is, perhaps, that clinical medicine is constantly rediscovering its humanistic core. Complexities create opportunities for innovation. In innovative environments, high-performing organizations are finding ways to create a culture that supports a diverse workforce preparing to deliver different models of care, with direct implications for excellence of patient experience and strong repercussions for medical education. The COVID-19 crisis saw major increases in the use of telemedicine, virtual office visits and other forms of online contact, and these are likely to increase considerably. This particular transformation will not be easy or comfortable to make. But reconfiguration of medical education seems inevitable, fuelled by online educational technology and the need to transform clinical training to more outpatient settings with promotion based on competency and person-centeredness, not simply time. As we prepare to enter 2024, this is an exciting time to be working in healthcare. We have more evidence than ever about how to provide high quality, person-centered care, and to keep patients safe. Shame on us if there is any hesitation about applying this knowledge to make the healthcare experience better for patients and providers. Embracing change and making continuous improvements are essential and urgent priorities for medicine and healthcare and, as we describe in the current article, will become more and more indispensably important in our rapidly changing world.

Competency-based medical education: The spark to ignite healthcare's escape fire

High-value care is what patients deserve and what healthcare professionals should deliver. However, it is not what happens much of the time. Quality improvement master Dr. Don Berwick argued more than two decades ago that American healthcare needs an escape fire, which is a new way of seeing and acting in a crisis situation. While coined in the U.S. context, the analogy applies in other Western healthcare contexts as well. Therefore, in this paper, the authors revisit Berwick's analogy, arguing that medical education can, and should, provide the spark for such an escape fire across the globe. They assert that medical education can achieve this by fully embracing competency-based medical education (CBME) as a way to place medicine's focus on the patient. CBME targets training outcomes that prepare graduates to optimize patient care. The authors use the escape fire analogy to argue that medical educators must drop long-held approaches and tools; treat CBME implementation as an adaptive challenge rather than a technical fix; demand genuine, rich discussions and engagement about the path forward; and, above all, center the patient in all they do.

Exploring Competency-Based Medical Education Through the Lens of the UME-GME Transition: A Qualitative Study

PURPOSE

Competency-based medical education (CBME) represents a shift to a paradigm with shared definitions, explicit outcomes, and assessments of competence. The groundwork has been laid to ensure all learners achieve the desired outcomes along the medical education continuum using the principles of CBME. However, this continuum spans the major transition from undergraduate medical education (UME) to graduate medical education (GME) that is also evolving. This study explores the experiences of medical educators working to use CBME assessments in the context of the UME-GME transition and their perspectives on the existing challenges.

METHOD

This study used a constructivist-oriented qualitative methodology. In-depth, semistructured interviews of UME and GME leaders in CBME were performed between February 2019 and January 2020 via Zoom. When possible, each interviewee was interviewed by 2 team members, one with UME and one with GME experience, which allowed follow-up questions to be pursued that reflected the perspectives of both UME and GME educators more fully. A multistep iterative process of thematic analysis was used to analyze the transcripts and identify patterns across interviews.

RESULTS

The 9 interviewees represented a broad swath of UME and GME leadership positions, though most had an internal medicine training background. Analysis identified 4 overarching themes: mistrust (a trust chasm exists between UME and GME); misaligned goals (the residency selection process is antithetical to CBME); inadequate communication (communication regarding competence is infrequent, often unidirectional, and lacks a shared language); and inflexible timeframes (current training timeframes do not account for individual learners' competency trajectories).

CONCLUSIONS

Despite the mutual desire and commitment to move to CBME across the continuum, mistrust, misaligned goals, inadequate communication, and inflexible timeframes confound such efforts of individual schools and programs. If current efforts to improve the UME-GME transition address the themes identified, educators may be more successful implementing CBME along the continuum.

A Changing Landscape for Lifelong Learning in Health Globally

On 25 July 2022, the Continuing Professional Development (CPD) Special Interest Group of the Association for Medical Education in Europe came together to open up discussions during a live webinar on 'Exploring the Evolution of CPD'. The objective was to bring together global medical educators to consider perspectives of CPD from the role of global lifelong learners, the role of educators and the role of education providers and health regulators. The landscape of CPD is evolving, and the roles of each key player must include specific actions for facilitated change. Delivering competency outcomes-based learning, fit for purpose, to lifelong learners in health will require (1) learner agency, (2) leadership from educators and (3) providers of lifelong learning to come together to improve delivery of CPD that leads to meaningful change in practice care delivery.

Competency-Based Medical Education in a Norm-Referenced World: A Root Cause Analysis of Challenges to the Competency-Based Paradigm in Medical School

Competency-based medical education (CBME) requires a criterion-referenced approach to assessment. However, despite best efforts to advance CBME, there remains an implicit, and at times, explicit, demand for norm-referencing, particularly at the junction of undergraduate medical education (UME) and graduate medical education (GME). In this manuscript, the authors perform a root cause analysis to determine the underlying reasons for continued norm-referencing in the context of the movement toward CBME. The root cause analysis consisted of 2 processes: (1) identification of potential causes and effects organized into a fishbone diagram and (2) identification of the 5 whys. The fishbone diagram identified 2 primary drivers: the false notion that measures such as grades are truly objective and the importance of different incentives for different key constituents. From these drivers, the importance of norm-referencing for residency selection was identified as a critical component. Exploration of the 5 whys further detailed the reasons for continuation of norm-referenced grading to facilitate selection, including the need for efficient screening in residency selection, dependence upon rank-order lists, perception that there is a best outcome to the match, lack of trust between residency programs and medical schools, and inadequate resources to support progression of trainees. Based on these findings, the authors argue that the implied purpose of assessment in UME is primarily stratification for residency selection. Because stratification requires comparison, a norm-referenced approach is needed. To advance CBME, the authors recommend reconsideration of the approach to assessment in UME to maintain the purpose of selection while also advancing the purpose of rendering a competency decision. Changing the approach will require a collaboration between national organizations, accrediting bodies, GME programs, UME programs, students, and patients/societies. Details are provided regarding the specific approaches required of each key constituent group.

Transdisciplinary entrustable professional activities

Healthcare has become highly specialized. Specialists, in medicine as well as in nursing, determine much of the high quality of current health care. But healthcare has also become increasingly fragmented, with professionals trained in separate postgraduate silos, with boundaries often difficult to cross. While a century ago, generalists dominated patient care provision, now specialists prevail and risk becoming alienated from each other, losing the ability to adapt to neighboring professional domains. Current health care requires a flexible workforce, ready to serve in multiple contexts, as the COVID-19 crisis has shown.The new concept of transdisciplinary entrustable professional activities, EPAs applicable in more than one specialty, was recently conceived to enhance collaboration and transfer between educational programs in postgraduate nursing in the Netherlands.In this paper, we reflect on our experiences so far, and on practical and conceptual issues concerning transdisciplinary EPAs, such as: who should define, train, assess, and register transdisciplinary EPAs? How can different prior education prepare for similar EPAs? And how do transdisciplinary EPAs affect professional identity?We believe that transdisciplinary EPAs can contribute to creating more flexible curricula and hence to a more coherent, collaborative healthcare workforce, less determined by the boundaries of traditional specialties.

Portfolio use in postgraduate medical education: a systematic scoping review

BACKGROUND

Portfolios are increasingly commonplace in postgraduate medical education. However, poor understanding of and variations in their content, quality, and structure have hindered their use across different settings, thus dampening their efficacy.

METHODS

This systematic scoping review on portfolios in postgraduate medical education utilized Krishna's Systematic Evidence Based Approach (SEBA). Braun and Clarke's thematic analysis and Hsieh and Shannon's directed content analysis were independently used to evaluate the data.

RESULTS

In total, 12 313 abstracts were obtained, and 76 full-text articles included. Six key themes/categories were identified: (i) portfolio definitions and functions, (ii) platforms, (iii) design, (iv) implementation, (v) use in assessments, and (vi) evaluations of their usage.

CONCLUSIONS

Portfolios allow for better appreciation and assessments of knowledge, skills, and attitudes in time-, learner-, and context-specific competencies through the establishment of smaller micro-competencies and micro-credentialling. Organized into three broad stages-development, implementation, and improvement-a six-step framework for optimizing and instituting portfolios in postgraduate medical education is offered.

Pain Medicine Education in the United States: Success, Threats, and Opportunities

The year 2022 marked the 30th anniversary of the first Accreditation Council for Graduate Medical Education (ACGME) accreditation of pain medicine training programs. Before this, the education of pain medicine practitioners was through primarily an apprenticeship model. Since accreditation, pain medicine education has grown under the national leadership of pain medicine physicians and educational experts from the ACGME, exemplified by the release of Pain Milestones 2.0 in 2022. The rapid growth of knowledge in pain medicine, along with its multidisciplinary nature, poses challenges of fragmentation, standardization of curriculum, and adaptation to societal needs. However, these same challenges present opportunities for pain medicine educators to shape the future of the specialty.

The Fate of Entrustable Professional Activities After Graduation: A Survey Study Among Graduated Physician Assistants

INTRODUCTION

Entrustable professional activities (EPAs) are used during training but may also have significance after graduation. This domain has not yet been much explored. We investigated the use of EPAs among alumni of Master Physician Assistant programs in the Netherlands, where EPAs have been used since 2010. We aim to describe if and how EPAs have a role after graduation. Are EPAs used for continuous entrustment decisions or when shifting work settings?

METHODS

In September 2020, all registered Dutch physician assistants (PAs) ( n = 1441) were invited to participate in a voluntary, anonymous survey focusing on the use of EPAs after graduation. Survey items included questions regarding the use and usefulness of EPAs, views on continuous entrustment decisions, and how PAs document their competence.

RESULTS

A total of 421 PAs (response rate 29%) yielded information about the significance of EPAs after training. Among the respondents, 60% ( n = 252) reported adding new competencies and skills after graduation. One-third ( n = 120) of the respondents were trained in EPA-based programs. Almost all EPA-trained PAs (96%; n = 103) considered the EPA structure suitable to maintain and renew entrustment. Furthermore, PAs reported continued use of the EPA framework to seek formal qualifications through entrustment decisions.

CONCLUSION

This study shows that EPAs can play an ongoing role for PAs after graduation. EPA-trained PAs overwhelmingly support the continuous use of the EPA framework for entrustment decisions from graduation until retirement.

"Dismantling Fixed Time, Variable Outcome Education: Abandoning 'Ready or Not, Here they Come' is Overdue"

Two decades after competency-based medical education appeared in the lexicon of medical educators, the community continues to struggle with realizing its full potential. The implementation of the time variable, fixed outcome component has languished based on complexity compounded by resistance to change. Learners continue to transition from medical school to residency, and then practice, primarily based on time rather than having achieved the ability to meet the needs of the patient populations they will serve. Only those few who demonstrate glaring deficiencies do not graduate. The authors urge the medical education community to move from the current fixed time path of medical education toward the implementation of a true continuum of time variable, fixed outcome education, training, and deliberate practice. The latter is defined by purposeful learning, coaching, feedback, and repetition on the path to achieving and maintaining expertise. The opportunities afforded by such a time-variable, fixed outcome approach include: 1) development of a career long growth mindset, 2) ability to address evolving population health needs and careers within the context of one's practice, and 3) continual improvement of care quality and outcomes for patients on the journey towards expertise for providers.

Challenges and opportunities for general practice specific CME in Europe - a narrative review of seven countries

BACKGROUND

Several changes have led to general practitioners (GPs) working in a more differentiated setting today and being supported by other health professions. As practice changes, primary care specific continuing medical education (CME) may also need to adapt. By comparing different primary care specific CME approaches for GPs across Europe, we aim at identifying challenges and opportunities for future development.

METHODS

Narrative review assessing, analysing and comparing CME programs for general practitioners across different north-western European countries (UK, Norway, the Netherlands, Belgium (Flanders), Germany, Switzerland, and France). Templates containing detailed items across seven dimensions of country-specific CME were developed and used. These dimensions are role of primary care within the health system, legal regulations regarding CME, published aims of CME, actual content of CME, operationalisation, funding and sponsorship, and evaluation.

RESULTS

General practice specific CME in the countries under consideration are presented and comparatively analysed based on the dimensions defined in advance. This shows that each of the countries examined has different strengths and weaknesses. A clear pioneer cannot be identified. Nevertheless, numerous impulses for optimising future GP training systems can be derived from the examples presented.

CONCLUSIONS

Independent of country specific CME programs several fields of potential action were identified: the development of curriculum objectives for GPs, the promotion of innovative teaching and learning formats, the use of synergies in specialist GP training and CME, the creation of accessible yet comprehensive learning platforms, the establishment of clear rules for sponsorship, the development of new financing models, the promotion of fair competition between CME providers, and scientifically based evaluation.

Competency-Based Frameworks in Medical School Education Programs: A Thematic Analysis of the Academic Medicine Snapshots, 2020

PURPOSE

Educational program objectives (EPOs) provide the foundation for a medical school's curriculum. In recent years, the Liaison Committee on Medical Education (LCME) endorsed an outcomes-based approach to objectives, to embrace the movement toward competency-based medical education (CBME). The purpose of this study was to explore the CBME frameworks used by medical schools in formulating their EPOs. A secondary aim was to determine factors related to the selection of specific frameworks.

METHOD

The authors performed a quantitative content analysis of entries to the 2020 Academic Medicine Snapshot. Publicly available data gathered included demographic features of each program (e.g., year founded, accreditation status, affiliation, etc.), participation in national medical education consortia, and presence of specific CBME frameworks identified in EPOs. Descriptive statistics were used to examine trends in frameworks used by medical schools. Bivariate comparisons between factors and frameworks were conducted using chi-square tests. Logistic regression was used to examine factors predicting use of more recently developed CBME frameworks.

RESULTS

A total of 135 institutions submitted Snapshots (RR = 88%). All institutions endorsed 1 or more CBME frameworks, with 37% endorsing 2 and 20% endorsing 3 or more. The most common was the Accreditation Council for Graduate Medical Education core competencies (63%). In addition to published frameworks, 36% of institutions developed their own competencies. Schools with pending LCME visits were 2.61 times more likely to use a more recently developed curricular framework, P = .022.

CONCLUSIONS

Medical schools in the United States have embraced the CBME movement through incorporation of competency-based frameworks in their EPOs. While it is encouraging that CBME frameworks have been integrated in medical school EPOs, the variability and use of multiple frameworks identifies the pressing need for a unified CBME framework in undergraduate medical education.

Developing and Mapping Entrustable Professional Activities with Saudi Meds Competency Framework: A Consensus Study

PURPOSE

This study aimed at developing a national consensus on entrustable professional activities (EPAs) for Saudi undergraduate medical education and mapping them with the "Saudi Meds" competency framework.

METHODS

A three phased approach was used. Phase 1 consisted of identifying and developing EPAs; Phase 2 consisted of building a national consensus on developed EPAs (validation process); and Phase 3 consisted of mapping the validated EPAs with the Saudi Meds competency framework. Nominal group and modified Delphi techniques were used to develop consensus on EPAs. Classical test theory-based item analysis was conducted to establish validity and reliability of finalized EPAs.

RESULTS

Fifteen expert medical educationists and 109 academic leaders from 23 medical schools participated in the validation process. The study achieved a consensus on 10 core EPAs with an overall reliability (Cronbach's Alpha) of 0.814. The item-total correlation ranged from 0.341 to 0.642.

CONCLUSION

This study results in a national consensus on generic, comprehensive and region-specific EPAs that have been mapped with Saudi Meds competency framework. Our study is the first step in the direction of facilitating EPA-based curricular reforms in Saudi medical schools.

Student Interprofessional Facilitator Training (SIFT) program: building capacity in clinical education leadership

BACKGROUND

While there are many teacher training programs for health professional students, few are interprofessional, and few integrate assessment and feedback prior to participation as peer teachers. In 2021, The Student Interprofessional Facilitator Training (SIFT) program was developed to allow senior students, already trained in peer teaching, to revise, build on, and practice their newly acquired skills in an interprofessional context. The aim of this study was to explore participant perception and performance, and the contextual factors that influence student aspirations as clinical teachers.

METHODS

Alumni of the 2021 Peer Teacher Training program (n = 74) were invited to participate in the SIFT program. Those who participated were invited to attend individual semi-structured interviews. Thematic analysis was used to code and categorise data into themes, using Communities of Practice as a conceptual framework. Skills in interprofessional facilitation were observed, assessed and students were provided with individual feedback. Assessment data were analysed using descriptive statistics.

RESULTS

Sixteen students from six disciplines joined the SIFT program, and 13/16 (81%) completed. Students were from medicine, nursing, diagnostic radiography, medical imaging, dentistry and speech pathology. Students reported an increased recognition of teaching as a learned skill, development of clinician identity formation as educators, development of interprofessional communication skills, increased awareness of the roles of other health professions, and an increased understanding of leadership. Participants expressed a desire for additional opportunities for interprofessional networking and peer teaching. A good level of competence in facilitation skills was reached by participants.

CONCLUSION

The SIFT program provided a sustainable framework for health professional students to develop and evidence their teaching and leadership skills in an interprofessional context. This study highlighted the important role of observation, assessment and feedback in student teacher training programs. The process of clear assessment guidelines, direct observation with feedback from supervisors provided a way to ensure quality improvement in peer teaching. The SIFT program will help to build capacity of interprofessional programs where large numbers of teachers are required for small group teaching. The next step will be to ensure a variety of opportunities within interprofessional contexts, and with face-to-face engagement.

The logic behind entrustable professional activity frameworks: A scoping review of the literature

INTRODUCTION

Entrustable professional activities (EPAs), discrete profession-specific tasks requiring integration of multiple competencies, are increasingly used to help define and inform curricula of specialty training programmes. Although guidelines exist to help guide the developmental process, deciding what logic to use to draft a preliminary EPA framework poses a crucial but often difficult first step. The logic of an EPA framework can be defined as the perspective used by its developers to break down the practice of a profession into units of professional work. This study aimed to map dominant logics and their rationales across postgraduate medical education and fellowship programmes.

METHODS

A scoping review using systematic searches within five electronic databases (Medline, Embase, Google Scholar, Scopus and Web of Science) was performed. Dominant logics of included papers were identified using inductive coding and iterative analysis.

RESULTS

In total, 42 studies were included. Most studies were conducted in the United States (n = 22; 52%), Canada (n = 6; 14%) and the Netherlands (n = 4; 10%). Across the reported range of specialties, family medicine (n = 4; 10%), internal medicine (n = 4; 10%), paediatrics (n = 3; 7%) and psychiatry (n = 3; 7%) were the most common. Three dominant logics could be identified, namely, 'service provision', 'procedures' and/or 'disease or patient categories'. The majority of papers (n = 37; 88%) used two or more logics when developing EPA frameworks (median = 3, range = 1-4). Disease or patient groups and service provision were the most common logics used (39% and 37%, respectively).

CONCLUSIONS

Most programmes used a combination of logics when trying to capture the essential tasks of a profession in EPAs. For each of the three dominant logics, the authors arrived at a definition and identified benefits, limitations and examples. These findings may potentially inform best practice guidelines for EPA development.

How can Entrustable Professional Activities serve the quality of health care provision through licensing and certification?

This paper about Entrustable Professional Activities (EPAs) was solicited to support the discussion about the future of licensing within the Medical Council of Canada. EPAs, units of professional practice to be entrusted to learners or professionals once they have shown to possess sufficient competence, were proposed in 2005 to operationalize competency-based postgraduate medical education and have become widely popular for various health professions education programs in many countries. EPAs break the breadth of competence for license down to units of practice that can be overseen, assessed, monitored, documented, and entrusted. EPAs together may constitute an individual's portfolio of qualifications, and define a scope of practice. A medical license and a specialty certification can then be defined as the required combination of EPAs for which one is qualified at any specific moment in time. That 'snapshot' could change over time and reflect the professional development of the individual, both in their competence and in their privileges to practice. Micro-credentialing and digital badges might become an adequate option to show-case one's scope of practice at any time and operationalize the idea of a dynamic portfolio of EPAs.

Approaching Training-Practice Gaps After the Transition: A Practice Proposal for Supervision After Training

Transitions within medical, veterinarian, and other health professional training, from classroom to workplace, between undergraduate, postgraduate, fellowship phases, and to unsupervised clinical practice, are often stressful. Endeavors to alleviate inadequate connections between phases have typically focused on preparation of learners for a next phase. Yet, while some of these efforts show results, they cannot obliviate transitional gaps. If reformulated as ‘not completely ready to assume the expected responsibilities in the next phase’, transitions may reflect intrinsic problems in a training trajectory. Indeed, the nature of classroom teaching and even skills training for example, will never fully reflect the true context of clinical training. In various stages of clinical training, the supervision provided to trainees, particularly medical residents, has increased over the past decades. This addresses calls for enhanced patient safety, but may inadequately prepare trainees for unsupervised practice. Transitions often evolve around the question how much support or supervision incoming trainees or junior professionals require. We propose to consider receiving incoming trainees and new employees in clinical workplaces with a conversation about required supervision for discrete tasks, or entrustable professional activities (EPAs). EPAs lend themselves for the question: “At what level of supervision will you be able to carry out this task?”. This question can be answered by both the trainee or junior employee and the supervisor or employer and can lead to agreement about specified supervision for a defined period of time. We expect that this “supported autonomy tool” could alleviate stress and enhance continued development after transitions.

Competency-Based Education and Practice in Physical Therapy: It's Time to Act!

Competency-based education (CBE) is a concept, a philosophy, and an approach to educational design where learner progression occurs when competency is demonstrated. It assumes a set of standard defined performance outcomes for any level of professional practice-students, residents, or practicing physical therapists. Those outcomes are based on the health needs of society and guide the curricular design, implementation, and evaluation of health professions education programs. Lack of a CBE framework-with no required demonstration of competence throughout one's career-has the potential to lead to variation in physical therapists' skills and to unwarranted variation in practice, potentially hindering delivery of the highest quality of patient care. CBE requires a framework that includes a commonly understood language; standardized, defined performance outcomes at various stages of learner development; and a process to assess whether competence has been demonstrated. The purpose of this perspective article is to (1) highlight the need for a shared language, (2) provide an overview of CBE and the impetus for the change, (3) propose a shift toward CBE in physical therapy, and (4) discuss the need for the profession to adopt a mindset requiring purposeful practice across one's career to safely and most efficiently practice in a given area. Utilizing a CBE philosophy throughout one's career should ensure high-quality and safe patient care to all-patient care that can adapt to the changing scope of physical therapist practice as well as the health care needs of society. The physical therapy profession is at a point at which we must step up the transition to a competency-based system of physical therapist education.

We Have No Choice but to Transform: The Future of Medical Education After the COVID-19 Pandemic

Medical education exists to prepare the physician workforce that our nation needs, but the COVID-19 pandemic threatened to disrupt that mission. Likewise, the national increase in awareness of social justice gaps in our country pointed out significant gaps in health care, medicine, and our medical education ecosystem. Crises in all industries often present leaders with no choice but to transform-or to fail. In this perspective, the authors suggest that medical education is at such an inflection point and propose a transformational vision of the medical education ecosystem, followed by a 10-year, 10-point plan that focuses on building the workforce that will achieve that vision. Broad themes include adopting a national vision; enhancing medicine's role in social justice through broadened curricula and a focus on communities; establishing equity in learning and processes related to learning, including wellness in learners, as a baseline; and realizing the promise of competency-based, time-variable training. Ultimately, 2020 can be viewed as a strategic inflection point in medical education if those who lead and regulate it analyze and apply lessons learned from the pandemic and its associated syndemics.

An Entrustable Professional Activity Addressing Racism and Pediatric Health Inequities

Racism and discrimination are the root of many pediatric health inequities and are well described in the literature. Despite the pervasiveness of pediatric health inequities, we have failed to adequately educate and prepare general pediatricians and pediatric subspecialists to address them. Deficiencies within education across the entire continuum and in our health care systems as a whole contribute to health inequities in unacceptable ways. To address these deficiencies, the field of pediatrics, along with other specialties, has been on a journey toward a more competency-based approach to education and assessment, and the framework created for the future is built on entrustable professional activities (EPAs). Competency-based medical education is one approach to addressing the deficiencies within graduate medical education and across the continuum by allowing educators to focus on the desired equitable patient outcomes and then develop an approach to teaching and assessing the tasks, knowledge, skills, and attitudes needed to achieve the goal of optimal, equitable patient care. To that end, we describe the development and content of a revised EPA entitled: Use of Population Health Strategies and Quality Improvement Methods to Promote Health and Address Racism, Discrimination, and Other Contributors to Inequities Among Pediatric Populations. We also highlight the ways in which this EPA can be used to inform curricula, assessments, professional development, organizational systems, and culture change.

An innovative interprofessional dental clinical learning environment using entrustable professional activities

INTRODUCTION

Changes in society, new public demands for dental care and contemporary educational insights have influenced dental education worldwide and demand a renewed perspective. Following this perspective, an innovative interprofessional dental Master curriculum was developed at Radboud University Nijmegen in the Netherlands.

EDUCATIONAL PRINCIPLES

The curriculum is based on five contemporary educational principles and the core of the curriculum consists of a Student Run Dental Clinic that is fully run by students under professional supervision.

THE NEW CURRICULUM

In the Student Run Dental Clinic, Master dental students and Bachelor oral hygiene students are responsible for the care of approximately 750 patients. The students work within the same clinic for 3 years and patients receive oral health care from the same students over a long period. The clinic is a longitudinal cross-disciplinary clinic with different dental subdisciplines. Entrustable professional activities (also known as EPAs), to our knowledge not yet widely used in dental education, were introduced to facilitate learning and assessment. Fourteen EPAs have been developed to stimulate interprofessional education and learning. Of these, five EPAs are identical for the dental and oral hygiene curriculum, leading to extended interprofessional education and learning in the Student Run Dental Clinic.

DISCUSSION

Preliminary results show that EPAs are generally well received by supervisors and students.

CONCLUSION

To monitor and investigate the exact effect of the interventions and underlying mechanisms, a research programme on interprofessional learning, practice-based learning and EPAs and entrustment in dental education was recently set up.

New ways of seeing: supplementing existing competency framework development guidelines with systems thinking

Competency frameworks provide a link between professional practice, education, training, and assessment. They support and inform downstream processes such as curriculum design, assessment, accreditation and professional accountability. However, existing guidelines are limited in accounting for the complexities of professional practice potentially undermining utility of such guidelines and validity of outcomes. This necessitates additional ways of "seeing" situated and context-specific practice. We highlight what a conceptual framework informed by systems thinking can offer when developing competency frameworks. Mirroring shifts towards systems thinking in program evaluation and quality improvement, we suggest that similar approaches that identify and make use of the role and influence of system features and contexts can provide ways of augmenting existing guidelines when developing competency frameworks. We framed a systems thinking approach in two ways. First using an adaptation of Ecological Systems Theory which offers a realist perspective of the person and environment, and the evolving interaction between the two. Second, by employing complexity thinking, which obligates attention to the relationships and influences of features within the system, we can explore the multiple complex, unique, and context-embedded problems that exist within and have stake in real-world practice settings. The ability to represent clinical practice when developing competency frameworks can be improved when features that may be relevant, including their potential interactions, are identified and understood. A conceptual framework informed by systems thinking makes visible features of a practice in context that may otherwise be overlooked when developing competency frameworks using existing guidelines.

Imagining the Future of Learning in Healthcare: The GAME 2019 #FuturistForum

The GAME 2019 #FuturistForum involved an exchange of ideas and perspectives on the future of learning in healthcare and necessary evolutions to sustain future health systems. This event allowed for reflection and discourse around a) what medical learning or learning in healthcare may look like 10-15 years from now, b) how technology would impact that evolution, and c) what collaborative roles distinct stakeholders would play. Seventy-five (75) key stakeholders, experts from various fields, participated in the two-day event. Four multifaceted themes were uncovered from the qualitative analysis, which are: learning will be lifelong and outcome-based, the health system will follow a preventive care model, technology will be an enabler of evolution in education and health systems, and that multi-level collaboration will support and sustain future progress. Future implications, exacerbated by the ongoing COVID-19 pandemic, and study limitations are described.

Entrustment in physician-patient communication: a modified Delphi study using the EPA approach

BACKGROUND

Competency based curricula across the globe stress on the importance of effective physician patient communication. A variety of courses have been used to train physicians for this purpose. However, few of them link competencies with practice resulting in confusions in implementation and assessment. This issue can be resolved by treating certain specific patient communication related tasks as acts of entrustment or entrustable professional activities (EPAs). In this study, we aimed to define a competency-based framework for assessing patient physician communication using the language of EPAs.

METHODS

A modified Delphi study was conducted in three stages. The first stage was an extensive literature review to identify and elaborate communication related tasks which could be treated as EPAs. The second stage was content validation by medical education experts for clarity and representativeness. The third stage was three iterative rounds of modified Delphi with predefined consensus levels. The McNemar test was used to check response stability in the Delphi Rounds.

RESULTS

Expert consensus resulted in development of 4 specific EPAs focused on physician-patient communication with their competencies and respective assessment strategies all aiming for level 5 of unsupervised practice. These include Providing information to the patient or their family about diagnosis or prognosis; Breaking Bad news to the patient or their family; Counseling a patient regarding their disease or illness; Resolving conflicts with patients or their families.

CONCLUSIONS

The EPAs for Physician-patient communication are a step toward an integrative, all-inclusive competency-based assessment framework for patient-centered care. They are meant to improve the quality of physician patient interaction by standardizing communication as a decision of entrustment. The EPAs can be linked to competency frameworks around the world and provide a useful assessment framework for effective training in patient communication. They can be integrated into any post graduate curriculum and can also serve as a self-assessment tool for postgraduate training programs across the globe to improve their patient communication curricula.

Teaching for implementation: A framework for building implementation research and practice capacity within the translational science workforce

Implementation science offers a compelling value proposition to translational science. As such, many translational science stakeholders are seeking to recruit, teach, and train an implementation science workforce. The type of workforce that will make implementation happen consists of both implementation researchers and practitioners, yet little guidance exists on how to train such a workforce. We-members of the Advancing Dissemination and Implementation Sciences in CTSAs Working Group-present the Teaching For Implementation Framework to address this gap. We describe the differences between implementation researchers and practitioners and demonstrate what and how to teach them individually and in co-learning opportunities. We briefly comment on educational infrastructures and resources that will be helpful in furthering this type of approach.

Questioning medical competence: Should the Covid-19 crisis affect the goals of medical education?

The COVID-19 pandemic has disrupted many societal institutions, including health care and education. Although the pandemic's impact was initially assumed to be temporary, there is growing conviction that medical education might change more permanently. The International Competency-based Medical Education (ICBME) collaborators, scholars devoted to improving physician training, deliberated how the pandemic raises questions about medical competence. We formulated 12 broad-reaching issues for discussion, grouped into micro-, meso-, and macro-level questions. At the individual micro level, we ask questions about adaptability, coping with uncertainty, and the value and limitations of clinical courage. At the institutional meso level, we question whether curricula could include more than core entrustable professional activities (EPAs) and focus on individualized, dynamic, and adaptable portfolios of EPAs that, at any moment, reflect current competence and preparedness for disasters. At the regulatory and societal macro level, should conditions for licensing be reconsidered? Should rules of liability be adapted to match the need for rapid redeployment? We do not propose a blueprint for the future of medical training but rather aim to provoke discussions needed to build a workforce that is competent to cope with future health care crises.

Health professions education scholarship: The emergence, current status, and future of a discipline in its own right

Medical education, as a domain of scholarly pursuit, has enjoyed a remarkably rapid development in the past 70 years and is now more commonly known as health professions education (HPE) scholarship. Evidenced by a solid increase of publications, numbers of specialized journals, professional associations, national and international conferences, academies for medical educators, masters and doctoral courses, and the establishment of many units of HPE scholarship, the domain of HPE education scholarship has matured into a scholarly discipline in its own right. In this contribution, the author reviews the developments of the field from Boyer's four criteria that determine scholarship: discovery, integration, application, and teaching. Born mid-20th century, and in the first decades developed in the predominant area of physician education, HPE scholarship has matured, with increasing breadth, depth, and volume of scholars, publications, conferences, and dedicated centers for research and development. The author concludes that, given the infrastructure that has emerged, HPE can arguably be considered a discipline in its own right. This academic question may not matter hugely for practices of scholarly work in this domain, and any stance in this academic debate inevitably reflects a personal view, but the author would support the view of health professions scholarship as being a unique niche, with inherent dependence on both medical and other health professional sciences, on the one hand, and social sciences, including educational sciences, on the other hand.

Harnessing the Potential Futures of CBME Here and Now

The COVID-19 pandemic of 2020 exposed the reactive nature of the medical education community in response to a disruption that, at one time, may have seemed preposterous. In this article, the author reflected on the impact of an unpredictable plight on a system of medical education that (1) is continuous but doesn't function as a continuum and (2) requires adaptation but is steeped in a fixed mindset and structure that resists change. As a result, innovations which were previously considered impossible, such as time variable education and training, were forced into being. Inspired by the changes brought about by the pandemic, the ensuing decade is explored through a lens of possible futures to envision a path forward based on resilience rather than reactivity.

Entrustable Professional Activities and Entrustment Decision Making: A Development and Research Agenda for the Next Decade

To establish a research and development agenda for Entrustable Professional Activities (EPAs) for the coming decade, the authors, all active in this area of investigation, reviewed recent research papers, seeking recommendations for future research. They pooled their knowledge and experience to identify 3 levels of potential research and development: the micro level of learning and teaching; the meso level of institutions, programs, and specialty domains; and the macro level of regional, national, and international dynamics. Within these levels, the authors categorized their recommendations for research and development. The authors identified 14 discrete themes, each including multiple questions or issues for potential exploration, that range from foundational and conceptual to practical. Much research to date has focused on a variety of issues regarding development and early implementation of EPAs. Future research should focus on large-scale implementation of EPAs to support competency-based medical education (CBME) and on its consequences at the 3 levels. In addition, emerging from the implementation phase, the authors call for rigorous studies focusing on conceptual issues. These issues include the nature of entrustment decisions and their relationship with education and learner progress and the use of EPAs across boundaries of training phases, disciplines and professions, including continuing professional development. International studies evaluating the value of EPAs across countries are another important consideration. Future studies should also remain alert for unintended consequences of the use of EPAs. EPAs were conceptualized to support CBME in its endeavor to improve outcomes of education and patient care, prompting creation of this agenda.

Final-year medical students' competence profiles according to the modified requirement tracking questionnaire

BACKGROUND

Undergraduate medical education is supposed to equip medical students with basic competences to select any specialty of their choice for postgraduate training. Medical specialties are characterized by a great diversity of their daily work routines and require different sets of competence facets. This study examines the self-assessed competence profiles of final-year undergraduate medical students and their specialty choice for postgraduate training. Students' profiles, who wish to choose anaesthesiology, internal medicine, or paediatrics, are compared with the physicians' competence profiles from these three disciplines.

METHODS

In this study, 148 volunteer final-year undergraduate medical students completed the modified requirement-tracking (R-Track) questionnaire for self-assessment of their competence profiles. The R-Track questionnaire contains 63 competence facets assigned to six areas of competence: "Mental abilities", "Sensory abilities", "Psychomotor & multitasking abilities", "Social interactive competences", "Motivation", and "Personality traits". The expression of the different competence facets had to be assessed on a 5-point Likert scale (1: "very low" to 5: "very high"). Additionally, socio-demographic data and the participants' first choice of a medical speciality for postgraduate education were collected. We used analysis of variance (ANOVA) for mean score comparison of subgroups and least significant difference (LSD) tests for post hoc analysis.

RESULTS

The competence area with the highest rating was "Motivation" (3.70 ± 0.47) while "Psychomotor & multitasking abilities" received the lowest rating (3.34 ± 0.68). Individual facets of competence ranked from "In need of harmony" (4.36 ± 0.72), followed by "Tactfulness" (4.26 ± 0.64), and "Cooperation/Agreeableness" (4.24 ± 0.53) to "Risk orientation" (2.90 ± 0.92), "Mathematical reasoning" (2.87 ± 1.25), and "Sanctioning" (2.26 ± 0.93). The students' competence profiles showed 100 % congruence with physicians' competence profiles of the postgraduate specialty of their choice for internal medicine, 33.3 % for paediatrics, and 0 % for anaesthesiology.

CONCLUSIONS

Undergraduate medical students could define their competence profiles with the modified R-Track questionnaire and compare them with the profile of their desired specialty for postgraduate training to discover possible learning gaps or to detect good specialty matches. A combination of students' competence self-assessment with an external assessment of students' facets of competence could provide curricular planners with useful information how to design learning opportunities for specific facets of competence.

Bridging the Gap between Undergraduate Veterinary Training and Veterinary Practice with Entrustable Professional Activities

The transition from being a veterinary student to becoming a member of the veterinary profession is known to be challenging. Despite being licensed directly after graduation, many veterinarians do not feel fully equipped to practice unsupervised when they graduate. The increasing rate of attrition from veterinary practice, and a relatively high percentage of burnout during the first years in practice, has been suggested to be related to a lack of early career support. Over the past decade, medical education has adopted the concept of entrustable professional activities (EPAs). Recently, EPAs have been proposed to restructure veterinary education to help support the transition from veterinary student to practicing veterinarian. Implementing an EPA-based approach could help to bridge the gap between school and clinical practice, potentially preventing veterinary graduates from dropping out early on from what could have been a promising and exciting professional career.

Defining competency for Royal Australian and New Zealand College of Obstetricians and Gynaecologists training: An exploratory study of Victorian Integrated Training Program coordinators' understanding of competency

BACKGROUND

Competency-based medical education (CBME) is increasingly employed by postgraduate training programs worldwide, including obstetrics and gynaecology. Focusing on assessment of outcomes rather than time-in-training, and utilising a well-defined curricular framework, CBME aims to train doctors capable of meeting the needs of modern society. When this study was undertaken, in 2019, the Royal Australian and New Zealand College of Obstetricians and Gynaecologists (RANZCOG) had a time-based curriculum and was due to undergo a curriculum review starting in 2020.

AIMS

To explore Victorian RANZCOG Integrated Training Program (ITP) coordinators' understanding of the concept of competency and how it is taught and assessed within RANZCOG training.

MATERIALS AND METHODS

A qualitative, grounded theory design using semi-structured interviews was employed. Victorian RANZCOG ITP coordinators from inner and outer metropolitan, and regional sites, were approached to participate. Transcripts were coded and analysed using thematic analysis.

RESULTS

Themes identified were: Competence, Vision and Innovation, Structures, ITP Coordinator Role and Teaching and Learning. Competence was defined as a combination of independent practice and understanding of ones' own limits, in addition to required clinical skills and knowledge. Enablers and barriers to achieving competency were identified and associated with structures, human and logistical factors. Victorian ITP coordinators believed the current training program has positive elements but could be further improved.

CONCLUSIONS

Several areas for future research were identified regarding understanding of competency, relevant if RANZCOG is to introduce a CBME framework. Replicating this research across all RANZCOG jurisdictions in Australia and New Zealand would be prudent to determine if the themes are universal.

Toward competency based continuing professional development for practicing surgeons

BACKGROUND

There has been a recent call for formal competency assessments of practicing physicians and surgeons to form a framework of competency based continuing professional development (CBCPD).

METHODS

An email questionnaire was conducted regarding CBCPD. Responses were further used to inform development of semi-structured interviews.

RESULTS

There were 58 questionnaire respondents (42%). There was moderate support for assessment of surgeons' technical skills (50.9%) or decision making (56.6%). Support was highest for a mechanism to flag surgeons in need of a focused competence assessment (83.0%). Eight surgeons participated in interviews. Interviews identified a range of benefits of CBCPD but also several challenges to implementation, including the need for fair, data-driven assessments, taking into account patient outcomes.

CONCLUSIONS

Through listening to surgeon concerns and recommendations for implementation strategies, this study's findings may support development of an effective CBCPD strategy with the potential to be embraced by surgeons and foster an environment of improved safety and performance.

Entrustment Decision Making: Extending Miller's Pyramid

The iconic Miller's pyramid, proposed in 1989, characterizes 4 levels of assessment in medical education ("knows," "knows how," "shows how," "does"). The frame work has created a worldwide awareness of the need to have different assessment approaches for different expected outcomes of education and training. At the time, Miller stressed the innovative use of simulation techniques, geared at the third level ("shows how"); however, the "does" level, assessment in the workplace, remained a largely uncharted area. In the 30 years since Miller's conference address and seminal paper, much attention has been devoted to procedures and instrument development for workplace-based assessment. With the rise of competency-based medical education (CBME), the need for approaches to determine the competence of learners in the clinical workplace has intensified. The proposal to use entrustable professional activities as a framework of assessment and the related entrustment decision making for clinical responsibilities at designated levels of supervision of learners (e.g., direct, indirect, and no supervision) has become a recent critical innovation of CBME at the "does" level. Analysis of the entrustment concept reveals that trust in a learner to work without assistance or supervision encompasses more than the observation of "doing" in practice (the "does" level). It implies the readiness of educators to accept the inherent risks involved in health care tasks and the judgment that the learner has enough experience to act appropriately when facing unexpected challenges. Earning this qualification requires qualities beyond observed proficiency, which led the authors to propose adding the level "trusted" to the apex of Miller's pyramid.

Building a Shared Mental Model of Competence Across the Continuum: Trainee Perceptions of Subinternships for Residency Preparation

INTRODUCTION

Toward a vision of competency-based medical education (CBME) spanning the undergraduate to graduate medical education (GME) continuum, University of Minnesota Medical School (UMMS) developed the Subinternship in Critical Care (SICC) offered across specialties and sites. Explicit course objectives and assessments focus on internship preparedness, emphasizing direct observation of handovers (Core Entrustable Professional Activity, "EPA," 8) and cross-cover duties (EPA 10).

METHODS

To evaluate students' perceptions of the SICC's and other clerkships' effectiveness toward internship preparedness, all 2016 and 2017 UMMS graduates in GME training (n = 440) were surveyed regarding skill development and assessment among Core EPAs 1, 4, 6, 8, 9, 10. Analysis included descriptive statistics plus chi-squared and Kappa agreement tests.

RESULTS

Respondents (n = 147, response rate 33%) rated the SICC as a rotation during which they gained most competence among EPAs both more (#4, 57% rated important; #8, 75%; #10, 70%) and less explicit (#6, 53%; #9, 69%) per rotation objectives. Assessments of EPA 8 (80% rated important) and 10 (76%) were frequently perceived as important toward residency preparedness. Agreement between importance of EPA development and assessment was moderate (Kappa = 0.40-0.59, all surveyed EPAs).

CONCLUSIONS

Graduates' perceptions support the SICC's educational utility and assessments. Based on this and other insight from the SICC, the authors propose implications toward collectively envisioning the continuum of physician competency.

Vertical integration in medical education: the broader perspective

Curricular integration represents collaborations between disciplines to establish a coherent curriculum and has become the dominant recommendation for medical education in the second half of the twentieth century. Vertical integration specifically is the integration between the clinical and basic science parts throughout the program. Vertically integrated curricula present basic sciences imbedded in a clinical context from the start of medical school.The authors briefly discuss vertical integration in relationship with context theory, motivation theory, professional identity formation, transition to practice and the continuum of education and practice. They conclude that vertical integration, rather than horizontal integration, extends far beyond curriculum structure. They consider vertical integration a philosophy of education, with impact on students' maturation and engagement with the profession, and which applies not only to undergraduate education but to the lifelong learning of professionals. The definition of vertical integration as "an educational approach that fosters a gradual increase of learner participation in the professional community through a stepwise increase of knowledge-based engagement in practice with graduated responsibilities in patient care" is more comprehensive than its older conceptualization.