Transforming primary care residency training: a collaborative faculty development initiative among family medicine, internal medicine, and pediatric residencies

Gold standard research and evidence applied: The Inspire Nursing Leadership Program

Billions of dollars are invested annually in leadership development globally; however, few programs are evidence-based, risking adverse outcomes, and wasted time and money. This article describes the novel Inspire Nursing Leadership Program (INLP) and the outcomes-based process of incorporating gold standard evidence into its design, delivery, and evaluation. The INLP design was informed by a needs analysis, research evidence, and by nursing, Indigenous, and equity, diversity, and inclusion experts. The program's goals include enabling participants to develop leadership capabilities, cultivate strategic community partnerships, lead innovation projects, and connect with colleagues. Design features include an outcomes-based approach, the LEADS framework, and alignment with the principles of adult learning. Components include leadership impact projects, 360-assessments, blended interactive sessions, coaching, mentoring, and application and reflection exercises. The evaluation framework and subsequent proposed research design align to top-quality standards. Healthcare leadership programs must be evidence-based to support leaders in improving and transforming health systems.

A Mixed-Methods Program Evaluation of a Self-directed Learning Panel Management Curriculum in an Internal Medicine Residency Clinic

BACKGROUND

Panel management (PM) curricula in internal medicine (IM) residency programs often assign performance measures which may not address the varied interests or needs of resident-learners.

AIM

To evaluate a self-directed learning (SDL)-based PM curriculum.

SETTING

University-based primary care practice in Burlington, Vermont.

PARTICIPANTS

Thirty-five internal medicine residents participated.

PROGRAM DESCRIPTION

Residents completed a PM curriculum that integrated SDL, electronic health record (EHR)-driven performance feedback, mentorship, and autonomy to set learning and patient care goals.

PROGRAM EVALUATION

Pre/post-curricular surveys assessed EHR tool acceptability, weekly curricular surveys and post-curricular focus groups assessed resident perceptions and goals, and an interrupted time series analysis of care gap closure rates was used to compare the pre-intervention and intervention periods. Majority of residents (28-32 or 80-91%) completed the surveys and focus groups. Residents found the EHR tools acceptable and valued protected time, mentorship, and autonomy to set goals. A total of 13,313 patient visits were analyzed. There were no significant differences between rates between the pre-intervention period and the first intervention period (p=0.44).

DISCUSSION

A longitudinal PM curriculum that incorporated SDL and goal setting with EHR-driven performance feedback was well-received by residents, however did not significantly impact the rate of care gap closure.

Leadership Matters: Needs Assessment and Framework for the International Federation for Emergency Medicine Administrative Leadership Curriculum

OBJECTIVES

The objective was to research and develop a novel curriculum on administrative leadership development within the discipline of emergency medicine (EM) with the goal of establishing and implementing it through the world's EM professional organizations.

METHODS

From 2016 to 2018 an assessment of different administrative and leadership programs was performed by researching and reviewing previously outlined curricula. Using the data from this assessment, a questionnaire was developed, that was subsequently sent to members of the International Federation for Emergency Medicine's (IFEM) listserv.

RESULTS

A total of 377 people from 38 different countries participated in the survey. The majority of respondents identified themselves as EM specialists (81%, 306/377), while others identified themselves as EM resident physicians (9.5%, 36/377) and non-EM specialist physicians (4.5%, 17/377). A large majority of respondents articulated that there was a paucity of developed curricula focusing on leadership, administrative, and management principles within their institution, training program, or professional organization. Across all topic areas, fewer than 30% of polled individuals indicated that they had formal education related to individual and programmatic leadership development, change management, assessment methodology, negotiation skills, financial analysis, media relations, and health care policy. Quality improvement (QI) was the only curricular element that a majority of respondents had integrated into their clinical practice (61%). Qualitative data analysis of the narrative comments was performed with further evaluation of thematic components.

CONCLUSIONS

The results of this study further support the findings that the majority of EM providers queried do not have a longitudinal curriculum that fosters administrative and leadership development nor advocate for its importance in relation to the quality of care. Given this gap, we propose that medical education at all levels-medical schools, EM resident/specialty training programs, and professional organizations-should consider creating administrative and leadership development programs. Additionally, development of any curriculum should require a global understanding of health care systems and awareness of the unique contexts of a given location and its available resources.

Conceptualization of Competency-Based Medical Education Terminology in Family Medicine Postgraduate Medical Education and Continuing Professional Development: A Scoping Review

PURPOSE

To examine the extent, range, and nature of how competency-based medical education (CBME) implementation terminology is used (i.e., the conceptualization of CBME-related terms) within the family medicine postgraduate medical education (PGME) and continuing professional development (CPD) literature.

METHOD

This scoping review's methodology was based on Arksey and O'Malley's framework and subsequent recommendations by Tricco and colleagues. The authors searched 5 databases and the gray literature for U.S. and Canadian publications between January 2000 and April 2017. Full-text English-language articles on CBME implementation that focused exclusively on family medicine PGME and/or CPD programs were eligible for inclusion. A standardized data extraction form was used to collect article demographic data and coding concepts data. Data analysis used mixed methods, including quantitative frequency analysis and qualitative thematic analysis.

RESULTS

Of 470 unique articles identified, 80 (17%) met the inclusion criteria and were selected for inclusion in the review. Only 12 (15%) of the 80 articles provided a referenced definition of the coding concepts (i.e., referred to an article/organization as the definition's source), resulting in 19 highly variable-and 12 unique- referenced definitions of key terms used in CBME implementation (competence, competency, competency-based medical education). Thematic analysis of the referenced definitions identified 15 dominant themes, among which the most common were (1) a multidimensional and dynamic concept that encompasses a variety of skill components and (2) being able to use communication, knowledge, technical skills, clinical reasoning, judgment, emotions, attitudes, personal values, and reflection in practice.

CONCLUSIONS

The construction and dissemination of shared definitions is essential to CBME's successful implementation. The low number of referenced definitions and lack of consensus on such definitions suggest more attention needs to be paid to conceptual rigor. The authors recommend those involved in family medicine education work with colleagues across medical specialties to develop a common taxonomy.

How Culture Is Understood in Faculty Development in the Health Professions: A Scoping Review

PURPOSE

To examine the ways in which culture is conceptualized in faculty development (FD) in the health professions.

METHOD

The authors searched PubMed, Web of Science, ERIC, and CINAHL, as well as the reference lists of identified publications, for articles on culture and FD published between 2006 and 2018. Based on inclusion criteria developed iteratively, they screened all articles. A total of 955 articles were identified, 100 were included in the full-text screen, and 70 met the inclusion criteria. Descriptive and thematic analyses of data extracted from the included articles were conducted.

RESULTS

The articles emanated from 20 countries; primarily focused on teaching and learning, cultural competence, and career development; and frequently included multidisciplinary groups of health professionals. Only 1 article evaluated the cultural relevance of an FD program. The thematic analysis yielded 3 main themes: culture was frequently mentioned but not explicated; culture centered on issues of diversity, aiming to promote institutional change; and cultural consideration was not routinely described in international FD.

CONCLUSIONS

Culture was frequently mentioned but rarely defined in the FD literature. In programs focused on cultural competence and career development, addressing culture was understood as a way of accounting for racial and socioeconomic disparities. In international FD programs, accommodations for cultural differences were infrequently described, despite authors acknowledging the importance of national norms, values, beliefs, and practices. In a time of increasing international collaboration, an awareness of, and sensitivity to, cultural contexts is needed.

Alignment of Preventive Medicine Physicians' Residency Training With Professional Needs

Preventive medicine (PM) physicians promote population-based approaches to health care with training that emphasizes public health, epidemiology, and policy. PM physicians use these skills in varied, often nonclinical, practice settings. PM career diversity challenges educators when designing residency curricula. Input from PM physicians about workforce environments is needed to ensure that residency requirements match skills needed post-residency. Graduates of one PM residency were sent a cross-sectional survey in 2016. Questions included professional experience, importance of 18 Accreditation Council for Graduate Medical Education sub-competencies and 13 leadership/management skills to current position, and residency training adequacy in those sub-competencies/skills. Responses were rated on 3-point Likert scales. Analyses were completed in 2017. Pearson's chi-square tests examined relationships between position type (academic/government) and perception of competencies' importance and training adequacy. Eighty PM physicians responded (46%): 44% worked in academia and 25% in federal/state/local government. Half (53%) were PM board certified. A total of 88% completed clinical residency prior to PM. Thirteen of 18 competencies were important to work, and respondents felt well trained in 16 of 18 competencies. Respondents did not feel well trained in emergency preparedness and surveillance systems during residency and their opinions about the importance of these sub-competencies varied based on where they worked. Respondents rated all 13 leadership/management skills as important, but reported inadequate residency training. In conclusion, respondents rated most Accreditation Council for Graduate Medical Education sub-competencies as important to current work and felt well trained, indicating good alignment between residency training and professional needs. Respondents also reported leadership/management training deficiencies. PM residencies might consider incorporating formal leadership training into curricula.

Continuity Clinic Practice Feedback Curriculum for Residents: A Model for Ambulatory Education

BACKGROUND

There is an unmet need for formal curricula to deliver practice feedback training to residents.

OBJECTIVE

We developed a curriculum to help residents receive and interpret individual practice feedback data and to engage them in quality improvement efforts.

METHODS

We created a framework based on resident attribution, effective metric selection, faculty coaching, peer and site comparisons, and resident-driven goals. The curriculum used electronic health record-generated resident-level data and disease-specific ambulatory didactics to help motivate quality improvement efforts. It was rolled out to 144 internal medicine residents practicing at 1 of 4 primary care clinic sites from July 2016 to June 2017. Resident attitudes and behaviors were tracked with presurveys and postsurveys, completed by 126 (88%) and 85 (59%) residents, respectively. Data log-ins and completion of educational activities were monitored. Group-level performance data were tracked using run charts.

RESULTS

Survey results demonstrated significant improvements on a 5-point Likert scale in residents' self-reported ability to receive (from a mean of 2.0 to 3.3, P < .001) and to interpret and understand (mean of 2.4 to 3.2, P < .001) their practice performance data. There was also an increased likelihood they would report that their practice had seen improvements in patient care (13% versus 35%, P < .001). Run charts demonstrated no change in patient outcome metrics.

CONCLUSIONS

A learner-centered longitudinal curriculum on ambulatory patient panels can help residents develop competency in receiving, interpreting, and effectively applying individualized practice performance data.

[An online dynamic knowledge base in multiple languages on general medicine and primary care]

INTRODUCTION

The International Classification of Primary Care, Second version (ICPC-2) aligned with the 10th Revision of the International Classification of Disease (ICD-10) is a standard for primary care epidemiology compendium. ICPC-2 has been also intended to identify the clinical topics in family medicine. Contextual field-specific knowledge in family medicine and primary care such as health structures, management, categories of patients, research methods, ethical or environmental features are not standardized and reflect, more often, the views of experts.

METHODS

A qualitative research method, applied to the analysis of several Family Medicine congresses, has helped identify, in addition to clinical items, a spectrum of contextual concepts addressed by family doctors during their exchanges at the congresses. Assembled in a hierarchical manner, these concepts were given expression, together with ICPC-2, under the name of Q-codes Version 2.5, in the multilingual multi-terminology semantic server of the Department of Information and medical informatics (D2Im) at the University of Rouen, France. The two classifications are edited under the acronym 3 CGP for Core Content classification of General Practice. This free access server allows you to consult the ICPC-2 in 22 languages and the Q-codes in ten languages.

RESULTS

The result of the joint use of these two classifications, as descriptors in congress to identify the concepts in texts or index the gray literature for family medicine and primary care is presented here in its various pilot uses. The validity and generalizability of 3CGP appears to be good in the light of the translations already carried out by colleagues around the world and of the applicability of the method in the two sides of the Atlantic. However the reproducibility and the inter-coder variations still remain to be tested for Q-codes. Maintenance remains an issue.

CONCLUSION

This method highlights the conceptual extension, the complexity and the dynamics of the role of general practitioner and family doctor as well as of primary care physician.

Developing primary care teams prepared to improve quality: a mixed-methods evaluation and lessons learned from implementing a microsystems approach

Background

Health systems in the United States are increasingly required to become leaders in quality to compete successfully in a value-conscious purchasing market. Doing so involves developing effective clinical teams using approaches like the clinical microsystems framework. However, there has been limited assessment of this approach within United States primary care settings.

Methods

This paper describes the implementation, mixed-methods evaluation results, and lessons learned from instituting a Microsystems approach across 6 years with 58 primary care teams at a large Midwestern academic health care system. The evaluation consisted of a longitudinal survey augmented by interviews and focus groups. Structured facilitated longitudinal discussions with leadership captured ongoing lessons learned. Quantitative analysis employed ordinal logistic regression and compared aggregate responses at 6-months and 12-months to those at the baseline period. Qualitative analysis used an immersion/crystallization approach.

Results

Survey results (N = 204) indicated improved perceptions of: organizational support, team effectiveness and cohesion, meeting and quality improvement skills, and team communication. Thematic challenges from the qualitative data included: lack of time and coverage for participation, need for technical/technology support, perceived devaluation of improvement work, difficulty aggregating or spreading learnings, tensions between team and clinic level change, a part-time workforce, team instability and difficulties incorporating a data driven improvement approach.

Conclusions

These findings suggest that a microsystems approach is valuable for building team relationships and quality improvement skills but is challenged in a large, diverse academic primary care context. They additionally suggest that primary care transformation will require purposeful changes implemented across the micro to macro-level including but not only focused on quality improvement training for microsystem teams.

Essentials of Ambulatory Care: An Interprofessional Workshop to Promote Core Skills and Values in Team-based Outpatient Care

Introduction

Team-based, interprofessional approaches to outpatient care are critical to high-quality patient care. However, few specific educational interventions promoting these skills in graduate level health care trainees have been described to date.

Methods

University of Minnesota faculty from the Schools of Medicine, Pharmacy, and Nursing created an interprofessional workshop experience exploring core concepts in outpatient care for graduate level trainees in pediatrics, family medicine, medicine-pediatrics, internal medicine, graduate-level nursing, and pharmacy. We focused on four key content areas: teamwork, systems thinking, the patient-centered health care home, and patient-centered communication. The workshop included brief didactics, role-plays, team-based experiences, and interactive skill practice. Participants completed an end-of-day survey reflecting on knowledge and attitude.

Results

From 2014-2017, nine workshops reached 305 trainees. Survey results from the 2015-2016 academic year are representative of our overall results and revealed that learners found the content high yield, and that they valued the opportunity to learn with their interprofessional colleagues. Improvements in perceived knowledge were noted in all domains. Trainees also reported increased skills, with 81% reporting both increased confidence in working within the interprofessional team, and change in attitude, and 90% reporting increased interest in working with their interprofessional colleagues after the workshop.

Discussion

Creating an opportunity for postgraduate level trainees from a variety of disciplines and professions to convene and focus on interprofessional team-based skills can fill a gap in interprofessional learning as they enter practice. Trainees were able to draw on their everyday experiences and find common ground with their interprofessional colleagues.

A Model for Catalyzing Educational and Clinical Transformation in Primary Care: Outcomes From a Partnership Among Family Medicine, Internal Medicine, and Pediatrics

PURPOSE

To report findings from a national effort initiated by three primary care certifying boards to catalyze change in primary care training.

METHOD

In this mixed-method pilot study (2012-2014), 36 faculty in 12 primary care residencies (family medicine, internal medicine, pediatrics) from four institutions participated in a professional development program designed to prepare faculty to accelerate change in primary care residency training by uniting them in a common mission to create effective ambulatory clinical learning environments. Surveys administered at baseline and 12 months after initial training measured changes in faculty members' confidence and skills, continuity clinics, and residency training programs. Feasibility evaluation involved assessing participation. The authors compared quantitative data using Wilcoxon signed-rank and Bhapkar tests. Observational field notes underwent narrative analysis.

RESULTS

Most participants attended two in-person training sessions (92% and 72%, respectively). Between baseline and 12 months, faculty members' confidence in leadership improved significantly for 15/19 (79%) variables assessed; their self-assessed skills improved significantly for 21/22 (95%) competencies. Two medical home domains ("Continuity of Care," "Support/Care Coordination") improved significantly (P < .05) between the two time periods. Analyses of qualitative data revealed that interdisciplinary learning communities formed during the program and served to catalyze transformational change.

CONCLUSIONS

Results suggest that improvements in faculty perceptions of confidence and skills occurred and that the creation of interdisciplinary learning communities catalyzed transformation. Lengthening the intervention period, engaging other professions involved in training the primary care workforce, and a more discriminating evaluation design are needed to scale this model nationally.