The Department of Veterans Affairs National Quality Scholars Fellowship Program: experience from 10 years of training quality scholars

Identifying Barriers and Facilitators to Veterans Affairs Whole Health Integration Using the Updated Consolidated Framework for Implementation Research

BACKGROUND

Veterans Affairs (VA) implemented the Veteran-centered Whole Health System initiative across VA sites with approaches to implementation varying by site.

PURPOSE

Using the Consolidated Framework for Implementation Research (CFIR), we aimed to synthesize systemic barriers and facilitators to Veteran use with the initiative. Relevance to healthcare quality, systematic comparison of implementation procedures across a national healthcare system provides a comprehensive portrait of strengths and opportunities for improvement.

METHODS

Advanced fellows from 11 VA Quality Scholars sites performed the initial data collection, and the final report includes CFIR-organized results from six sites.

RESULTS

Key innovation findings included cost, complexity, offerings, and accessibility. Inner setting barriers and facilitators included relational connections and communication, compatibility, structure and resources, learning centeredness, and information and knowledge access. Finally, results regarding individuals included innovation deliverers, implementation leaders and team, and individual capability, opportunity, and motivation to implement and deliver whole health care.

DISCUSSION AND IMPLICATIONS

Examination of barriers and facilitators suggest that Whole Health coaches are key components of implementation and help to facilitate communication, relationship building, and knowledge access for Veterans and VA employees. Continuous evaluation and improvement of implementation procedures at each site is also recommended.

Training the next generation of delivery science researchers: 10-year experience of a post-doctoral research fellowship program within an integrated care system

Introduction

Learning health systems require a workforce of researchers trained in the methods of identifying and overcoming barriers to effective, evidence-based care. Most existing postdoctoral training programs, such as NIH-funded postdoctoral T32 awards, support basic and epidemiological science with very limited focus on rigorous delivery science methods for improving care. In this report, we present the 10-year experience of developing and implementing a Delivery Science postdoctoral fellowship embedded within an integrated health care delivery system.

Methods

In 2012, the Kaiser Permanente Northern California Division of Research designed and implemented a 2-year postdoctoral Delivery Science Fellowship research training program to foster research expertise in identifying and addressing barriers to evidence-based care within health care delivery systems.

Results

Since 2014, 20 fellows have completed the program. Ten fellows had PhD-level scientific training, and 10 fellows had clinical doctorates (eg, MD, RN/PhD, PharmD). Fellowship alumni have graduated to faculty research positions at academic institutions (9), and research or clinical organizations (4). Seven alumni now hold positions in Kaiser Permanente's clinical operations or medical group (7).

Conclusions

This delivery science fellowship program has succeeded in training graduates to address delivery science problems from both research and operational perspectives. In the next 10 years, additional goals of the program will be to expand its reach (eg, by developing joint research training models in collaboration with clinical fellowships) and strengthen mechanisms to support transition from fellowship to the workforce, especially for researchers from underrepresented groups.

Curricula, Teaching Methods, and Success Metrics of Clinician-Scientist Training Programs: A Scoping Review

PURPOSE

To describe the literature on clinician-scientist training programs to inform the development of contemporary and inclusive training models.

METHOD

The authors conducted a scoping review, searching the PubMed/MEDLINE, CINAHL, and Embase databases from database inception until May 25, 2020. Studies presenting primary research that described and evaluated clinician-scientist training programs were identified for data abstraction. On the basis of deductive and inductive methods, information about program characteristics, curricula, teaching strategies, and success metrics was extracted. The extracted variables were analyzed using descriptive statistics.

RESULTS

From the initial 7,544 citations retrieved and 4,974 unique abstracts screened, 81 studies were included. Of the 81 included studies, 65 (80.2%) were published between 2011 and 2020, 54 (66.7%) were conducted in the United States, and 64 (79.0%) described programs that provided broad clinician-scientist training. Few programs provided funding or protected research time or specifically addressed needs of trainees from underrepresented minority groups. Curricula emphasized research methods and knowledge dissemination, whereas patient-oriented research competencies were not described. Most programs incorporated aspects of mentorship and used multiple teaching strategies, such as direct and interactive instruction. Extrinsic metrics of success (e.g., research output) were dominant in reported program outcomes compared with markers of intrinsic success (e.g., career fulfillment).

CONCLUSIONS

Although programs are providing clinician-scientists with practical skills training, opportunities exist for curricular and pedagogic optimization that may better support this complex career path. Training programs for clinician-scientists can address contemporary issues of wellness and equity by reconsidering metrics of program success and evolving the core tenets of their education models to include equity, diversity, and inclusion principles and patient-oriented research competencies.

How the VA is training the Next‐Generation workforce for learning health systems

Objectives

Methods

Results

Conclusions

The triple helix of clinical, research, and education missions in academic health centers: A qualitative study of diverse stakeholder perspectives

INTRODUCTION

Academic health centers are poised to improve health through their clinical, education, and research missions. However, these missions often operate in silos. The authors explored stakeholder perspectives at diverse institutions to understand challenges and identify alignment strategies.

METHODS

Authors used an exploratory qualitative design and thematic analysis approach with data obtained from electronic surveys sent to participants at five U.S. academic health centers (2017-18), with four different types of medical school/health system partnerships. Participants included educators, researchers, system leaders, administrators, clinical providers, resident/fellow physicians, and students. Investigators coded data using constant comparative analysis, met regularly to reconcile uncertainties, and collapsed/combined categories.

RESULTS

Of 175 participants invited, 113 completed the survey (65%). Three results categories were identified. First, five higher-order themes emerged related to aligning missions, including (a) shared vision and strategies, (b) alignment of strategy with community needs, (c) tension of economic drivers, (d) coproduction of knowledge, and (e) unifying set of concepts spanning all missions. Second, strategies for each mission were identified, including education (new competencies, instructional methods, recruitment), research (shifting agenda, developing partnerships, operations), and clinical operations (delivery models, focus on patient factors/needs, value-based care, well-being). Lastly, strategies for integrating each dyadic mission pair, including research-education, clinical operations education, and research-clinical operations, were identified.

CONCLUSIONS

Academic health centers are at a crossroads in regard to identity and alignment across the tripartite missions. The study's results provide pragmatic strategies to advance the tripartite missions and lead necessary change for improved patient health.

Value of Interprofessional Education: The VA Quality Scholars Program

ABSTRACT

Interprofessional collaboration (IPC) has been shown to improve healthcare quality and patient safety; however, formal interprofessional education (IPE) training is insufficient. The VA Quality Scholars (VAQS) program exists to develop interprofessional leaders and scholars in healthcare improvement. The purpose of this study was to examine the impact of integrating interprofessional healthcare learners and designing an interprofessional curriculum for the national VAQS program. VAQS alumni (graduates from 2001 to 2017) across eight national sites (n = 102 [53.1%]) completed a web-based survey to assess alumni perceptions of IPC skill development during the program and IPC skill utilization in their careers. Alumni from 2009 and earlier were physicians; alumni after 2009 came from diverse health professional backgrounds. Overall, IPC and teamwork was identified as the most used skill (n = 82, 70%) during their career. When comparing the pre-IPE period and the post-IPE period, post-IPE alumni identified IPC and teamwork as the area of greatest skill development (n = 38). Integrating interprofessional trainees and robust IPE curricula enhanced an established and successful quality improvement (QI) training program. VAQS alumni endorsed the importance of IPC skills during their careers. The VAQS program is an example of how health professionals can successfully learn IPC skills in healthcare QI.

Accelerating learning healthcare system development through embedded research: Career trajectories, training needs, and strategies for managing and supporting embedded researchers

BACKGROUND

Health systems and organizations seeking to achieve learning healthcare system principles are increasingly relying on embedded research teams to optimize delivery of evidence-based, high-quality care that improves patient and staff experience alike. However, building organizational capacity to conduct and benefit from embedded research may be challenging in the absence of clearer guidance on career pathways and training, as well as strategies for managing and supporting this unique workforce.

METHODS

In February 2018, 115 attendees from multiple agencies, institutions and professional societies participated in a conference to accelerate development of learning healthcare systems through embedded research. Workgroups engaged in structured brainstorming discussions of key domains; 21 diverse members focused on strengthening the embedded research community through more explicit development and support of multilevel career trajectories.

RESULTS

Emphasis emerged on the need for training that goes beyond traditional curricula in rigorous scientific methods to include leadership, communication, and other organizational and business skills rarely offered in research training programs. These skills are required for effective engagement of multilevel stakeholders supporting evidence-based changes in routine care. Improving readiness of other stakeholders to effectively act on evidence was noted as equally crucial, as was creation of mid-career development opportunities for researchers and implementers.

CONCLUSIONS

Further development and support of the embedded research workforce will require explicit attention to novel training programs and support of researchers and the stakeholders in the systems they aim to improve.

IMPLICATIONS

Strategies for improving career entry and mastery of skills that foster effective multilevel stakeholder engagement hold promise for strengthening the embedded research community and their contributions to systematic improvements in health and health care.

Creating a Framework to Integrate Residency Program and Medical Center Approaches to Quality Improvement and Patient Safety Training

Quality improvement and patient safety (QIPS) are core components of graduate medical education (GME). Training programs and affiliated medical centers must partner to create an environment in which trainees can learn while meaningfully contributing to QIPS efforts, to further the shared goal of improving patient care. Numerous challenges have been identified in the literature, including lack of resources, lack of faculty expertise, and siloed QIPS programs. In this article, the authors describe a framework for integrated QIPS training for residents in the University of Washington Internal Medicine Residency Program, beginning in 2014 with the creation of a dedicated QIPS chief resident position and assistant program director for health systems position, the building of a formal curriculum, and integration with medical center QIPS efforts. The postgraduate year (PGY) 1 curriculum focused on the culture of patient safety and entering traditional patient safety event (PSE) reports. The PGY-2 curriculum highlighted QIPS methodology and how to conduct mentored PSE reviews of cases that were of educational value to trainees and a clinical priority to the medical center. Additional PGY-2/PGY-3 training focused on the active report, presentation, and evaluation of cases during morbidity and mortality conferences while on clinical services, as well as how to lead longitudinal QIPS work. Select residents led mentored QI projects as part of an additional elective. The hallmark feature of this framework was the depth of integration with medical center priorities, which maximized educational and operational value. Evaluation of the program demonstrated improved attitudes, knowledge, and behavior changes in trainees, and significant contributions to medical center QIPS work. This specialty-agnostic framework allowed for training program and medical center integration, as well as horizontal integration across GME specialties, and can be a model for other institutions.

Developing Leaders and Scholars in Health Care Improvement: The VA Quality Scholars Program Competencies

Despite the need for leaders in health care improvement across health professions, there are no standards for the knowledge and skills that should be achieved through advanced interprofessional health care improvement training. Existing health care improvement training competencies focus on foundational knowledge expected of all trainees or for specific career pathways. Health care improvement leaders fill multiple roles within organizations and promote interprofessional improvement practice. The diverse skill set required of modern health care improvement leaders necessitates the development of training competencies specifically for fellowships in applied health care improvement. The authors describe the development of the revised national Veterans Affairs Quality Scholars (VAQS) Program competencies. The VAQS Program is an interprofessional, postdoctoral training program whose mission is to develop leaders and scholars to improve health care. An interprofessional committee of VAQS faculty reviewed and revised the competencies over 4 months beginning in fall 2018. The first draft was developed using 111 competencies submitted by 11 VAQS training sites and a review of published competencies. The final version included 22 competencies spanning 5 domains: interprofessional collaboration and teamwork, improvement and implementation science, organization and system leadership, methodological skills and analytic techniques for improvement and research, and teaching and coaching. Once attained, the VAQS competencies will guide the skill development that interprofessional health care improvement leaders need to participate in and lead health care improvement scholarship and implementation. These broad competencies are relevant to advanced training programs that develop health care improvement leaders and scholars and may be used by employers to understand the knowledge and skills expected of individuals who complete advanced fellowships in applied health care improvement.

Surviving and Thriving as Physicians in General Internal Medicine Fellowship in the Twenty-First Century

General internal medicine (GIM) fellowships play an important role in the development of physician scientists and clinical educators, as well as leaders in academic medicine. Nevertheless, the challenges of developing another novel aspect to one's career, along with balancing coursework, research productivity, clinical duties, and personal life during fellowship, can be overwhelming. Similarly, successfully securing a job at the end of fellowship can be a daunting process. In this article, we discuss the foundational tenets and themes of the GIM fellowship. These themes include (1) finding your purpose and passion, with a focus on selecting research coursework and developing an area of study; (2) the role and importance of mentorship, including the various kinds of mentorship that fellows require (traditional and peer mentorship, sponsors, and coaches), as well as how to be an effective mentee; (3) securing research funding; (4) landing a job; (5) and protecting time to meet personal goals. There is an increased need for a vibrant, diverse, and successful generation of general internal medicine researchers to advance our understanding of complex issues in clinical medicine and healthcare delivery and to inform health policy. It is our hope that this piece helps to support that mission.

The interprofessional Veterans Affairs Quality Scholars program pre- and postdoctoral nurse fellow outcomes

BACKGROUND

The Department of Veterans Affairs (VA) Quality Scholars (VAQS) program, an interprofessional fellowship that includes pre- and postdoctoral nurses, aims to inspire practice change leaders. Fellows participate in a national curriculum, lead improvement/research teams, and establish professional development plans with expert mentor guidance.

PURPOSE

To describe the distinctive elements of the VAQS program, nurse fellow outcomes, and accomplishments of nurse alumni as leaders, researchers, and educators.

METHODS

Data were reviewed and aggregated from past and current fellow surveys.

FINDINGS

Nurse fellows completed research and improvement projects that benefitted both the VA and the local health systems. Scholarly outcomes include publications, conference presentations, grant submissions, teaching/leading quality improvement, and research initiatives. Graduates transition to positions as nurse scientists, academic faculty, and operational leaders.

DISCUSSION

Fellows contribute to the strategic priorities of local and national VA and external health care organizations providing a pipeline of health system expert leaders, educators, and researchers.

CONCLUSION

Doctoral nursing fellowship experiences build human capital for enhancing the science of improvement and implementation, interprofessional collaboration, and leadership.

The interprofessional VA quality scholars program: Promoting predoctoral nursing scientists and their career trajectories

BACKGROUND

The VA Quality Scholars (VAQS) program is an interprofessional fellowship that provides a unique opportunity for predoctoral nurse scientists to embed their work in quality improvement learning "laboratories" to inform their scholarship, science, and research.

PURPOSE

To describe the VAQS program in relation to promoting nursing science and predoctoral nurse scientist (PhD) career trajectories, and to propose policy implications.

METHOD

Data were collected on all predoctoral (PhD, DNP) nurses who entered and completed the VAQS program nationally.

FINDINGS

A total of 17 predoctoral nurses (11 PhD and 6 DNP) have completed the VAQS program. Ten predoctoral PhD nurses (91%) completed their degree while in the program. Nine predoctoral PhD nurses (82%) entered a postdoctoral fellowship, and many obtained positions as faculty at research-intensive universities postfellowship.

DISCUSSION

The knowledge, skills, and experiences gained by predoctoral nurse scientists from the VAQS's program contribute to their nursing research and professional career growth.

Demonstrating the value of postgraduate fellowships for physicians in quality improvement and patient safety

BACKGROUND

Academic fellowships in quality improvement (QI) and patient safety (PS) have emerged as one strategy to fill a need for physicians who possess this expertise. The authors aimed to characterise the impact of two such programmes on the graduates and their value to the institutions in which they are housed.

METHODS

In 2018, a qualitative study of two US QIPS postgraduate fellowship programmes was conducted. Graduates' demographics and titles were collected from programme files,while perspectives of the graduates and their institutional mentors were collected through individual interviews and analysed using thematic analysis.

RESULTS

Twenty-eight out of 31 graduates (90%) and 16 out of 17 (94%) mentors participated in the study across both institutions. At a median of 3 years (IQR 2-4) postgraduation, QIPS fellowship programme graduates' effort distribution was: 50% clinical care (IQR 30-61.8), 48% QIPS administration (IQR 20-60), 28% QIPS research (IQR 17.5-50) and 15% education (7.1-30.4). 68% of graduates were hired in the health system where they trained. Graduates described learning the requisite hard and soft skills to succeed in QIPS roles. Mentors described the impact of the programme on patient outcomes and increasing the acceptability of the field within academic medicine culture.

CONCLUSION

Graduates from two QIPS fellowship programmes and their mentors perceive programmatic benefits related to individual career goal attainment and institutional impact. The results and conceptual framework presented here may be useful to other academic medical centres seeking to develop fellowships for advanced physician training programmes in QIPS.

Using a Logic Model to Design and Evaluate a Quality Improvement Leadership Course

Strong leadership is an essential factor in the success of quality improvement (QI) initiatives that generate and sustain improvements in patient outcomes. Notably, there is a rising need for frontline clinicians, who are often charged with leading QI efforts, to receive training in blended QI and leadership methods and skills. The Leading Healthcare Improvement (LHI) course is a longitudinal leadership course embedded within the Department of Veterans Affairs Quality Scholars (VAQS) program, a multisite interprofessional QI fellowship program. The LHI course was developed to provide frontline clinicians who are emerging QI leaders with the skills to lead and advance improvement efforts at their institutions. It consists of eight 60-minute online sessions and was implemented and delivered to a cohort of interprofessional fellows at 9 sites during the 2017-2018 academic year.This article describes the use of a logic model as a framework to guide the planning, implementation, and evaluation of the LHI course. The authors developed 5 logic model components: inputs, activities, outputs, short-term outcomes, and long-term outcomes. They defined the short-term outcomes using feedback from fellows and an evaluation of the fellows' abstract submissions to the VAQS Summer Institute. Submissions were reviewed to identify how fellows applied the LHI course concepts to QI projects at their respective sites. The authors also collected preliminary impact data from fellows to determine long-term outcomes.Finally, they used the logic model to inform changes to the LHI course based on the evaluation data they collected and developed plans to measure the impact of the course on learners, patients, and the health care system. The authors conclude with lessons learned to guide others who are implementing similar QI efforts.

Career Impact of the Chief Resident in Quality and Safety Training Program: An Alumni Evaluation

PURPOSE

Most evaluations of quality improvement and patient safety (QI/PS) training programs provide inadequate data on their impact on alumni careers and QI/PS involvement. To address this gap, the authors investigated continued participation in and barriers to QI/PS work, employment, and satisfaction with training among alumni of the Department of Veterans Affairs (VA) Chief Resident in Quality and Safety (CRQS) program.

METHOD

A cross-sectional, web-based survey was administered in January 2018 to all 238 CRQS program alumni (program years 2009-2017, 54 program sites).

RESULTS

A total of 145 alumni (61%) completed the survey, of whom 40% were employed at the VA. Participants reported various professional roles including academic appointments, QI/PS-specific positions, and hospital leadership positions. Most respondents reported involvement in QI/PS activities within the past year, including conducting QI or PS projects and teaching QI or PS. Alumni dedicated a median 15% of their work time to QI/PS. Almost all alumni reported experiencing barriers to QI/PS involvement, most frequently lack of time given clinical responsibilities. Most were satisfied with the training, and almost all reported CRQS participation helped their professional career advancement.

CONCLUSIONS

The continued involvement in QI/PS reported by alumni suggests training programs such as the CRQS program may be successful in building a workforce of leaders equipped to conduct and teach QI/PS. Dedicated time for QI/PS efforts is an important barrier. Future research should address possible career options and assess the larger, overall effect training physicians in QI/PS has on health systems and patient care.

Development of a Hybrid, Interprofessional, Interactive Quality Improvement Curriculum as a Model for Continuing Professional Development

Over the past 20 years, there has been an increased focus on quality improvement (QI) in health care, which is critical in achieving care that is patient-centered, safer, timelier, and more effective, efficient, and equitable. At the center of this movement is QI education, which is known to lead to learning, behavior change, and improved outcomes. However, there is a need for the development and provision of long-duration, interactive, interprofessional training in QI, to allow for in-depth learning and application of learned skills. To this end, we designed a curriculum for an established interprofessional, interactive, web-based QI fellowship for doctorally prepared clinicians. Curricular content is delivered virtually to geographically dispersed learners over a 2-year time span. The didactic curriculum and experiential learning opportunities provide learners with the foundational knowledge and practical skills to engage in-and eventually, lead-QI initiatives around the country. Evaluation of learner satisfaction and cognitive, affective, and skills-based learning has found that this model is an effective method to train geographically distributed learners. A hybrid training structure is used, where learners interact with the material through 3 distinct delivery modes: (1) virtual instruction in QI topics; (2) face-to-face training, mentorship, and the opportunity for practical application of applied knowledge and skills through the completion of QI projects; and (3) opportunities for other types of training, tailored to each learner's Individual Development Plan. This training program model holds value for QI learning in various health care settings, which are interprofessional by nature. These foundational concepts of hybrid learning to distributed learners-wherein an instructor delivers curriculum in small, face-to-face batches, interprofessional learning is supplemented in a virtual, longitudinal manner, and learners are allowed the opportunity to put skills into action for real-world problems in interdisciplinary clinical teams-can be applied in a multitude of settings, with comparatively lower time and cost expenditure than traditional training programs.

Health Systems Science: The "Broccoli" of Undergraduate Medical Education

Health system leaders are calling for reform of medical education programs to meet evolving needs of health systems. U.S. medical schools have initiated innovative curricula related to health systems science (HSS), which includes competencies in value-based care, population health, system improvement, interprofessional collaboration, and systems thinking. Successful implementation of HSS curricula is challenging because of the necessity for new curricular methods, assessments, and educators and for resource allocation. Perhaps most notable of these challenges, however, is students' mixed receptivity. Although many students are fully engaged, others are dissatisfied with curricular time dedicated to competencies not perceived as high yield. HSS learning can be viewed as "broccoli"-students may realize it is good for them in the long term, but it may not be palatable in the moment. Further analysis is necessary for accelerating change both locally and nationally.With over 11 years of experience in global HSS curricular reform in 2 medical schools and informed by the curricular implementation "performance gap," the authors explore student receptivity challenges, including marginalization of HSS coursework, infancy of the HSS field, relative nascence of curricula and educators, heterogeneity of pedagogies, tensions in students' perceptions of their professional role, and culture of HSS integration. The authors call for the reexamination of 5 issues influencing HSS receptivity: student recruitment processes, faculty development, building an HSS academic "home," evaluation metrics, and transparent collaboration between medical schools. To fulfill the social obligation of meeting patients' needs, educators must seek a shared understanding of underlying challenges of HSS innovations.

VA Quality Scholars Quality Improvement Coach Model to Facilitate Learning and Success

Despite the increase in quality improvement (QI) education both in practice and in health professions' education, gaps exist in the usefulness and success of QI projects. Barriers to successful QI are a result of delays in implementation, teamwork issues, and lack of QI knowledge. These barriers can be addressed using a QI Coach. A QI Coach is an expert in QI principles who has excellent communication and collaboration skills, and is experienced with organizational policies. The purpose of this article is to (a) describe the VA Quality Scholars (VAQS) QI Coach Model that includes the role of a coach and effective coaching strategies and (b) discuss lessons learned from the application of the VAQS QI Coach Model. The QI Coach facilitates success by providing novice QI teams with practical skills, encouragement, and support.

Teaching Root Cause Analysis Using Simulation: Curriculum and Outcomes

BACKGROUND

Clinicians are key drivers for improving health care quality and safety. However, some may lack experience in quality improvement and patient safety (QI/PS) methodologies, including root cause analysis (RCA).

OBJECTIVE

The Department of Veterans Affairs (VA) sought to develop a simulation approach to teach clinicians from the VA's Chief Resident in Quality and Safety program about RCA. We report the use of experiential learning to teach RCA, and clinicians' preparedness to conduct and teach RCA post-training. We provide curriculum details and materials to be adapted for widespread use.

METHODS

The course was designed to meet the learning objectives through simulation. We developed course materials, including presentations, a role-playing case, and an elaborate RCA case. Learning objectives included (1) basic structure of RCA, (2) process flow diagramming, (3) collecting information for RCA, (4) cause and effect diagramming, and (5) identifying actions and outcomes. We administered a voluntary, web-based survey in November 2016 to participants (N = 114) post-training to assess their competency with RCA.

RESULTS

A total of 93 individuals completed the survey of the 114 invited to participate, culminating an 82% response rate. Nearly all respondents (99%, N = 92) reported feeling at least moderately to extremely prepared to conduct and teach RCA post-training. Most respondents reported feeling very to extremely prepared to conduct and teach RCA (77%, N = 72).

CONCLUSIONS

Experiential learning involving simulations may be effective to improve clinicians' competency in QI/PS practices, including RCA. Further research is warranted to understand how the training affects clinicians' capacity to participate in real RCA teams post-training, as well as applicability to other disciplines and interdisciplinary teams.

Perceptions of Health Care Executives on Leadership Development Skills for Residents After Participating in a Longitudinal Mentorship Program

Despite the fact that physicians are being asked to lead and enact change to improve a myriad of quality of care measures, there is little focus on leadership skills development during their training. One strategy to address this gap is to focus on trainees during graduate medical education, specifically those residents aspiring to careers as physician leaders in quality. The authors designed a leadership curriculum for self-selected residents who are pursuing a certificate in health care leadership in quality. Residents were surveyed and focus groups were conducted with health system executives who participated in the curriculum as part of an evaluation designed to inform improvements in the program and to provide guidance to others who direct physician leadership training programs. The findings support the need to invest in young physician leaders who are focused on quality with the ultimate goal of improving population health in the ever-changing health care environment.

Immediate and long-term effects of a team-based quality improvement training programme

Background

Although many studies of quality improvement (QI) education programmes report improvement in learners’ knowledge and confidence, the impact on learners’ future engagement in QI activities is largely unknown and few studies report project measures beyond completion of the programme.

Method

We developed the Academy for Quality and Safety Improvement (AQSI) to prepare individuals, across multiple departments and professions, to lead QI. The 7-month programme consisted of class work and team-based project work. We assessed participants’ knowledge using a multiple choice test and an adapted Quality Improvement Knowledge Assessment Test (QIKAT) before and after the programme. We evaluated participants’ postprogramme QI activity and project status using surveys at 6 and 18 months.

Results

Over 5 years, 172 individuals and 32 teams participated. Participants had higher multiple choice test (71.9±12.7 vs 79.4±13.2; p<0.001) and adapted QIKAT scores (55.7±16.3 vs 61.8±14.7; p<0.001) after the programme. The majority of participants at 6 months indicated that they had applied knowledge and skills learnt to improve quality in their clinical area (129/148; 87.2%) and to implement QI interventions (92/148; 62.2%). At 18 months, nearly half (48/101; 47.5%) had led other QI projects and many (41/101; 40.6%) had provided QI mentorship to others. Overall, 14 (43.8%) teams had positive postintervention results at AQSI completion and 20 (62.5%) had positive results at some point (ie, completion, 6 months or 18 months after AQSI).

Conclusions

A team-based QI training programme resulted in a high degree of participants’ involvement in QI activities beyond completion of the programme. A majority of team projects showed improvement in project measures, often occurring after completion of the programme.

Eleven Principles for Teaching Quality Improvement Virtually: Engaging With Geographically Distributed Learners

Health care professionals in the United States are expected to engage in quality improvement (QI) as part of their daily practice. This has created the need for QI training at all levels of health professional education. A reported barrier to increasing QI-trained health care professionals is the lack of QI-trained faculty at health care institutions and the limited availability of practitioners, given their daily clinical demands. E-learning is a potential solution. E-learning allows learning outside the traditional classroom setting, where instructors can flexibly deliver practical QI curricula to an interprofessional audience in multiple practice locations. The 11 principles presented in this article are derived from established evidence and experience and provide QI educators with practical principles for course design, implementation, and learner feedback of an e-learning course in QI.

The Clinical Quality Fellowship Program: Developing Clinical Quality Leadership in the Greater New York Region

The Institute of Medicine has noted that a key factor underlying patient safety problems in the United States is a paucity of quality and safety training programs for clinicians. The Greater New York Hospital Association and United Hospital Fund created the Clinical Quality Fellowship Program (CQFP) to develop quality improvement leaders in the New York region. The goals of this article are to describe the CQFP's structure and curriculum, program participants' perceived value, improvement projects, and career paths. Eighty-seven participants completed the CQFP from 2010 to 2014. Among program participants completing self-assessment evaluations, significant improvements were observed across all quality improvement skill areas. Capstone project categories included inpatient efficiency, transitional care, and hospital infection. Fifty-six percent of participants obtained promotions following program completion. A training program emphasizing diverse curricular elements, varied learning approaches, and applied improvement projects increased participants' self-perceived skills, generated diverse improvement initiatives, and was associated with career advancement.

Evaluating investment in quality improvement capacity building: a systematic review

PURPOSE

Leading health systems have invested in substantial quality improvement (QI) capacity building, but little is known about the aggregate effect of these investments at the health system level. We conducted a systematic review to identify key steps and elements that should be considered for system-level evaluations of investment in QI capacity building.

METHODS

We searched for evaluations of QI capacity building and evaluations of QI training programmes. We included the most relevant indexed databases in the field and a strategic search of the grey literature. The latter included direct electronic scanning of 85 relevant government and institutional websites internationally. Data were extracted regarding evaluation design and common assessment themes and components.

RESULTS

48 articles met the inclusion criteria. 46 articles described initiative-level non-economic evaluations of QI capacity building/training, while 2 studies included economic evaluations of QI capacity building/training, also at the initiative level. No system-level QI capacity building/training evaluations were found. We identified 17 evaluation components that fit within 5 overarching dimensions (characteristics of QI training; characteristics of QI activity; individual capacity; organisational capacity and impact) that should be considered in evaluations of QI capacity building. 8 key steps in return-on-investment (ROI) assessments in QI capacity building were identified: (1) planning-stakeholder perspective; (2) planning-temporal perspective; (3) identifying costs; (4) identifying benefits; (5) identifying intangible benefits that will not be included in the ROI estimation; (6) discerning attribution; (7) ROI calculations; (8) sensitivity analysis.

CONCLUSIONS

The literature on QI capacity building evaluation is limited in the number and scope of studies. Our findings, summarised in a Framework to Guide Evaluations of QI Capacity Building, can be used to start closing this knowledge gap.

Strategies for Developing and Recognizing Faculty Working in Quality Improvement and Patient Safety

Academic clinical departments have the opportunity and responsibility to improve the quality and value of care and patient safety by supporting effective quality improvement activities. The pressure to provide high-value care while further developing academic programs has increased the complexity of decision making and change management in academic health systems. Overcoming these challenges will require faculty engagement and leadership; however, most academic departments do not have a sufficient number of individuals with expertise and experience in quality improvement and patient safety (QI/PS). Accordingly, the authors of this article advocate for a targeted and proactive approach to developing faculty working in QI/PS. They propose a strategy predicated on the identification of QI/PS as a strategic priority for academic departments, the creation of enabling resources in QI/PS, and the expansion of rigorous training programs in change management and in improvement and implementation sciences. Professional organizations, health systems, medical schools, and academic departments should recognize successful QI/PS work with awards and promotions. Individual faculty members should expand their collaborative networks, consider the generalizability and scholarly impact of their efforts when designing QI/PS initiatives, and benchmark the outcomes of their performance. Appointments and promotions committees should work proactively with department and QI/PS leaders to ensure that outstanding achievement in QI/PS is defined and recognized. As with the development of physician-investigators and clinician-educators, departments and health systems need a comprehensive approach to support and recognize the contributions of faculty working in QI/PS to meet the considerable needs and opportunities in health care.

Educational system factors that engage resident physicians in an integrated quality improvement curriculum at a VA hospital: a realist evaluation

PURPOSE

Learning about quality improvement (QI) in resident physician training is often relegated to elective or noncore clinical activities. The authors integrated teaching, learning, and doing QI into the routine clinical work of inpatient internal medicine teams at a Veterans Affairs (VA) hospital. This study describes the design factors that facilitated and inhibited the integration of a QI curriculum-including real QI work-into the routine work of inpatient internal medicine teams.

METHOD

A realist evaluation framework used three data sources: field notes from QI faculty; semistructured interviews with resident physicians; and a group interview with QI faculty and staff. From April 2011 to July 2012, resident physician teams at the White River Junction VA Medical Center used the Model for Improvement for their QI work and analyzed data using statistical process control charts.

RESULTS

Three domains affected the delivery of the QI curriculum and engagement of residents in QI work: setting, learner, and teacher. The constant presence of the QI material on a public space in the team workroom was a facilitating mechanism in the setting. Explicit sign-out of QI work to the next resident team formalized the handoff in the learner domain. QI teachers who were respected clinical leaders with QI expertise provided role modeling and local system knowledge.

CONCLUSIONS

Integrating QI teaching into the routine clinical and educational systems of an inpatient service is challenging. Identifiable, concrete strategies in the setting, learner, and teacher domains helped integrate QI into the clinical and educational systems.

Health systems engineering fellowship: curriculum and program development

Industrial engineering and related disciplines have been used widely in improvement efforts in many industries. These approaches have been less commonly attempted in health care. One factor limiting application is the limited workforce resulting from a lack of specific education and professional development in health systems engineering (HSE). The authors describe the development of an HSE fellowship within the United States Department of Veterans Affairs, Veterans Health Administration (VA). This fellowship includes a novel curriculum based on specifically established competencies for HSE. A 1-year HSE curriculum was developed and delivered to fellows at several VA engineering resource centers over several years. On graduation, a majority of the fellows accepted positions in the health care field. Challenges faced in developing the fellowship are discussed. Advanced educational opportunities in applied HSE have the potential to develop the workforce capacity needed to improve the quality of health care.

Documenting quality improvement and patient safety efforts: the quality portfolio. A statement from the academic hospitalist taskforce

Physicians increasingly investigate, work, and teach to improve the quality of care and safety of care delivery. The Society of General Internal Medicine Academic Hospitalist Task Force sought to develop a practical tool, the quality portfolio, to systematically document quality and safety achievements. The quality portfolio was vetted with internal and external stakeholders including national leaders in academic medicine. The portfolio was refined for implementation to include an outlined framework, detailed instructions for use and an example to guide users. The portfolio has eight categories including: (1) a faculty narrative, (2) leadership and administrative activities, (3) project activities, (4) education and curricula, (5) research and scholarship, (6) honors, awards, and recognition, (7) training and certification, and (8) an appendix. The authors offer this comprehensive, yet practical tool as a method to document quality and safety activities. It is relevant for physicians across disciplines and institutions and may be useful as a standalone document or as an adjunct to traditional promotion documents. As the Next Accreditation System is implemented, academic medical centers will require faculty who can teach and implement the systems-based practice requirements. The quality portfolio is a method to document quality improvement and safety activities.

Building capacity for quality: a pilot co-learning curriculum in quality improvement for faculty and resident learners

BACKGROUND

Despite a mandate to teach quality improvement (QI) to residents, many training programs lack faculty capacity to deliver a QI curriculum.

OBJECTIVE

We piloted a co-learning curriculum in QI to train residents while simultaneously developing QI teachers. We evaluated the curriculum's acceptability and feasibility and its effect on faculty engagement in doing and teaching QI.

METHODS

The curriculum involved 2 half-day, interactive sessions, a team-based QI project, and end-of-year project presentations. Key curriculum design principles included (1) residents and faculty co-attend all interactive sessions, (2) residents and faculty work together on team-based QI projects, and (3) QI projects align with divisional QI priorities. Using the Kirkpatrick framework for learner outcomes, we focused our program evaluation on Level 1 (satisfaction) and Level 2 (knowledge and skills acquisition) outcomes using year-end curriculum evaluations.

RESULTS

Our study included 14 residents (70%) and 6 faculty members (30%). With respect to satisfaction (Kirkpatrick Level 1 outcome), 93% (13 of 14) of residents and 100% (6 of 6) of faculty participants rated the overall curriculum as "above average" or "outstanding." Regarding faculty knowledge and skills acquisition (Kirkpatrick Level 2 outcomes), faculty self-rated their QI knowledge and interest in QI higher than their intent to incorporate QI into future practice and their comfort in teaching or supervising QI projects. All 5 faculty respondents (100%) rated the co-learning model for faculty development in QI as "above average" or "outstanding."

CONCLUSIONS

Teaching QI to residents and faculty as co-learners is feasible and acceptable and offers a promising model for programs to teach QI to residents while concurrently building faculty capacity.

Evaluation of VA Women's Health Fellowships: developing leaders in academic women's health

BACKGROUND

The Department of Veterans Affairs (VA) instituted the VA Women's Health Fellowship (VAWHF) Program in 1994, to accommodate the health needs of increasing numbers of female veterans and to develop academic leaders in women's health. Despite the longevity of the program, it has never been formally evaluated.

OBJECTIVE

To describe the training environments of VAWHFs and career outcomes of female graduates.

DESIGN AND PARTICIPANTS

Cross-sectional web-based surveys of current program directors (2010-2011) and VAWHF graduates (1995-2011).

RESULTS

Responses were received from six of seven program directors (86 %) and 42 of 74 graduates (57 %). The mean age of graduates was 41.2 years, and mean time since graduation was 8.5 years. Of the graduates, 97 % were female, 74 % trained in internal medicine, and 64 % obtained an advanced degree. Those with an advanced degree were more likely than those without an advanced degree to pursue an academic career (82 % vs. 60 %; P<0.01). Of the female graduates, 76 % practice clinical women's health and spend up to 66 % of their time devoted to women's health issues. Thirty percent have held a VA faculty position. Seventy-nine percent remain in academics, with 39 % in the tenure stream. Overall, 94 % had given national presentations, 88 % had received grant funding, 79 % had published in peer-reviewed journals, 64 % had developed or evaluated curricula, 51 % had received awards for teaching or research, and 49 % had held major leadership positions. At 11 or more years after graduation, 33 % of the female graduates in academics had been promoted to the rank of associate professor and 33 % to the rank of full professor.

CONCLUSIONS

The VAWHF Program has been successful in training academic leaders in women's health. Finding ways to retain graduates in the VA system would ensure continued clinical, educational, and research success for the VA women veteran's healthcare program.

Mastering improvement science skills in the new era of quality and safety: the Veterans Affairs National Quality Scholars Program

RATIONALE, AIMS AND OBJECTIVES

Healthcare professionals need a new skill set to ensure the success of quality improvement in healthcare. The Department of Veterans Affairs (VA) initiated the VA National Quality Scholars fellowship in 1998; its mission is to improve the quality of care, ensure safety, accelerate healthcare re-design, and advance the improvement science by educating the next generation of leaders in quality and safety. We describe the critical need for leadership in quality and safety and interprofessional education, illustrate the curriculum, provide lessons learned by fellows, summarize key lessons learned from the implementation of an interprofessional education approach, and present most recent accomplishments.

METHODS

Narrative review.

RESULTS

As of 2011, 106 program alumni are embedded in the health care delivery system across the United States. Since 2009, when nurse fellows joined the program, of the first nine graduating interdisciplinary fellows, the tailored curriculum has resulted in five advanced academic degrees, 42 projects, 29 teaching activities, 44 presentations, 36 publications, six grants funded or submitted, and two awards.

CONCLUSIONS

The VA National Quality Scholars program continues to nurture and develop leaders for the new millennium focusing on interprofessional education. The nations' health care systems need strong interdisciplinary leaders in advanced quality improvement science who are dedicated to improving the overall quality of health and health care.

Pilot study evaluating a practice-based learning and improvement curriculum focusing on the development of system-level quality improvement skills

BACKGROUND

We developed a practice-based learning and improvement (PBLI) curriculum to address important gaps in components of content and experiential learning activities through didactics and participation in systems-level quality improvement projects that focus on making changes in health care processes.

METHODS

We evaluated the impact of our curriculum on resident PBLI knowledge, self-efficacy, and application skills. A quasi-experimental design assessed the impact of a curriculum (PBLI quality improvement systems compared with non-PBLI) on internal medicine residents' learning during a 4-week ambulatory block. We measured application skills, self-efficacy, and knowledge by using the Systems Quality Improvement Training and Assessment Tool. Exit evaluations assessed time invested and experiences related to the team projects and suggestions for improving the curriculum.

RESULTS

The 2 groups showed differences in change scores. Relative to the comparison group, residents in the PBLI curriculum demonstrated a significant increase in the belief about their ability to implement a continuous quality improvement project (P  =  .020), comfort level in developing data collection plans (P  =  .010), and total knowledge scores (P < .001), after adjusting for prior PBLI experience. Participants in the PBLI curriculum also demonstrated significant improvement in providing a more complete aim statement for a proposed project after adjusting for prior PBLI experience (P  =  .001). Exit evaluations were completed by 96% of PBLI curriculum participants who reported high satisfaction with team performance.

CONCLUSION

Residents in our curriculum showed gains in areas fundamental for PBLI competency. The observed improvements were related to fundamental quality improvement knowledge, with limited gain in application skills. This suggests that while heading in the right direction, we need to conceptualize and structure PBLI training in a way that integrates it throughout the residency program and fosters the application of this knowledge and these skills.

The role for clinician educators in implementing healthcare improvement

Clinician educators-who work at the intersection of patient care and resident education-are well positioned to respond to calls for better, safer patient care and resident education. Explicit lessons that address implementing health care improvement and associated residency training came out of the Academic Chronic Care Collaboratives and include the importance of: (1) redesigning the clinical practice as a core component of the residency curriculum; (2) exploiting the efficiencies of the practice team; (3) replacing "faculty development" with "everyone's a learner;" (4) linking faculty across learning communities to build expertise; and (5) using rigorous methodology to design and evaluate interventions for practice redesign. There has been progress in addressing three thorny academic faculty issues-professional satisfaction, promotion and publication. For example, consensus criteria have been proposed for both faculty promotion as well as the institutional settings that nurture academic health care improvement careers, and the SQUIRE Publication Guidelines have been developed as a general framework for scholarly improvement publications. Extensive curricular resources exist for developing the expert faculty cadre. Curricula from representative training programs include quantitative and qualitative research methods, statistical methodologies appropriate for measuring systems change, organizational culture, management, leadership and scholarly writing for the improvement literature. Clinician educators-particularly those in general internal medicine-bear the principal responsibility for both patient care and resident training in academic departments of internal medicine. The intersection of these activities presents a unique opportunity for their playing a central role in implementing health care improvement and associated residency training. However, this role in academic settings will require an unambiguous development strategy both for faculty and their institutions.

Preparing medical students for the continual improvement of health and health care: Abraham Flexner and the new "public interest"

In 1910, in his recommendations for reforming medical education, Abraham Flexner responded to what he deemed to be the "public interest." Now, 100 years later, to respond to the current needs of society, the education of physicians must once again change. In addition to understanding the biological basis of health and disease, and mastering technical skills for treating individual patients, physicians will need to learn to navigate in and continually improve complex systems in order to improve the health of the patients and communities they serve. Physicians should not be mere participants in, much less victims of, such systems. Instead, they ought to be prepared to help lead those systems toward ever-higher-quality care for all. A number of innovative programs already exist for students and residents to help integrate improvement skills into professional preparation, and that goal is enjoying increasing support from major professional organizations and accrediting bodies. These experiences have shown that medical schools and residency programs will need to both teach the scientific foundations of system performance and provide opportunities for trainees to participate in team-based improvement of the real-world health systems in which they work. This significant curricular change, to meet the social need of the 21st century, will require educators and learners to embrace new core values, in addition to those held by the profession for generations. These include patient-centeredness, transparency, and stewardship of limited societal resources for health care.