Experiential Learning in Project-Based Quality Improvement Education: Questioning Assumptions and Identifying Future Directions

An interprofessional postgraduate quality improvement curriculum: results and lessons learned over a 5-year implementation

PROBLEM

Quality Improvement (QI) is interprofessional by nature; however, most academic QI programs occur in silos and do not leverage the opportunity to bring interprofessional learners together.

INTERVENTION

To evaluate QI competencies of physician, nursing, pharmacy, behavioral health, and social work residents after participating in a longitudinal QI curriculum. Lessons learned are shared to guide educators in developing QI curriculum for interprofessional learners.

CONTEXT

Cohorts of graduate students over 5 years participated in a QI curriculum that aligned with each professions' core quality competencies. Residents engaged in didactics and experiential learning in primary care clinics.

IMPACT

All learners (N = 74) demonstrated improvement in QI knowledge measured by the QIKAT-R and applied their skills demonstrated by completion of a QI project presented at the Institute for Healthcare Improvement annual forums. Participation in QI curriculum resulted in knowledge and skill improvement.

LESSONS LEARNED

An experiential QI curriculum is a natural place to bring diverse post-graduate learners together to improve QI knowledge and skills. Successful QI curriculum goals are to (a) align projects with institutional and stakeholder goals, (b) include coaches to promote teamwork and project management, (c) narrow project scope, (d) develop an improvement mindset that failures are learning opportunities, and (e) address needs for data access.

Good practices to optimise the performance of maternal and neonatal quality improvement teams: Results from a longitudinal qualitative evaluation in South Africa, before, and during COVID-19

Many maternal and neonatal deaths can be avoided if quality healthcare is provided. To this end, the South African National Department of Health implemented a quality improvement (QI) programme (2018-2022) to improve maternal and neonatal health services in 21 public health facilities. This study sought to identify good practices aimed at improving QI teams' performance by identifying optimal facility-level contextual factors and implementation processes. We purposively selected 14 facilities of the 21 facilities for a longitudinal qualitative process evaluation. We interviewed 17 team leaders, 47 members, and five QI advisors who provided technical support to the teams. The data were analysed using framework analysis. We choose the Consolidated Framework for Implementation Research as framework given that it explicates contexts and processes that shape programme implementation. Six quality improvement teams were assessed as well-performing, and eight as less well-performing. This research conceptualises a 'life course lens' for setting up and managing a QI team. We identified eight good practices, six related to implementation processes, and two contextual variables that will optimise team performance. The two most impactful practices to improve the performance of a QI team were (i) selecting healthcare workers with quality improvement-specific characteristics, and (ii) appointing advisors whose interpersonal skills match their technical quality improvement competencies.

A Standard Approach to Project-Based Learning in a Clinical Informatics Fellowship

BACKGROUND

 The Accreditation Council for Graduate Medical Education suggests that Clinical Informatics (CI) fellowship programs foster broad skills, which include collaboration and project management. However, they do not dictate how to best accomplish these learning objectives.

OBJECTIVES

 This study aimed to describe a standard approach to project-based learning for CI, to share its implementation, and to discuss lessons learned.

METHODS

 We created a standard approach to project-based learning based on concepts from adult learning theory, the project life cycle framework, the Toyota Production System, and Improvement Science.

RESULTS

 With this standard approach in place, we learned how best to support fellows in its use. In addition to this approach to supporting needs assessment, risk/change management, implementation, and evaluation/improvement skills, we found the need to develop fellow skills in collaboration, leadership, and time management/managing up. Supported by project-based learning using this standard approach, and with targeted project selection to meet topic-based learning objectives, fellows reached the ability to practice independently in 15 to 21 months.

DISCUSSION

 Fellows are uniquely positioned to ensure the success of projects due to their increased availability and protected time compared with attendings. They are readily available for project teams to draw upon their expertise with clinical workflows and understanding of technological solutions. Project-based learning addressing organizational priorities complements fellow project management coursework and improves fellows' ability to function successfully in large, complex, and dynamic organizations. Exposing fellows to contemporary problems, then addressing them through projects, provides fellows with up-to-date applied informatics knowledge.

CONCLUSION

 Project-based learning can ensure that many general CI learning objectives are supported inherently. It reinforces project management teachings, while providing fellows with a marketable project portfolio to aid with future job applications. Having projects tightly aligned with organizational priorities supports ongoing investment in fellowship programs.

Problem-Based Learning in Medical Education: A Global Research Landscape of the Last Ten Years (2013-2022)

Background

Problem-based learning (PBL) constructs a curriculum that merges theory and practice by employing clinical scenarios or real-world problems. Originally designed for the pre-clinical phase of undergraduate medicine, PBL has since been integrated into diverse aspects of medical education. Therefore, this study aims to map the global scientific landscape related to PBL in medical education in the last ten years.

Methods

We combined bibliometrics and network analysis to analyze the metadata of related research articles published between 2013 and 2022 and indexed in the Web of Science Core Collection.

Results

Our results show an annual publication rate of 9.42%. The two main journals disseminating research on this subject are BMC Medical Education and Medical Teacher. Education & Educational Research and Health Care Sciences & Services are the two most frequent research areas, and also the two most central nodes of the related network. The USA and China are the most publishing countries, while the Netherlands and Canada are the most collaborative. The Maastricht University holds the position of most publishing and collaborative research organization. The University of California ranks second in publications, while the University of Toronto is the second most central research organization.

Conclusions

Our study provides an overview of the last ten years of publications related to PBL and medical education, and we hope it can be of interest to educators, researchers, and students involved with this subject.

Supplementary Information

The online version contains supplementary material available at 10.1007/s40670-024-02003-1.

Case Report-Driven Medical Education in Rural Family Medicine Education: A Thematic Analysis

Case-based education (CBE) is a teaching method in which learners work on real-life cases to learn and apply concepts and skills they have been taught. Case report-driven medical education using the CBE framework can effectively facilitate student and resident learning, and entice them to become involved in actual clinical practice. Specific case report-driven medical education methods and learning outcomes are not clarified. This study aimed to clarify the specific learning processes and outcomes of case report-driven medical education in rural community-based medical education. Using a qualitative design based on a thematic analysis approach, data were collected through semi-structured interviews. The study participants were medical students and residents in training at a rural Japanese community hospital. Fifty-one case reports were completed and published in Cureus from April 2021 to March 2023. Participants learned about various difficulties related to volatility, uncertainty, complexity, and ambiguity (VUCA) in the medical care of various older patients, which increased their interest in family medicine. They appreciated the importance of case reports in academic careers and how their responsibilities as researchers increase with collaboration. Case report-driven medical education in community hospitals can drive medical students' and junior residents' learning regarding family medicine in the VUCA world.

Knowledge Spillover and Emotional Motivation-A Study on the Willingness and Influencing Factors of Project-Based Learning

Project-based learning (PBL) is a task-based learning mode, which is of great significance to context-based curriculum education. With data collected through questionnaires and interviews, this article builds a binary logistic regression analysis model to explore the learners' willingness of PBL and its influencing factors. A total of 14 influencing factors are set in the research, with an innovative import of knowledge spillover and emotional motivation, to examine the impact on PBL willingness. Results show that eight factors, such as project-based learning experience, clarity of curriculum tasks, contextuality of curriculum content, and requirement for innovation of curriculum tools, have significant positive impacts on learners' willingness of PBL, while four factors, including the challenge of the curriculum project and tendency of learning objectives setting, have significant negative impacts. What's more, the grade of the learners and the challenge of the curriculum project have no significant impact. This article verifies that individual characteristics, knowledge spillover, and emotional motivation have different directions and degrees of impact on learners' willingness of PBL. Then, reasons are explored and implications proposed that these factors should be distinguished and paid sufficient attention to. Finally, suggestions are put forward on strengthening the contextuality of curriculum content, identifying the heterogeneity of learners, and expanding innovative tools to develop a PBL-based blended teaching model. In this way, the potential of PBL can be fully realized in maximizing learning achievements.

Factors influencing measurement for improvement skills in healthcare staff: trainee, and trainer perspectives

BACKGROUND

Measurement for improvement is an integral component of quality improvement (QI) trainings and demonstrates whether a change resulted in an improvement. Despite its critical role, the development of measurement for improvement skills for QI is relatively under-explored.

PURPOSE

To explore the training, curricular and contextual factors that influence the development of measurement for improvement skills in healthcare professionals.

METHODS

This is a retrospective, qualitative, multiple case study design, based on two QI collaboratives. Trainees and trainers from these programmes participated in semi-structured interviews. A framework drawing on the Kirkpatrick's evaluation model and the Model for Understanding Success in Quality (MUSIQ) model was developed. The interviews were analysed based on a three-step qualitative thematic analysis method.

RESULTS

A total of 21 participants were interviewed (15 trainees and 6 trainers). Six themes emerged in the analysis of trainee interviewees: impact of differences in job role and hierarchical levels, narrow conception of QI, knowledge disparity between trained and untrained staff, balancing the benefits and burdens of measurement, early adopters of QI driving change and supportive and engaged leadership. Themes in trainer perspectives were knowledge and understanding of measurement, application of PDSA approach to programme design, balancing consistency with adaptation to context, and attributes of sites receptive to change as predictors of development of measurement for improvement skills in staff.

CONCLUSION

Training alone does not determine the development, sustainability and spread of measurement and QI skills. Instead, it is influenced by a combination of curricular, training, and contextual support structures. Training programmes should be aware of the impact of job role and hierarchy, increased knowledge disparity between trained and untrained staff and trainees equating QI to bundle implementation while designing programmes. Similarly, organisational support through leaders, encouraging staff who have an interest in measurement and a culture receptive to QI also supports development of measurement skills. The study highlights the need for trainees, trainers, and organisations to work together in balancing the benefits and burdens of measurement, leading to sustainable skill development in line with international best practices.

Practical strategies to enhance resident engagement in clinical quality improvement

BACKGROUND

Engaging residents in meaningful quality improvement (QI) is difficult. Challenges include competing demands, didactics which lack connection to meaningful work, suboptimal experiential learning, unclear accountability, absence of timely and relevant data, and lack of faculty coaches and role models. Various strategies to address these challenges for engagement have been described, but not as a unified approach. This paper describes a bundle of practical strategies to address common challenges to resident engagement in QI, illustrated through the experience of one residency education program.

METHODS

62 categorical residents in the University of Missouri Internal Medicine residency participated in a longitudinal QI curriculum integrated into residency clinic assignments with dedicated QI work sessions and brief just-in-time didactics with mentorship from faculty coaches. Residents completed at least two PDSA (Plan-Do-Study-Act) cycles for their projects. The experience included clear expectations and tools for accountability. Project criteria included importance to patients, residents, and the institution. Residents had access to data related to their own practice. A pre-post survey asked residents to self-assess their level of interest and engagement in QI on a 5-point Likert scale, with 1 = least desired and 5 = most desired result. Data were analyzed by paired t-test.

RESULTS

All 62 residents participated in the program as members of ten QI teams. 40/62 residents completed both pre- and post-surveys. Items related to self-assessment of QI in clinical work all changed in the desired direction: likelihood of participation (3.7 to 4.1, p = 0.03), frequency of QI use (3.3 to 3.9, p = 0.001), and opinion about using QI in clinical work (3.9 to 4.0, p = 0.21). Resident assessment of QI priority in clinical work did not change.

CONCLUSIONS

We implemented a practical strategies bundle to overcome common challenges to successfully engaging residents in clinical quality improvement. These strategies included QI work integrated into routine clinical assignments, just-in-time didactics, experiential learning with clear expectations and strategic project selection, timely and pertinent data from the residents' own practice, and real-time faculty coaching.

Theory in quality improvement and patient safety education: A scoping review

INTRODUCTION

Theory plays an important role in education programming and research. However, its use in quality improvement and patient safety education has yet to be fully characterized. The authors undertook a scoping review to examine the use of theory in quality improvement and patient safety education.

METHODS

Eligible articles used theory to inform the design or study of a quality improvement or patient safety curriculum. The authors followed scoping review methodology and searched articles referenced in 20 systematic reviews of quality improvement and patient safety education, or articles citing one of these reviews, and hand searched eligible article references. Data analysis involved descriptive and interpretive summaries of theories used and the perspectives the theories offered.

RESULTS

Eligibility criteria were met by 28 articles, and 102 articles made superficial mention of theory. Eligible articles varied in professional group, learning stage and journal type. Theories fell into two broad categories: learning theories (n = 20) and social science theories (n = 11). Theory was used in the design (n = 12) or study (n = 17) of quality improvement and patient safety education. The range of theories shows the opportunity afforded by using more than one type of theory.

DISCUSSION

Theory can guide decisions regarding quality improvement and patient safety education practices or play a role in selecting a methodology or lens through which to study educational processes and outcomes. Educators and researchers should make deliberate choices around the use of theory that relates to aspects of an educational program that they seek to illuminate.

A Tale of Four Programs: How Residents Learn About Quality Improvement during Postgraduate Medical Education at the University of Calgary

Phenomenon: Quality Improvement (QI) has become increasingly incorporated into competency frameworks for physician learners over the past two decades. As contemporary medical education adapts competency-based models of training, learners will be required to demonstrate competency in QI. There is a need to explore how various residency programs are currently teaching QI, including how residents might participate in experiential QI activities, and the various outcomes of these strategies. Approach: A collective case study examined how residents in four postgraduate programs at a single academic institution have learned about QI since the formal integration of QI as a cross-cutting competency. Data from surveys, interviews, observations, and archival records were collected in order to develop a comprehensive understanding of each case in its real-life context and explore current and historical trends and patterns within and across the four programs. Findings: Teaching and resident involvement in QI projects increased across all four programs since its formal integration into the national physician competency framework. Two programs had a longitudinal, hybrid QI curriculum involving didactic and experiential components. Two programs had didactic-alone QI curricula, with minimal resident engagement in applied QI activities. Between-program differences were quantified with regards to learning climate, safety climate, QI knowledge, skills, and attitudes, attitudes toward research during residency, and quality of mentorship for scholarly activities. Residents in programs with experiential learning reported higher knowledge, skills, and attitudes toward QI were motivated to lead improvement efforts in their future practice. Residents in programs with didactic-only QI teaching perceived that the historical operationalization of the scholarly project as research was a barrier to their involvement in QI, as it was not valued or legitimized in their academic and clinical contexts. Common barriers and facilitators to engagement with QI across all programs included time, mentorship, motivation, and competing demands such as feeling pressure to conduct research in order to obtain competitive fellowship positions or employment. Common across all programs was the perception of the residency scholarly project requirement as a "checkbox." Associations were quantified between the constructs of learning climate with safety culture, and safety culture with QI knowledge, skills, and attitudes. Insights: While hybrid QI curricula with experiential learning remains an effective curriculum strategy, tensions between research and QI may be a critical barrier to learner engagement in experiential activities. In addition to providing learners with support, time, mentorship, and explicitly communicating the value QI by the program, the local safety culture may impact QI learning beyond the core curriculum. Reconceptualization of the scholarly project requirements to normalize QI activities and recognizing the potential influence of the local organizational culture on QI learning and how trainees can positively or negatively shape these cultures warrants consideration.

Experiential QI Activity for Residents to Improve Women's Preventive Services

INTRODUCTION

The Accreditation Council for Graduate Medical Education (ACGME) requires family medicine residents to complete a quality improvement (QI) project. There is a need for more QI training activities to be shared to meet this requirement. Our objective was to describe an activity for residents to improve women's preventive health services in an underserved clinic. Specific aims were to determine: (1) how women's receipt of preventive services compared to benchmarks, (2) physician and staff knowledge of the process and barriers to receiving services, and (3) whether an intervention to increase awareness among physicians and staff improved preventive services.

METHODS

Residents (N=30) evaluated charts (N=505) to determine receipt of mammograms, pap tests, colon cancer screenings, and pneumonia vaccines. We compared estimates to existing clinic benchmarks. We presented initial (preintervention) results to physicians and staff at clinic team meetings. We collected perceptions of processes and barriers to preventive services. Preintervention methods were replicated (N=100) and results were compared (postintervention).

RESULTS

Preintervention, mammograms (72%) and Pap tests (65%) were lower than clinic benchmarks. Most (81%) women ages 65 and older received a pneumonia vaccine; however, this was lower than the national Healthy People 2020 goal. Fear, knowledge, and scheduling were identified as top barriers. Post-intervention, there was a statistically significant increase in Pap tests (P=.0013).

CONCLUSION

This activity trained residents how to impact their practice through QI methods and can be used in other programs as a foundation for developing basic QI initiatives. Future efforts should focus on evaluating barriers to preventive services from the patient perspective.

Interprofessional and multiprofessional approaches in quality improvement education

The imperative for all healthcare professionals to partake in quality improvement (QI) has resulted in the development of QI education programs with participants from different professional backgrounds. However, there is limited empirical and theoretical examination as to why, when and how interprofessional and multiprofessional education occurs in QI and the outcomes of these approaches. This paper reports on a qualitative collective case study of interprofessional and multiprofessional education in three longitudinal QI education programs. We conducted 58 interviews with learners, QI project coaches, program directors and institutional leads and 135 h of observations of in-class education sessions, and collected relevant documents such as course syllabi and handouts. We used an interpretive thematic analysis using a conventional and directed content analysis approach. In the directed content approach, we used sociology of professions theory with particular attention to professional socialization, hierarchies and boundaries in QI, to understand the ways in which individuals' professional backgrounds informed the planning and experiences of the QI education programs. Findings demonstrated that both interprofessional and multiprofessional education approaches were being used to achieve different education objectives. While each approach demonstrated positive learning and practice outcomes, tensions related to the different ways in which professional groups are engaging in QI, power dynamics between professional groups, and disconnects between curricula and practice existed. Further conceptual clarity is essential for a more informed discussion about interprofessional and multiprofessional education approaches in QI and explicit attention is needed to professional processes and tensions, to optimize the impact of education on practice.

A realist synthesis of quality improvement curricula in undergraduate and postgraduate medical education: what works, for whom, and in what contexts?

BACKGROUND

With the integration of quality improvement (QI) into competency-based models of physician training, there is an increasing requirement for medical students and residents to demonstrate competence in QI. There may be factors that commonly facilitate or inhibit the desired outcomes of QI curricula in undergraduate and postgraduate medical education. The purpose of this review was to synthesise attributes of QI curricula in undergraduate and postgraduate medical education associated with curricular outcomes.

METHODS

A realist synthesis of peer-reviewed and grey literature was conducted to identify the common contexts, mechanisms, and outcomes of QI curricula in undergraduate and postgraduate medical education in order to develop a programme theory to articulate what works, for whom, and in what contexts.

RESULTS

18854 records underwent title and abstract screening, full texts of 609 records were appraised for eligibility, data were extracted from 358 studies, and 218 studies were included in the development and refinement of the final programme theory. Contexts included curricular strategies, levels of training, clinical settings, and organisational culture. Mechanisms were identified within the overall QI curricula itself (eg, clear expectations and deliverables, and protected time), in the didactic components (ie, content delivery strategies), and within the experiential components (eg, topic selection strategies, working with others, and mentorship). Mechanisms were often associated with certain contexts to promote educational and clinical outcomes.

CONCLUSION

This research describes the various pedagogical strategies for teaching QI to medical learners and highlights the contexts and mechanisms that could potentially account for differences in educational and clinical outcomes of QI curricula. Educators may benefit from considering these contexts and mechanisms in the design and implementation of QI curricula to optimise the outcomes of training in this competency area.