Performance improvement: getting an early start

Implementation and Evaluation of Quality Improvement Training in Surgery: A Systematic Review

OBJECTIVE

The aim of this study was to review and appraise how quality improvement (QI) skills are taught to surgeons and surgical residents.

BACKGROUND

There is a global drive to deliver capacity in undertaking QI within surgical services. However, there are currently no specifications regarding optimal QI content or delivery.

METHODS

We reviewed QI educational intervention studies targeting surgeons or surgical trainees/residents published until 2017. Primary outcomes included teaching methods and training materials. Secondary outcomes were implementation frameworks and strategies used to deliver QI training successfully.

RESULTS

There were 20,590 hits across 10 databases, of which 11,563 were screened following de-duplication. Seventeen studies were included in the final synthesis. Variable QI techniques (eg, combined QI models, process mapping, and "lean" principles) and assessment methods were found. Delivery was more consistent, typically combining didactic teaching blended with QI project delivery. Implementation of QI training was poorly reported and appears supported by collaborative approaches (including building learning collaboratives, and coalitions). Study designs were typically pre-/post-training without controls. Studies generally lacked clarity on the underpinning framework (59%), setting description (59%), content (47%), and conclusions (47%), whereas 88% scored low on psychometrics reporting.

CONCLUSIONS

The evidence suggests that surgical QI training can focus on any well-established QI technique, provided it is done through a combination of didactic teaching and practical application. True effectiveness and extent of impact of QI training remain unclear, due to methodological weaknesses and inconsistent reporting. Conduct of larger-scale educational QI studies across multiple institutions can advance the field.

A realist synthesis of quality improvement curricula in undergraduate and postgraduate medical education: what works, for whom, and in what contexts?

BACKGROUND

With the integration of quality improvement (QI) into competency-based models of physician training, there is an increasing requirement for medical students and residents to demonstrate competence in QI. There may be factors that commonly facilitate or inhibit the desired outcomes of QI curricula in undergraduate and postgraduate medical education. The purpose of this review was to synthesise attributes of QI curricula in undergraduate and postgraduate medical education associated with curricular outcomes.

METHODS

A realist synthesis of peer-reviewed and grey literature was conducted to identify the common contexts, mechanisms, and outcomes of QI curricula in undergraduate and postgraduate medical education in order to develop a programme theory to articulate what works, for whom, and in what contexts.

RESULTS

18854 records underwent title and abstract screening, full texts of 609 records were appraised for eligibility, data were extracted from 358 studies, and 218 studies were included in the development and refinement of the final programme theory. Contexts included curricular strategies, levels of training, clinical settings, and organisational culture. Mechanisms were identified within the overall QI curricula itself (eg, clear expectations and deliverables, and protected time), in the didactic components (ie, content delivery strategies), and within the experiential components (eg, topic selection strategies, working with others, and mentorship). Mechanisms were often associated with certain contexts to promote educational and clinical outcomes.

CONCLUSION

This research describes the various pedagogical strategies for teaching QI to medical learners and highlights the contexts and mechanisms that could potentially account for differences in educational and clinical outcomes of QI curricula. Educators may benefit from considering these contexts and mechanisms in the design and implementation of QI curricula to optimise the outcomes of training in this competency area.

The business of educating the next generation of surgeons

Surgical education community needs to be informed about how education is funded and how it is threatened. In order to explore these issues the Association of Surgical Education convened a panel with significant experience in managing surgery departments to discuss the business of surgical education. They specifically addressed methods to recognize and reward faculty, educate residents on safety, quality and cost, and increase departmental revenue. This information is important in the current educational environment where there is an increased need for institutions to find alternate revenue streams to sustain graduate medical education. It is also important to find additional revenue streams to fund new residency slots to accommodate the greater number medical students who have been admitted to medical schools in response to meet the projected shortage of physicians.

Using a Root Cause Analysis Curriculum for Practice-Based Learning and Improvement in General Surgery Residency

OBJECTIVE

To describe and evaluate a root cause analysis (RCA)-based educational curriculum for quality improvement (QI) practice-based learning and implementation in general surgery residency.

DESIGN

A QI curriculum was designed using RCA and spaced-learning approaches to education. The program included a didactic session about the RCA methodology. Resident teams comprising multiple postgraduate years then selected a personal complication, completed an RCA, and presented the findings to the Department of Surgery. Mixed methods consisting of quantitative assessment of performance and qualitative feedback about the program were used to assess the value, strengths, and limitations of the program.

SETTING

Urban tertiary academic medical center.

PARTICIPANTS

General surgery residents, faculty, and medical students.

RESULTS

An RCA was completed by 4 resident teams for the following 4 adverse outcomes: postoperative neck hematoma, suboptimal massive transfusion for trauma, venous thromboembolism, and decubitus ulcer complications. Quantitative peer assessment of their performance revealed proficiency in selecting an appropriate case, defining the central problem, identifying root causes, and proposing solutions. During the qualitative feedback assessment, residents noted value of the course, with the greatest limitation being time constraints and equal participation.

CONCLUSION

An RCA-based curriculum can provide general surgery residents with QI exposure and training that they value. Barriers to successful implementation include time restrictions and equal participation from all involved members.

Embedding Quality and Safety in Otolaryngology–Head and Neck Surgery Education

Education in patient safety (PS) and quality improvement (QI) helps both medical students and residents understand the health care environment in the United States, where these concepts are now incorporated into virtually every aspect of patient care. The Accreditation Council of Graduate Medical Education has made PS/QI a mandatory component of resident education, and a number of specialties have published their experiences with incorporating PS/QI into their training programs. In otolaryngology–head and neck surgery, a strong curriculum can be built by teaching residents about the principles of PS/QI through both didactic and experiential learning, and morbidity and mortality and QI conferences can serve as the cornerstone of this curriculum. Understanding the potential challenges in PS/QI education can allow training programs to plan their strategy effectively for successful incorporation into their existing curricula.

The unmet need for a national surgical quality improvement curriculum: a systematic review

INTRODUCTION

The Accreditation Council for Graduate Medical Education Next Accreditation System will require general surgery training programs to demonstrate outstanding clinical outcomes and education in quality improvement (QI). The American College of Surgeons-National Surgical Quality Improvement Project Quality In-Training Initiative reports the results of a systematic review of the literature investigating the availability of a QI curriculum.

METHODS

Using defined search terms, a systematic review was conducted in Embase, PubMed, and Google Scholar (January 2000-March 2013) to identify a surgical QI curriculum. Bibliographies from selected articles and other relevant materials were also hand searched. Curriculum was defined as an organized program of learning complete with content, instruction, and assessment for use in general surgical residency programs. Two independent observers graded surgical articles on quality of curriculum presented.

RESULTS

Overall, 50 of 1155 references had information regarding QI in graduate medical education. Most (n = 24, 48%) described QI education efforts in nonsurgical fields. A total of 31 curricular blueprints were identified; 6 (19.4%) were specific to surgery. Targeted learners were most often post graduate year-2 residents (29.0%); only 6 curricula (19.4%) outlined a course for all residents within their respective programs. Plan, Do, Study, Act (n = 10, 32.3%), and Root Cause Analysis (n = 5, 16.1%) were the most common QI content presented, the majority of instruction was via lecture/didactics (n = 26, 83.9%), and only 7 (22.6%) curricula used validated tool kits for assessment.

CONCLUSION

Elements of QI curriculum for surgical education exist; however, comprehensive content is lacking. The American College of Surgeons-National Surgical Quality Improvement Project Quality In-Training Initiative will build on the high-quality components identified in our review and develop data-centered QI content to generate a comprehensive national QI curriculum for use in graduate surgical education.

A strategic approach to quality improvement and patient safety education and resident integration in a general surgery residency

OBJECTIVE

To outline a structured approach for general surgery resident integration into institutional quality improvement and patient safety education and development.

DESIGN

A strategic plan to address Accreditation Council for Graduate Medical Education (ACGME) Clinical Learning Environment Review assessments for resident integration into Quality Improvement and Patient Safety initiatives is described.

SETTING

Gundersen Lutheran Medical Foundation is an independent academic medical center graduating three categorical residents per year within an integrated multi-specialty health system serving 19 counties over 3 states.

RESULTS

The quality improvement and patient safety education program includes a formal lecture series, online didactic sessions, mandatory quality improvement or patient safety projects, institutional committee membership, an opportunity to serve as a designated American College of Surgeons National Surgical Quality Improvement Project and Quality in Training representative, mandatory morbidity and mortality conference attendance and clinical electives in rural surgery and international settings.

CONCLUSIONS

Structured education regarding and participation in quality improvement and patient safety programs are able to be accomplished during general surgery residency. The long-term outcomes and benefits of these strategies are unknown at this time and will be difficult to measure with objective data.