A multidisciplinary approach for teaching systems-based practice to internal medicine residents

Using an eLearning Module to Facilitate Sepsis Knowledge Acquisition Across Multiple Institutions and Learner Disciplines

OBJECTIVE

Guidelines exist for care of pediatric sepsis, but no study has assessed the benefit of electronic learning (eLearning) in this topic area. The objective of this multicenter study was to assess knowledge acquisition and retention for pediatric sepsis across multiple health care provider roles, using an adaptive and interactive eLearning module.

METHODS

The study used pretest, posttest, and 90-day delayed test scores to evaluate provider knowledge after an adaptive and interactive eLearning module intervention. The eLearning module contained conditional logic-based assessments that allowed real-time adjustments of the displayed content according to each participant's demonstrated knowledge. Physicians, nurses, and advanced practice providers, primarily emergency department based, at 9 pediatric institutions were included. Changes in test scores were stratified by provider role.

RESULTS

A total of 574 participants completed the posttest, and 296 (51.6%) of those completed the delayed test. Across all providers, there was an increase in test scores of 15.7% between the pretest and posttest (P < 0.001) with a large effect size as measured by Cramer's V. Across all providers, there was an overall test score increase of 5.2% (P < 0.001) between the pretest and delayed test, with a small effect size.

CONCLUSIONS

An eLearning module improved immediate and delayed pediatric sepsis knowledge in pediatric health care providers across multiple institutions and provider roles. Immediate knowledge gain was meaningful as indicated by effect sizes, although by the time of the delayed test, the effect was smaller. This module fills an important gap in currently available pediatric sepsis education.

A realist synthesis of quality improvement curricula in undergraduate and postgraduate medical education: what works, for whom, and in what contexts?

BACKGROUND

With the integration of quality improvement (QI) into competency-based models of physician training, there is an increasing requirement for medical students and residents to demonstrate competence in QI. There may be factors that commonly facilitate or inhibit the desired outcomes of QI curricula in undergraduate and postgraduate medical education. The purpose of this review was to synthesise attributes of QI curricula in undergraduate and postgraduate medical education associated with curricular outcomes.

METHODS

A realist synthesis of peer-reviewed and grey literature was conducted to identify the common contexts, mechanisms, and outcomes of QI curricula in undergraduate and postgraduate medical education in order to develop a programme theory to articulate what works, for whom, and in what contexts.

RESULTS

18854 records underwent title and abstract screening, full texts of 609 records were appraised for eligibility, data were extracted from 358 studies, and 218 studies were included in the development and refinement of the final programme theory. Contexts included curricular strategies, levels of training, clinical settings, and organisational culture. Mechanisms were identified within the overall QI curricula itself (eg, clear expectations and deliverables, and protected time), in the didactic components (ie, content delivery strategies), and within the experiential components (eg, topic selection strategies, working with others, and mentorship). Mechanisms were often associated with certain contexts to promote educational and clinical outcomes.

CONCLUSION

This research describes the various pedagogical strategies for teaching QI to medical learners and highlights the contexts and mechanisms that could potentially account for differences in educational and clinical outcomes of QI curricula. Educators may benefit from considering these contexts and mechanisms in the design and implementation of QI curricula to optimise the outcomes of training in this competency area.

The Action Research Program: Experiential Learning in Systems-Based Practice for First-Year Medical Students

PROBLEM

Systems-based practice focuses on the organization, financing, and delivery of medical services. The American Association of Medical Colleges has recommended that systems-based practice be incorporated into medical schools' curricula. However, experiential learning in systems-based practice, including practical strategies to improve the quality and efficiency of clinical care, is often absent from or inconsistently included in medical education.

INTERVENTION

A multidisciplinary clinician and nonclinician faculty team partnered with a cardiology outpatient clinic to design a 9-month clerkship for 1st-year medical students focused on systems-based practice, delivery of clinical care, and strategies to improve the quality and efficiency of clinical operations. The clerkship was called the Action Research Program. In 2013-2014, 8 trainees participated in educational seminars, research activities, and 9-week clinic rotations. A qualitative process and outcome evaluation drew on interviews with students, clinic staff, and supervising physicians, as well as students' detailed field notes.

CONTEXT

The Action Research Program was developed and implemented at the University of California, San Francisco, an academic medical center in the United States. All educational activities took place at the university's medical school and at the medical center's cardiology outpatient clinic.

OUTCOME

Students reported and demonstrated increased understanding of how care delivery systems work, improved clinical skills, growing confidence in interactions with patients, and appreciation for patients' experiences. Clinicians reported increased efficiency at the clinic level and improved performance and job satisfaction among medical assistants as a result of their unprecedented mentoring role with students. Some clinicians felt burdened when students shadowed them and asked questions during interactions with patients. Most student-led improvement projects were not fully implemented.

LESSONS LEARNED

The Action Research Program is a small pilot project that demonstrates an innovative pairing of experiential and didactic training in systems-based practice. Lessons learned include the need for dedicated time and faculty support for students' improvement projects, which were the least successful aspect of the program. We recommend that future projects aiming to combine clinical training and quality improvement projects designate distinct blocks of time for trainees to pursue each of these activities independently. In 2014-2015, the University of California, San Francisco School of Medicine incorporated key features of the Action Research Program into the standard curriculum, with plans to build upon this foundation in future curricular innovations.

How we used a patient visit tracker tool to advance experiential learning in systems-based practice and quality improvement in a medical student clinic

Poorly designed healthcare systems increase costs and preventable medical errors. To address these issues, systems-based practice (SBP) education provides future physicians with the tools to identify systemic errors and implement quality improvement (QI) initiatives to enhance the delivery of cost-effective, safe and multi-disciplinary care. Although SBP education is being implemented in residency programs and is mandated by the Accreditation Council for Graduate Medical Education (ACGME) as one of its core competencies, it has largely not been integrated into undergraduate medical education. We propose that Medical Student-Faculty Collaborative Clinics (MSFCCs) may be the ideal environment in which to train medical students in SBPs and QI initiatives, as they allow students to play pivotal roles in project development, administration, and management. Here we describe a process of experiential learning that was developed within a newly established MSFCC, which challenged students to identify inefficiencies, implement interventions, and track the results. After identifying bottlenecks in clinic operations, our students designed a patient visit tracker tool to monitor clinic flow and implemented solutions to decrease patient visit times. Our model allowed students to drive their own active learning in a practical clinical setting, providing early and unique training in crucial QI skills.

Residents' Perspectives on Patient Safety in University and Community Teaching Hospitals

BACKGROUND

Patient safety is an important concept in resident education. To date, few studies have assessed resident perceptions of patient safety across different specialties.

OBJECTIVE

The study explored residents' views on patient safety across the specialties of internal medicine, general surgery, and diagnostic radiology, focusing on common themes and differences.

METHODS

In fall 2012, interviews of small groups of senior residents in internal medicine, general surgery, and diagnostic radiology were conducted at 3 academic medical centers and 3 community teaching hospitals in 3 major US metropolitan areas. In total, 33 residents were interviewed. Interviews used interactive discussion to explore multiple facets of patient safety.

RESULTS

Residents identified lack of information, common errors, volume and acuity of patients, and inadequate supervision as major risks to patient safety. Specific threats to patient safety included communication problems, transitions of care, information technology interface issues, time constraints, and work flow. Residents disclosed that reporting safety issues was viewed as burdensome and carrying some degree of risk. There was variability as to whether residents would report safety threats they encountered.

CONCLUSIONS

Residents are aware of threats to patient safety and have a unique perspective compared with other health care professionals. Transitions of care and communication problems were the most common safety threats identified by the residents interviewed.

Where do we go from here? Moving from systems-based practice process measures to true competency via developmental milestones

For many educators it has been challenging to meet the Accreditation Council for Graduate Medical Education's requirements for teaching systems-based practice (SBP). An additional layer of complexity for educators is evaluating competency in SBP, despite milestones and entrustable professional activities (EPAs). In order to address this challenge, the authors present the results of a literature review for how SBP is currently being taught and a series of recommendations on how to achieve competency in SBP for graduate medical trainees with the use of milestones. The literature review included 29 articles and demonstrated that only 28% of the articles taught more than one of the six core principles of SBP in a meaningful way. Only 7% of the articles received the highest grade of A. The authors summarize four guiding principles for creating a competency-based curriculum that is in alignment with the Next Accreditation System (NAS): 1) the curriculum needs to include all of the core principles in that competency, 2) the objectives of the curriculum should be driven by clinical outcomes, 3) the teaching modalities need to be interactive and clinically relevant, and 4) the evaluation process should be able to measure competency and be directly reflective of pertinent milestones and/or EPAs. This literature review and the provided guiding principles can guide other residency educators in their development of competency-based curricula that meets the standards of the NAS.

Perspectives on the changing healthcare system: teaching systems-based practice to medical residents

PURPOSE

The Accreditation Council for Graduate Medical Education restructured its accreditation system to be based on educational outcomes in six core competencies. Systems-based practice is one of the six core competencies. The purpose of this report is to describe Weill Cornell Medical College's Internal Medicine Residency program curriculum for systems-based practice (SBP) and its evaluation process.

METHODS

To examine potential outcomes of the POCHS curriculum, an evaluation was conducted, examining participants': (1) knowledge gain; (2) course ratings; and (3) qualitative feedback.

RESULTS

On average, there was a 19 percentage point increase in knowledge test scores for all three cohorts. The course was rated overall highly, receiving an average of 4.6 on a 1-5 scale. Lastly, the qualitative comments supported that the material is needed and valued.

CONCLUSION

The course, entitled Perspectives on the Changing Healthcare System (POCHS) and its evaluation process support that systems-based practice is crucial to residency education. The course is designed not only to educate residents about the current health care system but also to enable them to think critically about the risk and benefits of the changes. POCHS provides a framework for teaching and assessing this competency and can serve as a template for other residency programs looking to create or restructure their SBP curriculum.

A longitudinal, experiential quality improvement curriculum meeting ACGME competencies for geriatrics fellows: lessons learned

Quality improvement (QI) initiatives are critical in the care of older adults who are more vulnerable to substandard care. QI education meets aspects of core Accreditation Council of Graduate Medical Education competencies and prepares learners for the rising focus on performance measurement in health care. The authors developed, implemented, and evaluated a QI curriculum for geriatrics fellows. The evidence-based curriculum included didactics and a fellow-led QI intervention based on audit and feedback through the Practice Improvement Module in Care of the Vulnerable Elderly. QI knowledge, attitudes, and behaviors were assessed before and after the improvement project. Fellows' knowledge of QI improved (p = .0156), but behavior did not change significantly across a short-term improvement project. A structured focus group with fellows revealed themes of accountability and the importance of interprofessional teamwork in QI. QI education for geriatrics fellows can be feasible, well received, and prepare future physician leaders for patient-centered care, performance measurement, and effecting systems change.

Tracking outpatient continuity and chronic disease indicators-a novel use of the new innovations clinic module

The Accreditation Council for Graduate Medical Education common program requirements for Practice-based Learning and Improvement in Internal Medicine specify that trainees must "systematically analyze [his/her] practice using quality improvement methods, and implement changes with the goal of practice improvement" and that the training program "must include use of performance data" in the assessment of the resident's practice. Before implementation of an electronic health record at our academic medical center, we found meeting these requirements to be challenging. This prompted us to set up the New Innovations (New Innovations, Inc, Uniontown, OH) Software Suite's Patient Continuity module to permit analysis and tracking of both quality of care indicators and patient continuity. By using the system, our residents were better able to monitor their patient panel sizes and composition and to correlate their practices with quality of care data. Residency programs, which currently utilize New Innovations software but lack an electronic health record, may find the continuity clinic module useful for engaging their house staff in structured practice improvement initiatives and in satisfying the Accreditation Council for Graduate Medical Education's common program requirements for practice-based learning.