Pediatrics Residents' Confidence and Performance Following a Longitudinal Quality Improvement Curriculum

Implementation of the WHO Standards to assess the quality of paediatric care using health workers as source of data: findings of a multicentre study (CHOICE) in Italy

OBJECTIVES

There is little experience in implementing the WHO Standards for improving the quality of care (QOC) for children. We describe the use of 75 WHO-Standard based Quality Measures to assess paediatric QOC, using health workers (HWs) as data sources.

DESIGN

Cross-sectional study.

SETTING

12 Italian hospitals.

PARTICIPANTS

The minimum target of 75% of HWs was reached in all facilities; answers from 598 HWs were analysed.

PRIMARY AND SECONDARY OUTCOME MEASURES

75 prioritised WHO Quality Measures were collected using a validated, and Italian-language questionnaire exploring views of HWs providing care to children. A QOC index was also calculated based on the assessed Quality Measures.

RESULTS

In both the domain of resources and work organisation, most Quality Measures showed a high overall frequency of reported 'need for improvement', with high variability across hospitals. Key needs for improvement included: availability of clear and complete protocols (eg, on paediatric emergencies: 44.6%; range 10.6%-92.6%); clear hospitalisation criteria for diarrhoea (50.5%; range 30.3%-71.7%); number of hand-washing stations (13.2%; range 3.4%-37.0%); equipped working rooms with computers for HWs (66.1%; range: 32.1%-97.0%); training (eg, on pain management: 43.5%; range 17.9%-76.7%), periodic discussion of clinical cases (43.5%; range 8.1%-83.7%) audits (48.8%; range 29.7%-76.7%); and all indicators related to system to improve QOC. Factors significantly associated with a lower QOC Index included HWs working in facilities in Southern Italy (p=0.001) and absence of a paediatric emergency department (p=0.011).

CONCLUSIONS

The use of the 75 prioritised Quality Measures, specific to HWs provide valuable data on paediatric QOC, which can be used to drive a quality improvement process.

Practical strategies to enhance resident engagement in clinical quality improvement

BACKGROUND

Engaging residents in meaningful quality improvement (QI) is difficult. Challenges include competing demands, didactics which lack connection to meaningful work, suboptimal experiential learning, unclear accountability, absence of timely and relevant data, and lack of faculty coaches and role models. Various strategies to address these challenges for engagement have been described, but not as a unified approach. This paper describes a bundle of practical strategies to address common challenges to resident engagement in QI, illustrated through the experience of one residency education program.

METHODS

62 categorical residents in the University of Missouri Internal Medicine residency participated in a longitudinal QI curriculum integrated into residency clinic assignments with dedicated QI work sessions and brief just-in-time didactics with mentorship from faculty coaches. Residents completed at least two PDSA (Plan-Do-Study-Act) cycles for their projects. The experience included clear expectations and tools for accountability. Project criteria included importance to patients, residents, and the institution. Residents had access to data related to their own practice. A pre-post survey asked residents to self-assess their level of interest and engagement in QI on a 5-point Likert scale, with 1 = least desired and 5 = most desired result. Data were analyzed by paired t-test.

RESULTS

All 62 residents participated in the program as members of ten QI teams. 40/62 residents completed both pre- and post-surveys. Items related to self-assessment of QI in clinical work all changed in the desired direction: likelihood of participation (3.7 to 4.1, p = 0.03), frequency of QI use (3.3 to 3.9, p = 0.001), and opinion about using QI in clinical work (3.9 to 4.0, p = 0.21). Resident assessment of QI priority in clinical work did not change.

CONCLUSIONS

We implemented a practical strategies bundle to overcome common challenges to successfully engaging residents in clinical quality improvement. These strategies included QI work integrated into routine clinical assignments, just-in-time didactics, experiential learning with clear expectations and strategic project selection, timely and pertinent data from the residents' own practice, and real-time faculty coaching.

Implementation and Evaluation of Quality Improvement Training in Surgery: A Systematic Review

OBJECTIVE

The aim of this study was to review and appraise how quality improvement (QI) skills are taught to surgeons and surgical residents.

BACKGROUND

There is a global drive to deliver capacity in undertaking QI within surgical services. However, there are currently no specifications regarding optimal QI content or delivery.

METHODS

We reviewed QI educational intervention studies targeting surgeons or surgical trainees/residents published until 2017. Primary outcomes included teaching methods and training materials. Secondary outcomes were implementation frameworks and strategies used to deliver QI training successfully.

RESULTS

There were 20,590 hits across 10 databases, of which 11,563 were screened following de-duplication. Seventeen studies were included in the final synthesis. Variable QI techniques (eg, combined QI models, process mapping, and "lean" principles) and assessment methods were found. Delivery was more consistent, typically combining didactic teaching blended with QI project delivery. Implementation of QI training was poorly reported and appears supported by collaborative approaches (including building learning collaboratives, and coalitions). Study designs were typically pre-/post-training without controls. Studies generally lacked clarity on the underpinning framework (59%), setting description (59%), content (47%), and conclusions (47%), whereas 88% scored low on psychometrics reporting.

CONCLUSIONS

The evidence suggests that surgical QI training can focus on any well-established QI technique, provided it is done through a combination of didactic teaching and practical application. True effectiveness and extent of impact of QI training remain unclear, due to methodological weaknesses and inconsistent reporting. Conduct of larger-scale educational QI studies across multiple institutions can advance the field.

Quality Improvement and Patient Safety Education in Internal Medicine Residency Training Program: An Exploratory Qualitative Study

BACKGROUND

Quality improvement and patient safety (QIPS) are a global health priority. Accordingly, QIPS education in medical education became mandatory. Despite that, information about QIPS education in postgraduate training in Saudi Arabia is limited. This study aimed to explore the educational aspects of QIPS in the internal medicine residency training program at King Abdulaziz Hospital in Al Ahsa, Saudi Arabia.

METHODS

This was a qualitative study employing the constructivist grounded theory approach. The sample size was determined using the theoretical saturation point, and we utilized a purposeful sampling technique. A semi-structured interview was used for data collection and was conducted between September 6 and October 20, 2020.

RESULTS

Twenty-two internal medicine trainee residents were required to serve the study purpose. The emerged themes were organized under awareness, education, barriers and opportunities and improvement priorities. Awareness of participants about the QIPS concept, importance, and value of education was found. The participants did not recognize specific dedicated QIPS education components under the structured training program. However, they recognized participation in patient safety-oriented activities but not in quality improvement activities. Consultants' observations and written exams were perceived as the assessment tools. Barriers including time limitation and opportunities including participation in quality improvement projects were identified. Participants suggested making QIPS education mandatory under the training program as an improvement priority.

CONCLUSION

This study highlighted the awareness of internal medicine residents of the QIPS concept, importance, and value of QIPS education. However, we found crucial gaps related to education including lack of a dedicated QIPS component under the training program. There is a need for multicenter studies to measure the magnitude of our findings for improvement of QIPS education in residency training in Saudi Arabia. This is the first study about QIPS education in residency training in Saudi Arabia up to our best knowledge.

Physical Medicine and Rehabilitation Residency Quality Improvement and Research Curriculum: Design and Implementation

ABSTRACT

Physical medicine and rehabilitation residency programs do not demonstrate a uniform level of training and mentorship for resident scholarly activities related in part to variable utilization of standardized curricula. The aim of this study was to design, develop, implement, and evaluate a structured Quality Improvement and Research Curriculum for a physical medicine and rehabilitation residency program in academic year 2015 using standardized methodology. A combination of five-phase project-lifecycle and six-step medical-curriculum development methodologies was used to integrate existing resources into five institutional domains: (1) Patient Safety and Quality Improvement Program; (2) Research Mentorship Program; (3) Rehab in Review; (4) Publication and Presentation Resources, and (5) Research and QI Lecture Series. Dedicated resident-faculty teams were created for individual domains and for the overall curriculum. Written materials developed included scope documents, reporting forms, and tracking tables. A dedicated webpage on the department website served as an accessible resource. A bimonthly Updates newsletter highlighted ongoing resident achievements. Program and resident outcome metrics were evaluated at the mid and end of academic year 2015. Excellent resident and good faculty participation in the curriculum was observed. Resident publication and presentation productivity improved. Time was the biggest barrier to success. Key factors for success included phased implementation, dedicated teams, scope clarity, accessible resources, personnel support, resident champions, and faculty mentorship.

A realist synthesis of quality improvement curricula in undergraduate and postgraduate medical education: what works, for whom, and in what contexts?

BACKGROUND

With the integration of quality improvement (QI) into competency-based models of physician training, there is an increasing requirement for medical students and residents to demonstrate competence in QI. There may be factors that commonly facilitate or inhibit the desired outcomes of QI curricula in undergraduate and postgraduate medical education. The purpose of this review was to synthesise attributes of QI curricula in undergraduate and postgraduate medical education associated with curricular outcomes.

METHODS

A realist synthesis of peer-reviewed and grey literature was conducted to identify the common contexts, mechanisms, and outcomes of QI curricula in undergraduate and postgraduate medical education in order to develop a programme theory to articulate what works, for whom, and in what contexts.

RESULTS

18854 records underwent title and abstract screening, full texts of 609 records were appraised for eligibility, data were extracted from 358 studies, and 218 studies were included in the development and refinement of the final programme theory. Contexts included curricular strategies, levels of training, clinical settings, and organisational culture. Mechanisms were identified within the overall QI curricula itself (eg, clear expectations and deliverables, and protected time), in the didactic components (ie, content delivery strategies), and within the experiential components (eg, topic selection strategies, working with others, and mentorship). Mechanisms were often associated with certain contexts to promote educational and clinical outcomes.

CONCLUSION

This research describes the various pedagogical strategies for teaching QI to medical learners and highlights the contexts and mechanisms that could potentially account for differences in educational and clinical outcomes of QI curricula. Educators may benefit from considering these contexts and mechanisms in the design and implementation of QI curricula to optimise the outcomes of training in this competency area.

Advancing Advocacy: Implementation of a Child Health Advocacy Curriculum in a Pediatrics Residency Program

INTRODUCTION

ACGME program requirements for graduate medical education state that pediatric residency programs should include elements of child advocacy education. Finding readily available, easily implementable advocacy curricula for pediatric residency programs is challenging. We conducted a generalized curricular needs assessment via literature review and a targeted needs assessment with health care providers and advocacy leaders and developed and implemented a child health advocacy curriculum in a pediatrics residency program.

METHODS

Delivered across 9 months, the curriculum included three components: electronic resources, didactic sessions, and interactive workshops aimed at developing advocacy skills in the context of pressing child health issues. The learner audience was PGY 1 through PGY 4. The curriculum was evaluated using pre- and postcurriculum surveys.

RESULTS

Our curriculum advanced child advocacy locally by establishing partnerships with state and federal American Academy of Pediatrics and pediatric residency programs, teaching residents to generate advocacy action plans, and implanting a longitudinal advocacy curriculum in the residency program. Sixty-four of 70 residents participated in the curriculum: 33% were PGY 1, 31% were PGY 2, 30% were PGY 3, and 6% were PGY 4. Pre- and postcurriculum surveys demonstrated improved knowledge of and comfort level with advocacy after curriculum completion.

DISCUSSION

Child advocacy teaching improved resident and faculty awareness about child health issues in the community, as well as understanding of pathways to advocate for child health. The curriculum is reproducible and feasible and can assist other institutions to develop advocacy education and skill development programs.

Pediatricians' Participation in Quality Improvement at the Time of Enrollment in MOC

BACKGROUND AND OBJECTIVES

Although national bodies have proclaimed the importance of incorporating quality improvement (QI) into the daily fabric of clinical care, the actual proportion of practicing pediatricians who participate in QI activities on an annual basis is unknown. Correspondingly little is known about pediatrician motivations for, attitudes about, and support received for QI participation.

METHODS

Pediatric diplomates enrolling in the American Board of Pediatrics' Maintenance of Certification program during calendar year 2016 were provided with the opportunity to complete a brief survey. A portion of the survey was focused on issues related to participation in QI programs.

RESULTS

Survey responses were received from 8714 of the 11 890 diplomates who enrolled in Maintenance of Certification in 2016 (response rate: 73.3%). Overall, 86.6% of respondents reported participation in at least 1 QI project in the previous year. There was variation in previous-year participation in a QI project by practice affiliation categories, ranging from 79.9% for nonacademic generalists to 92.4% for academic specialists. The extrinsic requirement for QI to maintain board certification was the dominant motivator among all respondents (50.7%), followed by 2 intrinsic factors: identify gaps in practice and implement change (40.3%) and opportunity to collaborate with others (36.9%).

CONCLUSIONS

Although the results are encouraging, despite almost 2 decades of national attention to the quality of health care and efforts to embed continual QI in health care delivery activities, ∼1 in 5 nonacademic pediatricians and 1 in 10 academic pediatricians did not report participating in any QI activities in the previous year.

Accuracy of pediatric residents in determination of dehydration in children with gastroenteritis

Objective

The aim of the present study was to determine the accuracy of pediatric residents in diagnosis of dehydration in children with gastroenteritis.

Methods

This was a cross-sectional study in Dr. Sheikh Hospital, affiliated with Mashhad University of Medical Sciences (Mashhad, Iran), in 2016. One hundred fifteen children aged 1 month to 14 years with gastroenteritis were included according to easy sampling. All patients were weighed. Dehydration was scored as mild, moderate and severe by pediatric residents according to Nelson standard table including pulse rate, blood pressure, blood skin supplement, skin turgor, fontanel, mucus membrane, tear respiration and urine output criteria. Patients were rehydrated and reweighed consequently. Percent loss of body weight (PLBW) was calculated and compared with dehydration score. Statistical analysis was performed using SPSS windows program version 19 (SPSS Institute, Inc., Chicago, IL, USA).

Results

Of the115 children, 65 patients were male (56.5%) with the median age of 14.5 months. The Kendall's tau-b and Spearman correlation coefficient for residents' estimation and PLBW were 0.18 and 0.23 respectively (p=0.01 and 0.12 respectively). The ICC between estimated dehydration and PLBW was 0.47. According to residents' estimation and gold standard, PLBW was 6.76% and 1.33%, respectively. The serum level of sodium, potassium, urea and creatinine were 141.8 mEq/L, 4.6 mEq/L, 34.45 mg/dL and 0.6 mg/dL, respectively.

Conclusion

There is positive but weak correlation between residents' estimation and PLBW in patients with dehydration. It is necessary to enhance the educational level of pediatric residents to increase the accuracy of physical examination and decrease medical errors.