Measurement of the Postgraduate Educational Environment of Junior Doctors Training in Medicine at an Irish University Teaching Hospital

Evaluation of learning environment of different family medicine programs, Jeddah-KSA, 2021

Background

A supportive educational climate in which learners are educated and monitored is a significant determinant of the medical trainees' performance and progress and eventually contributes to better patient care. Therefore, residents' training programs need to be assessed and incorporated according to the views and expectations of the candidates. The objectives of this research are to compare and evaluate the learning environment of Family Medicine (FM) programs in Jeddah and make practical recommendations for improvement of the learning environment.

Methods

A descriptive causal-comparative study was designed at FM programs in Jeddah, Saudi Arabia during January, and February 2021, including all residents from R1 to R4. A Postgraduate Hospital Educational Environment Measure (PHEEM) questionnaire was used in this study. The overall score and the three domains were calculated.

Results

Two hundred and eighty-three questionnaires were distributed, and 262 were completed and collected, making a response rate of 92.6%. Females represented were 150 (57.3%), and males were 112 (42.7%). The study shows that 78 (29.8%) of the residents reported that the learning environment was excellent, and 154 (58.8%) described it as a more positive than the negative environment, whereas 29 (11.1%) described it as having a lot of problems. Out of 160 maximum scores, the highest total score (127) was observed among residents at the National Guard program, whereas the lowest score (108) was in the FM joint program, P < 0.001.

Conclusion

Evaluation of the training programs is an essential component of quality assurance procedures. The satisfaction of the FM residents at different programs in Jeddah, Saudi Arabia, is better than reported previously, but however, further improvement is warranted. Juniors and residents of the National Guard program were more satisfied than their peers. We recommend low score items should have special consideration from high authorities and ongoing evaluation of the FM training program for further improvement of the learning environment.

Moroccan residents' perception of hospital learning environment measured with French version of the postgraduate hospital educational environment measure

PURPOSE

This study aimed to assess the educational environment of resident in Morocco and to compare the residents' perception depending on their specialties.

METHODS

We applied the French version of the postgraduate hospital educational environment measure (PHEEM) to measure the educational environment in 6 hospitals in Rabat from January to June 2017. Internal reliability of the questionnaire was assessed using Cronbach's alpha coefficient. Principal component analysis was conducted to assess the construct validity of the three subscales of the PHEEM questionnaire. Variance analysis (ANOVA test) was performed to compare means of PHEEM overall, subscale, and each item score among 6 specialties.

RESULTS

The response of 255 resident was included. The 40 items PHEEM questionnaire showed reliability with a Cronbach's alpha of 0.91. Principal component analysis on all 40 items suggested three factors explaining 48% of the variance with better results for the teaching subscale. Moroccan resident perceived their educational environment as more positive than negative. There was a significant difference in the overall and subscales score among the 6 specialties.

CONCLUSION

French version of the PHEEM score is a valid and reliable instrument in Morocco. Moroccan resident perceived their educational environment as more positive than negative but room for improvement of many challenges particularly the poor infrastructure, the suboptimal quality of supervision, and teaching and inadequate work regulation remained.

A Mixed-Methods Exploration of the Educational Climate and Safety Climate During the First Year of Clinical Practice in Ireland

PURPOSE

Educational climate (EC) and safety climate (SC) are key determinants of residents' professional development. The goal of this study was to gather longitudinal EC data and data on perceptions of SC in residency, and provide data on practices related to perceptions of EC and SC, by identifying factors associated with and changes in perceptions of EC and SC across the first year of practice, and elucidating good and poor practice relating to key elements of EC and SC.

METHOD

A mixed-methods design was adopted. First, 131 first-year residents in Ireland were surveyed at the end of each of their first 3 rotations (August 2016-March 2017). The survey measured EC and SC using established measures. Next, 69 semistructured interviews were conducted with a representative sample of residents (March-May 2017). An interview schedule was developed to aid in-depth probing of EC and SC perceptions. A deductive content analysis approach was adopted.

RESULTS

Perceptions of EC worsened over time. The EC and SC of surgical rotations were significantly poorer than those of medical rotations. Residents were more likely to describe team practices, rather than organizational practices, that contributed positively to their perceptions of EC and SC.

CONCLUSIONS

Further research is necessary to facilitate improvement of EC and SC for residents, particularly within surgical training. Future research exploring the contribution of organizational practices to EC and SC, the impact of targeted improvement activities, and best practices for involving residents in quality and safety initiatives is recommended.

Evaluating the educational environment in a residency programme in Singapore: can we help reduce burnout rates?

INTRODUCTION

The educational environment (EE) reflects the quality of a residency programme and has an association with burnout. Studying the EE allows for interventions to target specific weaknesses. We aimed to measure the EE of an internal medicine residency programme in Singapore, compare the perceptions between genders, residency grades and levels of work experience, and identify specific areas of weaknesses for intervention in hopes of reducing residency burnout rates in Singapore.

METHODS

This study took place between October and December 2017. We adopted a mixed methods approach, quantitatively using the Postgraduate Hospital Educational Environment Measure (PHEEM), and qualitative exploration using semi-structured focus group discussion.

RESULTS

A total of 136 (88.9%) out of 153 residents responded. Our total PHEEM scores (112.23 ± 16.71), along with the scores for all three subscales, were higher than those of institutions in previous studies. There were no differences in overall PHEEM and subscale scores between genders, residency grades or levels of work experience. However, there were differences for individual questions, which were explored in the focus group discussion. Senior residents juggling heavier workloads, responsibilities and examinations appeared to be most prone to burnout. We identified three recurring themes that contributed to a poor EE in our programme: excessive workload, poor faculty relationships and differing unmet needs.

CONCLUSION

Although our programme had a good EE, there were also areas of weaknesses revealed by specific questions, possibly contributing to burnout. We hope to implement interventions to these areas and subsequently assess for longitudinal changes in EE and burnout rates.

Using the Postgraduate Hospital Educational Environment Measure to Identify Areas for Improvement in a Singaporean Residency Program

BACKGROUND

Attributes of the clinical learning environment (CLE) are a measure of quality in postgraduate medical education, and assessing the CLE is a component of the New Accreditation System being introduced in Singapore by the Accreditation Council for Graduate Medical Education International. There is a dearth of published studies of CLE quality in Singapore.

OBJECTIVE

Our study had 3 aims: (1) to measure the CLE in 1 Singaporean residency program; (2) to compare trainee perceptions by sex, training level, and experience; and (3) to identify areas for improvement.

METHODS

Between October and December 2017, we conducted a mixed assessment of the CLE in an internal medicine program in Singapore, using the Postgraduate Hospital Educational Environment Measure (PHEEM) and qualitative exploration using a focus group.

RESULTS

Of 153 IM residents, 136 (89%) provided PHEEM responses and 8 participated in the focus group. Total PHEEM scores and scores for the 3 subscales were higher than published data on the use of the PHEEM in international settings. Exploration of selected PHEEM responses via a focus group identified attributes associated with negative perceptions of the CLE: excessive workload, inadequate faculty presence in the CLE, and unmet trainee needs. It also suggested senior residents' clinical workloads, greater responsibilities, and pending examinations may contribute to their less positive perceptions of the CLE.

CONCLUSIONS

Our analysis using the PHEEM showed overall positive perceptions of the CLE, along with areas for improvement amenable to interventions. Our approach has relevance to an accreditation model with ongoing evaluation of the CLE.

The learning environment of paediatric interns in South Africa

BACKGROUND

South African (SA) paediatric interns (recently qualified medical graduates) work in a high disease burdened and resource deficient environment for two years, prior to independent practice. Perceptions of this learning environment (LE) influences their approaches to training as well as the outcomes of this period of development. Obstacles to creating a supportive LE and supervisor interaction affects the quality of this training. Measuring perceptions of the LE with validated instruments can help inform improvements in learning during this crucial period of medical education.

METHODS

The aims of this study was to determine the psychometric qualities of the Postgraduate Hospital Educational Environment Measure (PHEEM) amongst paediatric interns across four hospital complexes in South Africa and to measure the LE as perceived by both interns and their supervisors. Construct validity was tested using factor analysis and internal consistency was measured with Cronbach's alpha.

RESULTS

A total of 209 interns and 60 supervisors (69% intern response rate) responded to the questionnaire. The PHEEM was found to be very reliable with an overall Cronbach's alpha of 0.943 and 0.874 for intern and supervisors respectively. Factor analysis using a 3-factor solution accounted for 42% of the variance with the teaching subscale having the best fit compared with the other sub-scales of the original tool. Most interns perceived the learning environment as being more positive than negative however, their perceptions differed significantly from that of their supervisors. Poor infrastructural support from institutions, excessive workloads and inadequate supervision were factors preventing optimal training of paediatric interns.

CONCLUSIONS

The SA version of the PHEEM tool used was found to be a reliable and valid instrument for use in interns amongst high disease burdened contexts. Various obstacles to creating an ideal learning environment for paediatric interns were identified to be in need of urgent review. Key differences in perceptions of an ideal learning environment between interns and their supervisors need to be fully explored as these may result in sub-optimal supervision and mentoring.

Adoption and correlates of Postgraduate Hospital Educational Environment Measure (PHEEM) in the evaluation of learning environments - A systematic review. MEDICAL TEACHER 2016;38:1248-1255. [PMID: 27564848 DOI: 10.1080/0142159x.2016.1210108]

BACKGROUND

The Postgraduate Hospital Educational Environment Measure (PHEEM) is a highly reliable and valid instrument to measure the educational environment during post graduate medical training. This review extends earlier reports by evaluating the extant adoption of PHEEM in various international clinical training sites, and its significant correlations in order to expand our understanding on the use of PHEEM and facilitate future applications and research.

METHOD

A systematic literature review was conducted on all articles between 2005 and October 2015 that adopted and reported data using the PHEEM.

RESULTS

Overall 30 studies were included, encompassing data from 14 countries internationally. Notable differences in the PHEEM scores were found between different levels of training, disciplines, and clinical training sites. Common strengths and weaknesses in learning environments were observed and there were significant correlations between PHEEM scores and In-Training Exam (ITE) performance (positive correlation) and level of burnout (negative correlation), respectively.

CONCLUSIONS

PHEEM is widely adopted in different learning settings, and is a useful tool to identify the strengths and weaknesses of an educational environment. Future research can examine other correlates of PHEEM and longitudinal changes in interventional studies.