Development and validation of an instrument to measure the postgraduate clinical learning and teaching educational environment for hospital-based junior doctors in the UK

Postgraduate medical trainees at a Ugandan university perceive their clinical learning environment positively but differentially despite challenging circumstances: a cross-sectional study

PURPOSE

The clinical learning environment is an essential component in health professions' education. Data are scant on how postgraduate trainees in sub-Saharan Africa perceive their medical school learning environments, and how those perceptions contribute to their engagement during training, their emotional wellbeing, and career aspirations. This study examined perceptions of postgraduate medical trainees (residents) in a resource-limited setting, regarding their learning environment and explored perceptual contributions to their career engagement during training. The data reported contribute to understanding how clinical learning environments can be improved in low-resource settings in Uganda and elsewhere.

METHODS

This study was done at the Faculty of Medicine of Mbarara University of Science and Technology in Uganda. We used a descriptive cross-sectional design involving sequential mixed methods. Quantitative data were collected using the Postgraduate Hospital Educational Environment Measure (PHEEM). Qualitative data were collected using focus group discussions.

RESULTS

Ninety of the 113 eligible residents responded (79.6%). Of these, 62 (68.9%) were males, 51 (56.7%) were third-year trainees, and the majority (40%) of the residents were aged between 30 and 34 years. Overall PHEEM scored 98.22 ± 38.09; Role Autonomy scored 34.25 ± 13.69, Teaching scored 39.7 ± 13.81, and Social Support scored 24.27 ± 10.59. Gender differences occurred in the perceptions of teaching and social support. Cronbach's alpha coefficient was 0.94 for the overall PHEEM. Five major themes were identified from the qualitative data (trainee support, supervision environment, engagement with overall learning environment, preparation for future practice, and challenges that impede training).

CONCLUSIONS

Overall, this study suggests that postgraduate trainees at the institution perceived the clinical learning environment positively amidst challenges of limited resources. Trainees' insights provided data that propose improvements on a number of domains in the learning environment.

The postgraduate medical educational climate assessed by the Danish Residency Educational Climate Test (DK-RECT): a validation and cross-sectional observational study

BACKGROUND

A good educational climate is essential for delivering high-quality training for medical trainees, professional development, and patient care. The aim of this study was to (1) validate the Dutch Residency Educational Climate Test (D-RECT) in a Danish setting and (2) describe and evaluate the educational climate among medical trainees.

METHODS

D-RECT was adopted in a three-step process: translation of D-RECT into Danish (DK-RECT), psychometric validation, and evaluation of educational climate. Trainees from 31 medical specialties at Copenhagen University Hospital - Rigshospitalet, Denmark were asked to complete an online survey in a cross-sectional study.

RESULTS

We performed a forward-backward translation from Dutch to Danish. Confirmatory factor analysis showed that DK-RECT was robust and valid. The reliability analysis showed that only seven trainees from one specialty were needed for a reliable result. With 304 trainees completing DK-RECT, the response rate was 68%. The subsequent analysis indicated a positive overall educational climate, with a median score of 4.0 (interquartile range (IQR): 3.0-5.0) on a five-point Likert scale. Analysis of the subscales showed that the subscale Feedback received the lowest ratings, while Supervision and Peer collaboration were evaluated highest.

CONCLUSIONS

Psychometric validation of D-RECT in a Danish context demonstrated valid results on the educational climate in specialist training. DK-RECT can be used to evaluate the effectiveness of interventions in the future and can facilitate the conversation on the educational climate.

Development and validation of a new measurement instrument to assess internship experience of medical doctors in low-income and middle-income countries

Routine surveys are used to understand the training quality and experiences of junior doctors but there are lack of tools designed to evaluate the training experiences of interns in low-income and middle-income countries (LMICs) where working conditions and resource constraints are challenging. We describe our process developing and validating a 'medical internship experience scale' to address this gap, work involving nine LMICs that varied in geographical locations, income-level and internship training models. We used a scoping review of existing tools, content validity discussions with target populations and an expert panel, back-and-forth translations into four language versions and cognitive interviews to develop and test the tool. Using data collected from 1646 interns and junior medical doctors, we assessed factor structure and assessed its reliability and validity. Fifty items about experiences of medical internship were retained from an initial pool of 102 items. These 50 items represent 6 major factors (constructs): (1) clinical learning and supervision, (2) patient safety, (3) job satisfaction, (4) stress and burnout, (5) mental well-being, and (6) fairness and discrimination. We reflect on the process of multicountry scale development and highlight some considerations for others who may use our scale, using preliminary analyses of the 1646 responses to illustrate that the tool may produce useful data to identify priorities for action. We suggest this tool could enable LMICs to assess key metrics regarding intern straining and initial work experiences and possibly allow comparison across countries and over time, to inform better internship planning and management.

Development of TOEKAN, a 360° evaluation tool for the clinical learning environment in General Practice postgraduate training

BACKGROUND

The General Practice (GP) postgraduate program exists for 80% out of workplace learning. The quality of the clinical learning environment (CLE) has a direct effect on the quality of training and the professional development of GP trainees.

METHODOLOGY

Participatory research was used to involve all stakeholders in the development process of a 360° evaluation tool that should improve the average quality of GP training practices, guide GP trainees towards the best training practices and detect and remediate GP trainers of lower quality.

RESULTS

TOEKAN (Tool for Communication and Evaluation of Quality Standards) was developed, which consists of a 72-item questionnaire for GP trainees and GP trainers and an 18-item questionnaire for those who coach and remediate GP trainers. The outcomes of the TOEKAN questionnaires are visualized in an online dashboard.

DISCUSSION

TOEKAN is the first 360° evaluation tool for CLE in GP education. All stakeholders will complete the survey on a regular basis and have access to the results. By creating intrinsic and extrinsic motivation as well as mediation measures, the quality of CLE will improve. Continuous monitoring of the use and outcomes of TOEKAN will allow to critically review and improve this new evaluation tool as well as support the broader implementation.

'We were treated like we are nobody': a mixed-methods study of medical doctors' internship experiences in Kenya and Uganda

OBJECTIVE

Medical interns are an important workforce providing first-line healthcare services in hospitals. The internship year is important for doctors as they transition from theoretical learning with minimal hands-on work under supervision to clinical practice roles with considerable responsibility. However, this transition is considered stressful and commonly leads to burn-out due to challenging working conditions and an ongoing need for learning and assessment, which is worse in countries with resource constraints. In this study, we provide an overview of medical doctors' internship experiences in Kenya and Uganda.

METHODS

Using a convergent mixed-methods approach, we collected data from a survey of 854 medical interns and junior doctors and semistructured interviews with 54 junior doctors and 14 consultants. Data collection and analysis were guided by major themes identified from a previous global scoping review (well-being, educational environment and working environment and condition), using descriptive analysis and thematic analysis respectively for quantitative and qualitative data.

FINDINGS

Most medical interns are satisfied with their job but many reported suffering from stress, depression and burn-out, and working unreasonable hours due to staff shortages. They are also being affected by the challenging working environment characterised by a lack of adequate resources and a poor safety climate. Although the survey data suggested that most interns were satisfied with the supervision received, interviews revealed nuances where many interns faced challenging scenarios, for example, poor supervision, insufficient support due to consultants not being available or being 'treated like we are nobody'.

CONCLUSION

We highlight challenges experienced by Kenyan and Ugandan medical interns spanning from burn-out, stress, challenging working environment, inadequate support and poor quality of supervision. We recommend that regulators, educators and hospital administrators should improve the resource availability and capacity of internship hospitals, prioritise individual doctors' well-being and provide standardised supervision, support systems and conducive learning environments.

A questionnaire for quality control in postgraduate medical education in Switzerland

BACKGROUND

To ensure high qualification standards in medical institutions, a questionnaire has been developed to evaluate the postgraduate medical education in Switzerland.

AIM

This article describes the development and longitudinal analysis of a questionnaire using eight scales to assess the quality of postgraduate medical education.

METHOD

The questionnaire has been administered to all residents every year since 2003. In 2020, 8,745 residents returned the questionnaire, resulting in a response rate of 70%. In addition, a survey is conducted annually among the directors of medical institutions.

RESULTS

We present results of the directors' survey and the resident evaluation from 2020, as well as longitudinal data over 16 years. The mean values of the eight scales remained stable or increased slightly over the years. The decision-making culture scale is generally rated best by the residents, while the evidence-based medicine scale is rated as the least good. The most important drivers of residents' satisfaction with a training site are the work environment and leadership culture scales. The directors perceive the evaluation to be fair and useful.

CONCLUSIONS

The questionnaire represents a reliable and useful tool for the quality control in postgraduate medical training. It provides yearly feedback to the directors regarding how the residents perceive their training giving insights for improvments.

Clinical learning evaluation questionnaire: a reliable and valid tool for the evaluation of clinical education by educators and students

BACKGROUND

The clinical learning evaluation questionnaire can be used in the clinical trial period of medical students to measure the effectiveness of the clinical learning environment. The purpose of this study was to collect validity evidence of an adapted questionnaire to measure the transcultural adaptation of a Persian version of CLEQ.

METHODS

A total of 200 questionnaires were completed by students who were at the end of their clinical rotation. The study instrument was the latest version of the CLEQ consists of 18 Items in four dimensions. The CLEQ was translated into Persian language through a four-step process of forward and backward translation. Data analysis was performed on two softwares, SPSS, version 22 and Lisrel, version 8.8.

RESULTS

The results showed that the 18-question CLEQ could be applied to the Persian translation of the tool. The response process evidence of the Persian questionnaire was established through feedback from 15 students in the sample group. The content validity index (CVI) for the items were between 0.8 and 0.9, and the content validity ratio (CVR) for the entire questionnaire was 0.9. The 4-factor feature of CLEQ was good model fit. The internal consistency analysis indicated that the Cronbach's alpha values for all items of the 18-item questionnaire were equal to 0.87 and for the subscales were 0.68 to 0.79.

CONCLUSION

The Persian translation of the 4-factor CLEQ has sufficient validity evidence to measure the transcultural adaptability of clinical education activities by instructors and students. The validity evidence are content, response process and internal structure. We recommend that the English 6-factor and 6-factor versions of CLEQ be tested on medical students at multiple foreign academic institutions to assess their efficiency.

Measuring the Learning Orientation Fostered by Pediatric Residency Programs With the Graduate Medical Education Learning Environment Inventory Instrument

INTRODUCTION

Mastery learning orientation, conceptualized as a growth mindset, can be beneficial to learners in medical education and is supported by a program...s learning environment. Currently, there are no instruments which reliably assess the learning orientation of a graduate medical education program...s learning environment.

OBJECTIVE

To explore the reliability and validity of the Graduate Medical Education Learning Environment Inventory (GME-LEI).

METHODS

Leaders of the Education in Pediatrics Across the Continuum (EPAC) project revised Krupat...s Educational Climate Inventory to create the GME-LEI. We investigated the GME-LEI...s reliability and validity through confirmatory factor and parallel factor analyses and calculated Cronbach...s alpha for each subscale. We compared mean subscale scores between residents in traditional programs and the EPAC project. As EPAC is known to foster a mastery-focused learning orientation, we hypothesized differences detected between resident groups would strengthen the instrument...s validity.

RESULTS

One hundred and twenty-seven pediatric residents completed the GME-LEI. The final 3-factor model was an acceptable fit to the data, and Cronbach...s alpha for each subscale was acceptable (Centrality: 0.87; Stress: 0.73; Support: 0.77). Mean scores on each subscale varied by program type (EPAC vs traditional) with EPAC residents reporting statistically significant higher scores in the Centrality of Learning subscale (2.03, SD 0.30, vs 1.79, SD 0.42; P.ß=.ß.023; scale of 1...4).

CONCLUSIONS

The GME-LEI reliably measures 3 distinct aspects of the GME learning environment with respect to learning orientation. The GME-LEI may be used to help programs better monitor the learning environment and make changes to support mastery-oriented learning.

Development and validation of an instrument to measure the Micro-Learning Environment of Students (MLEM)

BACKGROUND

There are multiple instruments to measure different learning environments but no valid and reliable instrument is present for measuring the micro-learning environment. This study aimed to develop and validate an instrument to measure the micro-learning environment of students. Measuring the micro-learning environment can give insight into the real-life experiences of students and enlighten us about the disparity between taught, delivered, and learned curricula.

METHODS

Multi-institutional Mixed methods study design with consecutive qualitative and, quantitative components was used based on information processing theory. Literature review, results of semi-structured interviews, and focus group discussion were combined to develop a questionnaire. Content and response process validity were established followed by pilot testing, reliability calculation, and exploratory and confirmatory factor analysis.

RESULTS

A forty-nine-item preliminary draft instrument was reduced to a total of twenty-four items final instrument having five themes regarding teaching practices, learners support, competence in teaching, progressive faculty, and teaching environment. The values of SCVI/Ave and S-CVI/UA were calculated to be 0.92 and 0.62 respectively. Reliability was calculated to be 0.94. Fit indices values were within the normal range.

CONCLUSION

The instrument for measuring the micro-learning environment has excellent content, construct, response process validity, and reliability.

Educational environment and mental wellbeing of medical and surgical postgraduate residents in Medellin, Colombia

INTRODUCTION

One of the most important moments in a doctor's life occurs when they do a medical residency. This period imposes stress and academic demands, which, together with the educational environment, allows for greater or lesser mental wellbeing. The objective of this study was to determine how the educational environment and mental wellbeing of medical residents are related.

METHODS

Analytical cross-sectional study, in residents of clinical-surgical specialties. The educational environment was assessed using the Postgraduate Hospital Educational Environment Measure (PHEEM), and mental wellbeing was assessed with the Warwick-Edinburgh Mental Wellbeing Scale (WEMWBS). Pearson's linear correlation was determined. Informed consent and approval by the university ethics committee were obtained.

RESULTS

The study population comprised 131 students, 43.8% male, with a median age of 28 years (interquartile range 4). In total, 87.9% of residents answered the survey. Of these, 65.9% were doing medical residencies and 34.1% surgical residencies. The mean PHEEM score was 107.96 ± 18.88, the positive emotions subscale was 29.32 ± 5.18 and positive functioning 23.61 ± 3.57, with a mean total mental wellbeing of 52.96 ± 8.44. A positive and moderate correlation was found between the total PHEEM score and each of the two mental wellbeing subscales (p < 0.001).

CONCLUSIONS

A positive correlation was found between a better perception of the educational environment and mental wellbeing by residents of clinical and surgical specialties with greater mental wellbeing.

Evaluation of learning environment of different family medicine programs, Jeddah-KSA, 2021

Background

A supportive educational climate in which learners are educated and monitored is a significant determinant of the medical trainees' performance and progress and eventually contributes to better patient care. Therefore, residents' training programs need to be assessed and incorporated according to the views and expectations of the candidates. The objectives of this research are to compare and evaluate the learning environment of Family Medicine (FM) programs in Jeddah and make practical recommendations for improvement of the learning environment.

Methods

A descriptive causal-comparative study was designed at FM programs in Jeddah, Saudi Arabia during January, and February 2021, including all residents from R1 to R4. A Postgraduate Hospital Educational Environment Measure (PHEEM) questionnaire was used in this study. The overall score and the three domains were calculated.

Results

Two hundred and eighty-three questionnaires were distributed, and 262 were completed and collected, making a response rate of 92.6%. Females represented were 150 (57.3%), and males were 112 (42.7%). The study shows that 78 (29.8%) of the residents reported that the learning environment was excellent, and 154 (58.8%) described it as a more positive than the negative environment, whereas 29 (11.1%) described it as having a lot of problems. Out of 160 maximum scores, the highest total score (127) was observed among residents at the National Guard program, whereas the lowest score (108) was in the FM joint program, P < 0.001.

Conclusion

Evaluation of the training programs is an essential component of quality assurance procedures. The satisfaction of the FM residents at different programs in Jeddah, Saudi Arabia, is better than reported previously, but however, further improvement is warranted. Juniors and residents of the National Guard program were more satisfied than their peers. We recommend low score items should have special consideration from high authorities and ongoing evaluation of the FM training program for further improvement of the learning environment.

An impaired learning environment: Resident physicians' experience of the transition to pandemic care during the first wave of the COVID-19 pandemic in Sweden

Introduction

Extensive studies regarding the COVID-19 pandemic have shown negative effects on physicians-in-training. Besides a high workload, their learning environment has been affected. A quality learning environment is vital for residents' physician's clinical development and also their health. Nevertheless, few studies have explored this. The aim of this study was to explore resident physicians' experiences of transition to pandemic care during the first wave of the COVID-19 pandemic in Sweden.

Method

In this qualitative study, 12 Swedish resident physicians were interviewed using a semi-structured interview guide. They were interviewed between June and October of 2020 and asked to reflect on the pandemic and, more specifically, the first wave. The empirical material was analysed using qualitative content analysis. The analysis resulted in one theme and four categories.

Results

The theme identified was An impaired learning environment which signifies the disruptions the resident physicians experienced during the first wave of the pandemic. The four categories, Professional role insecurity, High expectations but little influence, Stagnant clinical development, and Professional growth through experience, describe in what way the learning environment was impacted.

Burn-out and relationship with the learning environment among psychiatry residents: a longitudinal study

OBJECTIVES

Recent research suggests that burn-out is high and appears to be rooted in system-level factors including the local learning environment (LE). While most studies on this topic have been cross-sectional, our aim was to explore the relationship between burn-out and the LE over time within psychiatry residents. We hypothesised that burn-out is a significant predictor of learner perception of overall and all subdomains of LE within residents.

DESIGN

This was a repeated measures questionnaire study.

SETTING

We surveyed psychiatry residents in Singapore between January 2016 and December 2019.

PRIMARY AND SECONDARY OUTCOME MEASURES

The Oldenburg Burnout Inventory and the Postgraduate Hospital Education Environment Measure (PHEEM) were used to assess burn-out and resident perception of the LE, respectively. Linear mixed modelling was used to examine changes in PHEEM scores over time while taking into account burn-out status.

PARTICIPANTS

Overall, 93 residents (response rate 89.4%) took part.

RESULTS

The average difference between initial PHEEM total scores for residents with and without burn-out was significant (p<0.001). Burn-out status was a significant predictor of lower overall and all subdomain PHEEM scores at baseline (all p<0.001). PHEEM Teaching scores showed a significant increase over time for all residents regardless of burn-out status (p<0.05). However, PHEEM Total, Role Autonomy, Social Support scores did not change significantly over time or change significantly between residents with or without burn-out.

CONCLUSIONS

Perceptions of LE among psychiatry residents at baseline are inversely associated with burn-out status. That only the Teaching subdomain score increased over time could be accounted for by the fact that it is a more tangible and visible aspect of the LE compared with perceived role autonomy or social support subdomains. Our findings underscore the importance of attending to the well-being and improving the LE of our residents so as to optimise learning during training.

A social network intervention to improve connectivity and burnout among psychiatry residents in an academic institution: a quasi-experimental study

BACKGROUND

Burnout is common among residents, which could be associated with their professional network characteristics. This study aimed to assess the social networks of psychiatry residents and develop an intervention to improve their network characteristics, burnout, and perception of the educational environment.

METHODS

We recruited a cohort of 17 PGY-2 residents and assessed their social networks, burnout, and perception of the educational environment. After the baseline survey, we held a focus group with PGY-2 residents to discuss the results, their network characteristics, and interventions that can improve their relationships. The PGY-2 residents indicated that offering extracurricular opportunities to facilitate friendly interactions among the residents and faculty members would be the most feasible and acceptable intervention. Therefore, four "interest groups" for extracurricular activities were established. Residents and faculty members were invited to participate in interest groups to improve the network characteristics. Some PGY-2 residents and faculty members agreed to moderate interest group sessions (active members).

RESULTS

After the intervention, active residents improved significantly in the perceived personal accomplishment subscale of the burnout inventory and their perception of the educational environment. Active faculty members also had a significant increase in their relationships with PGY-2 residents in one domain of social networks.

CONCLUSIONS

Enhancing relationships between residents and faculty members through participatory intervention and extracurricular activities can improve faculty-resident connectivity and residents' perception of personal accomplishment and educational environment quality.

Internal Medicine Residents' Perceptions of the Learning Environment of a Residency Training Program in Ethiopia: a Mixed Methods Study

INTRODUCTION

The learning environment is an important determinant of the quality of medical education. Having a good learning climate leads to improved learning process, satisfaction with education, and helps achieve the goals of the curriculum. Assessment of the quality of learning environment helps with the identification of areas that need improvement. The aim of this study was to assess the learning environment of internal medicine training program in Ethiopia.

METHODS

A mixed methods study using a cross-sectional survey using Postgraduate Hospital Educational Environment Measure and a qualitative study using a focus group discussion was done on internal medicine residents from December 2020 to May 2021. Comparison of quantitative data was done using Mann-Whitney U-Test and Kruskal-Wallis H-test. P-value <0.05 was considered statistically significant.

RESULTS

A total of 100 residents participated in the study. The overall total mean score of the responses of the participants was 70.87 (±19.8) with mean perceptions of role autonomy, perceptions of teaching and perceptions of social support of 25.9 (±7.1), 27.1 (10.2) and 17.9 (±5.1), respectively. These values suggest the presence of plenty of problems in the program. Higher mean scores were reported by males and by earlier years of residency. Ten residents participated in the focus group discussion. Four recurring themes that negatively affect learning environment were identified and included excessive workload, inadequate teaching activity, non-conducive hospital physical environment and lack of diagnostic and therapeutic modalities.

CONCLUSION

The internal medicine residency learning environment has many challenges that need immediate attention and follow-up.

Depression and its associated factors: perceived stress, social support, substance use and related sociodemographic risk factors in medical school residents in Nairobi, Kenya

BACKGROUND

Little data exists regarding depression and its associated factors in medical residents and doctors in Sub-Saharan Africa. Residents are at high risk of developing depression owing to the stressful nature of their medical practice and academic training. Depression in medical residents leads to decreased clinical efficiency, and poor academic performance; it can also lead to substance abuse and suicide. Our primary aim was to measure depression prevalence among medical residents in Kenya's largest national teaching and referral hospital. Secondary aims were to describe how depression was associated with perceived stress, perceived social support, substance use, and educational environment.

METHODS

We sampled 338 residents belonging to 8 different specialties using self administered questionnaires in this cross-sectional survey between October 2019 and February 2020. Questionnaires included: sociodemographics, the Centres for Epidemiology Depression Scale - Revised, Perceived Stress Scale, Multidimensional Scale of Perceived Social Support, Alcohol, Smoking and Substance Involvement Screening Test, and Postgraduate Hospital Educational Environment Measure. Bivariate and multivariate linear regression were used to assess for risk factors for depression.

RESULTS

Mean participant age was 31.8 years and 53.4% were males. Most residents (70.4%) reported no to mild depressive symptoms, 12.7% had moderate, and 16.9% had severe depressive symptoms. Most residents had high social support (71.8%) and moderate stress (61.6%). The educational environment was rated as more positive than negative by 46.3% of residents. Bivariate analyses revealed significant correlations between depressive symptoms, perceived stress, substance use, perceived social support, and educational environment. Multivariate analysis showed that depression was strongly associated with: fewer hours of sleep (β = - 0.683, p = 0.002), high perceived stress (β = 0.709, p < 0.001) and low perceived social support (β = - 2.19, p < 0.001).

CONCLUSIONS

Only 30% of medical residents in our study had moderate and severe depressive symptoms. Most residents in our study reported high levels of social support, and moderate levels of stress. Though their overall appraisal of medical residency experience was positive, mental health support and self-care skills in the training of medical professionals needs prioritization.

Psychometric Properties and Calibration of the SPOREEM (Students' Perception of the Operating Room Educational Environment Measure)

OBJECTIVE

The experience in the operating room is considered as a crucial element affecting medical students' satisfaction with workplace-based training in surgery. We developed the "Students' Perception of the Operating Room Educational Environment Measure" (SPOREEM) and applied the approach of Item Response Theory to improve accuracy of its measurement.

DESIGN

Psychometric analysis determined the factorial structure. Using Item Response Theory, item thresholds were calculated on response option levels. Sum scores in the factors were then computed using calibrated unit weights.

SETTING

One hundred medical students from the University Medical Center in Goettingen, Germany, enrolled in a one-week surgery rotation completed the SPOREEM.

RESULTS

The final 19-item questionnaire resulted in 3 factors: "Learning support and inclusion" (1), "Workplace atmosphere" (2), and "Experience of emotional stress" (3). Item calibration resulted in refinement of sum scores in the factors. Male students significantly rated factor 1 more positively. Factor 2 was perceived to a similar degree in all 3 surgical disciplines involved. Factor 3 was rated lower by those students planning a surgical field of postgraduate training.

CONCLUSIONS

We developed a valid, reliable, and feasible tool to assess the overall educational climate of undergraduate training in the OR. Calibration of items refined the measurement.

Burnout and clinical learning environment among residents in Tehran: A cross-sectional study

Purpose

This study aimed to evaluate the quality of the educational environment in Tehran University of Medical Sciences across different medical specialties and its correlation with residents’ burnout.

Materials and methods

This cross-sectional study was conducted at Tehran University of Medical Sciences among residents drawn from three largest teaching hospitals affiliated. The Maslach Burnout Inventory and Postgraduate Hospital Educational Environment Measure (PHEEM) questionnaire were used to collect data through web-based, as well as paper-and pencil questionnaires. The data was analyzed using SPSS.

Results

A total of 221 residents completed the survey, with a response rate of 82%. Burnout was reported by 67.4% of medical residents. The total PHEEM score had a negative correlation with emotional exhaustion (r = - 0.57, P < 0.001), depersonalization (r = - 0.40, P < 0.001), and a positive one with personal accomplishment (r = 0.42, P < 0.001). Perception of social support significantly predicted burnout subscales (P < 0.05). PHEEM subscales also explained a small proportion of variance in emotional exhaustion (R = 0.55, R² = 0.308, P < .001). Clinical learning environment independent of personal characteristics was associated with residents' burnout according to multivariate regression analysis [OR = 0.567 (0.170–0.883), P = 0.012].

Conclusion

Clinical learning environment independent of personal characteristics was associated with residents' burnout in Iran. We suggest some initiatives to be introduced ranging from improving the clinical environments, reduce workloads and provide social support to all residents as well as encouraging them to involve in other extracurricular activities like music and physical exercise.

-A cross-sectional study of clinical learning environments across four undergraduate programs using the undergraduate clinical education environment measure

BACKGROUND

The clinical learning environment (CLE) influences students' achievement of learning outcomes and the development of their professional behaviors. However, CLEs are not always optimal for learning because of clinical productivity expectations and a lack of support from supervisors. The purpose of this study was to describe and compare students' perceptions of their CLEs across four undergraduate programs.

METHODS

This study is cross-sectional. In total, 735 students who were registered in the medical, nursing, physiotherapy, and speech-language pathology (SLP) programs were invited to participate. Data were collected using an online survey, which included demographics and the Undergraduate Clinical Education Environment Measure (UCEEM). The UCEEM consists of 26 items congregated into two overarching dimensions-experiential learning and social participation-with four subscales: opportunities to learn in and through work and quality of supervision, preparedness for student entry, workplace interaction patterns and student inclusion, and equal treatment.

RESULTS

In total 280 students (median age 28; range: 20-52; 72% females) returned the questionnaire. The mean total UCEEM score was 98.3 (SD 18.4; range: 91-130), with physiotherapy students giving the highest scores and medical students the lowest. The mean scores for the dimensions experiential learning and social participation for all the students were 62.8 (SD 13.6; range 59-85) and 35.5 (SD 6.2; range 13-45), respectively. Medical students rated the lowest for all subscales. The items receiving the highest ratings concerned equal treatment, whereas those receiving the lowest ratings concerned supervisors' familiarity with the learning objectives. There were few statistically significant differences between the semesters within each program.

CONCLUSIONS

The students generally hold positive perceptions toward their CLEs. However, the students from the medical and nursing programs rated their learning environment lower than did the students from the physiotherapy and SLP programs. Importantly, in several aspects, the medical students provided significantly lower ratings for their CLE compared with the students from the other programs. The medical students' low ratings for their supervisors' familiarity with the learning objectives underscore the need to ensure that the prerequisites for optimal supervision are met.

Educational Environment and Mental Wellbeing of Medical and Surgical Postgraduate Residents in Medellin, Colombia

INTRODUCTION

One of the most important moments in a doctor's life occurs when they do a medical residency. This period imposes stress and academic demands, which, together with the educational environment, allows for greater or lesser mental wellbeing. The objective of this study was to determine how the educational environment and mental wellbeing of medical residents are related.

METHODS

Analytical cross-sectional study, in residents of clinical-surgical specialties. The educational environment was assessed using the Postgraduate Hospital Educational Environment Measure (PHEEM), and mental wellbeing was assessed with the Warwick-Edinburgh Mental Wellbeing Scale (WEMWBS). Pearson's linear correlation was determined. Informed consent and approval by the university ethics committee were obtained.

RESULTS

The study population comprised 131 students, 43.8% male, with a median age of 28 years (interquartile range 4). In total, 87.9% of residents answered the survey. Of these, 65.9% were doing medical residencies and 34.1% surgical residencies. The mean PHEEM score was 107.96±18.88, the positive emotions subscale was 29.32±5.18 and positive functioning 23.61±3.57, with a mean total mental wellbeing of 52.96±8.44. A positive and moderate correlation was found between the total PHEEM score and each of the two mental wellbeing subscales (p <0.001).

CONCLUSIONS

A positive correlation was found between a better perception of the educational environment and mental wellbeing by residents of clinical and surgical specialties with greater mental wellbeing.

Selecting Instruments for Measuring the Clinical Learning Environment of Medical Education: A 4-Domain Framework

Learning environments shape the experiences of learners and practitioners, making them an important component of program evaluation. However, educators find it challenging to decide whether to measure clinical learning environments with existing instruments or to design their own new instrument and, if using an existing instrument, which to choose. To assist educators with these decisions, the authors compared clinical learning environment instruments based on their characteristics, underlying constructs, and degree to which items reflect 4 domains (personal, social, organizational, material) from a recently developed model for conceptualizing learning environments in the health professions. Building on 3 prior literature reviews as well as a literature search, the authors identified 6 clinically oriented learning environment instruments designed for medical education. They collected key information about each instrument (e.g., number of items and subscales, conceptual frameworks, operational definitions of the learning environment) and coded items from each instrument according to the 4 domains. The 6 instruments varied in number of items, underlying constructs, subscales, definitions of clinical learning environment, and domain coverage. Most instruments focused heavily on the organizational and social domains and less on the personal and material domains (half omitted the material domain entirely). The variations in these instruments suggest that educators might consider several guiding questions. How will they define the learning environment and which theoretical lens is most applicable (e.g., personal vitality, sociocultural learning theory)? What aspects or domains of the learning environment do they most wish to capture (e.g., personal support, social interactions, organizational culture, access to resources)? How comprehensive do they want the instrument to be (and correspondingly how much time do they expect people to devote to completing the instrument and how frequently)? Whose perspective do they wish to evaluate (e.g., student, resident, fellow, attending, team, patient)? Each of these considerations is addressed.

Tools for measuring medical internship experience: a scoping review

BACKGROUND

Appropriate and well-resourced medical internship training is important to ensure psychological health and well-being of doctors in training and also to recruit and retain these doctors. However, most reviews focused on clinical competency of medical interns instead of the non-clinical aspects of training. In this scoping review, we aim to review what tools exist to measure medical internship experience and summarize the major domains assessed.

METHOD

The authors searched MEDLINE, Embase, PsycINFO, ERIC, and the Cochrane Library for peer-reviewed studies that provided quantitative data on medical intern's (house officer, foundation year doctor, etc.) internship experience and published between 2000 and 2019. Three reviewers screened studies for eligibility with inclusion criteria. Data including tools used, key themes examined, and psychometric properties within the study population were charted, collated, and summarized. Tools that were used in multiple studies, and tools with internal validity or reliability assessed directed in their intern population were reported.

RESULTS

The authors identified 92 studies that were included in the analysis. The majority of studies were conducted in the US (n = 30, 32.6%) and the UK (n = 20, 21.7%), and only 14 studies (15.2%) were conducted in low- and middle-income countries. Major themes examined for internship experience included well-being, educational environment, and work condition and environment. For measuring well-being, standardized tools like the Maslach Burnout Inventory (for measuring burnout), Patient Health Questionnaire-9 (depression), General Health Questionnaire-12 or 30 (psychological distress) and Perceived Stress Scale (stress) were used multiple times. For educational environment and work condition and environment, there is a lack of widely used tools for interns that have undergone psychometric testing in this population other than the Postgraduate Hospital Educational Environment Measure, which has been used in four different countries.

CONCLUSIONS

There are a large number of tools designed for measuring medical internship experience. International comparability of results from future studies would benefit if tools that have been more widely used are employed in studies on medical interns with further testing of their psychometric properties in different contexts.

Operating Room Educational Environment in Canada: Perceptions of Surgical Residents

OBJECTIVE

The educational experience in operating rooms (OR) plays a central role in the transformation of a trainee into a surgeon. As Canadian residency programs transition to competency-based medical education, and since most surgical competencies are attained in the OR, we investigated the perceptions of Canadian surgical residents about their OR learning environment.

DESIGN

Cross-sectional, national survey.

SETTING

An online questionnaire, including the validated 40-item operating room educational environment measure (OREEM) inventory, was sent to residency programs of all surgical specialties in Canada. The OREEM assesses the trainees' perceptions of the "trainer and training," "learning opportunities," "atmosphere in the operating room," "supervision, workload, and support," Each individual item was rated using a 5-point Likert scale ranging from "strongly disagree" (scores 1) to "strongly agree" (scores 5). The mean score of each individual item was measured, and the mean scores of each subscale and an overall score of the questions were also measured.

PARTICIPANTS

Surgical residents in Canada.

RESULTS

Four hundred thirty residents were included for final analysis. The overall mean OREEM score was 3.72 ± 0.4. "Atmosphere in the OR" was the subscale with the highest mean score (3.87 ± 0.5), while "supervision, workload, and support" had the lowest subscale mean score (3.49 ± 0.5). The overall OREEM mean score for junior and senior residents was 3.67 ± 0.4 and 3.80 ± 0.4, respectively (p = 0.001). No significant differences were seen in the mean OREEM score between males and females or different surgical programs. Nevertheless, general surgery had the lowest "supervision, workload, and support" subscale score (3.27 ± 0.5; p < 0.001).

CONCLUSIONS

The overall educational environment in OR may be considered satisfactory as perceived by Canadian surgical residents; however, several areas for potential improvement are identified and suggestions for optimizing the learning environment are described.

The Effect of the Educational Environment on the rate of Burnout among Postgraduate Medical Trainees - A Narrative Literature Review

BACKGROUND

Burnout among postgraduate medical trainees is common. It is a syndrome characterised by emotional exhaustion, depersonalisation and reduced personal accomplishment. Burnout is seen as an organisational problem rather than the result of an individual's ability to cope with the stress at work. The educational environment can play a pivotal role in the prevention of burnout among postgraduate medical trainees. This narrative literature review is aimed at assessing the effect of the educational environment on burnout in postgraduate doctors-in-training.

METHODS

A search of the databases Medline and PscyInfo for articles published between 2015 and 2020 was performed with the key words 'burnout' and 'educational environment' or 'clinical learning environment' or 'postgraduate medical education' or 'learning environment'.

RESULTS

A total of 27 studies were identified and reviewed by the author. The prevalence of burnout reported varied widely between studies, ranging from 10% to 62%. Many of the factors that contribute to burnout form part of the educational environment, for example, hours worked, mistreatment, harassment and perceptions of injustice. Residency itself is a stressful period wherein trainees have to balance their responsibilities towards their patients with their responsibilities at home, all while furthering their studies and taking on new responsibilities. Interventions to prevent burnout and tackle existing burnout are multiple but very little solid evidence exists to attest to their efficacy. More research is needed to identify the most effective ways to deal with burnout in postgraduate medical trainees.

Clinical Learning Evaluation Questionnaire: A Confirmatory Factor Analysis

INTRODUCTION

The Clinical Learning Evaluation Questionnaire (CLEQ) is a multidimensional, reliable instrument designed to measure the effectiveness of the clinical learning environment for undergraduate medical students. This study seeks to measure and examine the underlying construct along with the latent variables by conducting a confirmatory factor analysis, using structural equation modeling (SEM) so that the instrument can be utilized as an evaluation tool for the continuous improvement of educational environments and curricula.

METHODS

A cross-sectional study was carried out on 185 third- and fourth-year medical students. A confirmatory factor analysis was conducted, beginning with principal component analysis for standardized factor loadings, using varimax rotation in SPSS to explore the underlying construct of items. The constructs to which each item was tied were determined, and then the data were run through AMOS to assess construct validity through item reduction based on the modification indices, and estimates were made of the standardized residual covariance of each item in order to determine the best model fit.

RESULTS

A total of 185 students completed the CLEQ Inventory. The original six-factor structure of the CLEQ did not achieve model fit (X²=1587.475, RMSEA=0.092, RMR=0.146, GFI=0.651, AGFI=0.601, CFI=0.728, NFI=0.626). However, the suggested four-factor model of CLEQ displayed good model fit with the improvement of values (X²=86.184, RMSEA=0.052, RMR=0.062, GFI=0.903, AGFI=0.865, CFI=0.951, NFI=0.871). Internal consistency analysis showed that Cronbach's alpha values of the original six-factor model ranged from 0.68 to 0.88, while four-factor model ranged from 0.72 to 0.87.

CONCLUSION

This study did not support the proposed six-factor structure of the CLEQ tool. However, the four-factor CLEQ structure demonstrated an adequate degree of good fit and was found to be as reliable as the original structure. Further research on the predictive validity of CLEQ is required as well as a comparison of the psychometric properties across different institutions and countries.

Validation of the French translation of the Dutch residency educational climate test

BACKGROUND

The learning environment is one of the most influential factors in training of medical residents. The Dutch Residency Educational Climate Test (D-RECT) is one of the strongest instruments for measuring the learning environment. However, it has not been translated in French. The objective of this study is the psychometric validation of the DRECT French version.

MATERIAL AND METHODS

After translation of the D-RECT questionnaire into French, residents of five Moroccan hospitals were invited to complete the questionnaire between July and September 2018. Confirmatory factor analysis was used to evaluate the validity of the construct using the standardized root mean square residual (SRMR), the root mean square error approximation (RMSEA), the Comparative Fit Index (CFI) and the Tucker- Lewis Index (TLI). Reliability analysis was analysed using Internal consistency and Test-retest.

RESULTS

During the study period, 211 residents completed the questionnaire. Confirmatory factor analysis showed an adequate model fit with the following indicators: SRMR = 0.058 / RMSEA = 0.07 / CFI = 0.88 / TLI = 0.87. The French translation had a good internal consistency (Cronbach alpha score >  0.7 for all subscales) and a good temporal stability (correlation score between two measurements = 0.89).

CONCLUSION

This French version has an acceptable validity of the construct, a good internal consistency and good temporal reliability, and may be used to evaluate the learning climate. Additional research is necessary in other French-speaking contexts, in order to confirm these results.

Sudanese paediatric residents' perception towards training environment in Sudan Medical Specialisation Board, 2020

The training environment is a determinant of learning outcomes. Paediatric residents spend most of their training programme activities in hospitals and related health centres. Measurement of the educational environment for residents is important to detect strengths and weaknesses and to ensure quality training.The overall aim is to determine the perception of postgraduate paediatric residents of a hospital educational environment. A descriptive cross-sectional study was conducted by using the modified Postgraduate Hospital Educational Environment Measure (PHEEM) to evaluate the training environment of paediatric residents in Sudan who spent 4 years of training after the curriculum was updated in 2014. PHEEM questionnaire was used to collect data from 150 final-year paediatric residents. Additional data about the programme were collected using checklists. Data were analysed using Statistical Package for the Social Science version 23. Of 101 residents who completed the forms, 19 (18.8%) were male and 82 (81.2%) were female. The total Cronbach's alpha score was 0.894. The total scale score was 74/160, which indicated an overall suboptimal response. The overall score was 74.66, autonomy score was 25.75, teachers score was 29.17 and social support score was 19.73. The overall mean ranged between 0.9604 and 2.9109. There were no significant differences between male and female responses. The examination results showed high scores despite the suboptimal educational environment. Perception of the training environment by residents showed suboptimal responses. All subscales showed problems that needed attention and urgent interventions. The social subscale score was the lowest and needed special attention with regard to the large number of females. It is vital to evaluate the whole training in order to make decisions about the weaknesses for improvements and continuation.

Implementation and Evaluation of a Military-Civilian Partnership to Train Mental Health Specialists

INTRODUCTION

Mental health specialists (MHS, or 68X) play a central role in meeting the growing demand for combat stress care among Service Members. Partnering with civilian institutions may enhance the MHS training experience beyond Advanced Individual Training (AIT).

METHODS

We describe a novel military-civilian collaboration to train U.S. Army Reserve MHS's in the psychiatric emergency service (PES) of a public, safety-net hospital. Details of implementation are described. The training rotation was evaluated after 1 year through a comprehensive chart abstraction of patients seen as well as surveys of MHS's and civilian partners.

RESULTS

The roles of MHS and physician officers in this rotation are described. Over 9 days in the PES, the MHS team evaluated 26 patients. MHS's described a high-quality training environment (83% rated very good or excellent) in which they frequently saw high-risk patients relevant to military practice. Experience with a certain patient presentation was correlated with comfort assessing and managing that presentation (p < 0.01). Many civilian staff (40%) felt the PES operated better with the presence of the Army team and 50% of civilians agreed their impression of the U.S. Army Reserve improved as a result of the partnership. Hundred percent of specialists and 80% of civilians reported very good to excellent rapport between military and civilian staff. Two civilian respondents (11%) expressed concern that the military team's presence impeded patient care.

CONCLUSION

This is the first military-civilian training collaboration for behavioral health specialists, who have already completed AIT. This program provided well-received and mission-relevant training for MHS's without notable adverse effects on patient care or team functioning in a civilian environment. Our findings are based on a small sample size, and no other such programs exist against which to compare these results. We propose that such educational partnerships, which have long been effective for other clinical specialists, may benefit the military, civilian communities, and the country.

Development of a brief learning environment measure for use in healthcare professions education: the Healthcare Education Micro Learning Environment Measure (HEMLEM)

BACKGROUND

The learning environment impacts many aspects of healthcare education, including student outcomes. Rather than being a single and fixed phenomenon, it is made up of multiple micro learning environments. The standard clinical learning environment measurement tools do not consider such diversity and may fail to adequately capture micro learning environments. Moreover, the existing tools are often long and may take a prohibitive amount of time to complete properly. This may have a negative impact on their usefulness in educational improvement strategies. In addition, there is no universal tool available which could be utilised across several healthcare student groups and placement settings.

AIM

To create an evidence-based measurement tool for assessing clinical micro learning environments across several healthcare profession student groups.

METHODS

The measurement tool was developed through a step-wise approach: 1) literature review with iterative analysis of existing tools; 2) generation of new items via thematic analysis of student experiences; 3) a Delphi process involving healthcare educators; 4) piloting of the prototype; and 5) item reduction.

RESULTS

The literature review and experiential data from healthcare students resulted in 115 and 43 items respectively. These items were refined, leaving 75 items for the Delphi process, which produced a prototype with 57 items. This prototype was then completed by 257 students across the range of healthcare professions, with item reduction resulting in a 12-item tool.

CONCLUSION

This paper describes a mixed methods approach to developing a brief micro learning environment measurement tool. The generated tool can be used for measuring student perceptions of clinical environments across several healthcare professions. Further cross-cultural and cross-professional validation studies are needed to support widespread use, possibly through mobile application.

Moroccan residents' perception of hospital learning environment measured with French version of the postgraduate hospital educational environment measure

PURPOSE

This study aimed to assess the educational environment of resident in Morocco and to compare the residents' perception depending on their specialties.

METHODS

We applied the French version of the postgraduate hospital educational environment measure (PHEEM) to measure the educational environment in 6 hospitals in Rabat from January to June 2017. Internal reliability of the questionnaire was assessed using Cronbach's alpha coefficient. Principal component analysis was conducted to assess the construct validity of the three subscales of the PHEEM questionnaire. Variance analysis (ANOVA test) was performed to compare means of PHEEM overall, subscale, and each item score among 6 specialties.

RESULTS

The response of 255 resident was included. The 40 items PHEEM questionnaire showed reliability with a Cronbach's alpha of 0.91. Principal component analysis on all 40 items suggested three factors explaining 48% of the variance with better results for the teaching subscale. Moroccan resident perceived their educational environment as more positive than negative. There was a significant difference in the overall and subscales score among the 6 specialties.

CONCLUSION

French version of the PHEEM score is a valid and reliable instrument in Morocco. Moroccan resident perceived their educational environment as more positive than negative but room for improvement of many challenges particularly the poor infrastructure, the suboptimal quality of supervision, and teaching and inadequate work regulation remained.

A Mixed-Methods Exploration of the Educational Climate and Safety Climate During the First Year of Clinical Practice in Ireland

PURPOSE

Educational climate (EC) and safety climate (SC) are key determinants of residents' professional development. The goal of this study was to gather longitudinal EC data and data on perceptions of SC in residency, and provide data on practices related to perceptions of EC and SC, by identifying factors associated with and changes in perceptions of EC and SC across the first year of practice, and elucidating good and poor practice relating to key elements of EC and SC.

METHOD

A mixed-methods design was adopted. First, 131 first-year residents in Ireland were surveyed at the end of each of their first 3 rotations (August 2016-March 2017). The survey measured EC and SC using established measures. Next, 69 semistructured interviews were conducted with a representative sample of residents (March-May 2017). An interview schedule was developed to aid in-depth probing of EC and SC perceptions. A deductive content analysis approach was adopted.

RESULTS

Perceptions of EC worsened over time. The EC and SC of surgical rotations were significantly poorer than those of medical rotations. Residents were more likely to describe team practices, rather than organizational practices, that contributed positively to their perceptions of EC and SC.

CONCLUSIONS

Further research is necessary to facilitate improvement of EC and SC for residents, particularly within surgical training. Future research exploring the contribution of organizational practices to EC and SC, the impact of targeted improvement activities, and best practices for involving residents in quality and safety initiatives is recommended.

Midwifery Student Evaluation of Practice: The MidSTEP tool - Perceptions of clinical learning experiences

BACKGROUND

Little emphasis has been given to the standardised measurement of midwifery students' perceptions of their clinical learning experiences.

AIM

To develop a tool that evaluates students' perceptions of their clinical learning experiences according to environment and impact of preceptors on professional development.

METHODS

A cross-sectional design was used. Tool development had three phases: item generation; expert review to assess clarity, apparent internal consistency and content validity; and psychometric testing. All Bachelor of Midwifery students at one university in Australia were invited to complete the online survey. Psychometric testing included dimensionality, internal consistency and test-retest reliability.

RESULTS

A 74% (n=279) response rate was achieved. Factor analysis revealed the Clinical Learning Environment Scale and Impact of the Midwifery Preceptor Scale accounting for 53.6% and 71.5% of variance respectively. Both scales were reliable (Cronbach's alpha=.92 and .94) and valid. Overall, students positively rated the clinical learning environment and preceptors' abilities to foster their sense of identity as a midwife. Students were less satisfied with preceptors' understanding of the academic program.

DISCUSSION

The new tool consists of two scales that reliably measure midwifery students' perceptions of how the clinical learning environment develops their skills and reflects a midwifery philosophy. Preceptors had a positive influence on students' skills and professional development.

CONCLUSIONS

The Midwifery Student Evaluation of Practice tool is the first valid and reliable measure of students' perceptions of their clinical learning experiences. Students' feedback provides valuable information to educators and preceptors on how best to optimise clinical learning.

Understanding the Mentoring Environment Through Thematic Analysis of the Learning Environment in Medical Education: a Systematic Review

BACKGROUND

Mentoring's success has been attributed to individualised matching, holistic mentoring relationships (MRs) and personalised mentoring environments (MEs). Whilst there is growing data on matching and MRs, a dearth of ME data has hindered development of mentoring programme. Inspired by studies likening MEs to learning environments (LEs) and data highlighting common characteristics between the two, this systematic review scrutinises reports on LEs to extrapolate the findings to the ME context to provide a better understanding of ME and their role in the mentoring process.

METHODS

Using identical search strategies, 6 reviewers carried out independent literature reviews of LEs in clinical medicine published between 1 January 2000 and 31 December 2015 using PubMed, ERIC, Cochrane Database of Systematic Reviews, Google Scholar and Scopus databases. Braun and Clarke's (2006) approach to thematic analysis was adopted to circumnavigate LE's evolving, context-specific, goal-sensitive, learner-tutor relationally dependent nature.

RESULTS

A total of 4574 abstracts were identified, 90 articles were reviewed, and 58 full-text articles were thematically analysed. The two themes identified were LE structure and LE culture. LE structure regards the framework that guides interactions within the LE. LE culture concerns the values and practices influencing learner-tutor-host organisation interactions.

DISCUSSION

LE is the product of culture and structure that influence and are influenced by the tutor-learner-host organisation relationship. LE structure guides the evolving tutor-learner-host organisation relationship whilst the LE culture nurtures it and oversees the LE structure. Similarities between LEs and MEs allow LE data to inform programme designers of ME's role in mentoring's success.

A cross-sectional study of burnout and its associations with learning environment and learner factors among psychiatry residents within a National Psychiatry Residency Programme

BACKGROUND

Multiple studies have reported high burnout rates among residents, including psychiatry. There is a paucity of studies examining the relationship between burnout and learning context, stress levels, resilience, stigma in healthcare providers and coping methods concurrently within the same cohort.

OBJECTIVE

We examined the rate of burnout among our psychiatry residents in a cross-sectional study and hypothesised that burnout is associated with poorer perception of learning environment, greater perceived stress, stigma levels, lower resilience and specific coping strategies during training.

METHODS

Ninety-three out of 104 psychiatry residents (89.4%) within our National Psychiatry Residency Programme participated in the study from June 2016 to June 2018. Relevant scales were administered to assess the perception of learning environment, burnout, stress, resilience, stigma levels and coping methods, respectively. We performed comparisons of the above measures between groups (burnout vs no burnout) and within-group correlations for these same measures.

RESULTS

Overall, 54.8% of the sample met criteria for burnout. Residents with burnout had poorer perception of the learning environment, greater stress levels (both p<0.001), were less willing to disclose/seek help and employed greater active-avoidance coping strategies. Within the burnout group, greater perceived stress was correlated with poorer perception of learning environment (r_s=-0.549) and greater use of active-avoidance coping (r_s=0.450) versus additional use of problem-focussed coping within the non-burnout group.

CONCLUSIONS

Burnout was related to both environment and learner factors. These findings viewed within the transactional, sequential and imbalance models of burnout suggest the need to address stressors, beef up coping, provide continual support and develop resilience among our learners.

Evaluating the educational environment in a residency programme in Singapore: can we help reduce burnout rates?

INTRODUCTION

The educational environment (EE) reflects the quality of a residency programme and has an association with burnout. Studying the EE allows for interventions to target specific weaknesses. We aimed to measure the EE of an internal medicine residency programme in Singapore, compare the perceptions between genders, residency grades and levels of work experience, and identify specific areas of weaknesses for intervention in hopes of reducing residency burnout rates in Singapore.

METHODS

This study took place between October and December 2017. We adopted a mixed methods approach, quantitatively using the Postgraduate Hospital Educational Environment Measure (PHEEM), and qualitative exploration using semi-structured focus group discussion.

RESULTS

A total of 136 (88.9%) out of 153 residents responded. Our total PHEEM scores (112.23 ± 16.71), along with the scores for all three subscales, were higher than those of institutions in previous studies. There were no differences in overall PHEEM and subscale scores between genders, residency grades or levels of work experience. However, there were differences for individual questions, which were explored in the focus group discussion. Senior residents juggling heavier workloads, responsibilities and examinations appeared to be most prone to burnout. We identified three recurring themes that contributed to a poor EE in our programme: excessive workload, poor faculty relationships and differing unmet needs.

CONCLUSION

Although our programme had a good EE, there were also areas of weaknesses revealed by specific questions, possibly contributing to burnout. We hope to implement interventions to these areas and subsequently assess for longitudinal changes in EE and burnout rates.

Using the Postgraduate Hospital Educational Environment Measure to Identify Areas for Improvement in a Singaporean Residency Program

BACKGROUND

Attributes of the clinical learning environment (CLE) are a measure of quality in postgraduate medical education, and assessing the CLE is a component of the New Accreditation System being introduced in Singapore by the Accreditation Council for Graduate Medical Education International. There is a dearth of published studies of CLE quality in Singapore.

OBJECTIVE

Our study had 3 aims: (1) to measure the CLE in 1 Singaporean residency program; (2) to compare trainee perceptions by sex, training level, and experience; and (3) to identify areas for improvement.

METHODS

Between October and December 2017, we conducted a mixed assessment of the CLE in an internal medicine program in Singapore, using the Postgraduate Hospital Educational Environment Measure (PHEEM) and qualitative exploration using a focus group.

RESULTS

Of 153 IM residents, 136 (89%) provided PHEEM responses and 8 participated in the focus group. Total PHEEM scores and scores for the 3 subscales were higher than published data on the use of the PHEEM in international settings. Exploration of selected PHEEM responses via a focus group identified attributes associated with negative perceptions of the CLE: excessive workload, inadequate faculty presence in the CLE, and unmet trainee needs. It also suggested senior residents' clinical workloads, greater responsibilities, and pending examinations may contribute to their less positive perceptions of the CLE.

CONCLUSIONS

Our analysis using the PHEEM showed overall positive perceptions of the CLE, along with areas for improvement amenable to interventions. Our approach has relevance to an accreditation model with ongoing evaluation of the CLE.

Perceptions of the Learning Environment on the Relationship Between Stress and Burnout for Residents in an ACGME-I Accredited National Psychiatry Residency Program

BACKGROUND

High rates of burnout have been reported in physicians in training, with contributing factors including stress, lack of coping skills, and attributes of the learning environment. The interrelationships among these factors and how they affect versus mitigate burnout in an international cohort of residents have not been studied.

OBJECTIVE

We examined the interrelationships between stress, perceptions of the learning environment, and coping strategies used in a cohort of psychiatry residents in Singapore, using burnout as the dependent variable. We hypothesized that perceptions of the learning environment and coping strategies influence the relationship between residency-related stress and burnout in psychiatry residents.

METHODS

From June 2016 to September 2017, 67 of 75 (89%) psychiatry residents from a single program in Singapore were assessed on their levels of stress and burnout, perceptions of their learning environment (including role autonomy, teaching, and social support), and the coping mechanisms they used.

RESULTS

Psychiatry residents in this Singaporean program perceived their overall learning environment to be positive. Perceptions of the learning environment, not coping strategies, significantly mediated the relationship between stress and burnout.

CONCLUSIONS

Findings from this study suggest that perceptions of the learning environment mediate the relationship between stress and burnout. Approaches to evaluate and improve resident perceptions of aspects of their learning environment may be an effective strategy to manage burnout in psychiatry residency programs.

The Dutch residency educational climate test: construct and concurrent validation in Spanish language

OBJECTIVES

To translate the 35-item version of the Dutch Residency Educational Climate Test (D-RECT), and assess its reliability, construct validity and concurrent validity in the Spanish language.

METHODS

For this validation study, the D-RECT was translated using international recommendations. A total of 220 paper-based resident evaluations covering two Colombian universities were cross-sectionally collected in 2015. A Confirmatory Factor Analysis (CFA) was used to assess the internal validity of the instrument using the Comparative fit index (CFI), Tucker-Lewis index (TLI), Standardized root mean square residual (SRMSR), and Root mean square error of approximation (RMSA). Cronbach's α was used to assess reliability. The concurrent validity was investigated through Pearson correlations with the Spanish version of the Postgraduate Hospital Educational Environment Measure (PHEEM).

RESULTS

The original 9-factor structure showed an appropriate fit for the Spanish version of the instrument (CFI = 0.84, TLI = 0.82, SRMSR = 0.06, and RMSA = 0.06). The reliability coefficients were satisfactory (>0.70). The mean total scores of the D-RECT and the PHEEM showed a significant correlation (r = 0.7, p<0.01).

CONCLUSIONS

This study confirms the validity and reliability of the Spanish version of the Dutch Residency Educational Climate Test, indicating that the instrument is suitable for the evaluation of departments' learning climate in the Spanish context. Future research is needed to confirm these findings in other Spanish speaking countries.

Exploring burnout and the association with the educational climate in pediatric residents in Thailand

BACKGROUND

This study, undertaken in Bangkok, Thailand, explored the extent to which paediatric residents in a non-Western setting experienced burnout and the potential association with factors in the medical educational climate and work-related quality of life.

METHODS

An exploratory sequential mixed methods design was employed in a cross-sectional study. The initial, quantitative phase used the validated Maslach Burnout Inventory, the Postgraduate Hospital Educational Environmental Measure (PHEEM) and Work-Related Quality of Life scale (WRQoL). Regression analysis was used to identify the correlation between burnout and educational climate. Thereafter, residents in all years with high levels of burnout on subscales were interviewed individually.

RESULTS

Forty-one paediatric residents completed the three questionnaires. None had high levels related to burnout in all three domains (emotional exhaustion, high level of depersonalization and perceived low personal accomplishment), seven (17%) showed high levels in two out of three domains. Emotional exhaustion and educational climate (perceptions of role autonomy, perceptions of teaching, perceptions of social support) were correlated with work-related quality of life. In the interviews, the main themes related to burnout were inappropriate tasks, teachers and teaching styles, the perception of knowledge insecurity relating to task performance, time dimensions, life crisis during training, role expectations and work allocation clarity, and facilities such as accommodation.

CONCLUSIONS

The study, in a non-Western setting, demonstrated a positive relation between educational climate and work-related quality of life. To help reduce the risk of burnout, the following factors were identified: minimize unnecessary or duplicated workload, schedule time arrangements to avoid extension of regular duty hours, and clearly define role expectations. The impact of inappropriate tasks, teachers and teaching styles (including unsafe environment) on the incidence of burnout was also highlighted. Additional studies focusing on teaching styles, safe learning climate and mistreatment in a non-Western context are needed.

Perception of clinical educational environment by student of physiotherapy based on the Educational Environment Measurement Questionnaire of the Postgraduate Hospital in Chile

PURPOSE

It aimed at describing the perception of the clinical educational environment by physiotherapy students based on the Educational Environment Measurement Questionnaire of the Postgraduate Hospital in Chile.

METHODS

The clinical education environment was evaluated according to the PHEEM by 192 students originally enrolled in the fifth year of the physiotherapy career at three different headquarters of the academic institution: Santiago, Viña del Mar and Concepcion Campus (Metropolitan, Valparaiso and Bio Bio region, respectively), from March to October 2018. The Cronbach's alpha was applied to measure the reliability of the instrument and the Student t and ANOVA tests were used to compare the differences of PHEEM scores by headquarters, environmental areas, and experience of internship.

RESULTS

A total overall average score of 125.88 was obtained, which meant an excellent educational environment. The overall score was 127.6±22.7 for Headquarters1, 125.6±21.6 for Headquarters2 and 122.5±26.9 for Headquarters3. According to the type of establishment, the scores were of 127.1±22.1 for private and 123.5±26.3 for public institutes. According to the type of area, the score was cataloged as an excellent educational environment in all cases, except in the respiratory care area (lowest score: 117.5±29.1). Finally, the score was 126.9±20.5 for the first internship, 121.7±29.3 for the second and 129.4±19.6 for the third.

CONCLUSION

There is relative homogeneity of the clinical educational environment for different headquarters, types of establishment or type of area; but there are significant differences in the number of the internship. The promotion of a good clinical educational environment can have an important impact on the development and performance of the future professional, being the detection of negative aspects an opportunity to improve the hidden curriculum.

Learning environment, stress and coping in psychiatry residents within a national training program: a longitudinal study

INTRODUCTION

Perception of one's learning environment is associated with academic performance and well-being of medical students. Yet, few studies have explored learners' perceptions and their correlates within a postgraduate environment. This study examined longitudinal changes in learning environment perception, perceived stress and coping for psychiatry residents in junior and senior years of training. Based on extant social learning theories, we hypothesized that learning environment perceptions will improve with seniority, and be accompanied by lower stress levels and better coping.

METHODS

Eighty-two out of 101 psychiatry residents (81.2%) from our National Psychiatry Residency Program rated their perception of learning environment, perceived stress, and coping strategies from June 2016 to June 2018. Correlations between these variables, and changes across five timepoints were examined.

RESULTS

Senior-year residents reported better perception of learning environment over time, together with increased use of problem-focused coping and lowered perceived stress levels. Junior-year residents reported no changes in learning environment perception and coping strategies, despite rating greater perceived stress levels over time. Perception of learning environment negatively correlated with perceived stress levels and specific coping strategies.

DISCUSSION

Based on these findings, we suggest specific strategies with the emphasis on context, participation, and social interaction within a community of practice to better support residents in training, which are applicable to other similar training programs.

Family medicine residents' educational environment and satisfaction of training program in Riyadh

Background

Improving health outcome indicators worldwide needs well-trained family physicians, and the Kingdom of Saudi Arabia is of no exception from that need.

Objectives

To address the level of satisfaction and assess the educational environment among residents of family medicine (FM) in Riyadh city.

Methodology

A cross-sectional study; the Postgraduate Hospital Educational Environment Measure (PHEEM) was used to assess the educational environment for all FM residents in fully structured training centers that include all levels of residents in Riyadh during 2016.

Results

About 187 surveys were distributed and 140 were collected, with a response rate of 74.87%. Cronbach's alpha scored at 0.917 for overall items. Out of 160 maximum score, the overall score of the PHEEM was 86.73 (standard deviation [SD]: 19.46). The perception of teaching score was 33.11 (SD: 8.80) out of 60, the perception of role autonomy score was 28.60 (SD: 7.35) out of 56, and the perception of social support was 25.02 (SD: 5.43) out of 44.

Conclusion

The educational environment is an important determinant of medical trainees' achievements and success. The results are better than what had been found in the previous studies, but more attention and effort should be done, especially for the poorly rated points in this study. We recommend a continuous evaluation and reconstruction of the Saudi Board of FM program, and such results could be a tool that might help in fostering better and stronger educational program.

Impact of hospital educational environment and occupational stress on burnout among Greek medical residents

Objective

A number of risk and protective factors have been described on the development of burnout syndrome amongst medical residents. The current study aims to investigate the impact of hospital educational environment and occupational stress on trainee doctors burnout. A cross-sectional study among 269 medical residents was conducted. Greek version of Postgraduate Hospital Educational Environment Measure (PHEEM-G) for the assessment of their educational environment, Greek Version of Job Stress Measure (JSM-G) for the stress assessment and Copenhagen Burnout Inventory (CBI) for burnout measurement were used.

Results

Medical residents’ perceptions about their educational environment are rather negative. Their job-related stress ranged between moderate and high levels, while burnout ranged in medium levels. A significant positive association was observed between total CBI and its subscales and stress. Positive evaluation of the clinical learning environment was inversely related with burnout levels. Job stress was correlated independently and positively with higher total burnout levels and its’ three dimensions. Work-related burnout was independently and negatively related with social support.

The clinical learning environment

Learning in a clinical context is foundational in the training of health professionals; there is simply no alternative. The subject of the clinical learning environment (CLE) is at the forefront of discussions. In this introduction to a themed issue on the CLE, we present an expanded conceptual model that approaches the CLE through six different lenses, termed "avenues:" architectural, digital, diversity and inclusion, education, psychological, and sociocultural, with each avenue represented by a paper. The aim is to facilitate dialog around the contributions of different academic disciplines to research on the CLE. Collectively the papers highlight the overlap between the various "avenues" in how they influence each other, and how they collectively have shaped the work to understand and improve the CLE. The expectation is that the various avenues can add to existing knowledge and create new ideas for interventions to improve the clinical learning environment across nations for learners and teachers with the ultimate aim of improving patient care. Research and efforts to improve the CLE are critical to learning, professional socialization and well-being for trainees as they learn and participate in patient care, and to the quality of care they will deliver over decades of practice after graduation.

Contextualizing Work-Based Assessments of Faculty and Residents: Is There a Relationship Between the Clinical Practice Environment and Assessments of Learners and Teachers?

PURPOSE

Competence is bound to context, yet seldom is environment explicitly considered in work-based assessments. This study explored faculty and residents' perspectives of the environment during internal medicine clinical teaching unit (CTU) rotations, the extent that each group accounts for environmental factors in assessments, and relationships between environmental factors and assessments.

METHOD

From July 2014 to June 2015, 212 residents and 54 faculty across 5 teaching hospitals at University of Toronto rated their CTU environment using a novel Practice Environment Rating Scale (PERS) matched by block and hospital. Faculty-PERS data were paired to In-Training Evaluation Reports (ITERs) of residents supervised during each block, and Resident-PERS data to Resident Assessment of Teaching Effectiveness (RATE) scores of the same faculty. Differences between perceptions and assessments were tested using repeated-measures MANOVAs, ANOVAs, and correlations.

RESULTS

One-hundred sixty-four residents completed the PERS; residents rated the CTU environment more positively than faculty (3.91/5 vs. 3.29, P < .001). Residents were less likely to report considering environmental factors when assessing faculty (2.70/5) compared with faculty assessing residents (3.40, P < .0001), d = 1.2. Whereas Faculty-PERS ratings did not correlate with ITER scores, Resident-PERS ratings had weak to moderate correlations with RATE scores (overall r = 0.27, P = .001).

CONCLUSIONS

Residents' perceptions of the environment had small but significant correlations with assessments of faculty. Faculty's perceptions did not affect assessments of residents, potentially because they reported accounting for environmental factors. Understanding the interplay between environment and assessment is essential to developing valid competency judgments.

Validity of the scan of postgraduate educational environment domains (SPEED) questionnaire in a rural general practice training setting

BACKGROUND

The educational environment is critical to learning and is determined by social interactions. Trainee satisfaction translates to career commitment, retention and a positive professional attitude as well as being an important factor in assessing the impact of the training program. This study aimed to validate the Scan of Postgraduate Educational Environment Domain (SPEED) tool and assess its appropriateness in evaluating the quality of General Practice (GP) rural postgraduate educational environment.

METHODS

A questionnaire containing the 15-item SPEED tool was administered to GP registrars to examine their perceptions of the educational environment. Principal component analysis (PCA) and exploratory factor analysis (EFA) were used to gather evidences of the validity of the instrument based on its internal structure. Additional validity evidence and reliability estimates were obtained using many-facet Rasch model analysis (MFRM).

RESULTS

The survey was completed by 351 registrars with a response rate of 60%. Parallel analysis performed using principal component analysis and exploratory factor analysis suggests that the SPEED tool is unidimensional. The MFRM analysis demonstrated an excellent degree of infit and outfit for items and training sites, but not for persons. The MFRM analysis also estimated high reliability levels for items (0.98), training sites (0.95) and persons within training sites (ranging from 0.87 to 0.93 in each training sites). Overall, the registrars agreed that the educational environment had high quality, with most (13 out of 15) of the items rated above 4 out of 5.

CONCLUSIONS

This study demonstrated a high degree of validity and reliability of the SPEED tool for the measurement of the quality of the educational environment in a rural postgraduate GP training context. However, when applied in a new setting, the tool may not function as a multidimensional tool consistent with its theoretical grounding.

Students' perceptions of the learning environment in two Nigerian medical schools offering different curricula

Objective

Compare the results of administering the DREEM questionnaire in two Nigerian medical schools offering traditional and student-centred curricular respectively, to identify any differences in the learning environment and appreciate advantages of the more modern curriculum.

Methods

A survey design was used. Data was analysed using the DREEM scoring rubric. The independent t-test was used to compare results.

Setting

The DREEM questionnaire was administered to final year medical students at two participating centres.

Participants

Final year students of a teacher-centred and a student-centred medical school.

Results

There were 138 respondents - 50 (96.2% of the final year students) from the teacher centred school and 88 (59.1% of the final year students) from the student-centred school. The mean total DREEM score was 117+22.3 in the former and 119 +23.6 in the latter (p = 0.798). Mean age of students in the teacher centred school was 28 ± 5.28 years, while that of the student-centred school was 23 ± 1.83 years (p < 0.05).

Conclusion

The mean total DREEM score proximity between the schools suggests that the younger students using a more student-centred curriculum have less of an appreciation of their improved learning environment than is expected. Thus, the hidden curriculum could be lagging behind the written one. The older students in the teacher centred environment have a more mature appreciation of their learning climate.

Funding

Personal sources.

The value of peer mentoring for the psychosocial wellbeing of junior doctors: a randomised controlled study

OBJECTIVE

To explore the value of a peer mentoring program for first year medical interns and to assess the demand for and benefits of such a program in an Australian hospital.

DESIGN, SETTING AND PARTICIPANTS

Randomised controlled study of the impact on first year interns of peer-led mentoring by second and third year interns, undertaken during 2015 at the Royal Perth Hospital, a tertiary teaching hospital. Methods and main outcome measure: Interns were recruited and randomised 1:1 to being assigned or not assigned a mentor. Qualitative outcome data were collected in semi-structured interviews and focus groups at 12 months to assess psychosocial wellbeing and job satisfaction.

RESULTS

Fifty-three of 79 interns (67%) applied to participate in the program. Twenty-six mentor-mentee pairs matched by sex and career preferences were established; 27 interns were allocated to the control group. Iterative data analysis identified two major themes related to the value of the mentorship program: aiding navigation through the complex health care system, and enhancing a sense of community. Participants with mentors reported high satisfaction with the program and a positive impact on stress levels, morale, sense of support, job satisfaction, and psychosocial wellbeing compared with participants without mentors.

CONCLUSION

An optional peer mentoring program enhances junior doctor support structures, builds a sense of community, and helps participating interns navigate their new professional environment. Our trial provides a feasibility model that could be adapted to local conditions, regionally or nationally.

TRIAL REGISTRATION

Australian New Zealand Clinical Trials Registry, ACTRN12618000455268; 29 March 2018 (retrospective).