Evaluating the implementation process of a participatory organizational level occupational health intervention in schools

Barriers and facilitators to implementing workplace interventions to promote mental health: qualitative evidence synthesis

BACKGROUND

Despite growing interest in workplace mental health interventions, evidence of their effectiveness is mixed. Implementation science offers a valuable lens to investigate the factors influencing successful implementation. However, evidence synthesis is lacking, especially for small-to-medium-sized enterprises (SMEs) and for specific work sectors. The objectives of this review are to establish the scope of research with explicit analysis of implementation aspects of workplace mental health interventions and to identify barriers and facilitators to implementation in general and within SMEs and selected sectors.

METHODS

A systematic scoping review and meta-synthesis of mixed methods process evaluation research from 11 databases, with the evaluation of methodological quality (MMAT) and confidence in findings (CERQual), was conducted. We selected information-rich studies and synthesised them using domains within the Nielsen and Randall implementation framework: context, intervention activities, implementation; and mental models.

RESULTS

We included 43 studies published between 2009 and 2022, of which 22 were rated as information-rich to be analysed for barriers and facilitators. Most studies were conducted in healthcare. Facilitators reflecting 'high confidence' included: relevant and tailored content, continuous and pro-active leadership buy-in and support, internal or external change agents/champions, assistance from managers and peers, resources, and senior-level experience and awareness of mental health issues. Healthcare sector-specific facilitators included: easy accessibility with time provided, fostering relationships, clear communication, and perceptions of the intervention. Stigma and confidentiality issues were reported as barriers overall. Due to the small number of studies within SMEs reported findings did not reach 'high confidence'. A lack of studies in construction and Information and Communication Technology meant separate analyses were not possible.

CONCLUSIONS

There is dependable evidence of key factors for the implementation of workplace mental health interventions which should be used to improve implementation. However, there is a lack of studies in SMEs and in a larger variety of sectors.

SYSTEMATIC REVIEW REGISTRATION

Research Registry ( reviewregistry897 ).

Pilot implementation of MiLES: a web-based intervention targeted at managers with the aim of enhancing the successful return to work of employees with cancer

BACKGROUND

MiLES is a web-based intervention targeted at managers with the aim of enhancing the successful return to work (RTW) of employees with cancer. The purpose of this study was to identify barriers to and facilitators of implementing MiLES in organizations, from a manager's perspective.

MATERIAL AND METHODS

MiLES was implemented as a pilot in four organizations for six weeks. Sixteen managers were included, of which fourteen were interviewed regarding their perceived barriers to and facilitators of implementation of MiLES in their organization. Interviews were recorded, transcribed verbatim and analyzed with content analysis.

RESULTS

The managers experienced barriers to and facilitators of implementation related to: (1) implementation responsibilities, (2) the intervention's content, and (3) organizational characteristics. Regarding implementation responsibilities, management board approval and an organizational infrastructure with distinct described implementation responsibilities were perceived as facilitators. Regarding the intervention's content, its accessibility, user-friendliness and completeness were perceived as facilitators. If the content did not meet the manager's specific needs, this was perceived as a barrier. Regarding organizational characteristics, several intangible (e.g., added value of MiLES within different organizations) and tangible (e.g., integration into absenteeism registration) organizational characteristics were perceived as facilitators. The absence of a quiet place to use MiLES was perceived as barrier.

CONCLUSION

Implementation of MiLES in organizations may benefit from an infrastructure within the organization that defines responsibilities regarding intervention delivery to managers of employees with cancer. Such an infrastructure should be aligned to existing organizational structures. As per interviewed managers, MiLES has added value in diverse organizations.

Testing middle range theories in realist evaluation: a case of a participatory organisational intervention

Purpose

Realist evaluation seeks to answer the question of “what works for whom in which circumstances?” through developing and testing middle range theories (MRTs). MRTs are programme theories that outline how certain mechanisms of an intervention work in a specific context to bring about certain outcomes. In this paper, the authors tested an initial MRT about the mechanism of participation. The authors used evidence from a participatory organisational intervention in five worksites of a large multi-national organisation in the US food service industry.

Design/methodology/approach

Qualitative data from 89 process tracking documents and 24 post-intervention, semi-structured interviews with intervention stakeholders were analysed using template analysis.

Findings

The operationalised mechanism was partial worksite managers’ engagement with the research team. Six contextual factors (e.g. high workload) impaired participation, and one contextual factor (i.e. existing participatory practices) facilitated participation. Worksite managers’ participation resulted in limited improvement in their awareness of how working conditions can impact on their employees’ safety, health, and well-being. Based on these findings, the authors modified the initial MRT into an empirical MRT.

Originality/value

This paper contributes to the understanding of “what works for whom in which circumstances” regarding participation in organisational interventions.

Effectiveness of health-oriented leadership interventions for improving health and wellbeing of employees: a systematic review

Aim

To identify and summarize the evidence for the effect of health-oriented leadership interventions on health and well-being outcomes at the employee level following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses statement (Moher et al. 2009).

Subject and Methods

A systematic search of relevant studies was conducted in multiple databases. Randomized controlled trials (RCTs), cluster-randomized controlled trials (cRCTs) and controlled before–after studies (CBAs) were included based on the following criteria: interventions that addressed supervisors, to raise awareness for the importance of health issues, teach mindfulness practices for conscious awareness, reduce stress and promote resources at the level of individual behavior, and evaluated the effect on at least one outcome of psychomental stress, absenteeism and well-being on the employee level.

Results

Of 6126 publications retrieved, ten studies were identified for analysis. Significant effects of leadership training were reported on exhaustion tendency, self-reported sickness absence, work-related sickness absence and job satisfaction in studies comparing health-oriented training programs to no intervention. Studies comparing health-oriented leadership training to other training did not report significant effects. Risk of bias was judged to be high in seven studies and unclear in three studies.

Conclusion

Evidence for the effectiveness of health-oriented leadership interventions on employees’ stress, absenteeism or well-being is judged to be low, clearly indicating the need for more and higher-quality research.

Implementation of an organizational intervention to improve low-wage food service workers' safety, health and wellbeing: findings from the Workplace Organizational Health Study

Background

Many organizational interventions aim to improve working conditions to promote and protect worker safety, health, and well-being. The Workplace Organizational Health Study used process evaluation to examine factors influencing implementation of an organizational intervention. This paper examines the extent to which the intervention was implemented as planned, the dose of intervention implemented, and ways the organizational context hindered or facilitated the implementation of the intervention.

Methods

This proof-of-concept trial was conducted with a large, multinational company that provides food service through contractual arrangements with corporate clients. The 13-month intervention was launched in five intervention sites in October 2018. We report findings on intervention implementation based on process tracking and qualitative data. Qualitative data from 25 post-intervention interviews and 89 process tracking documents were coded and thematically analyzed.

Results

Over the 13-month intervention, research team representatives met with site managers monthly to provide consultation and technical assistance on safety and ergonomics, work intensity, and job enrichment. Approximately two-thirds of the planned in-person or phone contacts occurred. We tailored the intervention to each site as we learned more about context, work demands, and relationships. The research team additionally met regularly with senior leadership and district managers, who provided corporate resources and guidance. By assessing the context of the food service setting in which the intervention was situated, we explored factors hindering and facilitating the implementation of the intervention. The financial pressures, competing priorities and the fast-paced work environment placed constraints on site managers’ availability and limited the full implementation of the intervention.

Conclusions

Despite strong support from corporate senior leadership, we encountered barriers in the implementation of the planned intervention at the worksite and district levels. These included financial demands that drove work intensity; turnover of site and district managers disrupting continuity in the implementation of the intervention; and staffing constraints that further increased the work load and pace. Findings underscore the need for ongoing commitment and support from both the parent employer and the host client.

Trial registration

This study was retrospectively registered with the Clinical Trials. Gov Protocol and Results System on June 2, 2021 with assigned registration number NCT04913168.

Evaluation of a school-based participatory intervention to improve school environments using the Consolidated Framework for Implementation Research

Background

Participatory research offers a promising approach to addressing health inequities and improving the social determinants of health for diverse populations of adolescents. However, little research has systematically explored factors influencing the implementation of participatory health interventions targeting health disparities.

Objective

This study examined the utility of the Consolidated Framework for Implementation Research (CFIR) in identifying and comparing barriers and facilitators influencing implementation of participatory research trials by employing an adaptation of the CFIR to assess the implementation of a multi-component, urban public school-based participatory health intervention.

Methods

We collected qualitative data over a one-year period through weekly team meeting observational field notes and regular semi-structured interviews with five community-based participatory researchers, one school-based partner, and four school principals involved in implementing a participatory intervention in five schools. Adapted CFIR constructs guided our largely deductive approach to thematic data analysis. We ranked each of the three intervention components as high or low implementation to create an overall implementation effectiveness score for all five schools. Cross-case comparison of constructs across high and low implementation schools identified constructs that most strongly influenced implementation.

Results

Ten of 30 assessed constructs consistently distinguished between high and low implementation schools in this participatory intervention, with five strongly distinguishing. Three additional constructs played influential, though non-distinguishing, roles within this participatory intervention implementation. Influential constructs spanned all five domains and fit within three broad themes: 1) leadership engagement, 2) alignment between the intervention and institutional goals, priorities, demographics, and existing systems, and 3) tensions between adaptability and complexity within participatory interventions. However, the dynamic and collaborative nature of participatory intervention implementation underscores the artificial distinction between inner and outer settings in participatory research and the individual behavior change focus does not consider how relationships between stakeholders at multiple levels of participatory interventions shape the implementation process.

Conclusions

The CFIR is a useful framework for the assessment of participatory research trial implementation. Our findings underscore how the framework can be readily adapted to further strengthen its fit as a tool to examine project implementation in this context.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12889-021-11644-5.

Developing Initial Middle Range Theories in Realist Evaluation: A Case of an Organisational Intervention

(1) Background: Realist evaluation is a promising approach for evaluating organisational interventions. Crucial to realist evaluation is the development and testing of middle range theories (MRTs). MRTs are programme theories that outline how the intervention mechanisms work in a specific context to bring about certain outcomes. To the best of our knowledge, no organisational intervention study has yet developed initial MRTs. This study aimed to develop initial MRTs based on qualitative evidence from the development phase of an organisational intervention in a large multi-national organisation, the US food service industry. (2) Methods: Data were collected through 20 semi-structured interviews with the organisation's managers, five focus groups with a total of 30 employees, and five worksite observations. Template analysis was used to analyse data. (3) Results: Four initial MRTs were developed based on four mechanisms of participation, leadership commitment, communication, and tailoring the intervention to fit the organisational context to formulate 'what may work for whom in which circumstances?' in organisational interventions; (4) Conclusions: Our findings provide insights into 'how' and 'which' initial MRTs can be developed in organisational interventions.

Implementing practices focused on workplace health and psychological wellbeing: A systematic review

RATIONALE

Workplace health and wellbeing practices (WHWPs) often fail to improve psychological health or wellbeing because of implementation failure. Thus, implementation should be evaluated to improve the effectiveness of WHWPs.

OBJECTIVE

We conducted a systematic review to identify critical success factors for WHWP implementation and gaps in the evidence. Doing so provides a platform for future theoretical development.

METHODS

We reviewed 74 separate studies that assessed the implementation of WHWPs and their effects on psychological health or psychological wellbeing. Most studies were from advanced industrial Western democracies (71). Intervention types included primary (e.g., work redesign, 37 studies; and health behavior change, 8 studies), secondary (e.g., mindfulness training, 11 studies), tertiary (e.g., focused on rehabilitation, 9 studies), and multifocal (e.g., including components of primary and secondary, 9 studies).

RESULTS

Tangible changes preceded improvements in health and wellbeing, indicating intervention success cannot be attributed to non-specific factors. Some interventions had beneficial effects through mechanisms not planned as part of the intervention. Three factors were associated with successful WHWP implementation: continuation, learning, and effective governance.

CONCLUSIONS

The review indicates future research could focus on how organizations manage conflict between WHWP implementation and existing organizational processes, and the dynamic nature of organizational contexts that affect and are affected by WHWP implementation. This systematic review is registered [PROSPERO: the International Prospective Register of Systematic Reviews ID: CRD42019119656].

A Proof-of-Concept System Dynamics Simulation Model of the Development of Burnout and Recovery Using Retrospective Case Data

The phenomenon of burnout is a complex issue, which despite major efforts from researchers and organizations remains hard to prevent. The current literature highlights an increasing global prevalence of employees that are dealing with burnout. What has been largely missing is a more systemic, dynamic, and personal perspective on the interactions of the key determinants of burnout. Burnout can be seen as the outcome of a complex system involving feedback loops between individual mental models, individual behavior, and external social influences. Understanding the feedback loops involved may enable employees and organizations to intervene in burnout trajectories early and effectively. System dynamics (SD) modeling is a methodology that can describe the structure and behavior of a complex system. The current paper describes the development of an SD model of burnout. First, an expert- and literature-informed causal loop diagram (CLD) of burnout is developed. Then, a novel approach is developed to collect personal retrospective scenario data. Finally, the CLD and data are translated into a quantitative SD model. The potential of the SD model is illustrated by simulating the behavior of three realistic personas during the onset of and recovery from burnout. The process of development of an SD model of burnout is presented and the strengths and limitations of the approach are discussed.

Promoting Employees' Recovery During Shift Work: Protocol for a Workplace Intervention Study

BACKGROUND

Shift work can be demanding owing to disturbances in the biological and social rhythms. This can cause short-term negative effects in employees, such as increased fatigue and reduced alertness. A potential way to counteract these negative effects is to enhance employees' recovery from work during working hours.

OBJECTIVE

The aim of this study is to develop and implement an intervention that focuses on promoting "on-job" recovery of shift workers.

METHODS

This study is performed in 2 department units with shift workers at a multinational company in the steel industry. For each department, an intervention will be developed and implemented through an iterative process of user-centered design and evaluation. This approach consists of various sessions in which employees and a project group (ie, researchers, line managers, human resource managers, and occupational health experts) provide input on the intervention content and implementation. Intervention effects will be evaluated using pretest and posttest web-based surveys. Digital ecological momentary assessment will be performed to gain insight into the link between the intervention and daily within-person processes. The intervention process and participants' perception of the interventions will be assessed through a process evaluation. Intervention results will be analyzed by performing mixed model repeated measures analyses and multilevel analyses.

RESULTS

This study is supported by the Netherlands Organization for Applied Scientific Research Work and Health Research Program, which is funded by the Ministry of Economic Affairs and supported by the Dutch Ministry of Social Affairs and Employment, program number 19.204.1-3. This study was approved by the institutional review board on February 7, 2019. From June to August 2019, baseline data were collected, and from November to December 2019, the first follow-up data were collected. The second follow-up data collection and data analysis are planned for the first two quarters of 2020. Dissemination of the results is planned for the last two quarters of 2020.

CONCLUSIONS

A strength of this study design is the participatory action approach to enhance the stakeholder commitments, intervention adherence, and compliance. Moreover, since the target group will be participating in the development and implementation of the intervention, the proposed impact will be high. In addition, the short-term as well as the long-term effects will be evaluated. Finally, this study uses a unique combination of quantitative and qualitative evaluation methods. A limitation of this study is that it is impossible to randomly assign participants to an intervention or control group. Furthermore, the follow-up period (6 months) might be too short to establish health-related effects. Lastly, the results of this study might be specific to the department, organization, or sector, which limits the generalizability of the findings. However, as workplace intervention research for shift workers is scarce, this study might serve as a starting point for future research on shift work interventions.

Translation and psychometric evaluation of the German version of the Organisational Readiness for Implementing Change measure (ORIC): a cross-sectional study

OBJECTIVES

To translate the Organisational Readiness for Implementing Change measure into German and assess its psychometric properties.

DESIGN

Cross-sectional psychometric study based on secondary analysis of baseline data from a shared decision-making implementation study.

SETTING

Three departments within one academic cancer centre in Hamburg, Germany.

PARTICIPANTS

For comprehensibility assessment of the translated ORIC version, we conducted cognitive interviews with healthcare professionals (HCPs, n=11). Afterwards, HCPs (n=230) filled out the measure.

PRIMARY AND SECONDARY OUTCOME MEASURES

The original English version of the ORIC was translated into German using a team translation protocol. Based on comprehensibility assessment via cognitive interviews with HCPs, the translated version was revised. We analysed acceptance (completion rate), factorial structure (exploratory factor analysis (EFA), confirmatory factor analysis (CFA), model fit), item characteristics (item difficulties, corrected item-total correlations, inter-item correlations) and internal consistency (Cronbach's α).

RESULTS

Translation and cognitive testing of the German ORIC was successful except for item 10, which showed low comprehensibility as part of content validity in cognitive interviews. Completion rate was >97%. EFA and CFA provided a one-factorial structure. Item difficulties ranged between 55.98 and 65.32, corrected item-total-correlation ranged between 0.665 and 0.774, inter-item correlations ranged between 0.434 and 0.723 and Cronbach's α was 0.93.

CONCLUSIONS

The German ORIC is a reliable measure with high completion rates and satisfying psychometric properties. A one-factorial structure of the German ORIC was confirmed. Item 10 showed limited comprehensibility and therefore reduces content validity of the measure. The German ORIC can be used to analyse organisational readiness for change as a precursor for implementation success of various interventions.

Decreasing employees' work stress by a participatory, organizational level work stress prevention approach: a multiple-case study in primary education

Background

Work stress is an important problem among employees in education in the Netherlands. The present study aims to investigate the effects of a participatory organizational level work stress prevention approach to reduce (quantitative) job demands, increase resources (i.e. autonomy, supervisor and coworker support) and to reduce work stress and increase job satisfaction of employees in primary education.

Methods

This study makes use of a multiple case study research design. The stress prevention approach is implemented at 5 primary schools and questionnaires were filled out by 119 employees of the 5 schools at baseline and 1 year later, measuring job demands, resources, work stress, job satisfaction and implementation factors.

Results

Multilevel analyses showed a significant decrease in job demands and a significant increase in job satisfaction between baseline and follow up. In addition, employees that were more satisfied with the communication about the intervention showed more improvements in autonomy and job satisfaction. However, employees reporting an increased dialogue in work stress between employees and management showed a smaller decrease in job demands.

Conclusion

The study shows a decrease in job demands and an increase in job satisfaction in the schools that implemented a stress prevention approach. Results of the study underline the importance of communication about the intervention as part of the implementation process, impacting the effectiveness of the intervention to improve autonomy and job satisfaction.

Trial registration

ISRCTN registry, study ID: ISRCTN14697835, registration date: 11-10-2019 (retrospectively registered).

A study protocol for a cluster randomised controlled trial on mindfulness-based stress reduction: studying effects of mindfulness-based stress reduction and an additional organisational health intervention on mental health and work-related perceptions of teachers in Dutch secondary vocational schools

Background

Dutch teachers in secondary vocational schools suffer from stress and burnout complaints that can cause considerable problems at work. This paper presents a study design that can be used to evaluate the short-term and long-term effectiveness of mindfulness-based stress reduction (MBSR), a person-focused intervention, both within and outside of the context of an additional organisational health intervention.

Methods

The proposed study comprises a cluster randomised controlled trial that will be conducted in at least three secondary vocational schools, to which teachers will be recruited from three types of courses: Care, Technology, and Economy. The allocation of the intervention programme to the participating schools will be randomised. The teachers from each school will be assigned to intervention group 1 (IG 1), intervention group 2 (IG 2), or the waiting list group (WG). IG 1 will receive MBSR training and IG 2 will receive MBSR training combined with an additional organisational health intervention. WG, that is the control group, will receive MBSR training one year later. The primary outcome variable of the proposed study is mindfulness, which will be measured using the Dutch version of the Five Facet Mindfulness Questionnaire (FFMQ-NL). In the conceptual model, the effects of teachers’ mindfulness resulting from the intervention programmes (MBSR training and MBSR training combined with an additional organisational health intervention) will be related to salient (secondary outcome) variables: mental health outcomes (e.g., burnout, work engagement), work performance, work-related perceptions (job demands and job resources), and personal competencies (e.g., occupational self-efficacy). Data will be collected before (T₀) and immediately after the MBSR training (T₁), and 3 (T₂) and 9 months (T₃) after the training. The power analysis revealed a required sample size of 66 teachers (22 in each group).

Discussion

The proposed study aims to provide insight into (1) the short-term and long-term effects of MBSR on teachers’ mental health, (2) the possible enhancing effects of the additional organisational health intervention, and (3) the teachers’ experiences with the interventions (working mechanisms, steps in the mindfulness change process). Strengths of this study design are the use of both positive and negative outcomes, the wide range of outcomes, both outcome and process measures, longitudinal data, mixed methods, and an integral approach. Although the proposed study protocol may not address all weaknesses of current studies (e.g., self-selection bias, self-reporting of data, the Hawthorne effect), it is innovative in many ways and can be expected to make important contributions to both the scientific and practical debate on how to beat work-related stress and occupational burnout, and on how to enhance work engagement and work performance.

Trial registration

Dutch Trial Register (www.trialregister.nl): NL5581. Registered on 6 July 2016.

Evaluating the Implementation of Ontario's Organ and Tissue Donation Physician Leadership Model: Mapping a Way Forward

Background

The demand for solid organ transplantation has spurred countries around the world to search for innovative policies and practices to increase the supply of organs. Spain has become a global reference point for organ donation with the highest transplantation rates. In Ontario, Canada the Ontario Trillium Gift of Life (TGLN) has sought to replicate some of the successes in Spain. In particular, TGLN's implementation of the Physician Leadership Model has been viewed as a promising strategy to improve donation conversion rates.

Objective

The objective of this study was to evaluate the implementation of TGLNs (TGLN) Physician Leadership Model by examining critical implementation process variables (education/training, communication, satisfaction, participation and reach).

Methods

This mixed-method implementation evaluation included data from all members of the Physician Leadership Model including the Chief Medical Officer, five Regional Medical Leads (RMLs), and the 52 Hospital Donation Physicians (HDPs). Social Network Analysis (SNA) surveys were sent to all 52 HDPs and yielded an 85% rate. Analysis included constructing sociograms and qualitatively analyzing interviews.

Results

TGLN's PLM was poised for success by utilizing the existing RMLs' network as a foundation. The social network analysis measures, particularly participation and reach, indicated the PLM was quite dense (ie, the degree to which members are connected) at baseline. HDPs reported communication to be facilitated by their connections to their RMLs. Early evaluative data indicated that lack of education and training was viewed by HDPs as a barrier, and thus more capacity would need to be directed to this issue. Overall, HDPs reported that various intended outcomes were being met.

Conclusion

We have demonstrated that an implementation evaluation helps us to understand which elements of the PLM were successful and which elements required immediate attention. This evaluation helped to highlight the successes and challenges in implementing the TGLN Physician Leadership Model in Ontario. Social network analysis of publicly funded capacity building systems has been identified as a promising area for health program evaluation to answer questions at a system level, such as identifying service provisions among information exchange networks and ultimately better health care.

Enhancing the social capital in industrial workplaces: Developing workplace interventions using intervention mapping

Social capital in the workplace has been found to be associated with employee wellbeing and work engagement. Yet, evidence of effects of interventions to enhance the social capital are lacking. The intervention mapping method has been described as a useful tool for developing workplace interventions but it is very resource consuming. We aimed to develop an adapted version of the intervention mapping method which is more practically feasible to apply. To get insight into strengths and weaknesses of the adapted method, we applied it and conducted interviews with staff at six companies. The interviews revealed that the action plans developed using the adapted intervention mapping method were generally perceived as relevant and that the action plans had a positive effect on the social capital. However, the implementation of the action plans had been a challenge. In conclusion, the adapted intervention mapping method appears to be suitable for developing interventions to enhance the social capital in the workplace. However, more attention to the implementation of the action plans needs to be incorporated into the method. Suggestions to enhance the implementation included the involvement of the management in the implementation and monitoring of the implementation of the action plans as well as integrating the action plans into existing procedures in the workplace.

Can a workplace leadership intervention reduce job insecurity and improve health? Results from a field study

PURPOSE

To examine the effectiveness of an intervention in the workplace designed to reduce job insecurity among employees affected by organizational change.

METHODS

Supervisors were randomly allocated to an intervention (IG) or waiting-list-control group (CG) and the intervention was administered over a period of 3 months, comprising six group sessions. N = 103 supervisors and their team members (mean age 41.80 ± 9.60 years, 60.19% male) provided data prior to (t0) and 3 months post-intervention (t1) by means of questionnaires and hair samples. Job insecurity (COPSOQ), mental health (HADS) and somatic health (GBB, hair cortisol concentration) were measured.

RESULTS

Job insecurity was reduced to a marginally significant degree in the IG compared to the CG at t1 (B = - 5.78, p = .06, CI [- 11.73, 0.17]). Differential effects for supervisors and team members were not found. No effects on health could be observed overall in the IG, but supervisors in the IG reported a significant decrease in exhaustion tendency (B = - 0.92, p = 0.01, CI [- 1.64, - 0.20]) and a non-significant trend towards higher levels of anxiety (B = 2.98, p = 0.10, CI [- 0.57, 6.54]) compared to team members.

CONCLUSIONS

This is the first study to provide some evidence for the effectiveness of an intervention that aimed at reducing job insecurity during organizational change. Health-related effects were observed in supervisors but not in team members. Further intervention studies are needed to add to the current knowledge base.

Economic evaluations of ergonomic interventions preventing work-related musculoskeletal disorders: a systematic review of organizational-level interventions

BACKGROUND

Work-related musculoskeletal disorders (WMSD) represent a major public health problem and economic burden to employers, workers and health insurance systems. This systematic review had two objectives: (1) to analyze the cost-benefit results of organizational-level ergonomic workplace-based interventions aimed at preventing WMSD, (2) to explore factors related to the implementation process of these interventions (obstacles and facilitating factors) in order to identify whether economic results may be due to a successful or unsuccessful implementation.

METHODS

Systematic review. Studies were searched in eight electronic databases and in reference lists of included studies. Companion papers were identified through backward and forward citation tracking. A quality assessment tool was developed following guidelines available in the literature. An integration of quantitative economic results and qualitative implementation data was conducted following an explanatory sequential design.

RESULTS

Out of 189 records, nine studies met selection criteria and were included in our review. Out of nine included studies, grouped into four types of interventions, seven yielded positive economic results, one produced a negative result and one mixed results (negative cost-effectiveness and positive net benefit). However, the level of evidence was limited for the four types of interventions given the quality and the limited number of studies identified. Our review shows that among the nine included studies, negative and mixed economic results were observed when the dose delivered and received by participants was low, when the support from top and/or middle management was limited either due to limited participation of supervisors in training sessions or a lack of financial resources and when adequacy of intervention to workers' needs was low. In studies where economic results were positive, implementation data showed strong support from supervisors and a high rate of employee participation.

CONCLUSION

Studies investigating the determinants of financial outcomes of prevention related to implementation process are very seldom. We recommend that in future research economic evaluation should include information on the implementation process in order to permit the interpretation of economic results and enhance the generalizability of results. This is also necessary for knowledge transfer and utilization of research results for prevention-oriented decision-making in occupational health and safety.

The effect of an organizational level participatory intervention in secondary vocational education on work-related health outcomes: results of a controlled trial

BACKGROUND

Work-related stress is highly prevalent in the educational sector. The aim of the current study was to evaluate the effectiveness of an organizational level, participatory intervention on need for recovery and vitality in educational workers. It was hypothesized that the intervention would decrease need for recovery and increase vitality.

METHODS

A quasi-experiment was conducted at two secondary Vocational Education and Training schools (N = 356) with 12- and 24-months follow-up measurements. The intervention consisted of 1) a needs assessment phase, wherein staff and teachers developed actions for happy and healthy working under supervision of a facilitator, and 2) an implementation phase, wherein these actions were implemented by the management teams. Mixed model analysis was applied in order to assess the differences between the intervention and control group on average over time. All analyses were corrected for baseline values and several covariates.

RESULTS

No effects of the intervention were found on need for recovery, vitality and most of the secondary outcomes. Two small, statistically significant effects were in unfavorable direction: the intervention group scored on average over time significantly lower on absorption (i.e. a subscale of work engagement) and organizational efficacy than the control group.

CONCLUSIONS

Since no beneficial effects of this intervention were found on the primary and most of the secondary outcomes, further implementation of the intervention in its current form is not eligible. We recommend that future organizational level interventions for occupational health 1) incorporate an elaborate implementation strategy, 2) are more specific in relating actions to stressors in the context, and 3) are integrated with secondary preventive, individual focused stress management interventions.

TRIAL REGISTRATION

Netherlands Trial Register NTR3284 (date registered: February 14 2012).