Process Evaluation of a Worksite Social and Physical Environmental Intervention

Implementation of an organizational intervention to improve low-wage food service workers' safety, health and wellbeing: findings from the Workplace Organizational Health Study

BACKGROUND

Many organizational interventions aim to improve working conditions to promote and protect worker safety, health, and well-being. The Workplace Organizational Health Study used process evaluation to examine factors influencing implementation of an organizational intervention. This paper examines the extent to which the intervention was implemented as planned, the dose of intervention implemented, and ways the organizational context hindered or facilitated the implementation of the intervention.

METHODS

This proof-of-concept trial was conducted with a large, multinational company that provides food service through contractual arrangements with corporate clients. The 13-month intervention was launched in five intervention sites in October 2018. We report findings on intervention implementation based on process tracking and qualitative data. Qualitative data from 25 post-intervention interviews and 89 process tracking documents were coded and thematically analyzed.

RESULTS

Over the 13-month intervention, research team representatives met with site managers monthly to provide consultation and technical assistance on safety and ergonomics, work intensity, and job enrichment. Approximately two-thirds of the planned in-person or phone contacts occurred. We tailored the intervention to each site as we learned more about context, work demands, and relationships. The research team additionally met regularly with senior leadership and district managers, who provided corporate resources and guidance. By assessing the context of the food service setting in which the intervention was situated, we explored factors hindering and facilitating the implementation of the intervention. The financial pressures, competing priorities and the fast-paced work environment placed constraints on site managers' availability and limited the full implementation of the intervention.

CONCLUSIONS

Despite strong support from corporate senior leadership, we encountered barriers in the implementation of the planned intervention at the worksite and district levels. These included financial demands that drove work intensity; turnover of site and district managers disrupting continuity in the implementation of the intervention; and staffing constraints that further increased the work load and pace. Findings underscore the need for ongoing commitment and support from both the parent employer and the host client.

TRIAL REGISTRATION

This study was retrospectively registered with the Clinical Trials. Gov Protocol and Results System on June 2, 2021 with assigned registration number NCT04913168 .

Use of Intervention Mapping for Occupational Risk Prevention and Health Promotion: A Systematic Review of Literature

Aim: Intervention mapping (IM) is a method to systematically design interventions that is applied regularly within the public health domain. This study investigates whether IM is effectively used within the occupational safety and health domain as well. Specifically, this study explores the relation between the fidelity regarding the use of the IM protocol for intervention development, the implementation process and the effectiveness of the occupational risk prevention and health promotion interventions. Methods: A systematic review was conducted including articles on development, implementation, and effects of occupational risk prevention and health promotion interventions that were developed according to the IM-protocol. By means of a checklist, two authors reviewed the articles and rated them on several indicators regarding the fidelity of the IM-protocol, the implementation process, and the intervention effect. Results: A literature search resulted in a total of 12 interventions as described in 38 articles. The fidelity to the IM-protocol was relatively low for participation throughout the development process and implementation planning. No relationship was found between fidelity of the IM-protocol and the intervention effect. A theory-based approach (as one of the core elements of IM) appears to be positively related to a successful implementation process. Conclusion: Results of the review suggest that organizing a participative approach and implementation planning is difficult in practice. In addition, results imply that conducting matrices of change objectives as part of the intervention development, although challenging and time-consuming, may ultimately pay off, resulting in a tailored intervention that matches the target group.

Variation in the operationalisation of dose in implementation of health promotion interventions: insights and recommendations from a scoping review

BACKGROUND

While 'dose' is broadly understood as the 'amount' of an intervention, there is considerable variation in how this concept is defined. How we conceptualise, and subsequently measure, the dose of interventions has important implications for understanding how interventions produce their effects and are subsequently resourced and scaled up. This paper aims to explore the degree to which dose is currently understood as a distinct and well-defined implementation concept outside of clinical settings.

METHODS

We searched four databases (MEDLINE, PsycINFO, EBM Reviews and Global Health) to identify original research articles published between 2000 and 2015 on health promotion interventions that contained the word 'dose' or 'dosage' in the title, abstract or keywords. We identified 130 articles meeting inclusion criteria and extracted data on how dose/dosage was defined and operationalised, which we then synthesised to reveal key themes in the use of this concept across health promotion interventions.

RESULTS

Dose was defined in a variety of ways, including in relation to the amount of intervention delivered and/or received, the level of participation in the intervention and, in some instances, the quality of intervention delivery. We also observed some conflation of concepts that are traditionally kept separate (such as fidelity) either as slippage or as part of composite measures (such as 'intervention dose').

DISCUSSION

Dose is not a well-defined or consistently applied concept in evaluations of health promotion interventions. While current approaches to conceptualisation and measurement of dose are suitable for interventions in organisational settings, they are less well suited to policies delivered at a population level. Dose often accompanies a traditional monotonic linear view of causality (e.g. dose response) which may or may not fully represent the intervention's theory of how change is brought about. Finally, we found dose and dosage to be used interchangeably. We recommend a distinction between these terms, with 'dosage' having the advantage of capturing change to amount 'dispensed' over time (in response to effects achieved). Dosage therefore acknowledges the inevitable dynamic and complexity of implementation.

Digital Interventions to Reduce Sedentary Behaviors of Office Workers: Scoping Review

BACKGROUND

There is a clear public health need to reduce office workers' sedentary behaviors (SBs), especially in the workplace. Digital technologies are increasingly being deployed in the workplace to measure and modify office workers' SBs. However, knowledge of the range and nature of research on this topic is limited; it also remains unclear to what extent digital interventions have exploited the technological possibilities.

OBJECTIVE

This study aimed to investigate the technological landscape of digital interventions for SB reduction in office workers and to map the research activity in this field.

METHODS

Terms related to SB, office worker, and digital technology were applied in various combinations to search Cochrane Library, Joanna Briggs Institute Database of Systematic Reviews, MEDLINE, PsycARTICLES, PsycINFO, Scopus, Association for Computing Machinery Digital Library, Engineering index Compendex, and Google Scholar for the years 2000 to 2017. Data regarding the study and intervention details were extracted. Interventions and studies were categorized into development, feasibility and/piloting, evaluation, or implementation phase based on the UK Medical Research Council (MRC) framework for developing and evaluating complex interventions. A novel framework was developed to classify technological features and annotate technological configurations. A mix of quantitative and qualitative approaches was used to summarize data.

RESULTS

We identified 68 articles describing 45 digital interventions designed to intervene with office workers' SB. A total of 6 common technological features had been applied to interventions with various combinations. Configurations such as "information delivery and mediated organizational and social support" and "digital log and automated tailored feedback" were well established in evaluation and implementation studies; in contrast, the integration of passive data collection, connected devices, and ATF or scheduled prompts was mostly present in development and piloting research.

CONCLUSIONS

This review is the first to map and describe the use of digital technologies in research on SB reduction in office workers. Interdisciplinary collaborations can help to maximize the potential of technologies. As novel modes of delivery that capitalize on embedded computing and electronics, wireless technologies have been developed and piloted in engineering, computing, and design fields, efforts can be directed to move them to the next phase of evaluation with more rigorous study designs. Quality of research may be improved by fostering conversations between different research communities and encouraging researchers to plan, conduct, and report their research under the MRC framework. This review will be particularly informative to those deciding on areas where further research or development is needed and to those looking to locate the relevant expertise, resources, and design inputs when designing their own systems or interventions.

Workplace interventions for reducing sitting at work

BACKGROUND

A large number of people are employed in sedentary occupations. Physical inactivity and excessive sitting at workplaces have been linked to increased risk of cardiovascular disease, obesity, and all-cause mortality.

OBJECTIVES

To evaluate the effectiveness of workplace interventions to reduce sitting at work compared to no intervention or alternative interventions.

SEARCH METHODS

We searched the Cochrane Central Register of Controlled Trials (CENTRAL), MEDLINE, Embase, CINAHL, OSH UPDATE, PsycINFO, ClinicalTrials.gov, and the World Health Organization (WHO) International Clinical Trials Registry Platform (ICTRP) search portal up to 9 August 2017. We also screened reference lists of articles and contacted authors to find more studies.

SELECTION CRITERIA

We included randomised controlled trials (RCTs), cross-over RCTs, cluster-randomised controlled trials (cluster-RCTs), and quasi-RCTs of interventions to reduce sitting at work. For changes of workplace arrangements, we also included controlled before-and-after studies. The primary outcome was time spent sitting at work per day, either self-reported or measured using devices such as an accelerometer-inclinometer and duration and number of sitting bouts lasting 30 minutes or more. We considered energy expenditure, total time spent sitting (including sitting at and outside work), time spent standing at work, work productivity and adverse events as secondary outcomes.

DATA COLLECTION AND ANALYSIS

Two review authors independently screened titles, abstracts and full-text articles for study eligibility. Two review authors independently extracted data and assessed risk of bias. We contacted authors for additional data where required.

MAIN RESULTS

We found 34 studies - including two cross-over RCTs, 17 RCTs, seven cluster-RCTs, and eight controlled before-and-after studies - with a total of 3,397 participants, all from high-income countries. The studies evaluated physical workplace changes (16 studies), workplace policy changes (four studies), information and counselling (11 studies), and multi-component interventions (four studies). One study included both physical workplace changes and information and counselling components. We did not find any studies that specifically investigated the effects of standing meetings or walking meetings on sitting time.Physical workplace changesInterventions using sit-stand desks, either alone or in combination with information and counselling, reduced sitting time at work on average by 100 minutes per workday at short-term follow-up (up to three months) compared to sit-desks (95% confidence interval (CI) -116 to -84, 10 studies, low-quality evidence). The pooled effect of two studies showed sit-stand desks reduced sitting time at medium-term follow-up (3 to 12 months) by an average of 57 minutes per day (95% CI -99 to -15) compared to sit-desks. Total sitting time (including sitting at and outside work) also decreased with sit-stand desks compared to sit-desks (mean difference (MD) -82 minutes/day, 95% CI -124 to -39, two studies) as did the duration of sitting bouts lasting 30 minutes or more (MD -53 minutes/day, 95% CI -79 to -26, two studies, very low-quality evidence).We found no significant difference between the effects of standing desks and sit-stand desks on reducing sitting at work. Active workstations, such as treadmill desks or cycling desks, had unclear or inconsistent effects on sitting time.Workplace policy changesWe found no significant effects for implementing walking strategies on workplace sitting time at short-term (MD -15 minutes per day, 95% CI -50 to 19, low-quality evidence, one study) and medium-term (MD -17 minutes/day, 95% CI -61 to 28, one study) follow-up. Short breaks (one to two minutes every half hour) reduced time spent sitting at work on average by 40 minutes per day (95% CI -66 to -15, one study, low-quality evidence) compared to long breaks (two 15-minute breaks per workday) at short-term follow-up.Information and counsellingProviding information, feedback, counselling, or all of these resulted in no significant change in time spent sitting at work at short-term follow-up (MD -19 minutes per day, 95% CI -57 to 19, two studies, low-quality evidence). However, the reduction was significant at medium-term follow-up (MD -28 minutes per day, 95% CI -51 to -5, two studies, low-quality evidence).Computer prompts combined with information resulted in no significant change in sitting time at work at short-term follow-up (MD -14 minutes per day, 95% CI -39 to 10, three studies, low-quality evidence), but at medium-term follow-up they produced a significant reduction (MD -55 minutes per day, 95% CI -96 to -14, one study). Furthermore, computer prompting resulted in a significant decrease in the average number (MD -1.1, 95% CI -1.9 to -0.3, one study) and duration (MD -74 minutes per day, 95% CI -124 to -24, one study) of sitting bouts lasting 30 minutes or more.Computer prompts with instruction to stand reduced sitting at work on average by 14 minutes per day (95% CI 10 to 19, one study) more than computer prompts with instruction to walk at least 100 steps at short-term follow-up.We found no significant reduction in workplace sitting time at medium-term follow-up following mindfulness training (MD -23 minutes per day, 95% CI -63 to 17, one study, low-quality evidence). Similarly a single study reported no change in sitting time at work following provision of highly personalised or contextualised information and less personalised or contextualised information. One study found no significant effects of activity trackers on sitting time at work.Multi-component interventions Combining multiple interventions had significant but heterogeneous effects on sitting time at work (573 participants, three studies, very low-quality evidence) and on time spent in prolonged sitting bouts (two studies, very low-quality evidence) at short-term follow-up.

AUTHORS' CONCLUSIONS

At present there is low-quality evidence that the use of sit-stand desks reduce workplace sitting at short-term and medium-term follow-ups. However, there is no evidence on their effects on sitting over longer follow-up periods. Effects of other types of interventions, including workplace policy changes, provision of information and counselling, and multi-component interventions, are mostly inconsistent. The quality of evidence is low to very low for most interventions, mainly because of limitations in study protocols and small sample sizes. There is a need for larger cluster-RCTs with longer-term follow-ups to determine the effectiveness of different types of interventions to reduce sitting time at work.

Strategies to improve the implementation of workplace-based policies or practices targeting tobacco, alcohol, diet, physical activity and obesity

BACKGROUND

Given the substantial period of time adults spend in their workplaces each day, these provide an opportune setting for interventions addressing modifiable behavioural risk factors for chronic disease. Previous reviews of trials of workplace-based interventions suggest they can be effective in modifying a range of risk factors including diet, physical activity, obesity, risky alcohol use and tobacco use. However, such interventions are often poorly implemented in workplaces, limiting their impact on employee health. Identifying strategies that are effective in improving the implementation of workplace-based interventions has the potential to improve their effects on health outcomes.

OBJECTIVES

To assess the effects of strategies for improving the implementation of workplace-based policies or practices targeting diet, physical activity, obesity, tobacco use and alcohol use.Secondary objectives were to assess the impact of such strategies on employee health behaviours, including dietary intake, physical activity, weight status, and alcohol and tobacco use; evaluate their cost-effectiveness; and identify any unintended adverse effects of implementation strategies on workplaces or workplace staff.

SEARCH METHODS

We searched the following electronic databases on 31 August 2017: CENTRAL; MEDLINE; MEDLINE In Process; the Campbell Library; PsycINFO; Education Resource Information Center (ERIC); Cumulative Index to Nursing and Allied Health Literature (CINAHL); and Scopus. We also handsearched all publications between August 2012 and September 2017 in two speciality journals: Implementation Science and Journal of Translational Behavioral Medicine. We conducted searches up to September 2017 in Dissertations and Theses, the WHO International Clinical Trials Registry Platform, and the US National Institutes of Health Registry. We screened the reference lists of included trials and contacted authors to identify other potentially relevant trials. We also consulted experts in the field to identify other relevant research.

SELECTION CRITERIA

Implementation strategies were defined as strategies specifically employed to improve the implementation of health interventions into routine practice within specific settings. We included any trial with a parallel control group (randomised or non-randomised) and conducted at any scale that compared strategies to support implementation of workplace policies or practices targeting diet, physical activity, obesity, risky alcohol use or tobacco use versus no intervention (i.e. wait-list, usual practice or minimal support control) or another implementation strategy. Implementation strategies could include those identified by the Effective Practice and Organisation of Care (EPOC) taxonomy such as quality improvement initiatives and education and training, as well as other strategies. Implementation interventions could target policies or practices directly instituted in the workplace environment, as well as workplace-instituted efforts encouraging the use of external health promotion services (e.g. gym membership subsidies).

DATA COLLECTION AND ANALYSIS

Review authors working in pairs independently performed citation screening, data extraction and 'Risk of bias' assessment, resolving disagreements via consensus or a third reviewer. We narratively synthesised findings for all included trials by first describing trial characteristics, participants, interventions and outcomes. We then described the effect size of the outcome measure for policy or practice implementation. We performed meta-analysis of implementation outcomes for trials of comparable design and outcome.

MAIN RESULTS

We included six trials, four of which took place in the USA. Four trials employed randomised controlled trial (RCT) designs. Trials were conducted in workplaces from the manufacturing, industrial and services-based sectors. The sample sizes of workplaces ranged from 12 to 114. Workplace policies and practices targeted included: healthy catering policies; point-of-purchase nutrition labelling; environmental supports for healthy eating and physical activity; tobacco control policies; weight management programmes; and adherence to guidelines for staff health promotion. All implementation interventions utilised multiple implementation strategies, the most common of which were educational meetings, tailored interventions and local consensus processes. Four trials compared an implementation strategy intervention with a no intervention control, one trial compared different implementation interventions, and one three-arm trial compared two implementation strategies with each other and a control. Four trials reported a single implementation outcome, whilst the other two reported multiple outcomes. Investigators assessed outcomes using surveys, audits and environmental observations. We judged most trials to be at high risk of performance and detection bias and at unclear risk of reporting and attrition bias.Of the five trials comparing implementation strategies with a no intervention control, pooled analysis was possible for three RCTs reporting continuous score-based measures of implementation outcomes. The meta-analysis found no difference in standardised effects (standardised mean difference (SMD) -0.01, 95% CI -0.32 to 0.30; 164 participants; 3 studies; low certainty evidence), suggesting no benefit of implementation support in improving policy or practice implementation, relative to control. Findings for other continuous or dichotomous implementation outcomes reported across these five trials were mixed. For the two non-randomised trials examining comparative effectiveness, both reported improvements in implementation, favouring the more intensive implementation group (very low certainty evidence). Three trials examined the impact of implementation strategies on employee health behaviours, reporting mixed effects for diet and weight status (very low certainty evidence) and no effect for physical activity (very low certainty evidence) or tobacco use (low certainty evidence). One trial reported an increase in absolute workplace costs for health promotion in the implementation group (low certainty evidence). None of the included trials assessed adverse consequences. Limitations of the review included the small number of trials identified and the lack of consistent terminology applied in the implementation science field, which may have resulted in us overlooking potentially relevant trials in the search.

AUTHORS' CONCLUSIONS

Available evidence regarding the effectiveness of implementation strategies for improving implementation of health-promoting policies and practices in the workplace setting is sparse and inconsistent. Low certainty evidence suggests that such strategies may make little or no difference on measures of implementation fidelity or different employee health behaviour outcomes. It is also unclear if such strategies are cost-effective or have potential unintended adverse consequences. The limited number of trials identified suggests implementation research in the workplace setting is in its infancy, warranting further research to guide evidence translation in this setting.

Workplace interventions for reducing sitting at work

BACKGROUND

A large number of people are employed in sedentary occupations. Physical inactivity and excessive sitting at workplaces have been linked to increased risk of cardiovascular disease, obesity, and all-cause mortality.

OBJECTIVES

To evaluate the effectiveness of workplace interventions to reduce sitting at work compared to no intervention or alternative interventions.

SEARCH METHODS

We searched the Cochrane Central Register of Controlled Trials (CENTRAL), MEDLINE, Embase, CINAHL, OSH UPDATE, PsycINFO, ClinicalTrials.gov, and the World Health Organization (WHO) International Clinical Trials Registry Platform (ICTRP) search portal up to 9 August 2017. We also screened reference lists of articles and contacted authors to find more studies.

SELECTION CRITERIA

We included randomised controlled trials (RCTs), cross-over RCTs, cluster-randomised controlled trials (cluster-RCTs), and quasi-RCTs of interventions to reduce sitting at work. For changes of workplace arrangements, we also included controlled before-and-after studies. The primary outcome was time spent sitting at work per day, either self-reported or measured using devices such as an accelerometer-inclinometer and duration and number of sitting bouts lasting 30 minutes or more. We considered energy expenditure, total time spent sitting (including sitting at and outside work), time spent standing at work, work productivity and adverse events as secondary outcomes.

DATA COLLECTION AND ANALYSIS

Two review authors independently screened titles, abstracts and full-text articles for study eligibility. Two review authors independently extracted data and assessed risk of bias. We contacted authors for additional data where required.

MAIN RESULTS

We found 34 studies - including two cross-over RCTs, 17 RCTs, seven cluster-RCTs, and eight controlled before-and-after studies - with a total of 3,397 participants, all from high-income countries. The studies evaluated physical workplace changes (16 studies), workplace policy changes (four studies), information and counselling (11 studies), and multi-component interventions (four studies). One study included both physical workplace changes and information and counselling components. We did not find any studies that specifically investigated the effects of standing meetings or walking meetings on sitting time.Physical workplace changesInterventions using sit-stand desks, either alone or in combination with information and counselling, reduced sitting time at work on average by 100 minutes per workday at short-term follow-up (up to three months) compared to sit-desks (95% confidence interval (CI) -116 to -84, 10 studies, low-quality evidence). The pooled effect of two studies showed sit-stand desks reduced sitting time at medium-term follow-up (3 to 12 months) by an average of 57 minutes per day (95% CI -99 to -15) compared to sit-desks. Total sitting time (including sitting at and outside work) also decreased with sit-stand desks compared to sit-desks (mean difference (MD) -82 minutes/day, 95% CI -124 to -39, two studies) as did the duration of sitting bouts lasting 30 minutes or more (MD -53 minutes/day, 95% CI -79 to -26, two studies, very low-quality evidence).We found no significant difference between the effects of standing desks and sit-stand desks on reducing sitting at work. Active workstations, such as treadmill desks or cycling desks, had unclear or inconsistent effects on sitting time.Workplace policy changesWe found no significant effects for implementing walking strategies on workplace sitting time at short-term (MD -15 minutes per day, 95% CI -50 to 19, low-quality evidence, one study) and medium-term (MD -17 minutes/day, 95% CI -61 to 28, one study) follow-up. Short breaks (one to two minutes every half hour) reduced time spent sitting at work on average by 40 minutes per day (95% CI -66 to -15, one study, low-quality evidence) compared to long breaks (two 15-minute breaks per workday) at short-term follow-up.Information and counsellingProviding information, feedback, counselling, or all of these resulted in no significant change in time spent sitting at work at short-term follow-up (MD -19 minutes per day, 95% CI -57 to 19, two studies, low-quality evidence). However, the reduction was significant at medium-term follow-up (MD -28 minutes per day, 95% CI -51 to -5, two studies, low-quality evidence).Computer prompts combined with information resulted in no significant change in sitting time at work at short-term follow-up (MD -10 minutes per day, 95% CI -45 to 24, two studies, low-quality evidence), but at medium-term follow-up they produced a significant reduction (MD -55 minutes per day, 95% CI -96 to -14, one study). Furthermore, computer prompting resulted in a significant decrease in the average number (MD -1.1, 95% CI -1.9 to -0.3, one study) and duration (MD -74 minutes per day, 95% CI -124 to -24, one study) of sitting bouts lasting 30 minutes or more.Computer prompts with instruction to stand reduced sitting at work on average by 14 minutes per day (95% CI 10 to 19, one study) more than computer prompts with instruction to walk at least 100 steps at short-term follow-up.We found no significant reduction in workplace sitting time at medium-term follow-up following mindfulness training (MD -23 minutes per day, 95% CI -63 to 17, one study, low-quality evidence). Similarly a single study reported no change in sitting time at work following provision of highly personalised or contextualised information and less personalised or contextualised information. One study found no significant effects of activity trackers on sitting time at work.Multi-component interventions Combining multiple interventions had significant but heterogeneous effects on sitting time at work (573 participants, three studies, very low-quality evidence) and on time spent in prolonged sitting bouts (two studies, very low-quality evidence) at short-term follow-up.

AUTHORS' CONCLUSIONS

At present there is low-quality evidence that the use of sit-stand desks reduce workplace sitting at short-term and medium-term follow-ups. However, there is no evidence on their effects on sitting over longer follow-up periods. Effects of other types of interventions, including workplace policy changes, provision of information and counselling, and multi-component interventions, are mostly inconsistent. The quality of evidence is low to very low for most interventions, mainly because of limitations in study protocols and small sample sizes. There is a need for larger cluster-RCTs with longer-term follow-ups to determine the effectiveness of different types of interventions to reduce sitting time at work.

Implementation of an ergonomics intervention in a Swedish flight baggage handling company-A process evaluation

Objective

To conduct a process evaluation of the implementation of an ergonomics training program aimed at increasing the use of loading assist devices in flight baggage handling.

Methods

Feasibility related to the process items recruitment, reach, context, dose delivered (training time and content); dose received (participants’ engagement); satisfaction with training; intermediate outcomes (skills, confidence and behaviors); and barriers and facilitators of the training intervention were assessed by qualitative and quantitative methods.

Results

Implementation proved successful regarding dose delivered, dose received and satisfaction. Confidence among participants in the training program in using and talking about devices, observed use of devices among colleagues, and internal feedback on work behavior increased significantly (p<0.01). Main facilitators were self-efficacy, motivation, and perceived utility of training among the trainees. Barriers included lack of peer support, opportunities to observe and practice behaviors, and follow-up activities; as well as staff reduction and job insecurity.

Conclusions

In identifying important barriers and facilitators for a successful outcome, this study can help supporting the effectiveness of future interventions. Our results suggest that barriers caused by organizational changes may likely be alleviated by recruiting motivated trainees and securing strong organizational support for the implementation.

Process Evaluation of a Workers' Health Surveillance Program for Meat Processing Workers

Objective To evaluate the implementation process of a workers' health surveillance (WHS) program in a Dutch meat processing company. Methods Workers from five plants were eligible to participate in the WHS program. The program consisted of four evaluative components and an intervention component. Qualitative and quantitative methods were used to evaluate seven process aspects. Data were gathered by interviews with stakeholders, participant questionnaires, and from registries of the company and occupational health service. Results Two recruitment strategies were used: open invitation or automatic participation. Of the 986 eligible workers, 305 participated in the program. Average reach was 53 %. Two out of five program components could not be assessed on dose delivered, dose received and fidelity. If components were assessable, 85-100 % of the components was delivered, 66-100 % of the components was received by participants, and fidelity was 100 %. Participants were satisfied with the WHS program (mean score 7.6). Contextual factors that facilitated implementation were among others societal developments and management support. Factors that formed barriers were program novelty and delayed follow-up. Conclusion The WHS program was well received by participants. Not all participants were offered the same number of program components, and not all components were performed according to protocol. Deviation from protocol is an indication of program failure and may affect program effectiveness.

Evaluating the implementation process of a participatory organizational level occupational health intervention in schools

BACKGROUND

The importance of process evaluations in examining how and why interventions are (un) successful is increasingly recognized. Process evaluations mainly studied the implementation process and the quality of the implementation (fidelity). However, in adopting this approach for participatory organizational level occupational health interventions, important aspects such as context and participants perceptions are missing. Our objective was to systematically describe the implementation process of a participatory organizational level occupational health intervention aimed at reducing work stress and increasing vitality in two schools by applying a framework that covers aspects of the intervention and its implementation as well as the context and participants perceptions.

METHODS

A program theory was developed, describing the requirements for successful implementation. Each requirement was operationalized by making use of the framework, covering: initiation, communication, participation, fidelity, reach, communication, satisfaction, management support, targeting, delivery, exposure, culture, conditions, readiness for change and perceptions. The requirements were assessed by quantitative and qualitative data, collected at 12 and 24 months after baseline in both schools (questionnaire and interviews) or continuously (logbooks).

RESULTS

The intervention consisted of a needs assessment phase and a phase of implementing intervention activities. The needs assessment phase was implemented successfully in school A, but not in school B where participation and readiness for change were insufficient. In the second phase, several intervention activities were implemented at school A, whereas this was only partly the case in school B (delivery). In both schools, however, participants felt not involved in the choice of intervention activities (targeting, participation, support), resulting in a negative perception of and only partial exposure to the intervention activities. Conditions, culture and events hindered the implementation of intervention activities in both schools.

CONCLUSIONS

The framework helped us to understand why the implementation process was not successful. It is therefore considered of added value for the evaluation of implementation processes in participatory organizational level interventions, foremost because of the context and mental models dimensions. However, less demanding methods for doing detailed process evaluations need to be developed. This can only be done if we know more about the most important process components and this study contributes to that knowledge base.

TRIAL REGISTRATION

Netherlands Trial Register NTR3284 .

Methods used to address fidelity of receipt in health intervention research: a citation analysis and systematic review

BACKGROUND

The American Behaviour Change Consortium (BCC) framework acknowledges patients as active participants and supports the need to investigate the fidelity with which they receive interventions, i.e. receipt. According to this framework, addressing receipt consists in using strategies to assess or enhance participants' understanding and/or performance of intervention skills. This systematic review aims to establish the frequency with which receipt is addressed as defined in the BCC framework in health research, and to describe the methods used in papers informed by the BCC framework and in the wider literature.

METHODS

A forward citation search on papers presenting the BCC framework was performed to determine the frequency with which receipt as defined in this framework was addressed. A second electronic database search, including search terms pertaining to fidelity, receipt, health and process evaluations was performed to identify papers reporting on receipt in the wider literature and irrespective of the framework used. These results were combined with forward citation search results to review methods to assess receipt. Eligibility criteria and data extraction forms were developed and applied to papers. Results are described in a narrative synthesis.

RESULTS

19.6% of 33 studies identified from the forward citation search to report on fidelity were found to address receipt. In 60.6% of these, receipt was assessed in relation to understanding and in 42.4% in relation to performance of skill. Strategies to enhance these were present in 12.1% and 21.1% of studies, respectively. Fifty-five studies were included in the review of the wider literature. Several frameworks and operationalisations of receipt were reported, but the latter were not always consistent with the guiding framework. Receipt was most frequently operationalised in relation to intervention content (16.4%), satisfaction (14.5%), engagement (14.5%), and attendance (14.5%). The majority of studies (90.0%) included subjective assessments of receipt. These relied on quantitative (76.0%) rather than qualitative (42.0%) methods and studies collected data on intervention recipients (50.0%), intervention deliverers (28.0%), or both (22.0%). Few studies (26.0%) reported on the reliability or validity of methods used.

CONCLUSIONS

Receipt is infrequently addressed in health research and improvements to methods of assessment and reporting are required.

Physical activity and relaxation in the work setting to reduce the need for recovery: what works for whom?

Background

To recover from work stress, a worksite health program aimed at improving physical activity and relaxation may be valuable. However, not every program is effective for all participants, as would be expected within a “one size fits all” approach. The effectiveness of how the program is delivered may differ across individuals. The aim of this study was to identify subgroups for whom one intervention may be better suited than another by using a new method called QUalitative INteraction Trees (QUINT).

Methods

Data were used from the “Be Active & Relax” study, in which 329 office workers participated. Two delivery modes of a worksite health program were given, a social environmental intervention (group motivational interviewing delivered by team leaders) and a physical environmental intervention (environmental modifications). The main outcome was change in Need for Recovery (NFR) from baseline to 12 month follow-up. The QUINT method was used to identify subgroups that benefitted more from either type of delivery mode, by incorporating moderator variables concerning sociodemographic, health, home, and work-related characteristics of the participants.

Results

The mean improvement in NFR of younger office workers in the social environmental intervention group was significantly higher than younger office workers who did not receive the social environmental intervention (10.52; 95 % CI: 4.12, 16.92). Furthermore, the mean improvement in NFR of older office workers in the social environmental intervention group was significantly lower than older office workers who did not receive the social environmental intervention ( −10.65; 95 % CI: −19.35, −1.96). The results for the physical environmental intervention indicated that the mean improvement in NFR of office workers (regardless of age) who worked fewer hours overtime was significantly higher when they had received the physical environmental intervention than when they had not received this type of intervention (7.40; 95 % CI: 0.99, 13.81). Finally, for office workers who worked more hours overtime there was no effect of the physical environmental intervention.

Conclusions

The results suggest that a social environmental intervention might be more beneficial for younger workers, and a physical environmental intervention might be more beneficial for employees with a few hours overtime to reduce the NFR.

Trial registration

NTR2553

Workplace interventions for reducing sitting at work

BACKGROUND

Office work has changed considerably over the previous couple of decades and has become sedentary in nature. Physical inactivity at workplaces and particularly increased sitting has been linked to increase in cardiovascular disease, obesity and overall mortality.

OBJECTIVES

To evaluate the effects of workplace interventions to reduce sitting at work compared to no intervention or alternative interventions.

SEARCH METHODS

We searched the Cochrane Central Register of Controlled Trials (CENTRAL), MEDLINE, EMBASE, CINAHL, OSH UPDATE, PsycINFO, Clinical trials.gov and the World Health Organization (WHO) International Clinical Trials Registry Platform (ICTRP) search portal up to 2 June, 2015. We also screened reference lists of articles and contacted authors to find more studies to include.

SELECTION CRITERIA

We included randomised controlled trials (RCTs), cluster-randomised controlled trials (cRCTs), and quasi-randomised controlled trials of interventions to reduce sitting at work. For changes of workplace arrangements, we also included controlled before-and-after studies (CBAs) with a concurrent control group. The primary outcome was time spent sitting at work per day, either self-reported or objectively measured by means of an accelerometer-inclinometer. We considered energy expenditure, duration and number of sitting episodes lasting 30 minutes or more, work productivity and adverse events as secondary outcomes.

DATA COLLECTION AND ANALYSIS

Two review authors independently screened titles, abstracts and full-text articles for study eligibility. Two review authors independently extracted data and assessed risk of bias. We contacted authors for additional data where required.

MAIN RESULTS

We included 20 studies, two cross-over RCTs, 11 RCTs, three cRCTs and four CBAs, with a total of 2180 participants from high income nations. The studies evaluated physical workplace changes (nine studies), policy changes (two studies), information and counselling (seven studies) and interventions from multiple categories (two studies). One study had both physical workplace changes and information and counselling components. We did not find any studies that had investigated the effect of periodic breaks or standing or walking meetings. Physical workplace changesA sit-stand desk alone compared to no intervention reduced sitting time at work per workday with between thirty minutes to two hours at short term (up to three months) follow-up (six studies, 218 participants, very low quality evidence). In two studies, sit-stand desks with additional counselling reduced sitting time at work in the same range at short-term follow-up (61 participants, very low quality evidence). One study found a reduction at six months' follow-up of -56 minutes (95% CI -101 to -12, very low quality evidence) compared to no intervention. Also total sitting time at work and outside work decreased with sit-stand desks compared to no intervention (MD -78 minutes, 95% CI -125 to -31, one study) as did the duration of sitting episodes lasting 30 minutes or more (MD -52 minutes, 95% CI -79 to -26, two studies). This is considerably less than the two to four hours recommended by experts. Sit-stand desks did not have a considerable effect on work performance, musculoskeletal symptoms or sick leave. It remains unclear if standing can repair the harms of sitting because there is hardly any extra energy expenditure.The effects of active workstations were inconsistent. Treadmill desks combined with counselling reduced sitting time at work (MD -29 minutes, 95% CI -55 to -2, one study) compared to no intervention at 12 weeks' follow-up. Pedalling workstations combined with information did not reduce inactive sitting at work considerably (MD -12 minutes, 95% CI -24 to 1, one study) compared to information alone at 16 weeks' follow-up. The quality of evidence was low for active workstations. Policy changesTwo studies with 443 participants provided low quality evidence that walking strategies did not have a considerable effect on workplace sitting time at 10 weeks' (MD -16 minutes, 95% CI -54 to 23) or 21 weeks' (MD -17 minutes, 95% CI -58 to 25) follow-up respectively. Information and counsellingCounselling reduced sitting time at work (MD -28 minutes, 95% CI -52 to -5, two studies, low quality evidence) at medium term (three months to 12 months) follow-up. Mindfulness training did not considerably reduce workplace sitting time (MD -2 minutes, 95% CI -22 to 18) at six months' follow-up and at 12 months' follow-up (MD -16 minutes, 95% CI -45 to 12, one study, low quality evidence). There was no considerable increase in work engagement with counselling.There was an inconsistent effect of computer prompting on sitting time at work. One study found no considerable effect on sitting at work (MD -17 minutes, 95% CI -48 to 14, low quality evidence) at 10 days' follow-up, while another study reported a significant reduction in sitting at work (MD -55 minutes, 95% CI -96 to -14, low quality evidence) at 13 weeks' follow-up. Computer prompts to stand reduced sitting at work by 14 minutes more (95% CI 10 to 19, one study) compared to computer prompts to step at six days' follow-up. Computer prompts did not change the number of sitting episodes that last 30 minutes or longer. Interventions from multiple categories Interventions combining multiple categories had an inconsistent effect on sitting time at work, with a reduction in sitting time at 12 weeks' (25 participants, very low quality evidence) and six months' (294 participants, low quality evidence) follow-up in two studies but no considerable effect at 12 months' follow-up in one study (MD -47.98, 95% CI -103 to 7, 294 participants, low quality evidence).

AUTHORS' CONCLUSIONS

At present there is very low to low quality evidence that sit-stand desks may decrease workplace sitting between thirty minutes to two hours per day without having adverse effects at the short or medium term. There is no evidence on the effects in the long term. There were no considerable or inconsistent effects of other interventions such as changing work organisation or information and counselling. There is a need for cluster-randomised trials with a sufficient sample size and long term follow-up to determine the effectiveness of different types of interventions to reduce objectively measured sitting time at work.

Implementation of the participatory approach for supervisors to prevent sick leave: a process evaluation

Purpose

To perform a process evaluation of a multifaceted strategy to implement the participatory approach for supervisors to prevent sick leave in three organisations.

Methods

The implementation strategy incorporated a working group meeting with stakeholder representatives, supervisor training, and optional supervisor coaching. Context, recruitment, reach, dose delivered, dose received, fidelity, and satisfaction with the strategy were assessed at organisational and supervisor level using questionnaires and registration forms.

Results

At least 4 out of 6 stakeholders were represented in the working group meetings, and 11 % (n = 116) of supervisors could be reached. The working group meetings and supervisor training were delivered and received as planned and were well appreciated within all three organisations. Three supervisors made use of coaching. At 6-month follow-up, 11 out of 41 supervisors (27 %) indicated that they had applied the participatory approach at least one time.

Conclusion

The implementation strategy was largely carried out as intended. However, reach of both supervisors and department managers should be improved. Future studies should consider targeting employees with the strategy.

Effectiveness of a worksite social & physical environment intervention on need for recovery, physical activity and relaxation; results of a randomized controlled trial

Objective

To investigate the effectiveness of a worksite social and physical environment intervention on need for recovery (i.e., early symptoms of work-related mental and physical fatigue), physical activity and relaxation. Also, the effectiveness of the separate interventions was investigated.

Methods

In this 2×2 factorial design study, 412 office employees from a financial service provider participated. Participants were allocated to the combined social and physical intervention, to the social intervention only, to the physical intervention only or to the control group. The primary outcome measure was need for recovery. Secondary outcomes were work-related stress (i.e., exhaustion, detachment and relaxation), small breaks, physical activity (i.e., stair climbing, active commuting, sport activities, light/moderate/vigorous physical activity) and sedentary behavior. Outcomes were measured by questionnaires at baseline, 6 and 12 months follow-up. Multilevel analyses were performed to investigate the effects of the three interventions.

Results

In all intervention groups, a non-significant reduction was found in need for recovery. In the combined intervention (n = 92), exhaustion and vigorous physical activities decreased significantly, and small breaks at work and active commuting increased significantly compared to the control group. The social intervention (n = 118) showed a significant reduction in exhaustion, sedentary behavior at work and a significant increase in small breaks at work and leisure activities. In the physical intervention (n = 96), stair climbing at work and active commuting significantly increased, and sedentary behavior at work decreased significantly compared to the control group.

Conclusion

None of the interventions was effective in improving the need for recovery. It is recommended to implement the social and physical intervention among a population with higher baseline values of need for recovery. Furthermore, the intervention itself could be improved by increasing the intensity of the intervention (for example weekly GMI-sessions), providing physical activity opportunities and exercise schemes, and by more drastic environment interventions (restructuring entire department floor).

Trial Registration

Nederlands Trial Register NTR2553