Reducing the Strength: a mixed methods evaluation of alcohol retailers' willingness to voluntarily reduce the availability of low cost, high strength beers and ciders in two UK local authorities

Public health engagement in alcohol licensing in England and Scotland: the ExILEnS mixed-method, natural experiment evaluation

Background

International systematic reviews suggest an association between alcohol availability and increased alcohol-related harms. Alcohol availability is regulated through separate locally administered licensing systems in England and Scotland, in which local public health teams have a statutory role. The system in Scotland includes a public health objective for licensing. Public health teams engage to varying degrees in licensing matters but no previous study has sought to objectively characterise and measure their activity, examine their effectiveness, or compare practices between Scotland and England.

Aim

To critically assess the impact and mechanisms of impact of public health team engagement in alcohol premises licensing on alcohol-related harms in England and Scotland.

Methods

We recruited 39 diverse public health teams in England (n = 27) and Scotland (n = 12). Public health teams more active in licensing were recruited first and then matched to lower-activity public health teams. Using structured interviews (n = 66), documentation analysis, and expert consultation, we developed and applied the Public Health Engagement In Alcohol Licensing (PHIAL) measure to quantify six-monthly activity levels from 2012 to 2019. Time series of PHIAL scores, and health and crime outcomes for each area, were analysed using multivariable negative binomial mixed-effects models to assess correlations between outcome and exposure, with 18-month average PHIAL score as the primary exposure metric. In-depth interviews (n = 53) and a workshop (n = 10) explored public health team approaches and potential mechanisms of impact of alcohol availability interventions with public health team members and licensing stakeholders (local authority licensing officers, managers and lawyers/clerks, police staff with a licensing remit, local elected representatives).

Findings

Nineteen public health team activity types were assessed in six categories: (1) staffing; (2) reviewing and (3) responding to licence applications; (4) data usage; (5) influencing licensing stakeholders/policy; and (6) public involvement. Usage and intensity of activities and overall approaches varied within and between areas over time, including between Scotland and England. The latter variation could be explained by legal, structural and philosophical differences, including Scotland's public health objective. This objective was felt to legitimise public health considerations and the use of public health data within licensing. Quantitative analysis showed no clear evidence of association between level of public health team activity and the health or crime outcomes examined, using the primary exposure or other metrics (neither change in, nor cumulative, PHIAL scores). Qualitative data suggested that public health team input was valued by many licensing stakeholders, and that alcohol availability may lead to harms by affecting the accessibility, visibility and norms of alcohol consumption, but that the licensing systems have limited power to act in the interests of public health.

Conclusions

This study provides no evidence that public health team engagement in local licensing matters was associated with measurable downstream reductions in crime or health harms, in the short term, or over a 7-year follow-up period. The extensive qualitative data suggest that public health team engagement is valued and appears to be slowly reorienting the licensing system to better address health (and other) harms, especially in Scotland, but this will take time. A rise in home drinking, alcohol deliveries, and the inherent inability of the licensing system to reduce - or in the case of online sales, to contain - availability, may explain the null findings and will continue to limit the potential of these licensing systems to address alcohol-related harms.

Future work

Further analysis could consider the relative success of different public health team approaches in terms of changing alcohol availability and retailing. A key gap relates to the nature and impact of online availability on alcohol consumption, harms and inequalities, alongside development and study of relevant policy options. A national approach to licensing data and oversight would greatly facilitate future studies and public health input to licensing.

Limitations

Our interview data and therefore PHIAL scores may be limited by recall bias where documentary evidence of public health activity was not available, and by possible variability in grading of such activity, though steps were taken to minimise both. The analyses would have benefited from additional data on licensing policies and environmental changes that might have affected availability or harms in the study areas.

Study registration

The study was registered with the Research Registry (researchregistry6162) on 26 October 2020. The study protocol was published in BMC Medical Research Methodology on 6 November 2018.

Funding

This synopsis presents independent research funded by the National Institute for Health and Care Research (NIHR) Public Health Research programme as award number 15/129/11.

Mechanisms of impact of alcohol availability interventions from the perspective of 63 diverse alcohol licensing stakeholders: a qualitative interview study

Aims

Interventions restricting temporal and spatial availability of alcohol are associated with reduced harm, but the pathways by which specific interventions have impact are poorly understood. We examined mechanisms of impact from the perspective of diverse licensing stakeholders.

Methods

Fifty-three in-depth interviews were conducted with licensing stakeholders (from public health teams [PHTs], police, local authority licensing teams and lawyers, and alcohol premises licensing committees) from 20 local government areas. Interviewees were recruited as part of the Exploring the impact of alcohol licensing in England and Scotland (ExILEnS) study. Data were analyzed thematically and preliminary themes/subthemes were discussed during online groups with a different sample of public health and licensing professionals (n = 10).

Findings

Most interviewees struggled to articulate how availability interventions might lead to changes in alcohol consumption or harms. Five overarching mechanisms were identified: access, visibility, premises and area-level norms, affordability, and management of the night-time economy, with specific pathways identified for certain subgroups/premises types. The mechanisms by which alcohol availability interventions may impact on alcohol consumption and harms are diverse, but were poorly understood.

Conclusions

These findings will inform licensing and availability policy and advocacy, highlighting the need for further scrutiny of the evidence underpinning identified mechanisms, and primary research to address knowledge gaps.

Framework for the development and evaluation of complex interventions: gap analysis, workshop and consultation-informed update

BACKGROUND

The Medical Research Council published the second edition of its framework in 2006 on developing and evaluating complex interventions. Since then, there have been considerable developments in the field of complex intervention research. The objective of this project was to update the framework in the light of these developments. The framework aims to help research teams prioritise research questions and design, and conduct research with an appropriate choice of methods, rather than to provide detailed guidance on the use of specific methods.

METHODS

There were four stages to the update: (1) gap analysis to identify developments in the methods and practice since the previous framework was published; (2) an expert workshop of 36 participants to discuss the topics identified in the gap analysis; (3) an open consultation process to seek comments on a first draft of the new framework; and (4) findings from the previous stages were used to redraft the framework, and final expert review was obtained. The process was overseen by a Scientific Advisory Group representing the range of relevant National Institute for Health Research and Medical Research Council research investments.

RESULTS

Key changes to the previous framework include (1) an updated definition of complex interventions, highlighting the dynamic relationship between the intervention and its context; (2) an emphasis on the use of diverse research perspectives: efficacy, effectiveness, theory-based and systems perspectives; (3) a focus on the usefulness of evidence as the basis for determining research perspective and questions; (4) an increased focus on interventions developed outside research teams, for example changes in policy or health services delivery; and (5) the identification of six 'core elements' that should guide all phases of complex intervention research: consider context; develop, refine and test programme theory; engage stakeholders; identify key uncertainties; refine the intervention; and economic considerations. We divide the research process into four phases: development, feasibility, evaluation and implementation. For each phase we provide a concise summary of recent developments, key points to address and signposts to further reading. We also present case studies to illustrate the points being made throughout.

LIMITATIONS

The framework aims to help research teams prioritise research questions and design and conduct research with an appropriate choice of methods, rather than to provide detailed guidance on the use of specific methods. In many of the areas of innovation that we highlight, such as the use of systems approaches, there are still only a few practical examples. We refer to more specific and detailed guidance where available and note where promising approaches require further development.

CONCLUSIONS

This new framework incorporates developments in complex intervention research published since the previous edition was written in 2006. As well as taking account of established practice and recent refinements, we draw attention to new approaches and place greater emphasis on economic considerations in complex intervention research. We have introduced a new emphasis on the importance of context and the value of understanding interventions as 'events in systems' that produce effects through interactions with features of the contexts in which they are implemented. The framework adopts a pluralist approach, encouraging researchers and research funders to adopt diverse research perspectives and to select research questions and methods pragmatically, with the aim of providing evidence that is useful to decision-makers.

FUTURE WORK

We call for further work to develop relevant methods and provide examples in practice. The use of this framework should be monitored and the move should be made to a more fluid resource in the future, for example a web-based format that can be frequently updated to incorporate new material and links to emerging resources.

FUNDING

This project was jointly funded by the Medical Research Council (MRC) and the National Institute for Health Research (Department of Health and Social Care 73514).

Qualitative process evaluation from a complex systems perspective: A systematic review and framework for public health evaluators

BACKGROUND

Public health evaluation methods have been criticized for being overly reductionist and failing to generate suitable evidence for public health decision-making. A "complex systems approach" has been advocated to account for real world complexity. Qualitative methods may be well suited to understanding change in complex social environments, but guidance on applying a complex systems approach to inform qualitative research remains limited and underdeveloped. This systematic review aims to analyze published examples of process evaluations that utilize qualitative methods that involve a complex systems perspective and proposes a framework for qualitative complex system process evaluations.

METHODS AND FINDINGS

We conducted a systematic search to identify complex system process evaluations that involve qualitative methods by searching electronic databases from January 1, 2014-September 30, 2019 (Scopus, MEDLINE, Web of Science), citation searching, and expert consultations. Process evaluations were included if they self-identified as taking a systems- or complexity-oriented approach, integrated qualitative methods, reported empirical findings, and evaluated public health interventions. Two reviewers independently assessed each study to identify concepts associated with the systems thinking and complexity science traditions. Twenty-one unique studies were identified evaluating a wide range of public health interventions in, for example, urban planning, sexual health, violence prevention, substance use, and community transformation. Evaluations were conducted in settings such as schools, workplaces, and neighborhoods in 13 different countries (9 high-income and 4 middle-income). All reported some utilization of complex systems concepts in the analysis of qualitative data. In 14 evaluations, the consideration of complex systems influenced intervention design, evaluation planning, or fieldwork. The identified studies used systems concepts to depict and describe a system at one point in time. Only 4 evaluations explicitly utilized a range of complexity concepts to assess changes within the system resulting from, or co-occurring with, intervention implementation over time. Limitations to our approach are including only English-language papers, reliance on study authors reporting their utilization of complex systems concepts, and subjective judgment from the reviewers relating to which concepts featured in each study.

CONCLUSION

This study found no consensus on what bringing a complex systems perspective to public health process evaluations with qualitative methods looks like in practice and that many studies of this nature describe static systems at a single time point. We suggest future studies use a 2-phase framework for qualitative process evaluations that seek to assess changes over time from a complex systems perspective. The first phase involves producing a description of the system and identifying hypotheses about how the system may change in response to the intervention. The second phase involves following the pathway of emergent findings in an adaptive evaluation approach.

Getting shops to voluntarily stop selling cheap, strong beers and ciders: a time-series analysis evaluating impacts on alcohol availability and purchasing

BACKGROUND

'Reducing the Strength' (RtS) is a public health initiative encouraging retailers to voluntarily stop selling cheap, strong beers/ciders (≥6.5% alcohol by volume). This study evaluates the impact of RtS initiatives on alcohol availability and purchasing in three English counties with a combined population of 3.62 million people.

METHODS

We used a multiple baseline time-series design to examine retail data over 29 months from a supermarket chain that experienced a two-wave, area-based role out of RtS: initially 54 stores (W1), then another 77 stores (W2). We measured impacts on units of alcohol sold (primary outcome: beers/ciders; secondary outcome: all alcoholic products), economic impacts on alcohol sales and substitution effects.

RESULTS

We observed a non-significant W1 increase (+3.7%, 95% CI: -11.2, 21.0) and W2 decrease (-6.8%, 95% CI: -20.5, 9.4) in the primary outcome. We observed a significant W2 decrease in units sold across all alcohol products (-10.5%, 95% CI: -19.2, -0.9). The direction of effect between waves was inconsistent for all outcomes, including alcohol sales, with no evidence of substitution effects.

CONCLUSIONS

In the UK, voluntary RtS initiatives appear to have little or no impact on reducing alcohol availability and purchase from the broader population of supermarket customers.

Controlling alcohol availability through local policy: an observational study to evaluate Cumulative Impact Zones in a London borough

Background

Cumulative impact zones (CIZs) are a discretionary policy lever available to local government, used to restrict the availability of alcohol in areas deemed already saturated. Despite little evidence of their effect, over 200 such zones have been introduced. This study explores the impact of three CIZs on the licensing of venues in the London Borough of Southwark.

Methods

Using 10 years of licensing data, we examined changes in the issuing of licences on the introduction of three CIZs within Southwark, relative to control areas. The number of licence applications made (N = 1110), the number issued, and the proportion objected to, were analysed using negative binomial regression.

Results

In one area tested, CIZ implementation was associated with 119% more licence applications than control areas (incidence rate ratios (IRR) = 2.19, 95% confidence intervals (CI): 1.29-3.73, P = 0.004) and 133% more licences granted (IRR = 2.33, 95% CI: 1.31-4.16, P = 0.004). No significant effect was found for the other two areas. CIZs were found to have no discernible effect on the relative proportion of licence applications receiving objections.

Conclusions

CIZs are proposed as a key lever to limit alcohol availability in areas of high outlet density. We found no evidence that CIZ establishment reduced the number of successful applications in Southwark.

Different scientific approaches are needed to generate stronger evidence for population health improvement

In a Perspective, Martin White and Jean Adams discuss challenges in the evaluation of interventions intended to benefit population health.

Consequences of removing cheap, super-strength beer and cider: a qualitative study of a UK local alcohol availability intervention

OBJECTIVES

Increasingly, English local authorities have encouraged the implementation of an intervention called 'Reducing the Strength' (RtS) whereby off-licences voluntarily stop selling inexpensive 'super-strength' (≥6.5% alcohol by volume (ABV)) beers and ciders. We conceptualised RtS as an event within a complex system in order to identify pathways by which the intervention may lead to intended and unintended consequences.

DESIGN

A qualitative study including a focus group and semistructured interviews.

SETTING

An inner-London local authority characterised by a high degree of residential mobility, high levels of social inequality and a large homeless population. Intervention piloted in three areas known for street drinking with a high alcohol outlet density.

PARTICIPANTS

Alcohol service professionals, homeless hostel employees, street-based services managers and hostel dwelling homeless alcohol consumers (n=30).

RESULTS

Participants describe a range of potential substitution behaviours to circumvent alcohol availability restrictions including consuming different drinks, finding alternative shops, using drugs or committing crimes to purchase more expensive drinks. Service providers suggested the intervention delivered in this local authority missed opportunities to encourage engagement between the council, alcohol services, homeless hostels and off-licence stores. Some participants believed small-scale interventions such as RtS may facilitate new forms of engagement between public and private sector interests and contribute to long-term cultural changes around drinking, although they may also entrench the view that 'problem drinking' only occurs in certain population groups.

CONCLUSIONS

RtS may have limited individual-level health impacts if the target populations remain willing and able to consume alternative means of intoxication as a substitute for super-strength products. However, RtS may also lead to wider system changes not directly related to the consumption of super-strengths and their assumed harms.