Consequences of removing cheap, super-strength beer and cider: a qualitative study of a UK local alcohol availability intervention

Public health engagement in alcohol licensing in England and Scotland: the ExILEnS mixed-method, natural experiment evaluation

Background

International systematic reviews suggest an association between alcohol availability and increased alcohol-related harms. Alcohol availability is regulated through separate locally administered licensing systems in England and Scotland, in which local public health teams have a statutory role. The system in Scotland includes a public health objective for licensing. Public health teams engage to varying degrees in licensing matters but no previous study has sought to objectively characterise and measure their activity, examine their effectiveness, or compare practices between Scotland and England.

Aim

To critically assess the impact and mechanisms of impact of public health team engagement in alcohol premises licensing on alcohol-related harms in England and Scotland.

Methods

We recruited 39 diverse public health teams in England (n = 27) and Scotland (n = 12). Public health teams more active in licensing were recruited first and then matched to lower-activity public health teams. Using structured interviews (n = 66), documentation analysis, and expert consultation, we developed and applied the Public Health Engagement In Alcohol Licensing (PHIAL) measure to quantify six-monthly activity levels from 2012 to 2019. Time series of PHIAL scores, and health and crime outcomes for each area, were analysed using multivariable negative binomial mixed-effects models to assess correlations between outcome and exposure, with 18-month average PHIAL score as the primary exposure metric. In-depth interviews (n = 53) and a workshop (n = 10) explored public health team approaches and potential mechanisms of impact of alcohol availability interventions with public health team members and licensing stakeholders (local authority licensing officers, managers and lawyers/clerks, police staff with a licensing remit, local elected representatives).

Findings

Nineteen public health team activity types were assessed in six categories: (1) staffing; (2) reviewing and (3) responding to licence applications; (4) data usage; (5) influencing licensing stakeholders/policy; and (6) public involvement. Usage and intensity of activities and overall approaches varied within and between areas over time, including between Scotland and England. The latter variation could be explained by legal, structural and philosophical differences, including Scotland's public health objective. This objective was felt to legitimise public health considerations and the use of public health data within licensing. Quantitative analysis showed no clear evidence of association between level of public health team activity and the health or crime outcomes examined, using the primary exposure or other metrics (neither change in, nor cumulative, PHIAL scores). Qualitative data suggested that public health team input was valued by many licensing stakeholders, and that alcohol availability may lead to harms by affecting the accessibility, visibility and norms of alcohol consumption, but that the licensing systems have limited power to act in the interests of public health.

Conclusions

This study provides no evidence that public health team engagement in local licensing matters was associated with measurable downstream reductions in crime or health harms, in the short term, or over a 7-year follow-up period. The extensive qualitative data suggest that public health team engagement is valued and appears to be slowly reorienting the licensing system to better address health (and other) harms, especially in Scotland, but this will take time. A rise in home drinking, alcohol deliveries, and the inherent inability of the licensing system to reduce - or in the case of online sales, to contain - availability, may explain the null findings and will continue to limit the potential of these licensing systems to address alcohol-related harms.

Future work

Further analysis could consider the relative success of different public health team approaches in terms of changing alcohol availability and retailing. A key gap relates to the nature and impact of online availability on alcohol consumption, harms and inequalities, alongside development and study of relevant policy options. A national approach to licensing data and oversight would greatly facilitate future studies and public health input to licensing.

Limitations

Our interview data and therefore PHIAL scores may be limited by recall bias where documentary evidence of public health activity was not available, and by possible variability in grading of such activity, though steps were taken to minimise both. The analyses would have benefited from additional data on licensing policies and environmental changes that might have affected availability or harms in the study areas.

Study registration

The study was registered with the Research Registry (researchregistry6162) on 26 October 2020. The study protocol was published in BMC Medical Research Methodology on 6 November 2018.

Funding

This synopsis presents independent research funded by the National Institute for Health and Care Research (NIHR) Public Health Research programme as award number 15/129/11.

The impact of alcohol minimum unit pricing on people with experience of homelessness: Qualitative study

BACKGROUND

Alcohol Minimum Unit Pricing (MUP) was introduced in Scotland in May 2018. Existing evidence suggests MUP can reduce alcohol consumption in the general population, but there is little research about its impact on vulnerable groups. This qualitative study explored experiences of MUP among people with experience of homelessness.

METHODS

We conducted qualitative semi-structured interviews with a purposive sample of 46 people with current or recent experience of homelessness who were current drinkers when MUP was introduced. Participants (30 men and 16 women) were aged 21 to 73 years. Interviews focused on views and experiences of MUP. Data were analysed using thematic analysis.

RESULTS

People with experience of homelessness were aware of MUP but it was accorded low priority in their hierarchy of concerns. Reported impacts varied. Some participants reduced their drinking, or moved away from drinking strong white cider, in line with policy intentions. Others were unaffected because the cost of their preferred drink (usually wine, vodka or beer) did not change substantially. A minority reported increased involvement in begging. Wider personal, relational and social factors also played an important role in responses to MUP.

CONCLUSION

This is the first qualitative study to provide a detailed exploration of the impact of MUP among people with experience of homelessness. Our findings suggest that MUP worked as intended for some people with experience of homelessness, while a minority reported negative consequences. Our findings are of international significance to policymakers, emphasising the need to consider the impact of population level health policies on marginalised groups and the wider contextual factors that affect responses to policies within these groups. It is important to invest further in secure housing and appropriate support services and to implement and evaluate harm reduction initiatives such as managed alcohol programmes.

Mechanisms of impact of alcohol availability interventions from the perspective of 63 diverse alcohol licensing stakeholders: a qualitative interview study

Aims

Interventions restricting temporal and spatial availability of alcohol are associated with reduced harm, but the pathways by which specific interventions have impact are poorly understood. We examined mechanisms of impact from the perspective of diverse licensing stakeholders.

Methods

Fifty-three in-depth interviews were conducted with licensing stakeholders (from public health teams [PHTs], police, local authority licensing teams and lawyers, and alcohol premises licensing committees) from 20 local government areas. Interviewees were recruited as part of the Exploring the impact of alcohol licensing in England and Scotland (ExILEnS) study. Data were analyzed thematically and preliminary themes/subthemes were discussed during online groups with a different sample of public health and licensing professionals (n = 10).

Findings

Most interviewees struggled to articulate how availability interventions might lead to changes in alcohol consumption or harms. Five overarching mechanisms were identified: access, visibility, premises and area-level norms, affordability, and management of the night-time economy, with specific pathways identified for certain subgroups/premises types. The mechanisms by which alcohol availability interventions may impact on alcohol consumption and harms are diverse, but were poorly understood.

Conclusions

These findings will inform licensing and availability policy and advocacy, highlighting the need for further scrutiny of the evidence underpinning identified mechanisms, and primary research to address knowledge gaps.

Alcohol minimum unit pricing and people experiencing homelessness: A qualitative study of stakeholders' perspectives and experiences

INTRODUCTION

Minimum unit pricing (MUP) may reduce harmful drinking in the general population, but there is little evidence regarding its impact on marginalised groups. Our study is the first to explore the perceptions of MUP among stakeholders working with people experiencing homelessness following its introduction in Scotland in May 2018.

METHODS

Qualitative semi-structured interviews were conducted with 41 professional stakeholders from statutory and third sector organisations across Scotland. We explored their views on MUP and its impact on people experiencing homelessness, service provision and implications for policy. Data were analysed using thematic analysis.

RESULTS

Participants suggested that the introduction of MUP in Scotland had negligible if any discernible impact on people experiencing homelessness and services that support them. Most service providers felt insufficiently informed about MUP prior to its implementation. Participants reported that where consequences for these populations were evident, they were primarily anticipated although some groups were negatively affected. People experiencing homelessness have complex needs in addition to alcohol addiction, and changes in the way services work need to be considered in future MUP-related discussions.

DISCUSSION AND CONCLUSIONS

This study suggests that despite initial concerns about potential unintended consequences of MUP, many of these did not materialise to the levels anticipated. As a population-level health policy, MUP is likely to have little beneficial impact on people experiencing homelessness without the provision of support to address their alcohol use and complex needs. The additional needs of certain groups (e.g., people with no recourse to public funds) need to be considered.

Applying a complex systems perspective to alcohol consumption and the prevention of alcohol-related harms in the 21st century: a scoping review

BACKGROUND AND AIMS

A complex systems perspective has been advocated to explore multi-faceted factors influencing public health issues, including alcohol consumption and associated harms. This scoping review aimed to identify studies that applied a complex systems perspective to alcohol consumption and the prevention of alcohol-related harms in order to summarize their characteristics and identify evidence gaps.

METHODS

Studies published between January 2000 and September 2020 in English were located by searching for terms synonymous with 'complex systems' and 'alcohol' in the Scopus, MEDLINE, Web of Science and Embase databases, and through handsearching and reference screening of included studies. Data were extracted on each study's aim, country, population, alcohol topic, system levels, funding, theory, methods, data sources, time-frames, system modifications and type of findings produced.

RESULTS

Eighty-seven individual studies and three systematic reviews were identified, the majority of which were conducted in the United States or Australia in the general population, university students or adolescents. Studies explored types and patterns of consumption behaviour and the local environments in which alcohol is consumed. Most studies focused on individual and local interactions and influences, with fewer examples exploring the relationships between these and regional, national and international subsystems. The body of literature is methodologically diverse and includes theory-led approaches, dynamic simulation models and social network analyses. The systematic reviews focused on primary network studies.

CONCLUSIONS

The use of a complex systems perspective has provided a variety of ways of conceptualizing and analyzing alcohol use and harm prevention efforts, but its focus ultimately has remained on predominantly individual- and/or local-level systems. A complex systems perspective represents an opportunity to address this gap by also considering the vertical dimensions that constrain, shape and influence alcohol consumption and related harms, but the literature to date has not fully captured this potential.

Framework for the development and evaluation of complex interventions: gap analysis, workshop and consultation-informed update

BACKGROUND

The Medical Research Council published the second edition of its framework in 2006 on developing and evaluating complex interventions. Since then, there have been considerable developments in the field of complex intervention research. The objective of this project was to update the framework in the light of these developments. The framework aims to help research teams prioritise research questions and design, and conduct research with an appropriate choice of methods, rather than to provide detailed guidance on the use of specific methods.

METHODS

There were four stages to the update: (1) gap analysis to identify developments in the methods and practice since the previous framework was published; (2) an expert workshop of 36 participants to discuss the topics identified in the gap analysis; (3) an open consultation process to seek comments on a first draft of the new framework; and (4) findings from the previous stages were used to redraft the framework, and final expert review was obtained. The process was overseen by a Scientific Advisory Group representing the range of relevant National Institute for Health Research and Medical Research Council research investments.

RESULTS

Key changes to the previous framework include (1) an updated definition of complex interventions, highlighting the dynamic relationship between the intervention and its context; (2) an emphasis on the use of diverse research perspectives: efficacy, effectiveness, theory-based and systems perspectives; (3) a focus on the usefulness of evidence as the basis for determining research perspective and questions; (4) an increased focus on interventions developed outside research teams, for example changes in policy or health services delivery; and (5) the identification of six 'core elements' that should guide all phases of complex intervention research: consider context; develop, refine and test programme theory; engage stakeholders; identify key uncertainties; refine the intervention; and economic considerations. We divide the research process into four phases: development, feasibility, evaluation and implementation. For each phase we provide a concise summary of recent developments, key points to address and signposts to further reading. We also present case studies to illustrate the points being made throughout.

LIMITATIONS

The framework aims to help research teams prioritise research questions and design and conduct research with an appropriate choice of methods, rather than to provide detailed guidance on the use of specific methods. In many of the areas of innovation that we highlight, such as the use of systems approaches, there are still only a few practical examples. We refer to more specific and detailed guidance where available and note where promising approaches require further development.

CONCLUSIONS

This new framework incorporates developments in complex intervention research published since the previous edition was written in 2006. As well as taking account of established practice and recent refinements, we draw attention to new approaches and place greater emphasis on economic considerations in complex intervention research. We have introduced a new emphasis on the importance of context and the value of understanding interventions as 'events in systems' that produce effects through interactions with features of the contexts in which they are implemented. The framework adopts a pluralist approach, encouraging researchers and research funders to adopt diverse research perspectives and to select research questions and methods pragmatically, with the aim of providing evidence that is useful to decision-makers.

FUTURE WORK

We call for further work to develop relevant methods and provide examples in practice. The use of this framework should be monitored and the move should be made to a more fluid resource in the future, for example a web-based format that can be frequently updated to incorporate new material and links to emerging resources.

FUNDING

This project was jointly funded by the Medical Research Council (MRC) and the National Institute for Health Research (Department of Health and Social Care 73514).

Evaluation of public health interventions from a complex systems perspective: A research methods review

INTRODUCTION

Applying a complex systems perspective to public health evaluation may increase the relevance and strength of evidence to improve health and reduce health inequalities. In this review of methods, we aimed to: (i) classify and describe different complex systems methods in evaluation applied to public health; and (ii) examine the kinds of evaluative evidence generated by these different methods.

METHODS

We adapted critical review methods to identify evaluations of public health interventions that used systems methods. We conducted expert consultation, searched electronic databases (Scopus, MEDLINE, Web of Science), and followed citations of relevant systematic reviews. Evaluations were included if they self-identified as using systems- or complexity-informed methods and if they evaluated existing or hypothetical public health interventions. Case studies were selected to illustrate different types of complex systems evaluation.

FINDINGS

Seventy-four unique studies met our inclusion criteria. A framework was developed to map the included studies onto different stages of the evaluation process, which parallels the planning, delivery, assessment, and further delivery phases of the interventions they seek to inform; these stages include: 1) theorising; 2) prediction (simulation); 3) process evaluation; 4) impact evaluation; and 5) further prediction (simulation). Within this framework, we broadly categorised methodological approaches as mapping, modelling, network analysis and 'system framing' (the application of a complex systems perspective to a range of study designs). Studies frequently applied more than one type of systems method.

CONCLUSIONS

A range of complex systems methods can be utilised, adapted, or combined to produce different types of evaluative evidence. Further methodological innovation in systems evaluation may generate stronger evidence to improve health and reduce health inequalities in our complex world.

Qualitative process evaluation from a complex systems perspective: A systematic review and framework for public health evaluators

BACKGROUND

Public health evaluation methods have been criticized for being overly reductionist and failing to generate suitable evidence for public health decision-making. A "complex systems approach" has been advocated to account for real world complexity. Qualitative methods may be well suited to understanding change in complex social environments, but guidance on applying a complex systems approach to inform qualitative research remains limited and underdeveloped. This systematic review aims to analyze published examples of process evaluations that utilize qualitative methods that involve a complex systems perspective and proposes a framework for qualitative complex system process evaluations.

METHODS AND FINDINGS

We conducted a systematic search to identify complex system process evaluations that involve qualitative methods by searching electronic databases from January 1, 2014-September 30, 2019 (Scopus, MEDLINE, Web of Science), citation searching, and expert consultations. Process evaluations were included if they self-identified as taking a systems- or complexity-oriented approach, integrated qualitative methods, reported empirical findings, and evaluated public health interventions. Two reviewers independently assessed each study to identify concepts associated with the systems thinking and complexity science traditions. Twenty-one unique studies were identified evaluating a wide range of public health interventions in, for example, urban planning, sexual health, violence prevention, substance use, and community transformation. Evaluations were conducted in settings such as schools, workplaces, and neighborhoods in 13 different countries (9 high-income and 4 middle-income). All reported some utilization of complex systems concepts in the analysis of qualitative data. In 14 evaluations, the consideration of complex systems influenced intervention design, evaluation planning, or fieldwork. The identified studies used systems concepts to depict and describe a system at one point in time. Only 4 evaluations explicitly utilized a range of complexity concepts to assess changes within the system resulting from, or co-occurring with, intervention implementation over time. Limitations to our approach are including only English-language papers, reliance on study authors reporting their utilization of complex systems concepts, and subjective judgment from the reviewers relating to which concepts featured in each study.

CONCLUSION

This study found no consensus on what bringing a complex systems perspective to public health process evaluations with qualitative methods looks like in practice and that many studies of this nature describe static systems at a single time point. We suggest future studies use a 2-phase framework for qualitative process evaluations that seek to assess changes over time from a complex systems perspective. The first phase involves producing a description of the system and identifying hypotheses about how the system may change in response to the intervention. The second phase involves following the pathway of emergent findings in an adaptive evaluation approach.

Getting shops to voluntarily stop selling cheap, strong beers and ciders: a time-series analysis evaluating impacts on alcohol availability and purchasing

BACKGROUND

'Reducing the Strength' (RtS) is a public health initiative encouraging retailers to voluntarily stop selling cheap, strong beers/ciders (≥6.5% alcohol by volume). This study evaluates the impact of RtS initiatives on alcohol availability and purchasing in three English counties with a combined population of 3.62 million people.

METHODS

We used a multiple baseline time-series design to examine retail data over 29 months from a supermarket chain that experienced a two-wave, area-based role out of RtS: initially 54 stores (W1), then another 77 stores (W2). We measured impacts on units of alcohol sold (primary outcome: beers/ciders; secondary outcome: all alcoholic products), economic impacts on alcohol sales and substitution effects.

RESULTS

We observed a non-significant W1 increase (+3.7%, 95% CI: -11.2, 21.0) and W2 decrease (-6.8%, 95% CI: -20.5, 9.4) in the primary outcome. We observed a significant W2 decrease in units sold across all alcohol products (-10.5%, 95% CI: -19.2, -0.9). The direction of effect between waves was inconsistent for all outcomes, including alcohol sales, with no evidence of substitution effects.

CONCLUSIONS

In the UK, voluntary RtS initiatives appear to have little or no impact on reducing alcohol availability and purchase from the broader population of supermarket customers.

Different scientific approaches are needed to generate stronger evidence for population health improvement

In a Perspective, Martin White and Jean Adams discuss challenges in the evaluation of interventions intended to benefit population health.