Implications of a complexity perspective for systematic reviews and guideline development in health decision making

"Going into the black box": a policy analysis of how the World Health Organization uses evidence to inform guideline recommendations

Background

The World Health Organization (WHO) plays a crucial role in producing global guidelines. In response to previous criticism, WHO has made efforts to enhance the process of guideline development, aiming for greater systematicity and transparency. However, it remains unclear whether these changes have effectively addressed these earlier critiques. This paper examines the policy process employed by WHO to inform guideline recommendations, using the update of the WHO Consolidated HIV Testing Services (HTS) Guidelines as a case study.

Methods

We observed guideline development meetings and conducted semi-structured interviews with key participants involved in the WHO guideline-making process. The interviews were recorded, transcribed, and analysed thematically. The data were deductively coded and analysed in line with the main themes from a published conceptual framework for context-based evidence-based decision making: introduction, interpretation, and application of evidence.

Results

The HTS guideline update was characterized by an inclusive and transparent process, involving a wide range of stakeholders. However, it was noted that not all stakeholders could participate equally due to gaps in training and preparation, particularly regarding the complexity of the Grading Recommendations Assessment Development Evaluation (GRADE) framework. We also found that WHO does not set priorities for which or how many guidelines should be produced each year and does not systematically evaluate the implementation of their recommendations. Our interviews revealed disconnects in the evidence synthesis process, starting from the development of systematic review protocols. While GRADE prioritizes evidence from RCTs, the Guideline Development Group (GDG) heavily emphasized "other" GRADE domains for which little or no evidence was available from the systematic reviews. As a result, expert judgements and opinions played a role in making recommendations. Finally, the role of donors and their presence as observers during GDG meetings was not clearly defined.

Conclusion

We found a need for a different approach to evidence synthesis due to the diverse range of global guidelines produced by WHO. Ideally, the evidence synthesis should be broad enough to capture evidence from different types of studies for all domains in the GRADE framework. Greater structure is required in formulating GDGs and clarifying the role of donors through the process.

The current state of complex systems research on socioeconomic inequalities in health and health behavior-a systematic scoping review

BACKGROUND

Interest in applying a complex systems approach to understanding socioeconomic inequalities in health is growing, but an overview of existing research on this topic is lacking. In this systematic scoping review, we summarize the current state of the literature, identify shared drivers of multiple health and health behavior outcomes, and highlight areas ripe for future research.

METHODS

SCOPUS, Web of Science, and PubMed databases were searched in April 2023 for peer-reviewed, English-language studies in high-income OECD countries containing a conceptual systems model or simulation model of socioeconomic inequalities in health or health behavior in the adult general population. Two independent reviewers screened abstracts and full texts. Data on study aim, type of model, all model elements, and all relationships were extracted. Model elements were categorized based on the Commission on Social Determinants of Health framework, and relationships between grouped elements were visualized in a summary conceptual systems map.

RESULTS

A total of 42 publications were included; 18 only contained a simulation model, 20 only contained a conceptual model, and 4 contained both types of models. General health outcomes (e.g., health status, well-being) were modeled more often than specific outcomes like obesity. Dietary behavior and physical activity were by far the most commonly modeled health behaviors. Intermediary determinants of health (e.g., material circumstances, social cohesion) were included in nearly all models, whereas structural determinants (e.g., policies, societal values) were included in about a third of models. Using the summary conceptual systems map, we identified 15 shared drivers of socioeconomic inequalities in multiple health and health behavior outcomes.

CONCLUSIONS

The interconnectedness of socioeconomic position, multiple health and health behavior outcomes, and determinants of socioeconomic inequalities in health is clear from this review. Factors central to the complex system as it is currently understood in the literature (e.g., financial strain) may be both efficient and effective policy levers, and factors less well represented in the literature (e.g., sleep, structural determinants) may warrant more research. Our systematic, comprehensive synthesis of the literature may serve as a basis for, among other things, a complex systems framework for socioeconomic inequalities in health.

Barriers and Opportunities for WHO "Best Buys" Non-communicable Disease Policy Adoption and Implementation From a Political Economy Perspective: A Complexity Systematic Review

BACKGROUND

Improving the adoption and implementation of policies to curb non-communicable diseases (NCDs) is a major challenge for better global health. The adoption and implementation of such policies remain deficient in various contexts, with limited insights into the facilitating and inhibiting factors. These policies have traditionally been treated as technical solutions, neglecting the critical influence of political economy dynamics. Moreover, the complex nature of these interventions is often not adequately incorporated into evidence for policy-makers. This study aims to systematically review and evaluate the factors affecting NCD policy adoption and implementation.

METHODS

We conducted a complex systematic review of articles discussing the adoption and implementation of World Health Organization's (WHO's) "best buys" NCD policies. We identified political economy factors and constructed a causal loop diagram (CLD) program theory to elucidate the interplay between factors influencing NCD policy adoption and implementation. A total of 157 papers met the inclusion criteria.

RESULTS

Our CLD highlights a central feedback loop encompassing three vital variables: (1) the ability to define, (re)shape, and pass appropriate policy into law; (2) the ability to implement the policy (linked to the enforceability of the policy and to addressing NCD local burden); and (3) ability to monitor progress, evaluate and correct the course. Insufficient context-specific data impedes the formulation and enactment of suitable policies, particularly in areas facing multiple disease burdens. Multisectoral collaboration plays a pivotal role in both policy adoption and implementation. Effective monitoring and accountability systems significantly impact policy implementation. The commercial determinants of health (CDoH) serve as a major barrier to defining, adopting, and implementing tobacco, alcohol, and diet-related policies.

CONCLUSION

To advance global efforts, we recommend focusing on the development of robust accountability, monitoring, and evaluation systems, ensuring transparency in private sector engagement, supporting context-specific data collection, and effectively managing the CDoH. A system thinking approach can enhance the implementation of complex public health interventions.

Using a systems thinking approach to explore the complex relationships between schizophrenia and premature mortality

BACKGROUND

People with schizophrenia have a higher risk of mortality compared to the general population, which has not improved over time. The majority of premature deaths are due to comorbid physical diseases, driven by interrelated factors operating at the individual level, through health systems and influenced by social determinants of health. A holistic understanding of this problem and the causal pathways linking these factors together is lacking.

AIMS

This study aims to understand why the mortality gap between people with schizophrenia and the general population is not improving by developing a causal loop diagram (CLD), a systems thinking approach which enables empirical research and theoretical knowledge to be combined into a visual representation of causal relationships and feedback loops.

METHOD

The CLD was constructed using published literature, including both quantitative and qualitative studies, to identify key variables and relationships, and refined through consultation with experts in the topic area.

RESULTS

A total of 21 variables and 68 connections were included in the CLD, with 23 distinct feedback loops identified. Stigma and social support had the most connections, while unemployment was involved in the greatest number of feedback loops. Most feedback mechanisms served to reinforce behavioural risk factors, inadequate healthcare and social disadvantage.

CONCLUSIONS

The CLD has created a holistic and dynamic understanding of the causal pathways driving the mortality gap between people with schizophrenia and the general population, providing insights into why it has persisted over time. One of the key findings was the critical role of social determinants in shaping health outcomes, highlighting the need for person-centred models of care and multisectoral government action.

Initial programme theory development: The first step in a realist evaluation of a cross-sectoral intervention for expectant Danish parents living with psychosocial risks

A distinct inequality in maternity care exists, and women with psychosocial risks are at a greater risk of adverse birth outcomes. In several high-income countries, a psychosocial risk assessment early in pregnancy is recommended so that expectant parents are offered an appropriate level of care which facilitates relevant, tailored interventions for those in need. In 2017, a cross-sectoral and interdisciplinary intervention for expectant parents with psychosocial risks was developed and implemented in the North Denmark Region. The development process of the intervention has not been reported and theory-based knowledge about how supportive interventions bring about change for expectant parents with psychosocial risks is scarce. Through the initial phase of a realist evaluation, we aimed to elicit key contexts and mechanisms of change regarding the intervention for expectant parents with psychosocial risks. Through an initial programme theory, this article illustrates how, for whom and in which contexts the intervention is intended to work. Data is comprised of intervention documents, 14 pilot observations and 29 realist interviews with key stakeholders. A thematic analytical approach inspired by retroductive thinking was applied to identify and analyse patterns related to the incentive of the intervention, its structure, intended outcomes, generative mechanisms and contextual matters. Generative mechanisms responsible for bringing about change in the intervention were identified as healthcare professionals' approach, continuity, trust, early intervention and social network. Cross-sectoral collaboration and healthcare professionals' competencies were assumed to be central stimulating contextual factors. The initial programme theory developed in this study will serve as the basis for further refinement via empirical testing in a later phase of the realist evaluation.

The impact of third-party authorization requirements on abortion-related outcomes: a synthesis of legal and health evidence

OBJECTIVES

This review synthesizes legal and health evidence to demonstrate the health and human rights impacts of third-party authorization requirements (TPAs) on abortion seekers.

RESULTS

The synthesized evidence substantiates the pre-existing position in international human rights law that requirements that abortion be authorized by third parties like parents, spouses, committees, and courts create barriers to abortion, should not be introduced at all, or should be repealed where they exist.

CONCLUSIONS

The review establishes that rights-based regulation of abortion should not impose TPAs in any circumstances. Instead, the provision and management of abortion should be treated in a manner cognizant with the general principles of informed consent in international human rights law, presuming capacity in all adults regardless of marital status and treatment sought, and recognizing the evolving capacity of young people in line with their internationally-protected rights.

The Commercial Determinants of Health and Evidence Synthesis (CODES): methodological guidance for systematic reviews and other evidence syntheses

BACKGROUND

The field of the commercial determinants of health (CDOH) refers to the commercial products, pathways and practices that may affect health. The field is growing rapidly, as evidenced by the WHO programme on the economic and commercial determinants of health and a rise in researcher and funder interest. Systematic reviews (SRs) and evidence synthesis more generally will be crucial tools in the evolution of CDOH as a field. Such reviews can draw on existing methodological guidance, though there are areas where existing methods are likely to differ, and there is no overarching guidance on the conduct of CDOH-focussed systematic reviews, or guidance on the specific methodological and conceptual challenges.

METHODS/RESULTS

CODES provides guidance on the conduct of systematic reviews focussed on CDOH, from shaping the review question with input from stakeholders, to disseminating the review. Existing guidance was used to identify key stages and to provide a structure for the guidance. The writing group included experience in systematic reviews and other forms of evidence synthesis, and in equity and CDOH research (both primary research and systematic reviews).

CONCLUSIONS

This guidance highlights the special methodological and other considerations for CDOH reviews, including equity considerations, and pointers to areas for future methodological and guideline development. It should contribute to the reliability and utility of CDOH reviews and help stimulate the production of reviews in this growing field.

An umbrella review of the acceptability of fiscal and pricing policies to reduce diet-related noncommunicable disease

CONTEXT

Poor diet has been implicated in a range of noncommunicable diseases. Fiscal and pricing policies (FPs) may offer a means by which consumption of food and non-alcoholic beverages with links to such diseases can be influenced to improve public health.

OBJECTIVE

To examine the acceptability of FPs to reduce diet-related noncommunicable disease, based on systematic review evidence.

DATA SOURCES

MEDLINE, EMBASE, PsychInfo, SCI, SSCI, Web of Science, Scopus, EconLit, the Cochrane Library, Epistemonikos, and the Campbell Collaboration Library were searched for relevant studies published between January 1, 1990 and June 2021.

DATA EXTRACTION

The studies included systematic reviews of diet-related FPs and: used real-world evidence; examined real or perceived barriers/facilitators; targeted the price of food or non-alcoholic beverages; and applied to entire populations within a jurisdiction. A total of 9996 unique relevant records were identified, which were augmented by a search of bibliographies and recommendations from an external expert advisory panel. Following screening, 4 systematic reviews remained.

DATA ANALYSIS

Quality appraisal was conducted using the AMSTAR 2 tool. A narrative synthesis was undertaken, with outcomes grouped according to the WHO-INTEGRATE criteria. The findings indicated a paucity of high-quality systematic review evidence and limited public support for the use of FPs to change dietary habits. This lack of support was related to a number of factors that included: their perceived potential to be regressive; a lack of transparency, ie, there was mistrust around the use of revenues raised; a paucity of evidence around health benefits; the deliberate choice of rates that were lower than those considered necessary to affect diet; and concerns about the potential of such FPs to harm economic outcomes such as employment.

CONCLUSION

The findings underscore the need for high-quality systematic review evidence on this topic, and the importance of responding to public concerns and putting in place mechanisms to address these when implementing FPs. This study was funded by Safefood [02A-2020].

SYSTEMATIC REVIEW REGISTRATION

PROSPERO registration no. CRD42021274454.

The WHO abortion care guideline: Law and policy-Past, present, and future

In the 2022 Abortion Care Guideline, the World Health Organization (WHO) undertook systematic evidence reviews of seven law and policy interventions to assess their health and social impacts. Distinct recommendations were formulated for each. The present article highlights how the Guideline reconceptualizes abortion regulation as a complex structural intervention that shapes clinical care and service delivery and distributes risks and resources within these systems and in the care relations that define them. It then presents the Guideline recommendations and summarizes their evidence base, drawing on recent legal and policy developments to emphasize their real-world significance. The article concludes by anticipating the future of abortion law and policy, focusing on service delivery innovations and diverse care models, drug regulation and the supply of abortion pills, and protective interventions crafted in the context of political crisis and immediate need that serve policy objectives and take regulatory forms different from the past.

Interventions targeting the mental health and wellbeing of care-experienced children and young people in higher-income countries: Evidence map and systematic review

BACKGROUND

The mental health and wellbeing of care-experienced children and young people (i.e. foster care, kinship care, residential care) is poorer than non-care-experienced populations. The Care-experienced cHildren and young people's Interventions to improve Mental health and wEll-being outcomes Systematic review (CHIMES) aimed to synthesise the international evidence base for interventions targeting subjective wellbeing, mental health and suicide amongst care-experienced young people aged ≤ 25 years.

METHODS

For the first phase of the review, we constructed an evidence map identifying key clusters and gaps in interventions and evaluations. Studies were identified through 16 electronic databases and 22 health and social care websites, in addition to expert recommendations, citation tracking and screening of relevant systematic reviews. We charted interventions and evaluations with a summary narrative, tables and infographics.

RESULTS

In total, 64 interventions with 124 associated study reports were eligible. The majority of study reports were from the USA (n = 77). Interventions primarily targeted children and young people's skills and competencies (n = 9 interventions), the parental functioning and practices of carers (n = 26), or a combination of the two (n = 15). While theoretically under-specified, interventions were largely informed by theories of Attachment, Positive Youth Development, and Social Learning Theory. Current evaluations prioritised outcomes (n = 86) and processes (n = 50), with a paucity of study reports including theoretical descriptions (n = 24) or economic evaluations (n = 1). Interventions most frequently targeted outcomes related to mental, behavioural or neurodevelopmental disorders, notably total social, emotional and behavioural problems (n = 48 interventions) and externalising problem behaviours (n = 26). There were a limited number of interventions targeting subjective wellbeing or suicide-related outcomes.

CONCLUSIONS

Future intervention development might focus on structural-level intervention theories and components, and target outcomes related to subjective wellbeing and suicide. In accordance with current methodological guidance for intervention development and evaluation, research needs to integrate theoretical, outcome, process and economic evaluation in order to strengthen the evidence base.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO CRD42020177478.

The impact of criminalisation on abortion-related outcomes: a synthesis of legal and health evidence

Abortion is criminalised to at least some degree in most countries. International human rights bodies have recognised that criminalisation results in the provision of poor-quality healthcare goods and services, is associated with lack of registration and unavailability of essential medicines including mifepristone and misoprostol, obstructs the provision of abortion information, obstructs training for abortion provision, is associated with delayed and unsafe abortion, and does not achieve its apparent aims of ether protecting abortion seekers from unsafe abortion or preventing abortion. Human rights bodies recommend decriminalisation, which is generally associated with reduced stigma, improved quality of care, and improved access to safe abortion. Drawing on insights from reproductive health, law, policy, and human rights, this review addresses knowledge gaps related to the health and non-health outcomes of criminalisation of abortion. This review identified evidence of the impacts of criminalisation of people seeking to access abortion and on abortion providers and considered whether, and if so how, this demonstrates the incompatibility of criminalisation with substantive requirements of international human rights law. Our analysis shows that criminalisation is associated with negative implications for health outcomes, health systems, and human rights enjoyment. It provides a further underpinning from empirical evidence of the harms of criminalisation that have already been identified by human rights bodies. It also provides additional evidence to support the WHO's recommendation for full decriminalisation of abortion.

Using GRADE Evidence to Decision frameworks to support the process of health policy-making: an example application regarding taxation of sugar-sweetened beverages

BACKGROUND

Grading of Recommendations, Assessment, Development and Evaluation (GRADE) Evidence to Decision (EtD) frameworks are well-known tools that enable guideline panels to structure the process of developing recommendations and making decisions in healthcare and public health. To date, they have not regularly been used for health policy-making. This article aims to illustrate the application of the GRADE EtD frameworks in the process of nutrition-related policy-making for a European country.

METHODS

Based on methodological guidance by the GRADE Working Group and the findings of our recently published scoping review, we illustrate the process of moving from evidence to recommendations, by applying the EtD frameworks to a fictitious example. Sugar-sweetened beverage (SSB) taxation based on energy density was chosen as an example application.

RESULTS

A fictitious guideline panel was convened by a national nutrition association to develop a population-level recommendation on SSB taxation aiming to reduce the burden of overweight and obesity. Exemplary evidence was summarized for each EtD criterion and conclusions were drawn based on all judgements made in relation to each criterion. As a result of the high priority to reduce the burden of obesity and because of the moderate desirable effects on health outcomes, but considering scarce or varying research evidence for other EtD criteria, the panel made a conditional recommendation for SSB taxation. Decision-makers may opt for conducting a pilot study prior to implementing the policy on a national level.

CONCLUSIONS

GRADE EtD frameworks can be used by guideline panels to make the process of developing recommendations in the field of health policy more systematic, transparent and comprehensible.

Rapid evidence synthesis to enable innovation and adoption in health and social care

BACKGROUND

The rapid identification and adoption of effective innovations in healthcare is a known challenge. The strongest evidence base for innovations can be provided by evidence synthesis, but this is frequently a lengthy process and even rapid versions of this can be time-consuming and complex. In the UK, the Accelerated Access Review and Academic Health Science Network (AHSN) have provided the impetus to develop a consistently rapid process to support the identification and adoption of high-value innovations in the English NHS.

METHODS

The Greater Manchester Applied Research Collaboration (ARC-GM) developed a framework for a rapid evidence synthesis (RES) approach, which is highly integrated within the innovation process of the Greater Manchester AHSN and the associated healthcare and research ecosystem. The RES uses evidence synthesis approaches and draws on the GRADE Evidence to Decision framework to provide rapid assessments of the existing evidence and its relevance to specific decision problems. We implemented this in a real-time context of decision-making around adoption of innovative health technologies.

RESULTS

Key stakeholders in the Greater Manchester decision-making process for healthcare innovations have found that our approach is both timely and flexible; it is valued for its combination of rigour and speed. Our RES approach rapidly and systematically identifies, appraises and contextualises relevant evidence, which can then be transparently incorporated into decisions about the wider adoption of innovations. The RES also identifies limitations in existing evidence for innovations and this can inform subsequent evaluations. There is substantial interest from other ARCs and AHSNs in implementing a similar process. We are currently exploring methods to make completed RES publicly available. We are also exploring methods to evaluate the impact of using RES as more implementation decisions are made.

CONCLUSIONS

The RES framework we have implemented combines transparency and consistency with flexibility and rapidity. It therefore maximises utility in a real-time decision-making context for healthcare innovations.

Using systems perspectives in evidence synthesis: A methodological mapping review

Reviewing complex interventions is challenging because they include many elements that can interact dynamically in a nonlinear manner. A systems perspective offers a way of thinking to help understand complex issues, but its application in evidence synthesis is not established. The aim of this project was to understand how and why systems perspectives have been applied in evidence synthesis. A methodological mapping review was conducted to identify papers using a systems perspective in evidence synthesis. A search was conducted in seven bibliographic databases and three search engines. A total of 101 papers (representing 98 reviews) met the eligibility criteria. Two categories of reviews were identified: (1) reviews using a "systems lens" to frame the topic, generate hypotheses, select studies, and guide the analysis and interpretation of findings (n = 76) and (2) reviews using systems methods to develop a systems model (n = 22). Several methods (e.g., systems dynamic modeling, soft systems approach) were identified, and they were used to identify, rank and select elements, analyze interactions, develop models, and forecast needs. The main reasons for using a systems perspective were to address complexity, view the problem as a whole, and understand the interrelationships between the elements. Several challenges for capturing the true nature and complexity of a problem were raised when performing these methods. This review is a useful starting point when designing evidence synthesis of complex interventions. It identifies different opportunities for applying a systems perspective in evidence synthesis, and highlights both commonplace and less familiar methods.

Early Reflections on Mphatlalatsane, a Maternal and Neonatal Quality Improvement Initiative Implemented During COVID-19 in South Africa

Despite global progress in reducing maternal and neonatal mortality and stillbirths, much work remains to be done to achieve the Sustainable Development Goals. Reports indicate that coronavirus disease (COVID-19) disrupts the provision and uptake of routine maternal and neonatal health care (MNH) services and negatively impacts cumulative pre-COVID-19 achievements. We describe a multipartnered MNH quality improvement (QI) initiative called Mphatlalatsane, which was implemented in South Africa before and during the COVID-19 pandemic. The initiative aimed to reduce the maternal mortality ratio, neonatal mortality rate, and stillbirth rate by 50% between 2018 and 2022. The multifaceted design comprises QI and other intervention activities across micro-, meso-, and macrolevels, and its area-based approach facilitates patients' access to MNH services. The initiative commenced 6 months pre-COVID-19, with subsequent adaptation necessitated by COVID-19. The initial focus on a plan-do-study-act QI model shifted toward meeting the immediate needs of health care workers (HCWs), the health system, and health care managers arising from COVID-19. Examples include providing emotional support to staff and streamlining supply chain management for infection control and personal protection materials. As these needs were addressed, Mphatlalatsane gradually refocused HCWs' and managers' attention to recognize the disruptions caused by COVID-19 to routine MNH services. This gradual reprioritization included the development of a risk matrix to help staff and managers identify specific risks to service provision and uptake and develop mitigating measures. Through this approach, Mphatlalatsane led to an optimization case using existing resources rather than requesting new resources to build an investment case, with a responsive design and implementation approach as the cornerstone of the initiative. Further, Mphatlalatsane demonstrates that agile and context-specific responses to crises such as the COVID-19 pandemic can mitigate such threats and maintain interventions to improve MNH services.

The impact of mandatory waiting periods on abortion-related outcomes: a synthesis of legal and health evidence

This review follows an established methodology for integrating human rights to address knowledge gaps related to the health and non-health outcomes of mandatory waiting periods (MWPs) for access to abortion. MWP is a requirement imposed by law, policy, or practice, to wait a specified amount of time between requesting and receiving abortion care. Recognizing that MWPs “demean[] women as competent decision-makers”, the World Health Organization recommends against MWPs. International human rights bodies have similarly encouraged states to repeal and not to introduce MWPs, which they recognize as operating as barriers to accessing sexual and reproductive healthcare. This review of 34 studies published between 2010 and 2021, together with international human rights law, establishes the health and non-health harms of MWPs for people seeking abortion, including delayed abortion, opportunity costs, and disproportionate impact. Impacts on abortion providers include increased workloads and system costs.

The impact of 'grounds' on abortion-related outcomes: a synthesis of legal and health evidence

Where abortion is legal, it is often regulated through a grounds-based approach. A grounds-based approach to abortion provision occurs when law and policy provide that lawful abortion may be provided only where a person who wishes to have an abortion satisfies stipulated 'grounds', sometimes described as 'exceptions' or 'exceptional grounds'. Grounds-based approaches to abortion are, prima facie, restrictive as they limit access to abortion based on factors extraneous to the preferences of the pregnant person. International human rights law specifies that abortion must be available (and not 'merely' lawful) where the life or health of the pregnant woman or girl is at risk, or where carrying a pregnancy to term would cause her substantial pain or suffering, including but not limited to situations where the pregnancy is the result of rape or incest or the pregnancy is not viable. However, international human rights law does not specify a grounds-based approach as the way to give effect to this requirement. The aim of this review is to address knowledge gaps related to the health and non-health outcomes plausibly related to the effects of a grounds-based approach to abortion regulation. The evidence from this review shows that grounds have negative implications for access to quality abortion and for the human rights of pregnant people. Further, it shows that grounds-based approaches are insufficient to meet states' human rights obligations. The evidence presented in this review thus suggests that enabling access to abortion on request would be more rights-enhancing than grounds-based approaches to abortion regulation.

Online synchronous chat counselling for young people aged 12-25: a mixed methods systematic review protocol

INTRODUCTION

Youth mental health is a global issue, with 75% of many serious mental health difficulties emerging before the age of 25. An increase in the popularity of online counselling for young people's mental health has been seen in recent years, due to their accessibility, cost-effectiveness and reduced stigmatising effects. Online synchronous chat counselling consists of real-time, text-based, one-to-one chats with a mental health professional and/or trained volunteer. Literature to date examining the effectiveness of these interventions has been limited, and little is known about their design features, their acceptance, effectiveness and the therapeutic processes that contribute to their working.

METHODS AND ANALYSIS

A mixed-methods systematic review of the literature will be conducted. PsycINFO MEDLINE, CINAHL, Web of Science and relevant grey literature will be searched for peer-reviewed, English language studies between January 1995 and June 2021. Backward and forward reference checking will be conducted. Quality of included articles will be examined using the Mixed Methods Appraisal Tool and a combination of the TIDieR checklist and a prepopulated data table will be used for extraction. A mixed methods review adopting a convergent-integrated design will be employed. Quantitative data will be transformed and analysed simultaneously alongside qualitative data using narrative synthesis.

ETHICS AND DISSEMINATION

The research does not require ethical approval. Findings will be disseminated through peer-reviewed publications, academic conference presentations, academic social media and invited workshops, webinars and seminars.

PROSPERO REGISTRATION NUMBER

CRD42021256016.

Using COVID-19 Pandemic as a Prism: A Systematic Review of Methodological Approaches and the Quality of Empirical Studies on Physical Activity Behavior Change

Background

The COVID-19 pandemic has highlighted the importance of scientific endeavors. The goal of this systematic review is to evaluate the quality of the research on physical activity (PA) behavior change and its potential to contribute to policy-making processes in the early days of COVID-19 related restrictions.

Methods

We conducted a systematic review of methodological quality of current research according to PRISMA guidelines using Pubmed and Web of Science, of articles on PA behavior change that were published within 365 days after COVID-19 was declared a pandemic by the World Health Organization (WHO). Items from the JBI checklist and the AXIS tool were used for additional risk of bias assessment. Evidence mapping is used for better visualization of the main results. Conclusions about the significance of published articles are based on hypotheses on PA behavior change in the light of the COVID-19 pandemic.

Results

Among the 1,903 identified articles, there were 36% opinion pieces, 53% empirical studies, and 9% reviews. Of the 332 studies included in the systematic review, 213 used self-report measures to recollect prepandemic behavior in often small convenience samples. Most focused changes in PA volume, whereas changes in PA types were rarely measured. The majority had methodological reporting flaws. Few had very large samples with objective measures using repeated measure design (pre and during the pandemic). In addition to the expected decline in PA duration, these studies show that many of those who were active prepandemic, continued to be active during the pandemic.

Conclusions

Research responded quickly at the onset of the pandemic. However, most of the studies lacked robust methodology, and PA behavior change data lacked the accuracy needed to guide policy makers. To improve the field, we propose the implementation of longitudinal cohort studies by larger organizations such as WHO to ease access to data on PA behavior, and suggest those institutions set clear standards for this research. Researchers need to ensure a better fit between the measurement method and the construct being measured, and use both objective and subjective measures where appropriate to complement each other and provide a comprehensive picture of PA behavior.

The impact of provider restrictions on abortion-related outcomes: a synthesis of legal and health evidence

Many components of abortion care in early pregnancy can safely be provided on an outpatient basis by mid-level providers or by pregnant people themselves. Yet, some states impose non-evidence-based provider restrictions, understood as legal or regulatory restrictions on who may provide or manage all or some aspects of abortion care. These restrictions are inconsistent with the World Health Organization’s support for the optimization of the roles of various health workers, and do not usually reflect evidence-based determinations of who can provide abortion. As a matter of international human rights law, states should ensure that the regulation of abortion is evidence-based and proportionate, and disproportionate impacts must be remedied. Furthermore, states are obliged take steps to ensure women do not have to undergo unsafe abortion, to reduce maternal morbidity and mortality, and to effectively protect women and girls from the physical and mental risks associated with unsafe abortion. States must revise their laws to ensure this. Where laws restrict those with the training and competence to provide from participating in abortion care, they are prima facie arbitrary and disproportionate and thus in need of reform. This review, developed by experts in reproductive health, law, policy, and human rights, examined the impact of provider restrictions on people seeking abortion, and medical professionals. The evidence from this review suggests that provider restrictions have negative implications for access to quality abortion, contributing inter alia to delays and recourse to unsafe abortion. A human rights-based approach to abortion regulation would require the removal of overly restrictive provider restrictions. The review provides evidence that speaks to possible routes for regulatory reform by expanding the health workforce involved in abortion-related care, as well as expanding health workers' roles, both of which could improve timely access to first trimester surgical and medical abortion, reduce costs, save time, and reduce the need for travel.

This review identifies evidence of the impacts of provider restrictions on people seeking to access abortion and on abortion providers. It pursues a methodology designed to ensure the full integration of public health and human rights standards developed by the research team and published elsewhere. The evidence from this review points clearly to provider restrictions having negative implications for health outcomes, health systems, and human rights. This is especially important as international guidance provided by the WHO indicates best practice in provision and management of abortion and shows clearly that undue provider restrictions are not justified by reference to the nature and complexity of abortion.

Evaluation proposal of a national community-based obesity prevention programme: a novel approach considering the complexity perspective

Community-based obesity prevention programmes are considered an important strategy to curb the obesity epidemic. The JOGG (Youth At a Healthy Weight) approach is a large-scale community-based programme for childhood obesity prevention in the Netherlands that has been implemented over the past ten years. Practice-based development of the programme, both at the national and local level, increasingly poses challenges for its evaluation. One considerable challenge is the increasing acknowledgement of the complexity in the JOGG-approach, characterized by (a) objectives that vary locally, (b) adaptions to the programme over time in response to a community's shifting needs, challenges and opportunities, and (c) emergent outcomes and non-linear causality.We propose an evaluation framework that highlights elements of the complex local practice, including the local programme theory, implementation, adaption, the influence of context and feedback loops and intended as well as emergent and unintended outcomes. By studying each of these elements in practice, we hope to learn about principles that guide effective obesity prevention across contexts. The results of the proposed evaluation will inform both practice and research.Considering complexity in evaluation is a relatively new challenge in public health and therefore an emergent research area. The proposed framework for complex evaluations allows to retrospectively evaluate a programme that was implemented and developed in practice, and enables us to learn from practice-based experiences. Following the ISBNPA Dare2Share initiative, we kindly invite other researchers in the field to share their ideas and experiences regarding integration of complexity in evaluation.

Multiple outcome interactions in healthcare systems: a participatory outcome mapping approach

Outcomes, which are the result state or condition from a process or intervention, are essential elements of healthcare system design and an important indicator of performance. They are included in well-known system analysis frameworks such as the Systems Engineering Initiative for Patient Safety (SEIPS) and Cognitive Work Analysis (CWA). However, fewer practical approaches exist for understanding and communicating interactions among healthcare outcomes. This study applies a novel mapping method as a practical approach to collect, aggregate and visualise interrelations among multiple healthcare outcomes. Graphic facilitation mapping sessions with eleven healthcare providers and ten patients with chronic conditions were conducted. Participants created outcome interrelationship maps following a six-step process. Two outcome-based network visualisations were synthesised using network analysis. This outcome-based approach advances how we frame healthcare systems, focussing on accommodating multiple stakeholders' visions, understanding interrelations, and defining trade-offs. This practical approach may complement frameworks such as SEIPS and CWA. Practitioner summary: The presented outcome-based mapping approach can facilitate the understanding of outcomes as part of the interrelated healthcare system. The approach allows the discussion and integration of different stakeholders' outcome priorities to identify critical elements and better inform the development or adaptation of healthcare systems. Abbreviations: SEIPS: engineering initiative for patient safety; CWA: cognitive work analysis; HFE: human factors and ergonomics; AH: abstraction hierarchy; POTS: postural orthostatic tachycardia syndrome; DRM: design research methodology; FA2: forceAtlas2; HbA1c: glycated haemoglobin; NHS: National Health Service; UK: United Kingdom.

Contextual factors influencing complex intervention research processes in care homes: a systematic review and framework synthesis

Background

Care homes are complex settings to undertake intervention research. Barriers to research implementation processes can threaten studies’ validity, reducing the value to residents, staff, researchers and funders. We aimed to (i) identify and categorise contextual factors that may mediate outcomes of complex intervention studies in care homes and (ii) provide recommendations to minimise the risk of expensive research implementation failures.

Methods

We conducted a systematic review using a framework synthesis approach viewed through a complex adaptive systems lens. We searched: MEDLINE, Embase, CINAHL, ASSIA databases and grey literature. We sought process evaluations of care home complex interventions published in English. Narrative data were indexed under 28 context domains. We performed an inductive thematic analysis across the context domains.

Results

We included 33 process evaluations conducted in high-income countries, published between 2005 and 2019. Framework synthesis identified barriers to implementation that were more common at the task and organisational level. Inductive thematic analysis identified (i) avoiding procedural drift and (ii) participatory action and learning as key priorities for research teams. Research team recommendations include advice for protocol design and care home engagement. Care home team recommendations focus on internal resources and team dynamics. Collaborative recommendations apply to care homes’ individual context and the importance of maintaining positive working relationships.

Discussion

Researchers planning and undertaking research with care homes need a sensitive appreciation of the complex care home context. Study implementation is most effective where an intervention is co-produced, with agreed purpose and adequate resources to incorporate within existing routines and care practices.

Computerized Clinical Decision Support Systems for the Early Detection of Sepsis Among Adult Inpatients: Scoping Review

Background

Sepsis is a significant cause of morbidity and mortality worldwide. Early detection of sepsis followed promptly by treatment initiation improves patient outcomes and saves lives. Hospitals are increasingly using computerized clinical decision support (CCDS) systems for the rapid identification of adult patients with sepsis.

Objective

This scoping review aims to systematically describe studies reporting on the use and evaluation of CCDS systems for the early detection of adult inpatients with sepsis.

Methods

The protocol for this scoping review was previously published. A total of 10 electronic databases (MEDLINE, Embase, CINAHL, the Cochrane database, LILACS [Latin American and Caribbean Health Sciences Literature], Scopus, Web of Science, OpenGrey, ClinicalTrials.gov, and PQDT [ProQuest Dissertations and Theses]) were comprehensively searched using terms for sepsis, CCDS, and detection to identify relevant studies. Title, abstract, and full-text screening were performed by 2 independent reviewers using predefined eligibility criteria. Data charting was performed by 1 reviewer with a second reviewer checking a random sample of studies. Any disagreements were discussed with input from a third reviewer. In this review, we present the results for adult inpatients, including studies that do not specify patient age.

Results

A search of the electronic databases retrieved 12,139 studies following duplicate removal. We identified 124 studies for inclusion after title, abstract, full-text screening, and hand searching were complete. Nearly all studies (121/124, 97.6%) were published after 2009. Half of the studies were journal articles (65/124, 52.4%), and the remainder were conference abstracts (54/124, 43.5%) and theses (5/124, 4%). Most studies used a single cohort (54/124, 43.5%) or before-after (42/124, 33.9%) approach. Across all 124 included studies, patient outcomes were the most frequently reported outcomes (107/124, 86.3%), followed by sepsis treatment and management (75/124, 60.5%), CCDS usability (14/124, 11.3%), and cost outcomes (9/124, 7.3%). For sepsis identification, the systemic inflammatory response syndrome criteria were the most commonly used, alone (50/124, 40.3%), combined with organ dysfunction (28/124, 22.6%), or combined with other criteria (23/124, 18.5%). Over half of the CCDS systems (68/124, 54.8%) were implemented alongside other sepsis-related interventions.

Conclusions

The current body of literature investigating the implementation of CCDS systems for the early detection of adult inpatients with sepsis is extremely diverse. There is substantial variability in study design, CCDS criteria and characteristics, and outcomes measured across the identified literature. Future research on CCDS system usability, cost, and impact on sepsis morbidity is needed.

International Registered Report Identifier (IRRID)

RR2-10.2196/24899

Shifting the dynamics: implementation of locally driven, mixed-methods modelling to inform schistosomiasis control and elimination activities

INTRODUCTION

The integration of more diverse perspectives into the development of evidence for decision-making has been elusive, despite years of rhetoric to the contrary. This has led to cycles of population-based health interventions which have not delivered the promised results. The WHO most recently set a target for schistosomiasis elimination by 2030 and called for cross-cutting approaches to be driven by endemic countries themselves. The extent to which elimination is feasible within the time frame has been a subject of debate.

METHODS

Systems maps were developed through participatory modelling activities with individuals working on schistosomiasis control and elimination activities from the village through national levels in Uganda. These maps were first synthesised, then used to frame the form and content of subsequent mathematical modelling activities, and finally explicitly informed model parameter specifications for simulations, using the open-source SCHISTOX model, driven by the participants.

RESULTS

Based on the outputs of the participatory modelling, the simulation activities centred around reductions in water contact. The results of the simulations showed that mass drug administration, at either the current or target levels of coverage, combined with water contact reduction activities, achieved morbidity control in high prevalence Schistosoma mansoni settings, while both morbidity control and elimination were achieved in high prevalence S. haematobium settings within the 10-year time period.

CONCLUSION

The combination of participatory systems mapping and individual-based modelling was a rich strategy which explicitly integrated the perspectives of national and subnational policymakers and practitioners into the development of evidence. This strategy can serve as a method by which individuals who have not been traditionally included in modelling activities, and do not hold positions or work in traditional centres of power, may be heard and truly integrated into the development of evidence for decision-making in global health.

Transforming Nepal's primary health care delivery system in global health era: addressing historical and current implementation challenges

Nepal’s Primary Health Care (PHC) is aligned vertically with disease control programs at the core and a vast network of community health workers at the periphery. Aligning with the globalization of health and the factors affecting global burden of diseases, Nepal echoes the progressive increase in life expectancy, changes in diseases patterns, including the current impact of COVID-19. Nepal’s health system is also accommodating recent federalization, and thus it is critical to explore how the primary health care system is grappling the challenges amidst these changes. In this review, we conducted a narrative synthesis of literature to explore the challenges related to transformation of Nepal’s primary health care delivery system to meet the demands incurred by impact of globalization and recent federalization, covering following database: PubMED, Embase and Google Scholar. Of the 49 articles abstracted for full text review, 37 were included in the analyses. Existing theories were used for constructing the conceptual framework to explain the study findings. The results are divided into four themes. Additional searches were conducted to further support the narrative synthesis: a total of 46 articles were further included in the articulation of main findings. Transforming Nepal’s primary health care system requires a clear focus on following priority areas that include i) Revised efforts towards strengthening of community based primary health care units; ii) Adapting vertical programs to federal governance; iii) Reinforcing the health insurance scheme; and iv) Strengthening an existing network of community health workers and health human resources. This review discusses how these broad goals bear challenges and opportunities.

Preventing Persistent Postsurgical Pain: A Systematic Review and Component Network Meta-analysis

BACKGROUND AND OBJECTIVES

Evidence for perioperative methods to prevent persistent postsurgical pain (PPP) is uncertain, in part because few treatments have been directly compared. Here we have used component network meta-analysis (cNMA) to incorporate both direct and indirect evidence in the evaluation of the efficacy and tolerability of pharmacological and neural block treatments.

DATABASES AND DATA TREATMENT

We searched the Cochrane Central Registry of Controlled Trials, Embase, MEDLINE, ClinicalTrials.gov, and the World Health Organization International Clinical Trials Registry up to January 2021, for randomized, double-masked, controlled trials that reported the prevalence of PPP. We assessed trial quality with the Cochrane risk of bias tool (RoB 2.0). We analyzed the results with frequentist cNMA models. The primary outcome was the relative risk (RR) of PPP. We assessed efficacy in relation to a clinically important effect size of RR = 0.9, which is a 10% improvement with treatment.

RESULTS

The analysis included 107 trials (13,553 participants) of 13 treatments. The effects of complex interventions were the multiplicative effects of their components. Compared with placebo, serotonin-norepinephrine reuptake inhibitors (SNRIs), neural block alone, or in combination with NMDA receptor blockers or gabapentanoids were effective. Treatments with benefit in the immediate post-operative period predicted a reduced risk of PPP.

CONCLUSIONS

Several treatments and treatment combinations effectively reduce PPP prevalence. Pain outcomes in the immediate postoperative period are an important mediator of PPP. Multimodal interventions can be analyzed using cNMA.

Training primary health care providers in Colombia, Mexico and Peru to increase alcohol screening: Mixed-methods process evaluation of implementation strategy

Background

Initial results from the SCALA study demonstrated that training primary health care providers is an effective implementation strategy to increase alcohol screening in Colombia, Mexico and Peru, but did not show evidence of superior performance for the standard compared to the shorter training arm. This paper elaborates on those outcomes by examining the relationship of training-related process evaluation indicators with the alcohol screening practice.

Methods

A mix of convergent and exploratory mixed-methods design was employed. Data sources included training documentation, post-training questionnaires, observation forms, self-report forms and interviews. Available quantitative data were compared on outcome measure - providers' alcohol screening.

Results

Training reach was high: three hundred fifty-two providers (72.3% of all eligible) participated in one or more training or booster sessions. Country differences in session length reflected adaptation to previous topic knowledge and experience of the providers. Overall, 49% of attendees conducted alcohol screening in practice. A higher dose received was positively associated with screening, but there was no difference between standard and short training arms. Although the training sessions were well received by participants, satisfaction with training and perceived utility for practice were not associated with screening. Profession, but not age or gender, was associated with screening: in Colombia and Mexico, doctors and psychologists were more likely to screen (although the latter represented only a small proportion of the sample) and in Peru, only psychologists.

Conclusions

The SCALA training programme was well received by the participants and led to half of the participating providers conducting alcohol screening in their primary health care practice. The dose received and the professional role were the key factors associated with conducting the alcohol screening in practice.Plain Language Summary: Primary health care providers can play an important role in detecting heavy drinkers among their consulting patients, and training can be an effective implementation strategy to increase alcohol screening and detection. Existing training literature predominantly focuses on evaluating trainings in high-income countries, or evaluating their effectiveness rather than implementation. As part of SCALA (Scale-up of Prevention and Management of Alcohol Use Disorders in Latin America) study, we evaluated training as implementation strategy to increase alcohol screening in primary health care in a middle-income context. Overall, 72.3% of eligible providers attended the training and 49% of training attendees conducted alcohol screening in practice after attending the training. Our process evaluation suggests that simple intervention with sufficient time to practice, adapted to limited provider availability, is optimal to balance training feasibility and effectiveness; that booster sessions are especially important in context with lower organizational or structural support; and that ongoing training refinement during the implementation period is necessary.

Exploring the drivers of malnutrition in West Africa from health and social science perspectives: A comparative methodological review

West Africa has a high burden of malnutrition and the drivers are often complex, highly context-specific, and cut across individual, social, political and environmental domains. Public health research most often considers immediate individual health and diet drivers, at the expense of wider considerations that may fall outside of a health agenda. The objective of this systematic mapping review is to map the broad drivers of malnutrition in West Africa, from public health and social science perspectives, and to evaluate the additional value of an interdisciplinary approach. Evidence was gathered from one public health (MEDLINE) and one social science (International Bibliography of Social Science) database using a detailed search syntax tailored to each disciplinary configuration. Literature was screened against pre-determined eligibility criteria and extracted from abstracts. Studies published in English or French between January 2010 and April 2018 were considered for inclusion. Driver categories (immediate, underlying and basic drivers) were coded against the UNICEF conceptual framework of malnutrition. A total of 358 studies were included; 237 were retrieved from the public health database and 124 from the social science database, 3 studies were included in both. The public health and social science literature document different drivers, with MEDLINE most often reporting immediate drivers of malnutrition and the International Bibliography of Social Science database reporting underlying and basic drivers. The combined literature offers more balanced representation across categories. An interdisciplinary approach proved successful in achieving complementarity in search results while upholding rigorous methods. We recommend that interdisciplinary approaches are utilised to bridge recognised gaps between defined disciplines.

Understanding the impact of exposure to adverse socioeconomic conditions on chronic stress from a complexity science perspective

BACKGROUND

Chronic stress increases chronic disease risk and may underlie the association between exposure to adverse socioeconomic conditions and adverse health outcomes. The relationship between exposure to such conditions and chronic stress is complex due to feedback loops between stressor exposure and psychological processes, encompassing different temporal (acute stress response to repeated exposure over the life course) and spatial (biological/psychological/social) scales. We examined the mechanisms underlying the relationship between exposure to adverse socioeconomic conditions and chronic stress from a complexity science perspective, focusing on amplifying feedback loops across different scales.

METHODS

We developed a causal loop diagram (CLD) to interpret available evidence from this perspective. The CLD was drafted by an interdisciplinary group of researchers. Evidence from literature was used to confirm/contest the variables and causal links included in the conceptual framework and refine their conceptualisation. Our findings were evaluated by eight independent researchers.

RESULTS

Adverse socioeconomic conditions imply an accumulation of stressors and increase the likelihood of exposure to uncontrollable childhood and life course stressors. Repetition of such stressors may activate mechanisms that can affect coping resources and coping strategies and stimulate appraisal of subsequent stressors as uncontrollable. We identified five feedback loops describing these mechanisms: (1) progressive deterioration of access to coping resources because of repeated insolvability of stressors; (2) perception of stressors as uncontrollable due to learned helplessness; (3) tax on cognitive bandwidth caused by stress; (4) stimulation of problem avoidance to provide relief from the stress response and free up cognitive bandwidth; and (5) susceptibility to appraising stimuli as stressors against a background of stress.

CONCLUSIONS

Taking a complexity science perspective reveals that exposure to adverse socioeconomic conditions implies recurrent stressor exposure which impacts chronic stress via amplifying feedback loops that together could be conceptualised as one vicious cycle. This means that in order for individual-level psychological interventions to be effective, the context of exposure to adverse socioeconomic conditions also needs to be addressed.

Framework for the development and evaluation of complex interventions: gap analysis, workshop and consultation-informed update

BACKGROUND

The Medical Research Council published the second edition of its framework in 2006 on developing and evaluating complex interventions. Since then, there have been considerable developments in the field of complex intervention research. The objective of this project was to update the framework in the light of these developments. The framework aims to help research teams prioritise research questions and design, and conduct research with an appropriate choice of methods, rather than to provide detailed guidance on the use of specific methods.

METHODS

There were four stages to the update: (1) gap analysis to identify developments in the methods and practice since the previous framework was published; (2) an expert workshop of 36 participants to discuss the topics identified in the gap analysis; (3) an open consultation process to seek comments on a first draft of the new framework; and (4) findings from the previous stages were used to redraft the framework, and final expert review was obtained. The process was overseen by a Scientific Advisory Group representing the range of relevant National Institute for Health Research and Medical Research Council research investments.

RESULTS

Key changes to the previous framework include (1) an updated definition of complex interventions, highlighting the dynamic relationship between the intervention and its context; (2) an emphasis on the use of diverse research perspectives: efficacy, effectiveness, theory-based and systems perspectives; (3) a focus on the usefulness of evidence as the basis for determining research perspective and questions; (4) an increased focus on interventions developed outside research teams, for example changes in policy or health services delivery; and (5) the identification of six 'core elements' that should guide all phases of complex intervention research: consider context; develop, refine and test programme theory; engage stakeholders; identify key uncertainties; refine the intervention; and economic considerations. We divide the research process into four phases: development, feasibility, evaluation and implementation. For each phase we provide a concise summary of recent developments, key points to address and signposts to further reading. We also present case studies to illustrate the points being made throughout.

LIMITATIONS

The framework aims to help research teams prioritise research questions and design and conduct research with an appropriate choice of methods, rather than to provide detailed guidance on the use of specific methods. In many of the areas of innovation that we highlight, such as the use of systems approaches, there are still only a few practical examples. We refer to more specific and detailed guidance where available and note where promising approaches require further development.

CONCLUSIONS

This new framework incorporates developments in complex intervention research published since the previous edition was written in 2006. As well as taking account of established practice and recent refinements, we draw attention to new approaches and place greater emphasis on economic considerations in complex intervention research. We have introduced a new emphasis on the importance of context and the value of understanding interventions as 'events in systems' that produce effects through interactions with features of the contexts in which they are implemented. The framework adopts a pluralist approach, encouraging researchers and research funders to adopt diverse research perspectives and to select research questions and methods pragmatically, with the aim of providing evidence that is useful to decision-makers.

FUTURE WORK

We call for further work to develop relevant methods and provide examples in practice. The use of this framework should be monitored and the move should be made to a more fluid resource in the future, for example a web-based format that can be frequently updated to incorporate new material and links to emerging resources.

FUNDING

This project was jointly funded by the Medical Research Council (MRC) and the National Institute for Health Research (Department of Health and Social Care 73514).

Characterizing social-ecological context and success factors of antimicrobial resistance interventions across the One Health spectrum: analysis of 42 interventions targeting E. coli

Background

Antimicrobial resistance (AMR) is among the most pressing One Health issues. While interventions and policies with various targets and goals have been implemented, evidence about factors underpinning success and failure of interventions in different sectors is lacking. The objective of this study is to identify characteristics of AMR interventions that increase their capacity to impact AMR. This study focuses on AMR interventions targeting E. coli.

Methods

We used the AMR-Intervene framework to extract descriptions of the social and ecological systems of interventions to determine factors contributing to their success.

Results

We identified 52 scientific publications referring to 42 unique E. coli AMR interventions. We mainly identified interventions implemented in high-income countries (36/42), at the national level (16/42), targeting primarily one sector of society (37/42) that was mainly the human sector (25/42). Interventions were primarily funded by governments (38/42). Most intervention targeted a low leverage point in the AMR system, (36/42), and aimed to change the epidemiology of AMR (14/42). Among all included publications, 55% (29/52) described at least one success factor or obstacle (29/52) and 19% (10/52) identified at least one success factor and one obstacle. Most reported success factors related to communication between the actors and stakeholders and the role of media, and stressed the importance of collaboration between disciplines and external partners. Described obstacles covered data quality, access to data and statistical analyses, and the validity of the results.

Conclusions

Overall, we identified a lack of diversity regarding interventions. In addition, most published E. coli interventions were poorly described with limited evidence of the factors that contributed to the intervention success or failure. Design and reporting guidelines would help to improve reporting quality and provide a valuable tool for improving the science of AMR interventions.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12879-021-06483-z.

Strengthening prevention in communities through systems change: lessons from the evaluation of Healthy Families NZ

This article presents the findings from the first 3 years of the evaluation of Healthy Families NZ, a systems-change intervention to prevent chronic diseases in 10 communities. The initiative, which builds on existing prevention activities, aims to strengthen the health prevention system through evidence-driven action to enable people to make good food choices, be physically active, smoke-free and free from alcohol-related harm. Key investment areas are a dedicated systems thinking and acting health promotion workforce, and activating leaders who can influence transformational change. The evaluation to date has found the initiative is being implemented with integrity. Evidence indicates a shift towards greater action on prevention, and the prevention system being strengthened. Māori ownership has been enabled, and prioritizing equity has led teams to utilize methods that amplify diverse local perspectives. There is progress on developing a flexible workforce through adaptive learning, flexible resources, professional development and a responsive National team. There is also progress in activating local leadership and empowering local teams. The initiative design has explicitly taken into account the context of complexity within which it is being implemented. It has evolved to focus on action that can accelerate sharing information and practices within communities, and between policy and decision-makers. Healthy Families NZ and its evaluation have been refunded to 2022. This provides an important opportunity to gather further insight into effective ways to strengthen the community agency and trust needed to promote and deliver evidence-based action on prevention.

Dynamics of the complex food environment underlying dietary intake in low-income groups: a systems map of associations extracted from a systematic umbrella literature review

Background

Inequalities in obesity pertain in part to differences in dietary intake in different socioeconomic groups. Examining the economic, social, physical and political food environment of low-income groups as a complex adaptive system – i.e. a system of multiple, interconnected factors exerting non-linear influence on an outcome, can enhance the development and assessment of effective policies and interventions by honouring the complexity of lived reality. We aimed to develop and apply novel causal loop diagramming methods in order to construct an evidence-based map of the underlying system of environmental factors that drives dietary intake in low-income groups.

Methods

A systematic umbrella review was conducted on literature examining determinants of dietary intake and food environments in low-income youths and adults in high/upper-middle income countries. Information on the determinants and associations between determinants was extracted from reviews of quantitative and qualitative studies. Determinants were organised using the Determinants of Nutrition and Eating (DONE) framework. Associations were synthesised into causal loop diagrams that were subsequently used to interpret the dynamics underlying the food environment and dietary intake. The map was reviewed by an expert panel and systems-based analysis identified the system paradigm, structure, feedback loops and goals.

Results

Findings from forty-three reviews and expert consensus were synthesised in an evidence-based map of the complex adaptive system underlying the food environment influencing dietary intake in low-income groups. The system was interpreted as operating within a supply-and-demand, economic paradigm. Five sub-systems (‘geographical accessibility’, ‘household finances’, ‘household resources’, ‘individual influences’, ‘social and cultural influences’) were presented as causal loop diagrams comprising 60 variables, conveying goals which undermine healthy dietary intake.

Conclusions

Our findings reveal how poor dietary intake in low-income groups can be presented as an emergent property of a complex adaptive system that sustains a food environment that increases the accessibility, availability, affordability and acceptability of unhealthy foods. In order to reshape system dynamics driving unhealthy food environments, simultaneous, diverse and innovative strategies are needed to facilitate longer-term management of household finances and socially-oriented practices around healthy food production, supply and intake. Ultimately, such strategies must be supported by a system paradigm which prioritises health.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12966-021-01164-1.

Simulation modeling to assess performance of integrated healthcare systems: Literature review to characterize the field and visual aid to guide model selection

Background

The guiding principle of many health care reforms is to overcome fragmentation of service delivery and work towards integrated healthcare systems. Even though the value of integration is well recognized, capturing its drivers and its impact as part of health system performance assessment is challenging. The main reason is that current assessment tools only insufficiently capture the complexity of integrated systems, resulting in poor impact estimations of the actions taken towards the ‘Triple Aim’. We describe the unique nature of simulation modeling to consider key health reform aspects: system complexity, optimization of actions, and long-term assessments.

Research question

How can the use and uptake of simulation models be characterized in the field of performance assessment of integrated healthcare systems?

Methods

A systematic search was conducted between 2000 and 2018, in 5 academic databases (ACM D. Library, CINAHL, IEEE Xplore, PubMed, Web of Science) complemented with grey literature from Google Scholar. Studies using simulation models with system thinking to assess system performance in topics relevant to integrated healthcare were selected for revision.

Results

After screening 2274 articles, 30 were selected for analysis. Five modeling techniques were characterized, across four application areas in healthcare. Complexity was defined in nine aspects, embedded distinctively in each modeling technique. ‘What if?’ & ‘How to?’ scenarios were identified as methods for system optimization. The mean time frame for performance assessments was 18 years.

Conclusions

Simulation models can evaluate system performance emphasizing the complex relations between components, understanding the system’s adaptability to change in short or long-term assessments. These advantages position them as a useful tool for complementing performance assessment of integrated healthcare systems in their pursuit of the ‘Triple Aim’. Besides literacy in modeling techniques, accurate model selection is facilitated after identification and prioritization of the complexities that rule system performance. For this purpose, a tool for selecting the most appropriate simulation modeling techniques was developed.

Performance of conceptual framework elements for the retrieval of qualitative health literature: a case study

Objective

A growing volume of studies address methods for performing systematic reviews of qualitative studies. One such methodological aspect is the conceptual framework used to structure the review question and plan the search strategy for locating relevant studies. The purpose of this case study was to evaluate the retrieval potential of each element of conceptual frameworks in qualitative systematic reviews in the health sciences.

Methods

The presence of elements from conceptual frameworks in publication titles, abstracts, and controlled vocabulary in CINAHL and PubMed was analyzed using a set of qualitative reviews and their included studies as a gold standard. Using a sample of 101 publications, we determined whether particular publications could be retrieved if a specific element from the conceptual framework was used in the search strategy.

Results

We found that the relative recall of conceptual framework elements varied considerably, with higher recall for patient/population (99%) and research type (97%) and lower recall for intervention/phenomenon of interest (74%), outcome (79%), and context (61%).

Conclusion

The use of patient/population and research type elements had high relative recall for qualitative studies. However, other elements should be used with great care due to lower relative recall.

Understanding obesity-related behaviors in youth from a systems dynamics perspective: The use of causal loop diagrams

This paper reports how we applied systems dynamics methods to gain insight into the complexity of obesity-related behaviors in youth, including diet, physical activity, sedentary behavior, and sleep, by integrating a literature review into causal loop diagrams (CLDs). Results showed that the CLDs consisted of multiple subsystems and three types of dynamics appeared, including (1) feedback loops, (2) connections between feedback loops and subsystems, and (3) mechanisms. We observed clear similarities in the dynamics for the four behaviors in that they relate to "traditional" subsystems, such as home and school environments, as well as to newly added subsystems, including macroeconomics, social welfare, and urban systems. The CLDs provided insights that can support the development of intervention strategies, including (1) the confirmation that a range of mechanisms cover and connect multiple levels and settings, meaning that there is no silver bullet to address obesity; (2) understanding of how interventions in one particular setting, such as school, might be influenced by the interactions with other settings, such as urban systems; and (3) a comprehensive view of (un)intended consequences. This way of framing the problem will assist moving towards public health interventions that respond to and operate in the complexity of the real world.

Integrating rights and evidence: a technical advance in abortion guideline development

As part of its core work, the WHO generates, translates and disseminates knowledge, including through guideline development. In recent years, substantial work has been undertaken to revise the Evidence to Decision framework in order to fully integrate inter alia human rights. This paper describes an innovative methodological approach taken by the authors to inform law and policy recommendations for the forthcoming third edition of the Safe Abortion: Technical and Policy Guidance for Health Systems. The methodology described here effectively integrates human rights protection and enjoyment as part of health outcomes and analysis, ensuring that subsequent recommendations are consistent with international human rights standards. This will allow guideline users to make informed decisions on interventions, including legal and policy reform, to fulfil relevant human rights including the right to health.

Making sense of the evidence in population health intervention research: building a dry stone wall

To effectively tackle population health challenges, we must address the fundamental determinants of behaviour and health. Among other things, this will entail devoting more attention to the evaluation of upstream intervention strategies. However, merely increasing the supply of such studies is not enough. The pivotal link between research and policy or practice should be the cumulation of insight from multiple studies. If conventional evidence synthesis can be thought of as analogous to building a wall, then we can increase the supply of bricks (the number of studies), their similarity (statistical commensurability) or the strength of the mortar (the statistical methods for holding them together). However, many contemporary public health challenges seem akin to herding sheep in mountainous terrain, where ordinary walls are of limited use and a more flexible way of combining dissimilar stones (pieces of evidence) may be required. This would entail shifting towards generalising the functions of interventions, rather than their effects; towards inference to the best explanation, rather than relying on binary hypothesis-testing; and towards embracing divergent findings, to be resolved by testing theories across a cumulated body of work. In this way we might channel a spirit of pragmatic pluralism into making sense of complex sets of evidence, robust enough to support more plausible causal inference to guide action, while accepting and adapting to the reality of the public health landscape rather than wishing it were otherwise. The traditional art of dry stone walling can serve as a metaphor for the more ‘holistic sense-making’ we propose.

Identifying data for the empirical assessment of law (IDEAL): a realist approach to research gaps on the health effects of abortion law

Reproductive rights have been the focus of United Nations consensus documents, a priority for agencies like the WHO, and the subject of judgments issued by national and international courts. Human rights approaches have galvanised abortion law reform across numerous countries, but human rights analysis is not designed to empirically assess how legal provisions regulating abortion shape the actual delivery of abortion services and outcomes. Reliable empirical measurement of the health and social effects of abortion regulation is vital input for policymakers and public health guidance for abortion policy and practice, but research focused explicitly on assessing the health effects of abortion law and policy is limited at the global level. This paper describes a method for Identifying Data for the Empirical Assessment of Law (IDEAL), to assess potential health effects of abortion regulations. The approach was applied to six critical legal interventions: mandatory waiting periods, third-party authorisation, gestational limits, criminalisation, provider restrictions and conscientious objection. The IDEAL process allowed researchers to link legal interventions and processes that have not been investigated fully in empirical research to processes and outcomes that have been more thoroughly studied. To the extent these links are both transparent and plausible, using IDEAL to make them explicit allows both researchers and policy stakeholders to make better informed assessments and guidance related to abortion law. The IDEAL method also identifies gaps in scientific research. Given the importance of law to public health generally, the utility of IDEAL is not limited to abortion law.

[Evidence-based public health: perspectives and specific implementation factors]

Evidenzbasierung stellt auch im öffentlichen Gesundheitswesen eine zentrale Anforderung dar. 5 allgemeine Prinzipien gelten in der evidenzbasierten Medizin wie in der evidenzbasierten Public Health (EBPH). Sie umfassen Systematik, Transparenz im Umgang mit Unsicherheit, Integration und Partizipation, Umgang mit Interessenkonflikten sowie einen strukturierten, reflektierten Prozess. Dieser Artikel hat das Ziel, ein gemeinsames Verständnis von evidenzbasierter Public Health zu fördern.

Mit einer systematischen Literaturrecherche zu Perspektiven der Evidenzbasierung in Public Health wurde das internationale Verständnis von EBPH beleuchtet. So wurden 20 englischsprachige und eine deutschsprachige Quelle identifiziert und einer Inhaltsanalyse unterzogen. Über die allgemeinen Prinzipien hinausgehende Charakteristika dieser Perspektiven befassen sich mit Aspekten der Bevölkerungsorientierung, dem zugrunde liegenden Verständnis von Evidenz, zu beteiligenden Disziplinen und Interessengruppen sowie relevanten Kriterien und notwendigen Kompetenzen für eine Umsetzung von Evidenzbasierung.

Darauf aufbauend und unter Berücksichtigung methodischer Entwicklungen im Umgang mit Komplexität lassen sich 4 spezifische Umsetzungsfaktoren der EBPH ableiten. Sie umfassen Theorie, Interdisziplinarität, Kontextabhängigkeit und Komplexität sowie allgemeine gesellschaftliche Aspekte.

Die praktische Umsetzung von EBPH erfordert personelle und finanzielle Ressourcen sowie Kompetenzen – unter anderem für die Durchführung systematischer Übersichtsarbeiten zur Wirksamkeit von Maßnahmen unter Alltagsbedingungen, für die wissenschaftliche Betrachtung weiterer relevanter Fragestellungen sowie für die Etablierung transparenter Prozesse zur Formulierung von Empfehlungen.

Together stronger: boundary work within an Australian systems-based prevention initiative

Complexity and systems science are increasingly used to devise interventions to address health and social problems. Boundaries are important in systems thinking, as they bring attention to the power dynamics that guide decision-making around the framing of a situation, and how it is subsequently tackled. Using complexity theory as an analytical frame, this qualitative exploratory study examined boundary interactions between local government and community health organizations during the operationalization of a systems-based initiative to prevent obesity and chronic diseases (Healthy Together Communities-HTCs) in Victoria, Australia. Across two HTC sites, data was generated through semi-structured interviews with 20 key informants, in mid-2015. Template analysis based on properties of complex systems was applied to the data. The dynamics of boundary work are explored using three case illustrations: alignment, boundary spanning and boundary permeability. Alignment was both a process and an outcome of boundary work, and occurred at strategic, operational and individual levels. Boundary spanning was an important mechanism to develop a unified collaborative approach, and ensure that mainstream initiatives reached disadvantaged groups. Finally, some boundaries exhibited different levels of permeability for local government and community health organizations. This influenced how each organization could contribute to HTC interventions in unique, yet complementary ways. The study of boundary work offers potential for understanding the mechanisms that contribute to the nonlinear behaviour of complex systems. The complementarity of partnering organizations, and boundary dynamics should be considered when designing and operationalizing multilevel, complex systems-informed prevention initiatives.

Selecting Review Outcomes for Systematic Reviews of Public Health Interventions

For systematic reviews to have an impact on public health, they must report outcomes that are important for decision-making. Systematic reviews of public health interventions, however, have a range of potential end users, and identifying and prioritizing the most important and relevant outcomes represents a considerable challenge.In this commentary, we describe potentially useful approaches that systematic review teams can use to identify review outcomes to best inform public health decision-making. Specifically, we discuss the importance of stakeholder engagement, the use of logic models, consideration of core outcome sets, reviews of the literature on end users' needs and preferences, and the use of decision-making frameworks in the selection and prioritization of outcomes included in reviews.The selection of review outcomes is a critical step in the production of public health reviews that are relevant to those who use them. Utilizing the suggested strategies may help the review teams better achieve this.

A review of methods for addressing components of interventions in meta-analysis

Many healthcare interventions are complex, consisting of multiple, possibly interacting, components. Several methodological articles addressing complex interventions in the meta-analytical context have been published. We hereby provide an overview of methods used to evaluate the effects of complex interventions with meta-analytical models. We summarized the methodology, highlighted new developments, and described the benefits, drawbacks, and potential challenges of each identified method. We expect meta-analytical methods focusing on components of several multicomponent interventions to become increasingly popular due to recently developed, easy-to-use, software tools that can be used to conduct the relevant analyses. The different meta-analytical methods are illustrated through two examples comparing psychotherapies for panic disorder.

The case for developing a cohesive systems approach to research across unhealthy commodity industries

OBJECTIVES

Most non-communicable diseases are preventable and largely driven by the consumption of harmful products, such as tobacco, alcohol, gambling and ultra-processed food and drink products, collectively termed unhealthy commodities. This paper explores the links between unhealthy commodity industries (UCIs), analyses the extent of alignment across their corporate political strategies, and proposes a cohesive systems approach to research across UCIs.

METHODS

We held an expert consultation on analysing the involvement of UCIs in public health policy, conducted an analysis of business links across UCIs, and employed taxonomies of corporate political activity to collate, compare and illustrate strategies employed by the alcohol, ultra-processed food and drink products, tobacco and gambling industries.

RESULTS

There are clear commonalities across UCIs' strategies in shaping evidence, employing narratives and framing techniques, constituency building and policy substitution. There is also consistent evidence of business links between UCIs, as well as complex relationships with government agencies, often allowing UCIs to engage in policy-making forums. This knowledge indicates that the role of all UCIs in public health policy would benefit from a common approach to analysis. This enables the development of a theoretical framework for understanding how UCIs influence the policy process. It highlights the need for a deeper and broader understanding of conflicts of interests and how to avoid them; and a broader conception of what constitutes strong evidence generated by a wider range of research types.

CONCLUSION

UCIs employ shared strategies to shape public health policy, protecting business interests, and thereby contributing to the perpetuation of non-communicable diseases. A cohesive systems approach to research across UCIs is required to deepen shared understanding of this complex and interconnected area and also to inform a more effective and coherent response.

Care-experienced cHildren and young people's Interventions to improve Mental health and wEll-being outcomes: Systematic review (CHIMES) protocol

INTRODUCTION

The mental health and well-being of children and young people who have been in care (ie, care-experienced) are a priority. There are a range of interventions aimed at addressing these outcomes, but the international evidence-base remains ambiguous. There is a paucity of methodologically robust systematic reviews of intervention effectiveness, with few considering the contextual conditions under which evaluations were conducted. This is important in understanding the potential transferability of the evidence-base across contexts. The present systematic review will adopt a complex systems perspective to synthesise evidence reporting evaluations of mental health and well-being interventions for care-experienced children and young people. It will address impact, equity, cost-effectiveness, context, implementation and acceptability. Stakeholder consultation will prioritise a programme theory, and associated intervention, that may progress to further development and evaluation in the UK.

METHODS AND ANALYSIS

We will search 16 bibliographic databases from 1990 to June 2020. Supplementary searching will include citation tracking, author recommendation, and identification of evidence clusters relevant to included evaluations. The eligible population is children and young people (aged ≤25 years) with experience of being in care. Outcomes are (1) mental, behavioural or neurodevelopmental disorders; (2) subjective well-being; (3) self-harm; suicidal ideation; suicide. Study quality will be appraised with methodologically appropriate tools. We will construct a taxonomy of programme theories and intervention types. Thematic synthesis will be used for qualitative data reporting context, implementation and acceptability. If appropriate, meta-analysis will be conducted with outcome and economic data. Convergent synthesis will be used to integrate syntheses of qualitative and quantitative data.

ETHICS AND DISSEMINATION

We have a comprehensive strategy for engagement with care-experienced children and young people, carers and social care professionals. Dissemination will include academic and non-academic publications and conference presentations. Ethical approval from Cardiff University's School of Social Sciences REC will be obtained if necessary.

PROSPERO REGISTRATION NUMBER

CRD42020177478.