Processes, contexts, and rationale for disinvestment: a protocol for a critical interpretive synthesis

Greater agreement is required to harness the potential of health intelligence: a critical interpretive synthesis

OBJECTIVES

To synthesize existing knowledge on the features of, and approaches to, health intelligence, including definitions, key concepts, frameworks, methods and tools, types of evidence used, and research gaps.

STUDY DESIGN AND SETTING

We applied a critical interpretive synthesis methodology, combining systematic searching, purposive sampling, and inductive analysis to explore the topic. We conducted electronic and supplementary searches to identify records (papers, books, websites) based on their potential relevance to health intelligence. The key themes identified in the literature were combined under each of the compass subquestions and circulated among the research team for discussion and interpretation.

RESULTS

Of the 290 records screened, 40 were included in the synthesis. There is no clear definition of health intelligence in the literature. Some records describe it in similar terms as public health surveillance. Some focus on the use of artificial intelligence, while others refer to health intelligence in a military or security sense. And some authors have suggested a broader definition of health intelligence that explicitly includes the concepts of synthesis of research evidence for informed decision making.

CONCLUSION

Rather than developing a new or all-encompassing definition, we suggest incorporating the concept and scope of health intelligence within the evidence ecosystem.

Prevalence of Computed Tomography Overuse for Mild Head Injury in Adults

INTRODUCTION

The Canadian CT Head Rule (CCHR) is one of many established guidelines for assessing the need for computed tomography (CT) imaging in patients with minor head injuries. Adhering to such criteria would promote the appropriate use of CT imaging, lower healthcare expenses, and prevent harmful radiation exposure. There is no current literature assessing the overuse of CT imaging for minor head injuries in the Kingdom of Bahrain. This study aims to evaluate CT overuse in adult patients with minor head trauma.  Methods: The study was conducted at the Bahrain Defense Force Hospital over 12 months from January to December 2021. All adult patients (>14 years) who sustained a minor head injury and were referred to the emergency department for CT brain imaging were included in the study. Patients presenting for other reasons or suffering from moderate to severe head injuries were excluded. CT reports were retrieved for analysis. The CCHR was used as a reference.  Results: A total of 486 CT scans were performed. Loss of consciousness was the most common symptom on presentation (n = 74 cases). Only 12.1% of CT scans reported positive findings. The prevalence of CT overuse was highest in patients aged 21-30 years. Patients presenting with loss of consciousness showed a high overuse of CT imaging, accounting for 20.3% of all cases. Only 77.4% of cases met the CCHR criteria and 22.6% were defined as overuse, with 95% confidence interval (0.189, 0.266).  Conclusion: When referring to the CCHR, CT imaging for a minor head injury in adults was overused in 22.6% of cases. Further research will be required to reveal the underlying reasons for these findings along with interventions to reduce future overuse.

Facilitators, barriers and strategies for health-system guidance implementation: a critical interpretive synthesis protocol

Background

As systematically developed statements regarding possible courses of action, health system guidance (HSG) can assist with making decisions about addressing problems or achieving goals in health systems. However, there are conceptual and methodological challenges in HSG implementation due to the complexity of health-system policy-making, the diversity of available evidence and vast differences in contexts. To address these gaps, we aim to develop a theoretical framework for supporting HSG implementation as part of a broader effort to promote evidence-informed policy-making in health systems.

Methods

To develop a theoretical framework about facilitators, barriers and strategies for HSG implementation, we will apply a critical interpretive synthesis (CIS) approach to synthesize the findings from a range of relevant literature. We will search 11 electronic databases and seven organizational websites to identify relevant published and grey literature. We will check the references of included studies and contact experts to identify additional eligible papers. Finally, we will conduct purposively sampling of the literature to fill any identified conceptual gaps. We will use relevance and five quality criteria to assess included papers. A standardized form will be developed for extracting information. We will use an interpretive analytic approach to synthesize the findings, including a constant comparative method throughout the analysis. Two independent reviewers will conduct the literature screening and relevance assessment, and disagreements will be resolved through discussion. The principal investigator will conduct data extraction and synthesis, and a second reviewer will check the sample of extracted data for consistency and accuracy.

Discussion

A new theoretical framework about facilitators, barriers and strategies for HSG implementation will be developed using a CIS approach. The HSG implementation framework could be widely used for supporting the implementation of HSG covering varied topics and in different contexts (including low-, middle- and high-income countries). In later work, we will develop a tool for supporting HSG implementation based on the theoretical framework.

Registration PROSPERO CRD42020214072. Date of Registration: 14 December 2020.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12961-022-00908-0.

Understanding the Conceptualization and Operationalization of Trauma-Informed Care Within and Across Systems: A Critical Interpretive Synthesis

Policy Points In order to achieve successful operationalization of trauma-informed care (TIC), TIC policies must include conceptual clarity regarding the definition of both trauma and TIC. Furthermore, TIC requires clear and cohesive policies that address operational factors such as clearly delineated roles of service providers, protocol for positive trauma screens, necessary financial infrastructure, and mechanisms of intersectoral collaboration. Additionally, policy procedures need to be considered for how TIC is provided at the program and service level as well as what TIC means at the organizational, system, and intersectoral level.

CONTEXT

Increased recognition of the epidemiology of trauma and its impact on individuals within and across human service delivery systems has contributed to the development of trauma-informed care (TIC). How TIC can be conceptualized and implemented, however, remains unclear. This study seeks to review and analyze the TIC literature from within and across systems of care and to generate a conceptual framework regarding TIC.

METHODS

Our study followed a critical interpretive synthesis methodology. We searched multiple databases (Campbell Collaboration, Econlit, Health Systems Evidence, Embase, ERIC, HealthSTAR, IPSA, JSTOR, Medline, PsychINFO, Social Sciences Abstracts, Sociological Abstracts and Web of Science),as well as relevant gray literature and information-rich websites. We used a coding tool, adapted to the TIC literature, for data extraction.

FINDINGS

Electronic database searches yielded 2,439 results and after inclusion/exclusion criteria were applied, a purposive sample of 98 information-rich articles was generated. Conceptual clarity and definitional understanding of TIC is lacking in the literature, which has led to poor operationalization of TIC. Additionally, infrastructural and ideological barriers, such as insufficient funding and service provider "buy-in," have hindered TIC implementation. The resulting conceptual framework defines trauma and depicts critical elements of vertical TIC, including the bidirectional relationship between the trauma-affected individual and the system, and horizontal TIC, which requires intersectoral collaboration, an established referral network, and standardized TIC language.

CONCLUSIONS

Successful operationalization of TIC requires policies that address current gaps in systems arrangements, such as the lack of funding structures for TIC, and political factors, such as the role of policy legacies. The emergent conceptual framework acknowledges critical factors affecting operationalization.

Maternal and newborn health for the urban poor: the need for a new mental model and implementation strategies to accelerate progress

Background

Urbanization challenges the assumptions that have traditionally influenced maternal and newborn health (MNH) programs. This landscaping outlines how current mental models for MNH programs have fallen short for urban slum populations and identifies implications for the global community. We employed a three-pronged approach, including a literature review, key informant interviews with global- and national-level experts, and a case study in Bangladesh.

Main body

Our findings highlight that the current mental model for MNH is inadequate to address the needs of the urban poor. Implementation challenges have arisen from using traditional methods that are not well adapted to traits inherent in slum settings. A re-thinking of implementation strategies will also need to consider a paucity of available routine data, lack of formal coordination between stakeholders and providers, and challenging municipal government structures. Innovative approaches, including with communications, outreach, and technology, will be necessary to move beyond traditional rural-centric approaches to MNH. As populations continue to urbanize, common slum dynamics will challenge conventional strategies for health service delivery. In addition, the COVID-19 pandemic has exposed weaknesses in a system that requires intersectoral collaborations to deliver quality care.

Conclusion

Programs will need to be iterative and adaptive, reflective of sociodemographic features. Integrating the social determinants of health into evaluations, using participatory human-centered design processes, and innovative public-private partnerships may prove beneficial in slum settings. But a willingness to rethink the roles of all actors within the delivery system overall may be needed most.

Domains and processes for institutionalizing evidence-informed health policy-making: a critical interpretive synthesis

Background

While calls for institutionalization of evidence-informed policy-making (EIP) have become stronger in recent years, there is a paucity of methods that governments and organizational knowledge brokers can use to sustain and integrate EIP as part of mainstream health policy-making. The objective of this paper was to conduct a knowledge synthesis of the published and grey literatures to develop a theoretical framework with the key features of EIP institutionalization.

Methods

We applied a critical interpretive synthesis (CIS) that allowed for a systematic, yet iterative and dynamic analysis of heterogeneous bodies of literature to develop an explanatory framework for EIP institutionalization. We used a “compass” question to create a detailed search strategy and conducted electronic searches to identify papers based on their potential relevance to EIP institutionalization. Papers were screened and extracted independently and in duplicate. A constant comparative method was applied to develop a framework on EIP institutionalization. The CIS was triangulated with the findings of stakeholder dialogues that involved civil servants, policy-makers and researchers.

Results

We identified 3001 references, of which 88 papers met our eligibility criteria. This CIS resulted in a definition of EIP institutionalization as the “process and outcome of (re-)creating, maintaining and reinforcing norms, regulations, and standard practices that, based on collective meaning and values, actions as well as endowment of resources, allow evidence to become—over time—a legitimate and taken-for-granted part of health policy-making”. The resulting theoretical framework comprised six key domains of EIP institutionalization that capture both structure and agency: (1) governance; (2) standards and routinized processes; (3) partnership, collective action and support; (4) leadership and commitment; (5) resources; and (6) culture. Furthermore, EIP institutionalization is being achieved through five overlapping stages: (i) precipitating events; (ii) de-institutionalization; (iii) semi-institutionalization (comprising theorization and diffusion); (iv) (re)-institutionalization; and (v) renewed de-institutionalization processes.

Conclusions

This CIS advances the theoretical and conceptual discussions on EIP institutionalization, and provides new insights into an evidence-informed framework for initiating, strengthening and/or assessing efforts to institutionalize EIP.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12961-022-00820-7.

Exploring the co-involvement of disabled adolescents in participatory action research; protocol for a critical interpretative synthesis

Background: Participatory action research (PAR) provides an opportunity for academic researchers and adolescents to co-conduct research within an area of shared interest. Reciprocal learning occurs as co-researchers acquire research skills and knowledge, and academic researchers gain understanding of the issue being examined, from the perspective of those with lived experience. All members of the research team have a shared responsibility for the research and decision-making processes. PAR has predominantly involved adults as co-researchers. However, in recent years more effort has been made to co-conduct research with adolescents. The aim of this review is to interrogate the practices of academic researchers employing a PAR approach when working along-side disabled adolescents.

Methods/design: A critical interpretive synthesis (CIS) will be conducted, allowing for a diverse range of evidence to be drawn from. A systematic search of nine databases, from 1990 onwards, will be conducted first. Reference checking will occur to elicit further relevant data. Following screening, further purposive sampling will be completed to facilitate the development of concepts and theory in line with the on-going analysis and synthesis of findings. Data analysis will involve interpretation of included papers in relation to the principles of PAR and a ‘best-practice’ framework will be developed. During analysis particular emphasis will be given to the identification of potential social barriers to the participation of disabled adolescents in PAR.   

Discussion: PAR is widely employed but little is known about its use when working with disabled adolescents. This current CIS will critically question the current practices of academic researchers employing PAR when working along-side disabled adolescents and future research through the best practice framework we will develop.

Too Much Cancer Care?: Nurses' Perspectives on the Unnecessary Use of Oncology Services

BACKGROUND

"Unnecessary use of health services" refers to care that does not add value for patients and can lead to physical, emotional, and economical harm. High rates of overuse have been reported within oncology, and patients experience its consequences.

OBJECTIVE

The aim of this study was to explore perceptions and experiences of oncology nurses regarding unnecessary use of oncology services.

METHODS

In-depth, semistructured interviews were conducted with a convenience sample of 20 oncology nurses currently practicing in Israel. Interviews were recorded, transcribed, and analyzed thematically.

RESULTS

Themes included perceptions of unnecessary use of health services in cancer (causes and effects of unnecessary use, current and proposed solutions) and negative effects of unnecessary cancer care on patients, families, providers, and the system, including decreased quality of life, increased suffering, and emotional effects on patients and families. Causes were seen on provider, family, and patient levels, such as difficulty for providers to "give up," lack of registered nurses' authority, and family and patient demands. Multidisciplinary care provision, nurses' role, and the patient-provider relationship were seen as existing facilitators minimizing unnecessary use. Future improvement can be achieved by strengthening relationships, providing support to healthcare providers, and improving communication.

CONCLUSIONS

Nurses perceive unnecessary use of health services as a result of multiple, interlinked and complex causes, but few targeted interventions exist. Future research should explore quantifying unnecessary use to determine an accurate representation of the issue.

IMPLICATIONS FOR PRACTICE

Solutions should include engaging patients and families, involving nurses, and fostering multidisciplinary collaborative teamwork to positively affect care and treatment decision-making processes.

Understanding the implementation of evidence-informed policies and practices from a policy perspective: a critical interpretive synthesis

BACKGROUND

The fields of implementation science and knowledge translation have evolved somewhat independently from the field of policy implementation research, despite calls for better integration. As a result, implementation theory and empirical work do not often reflect the implementation experience from a policy lens nor benefit from the scholarship in all three fields. This means policymakers, researchers, and practitioners may find it challenging to draw from theory that adequately reflects their implementation efforts.

METHODS

We developed an integrated theoretical framework of the implementation process from a policy perspective by combining findings from these fields using the critical interpretive synthesis method. We began with the compass question: How is policy currently described in implementation theory and processes and what aspects of policy are important for implementation success? We then searched 12 databases as well as gray literature and supplemented these documents with other sources to fill conceptual gaps. Using a grounded and interpretive approach to analysis, we built the framework constructs, drawing largely from the theoretical literature and then tested and refined the framework using empirical literature.

RESULTS

A total of 11,434 documents were retrieved and assessed for eligibility and 35 additional documents were identified through other sources. Eighty-six unique documents were ultimately included in the analysis. Our findings indicate that policy is described as (1) the context, (2) a focusing lens, (3) the innovation itself, (4) a lever of influence, (5) an enabler/facilitator or barrier, or (6) an outcome. Policy actors were also identified as important participants or leaders of implementation. Our analysis led to the development of a two-part conceptual framework, including process and determinant components.

CONCLUSIONS

This framework begins to bridge the divide between disciplines and provides a new perspective about implementation processes at the systems level. It offers researchers, policymakers, and implementers a new way of thinking about implementation that better integrates policy considerations and can be used for planning or evaluating implementation efforts.

Understanding the implementation of evidence-informed policies and practices from a policy perspective: a critical interpretive synthesis

BACKGROUND

The fields of implementation science and knowledge translation have evolved somewhat independently from the field of policy implementation research, despite calls for better integration. As a result, implementation theory and empirical work do not often reflect the implementation experience from a policy lens nor benefit from the scholarship in all three fields. This means policymakers, researchers, and practitioners may find it challenging to draw from theory that adequately reflects their implementation efforts.

METHODS

We developed an integrated theoretical framework of the implementation process from a policy perspective by combining findings from these fields using the critical interpretive synthesis method. We began with the compass question: How is policy currently described in implementation theory and processes and what aspects of policy are important for implementation success? We then searched 12 databases as well as gray literature and supplemented these documents with other sources to fill conceptual gaps. Using a grounded and interpretive approach to analysis, we built the framework constructs, drawing largely from the theoretical literature and then tested and refined the framework using empirical literature.

RESULTS

A total of 11,434 documents were retrieved and assessed for eligibility and 35 additional documents were identified through other sources. Eighty-six unique documents were ultimately included in the analysis. Our findings indicate that policy is described as (1) the context, (2) a focusing lens, (3) the innovation itself, (4) a lever of influence, (5) an enabler/facilitator or barrier, or (6) an outcome. Policy actors were also identified as important participants or leaders of implementation. Our analysis led to the development of a two-part conceptual framework, including process and determinant components.

CONCLUSIONS

This framework begins to bridge the divide between disciplines and provides a new perspective about implementation processes at the systems level. It offers researchers, policymakers, and implementers a new way of thinking about implementation that better integrates policy considerations and can be used for planning or evaluating implementation efforts.

Towards a multilevel governance framework on the implementation of patient rights in health facilities: a protocol for a systematic scoping review

INTRODUCTION

Patient rights are "those rights that are attributed to a person seeking healthcare". Patient rights have implications for quality of healthcare and acts as a key accountability tool. It can galvanise structural improvements in the health system and reinforces ethical healthcare. States are duty bound to respect, protect and promote patient rights. The rhetoric on patient rights is burgeoning across the globe. With changing modes of governance arrangements, a number of state and non-state actors and institutions at various levels play a role in the design and implementation of (patient rights) policies. However, there is limited understanding on the multilevel institutional mechanisms for patient rights implementation in health facilities. We attempt to fill this gap by analysing the available scholarship on patient rights through a critical interpretive synthesis approach in a systematic scoping review.

METHODS

The review question is 'how do the multilevel actors, institutional structures, processes interact and influence the patient rights implementation in healthcare facilities? How do they work at what level and in which contexts?" Three databases PubMed, LexisNexis and Web of Science will be systematically searched until 30 th April 2020, for empirical and non-empirical literature in English from both lower middle-income countries and high-income countries. Targeted search will be performed in grey literature and through citation and reference tracking of key records. Using the critical interpretive synthesis approach, a multilevel governance framework on the implementation of patient rights in health facilities which is grounded in the data will be developed.

ETHICS AND DISSEMINATION

The review uses published literature hence ethics approval is not required. The findings of the review will be published in a peer-reviewed journal.

REGISTRATION NUMBER

PROSPERO 2020 CRD42020176939.

A framework for explaining the role of values in health policy decision-making in Latin America: a critical interpretive synthesis

BACKGROUND

Although values underpin the goals pursued in health systems, including how health systems benefit the population, it is often not clear how values are incorporated into policy decision-making about health systems. The challenge is to encompass social/citizen values, health system goals, and financial realities and to incorporate them into the policy-making process. This is a challenge for all health systems and of particular importance for Latin American (LA) countries. Our objective was to understand how and under what conditions societal values inform decisions about health system financing in LA countries.

METHODS

A critical interpretive synthesis approach was utilised for this work. We searched 17 databases in December 2016 to identify articles written in English, Spanish or Portuguese that focus on values that inform the policy process for health system financing in LA countries at the macro and meso levels. Two reviewers independently screened records and assessed them for inclusion. One researcher conceptually mapped the included articles, created structured summaries of key findings from each, and selected a purposive sample of articles to thematically synthesise the results across the domains of agenda-setting/prioritisation, policy development and implementation.

RESULTS

We identified 5925 references, included 199 papers, and synthesised 68 papers. We identified 116 values and developed a framework to explain how values have been used to inform policy decisions about financing in LA countries. This framework has four categories - (1) goal-related values (i.e. guiding principles of the health system); (2) technical values (those incorporated into the instruments adopted by policy-makers to ensure a sustainable and efficient health system); (3) governance values (those applied in the policy process to ensure a transparent and accountable process of decision-making); and (4) situational values (a broad category of values that represent competing strategies to make decisions in the health systems, their influence varying according to the four factors).

CONCLUSIONS

It is an effort to consolidate and explain how different social values are considered and how they support policy decision-making about health system financing. This can help policy-makers to explicitly incorporate values into the policy process and understand how values are supporting the achievement of policy goals in health system financing.

TRIAL REGISTRATION

The protocol was registered with PROSPERO, ID=CRD42017057049 .

An integrated model of multimorbidity and symptom science

BACKGROUND

Prevalence and complexity of persons with multiple chronic conditions (MCC), also known as multimorbidity, are shifting clinical practice from a single disease focus to one considering MCC and symptoms. Although symptoms are intricately bound to concepts inherent in MCC science, symptoms are largely ignored in multimorbidity research and literature.

PURPOSE

Introduce an Integrated Model of Multimorbidity and Symptom Science.

METHODS

Critical integrative review and synthesis process.

FINDINGS

The model comprises three primary domains: 1. Contributing/ Risk Factors; 2. Symptom/Disease/Treatment Interactions; and 3. Patient Outcomes.

DISCUSSION

The model highlights the multilevel nature of contributing factors and the recursive interactions among multiple etiologies, conditions, symptoms, therapies, and outcomes.

A critical interpretive synthesis of informal payments in maternal health care

Informal payments for healthcare are widely acknowledged as undercutting health care access, but empirical research is somewhat limited. This article is a critical interpretive synthesis that summarizes the evidence base on the drivers and impact of informal payments in maternal health care and critically interrogates the paradigms that are used to describe informal payments. Studies and conceptual articles identified both proximate and systems drivers of informal payments. These include norms of gift giving, health workforce scarcity, inadequate health systems financing, the extent of formal user fees, structural adjustment and the marketization of health care, and patient willingness to pay for better care. Similarly, there are proximal and distal impacts, including on household finances, patient satisfaction and provider morale. Informal payments have been studied and addressed from a variety of different perspectives, including anti-corruption, ethnographic and other in-depth qualitative approaches and econometric modelling. Summarizing and discussing the advantages and disadvantages of these and other paradigms illustrates the value of an inter-disciplinary approach. The same tacit, hidden attributes that make informal payments hard to measure also make them hard to discuss and address. A multidisciplinary health systems approach that leverages and integrates positivist, interpretivist and constructivist tools of social science research can lead to better insight. With this, we can challenge ‘master narratives’ and meet universalistic, equity-oriented global health objectives.

Stakeholder perspectives on the challenges surrounding management and supply of essential medicines

Background Shortages of essential medicines impact patient safety and raise the costs of medicines to consumers and governments. Ongoing medicine shortages have become a critical issue that threaten global access to medicines. Objective The aim of this study was to explore key stakeholders' perspectives on the challenges surrounding management and supply of essential medicines. Setting Western Pacific, Asia, Europe, North America, and Africa. Methods In-depth, semi-structured interviews with 47 participants were conducted across seven stakeholder groups globally. Stakeholders included government, academics, consumer groups, non-profit organisations, hospital healthcare providers, manufacturers, and wholesaler/distributors. A grounded theory approach was applied to qualitative analysis. Main outcome measure Stakeholders' perspectives on the challenges surrounding management and supply of essential medicines. Results This study showed that supporting consumer demand for a wide range of therapeutic products required increased resources and coordination. Four main themes were identified: (1) consumer demand for a wide range of individual therapeutic needs cannot be sustained by the supply chain; (2) there lacked a coordinated approach to manage medicine shortages throughout the supply chain; (3) there were gaps in communication throughout the continuum of the supply chain; and (4) both international and local disruptions contributed to vulnerabilities in the supply chain. Conclusion Prioritisation of supply, logistics, and budget decisions around essential medicines need to be clearly coordinated between stakeholders to mitigate medicine shortages. Financial structures should include resilience planning to support fair and equitable access to medicines that meet consumer needs.

Assessing value in health care: using an interpretive classification system to understand existing practices based on a systematic review

BACKGROUND

Implementing adequate strategies to assess the value of health services plays a central role in the effort to deal with the financial pressures faced by health care systems worldwide. This study aimed to understand which approaches to value assessment have been used in developed countries.

METHODS

We conducted a rapid review and a gray literature search to identify value assessment frameworks. A two-stage screening process was utilized to identify existing approaches and cluster similar frameworks. In addition, we developed an interpretive classification system to make sense of existing approaches.

RESULTS

One thousand one hundred seventy-six references were identified and 38 papers were selected for full-review. Among these 38 articles, 22 distinct approaches to assess value of health care interventions were identified and classified according to four points: 1) use of single or multiple considerations to base value estimates; 2) use of disease-specific or generic criteria; 3) reliance on process-based or outcomes-based consideration; and 4) type of input and evidence considered.

CONCLUSIONS

The contextual nature of value assessment in health care becomes evident with the diversity of existing approaches. Despite the predominance of cases relying on the Incremental cost-effectiveness ratio as the measure of value, this approach has not been sufficient to meet the needs of decision-makers. The use of multiple criteria has become more and more important, as well as the consideration of patient-reported measures. Considerations of costs are not always explicit and consistent.

Addressing overuse of health services in health systems: a critical interpretive synthesis

Background

Health systems are increasingly focusing on the issue of ‘overuse’ of health services and how to address it. We developed a framework focused on (1) the rationale and context for health systems prioritising addressing overuse, (2) elements of a comprehensive process and approach to reduce overuse and (3) implementation considerations for addressing overuse.

Methods

We conducted a critical interpretive synthesis informed by a stakeholder-engagement process. The synthesis identified relevant empirical and non-empirical articles about system-level overuse. Two reviewers independently screened records, assessed for inclusion and conceptually mapped included articles. From these, we selected a purposive sample, created structured summaries of key findings and thematically synthesised the results.

Results

Our search identified 3545 references, from which we included 251. Most articles (76%; n = 192) were published within 5 years of conducting the review and addressed processes for addressing overuse (63%; n = 158) or political and health system context (60%; n = 151). Besides negative outcomes at the patient, system and global level, there were various contextual factors to addressing service overuse that seem to be key issue drivers. Processes for addressing overuse can be grouped into three elements comprising a comprehensive approach, including (1) approaches to identify overused health services, (2) stakeholder- or patient-led approaches and (3) government-led initiatives. Key implementation considerations include the need to develop ‘buy in’ from stakeholders and citizens.

Conclusions

Health systems want to ensure the use of high-value services to keep citizens healthy and avoid harm. Our synthesis can be used by policy-makers, stakeholders and researchers to understand how the issue has been prioritised, what approaches have been used to address it and implementation considerations.

Systematic review registration

PROSPERO CRD42014013204.

Models and applications for measuring the impact of health research: update of a systematic review for the Health Technology Assessment programme

BACKGROUND

This report reviews approaches and tools for measuring the impact of research programmes, building on, and extending, a 2007 review.

OBJECTIVES

(1) To identify the range of theoretical models and empirical approaches for measuring the impact of health research programmes; (2) to develop a taxonomy of models and approaches; (3) to summarise the evidence on the application and use of these models; and (4) to evaluate the different options for the Health Technology Assessment (HTA) programme.

DATA SOURCES

We searched databases including Ovid MEDLINE, EMBASE, Cumulative Index to Nursing and Allied Health Literature and The Cochrane Library from January 2005 to August 2014.

REVIEW METHODS

This narrative systematic literature review comprised an update, extension and analysis/discussion. We systematically searched eight databases, supplemented by personal knowledge, in August 2014 through to March 2015.

RESULTS

The literature on impact assessment has much expanded. The Payback Framework, with adaptations, remains the most widely used approach. It draws on different philosophical traditions, enhancing an underlying logic model with an interpretative case study element and attention to context. Besides the logic model, other ideal type approaches included constructionist, realist, critical and performative. Most models in practice drew pragmatically on elements of several ideal types. Monetisation of impact, an increasingly popular approach, shows a high return from research but relies heavily on assumptions about the extent to which health gains depend on research. Despite usually requiring systematic reviews before funding trials, the HTA programme does not routinely examine the impact of those trials on subsequent systematic reviews. The York/Patient-Centered Outcomes Research Institute and the Grading of Recommendations Assessment, Development and Evaluation toolkits provide ways of assessing such impact, but need to be evaluated. The literature, as reviewed here, provides very few instances of a randomised trial playing a major role in stopping the use of a new technology. The few trials funded by the HTA programme that may have played such a role were outliers.

DISCUSSION

The findings of this review support the continued use of the Payback Framework by the HTA programme. Changes in the structure of the NHS, the development of NHS England and changes in the National Institute for Health and Care Excellence's remit pose new challenges for identifying and meeting current and future research needs. Future assessments of the impact of the HTA programme will have to take account of wider changes, especially as the Research Excellence Framework (REF), which assesses the quality of universities' research, seems likely to continue to rely on case studies to measure impact. The HTA programme should consider how the format and selection of case studies might be improved to aid more systematic assessment. The selection of case studies, such as in the REF, but also more generally, tends to be biased towards high-impact rather than low-impact stories. Experience for other industries indicate that much can be learnt from the latter. The adoption of researchfish^® (researchfish Ltd, Cambridge, UK) by most major UK research funders has implications for future assessments of impact. Although the routine capture of indexed research publications has merit, the degree to which researchfish will succeed in collecting other, non-indexed outputs and activities remains to be established.

LIMITATIONS

There were limitations in how far we could address challenges that faced us as we extended the focus beyond that of the 2007 review, and well beyond a narrow focus just on the HTA programme.

CONCLUSIONS

Research funders can benefit from continuing to monitor and evaluate the impacts of the studies they fund. They should also review the contribution of case studies and expand work on linking trials to meta-analyses and to guidelines.

FUNDING

The National Institute for Health Research HTA programme.

Children and youth's biopsychosocial wellbeing in the context of energy resource activities

BACKGROUND

Children and youth emerge as key populations that are impacted by energy resource activities, in part because of their developmental vulnerabilities, as well as the compounding effects of energy systems on their families, communities, and physical environments. While there is a larger literature focused on fossil fuel emissions and children, the impacts of many aspects of energy systems on children and youth remain under examined and scattered throughout the health, social science, and environmental science literatures.

OBJECTIVES

This systematic interdisciplinary review examines the biological, psychosocial, and economic impacts of energy systems identified through social science research - specifically focused on household and industrial extraction and emissions - on children and youth functioning.

METHODS

A critical interpretive search of interdisciplinary and international social sciences literature was conducted using an adaptive protocol focusing on the biopsychosocial and economic impacts of energy systems on children and youth. The initial results were complemented with a purposeful search to extend the breadth and depth of the final collection of articles.

DISCUSSION

Although relatively few studies have specifically focused on children and youth in this context, the majority of this research uncovers a range of negative health impacts that are directly and indirectly related to the development and ongoing operations of natural resource production, particularly oil and gas, coal, and nuclear energy. Psychosocial and cultural effects, however, remain largely unexamined and provide a rich avenue for further research.

CONCLUSIONS

This synthesis identifies an array of adverse biopsychosocial health outcomes on children and youth of energy resource extraction and emissions, and identifies gaps that will drive future research in this area.

Sustainability in Health care by Allocating Resources Effectively (SHARE) 9: conceptualising disinvestment in the local healthcare setting

BACKGROUND

This is the ninth in a series of papers reporting a program of Sustainability in Health care by Allocating Resources Effectively (SHARE) in a local healthcare setting. The disinvestment literature has broadened considerably over the past decade; however there is a significant gap regarding systematic, integrated, organisation-wide approaches. This debate paper presents a discussion of the conceptual aspects of disinvestment from the local perspective.

DISCUSSION

Four themes are discussed: Terminology and concepts, Motivation and purpose, Relationships with other healthcare improvement paradigms, and Challenges to disinvestment. There are multiple definitions for disinvestment, multiple concepts underpin the definitions and multiple alternative terms convey these concepts; some definitions overlap and some are mutually exclusive; and there are systematic discrepancies in use between the research and practice settings. Many authors suggest that the term 'disinvestment' should be avoided due to perceived negative connotations and propose that the concept be considered alongside investment in the context of all resource allocation decisions and approached from the perspective of optimising health care. This may provide motivation for change, reduce disincentives and avoid some of the ethical dilemmas inherent in other disinvestment approaches. The impetus and rationale for disinvestment activities are likely to affect all aspects of the process from identification and prioritisation through to implementation and evaluation but have not been widely discussed. A need for mechanisms, frameworks, methods and tools for disinvestment is reported. However there are several health improvement paradigms with mature frameworks and validated methods and tools that are widely-used and well-accepted in local health services that already undertake disinvestment-type activities and could be expanded and built upon. The nature of disinvestment brings some particular challenges for policy-makers, managers, health professionals and researchers. There is little evidence of successful implementation of 'disinvestment' projects in the local setting, however initiatives to remove or replace technologies and practices have been successfully achieved through evidence-based practice, quality and safety activities, and health service improvement programs.

CONCLUSIONS

These findings suggest that the construct of 'disinvestment' may be problematic at the local level. A new definition and two potential approaches to disinvestment are proposed to stimulate further research and discussion.

DRUG DISINVESTMENT FRAMEWORKS: COMPONENTS, CHALLENGES, AND SOLUTIONS

OBJECTIVES

Value assessments of marketed drug technologies have been developed through disinvestment frameworks. Components of these frameworks are varied and implementation challenges are prevalent. The objective of this systematic literature review was to describe disinvestment framework process components for drugs and to report on framework components, challenges, and solutions.

METHODS

A systematic literature search was conducted using the terms: reassessment, reallocation, reinvestment, disinvestment, delist, decommission or obsolescence in MEDLINE, EMBASE, NLM PubMed, the Cochrane Library, and CINAHL from January 1, 2000, until November 14, 2015. Additional citations were identified through a gray literature search of Health Technology Assessment international (HTAi) and the International Network of Agencies for Health Technology Assessment (INAHTA) member Web sites and from bibliographies of full-text reviewed manuscripts.

RESULTS

Sixty-three articles underwent full text review and forty were included in the qualitative analysis. Framework components including disinvestment terms and definitions, identification and prioritization criteria and methods, assessment processes, stakeholders and dissemination strategies, challenges, and solutions were compiled. This review finds that stakeholders lack the political, administrative, and clinical will to support disinvestment and that there is not one disinvestment framework that is considered best practice.

CONCLUSIONS

Drug technology disinvestment components and processes vary and challenges are numerous. Future research should focus on lessening value assessment challenges. This could include adopting more neutral framework terminology, setting fixed reassessment timelines, conducting therapeutic reviews, and modifying current qualitative decision-making assessment frameworks.

Ethical challenges related to assistive product access for older adults and adults living with a disability: a scoping review protocol

BACKGROUND

Despite the surge of research and development in assistive products for older adults and/or people living with disabilities, policies on access and procurement have lagged in responding to the growing demand from users. Developing policies to address these concerns require an understanding of the ethical challenges underlying approaches for providing assistive products. The purpose of this scoping review is to identify and map the literature pertaining to ethical challenges related to assistive product access and procurement to inform policy development.

METHODS/DESIGN

We will use established approaches to conducting scoping reviews which include five stages: (1) conducting broad searches to identify potentially relevant literature, (2) refining selection criteria, (3) reviewing search results, (4) mapping literature according to conceptual areas of interest, and (5) summarizing results. We will analyze data by thematically grouping the descriptions of assistive products identified in the included articles and conducting a content analysis to iteratively develop a targeted synthesis of literature focused on ethical challenges in relation to assistive product access and procurement by older adults and/or adults living with disabilities.

DISCUSSION

Our scoping review findings will focus on and provide insight about the models, frameworks, and principles that have been used to understand ethical challenges related to technology access and procurement. We will use the findings to help inform a series of citizen panels in Canada to identify Canadians' values and preferences for enhancing equitable access to assistive products.

De-adoption and its 43 related terms: harmonizing low-value care terminology

Research into the prevalence and impact of low-value medical practices has evolved substantially over the past two decades. However, despite international efforts, many challenges still remain with regards to progress in this field, including limits in the capacity to identify and prioritize low-value care practices and to systematically appraise clinical and policy attempts at redressing low-value care. A recent article by Niven et al. in BMC Medicine consolidates the current literature and terminology on the de-adoption of clinical practices, advocating the use of de-adoption as an appropriate term to label low-value care and proposes a new synthesis model to facilitate efforts to reverse ineffective and harmful medical practices. We hope that this work will facilitate advances in low-value care research and policy, and shift focus towards establishing evidence for de-adopting low-value interventions, which is crucial since attempts to reduce low-value care interventions have shown mixed results. Please see related article: http://www.biomedcentral.com/1741-7015/13/255.

Analysis of evidence supporting the Federation of Bosnia and Herzegovina reimbursement medicines lists: role of the WHO Essential Medicines List, Cochrane systematic reviews and technology assessment reports

PURPOSE

We compared recently introduced Basic Medicines Lists of the Federation of Bosnia and Herzegovina (BH) (FBH Basic Lists (FBLs)) with the World Health Organization (WHO) Essential Medicines List (EML) and the evidence supporting the inclusion of additional medicines on FBLs.

METHODS

The sources of data included the 18th edition of the EML and the following FBLs: 2013 Hospital List, 2013 A List in Outpatient Setting, and 2012 List financed by the Federal Solidarity Fund. For medicines found on FBLs but not on EML, we searched the Cochrane Database of Systematic Reviews (CSR) and public health technology assessment (HTA) reports for evidence.

RESULTS

FBLs had 134 medicines and 17 combinations that were not on EML, as well as 9 medicines deleted and 4 rejected from EML. EML had 82 medicines and 10 combinations of medicines not included in FBLs. Out of 125 medicines on FBLs but not on EML, 52 (42%) had good CSR evidence supporting their inclusion (n = 38) or exclusion (n = 14). For the rest (n = 74), we found 24 favourable HTA reports. For the total of 89 medicines (27%) listed on FBLs, we found no evidence (EML, CSR, HTA reports) good enough to justify their inclusion in FBLs.

CONCLUSIONS

In circumstances of scarce financial resources, greater reliance on well-established, proven list is crucial. Independent, unbiased, high-quality evidence such as WHO EML, CSR and HTA reports (national or international with local adaptations) should be used when deciding on medicine reimbursement.