Using real-world evidence in healthcare from Western to Central and Eastern Europe: a review of existing barriers

An Overview of Real-World Data Infrastructure for Cancer Research

AIMS

There is increasing interest in the opportunities offered by Real World Data (RWD) to provide evidence where clinical trial data does not exist, but access to appropriate data sources is frequently cited as a barrier to RWD research. This paper discusses current RWD resources and how they can be accessed for cancer research.

MATERIALS AND METHODS

There has been significant progress on facilitating RWD access in the last few years across a range of scales, from local hospital research databases, through regional care records and national repositories, to the impact of federated learning approaches on internationally collaborative studies. We use a series of case studies, principally from the UK, to illustrate how RWD can be accessed for research and healthcare improvement at each of these scales.

RESULTS

For each example we discuss infrastructure and governance requirements with the aim of encouraging further work in this space that will help to fill evidence gaps in oncology.

CONCLUSION

There are challenges, but real-world data research across a range of scales is already a reality. Taking advantage of the current generation of data sources requires researchers to carefully define their research question and the scale at which it would be best addressed.

Guidance on using real-world evidence from Western Europe in Central and Eastern European health policy decision making

Aim: Real-world data and real-world evidence (RWE) are becoming more important for healthcare decision making and health technology assessment. We aimed to propose solutions to overcome barriers preventing Central and Eastern European (CEE) countries from using RWE generated in Western Europe. Materials & methods: To achieve this, following a scoping review and a webinar, the most important barriers were selected through a survey. A workshop was held with CEE experts to discuss proposed solutions. Results: Based on survey results, we selected the nine most important barriers. Multiple solutions were proposed, for example, the need for a European consensus, and building trust in using RWE. Conclusion: Through collaboration with regional stakeholders, we proposed a list of solutions to overcome barriers on transferring RWE from Western Europe to CEE countries.

Recommendations to overcome barriers to the use of artificial intelligence-driven evidence in health technology assessment

Background

Artificial intelligence (AI) has attracted much attention because of its enormous potential in healthcare, but uptake has been slow. There are substantial barriers that challenge health technology assessment (HTA) professionals to use AI-generated evidence for decision-making from large real-world databases (e.g., based on claims data). As part of the European Commission-funded HTx H2020 (Next Generation Health Technology Assessment) project, we aimed to put forward recommendations to support healthcare decision-makers in integrating AI into the HTA processes. The barriers, addressed by the paper, are particularly focusing on Central and Eastern European (CEE) countries, where the implementation of HTA and access to health databases lag behind Western European countries.

Methods

We constructed a survey to rank the barriers to using AI for HTA purposes, completed by respondents from CEE jurisdictions with expertise in HTA. Using the results, two members of the HTx consortium from CEE developed recommendations on the most critical barriers. Then these recommendations were discussed in a workshop by a wider group of experts, including HTA and reimbursement decision-makers from both CEE countries and Western European countries, and summarized in a consensus report.

Results

Recommendations have been developed to address the top 15 barriers in areas of (1) human factor-related barriers, focusing on educating HTA doers and users, establishing collaborations and best practice sharing; (2) regulatory and policy-related barriers, proposing increasing awareness and political commitment and improving the management of sensitive information for AI use; (3) data-related barriers, suggesting enhancing standardization and collaboration with data networks, managing missing and unstructured data, using analytical and statistical approaches to address bias, using quality assessment tools and quality standards, improving reporting, and developing better conditions for the use of data; and (4) technological barriers, suggesting sustainable development of AI infrastructure.

Conclusion

In the field of HTA, the great potential of AI to support evidence generation and evaluation has not yet been sufficiently explored and realized. Raising awareness of the intended and unintended consequences of AI-based methods and encouraging political commitment from policymakers is necessary to upgrade the regulatory and infrastructural environment and knowledge base required to integrate AI into HTA-based decision-making processes better.

Transferability of real-world data across borders for regulatory and health technology assessment decision-making

Recently, there has been increased consideration of real-world data (RWD) and real-world evidence (RWE) in regulatory and health technology assessment (HTA) decision-making. Due to challenges in identifying high-quality and relevant RWD sources, researchers and regulatory/HTA bodies may turn to RWD generated in locales outside of the locale of interest (referred to as "transferring RWD"). We therefore performed a review of stakeholder guidance as well as selected case studies to identify themes for researchers to consider when transferring RWD from one jurisdiction to another. Our review highlighted that there is limited consensus on defining decision-grade, transferred RWD; certain stakeholders have issued relevant guidance, but the recommendations are high-level and additional effort is needed to generate comprehensive guidance. Additionally, the case studies revealed that RWD transferability has not been a consistent concern for regulatory/HTA bodies and that more focus has been put on the evaluation of internal validity. To help develop transferability best practices (alongside internal validity best practices), we suggest that researchers address the following considerations in their justification for transferring RWD: treatment pathways, nature of the healthcare system, incidence/prevalence of indication, and patient demographics. We also recommend that RWD transferability should garner more attention as the use of imported RWD could open doors to high-quality data sources and potentially reduce methodological issues that often arise in the use of local RWD; we thus hope this review provides a foundation for further dialogue around the suitability and utility of transferred RWD in the regulatory/HTA decision-making space.

Outcome-based reimbursement in Central-Eastern Europe and Middle-East

Outcome-based reimbursement models can effectively reduce the financial risk to health care payers in cases when there is important uncertainty or heterogeneity regarding the clinical value of health technologies. Still, health care payers in lower income countries rely mainly on financial based agreements to manage uncertainties associated with new therapies. We performed a survey, an exploratory literature review and an iterative brainstorming in parallel about potential barriers and solutions to outcome-based agreements in Central and Eastern Europe (CEE) and in the Middle East (ME). A draft list of recommendations deriving from these steps was validated in a follow-up workshop with payer experts from these regions. 20 different barriers were identified in five groups, including transaction costs and administrative burden, measurement issues, information technology and data infrastructure, governance, and perverse policy outcomes. Though implementing outcome-based reimbursement models is challenging, especially in lower income countries, those challenges can be mitigated by conducting pilot agreements and preparing for predictable barriers. Our guidance paper provides an initial step in this process. The generalizability of our recommendations can be improved by monitoring experiences from pilot reimbursement models in CEE and ME countries and continuing the multistakeholder dialogue at national levels.