Structure and Content of a Taxonomy to Support the Use of Real-World Evidence by Health Technology Assessment Practitioners and Healthcare Decision Makers

Regional Citrate Anticoagulation Versus Systemic Heparin in Continuous Kidney Replacement Therapy: Examining the Role of Evidence in Health Technology Assessment

INTRODUCTION

Continuous kidney replacement therapy (CKRT) is an established treatment supporting kidney function in patients with severe acute kidney disease. Systemic heparin and regional citrate anticoagulation (RCA) are the main anticoagulation strategies to prevent dialysis filter loss due to clotting, a complication of all KRT, including CKRT. The present study aims to comprehensively compare two anticoagulation strategies by collecting available clinical and economic evidence for an adult population under CKRT through a systematic literature review and meta-analysis.

METHODS

Randomized controlled trials, prospective/retrospective observational studies and economic analyses, involving systemic heparin or RCA, were searched through PubMed and Web of Science databases. Extracted data focused on clinical parameters, adverse events and cost items. Meta-analyses were conducted on data points with numeric outcomes to compare the two anticoagulation techniques. An evaluation of the quality of the evidence was also conducted using the GRADE system.

RESULTS

Seventy-two studies were eligible for this meta-analysis. Statistically significant differences between heparin and RCA were observed in ionized calcium levels (mmol/l; heparin 1.19, RCA 1.13), bleeding events (heparin 12.6%, RCA 2.4%), filter lifespan (hours; heparin 16.43, RCA 36.69), clotting issues (heparin 50.7%, RCA 21.3%), filter failure rate (heparin 67.7%, RCA 13.5%), hypocalcemia (heparin 0.1%, RCA 4.4%) and alkalosis (heparin 0.4%, RCA 6.6%) rates. Limitations include heterogeneity across studies, particularly for RCA, and potential biases, although the overall methodological quality ranged from moderate to low.

CONCLUSIONS

Based on the evidence presented, despite higher rates of hypocalcemia and alkalosis, RCA demonstrates advantages over heparin, including a reduction in bleeding events, prevention of filter clotting and improvement in filter lifespan. Additionally, the cost outcome demonstrated comparable statistics depending on the RCA protocol considered, which supports the potential cost-effectiveness of RCA. RCA provides clear clinical and potential organizational benefits and comparable cost statistics with a reasonable level of confidence in the evidence for the economic data.

Real-world evidence to support health technology assessment and payer decision making: is it now or never?

OBJECTIVES

The aim of this policy article is twofold: (i) to provide a summary and update of recent important policy developments, in particular relevant guidance on the use of real-world data/real-world evidence (RWD/RWE) by health technology assessment (HTA) bodies and (ii) to set out our policy recommendations on how the different elements of an "RWE framework" we have previously developed could support, further enhance and facilitate the use of RWE for HTA purposes and by HTA bodies and payers.

METHODS

We undertook a targeted review and analysis of recent important policy developments. The aim was to build on our recommendations from previous work on the "RWE Framework," and consider how the relevant tools from our Framework can further enhance and facilitate the use of RWE for HTA purposes and by HTA bodies/payers.

RESULTS

We provide eight conditions that we argue would, in combination, constitute the optimal use and acceptance of RWD/RWE for HTA. We believe that, should the eight conditions hold, RWD/RWE would enable more efficient access to medicines and healthcare technologies for patients.

CONCLUSIONS

High-quality, fit-for-purpose RWD/RWE can and should be used more frequently in HTA. Multi-stakeholder and cross-geography collaborative partnerships are needed to align on best practices to optimize the evidence that needs to be generated to satisfy all stakeholders' needs.

Assessing Real-World Data From Electronic Health Records for Health Technology Assessment: The SUITABILITY Checklist: A Good Practices Report of an ISPOR Task Force

This ISPOR Good Practices report provides a framework for assessing the suitability of electronic health records data for use in health technology assessments (HTAs). Although electronic health record (EHR) data can fill evidence gaps and improve decisions, several important limitations can affect its validity and relevance. The ISPOR framework includes 2 components: data delineation and data fitness for purpose. Data delineation provides a complete understanding of the data and an assessment of its trustworthiness by describing (1) data characteristics; (2) data provenance; and (3) data governance. Fitness for purpose comprises (1) data reliability items, ie, how accurate and complete the estimates are for answering the question at hand and (2) data relevance items, which assess how well the data are suited to answer the particular question from a decision-making perspective. The report includes a checklist specific to EHR data reporting: the ISPOR SUITABILITY Checklist. It also provides recommendations for HTA agencies and policy makers to improve the use of EHR-derived data over time. The report concludes with a discussion of limitations and future directions in the field, including the potential impact from the substantial and rapid advances in the diffusion and capabilities of large language models and generative artificial intelligence. The report's immediate audiences are HTA evidence developers and users. We anticipate that it will also be useful to other stakeholders, particularly regulators and manufacturers, in the future.

Using Real-World Data in the Health Technology Assessment of Pharmaceuticals: Strengths, Difficulties, and a Pragmatic Way Forward

In the past decade, there have been increasing calls for greater use of real-world evidence (RWE) and data (RWD), with the explicit goal of enabling faster provision of effective medicines to patients in need. The push for decision makers to accept RWE is especially noticeable in the pursuit of regulatory approval, but RWE, particularly when used to estimate the relative effectiveness of interventions, is not always readily accepted by agencies responsible for reimbursement and pricing of new pharmaceuticals and, to a varying degree, is not accepted across jurisdictions. This lack of trust hampers the use of RWE despite a very large and growing literature base on the principles of how RWE should be used. In this article, we suggest an important part of the explanation of why this situation has arisen and make suggestions for its alleviation. Given that problems commonly arise that are particular to the question being asked and the data sources being used, general guidance on the principles of how to use RWD cannot cover all eventualities. Therefore, we are suggesting the creation of an archive, or repository, to record uses of RWD in support of decisions by funding bodies or their advisors. This article introduces a proposed, structured classification of decision types using RWE, around which evidence can be assembled in a curated source (RWD/RWE taxonomy) and thus facilitate judgments on when evidence is "good enough." This article is part of a series in a special issue of this journal that looks at the barriers to optimal use of RWE in health technology assessment and how to overcome them. We begin significantly to populate our "taxonomy" with examples in an accompanying article. We also propose recommendations for international standards of evaluating the acceptability of RWD governance practices.

The Real-World Evidence Workstream in EUreccA 2025: How the Task Was Addressed

This is one of a series of articles that consider the barriers to optimal use of real-world evidence (RWE) in health technology assessment (HTA) as well as ways to overcome them. The work was carried out as part of EUreccA 2025 (European Initiative for New Reimbursement and Access Approaches 2025), in particular with the RWE workstream embodied within that collaboration. The starting premises of this workstream were as follows: (1) the acceptance of RWE by HTA agencies and payers in the assessment of drugs is suboptimal and variable between jurisdictions, and (2) if that were not the case, the path of new pharmaceuticals to patients could be quicker and less expensive. Elsewhere in this issue we set out the conclusions we had reached in the EUreccA RWE workstream. In this article, we set out the methodology used to conduct the totality of the EureccA 2025 RWE workstream effort, which led us to those conclusions. The main results, strengths, and limitations of the individual parts are discussed further in separate articles in this supplement. Through scoping work, we generated 4 key topics within which to identify and address the barriers to optimal RWE use in HTA. Through pragmatic literature searches, stakeholder engagement, and case studies, we suggest ways in which the problems identified may be addressed as a contribution to progress in this area.

Across-Country Variations of Real-World Data and Evidence for Drugs: A 5-European-Country Study

OBJECTIVES

This study aimed to describe the role of real-world data (RWD) and real-world evidence (RWE) in health technology assessment (HTA) in 5 European countries and to identify the hurdles to the acceptance of RWE and suggest directions toward its more effective use.

METHODS

Authors from France, Germany, Italy, and Sweden used a common template to extract evidence. For England, the Cancer Drugs Fund was described and analyzed as a particular model for the use of RWD to provide evidence for coverage decisions and managed entry agreements.

RESULTS

In all countries except Germany, HTA bodies acknowledged the relevance of RWD/RWE to address postlaunch uncertainties. In Germany, evidence from randomized controlled trials remains the gold standard, and evidence based on RWD is generally rejected. Multiple sources of RWD exist, but the quality, the immediate relevance of existing sources, and their interoperability limit their adaptation to the specifics of a given drug. This leads to skepticism about the validity of the evidence. Timing is also a key issue: the production of evidence may not be synchronized with the HTA and pricing bodies' agendas. The Cancer Drugs Fund case emphasizes that a strong partnership among all stakeholders and a pragmatic use of existing data, alongside clinical evidence provided by companies, are key success factors.

CONCLUSIONS

A continuous investment in national health information systems is a key issue for providing valid RWE. Processes and aids to guide the acceptability and usage of RWE derived from pairing between sources and questions are essential.