Identifying the Need for Good Practices in Health Technology Assessment: Summary of the ISPOR HTA Council Working Group Report on Good Practices in HTA

The global landscape of country-level health technology assessment processes: A survey among 104 countries

To make progress towards universal health coverage (UHC), countries need to be able to develop and implement evidence-informed and inclusive processes for decision-making to inform what services are provided and purchased. Health Technology Assessment (HTA) processes are an established mechanism to support evidence-informed decision-making in the health sector. To assess the practice of HTA in countries, WHO conducted a global survey that explores the status of HTA. The survey is the largest source of information in terms of number of countries for describing global HTA status. The final sample analysed in this paper is the 104 countries (82% or 104/127) that responded "yes" to the question of having a systematic, formal health decision-making process at the national level. The results show that while many countries have HTA bodies in place, these serve different functions. While there are more established processes in higher income country groups, even those show room for improvement in areas such as social participation and appeals. Lack of awareness of the importance of HTA and institutionalization were the top two barriers to HTA utilization. There is further progress that needs to be made in HTA globally. Countries need to build on available guidance to ensure the appropriate elements are in place for sustainable country decision-making processes and develop more understanding of how they vary across settings.

Are quality-adjusted life years (QALYs) becoming more expensive? Evidence from economic evaluations of diabetic therapeutics

BACKGROUND

Empirical evidence regarding temporal trends in cost per quality-adjusted life year (QALY) gained remains limited. This study investigates the evolution of cost-effectiveness for diabetes mellitus treatments over time.

RESEARCH DESIGN AND METHODS

We analyzed cost-effectiveness analyses of anti-diabetic pharmaceuticals extracted from the Tufts Medical Center Cost-Effectiveness Analysis Registry (CEAR). Incremental cost-effectiveness ratios (ICERs) were normalized by GDP per capita and categorized into four threshold-based groups. In addition, we examined temporal trends in incremental QALYs. Analyses stratified by Organisation for Economic Co-operation and Development (OECD) membership were also conducted.

RESULTS

Among 239 eligible studies, the proportion of highly cost-effective interventions in OECD countries decreased from 62.50% (1999-2005) to 35.48% (2021-2023), while interventions exceeding 3хGDP per capita/QALY increased from 12.50% to 54.84%. This trend was less pronounced in non-OECD countries. Mean incremental QALYs remained stable (range: 0.19-0.47) across periods and between OECD and non-OECD countries, suggesting that rising costs rather than diminishing health benefits drive the declining cost-effectiveness.

CONCLUSIONS

The cost-effectiveness of anti-diabetic medications has deteriorated substantially over time, particularly in OECD countries, despite stable therapeutic benefits. These findings highlight the need for dynamic approaches to cost-effectiveness thresholds and robust price negotiations to ensure sustainable access to innovative therapies.

Good Practices for Health Technology Assessment Guideline Development: A Report of the Health Technology Assessment International, HTAsiaLink, and ISPOR Special Task Force

OBJECTIVES

Health technology assessment (HTA) guidelines are intended to support the successful implementation of HTA by enhancing consistency and transparency in concepts, methods, processes, and use, thereby enhancing the legitimacy of the decision-making process. This report lays out good practices and practical recommendations for developing or updating HTA guidelines to ensure successful implementation.

METHODS

The task force was established in 2022 and comprised experts and academics from various geographical regions, each with substantial experience in developing HTA guidelines for national health policy making. Literature reviews and key informant interviews were conducted to inform these good practices. Stakeholder consultations, open peer reviews, and expert opinions validated the recommendations. A series of teleconferences among task force members was held to iteratively refine the report.

RESULTS

The recommendations cover six key aspects throughout the guideline development cycle: (1) setting objectives, scope, and principles of the guideline, (2) building a team for a quality guideline, (3) defining a stakeholder engagement plan, (4) developing content and utilizing available resources, (5) putting in place appropriate institutional arrangements, and (6) monitoring and evaluating guideline success.

CONCLUSION

This report presents a set of resources and context-appropriate practices for developing or updating HTA guidelines. Across all contexts, the recommendations emphasize transparency, building trust among stakeholders, and fostering a culture of ongoing learning and improvement. The report recommends timing development and revision of guidelines according to the HTA landscape and pace of HTA institutionalization. Because HTA is increasingly used to inform different kinds of decision making in a variety of country contexts, it will be important to continue to monitor lessons learned to ensure the recommendations remain relevant and effective.

Technology Assessment vs. Technology Appraisal-How to Strengthen the Science/Value Dichotomy with EU HTA?

Many countries around the world use health technology assessment (HTA) to inform reimbursement and pricing decisions. HTA is often split into two steps, called assessment and appraisal. While the term HTA itself has been defined by international consortia, there is heterogeneity in the way different stakeholders use the terms assessment and appraisal. This creates ambiguity regarding which activities are included in technology assessment. With the new EU HTA Regulation, the HTA community should urgently seek to clarify the distinction between assessment and appraisal, as the regulation aims to centralize the clinical part of technology assessment at the European level. Failure to clarify this terminology will put the ambition of the regulation such as increased efficiency and reduction in duplication at risk. In this article, we argue that the distinction between assessment and appraisal should be seen as a science/value dichotomy. We discuss the transition from centralized assessment activities to country-level appraisal, which should culminate in a categorization of the overall added benefit in a local context. Finally, we touch on the important dimension of uncertainty always present in medical decision making.

The three-domain impact framework for characterizing impact of patient involvement in health technology assessment

OBJECTIVES

Evaluating the impact of patient involvement in health technology assessments (HTA) may help improve practices and avoid ineffective activities. Evaluation, however, continues to be infrequent, inconsistent, and often only relates to process quantity or quality. The Patient and Citizen Involvement in HTA Interest Group (PCIG) within Health Technology Assessment International set out to contextualize this impact to support evaluation.

METHODS

Given the lack of established methodology to measure impact, the team performed a qualitative analysis of first-hand accounts about perceived changes in HTA due to involvement of patient stakeholders. A questionnaire was developed, piloted, and rolled out to collect personal perspectives from stakeholders with relevant experience. The stories were analyzed in the aggregate to identify themes in the data.

RESULTS

From January 2019 to September 2021, twenty-four responses were collected through PCIG's network. Responses (including one joint industry-HTA body submission) came from patient representatives (12), HTA bodies (11), and industry representatives (2) from North America (5), South America (3), Europe (13), and Asia Pacific (3). Based on themes commonly reported, a three-domain framework for evaluating impact is proposed: impact on basis of HTA result or recommendation, impact on HTA body, and impact on patient participants. The framework includes components under each domain to support reporting.

CONCLUSIONS

Using the Three-Domain Impact Framework may be useful in identifying, evaluating, and communicating the value of patient involvement in HTA. Enhancing and increasing reporting practices may improve transparency and facilitate process improvements for meaningful integration of patient stakeholders into HTA appraisals across jurisdictions.

An overview of the perspectives used in health economic evaluations

The term 'perspective' in the context of economic evaluations and costing studies in healthcare refers to the viewpoint that an analyst has adopted to define the types of costs and outcomes to consider in their studies. However, there are currently notable variations in terms of methodological recommendations, definitions, and applications of different perspectives, depending on the objective or intended user of the study. This can make it a complex area for stakeholders when interpreting these studies. Consequently, there is a need for a comprehensive overview regarding the different types of perspectives employed in such analyses, along with the corresponding implications of their use. This is particularly important, in the context of low-and-middle-income countries (LMICs), where practical guidelines may be less well-established and infrastructure for conducting economic evaluations may be more limited. This article addresses this gap by summarising the main types of perspectives commonly found in the literature to a broad audience (namely the patient, payer, health care providers, healthcare sector, health system, and societal perspectives), providing their most established definitions and outlining the corresponding implications of their uses in health economic studies, with examples particularly from LMIC settings. We then discuss important considerations when selecting the perspective and present key arguments to consider when deciding whether the societal perspective should be used. We conclude that there is no one-size-fits-all answer to what perspective should be used and the perspective chosen will be influenced by the context, policymakers'/stakeholders' viewpoints, resource/data availability, and intended use of the analysis. Moving forward, considering the ongoing issues regarding the variation in terminology and practice in this area, we urge that more standardised definitions of the different perspectives and the boundaries between them are further developed to support future studies and guidelines, as well as to improve the interpretation and comparison of health economic evidence.

Comparing Preferences for Disease Profiles: A Discrete Choice Experiment from a US Societal Perspective

OBJECTIVES

There is increasing interest in expanding the elements of value to be considered when making health policy decisions. To help inform value frameworks, this study quantified preferences for disease attributes in a general public sample and examined which combination of attributes (disease profiles) are considered most important for research and treatment.

METHODS

A discrete choice experiment (DCE) was conducted in a US general population sample, recruited through online consumer panels. Respondents were asked to select one of a set of health conditions they believed to be most important, characterized by attributes defined by a previous qualitative study: onset age; cause of disease; life expectancy; caregiver requirement; symptom burden (characterized by the Health Utilities Index with varying levels of ambulation independence, dexterity limitations, and degree of pain and discomfort); and disease prevalence. A fractional factorial DCE design was implemented using R, and 60 choice sets were generated (separated into blocks of 10 per participant). Data were analyzed using a mixed-logit regression model, and results used to assess the likelihood of preferring disease profiles. Based on individual attribute preferences, overall preferences for disease profiles, including a profile aligned with Duchenne muscular dystrophy (DMD), were compared.

RESULTS

Fifty-two percent of respondents (n = 537) were female, and 70.6% were aged 18-54 years. Attributes considered most important were those related to life expectancy (odds ratio [OR], 95% confidence interval [CI] 1.88 [1.56-2.27] for a 50% reduction in remaining life expectancy vs no impact), and symptom burden (OR [95% CI] 1.84 [1.47-2.31] for severe vs mild burden). Greater importance was also found for pediatric onset, caregiver requirement, and diseases affecting more people. As an example of disease profile preferences, a DMD-like pediatric inherited disease with 50% reduction in life expectancy, extensive caregiver requirement, severe symptom burden, and 1:5000 prevalence had 2.37-fold higher odds of being selected as important versus an equivalent disease with adult onset and no life expectancy reduction.

CONCLUSIONS

Of disease attributes included in this DCE, respondents valued higher prevalence of disease, life expectancy and symptom burden as most important for prioritizing research and treatment. Based on expressed attribute preferences, a case study of an inherited pediatric disease involving substantial reductions to length and quality of life and requiring caregiver support has relatively high odds of being identified as important compared to diseases reflecting differing attribute profiles. These findings can help inform expansions of value frameworks by identifying important attributes from the societal perspective.

Exploring Perceptions of Biologic Therapies: A Qualitative Study Among Canadians Living with Severe Asthma

INTRODUCTION

Biologic therapies have demonstrated benefits for individuals with severe asthma, including reduced daily symptoms and severe exacerbations. However, data describing patient perspectives on these treatments are limited. This study sought to understand the preferences and priorities of Canadians with severe asthma in the context of novel biologic treatment options.

METHODS

Semi-structured, qualitative interviews were conducted among Canadians with severe asthma from July to August 2022. Purposeful sampling included individuals with and without biologic therapy experience. All participants described daily life with severe asthma, experiences and priorities related to asthma treatment and their impressions of biologics. Reflexive thematic analysis was used to explore patterns in the data.

RESULTS

Among 18 individuals included, 10 were currently taking or had prior experience with biologic treatment for asthma. Those who had never been treated with biologics were unfamiliar with them, considering treatment, or believed that they may not be eligible. Four themes were developed to convey the perspectives of participants on biologics: (1) life-changing benefits, but not for all; (2) navigating barriers to being prescribed and remaining adherent to biologic treatments; (3) treatment administration preferences are not only about convenience; (4) concerns about safety and the unknown as a source of treatment hesitancy.

CONCLUSIONS

Findings suggest that the clinical benefits of biologics align with patient perceptions of achieving good asthma control. However, treatment gaps persist among individuals who do not experience a meaningful improvement in their asthma symptoms and those who face barriers accessing biologics. People with severe asthma attributed importance to greater availability of at-home treatment options, improved access to financial support to cover treatment costs and support to address safety concerns. This research provides insight into patient-based treatment priorities and preferences for biologics, which may help inform decision-making related to emerging therapies for severe asthma.

National Immunization Program Decision Making Using the CAPACITI Decision-Support Tool: User Feedback from Indonesia and Ethiopia

To ensure that limited domestic resources are invested in the most effective interventions, immunization programs in low- and middle-income countries (LMICs) must prioritize a growing number of new vaccines while considering opportunities to optimize the vaccine portfolio, as well as other components of the health system. There is a strong impetus for immunization decision-making to engage and coordinate various stakeholders across the health system in prioritization. To address this, national immunization program decision-makers in LMICs collaborated with WHO to structure deliberation among stakeholders and document an evidence-based, context-specific, and transparent process for prioritization or selection among multiple vaccination products, services, or strategies. The output of this effort is the Country-led Assessment for Prioritization on Immunization (CAPACITI) decision-support tool, which supports using multiple criteria and stakeholder perspectives to evaluate trade-offs affecting health interventions, taking into account variable data quality. Here, we describe the user feedback from Indonesia and Ethiopia, two initial countries that piloted the CAPACITI decision-support tool, highlighting enabling and constraining factors. Potential immunization program benefits and lessons learned are also summarized for consideration in other settings.

The Health Inequality Impact of a New Cancer Therapy Given Treatment and Disease Characteristics

OBJECTIVES

This study aimed to perform a simulation study to quantify the health inequality impact of a cancer therapy given cancer and treatment characteristics using the distributional cost-effectiveness framework.

METHODS

The following factors were varied in 10 000 simulations: lifetime risk of the disease, median overall survival (OS) with standard of care (SOC), difference in OS between non-Hispanic (NH)-Black and NH-White patients (prognostic effect), treatment effect of the new therapy relative to SOC, whether the treatment effect differs between NH-Black and NH-White patients (effect modification), health utility, drug costs, and preprogression and postprogression costs. Based on these characteristics, the incremental population net health benefits were calculated for the new therapy and applied to a US distribution of quality-adjusted life expectancy at birth. The health inequality impact was quantified as the difference in the degree of inequality in the "post-new therapy" versus "pre-new therapy" quality-adjusted life expectancy distributions.

RESULTS

For cancer types characterized by relatively large lifetime risk, large median OS with SOC, large treatment effect, and large effect modification, the direction of the impact of the new therapy on inequality is easy to predict. When effect modification is minor or absent, which is a realistic scenario, the direction of the inequality impact is difficult to predict. Larger incremental drug costs have a worsening effect on health inequality.

CONCLUSIONS

The findings provide a guide to help decision makers and other stakeholders make an initial assessment whether a new therapy with known treatment effects for a specific tumor type can have a positive or negative health inequality impact.

Mapping of health technology assessment in China: a comparative study between 2016 and 2021

BACKGROUND

Health Technology Assessment (HTA) in China has recently expanded from purely academic research to include policy or decision-oriented practice, especially after HTA evidence was used to update the National Reimbursement Drug List for the first time in 2017. This study aims to identify the progress and challenges of HTA development from 2016 to 2021 and inform policies and decisions to promote further HTA development in China.

METHODS

We conducted a cross-sectional web-based survey with policy makers, researchers and industry-providers in China in 2016 and 2021 respectively. The 'Mapping of HTA Instrument', was utilized to assess the HTA development across eight domains: Institutionalization, Identification, Priority setting, Assessment, Appraisal, Reporting, Dissemination of findings and conclusions, and Implementation in policy and practice. To reduce the influence of confounders and compare the mapping outcomes between the 2016 and 2021 groups, we conducted 1:1 Propensity Score Matching (PSM). Univariate analysis was conducted to compare the differences between the two groups. The overall results were further compared with those of a mapping study that included ten countries.

RESULTS

In total, 212 and 255 respondents completed the survey in 2016 and 2021, respectively. The total score of the HTA development level in China in 2021 was higher than that in 2016 before PSM (89.38 versus 83.96). Following PSM, 183 respondents from the 2016 and 2021 groups were matched. Overall, the mean scores for most indicators in the Institutionalization domain and Dissemination domain in 2021 were higher than those in 2016 (P < 0.05). The Appraisal domain in 2021 was more explicit, transparent and replicable than that in 2016 (t = -3.279, P < 0.05). However, the mean scores of most indicators in the Assessment domain were higher in 2016 than those in 2021 (P < 0.05).

CONCLUSIONS

Our study suggest that the level of HTA development in China progressed significantly from 2016 to 2021. However, before engaging in HTA activities, further efforts are required to enhance the assessment process. For instance, it is important to establish a clear goal and scope for HTA; adapt standardized methodologies for evaluating the performance of systematic reviews or meta-analyses; and provide comprehensive descriptions of the safety, clinical effectiveness, cost, and cost-effectiveness of the assessed technologies, thus improving the development of HTA in China.

Institutionalizing Health Technology Assessment in Ghana: Enablers, Constraints, and Lessons

Health Technology Assessment (HTA) has been institutionalized in Ghana with structures, processes, and methods. This paper identifies and analyzes the policy players involved; the way in which issues were framed; and the manner in which administrative structures were used to set the agenda for, adopt, and implement HTA. It shows that the Ministry of Health, supported by other players, led HTA agenda-setting through training activities and discussions on evidence of selection pharmaceuticals, medical devices, and other health-related technologies. HTA was then captured in a health sector aide memoire that summarized the decisions made at a national health summit. In implementing the HTA policy, technical working groups and a steering committee were constituted to provide recommendations to the minister of health on high-level decisions. The ability of agenda influencers to maneuver existing administrative and bureaucratic structures, align them with national strategic goals, and sustain HTA implementation enabled Ghana to institutionalize HTA. Limited financial support and a dearth of in-country expertise are being addressed through capacity building and funding. To ensure early national buy-in and uptake, policy makers and agenda influencers need to understand each country's health system and align HTA with national policy decision-making processes.

Future Role of Health Technology Assessment for Genomic Medicine in Oncology: A Canadian Laboratory Perspective

Genome-based testing in oncology is a rapidly expanding area of health care that is the basis of the emerging area of precision medicine. The efficient and considered adoption of novel genomic medicine testing is hampered in Canada by the fragmented nature of health care oversight as well as by lack of clear and transparent processes to support rapid evaluation, assessment, and implementation of genomic tests. This article provides an overview of some key barriers and proposes approaches to addressing these challenges as a potential pathway to developing a national approach to genomic medicine in oncology.

The Full Value of Vaccine Assessments (FVVA): a framework for assessing and communicating the value of vaccines for investment and introduction decision-making

BACKGROUND

Several economic obstacles can deter the development and use of vaccines. This can lead to limited product options for some diseases, delays in new product development, and inequitable access to vaccines. Although seemingly distinct, these obstacles are actually interrelated and therefore need to be addressed through a single over-arching strategy encompassing all stakeholders.

METHODS

To help overcome these obstacles, we propose a new approach, the Full Value of Vaccines Assessments (FVVA) framework, to guide the assessment and communication of the value of a vaccine. The FVVA framework is designed to facilitate alignment across key stakeholders and to enhance decision-making around investment in vaccine development, policy-making, procurement, and introduction, particularly for vaccines intended for use in low- and middle-income countries.

RESULTS

The FVVA framework has three key elements. First, to enhance assessment, existing value-assessment methods and tools are adapted to include broader benefits of vaccines as well as opportunity costs borne by stakeholders. Second, to improve decision-making, a deliberative process is required to recognize the agency of stakeholders and to ensure country ownership of decision-making and priority setting. Third, the FVVA framework provides a consistent and evidence-based approach that facilitates communication about the full value of vaccines, helping to enhance alignment and coordination across diverse stakeholders.

CONCLUSIONS

The FVVA framework provides guidance for stakeholders organizing global-level efforts to promote investment in vaccines that are priorities for LMICs. By providing a more holistic view of the benefits of vaccines, its application also has the potential to encourage greater take-up by countries, thereby leading to more sustainable and equitable impacts of vaccines and immunization programmes.

Are current clinical studies on artificial intelligence-based medical devices comprehensive enough to support a full health technology assessment? A systematic review

INTRODUCTION

Artificial Intelligence-based Medical Devices (AI-based MDs) are experiencing exponential growth in healthcare. This study aimed to investigate whether current studies assessing AI contain the information required for health technology assessment (HTA) by HTA bodies.

METHODS

We conducted a systematic literature review based on the Preferred Reporting Items for Systematic Reviews and Meta-Analyses methodology to extract articles published between 2016 and 2021 related to the assessment of AI-based MDs. Data extraction focused on study characteristics, technology, algorithms, comparators, and results. AI quality assessment and HTA scores were calculated to evaluate whether the items present in the included studies were concordant with the HTA requirements. We performed a linear regression for the HTA and AI scores with the explanatory variables of the impact factor, publication date, and medical specialty. We conducted a univariate analysis of the HTA score and a multivariate analysis of the AI score with an alpha risk of 5 %.

RESULTS

Of 5578 retrieved records, 56 were included. The mean AI quality assessment score was 67 %; 32 % of articles had an AI quality score ≥ 70 %, 50 % had a score between 50 % and 70 %, and 18 % had a score under 50 %. The highest quality scores were observed for the study design (82 %) and optimisation (69 %) categories, whereas the scores were lowest in the clinical practice category (23 %). The mean HTA score was 52 % for all seven domains. 100 % of the studies assessed clinical effectiveness, whereas only 9 % evaluated safety, and 20 % evaluated economic issues. There was a statistically significant relationship between the impact factor and the HTA and AI scores (both p = 0.046).

DISCUSSION

Clinical studies on AI-based MDs have limitations and often lack adapted, robust, and complete evidence. High-quality datasets are also required because the output data can only be trusted if the inputs are reliable. The existing assessment frameworks are not specifically designed to assess AI-based MDs. From the perspective of regulatory authorities, we suggest that these frameworks should be adapted to assess the interpretability, explainability, cybersecurity, and safety of ongoing updates. From the perspective of HTA agencies, we highlight that transparency, professional and patient acceptance, ethical issues, and organizational changes are required for the implementation of these devices. Economic assessments of AI should rely on a robust methodology (business impact or health economic models) to provide decision-makers with more reliable evidence.

CONCLUSION

Currently, AI studies are insufficient to cover HTA prerequisites. HTA processes also need to be adapted because they do not consider the important specificities of AI-based MDs. Specific HTA workflows and accurate assessment tools should be designed to standardise evaluations, generate reliable evidence, and create confidence.

Progress toward Health System Readiness for Genome-Based Testing in Canada

(1) Background: Genomic medicine harbors the real potential to improve the health and healthcare journey of patients, care provider experiences, and improve the health system efficiency-even reducing healthcare costs. There is expected to be an exponential growth in medically necessary new genome-based tests and test approaches in the coming years. Testing can also create scientific research and commercial opportunities beyond healthcare decision making. The purpose of this research is to generate a better understanding of Canada's state of readiness for genomic medicine, and to provide some insights for other healthcare systems. (2) Methods: A mixed-methods approach of a review of the literature and key informant interviews with a purposive sample of experts was used. The health system readiness was assessed using a previously published set of conditions. (3) Results: Canada has created some of the established conditions, but further action needs to be taken to improve the state of readiness for genome-based medicine. The important gaps to be filled are the need for linked information systems and data integration; evaluative processes that are timely and transparent; navigational tools for care providers; dedicated funding to facilitate rapid onboarding and support test development and proficiency testing; and broader engagement with innovation stakeholders beyond care providers and patients. These findings highlight the role of the organizational context, social influence, and other factors that are known to affect the diffusion of innovation within health systems.

Expanding health technology assessment towards broader value: Ireland as a case study

Healthcare innovations often represent important improvements in population welfare, but at what cost, and to whom? Health technology assessment (HTA) is a multidisciplinary process to inform resource allocation. HTA is conventionally anchored on health maximization as the only relevant output of health services. If we accept the proposition that health technologies can generate value outside the healthcare system, resource allocation decisions could be suboptimal from a societal perspective. Incorporating "broader value" in HTA as derived from social values and patient experience could provide a richer evaluative space for informing resource allocation decisions. This article considers how HTA is practiced and what its current context implies for adopting "broader value" to evaluating health technologies. Methodological challenges are highlighted, as is a future research agenda. Ireland serves as an example of a healthcare system that both has an explicit role for HTA and is evolving under a current program of reform to offer universal, single-tier access to public services. There are various ways in which HTA processes could move beyond health, including considering the processes of care delivery and/or expanding the evaluative space to some broader concept of well-being. Methods to facilitate the latter exist, but their adaptation to HTA is still emerging. We recommend a multi-stakeholder working group to develop and advance an international agenda for HTA that captures welfare/benefit beyond health.

Beyond clinical and cost-effectiveness: The contribution of qualitative research to health technology assessment

Recent developments in health technology assessment (HTA), including the promotion of a new and internationally accepted definition of HTA, have highlighted the need to go beyond clinical and cost-effectiveness to fully understand the potential value of health technologies. Multidisciplinary efforts to generate patient-focused evidence relevant to HTA, using both quantitative and qualitative approaches, are needed. Although it has been more than 20 years since opportunities for qualitative methods to inform HTA were first discussed, their use remains infrequent. The goal of this article is to resurrect the debate about the value of qualitative research in HTA. Drawing on examples from published literature, we propose five key areas where qualitative methods can contribute to HTA, complementary to studies of clinical and cost-effectiveness: (i) assessing acceptability and subjective value; (ii) understanding perspectives and providing context; (iii) reaching the groups other methods cannot reach; (iv) laying the groundwork for subsequent quantitative exercises; and (v) contributing to economic model development.

Health technology assessment for oral health in the past decade: a scoping review

BACKGROUND

Health technology assessment (HTA) is the systematic evaluation of various properties and effects of a health technology. HTA can serve as a bridge between the world of knowledge and that of decision making, offering decision makers the best summary of scientific evidence. Scoping HTA reports in the context of dentistry can help researchers identify grey areas; help practitioners make evidence-based decisions and further initiate better policy making.

AIM

To provide an overview on HTAs pertaining to oral health and dentistry in the past decade, map the extension and scope of the methodological practices, key findings, and limitations.

METHODOLOGY

A scoping review was conducted using the Joanna Briggs Institute framework. A comprehensive search for HTA reports was done through the International Network of Agencies for Health Technology Assessment Database from January 2010 to December 2020. Consecutively, electronic databases (PubMed and Google Scholar) were searched. Finally, thirty-six reports were included in this review and analyzed.

RESULTS

A total of 709 articles were initially identified, of which thirty-six met the inclusion criteria. Reviewed HTAs focused on various specialties of dentistry worldwide. Maximum number of reports (N = 5) were related to "prosthodontics and dental implants" and technologies related to preventive dentistry were most commonly assessed (N = 4).

CONCLUSION

Functional, appropriate, and evidence-based information provided through HTA pertaining to oral health on a regular basis will enable decision makers to have enough data to make decisions on the future use of new technology, modify existing policies, accelerate its translation into practice, and ensure provision of robust dental healthcare services.

Health technology assessment 2025 and beyond: lifecycle approaches to promote engagement and efficiency in health technology assessment

Lifecycle considerations have always been part of health technology assessment (HTA). However, the concept of taking a fuller, more holistic "lifecycle approach" is gaining interest in the HTA community. The 2022 HTAi Global Policy Forum (GPF) discussed how adopting a lifecycle approach could promote stakeholder engagement and robust evidence generation, and whether it could enhance information sharing and transparency across stakeholder groups. This article summarizes the discussions held at the 2022 HTAi GPF and subsequent HTAi Annual Meeting panel session that debated some of the key challenges and opportunities, with particular focus on the pre- and postmarket and disinvestment phase activities. Core themes and recommendations identified that collaboration and patient involvement are happening but still needs to be strengthened, and moving to disease-based approaches may help, although individual contexts still need to be considered. Appropriately developed and mandated core outcome sets may help with information sharing and efficiency in all lifecycle activities. Further, methods for the appropriate use of big data and digital data collection should be developed and driven by the HTA community. The value of lifecycle activities should be reviewed; in particular, scientific advice appears valuable, but the magnitude of effect is somewhat unknown due to the challenges around the confidential nature of these activities. Not all lifecycle activities can be conducted for every technology, and while there is a move away from disinvestment phase activities, more structured prioritization criteria are required. This article ends with suggested next steps to bring forward some of the priority recommendations.

Decision-analytic modeling for early health technology assessment of medical devices - a scoping review

Objective

The goal of this review was to identify decision-analytic modeling studies in early health technology assessments (HTA) of high-risk medical devices, published over the last three years, and to provide a systematic overview of model purposes and characteristics. Additionally, the aim was to describe recent developments in modeling techniques.

Methods

For this scoping review, we performed a systematic literature search in PubMed and Embase including studies published in English or German. The search code consisted of terms describing early health technology assessment and terms for decision-analytic models. In abstract and full-text screening, studies were excluded that were not modeling studies for a high-risk medical device or an in-vitro diagnostic test. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) flow diagram was used to report on the search and exclusion of studies. For all included studies, study purpose, framework and model characteristics were extracted and reported in systematic evidence tables and a narrative summary.

Results

Out of 206 identified studies, 19 studies were included in the review. Studies were either conducted for hypothetical devices or for existing devices after they were already available on the market. No study extrapolated technical data from early development stages to estimate potential value of devices in development. All studies except one included cost as an outcome. Two studies were budget impact analyses. Most studies aimed at adoption and reimbursement decisions. The majority of studies were on in-vitro diagnostic tests for personalized and targeted medicine. A timed automata model, to our knowledge a model type new to HTA, was tested by one study. It describes the agents in a clinical pathway in separate models and, by allowing for interaction between the models, can reflect complex individual clinical pathways and dynamic system interactions. Not all sources of uncertainty for in-vitro tests were explicitly modeled. Elicitation of expert knowledge and judgement was used for substitution of missing empirical data. Analysis of uncertainty was the most valuable strength of decision-analytic models in early HTA, but no model applied sensitivity analysis to optimize the test positivity cutoff with regard to the benefit-harm balance or cost-effectiveness. Value-of-information analysis was rarely performed. No information was found on the use of causal inference methods for estimation of effect parameters from observational data.

Conclusion

Our review provides an overview of the purposes and model characteristics of nineteen recent early evaluation studies on medical devices. The review shows the growing importance of personalized interventions and confirms previously published recommendations for careful modeling of uncertainties surrounding diagnostic devices and for increased use of value-of-information analysis. Timed automata may be a model type worth exploring further in HTA. In addition, we recommend to extend the application of sensitivity analysis to optimize positivity criteria for in-vitro tests with regard to benefit-harm or cost-effectiveness. We emphasize the importance of causal inference methods when estimating effect parameters from observational data.

Assessing the potential of HTA to inform resource allocation decisions in low-income settings: The case of Malawi

Health technology assessment (HTA) offers a set of analytical tools to support health systems' decisions about resource allocation. Although there is increasing interest in these tools across the world, including in some middle-income countries, they remain rarely used in low-income countries (LICs). In general, the focus of HTA is narrow, mostly limited to assessments of efficacy and cost-effectiveness. However, the principles of HTA can be used to support a broader series of decisions regarding new health technologies. We examine the potential for this broad use of HTA in LICs, with a focus on Malawi. We develop a framework to classify the main decisions on health technologies within health systems. The framework covers decisions on identifying and prioritizing technologies for detailed assessment, deciding whether to adopt an intervention, assessing alternative investments for implementation and scale-up, and undertaking further research activities. We consider the relevance of the framework to policymakers in Malawi and we use two health technologies as examples to investigate the main barriers and enablers to the use of HTA methods. Although the scarcity of local data, expertise, and other resources could risk limiting the operationalisation of HTA in LICs, we argue that even in highly resource constrained health systems, such as in Malawi, the use of HTA to support a broad range of decisions is feasible and desirable.

Effective and Efficient Delivery of Genome-Based Testing-What Conditions Are Necessary for Health System Readiness?

Health systems internationally must prepare for a future of genetic/genomic testing to inform healthcare decision-making while creating research opportunities. High functioning testing services will require additional considerations and health system conditions beyond traditional diagnostic testing. Based on a literature review of good practices, key informant interviews, and expert discussion, this article attempts to synthesize what conditions are necessary, and what good practice may look like. It is intended to aid policymakers and others designing future systems of genome-based care and care prevention. These conditions include creating communities of practice and healthcare system networks; resource planning; across-region informatics; having a clear entry/exit point for innovation; evaluative function(s); concentrated or coordinated service models; mechanisms for awareness and care navigation; integrating innovation and healthcare delivery functions; and revisiting approaches to financing, education and training, regulation, and data privacy and security. The list of conditions we propose was developed with an emphasis on describing conditions that would be applicable to any healthcare system, regardless of capacity, organizational structure, financing, population characteristics, standardization of care processes, or underlying culture.

Stakeholder perception of pharmaceutical value: A multicriteria decision analysis pilot case study for value assessment in the United States

BACKGROUND: Recent attention to value frameworks has highlighted limitations of current conventional value and health technology assessment (V/HTA) methods (eg, cost-effectiveness). Multicriteria decision analysis (MCDA) has potential as a supplemental tool to incorporate additional value criteria into conventional value assessment. OBJECTIVE: To conduct a pilot study to illustrate the impact of an MCDA approach on the value perceptions of hypothetical treatment profiles from a multistakeholder panel. METHODS: Participants voted on value perceptions of 2 hypothetical treatments with similar cost-effectiveness evidence: Treatment A for aggressive B-cell non-Hodgkin lymphoma in adults and treatment B for episodic migraine in adults. Participants voted treatments A and B as low, intermediate, or high value before and after a weighting exercise on prespecified, additional value criteria. Weights from participants were used to calculate treatment-specific MCDA scores from 0 (least favorable) to 100 (most favorable) and were presented to participants for a second value-perception vote. Analyses compared changes in value perceptions within treatments A and B post-MCDA exercise. RESULTS: Before considering MCDA scores for treatment A, 0% of participants considered it to be low, 52% intermediate, and 48% high value. After considering MCDA scores for treatment A, 4% considered it low, 29% intermediate, and 67% high value. Both before and after considering MCDA scores for treatment B, 13%, considered it low, 57% intermediate, and 30% high value. Mean MCDA scores for treatments A and B were 67 and 63, respectively. Of all stakeholders, 41% altered their perception of value for treatment A (9% negatively and 32% positively) and, separately, 45% for treatment B (23% both negatively and positively) after considering MCDA scores. CONCLUSIONS: With nearly half of participants altering their perception of value after consideration of additional value criteria, findings support the need for a more inclusive and flexible value assessment process. DISCLOSURES: This study was funded by The National Pharmaceutical Council. Dr Perfetto was employed by the National Health Council (NHC) at the time this work was completed, and all honoraria and consulting and travel fees were paid to the NHC. The NHC is a not-for-profit, membership organization. It is supported through membership dues and sponsorship funds. The complete list of members and sponsors is located on the NHC's website at www.nationalhealthcouncil.org. She is also an advisor for the Brain Injury Association of America, Dan Lewis Foundation, and Canter for Medical Technology Policy.

Health technology assessment of whole genome sequencing in the diagnosis of genetic disorders: a scoping review of the literature

OBJECTIVE

The aim of this scoping review is to map the available evidence about the use of health technology assessment (HTA) in the assessment of whole genome sequencing (WGS).

METHODS

A scoping review methodology was adopted. The population, concept, and context framework was used to build up the research question and to establish the eligibility criteria. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews was adopted to implement a comprehensive search strategy. Evidence was retrieved from scientific databases and HTA organizations Web sites. Reports were classified as full HTA, mini-HTA, rapid reviews or other.

RESULTS

The search strategy identified seven reports. Five HTA organizations from five countries elaborated the reports: one full HTA, four rapid reviews, and two classified as others. The reports were mainly focused on the evaluation of the clinical utility and cost-effectiveness of genome-wide sequencing as well as informing policy questions by providing analyses of organizational and ethical considerations.

CONCLUSIONS

Few HTA organizations are drafting reports for WGS. It is essential to stimulate a critical reflection during the elaboration of HTA reports for WGS to steer choices of decision makers in the establishment of priorities for research and policy and reimbursement rates.

Challenges of Health Technology Assessment in Pluralistic Healthcare Systems: An ISPOR Council Report

Health technology assessment (HTA) has been growing in use over the past 40 years, especially in its impact on decisions regarding the reimbursement, adoption, and use of new drugs, devices, and procedures. In countries or jurisdictions with "pluralistic" healthcare systems, there are multiple payers or sectors, each of which could potentially benefit from HTA. Nevertheless, a single HTA, conducted centrally, may not meet the needs of these different actors, who may have different budgets, current standards of care, populations to serve, or decision-making processes. This article reports on the research conducted by an ISPOR Health Technology Assessment Council Working Group established to examine the specific challenges of conducting and using HTA in countries with pluralistic healthcare systems. The Group used its own knowledge and expertise, supplemented by a narrative literature review and survey of US payers, to identify existing challenges and any initiatives taken to address them. We recommend that countries with pluralistic healthcare systems establish a national focus for HTA, develop a uniform set of HTA methods guidelines, ensure that HTAs are produced in a timely fashion, facilitate the use of HTA in the local setting, and develop a framework to encourage transparency in HTA. These efforts can be enhanced by the development of good practice guidance from ISPOR or similar groups and increased training to facilitate local use of HTA.

Barriers to Use Artificial Intelligence Methodologies in Health Technology Assessment in Central and East European Countries

The aim of this paper is to identify the barriers that are specifically relevant to the use of Artificial Intelligence (AI)-based evidence in Central and Eastern European (CEE) Health Technology Assessment (HTA) systems. The study relied on two main parallel sources to identify barriers to use AI methodologies in HTA in CEE, including a scoping literature review and iterative focus group meetings with HTx team members. Most of the other selected articles discussed AI from a clinical perspective (n = 25), and the rest are from regulatory perspective (n = 13), and transfer of knowledge point of view (n = 3). Clinical areas studied are quite diverse—from pediatric, diabetes, diagnostic radiology, gynecology, oncology, surgery, psychiatry, cardiology, infection diseases, and oncology. Out of all 38 articles, 25 (66%) describe the AI method and the rest are more focused on the utilization barriers of different health care services and programs. The potential barriers could be classified as data related, methodological, technological, regulatory and policy related, and human factor related. Some of the barriers are quite similar, especially concerning the technologies. Studies focusing on the AI usage for HTA decision making are scarce. AI and augmented decision making tools are a novel science, and we are in the process of adapting it to existing needs. HTA as a process requires multiple steps, multiple evaluations which rely on heterogenous data. Therefore, the observed range of barriers come as a no surprise, and experts in the field need to give their opinion on the most important barriers in order to develop recommendations to overcome them and to disseminate the practical application of these tools.

A Conceptual Framework for Life-Cycle Health Technology Assessment

OBJECTIVES

Health technology assessment (HTA) uses evidence appraisal and synthesis with economic evaluation to inform adoption decisions. Standard HTA processes sometimes struggle to (1) support decisions that involve significant uncertainty and (2) encourage continued generation of and adaptation to new evidence. We propose the life-cycle (LC)-HTA framework, addressing these challenges by providing additional tools to decision makers and improving outcomes for all stakeholders.

METHODS

Under the LC-HTA framework, HTA processes align to LC management. LC-HTA introduces changes in HTA methods to minimize analytic time while optimizing decision certainty. Where decision uncertainty exists, we recommend risk-based pricing and research-oriented managed access (ROMA). Contractual procurement agreements define the terms of reassessment and provide additional decision options to HTA agencies. LC-HTA extends value-of-information methods to inform ROMA agreements, leveraging routine, administrative data, and registries to reduce uncertainty.

RESULTS

LC-HTA enables the adoption of high-value high-risk innovations while improving health system sustainability through risk-sharing and reducing uncertainty. Responsiveness to evolving evidence is improved through contractually embedded decision rules to simplify reassessment. ROMA allows conditional adoption to obtain additional information, with confidence that the net value of that adoption decision is positive.

CONCLUSIONS

The LC-HTA framework improves outcomes for patients, sponsors, and payers. Patients benefit through earlier access to new technologies. Payers increase the value of the technologies they invest in and gain mechanisms to review investments. Sponsors benefit through greater certainty in outcomes related to their investment, swifter access to markets, and greater opportunities to demonstrate value.

Systematic literature review on the implicit factors influencing the HTA deliberative process in Europe

Objectives

Deliberative processes in Health Technologies Assessment (HTA) result in recommendations that determine the reimbursement of medicines, diagnostics or devices. These processes are governed by explicit criteria, but are also influenced by implicit factors. The objective of this work was to identify the implicit factors influencing HTA deliberative processes in five European countries (France, Germany, Italy, Spain and the UK).

Methods

A systematic review of literature published between 2009 and 2019 was conducted. The search was performed in Pubmed, The Cochrane Database of Systematic Reviews, Google Scholar and Center for Reviews and Dissemination. The ISPOR database was searched manually.

Results

Out of 100 eligible publications, eight articles were selected for data extraction and analysis. The implicit factors in the HTA deliberative process most frequently mentioned in the identified literature are value judgments, biases, preferences and subjectivity. Five out of the eight articles highlight the need to further improve the transparency of the process, and three provide recommendations on how to address the influence of implicit factors on the HTA deliberative process through a framework.

Conclusion

Even in countries with a long HTA history, evidence on implicit factors is scarce. Some methods have been recommended for addressing these factors. Further research is required to characterize the implicit factors in the HTA deliberative process at a country level and explore potential ways to mitigate the influence of these factors on the HTA deliberative process.

Designing and Implementing Deliberative Processes for Health Technology Assessment: A Good Practices Report of a Joint HTAi/ISPOR Task Force

Objectives

Deliberative processes for health technology assessment (HTA) are intended to facilitate participatory decision making, using discussion and open dialogue between stake-holders. Increasing attention is being given to deliberative processes, but guidance is lacking for those who wish to design or use them. Health Technology Assessment International (HTAi) and ISPOR—The Professional Society for Health Economics and Outcomes Research initiated a joint Task Force to address this gap.

Methods

The joint Task Force consisted of fifteen members with different backgrounds, perspectives, and expertise relevant to the field. It developed guidance and a checklist for deliberative processes for HTA. The guidance builds upon the few, existing initiatives in the field, as well as input from the HTA community following an established consultation plan. In addition, the guidance was subject to two rounds of peer review.

Results

A deliberative process for HTA consists of procedures, activities, and events that support the informed and critical examination of an issue and the weighing of arguments and evidence to guide a subsequent decision. Guidance and an accompanying checklist are provided for (i) developing the governance and structure of an HTA program and (ii) informing how the various stages of an HTA process might be managed using deliberation.

Conclusions

The guidance and the checklist contain a series of questions, grouped by six phases of a model deliberative process. They are offered as practical tools for those wishing to establish or improve deliberative processes for HTA that are fit for local contexts. The tools can also be used for independent scrutiny of deliberative processes.

Designing and Implementing Deliberative Processes for Health Technology Assessment: A Good Practices Report of a Joint HTAi/ISPOR Task Force

OBJECTIVES

Deliberative processes for health technology assessment (HTA) are intended to facilitate participatory decision making, using discussion and open dialogue between stakeholders. Increasing attention is being given to deliberative processes, but guidance is lacking for those who wish to design or use them. Health Technology Assessment International (HTAi) and ISPOR-The Professional Society for Health Economics and Outcomes Research initiated a joint Task Force to address this gap.

METHODS

The joint Task Force consisted of 15 members with different backgrounds, perspectives, and expertise relevant to the field. It developed guidance and a checklist for deliberative processes for HTA. The guidance builds upon the few, existing initiatives in the field, as well as input from the HTA community following an established consultation plan. In addition, the guidance was subject to 2 rounds of peer review.

RESULTS

A deliberative process for HTA consists of procedures, activities, and events that support the informed and critical examination of an issue and the weighing of arguments and evidence to guide a subsequent decision. Guidance and an accompanying checklist are provided for (i) developing the governance and structure of an HTA program and (ii) informing how the various stages of an HTA process might be managed using deliberation.

CONCLUSIONS

The guidance and the checklist contain a series of questions, grouped by 6 phases of a model deliberative process. They are offered as practical tools for those wishing to establish or improve deliberative processes for HTA that are fit for local contexts. The tools can also be used for independent scrutiny of deliberative processes.

Cost-Effectiveness of Population Screening Programs for Cardiovascular Diseases and Diabetes in Low- and Middle-Income Countries: A Systematic Review

Almost all low- and middle-income countries (LMICs) have instated a program to control and manage non-communicable diseases (NCDs). Population screening is an integral component of this strategy and requires a substantial chunk of investment. Therefore, testing the screening program for economic along with clinical effectiveness is essential. There is significant proof of the benefits of incorporating economic evidence in health decision-making globally, although evidence from LMICs in NCD prevention is scanty. This systematic review aims to consolidate and synthesize economic evidence of screening programs for cardiovascular diseases (CVD) and diabetes from LMICs. The study protocol is registered on PROSPERO (CRD42021275806). The review includes articles from English and Chinese languages. An initial search retrieved a total of 2,644 potentially relevant publications. Finally, 15 articles (13 English and 2 Chinese reports) were included and scrutinized in detail. We found 6 economic evaluations of interventions targeting cardiovascular diseases, 5 evaluations of diabetes interventions, and 4 were combined interventions, i.e., screening of diabetes and cardiovascular diseases. The study showcases numerous innovative screening programs that have been piloted, such as using mobile technology for screening, integrating non-communicable disease screening with existing communicable disease screening programs, and using community health workers for screening. Our review reveals that context is of utmost importance while considering any intervention, i.e., depending on the available resources, cost-effectiveness may vary—screening programs can be made universal or targeted just for the high-risk population.

Topic selection process in health technology assessment agencies around the world: a systematic review

Objective

The purpose of this study was to systematically review the process for topic selection by health technology assessment (HTA) agencies around the world to provide the knowledge base for the improvement of topic selection frameworks in HTA agencies.

Methods

A systematic search was conducted in PubMed and EMBASE to identify papers up to February 2019. Gray literature was identified by screening the Web sites of HTA agencies on the nonprofit member list of the International Network of Agencies for Health Technology Assessment (INAHTA). Data were extracted for each HTA agency and synthesized, with issues including general contextual information about each agency and the process of topic selection.

Results

Out of forty-nine nonprofit members of INAHTA, a total of seventeen HTA agencies with a framework for topic selection were identified from twenty-two included papers/documents. Multiple criteria were used for topic selection in all frameworks and agencies undertook multiple steps, which could include the specification of criteria for topic selection, identification of topics, short listing of potential topics, scoping of potential topics, scoring and ranking of potential topics, and deliberation and decision on final topics for HTA. Shortcomings were found in relation to methods of scoring and ranking as well as lack of monitoring and the evaluation of the process.

Conclusions

Our study provides insights into the current practice of topic selection in HTA agencies. Multiple criteria decision analysis methodology appears highly relevant to these processes. A consensus approach for the development of methods of topic selection would be valuable for the HTA community.

Understanding innovation of health technology assessment methods: the IHTAM framework

Adequate methods are urgently needed to guarantee the good practice of health technology assessment (HTA) for technologies with novel properties. The aim of the study was to construct a conceptual framework to help understand the innovation of HTA methods (IHTAM). The construction of the IHTAM framework was based on two scoping reviews, one on the current practice of innovating methods, that is existing HTA frameworks, and one on theoretical foundations for innovating methods outside the HTA discipline. Both aimed to identify and synthesize concepts of innovation (i.e., innovation processes and roles of stakeholders in innovation). Using these concepts, the framework was developed in iterative brainstorming sessions and subsequent discussions with representatives from various stakeholder groups. The framework was constructed based on twenty documents on innovating HTA frameworks and fourteen guidelines from three scientific disciplines. It includes a generic innovation process consisting of three phases (“Identification,” “Development,” and “Implementation”) and nine subphases. In the framework, three roles that HTA stakeholders can play in innovation (“Developers,” “Practitioners,” and “Beneficiaries”) are defined, and a process on how the stakeholders innovate HTA methods is included. The IHTAM framework visualizes systematically which elements and stakeholders are important to the development and implementation of novel HTA methods. The framework could be used by all stakeholders involved in HTA innovation to learn how to engage dynamically and collaborate effectively throughout the innovation process. HTA stakeholders in practice have welcomed the framework, though additional testing of its applicability and acceptance is essential.

Health technology assessment-informed pricing negotiation in China: higher negotiated price for more effective targeted anticancer medicines?

Background

In China, health technology assessment (HTA) has recently been adopted in pricing negotiation for medicine listing in the National Reimbursement Drug List. At present, how HTA is applied to inform the decision-making process remains underreported. In order to explore how the adoption of HTA was translated into listing and price negotiation results in light of the confidential nature of the negotiating process, this study aimed to compare the negotiated price and the clinical benefit of selected targeted anticancer medicines (TAMs) involved in the 2019 negotiation.

Main text

Among 16 TAMs successfully negotiated, only four TAMs representing four indication groups had appropriate reference medicines for comparison and were, therefore, included in the analysis. The price and clinical benefit of the four TAMs were compared against one or two reference medicines with the same initial indications. The sales prices for nine TAMs before and after the negotiation were extracted from the centralized medication procurement system. Clinical benefits were evaluated based on evidence from published articles and clinical guidelines. The results suggested that, despite the application of HTA, both rational and irrational decisions had been made about the reimbursement of TAMs in the 2019 negotiation, warranting further investigation.

Conclusion

While the development and adoption of HTA has seen significant progress in China, actions are needed to ensure that the adoption of HTA is effectively applied in decisions on the reimbursement of medicines.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12961-021-00810-1.

Clarifying Values: An Updated and Expanded Systematic Review and Meta-Analysis

Background

Patient decision aids should help people make evidence-informed decisions aligned with their values. There is limited guidance about how to achieve such alignment.

Purpose

To describe the range of values clarification methods available to patient decision aid developers, synthesize evidence regarding their relative merits, and foster collection of evidence by offering researchers a proposed set of outcomes to report when evaluating the effects of values clarification methods.

Data Sources

MEDLINE, EMBASE, PubMed, Web of Science, the Cochrane Library, and CINAHL.

Study Selection

We included articles that described randomized trials of 1 or more explicit values clarification methods. From 30,648 records screened, we identified 33 articles describing trials of 43 values clarification methods.

Data Extraction

Two independent reviewers extracted details about each values clarification method and its evaluation.

Data Synthesis

Compared to control conditions or to implicit values clarification methods, explicit values clarification methods decreased the frequency of values-incongruent choices (risk difference, –0.04; 95% confidence interval [CI], –0.06 to –0.02; P < 0.001) and decisional conflict (standardized mean difference, –0.20; 95% CI, –0.29 to –0.11; P < 0.001). Multicriteria decision analysis led to more values-congruent decisions than other values clarification methods (χ² = 9.25, P = 0.01). There were no differences between different values clarification methods regarding decisional conflict (χ² = 6.08, P = 0.05).

Limitations

Some meta-analyses had high heterogeneity. We grouped values clarification methods into broad categories.

Conclusions

Current evidence suggests patient decision aids should include an explicit values clarification method. Developers may wish to specifically consider multicriteria decision analysis. Future evaluations of values clarification methods should report their effects on decisional conflict, decisions made, values congruence, and decisional regret.

Health Economics in the Field of Prosthetics and Orthotics: A Global Perspective

The rapid advancement of prosthetic and orthotic (P&O) technology raises the question how the industry can ensure that patients have access to the benefits and providers get paid properly and fairly by healthcare payers. This is a challenge that not only P&O but all areas of health technology face. In many areas of medicine and health products, such as drugs and medical devices, health-technology assessments (HTA) have become a standard procedure in the coverage and reimbursement process. In most countries, P&O is lagging behind that development, although some countries have already formalized HTA for prosthetic and orthotic products and may even use cost-effectiveness analyses to determine pricing and payment amounts. This article gives an overview on the coverage and reimbursement processes in the United States, Canada, Germany, France, Sweden, the United Kingdom, Poland, Japan, and China. This selection reflects the variety and diversity of coverage and reimbursement processes that the P&O industry faces globally. The paper continues with an overview on the necessary research and investment efforts that manufacturers will have to make in the future, and contemplates the likely consequences for the manufacturer community in the market place. Health economics may help support the transition from price-based to value-based coverage and reimbursement but will come at considerable costs to the industry.

The CAPACITI Decision-Support Tool for National Immunization Programs

OBJECTIVES

Immunization programs in low-income and middle-income countries (LMICs) are faced with an ever-growing number of vaccines of public health importance recommended by the World Health Organization, while also financing a greater proportion of the program through domestic resources. More than ever, national immunization programs must be equipped to contextualize global guidance and make choices that are best suited to their setting. The CAPACITI decision-support tool has been developed in collaboration with national immunization program decision makers in LMICs to structure and document an evidence-based, context-specific process for prioritizing or selecting among multiple vaccination products, services, or strategies.

METHODS

The CAPACITI decision-support tool is based on multi-criteria decision analysis, as a structured way to incorporate multiple sources of evidence and stakeholder perspectives. The tool has been developed iteratively in consultation with 12 countries across Africa, Asia, and the Americas.

RESULTS

The tool is flexible to existing country processes and can follow any type of multi-criteria decision analysis or a hybrid approach. It is structured into 5 sections: decision question, criteria for decision making, evidence assessment, appraisal, and recommendation. The Excel-based tool guides the user through the steps and document discussions in a transparent manner, with an emphasis on stakeholder engagement and country ownership.

CONCLUSIONS

Pilot countries valued the CAPACITI decision-support tool as a means to consider multiple criteria and stakeholder perspectives and to evaluate trade-offs and the impact of data quality. With use, it is expected that LMICs will tailor steps to their context and streamline the tool for decision making.

Limited role of patient input in specialty drug coverage policies

BACKGROUND: Despite increased financial contributions towards care, consumers' role in shaping their insurance benefits is unclear. OBJECTIVE: To examine the role played by patient input when US commercial health plans formulate specialty drug coverage policies, along with the benefits and challenges of considering this input. METHODS: We employed a parallel, mixed-methods approach. First, we reviewed health plans' policy development processes as reported on their websites. Second, we reviewed a data set of private health plan coverage decisions for specialty drugs and examined whether the evidence cited in policies included patient-reported outcomes (eg, health-related quality of life endpoints) and patient-based methodological designs (eg, interviews or surveys of patients). Third, we performed a survey (N = 21 respondents) and interviews (N = 5 interviewees) with plan decision-makers to determine the current role of patient input in plan decision-making, and the benefits and challenges of incorporating this data when formulating specialty drug coverage policies. RESULTS: We found that plans do not commonly solicit patient input when developing coverage policies, with only two instances of limited interaction between plans and patients or members. 1,316 (9%) of the studies plans cited in their specialty drug coverage policies included at least one patient-reported endpoint, and 0.4% (N = 62) used a patient-based methodological design. Of studies with patient-based designs, 40 used interviews, 26 included surveys/questionnaires, and one concerned shared decision-making (design categories not mutually exclusive). Almost half of the survey respondents reported having never engaged with patients or members when developing coverage policies. Among respondents who had engaged with patients or members, most reported doing so only rarely. The survey and interviews highlighted various benefits of soliciting patient input, including the value of obtaining a humanistic perspective, and several challenges, including resource requirements and the quality of obtained information. CONCLUSIONS: We found a notable lack of patient and member engagement by commercial health plans when formulating drug coverage policies. Survey respondents and interviewees identified benefits of accounting for patients' and plan members' values and preferences in specialty drug coverage policies, but also reported a number of important challenges to doing so. DISCLOSURES: National Pharmaceutical Council provided funding for this research.

HTA Reshaping: Rethinking the Health Technology Assessment Framework in Portugal

Introduction

Health technology assessment (HTA) aims to provide decision makers with relevant data to make informed choices. Recent changes in the Portuguese HTA framework have altered substantially the assessment methodology with regard to economic evaluation, with potential impacts on access and process efficiency. The HTA Reshaping Project had as its main objective informing the debate on HTA in Portugal, thereby identifying improvement opportunities and solutions to the HTA framework that address future challenges.

Methods

The project comprised several phases, i.e., (1) mapping and evaluation of different HTA frameworks across Europe, identifying best practices and key variables to consider in future frameworks; (2) conduction of in-depth interviews with relevant stakeholders (n = 11); and (3) development of 2 workshops - one with young professionals (n = 12) and another with relevant HTA stakeholders (n = 19) - to consolidate and further explore vital elements of HTA, aimed at brainstorming ideas and developing solutions to improve some of the most critical points, with a view to addressing future challenges.

Results

The comparison of HTA frameworks showed that their purpose and sophistication vary across European countries. For example, the need for economic evidence is not unanimous, and reimbursement agreements vary considerably. Among the stakeholders interviewed there was a high level of agreement on priorities that should be addressed, e.g., expanding and creating national level registries and assuring patient participation throughout the HTA process. The possibility of using managed entry agreements to enhance patients' access, applying multi-indication pricing for medicines with different therapeutic values per indication, and improvement of registry/system interoperability gathered a moderate level of agreement.

Conclusions

The Portuguese HTA framework might be further adapted to upcoming challenges and should evolve to improve access to innovative therapies. There is still a long path towards the convergence of HTA frameworks in EU member states.

Systems thinking in health technology assessment: a scoping review

OBJECTIVE

Our objective was to assess how, and to what extent, a systems-level perspective is considered in decision-making processes for health interventions by illustrating how studies define the boundaries of the system in their analyses and by defining the decision-making context in which a systems-level perspective is undertaken.

METHOD

We conducted a scoping review following the Joanna Briggs Institute methodology. MEDLINE, EMBASE, Cochrane Library, and EconLit were searched and key search concepts included decision making, system, and integration. Studies were classified according to an interpretation of the "system" of analysis used in each study based on a four-level model of the health system (patient, care team, organization, and/or policy environment) and using categories (based on intervention type and system impacts considered) to describe the decision-making context.

RESULTS

A total of 2,664 articles were identified and 29 were included for analysis. Most studies (16/29; 55%) considered multiple levels of the health system (i.e., patient, care team, organization, environment) in their analysis and assessed multiple classes of interventions versus a single class of intervention (e.g., pharmaceuticals, screening programs). Approximately half (15/29; 52%) of the studies assessed the influence of policy options on the system as a whole, and the other half assessed the impact of interventions on other phases of the disease pathway or life trajectory (14/29; 48%).

CONCLUSIONS

We found that systems thinking is not common in areas where health technology assessments (HTAs) are typically conducted. Against this background, our study demonstrates the need for future conceptualizations and interpretations of systems thinking in HTA.

Deliberative Processes by Health Technology Assessment Agencies: A Reflection on Legitimacy, Values and Patient and Public Involvement Comment on "Use of Evidence-informed Deliberative Processes by Health Technology Assessment Agencies Around the Globe"

Legitimacy of deliberation processes leading to recommendations for public financing or clinical practice depends on the data considered, stakeholders involved and the process by which both of these are selected and organised. Oortwijn et al provides an interesting exploration of processes currently in place in health technology assessment (HTA) agencies. However, agencies are struggling with core issues central to their legitimacy that goes beyond the procedural exploration of Oortwijn et al, such as: how processes reflect the mission and values of the agencies? How they ensure that recommendations are fair and reasonable? Which role should be given to public and patient involvement? Do agencies have a positive impact on the healthcare system and the populations served? What are the drivers of their evolution? We concur with Culyer commentary on the need of learning from doing what works best and that a reflection is indeed needed to "enhance the fairness and legitimacy of HTA."

Companies' Health Technology Assessment Strategies and Practices in Australia, Canada, England, France, Germany, Italy and Spain: An Industry Metrics Study

Background: Health technology assessment (HTA) has increased in importance in supporting payer decision making by assessing the relative effectiveness and cost effectiveness of new medicines. Thus, pharmaceutical companies need to address the HTA requirements early during development to improve reimbursement outcomes. Currently, there is a lack of research to assess the impact of HTA on development and jurisdictional outcome from companies’ perspectives. This study aimed to assess companies’ HTA strategy and characterise HTA practice in seven jurisdictions.

Methods: A multi-year, annual study collected information for individual products, focusing on development activities regarding inclusion of HTA requirements and selection of global comparators. The generation of local contextual information, submission strategies and predictability of HTA outcomes was examined jurisdictionally in Australia, Canada, England, France, Germany, Italy and Spain. The study questionnaire was built into a secure online data collection platform and data were provided annually by participating companies.

Results: Data for 169 compounds were provided by nine international companies between 2014 and 2018. HTA requirements were implemented in evidence generation plan for 63% of products during development. Global comparators were accepted by HTA bodies for more than half of studied products; Spain showed the highest acceptance rate (85%). Companies took advantages of parallel process in Australia and Canada to shorten product rollout time. Australia demonstrated general consistency in HTA review time, and England had the longest variation (interquartile range, 216 days). Requirements for additional information after submission occurred at all HTA bodies. Germany and Italy showed the highest percentage of products being reimbursed as per regulatory label (80 and 68%, respectively). Canada was the most predictable jurisdiction, with the highest proportion of review outcome (90%) that met companies’ expectations.

Conclusion: Companies are addressing HTA requirements during development for many products; however, they are challenged by varying requirements and practices and product success ultimately depends on how HTA organisations and payers assess added value in the context of the national healthcare systems. This ongoing study created a baseline to help capture fact-based changes for company HTA strategies and HTA body practices.

Use of real-world evidence in economic assessments of pharmaceuticals in the United States

BACKGROUND: Despite the increasing interest in expanding the use of real-world evidence (RWE) in economic assessments of pharmaceuticals, decision makers face uncertainty about how RWE should be used. OBJECTIVE: To assess the use of RWE in economic assessments of drugs by the Institute for Clinical and Economic Review (ICER). METHODS: We reviewed cost-effectiveness and budget impact analyses in final evidence reports of pharmaceuticals published by ICER. We calculated the total number of RWE uses and the proportion of model inputs informed by RWE per report. We classified model inputs into 15 categories based on their attributes and then examined what category each RWE informed to classify the reason for RWE use. Finally, we characterized RWE by study design, data source, and sponsor type. RESULTS: We identified 33 reports, all of which used RWE; the mean RWE use per report was 12 (range = 4-26). The average proportion of model inputs informed by RWE per report was 32.7%, but this proportion had a wide range (range = 4.1%-76.9%). RWE was most commonly used for disease progression inputs (28.7%) and health care resource utilization and costs (21.1%), but was rarely used for drug-specific clinical outcomes such as effectiveness (1.5%), adverse drug event rates (0.5%), and discontinuation rates (1.2%). The most frequently used study design was a retrospective cohort (56.6%), and the most frequently used data source was registry data (41.4%). About a third (30.2%) of RWE was industry-sponsored. CONCLUSIONS: RWE has been commonly used to inform pharmaceutical value assessments conducted by ICER. However, there has been relatively limited use of RWE to inform drug-specific effectiveness, despite calls for greater inclusion of RWE in value assessments for real-world drug effectiveness. DISCLOSURES: This study was funded by the University of Washington School of Pharmacy Corporate Advisory Board Health Tech Fund (HTF). The funder had no role in management, analysis, and interpretation of the data; preparation, review, and approval of the manuscript; and the decision to submit the manuscript for publication. All authors were employed by the CHOICE Institute, University of Washington School of Pharmacy, at the time of the study. Carlson reports grants from the Institute for Clinical and Economic Review during the conduct of the study and personal fees from Bayer, Adaptive Biotechnologies, Allergan, Galderma, and ViFor Pharma, unrelated to this study. Veenstra reports personal fees from several manufacturers unrelated to this study. The other authors have nothing to disclose.