Transparency vs. closed-door policy: do process characteristics have an impact on the outcomes of coverage decisions? A statistical analysis

Involvement of Patients and Medical Professionals in the Assessment of Relative Effectiveness: A Need for Closer Cooperation

OBJECTIVES

Involvement of patients and medical professionals in assessment of relative effectiveness (relative effectiveness assessment) contributes to an efficient and effective health technology assessment (HTA) process and supports acceptance and implementation of the outcome. This study aimed to analyze stakeholder involvement in assessing relative effectiveness and how the parties involved value this collaboration.

METHODS

This is a document analysis of all drug assessments completed in 2019 (20) by the public HTA agency of The Netherlands, enriched with semistructured interviews with employees of the HTA agency (18) and representatives of patient (5) and medical (11) associations involved in these assessments. Data were analyzed, coded, and categorized.

RESULTS

In almost half of the assessments, there was no coordination with the medical associations at the start of the relative effectiveness assessment and no patient associations involved in this phase. During the assessment procedure, patient and medical associations were always asked to comment on the draft report. Nevertheless, the strict 5-day deadline that the HTA agency uses as a response period often hampered a proper response and involvement. According to interviewees of the HTA agency, this leads to a great diversity in the substantive quality of their input. Patient and medical associations indicated that the HTA agency relies too much on "paper knowledge," which leads to a (perceived) lack of alignment with clinical practice.

CONCLUSIONS

The limited involvement results in a lack of coordination and mutual trust. Optimizing involvement of patients and medical professionals in HTA practice requires effort from all parties involved. Procedural adjustments and better coordination, especially at the start of the assessment, would probably improve cooperation.

Systematic literature review on the implicit factors influencing the HTA deliberative process in Europe

Objectives

Deliberative processes in Health Technologies Assessment (HTA) result in recommendations that determine the reimbursement of medicines, diagnostics or devices. These processes are governed by explicit criteria, but are also influenced by implicit factors. The objective of this work was to identify the implicit factors influencing HTA deliberative processes in five European countries (France, Germany, Italy, Spain and the UK).

Methods

A systematic review of literature published between 2009 and 2019 was conducted. The search was performed in Pubmed, The Cochrane Database of Systematic Reviews, Google Scholar and Center for Reviews and Dissemination. The ISPOR database was searched manually.

Results

Out of 100 eligible publications, eight articles were selected for data extraction and analysis. The implicit factors in the HTA deliberative process most frequently mentioned in the identified literature are value judgments, biases, preferences and subjectivity. Five out of the eight articles highlight the need to further improve the transparency of the process, and three provide recommendations on how to address the influence of implicit factors on the HTA deliberative process through a framework.

Conclusion

Even in countries with a long HTA history, evidence on implicit factors is scarce. Some methods have been recommended for addressing these factors. Further research is required to characterize the implicit factors in the HTA deliberative process at a country level and explore potential ways to mitigate the influence of these factors on the HTA deliberative process.

Low geriatric nutritional risk index is a risk factor for death within 1 year following hip fracture

PURPOSE

Hip fracture is common in older patients and is associated with high mortality and functional impairment. The Geriatric Nutritional Risk Index (GNRI) evaluates the risk of malnutrition-related complications, and the Barthel Index (BI) evaluates older patients' functional status. The study aim was to determine the risk factors for both death and decreased BI within 1 year after hip fracture.

METHODS

We retrospectively reviewed the records of 108 patients who were treated for hip fractures in 10 public or private hospitals from February to July 2007. Participating facilities comprised eight public or private hospitals with 200-499 beds, and two private or orthopedic hospitals with 20-199 beds. We evaluated several risk factors for death and lower BI within 1 year after hip fracture.

RESULTS

The mortality rate within 1 year postoperatively for patients who survived inpatient stay was 6.5% (7/108). The proportion of patients with decreased postoperative BI was 43.6% (44/101). Binomial logistic regression analysis showed that several factors, including low GNRI (odds ratio [OR]: 0.80; 95% confidence interval [CI: 0.68-0.93]), were risk factors for death within 1 year. Postoperative delirium (OR: 8.84 [1.52-51.6]), postinjury dementia (OR: 34.8 [3.01-402]), preinjury BI (OR: 1.05 [1.02-1.08]), and preinjury dementia (OR: 6.22 [1.73-22.4]) were risk factors for decreased postoperative BI.

CONCLUSIONS

Our findings indicated that lower GNRI was a risk factor for death within 1 year of hip surgery and that delirium and dementia were among the risk factors for decreased BI 1 year after hip fracture.

The Emerging Social Science Literature on Health Technology Assessment: A Narrative Review

BACKGROUND

Social scientists have paid increasing attention to health technology assessment (HTA). This paper provides an overview of existing social scientific literature on HTA, with a focus on sociology and political science and their subfields.

METHODS

Narrative review of key pieces in English.

RESULTS

Three broad themes recur in the emerging social science literature on HTA: the drivers of the establishment and concrete institutional designs of HTA bodies; the effects of institutionalized HTA on pricing and reimbursement systems and the broader society; and the social and political influences on HTA decisions.

CONCLUSION

Social scientists bring a focus on institutions and social actors involved in HTA, using primarily small-N research designs and qualitative methods. They provide valuable critical perspectives on HTA, at times challenging its otherwise unquestioned assumptions. However, they often leave aside questions important to the HTA practitioner community, including the role of culture and values. Closer collaboration could be beneficial to tackle new relevant questions pertaining to HTA.

Why do health technology assessment drug reimbursement recommendations differ between countries? A parallel convergent mixed methods study

Using quantitative and qualitative research designs, respectively, two studies investigated why countries make different health technology assessment (HTA) drug reimbursement recommendations. Building on these, the objective of this study was to (a) develop a conceptual framework integrating the factors explaining these decisions, (b) explore their relationship and (c) assess if they are congruent, complementary or discrepant. A parallel convergent mixed methods design was used. Countries included in both previous studies were selected (England, Sweden, Scotland and France). A conceptual framework that integrated and organised the factors explaining the decisions from the two studies was developed. Relationships between factors were explored and illustrated through case studies. The framework distinguishes macro-level factors from micro-level ones. Only two of the factors common to both studies were congruent, while two others reached discrepant conclusions (stakeholder input and external review of the evidence processes). The remaining factors identified within one or both studies were complementary. Bringing together these findings contributed to generating a more complete picture of why countries make different HTA recommendations. Results were mostly complementary, explaining and enhancing each other. We conclude that differences often result from a combination of factors, with an important component relating to what occurs during the deliberative process.

Risk Factors for Surgical Site Infection after Soft-Tissue Sarcoma Resection, Including the Preoperative Geriatric Nutritional Risk Index

Malignant soft-tissue sarcoma resection is associated with a relatively high incidence of surgical site infection (SSI). The known risk factors for SSI following soft-tissue sarcoma resection include tumor size and location, prolonged surgery, and massive blood loss. The geriatric nutritional risk index (GNRI) was used as a tool to help predict the occurrence of SSI after major surgery. We investigated the utility of the GNRI as a predictor of SSI following soft-tissue sarcoma resection. We retrospectively reviewed 152 patients who underwent surgical resection of soft-tissue sarcoma in our institute, and found that the incidence of SSI was 18.4% (28/152). The SSI and non-SSI groups significantly differed regarding surgical time, diameter of the skin incision, maximum tumor diameter, instrumentation, presence of an open wound, preoperative chemotherapy, preoperative C-reactive protein concentration, and GNRI. Binomial logistic regression analysis showed that the risk factors for SSI following soft-tissue sarcoma surgery were male sex, larger skin incision diameter, larger maximum tumor diameter, presence of an open wound, and lower GNRI. Our findings indicate that malnutrition is a risk factor for SSI after soft-tissue sarcoma resection, and suggest that appropriate assessment and intervention for malnutrition may reduce the incidence of SSI.

What is driving HTA decision-making? Evidence from cancer drug reimbursement decisions from 6 European countries

BACKGROUND

Decisions on the reimbursement of the same cancer drugs are different across European countries, but empirical work on the reasons behind these differences has been scarce. The main objective of this paper is to make a methodological contribution to existing research, specifically by outlining the systematic process of analysis to address such questions and determining the factors that might lead to different drug reimbursement decisions, and to explore its application in the field of oncology.

METHODS

Reimbursement decisions on cancer drugs in six European countries (Belgium, England, Poland, Portugal, Scotland, and Sweden) between 2006 and 2014 were included in the study. A taxonomy was developed, comprising two groups of variables (system-level and product-specific) and an econometric model was specified (multilevel mixed-effects ordered probit).

RESULTS

Only one in six evaluations in the sample reach the same reimbursement recommendation. Most health system variables were not determinants of a higher or lower probability of a positive reimbursement recommendation. However, the probability of reimbursement was higher when a drug was considered cost-effective by NICE/SMC and when there was a financial Managed Entry Agreement. This work also demonstrated a possible econometric approach for analysing differences in reimbursement decisions and contributes a structured approach for collecting and preparing data for such analyses.

CONCLUSIONS

Drug reimbursement decisions can be analysed in detail along a set of factors that are related to each decision. This information is essential, not only for understanding why a particular drug is accepted in one country and not in another but also when trying to implement a new HTA system or reform an existing one. This analysis provides policy makers and stakeholders with a model that enables a better understanding of the factors that drive HTA decisions and is adaptable to answer similar questions. Moreover, the data collection limitations encountered and described in this work shed light on the need for greater accessibility and transparency in HTA systems and regarding HTA outcomes.

Validation of Different Nutritional Assessment Tools in Predicting Prognosis of Patients with Soft Tissue Spindle-Cell Sarcomas

Predicting outcomes in patients with soft tissue sarcoma (STS) is challenging. To improve these predictions, we retrospectively analyzed common nutritional assessment systems, including Glasgow prognostic score (GPS), Geriatric Nutritional Risk Index (GNRI), neutrophil–lymphocyte ratio (NLR), platelet–lymphocyte ratio (PLR), and controlling nutritional (CONUT) score against outcomes in 103 patients with STS, of whom 15 (14.6%) died within 1 year of diagnosis. GPS, GNRI, NLR, PLR, and CONUT scores significantly differed between patients who died within one year and patients who lived longer. Binomial logistic regression analysis showed that male sex, older age at diagnosis, higher GPS, higher stage, and unresectable STS were risk factors for death within a year of diagnosis. Overall survival was evaluated by Cox proportional hazards models, which correlated higher NLR, higher PLR, larger maximum diameter of tumor, higher stage, and unresectable STS with poor prognosis. We next examined prognostic factors in the 93 patients with resectable STS, and found male sex, higher GPS, and higher stage were correlated with poor prognosis in these patients. Our findings suggest that GPS, NLR, and PLR are simple predictors of outcome in patients with STS. Nutritional therapies might improve their GPS and prognosis.

When health technology assessment is confidential and experts have no power: the case of Hungary

Health technology assessment (HTA) is not simply a mechanistic technical exercise as it takes place within a specific institutional context. Yet, we know little about how this context influences the operation of HTA and its ability to influence policy and practice. We seek to demonstrate the importance of considering institutional context, using a case study of Hungary, a country that has pioneered HTA in Central and Eastern Europe. We conducted 26 in-depth, semi-structured interviews with public- and private-sector stakeholders. We found that while the HTA Department, the Hungarian HTA organisation, fulfilled its formal role envisaged in the legislation, its potential for supporting evidence-based decision-making was not fully realised given the low levels of transparency and stakeholder engagement. Further, the Department's practical influence throughout the reimbursement process was perceived as being constrained by the payer and policy-makers, as well as its own limited organisational capacity. There was also scepticism as to whether the current operational form of the HTA process delivered 'good value for money'. Nevertheless, it still had a positive impact on the development of a broader institutional HTA infrastructure in Hungary. Our findings highlight the importance of considering institutional context in analysing the HTA function within health systems.

Risk factors for bone loss in patients with rheumatoid arthritis treated with biologic disease-modifying anti-rheumatic drugs

OBJECTIVE

Osteoporosis is a complication of rheumatoid arthritis. We examined the risk factors for bone loss in rheumatoid arthritis patients receiving biological disease-modifying anti-rheumatic drugs. Lumbar spine and femoral neck bone mineral density was measured at two time points in 153 patients with rheumatoid arthritis managed with biological disease-modifying anti-rheumatic drugs. We examined patients' variables to identify risk factors for least significant reduction of bone mineral density.

RESULTS

Least significant reduction of lumbar spine bone mineral density (≤ - 2.4%) was seen in 13.1% of patients. Least significant reduction of femoral neck bone mineral density (≤ - 1.9%) was seen in 34.0% of patients. Multiple logistic regression analysis showed that a risk factor for least significant reduction of the lumbar spine was high-dose methylprednisolone use. Multiple regression analysis showed that a risk factor for least significant reduction of the femoral neck was short disease duration. Our findings showed that a risk factor for femoral neck bone mineral density reduction was a short disease duration. These findings suggest that rheumatoid arthritis patients receiving treatment with biological disease-modifying anti-rheumatic drugs may benefit from earlier osteoporosis treatments to prevent femoral neck bone loss.

Contributions and challenges for worldwide vaccine safety: The Global Advisory Committee on Vaccine Safety at 15 years

In 1999, the Global Advisory Committee on Vaccine Safety (GACVS) was established by the World Health Organization (WHO) to provide independent scientific advice on issues relating to the safety of vaccines and immunization. Fifteen years onward, we conducted a multi-faceted review to evaluate the impact, reach and challenges facing GACVS, including the role GACVS plays in informing global, regional and WHO member state vaccine policy. The methods included measures of organizational structure, citation impact, themes approached, and a discussion by previous and current members to evaluate past, present and future challenges. Given the increasing range of data sources and the deployment of many new vaccines, the Committee is facing the complex task of identifying the best available evidence for recommendations on vaccine safety. To help meet the increased demand for public transparency in decision making, GACVS-structured methodology for evidence-based decisions is evolving. GACVS also promotes best practices and capacity building for timely and accurate risk assessment; risk communications; outreach to help countries maintain and, if needed, rebuild public trust in vaccines; and advocacy for bridging the major gaps in vaccine safety capacity globally.

Using CART to Identify Thresholds and Hierarchies in the Determinants of Funding Decisions

There is much interest in understanding decision-making processes that determine funding outcomes for health interventions. We use classification and regression trees (CART) to identify cost-effectiveness thresholds and hierarchies in the determinants of funding decisions. The hierarchical structure of CART is suited to analyzing complex conditional and nonlinear relationships. Our analysis uncovered hierarchies where interventions were grouped according to their type and objective. Cost-effectiveness thresholds varied markedly depending on which group the intervention belonged to: lifestyle-type interventions with a prevention objective had an incremental cost-effectiveness threshold of $2356, suggesting that such interventions need to be close to cost saving or dominant to be funded. For lifestyle-type interventions with a treatment objective, the threshold was much higher at $37,024. Lower down the tree, intervention attributes such as the level of patient contribution and the eligibility for government reimbursement influenced the likelihood of funding within groups of similar interventions. Comparison between our CART models and previously published results demonstrated concurrence with standard regression techniques while providing additional insights regarding the role of the funding environment and the structure of decision-maker preferences.

From market access to patient access: overview of evidence-based approaches for the reimbursement and pricing of pharmaceuticals in 36 European countries

Background

Coverage decisions determining the benefit baskets of health systems have been increasingly relying on evidence regarding patient benefit and costs. Relevant structures, methodologies, and processes have especially been established for pharmaceuticals but approaches differ. The objective of this work was thus to identify institutions in a broad range of European countries (n = 36) in charge of determining the value of pharmaceuticals for pricing and reimbursement purposes and to map their decision-making process; to examine the different approaches and consider national and supranational possibilities for best practice.

Methods

Institutions were identified through websites of international networks, ministries, and published literature. Details on institutional practices were supplemented with information from institution websites and linked online sources.

Results

The type and extent of information available varied considerably across countries. Different types of public regulatory bodies are involved in pharmaceutical coverage decisions, assuming a range of responsibilities. As a rule, the assessment of scientific evidence is kept structurally separate from its appraisal. Recommendations on value are uniformly issued by specific committees within or commissioned by responsible institutions; these institutions often also act as decision-makers on reimbursement status and level or market price. While effectiveness and costs are important criteria in all countries, the latter are often considered on a case-by-case basis. In all countries, manufacturer applications, including relevant evidence, are used as one of the main sources of information for the assessment.

Conclusion

Transparency of evidence-based coverage decisions should be enhanced. International collaboration can facilitate knowledge exchange, improve efficiency of information production, and strengthen new or developing systems.

Electronic supplementary material

The online version of this article (doi:10.1186/s12961-015-0028-5) contains supplementary material, which is available to authorized users.

Concepts of 'personalization' in personalized medicine: implications for economic evaluation

CONTEXT

This study assesses if, and how, existing methods for economic evaluation are applicable to the evaluation of personalized medicine (PM) and, if not, where extension to methods may be required.

METHODS

A structured workshop was held with a predefined group of experts (n = 47), and was run using a modified nominal group technique. Workshop findings were recorded using extensive note taking, and summarized using thematic data analysis. The workshop was complemented by structured literature searches.

RESULTS

The key finding emerging from the workshop, using an economic perspective, was that two distinct, but linked, interpretations of the concept of PM exist (personalization by 'physiology' or 'preferences'). These interpretations involve specific challenges for the design and conduct of economic evaluations. Existing evaluative (extra-welfarist) frameworks were generally considered appropriate for evaluating PM. When 'personalization' is viewed as using physiological biomarkers, challenges include representing complex care pathways; representing spillover effects; meeting data requirements such as evidence on heterogeneity; and choosing appropriate time horizons for the value of further research in uncertainty analysis. When viewed as tailoring medicine to patient preferences, further work is needed regarding revealed preferences, e.g. treatment (non)adherence; stated preferences, e.g. risk interpretation and attitude; consideration of heterogeneity in preferences; and the appropriate framework (welfarism vs. extra-welfarism) to incorporate non-health benefits.

CONCLUSIONS

Ideally, economic evaluations should take account of both interpretations of PM and consider physiology and preferences. It is important for decision makers to be cognizant of the issues involved with the economic evaluation of PM to appropriately interpret the evidence and target future research funding.

Funding decisions for newborn screening: a comparative review of 22 decision processes in Europe

Decision-makers need to make choices to improve public health. Population-based newborn screening (NBS) is considered as one strategy to prevent adverse health outcomes and address rare disease patients' needs. The aim of this study was to describe key characteristics of decisions for funding new NBS programmes in Europe. We analysed past decisions using a conceptual framework. It incorporates indicators that capture the steps of decision processes by health care payers. Based on an internet survey, we compared 22 decisions for which answers among two respondents were validated for each observation. The frequencies of indicators were calculated to elicit key characteristics. All decisions resulted in positive, mostly unrestricted funding. Stakeholder participation was diverse focusing on information provision or voting. Often, decisions were not fully transparent. Assessment of NBS technologies concentrated on expert opinion, literature review and rough cost estimates. Most important appraisal criteria were effectiveness (i.e., health gain from testing for the children being screened), disease severity and availability of treatments. Some common and diverging key characteristics were identified. Although no evidence of explicit healthcare rationing was found, processes may be improved in respect of transparency and scientific rigour of assessment.