Introduction of new technologies and decision making processes: a framework to adapt a Local Health Technology Decision Support Program for other local settings

Synthesis of relevant information around non-core domains to support Multi-Criteria Decision Analysis (MCDA) for decision making

Countries fundamentally base macro and micro decision making in the field of health on economic considerations, the budgetary impact of technologies being a major criterion. Nevertheless, the value of the technology of interest and its dimensions are more complex if we seek to take decisions based on the value itself. The use of structured and explicit approaches that require the assessment of multiple criteria that reflect the dimensions of this value may significantly improve the quality of the decision making. Multi-criteria decision analysis (MCDA) is a complementary decision-making tool that is able to systematically incorporate dimensions or domains such as ethical, organisational, legal, environmental and social considerations, as well as costs and benefits of medical interventions, together with the distinct perspectives of the interested parties. The objective of this article is to propose the implementation of analysis of non-core domains, in reports of Health Technology Assessment (HTA) agencies/units. To assess the scientific evidence on MCDA techniques a systematic review was conducted using structured searches in biomedical databases and websites of various HTA organisations. A consensus group was held using the nominal group technique and involving users of healthcare services, providers, managers and academics. Complementary, a survey was sent to HTA agencies to ascertain the degree of implementation of MCDA in their methods. 42 articles reporting the use of non-core criteria for the assessment of health technologies were included in the analysis. From these articles, a total of 216 non-core criteria were retrieved and categorised into domains by the researchers, and of these, 56 were classified as socioeconomic, 59 as organisational, 10 as legal, 8 as environmental and 47 as ethical, while 36 were considered to relate to other domains. The consensus group, based on the 216 non-core criteria obtained from the systematic review, proposed, and defined 26 criteria that participants considered necessary for decision making in healthcare. The consensus group did not consider that any of the domains should be given more weight than others or that any individual criteria should dominate. These approaches can serve as a framework of reference for a well-structured systematic discussion concerning the basis of individual criteria and the evidence supporting them.

Early practice of use of video consultations in rehabilitation of hand injuries in children and adults: Content, acceptability, and cost-effectiveness

BACKGROUND

Video consultation was implemented as a new service in a hospital hand therapy setting.

PURPOSE

To describe the first year's practice of video consultations in the rehabilitation of upper extremity injuries, evaluate the acceptability, and investigate economic effects.

STUDY DESIGN

Iterative design including economic evaluation.

METHODS

Using the framework early health technology assessment, 13 hand therapists described characteristics of 99 video consultations, under predefined headlines: the patients' municipally, adult vs child, time use, technical, content, and usefulness compared to physical consultations. The text was coded and categorized according to 22 techniques or tools used by hand therapists, and challenges were identified. Acceptability was assessed on a three-graded adjectival scale. To illustrate the costs associated with video vs physical consultations, we drafted different scenarios based on the data and stakeholder insights.

RESULTS

Of 99 planned video consultations (16 with children), 88 were completed. Techniques or tools most frequently used were the performance of exercises (n = 55), orthoses (n = 26), and daily activities (n = 23). Technical challenges were common, and observation of children could be difficult. Eleven of the completed consultations were rated as not acceptable and 77 as acceptable and as either useful (n = 28) or very useful (n = 49). Four drafted scenarios showed cost savings of video consultations for the health institution and society, highest at longer travel distances and in other cases where the patient could claim refunds related to travel and time away from work and home.

CONCLUSIONS

The results show therapeutic possibilities and points to areas for improvements and illustrate settings where the use of video may save costs for the health institution and society.

Understanding innovation of health technology assessment methods: the IHTAM framework

Adequate methods are urgently needed to guarantee the good practice of health technology assessment (HTA) for technologies with novel properties. The aim of the study was to construct a conceptual framework to help understand the innovation of HTA methods (IHTAM). The construction of the IHTAM framework was based on two scoping reviews, one on the current practice of innovating methods, that is existing HTA frameworks, and one on theoretical foundations for innovating methods outside the HTA discipline. Both aimed to identify and synthesize concepts of innovation (i.e., innovation processes and roles of stakeholders in innovation). Using these concepts, the framework was developed in iterative brainstorming sessions and subsequent discussions with representatives from various stakeholder groups. The framework was constructed based on twenty documents on innovating HTA frameworks and fourteen guidelines from three scientific disciplines. It includes a generic innovation process consisting of three phases (“Identification,” “Development,” and “Implementation”) and nine subphases. In the framework, three roles that HTA stakeholders can play in innovation (“Developers,” “Practitioners,” and “Beneficiaries”) are defined, and a process on how the stakeholders innovate HTA methods is included. The IHTAM framework visualizes systematically which elements and stakeholders are important to the development and implementation of novel HTA methods. The framework could be used by all stakeholders involved in HTA innovation to learn how to engage dynamically and collaborate effectively throughout the innovation process. HTA stakeholders in practice have welcomed the framework, though additional testing of its applicability and acceptance is essential.

A Web-Based Communication Platform to Improve Home Care Services in Norway (DigiHelse): Pilot Study

Background

Home care service in Norway is struggling to meet the increasing demand for health care under restricted budget constraints, although one-fourth of municipal budgets are dedicated to health services. The integration of Web-based technology in at-home care is expected to enhance communication and patient involvement, increase efficiency and reduce cost. DigiHelse is a Web-based platform designed to reinforce home care service in Norway and is currently undergoing a development process to meet the predefined needs of the country’s municipalities. Some of the main features of the platform are digital messages between residents and the home care service, highlighting information on planned and completed visits, the opportunity to cancel visits, and notifications for completed visits.

Objective

This study aimed to test the usability and economic feasibility of adopting DigiHelse in four districts in Oslo by applying registry and behavioral data collected throughout a one-year pilot study. Early health technology assessment was used to estimate the potential future value of DigiHelse, including the predictive value of behavior data.

Methods

Outcome measures identified by stakeholder insights and scenario drafting in the project’s concept phase were used to assess potential socioeconomic benefits. Aggregated data were collected to assess changes in health consumption at baseline, and then 15 and 52 weeks after DigiHelse was implemented. The present value calculation was updated with data from four intervention groups and one control group. A quasi-experimental difference-in-difference design was applied to estimate the causal effect. Descriptive behavioral data from the digital platform was applied to assess the usability of the platform.

Results

Over the total study period (52 weeks), rates increased for all outcome estimates: the number of visits (rate ratio=1.04; P=.10), unnecessary trips (rate ratio=1.37; P=.26), and phone calls (rate ratio=1.24; P=.08). A significant gap was found between the estimated value of DigiHelse in the concept phase and after the one-year pilot. In the present pilot assessment, costs are expected to exceed potential savings by €67 million (US $75 million) over ten years, as compared to the corresponding concept estimates of a potential gain of €172.6 million (US $193.6 million). Interestingly, behavioral data from the digital platform revealed that only 3.55% (121/3405) of recipients actively used the platform after one year.

Conclusions

Behavioral data provides a valuable source for assessing usability. In this pilot study, the low adoption rate may, at least in part, explain the inability of DigiHelse to perform as expected. This study points to an early assessment of behavioral data as an opportunity to identify inefficiencies and direct digital development. For DigiHelse, insight into why the recipients in Oslo have not made greater use of the Web-based platform seems to be the next step in ensuring the right improvement measures for the home care service.

Sustainability in Health care by Allocating Resources Effectively (SHARE) 9: conceptualising disinvestment in the local healthcare setting

BACKGROUND

This is the ninth in a series of papers reporting a program of Sustainability in Health care by Allocating Resources Effectively (SHARE) in a local healthcare setting. The disinvestment literature has broadened considerably over the past decade; however there is a significant gap regarding systematic, integrated, organisation-wide approaches. This debate paper presents a discussion of the conceptual aspects of disinvestment from the local perspective.

DISCUSSION

Four themes are discussed: Terminology and concepts, Motivation and purpose, Relationships with other healthcare improvement paradigms, and Challenges to disinvestment. There are multiple definitions for disinvestment, multiple concepts underpin the definitions and multiple alternative terms convey these concepts; some definitions overlap and some are mutually exclusive; and there are systematic discrepancies in use between the research and practice settings. Many authors suggest that the term 'disinvestment' should be avoided due to perceived negative connotations and propose that the concept be considered alongside investment in the context of all resource allocation decisions and approached from the perspective of optimising health care. This may provide motivation for change, reduce disincentives and avoid some of the ethical dilemmas inherent in other disinvestment approaches. The impetus and rationale for disinvestment activities are likely to affect all aspects of the process from identification and prioritisation through to implementation and evaluation but have not been widely discussed. A need for mechanisms, frameworks, methods and tools for disinvestment is reported. However there are several health improvement paradigms with mature frameworks and validated methods and tools that are widely-used and well-accepted in local health services that already undertake disinvestment-type activities and could be expanded and built upon. The nature of disinvestment brings some particular challenges for policy-makers, managers, health professionals and researchers. There is little evidence of successful implementation of 'disinvestment' projects in the local setting, however initiatives to remove or replace technologies and practices have been successfully achieved through evidence-based practice, quality and safety activities, and health service improvement programs.

CONCLUSIONS

These findings suggest that the construct of 'disinvestment' may be problematic at the local level. A new definition and two potential approaches to disinvestment are proposed to stimulate further research and discussion.

Sustainability in health care by allocating resources effectively (SHARE) 3: examining how resource allocation decisions are made, implemented and evaluated in a local healthcare setting

Background

This is the third in a series of papers reporting a program of Sustainability in Health care by Allocating Resources Effectively (SHARE) in a local healthcare setting. Leaders in a large Australian health service planned to establish an organisation-wide, systematic, integrated, evidence-based approach to disinvestment. In order to introduce new systems and processes for disinvestment into existing decision-making infrastructure, we aimed to understand where, how and by whom resource allocation decisions were made, implemented and evaluated. We also sought the knowledge and experience of staff regarding previous disinvestment activities.

Methods

Structured interviews, workshops and document analysis were used to collect information from multiple sources in an environmental scan of decision-making systems and processes. Findings were synthesised using a theoretical framework.

Results

Sixty-eight respondents participated in interviews and workshops. Eight components in the process of resource allocation were identified: Governance, Administration, Stakeholder engagement, Resources, Decision-making, Implementation, Evaluation and, where appropriate, Reinvestment of savings. Elements of structure and practice for each component are described and a new framework was developed to capture the relationships between them. A range of decision-makers, decision-making settings, type and scope of decisions, criteria used, and strengths, weaknesses, barriers and enablers are outlined. The term ‘disinvestment’ was not used in health service decision-making. Previous projects that involved removal, reduction or restriction of current practices were driven by quality and safety issues, evidence-based practice or a need to find resource savings and not by initiatives where the primary aim was to disinvest. Measuring resource savings is difficult, in some situations impossible. Savings are often only theoretical as resources released may be utilised immediately by patients waiting for beds, clinic appointments or surgery. Decision-making systems and processes for resource allocation are more complex than assumed in previous studies.

Conclusion

There is a wide range of decision-makers, settings, scope and type of decisions, and criteria used for allocating resources within a single institution. To our knowledge, this is the first paper to report this level of detail and to introduce eight components of the resource allocation process identified within a local health service.

Electronic supplementary material

The online version of this article (doi:10.1186/s12913-017-2207-2) contains supplementary material, which is available to authorized users.

Planned and ongoing projects (pop) database: development and results

OBJECTIVES

The aim of this study was to present the development, structure and results of a database on planned and ongoing health technology assessment (HTA) projects (POP Database) in Europe.

METHODS

The POP Database (POP DB) was set up in an iterative process from a basic Excel sheet to a multifunctional electronic online database. The functionalities, such as the search terminology, the procedures to fill and update the database, the access rules to enter the database, as well as the maintenance roles, were defined in a multistep participatory feedback loop with EUnetHTA Partners.

RESULTS

The POP Database has become an online database that hosts not only the titles and MeSH categorizations, but also some basic information on status and contact details about the listed projects of EUnetHTA Partners. Currently, it stores more than 1,200 planned, ongoing or recently published projects of forty-three EUnetHTA Partners from twenty-four countries. Because the POP Database aims to facilitate collaboration, it also provides a matching system to assist in identifying similar projects. Overall, more than 10 percent of the projects in the database are identical both in terms of pathology (indication or disease) and technology (drug, medical device, intervention). In addition, approximately 30 percent of the projects are similar, meaning that they have at least some overlap in content.

CONCLUSIONS

Although the POP DB is successful concerning regular updates of most national HTA agencies within EUnetHTA, little is known about its actual effects on collaborations in Europe. Moreover, many non-nationally nominated HTA producing agencies neither have access to the POP DB nor can share their projects.

The role of health technology assessment bodies in shaping drug development

The use of health technology assessment (HTA) to inform policy-making is established in most developed countries. Compared to licensing agencies, HTA agencies have different interests and, therefore, different evidence requirements. Criteria for coverage or reimbursement decisions on pharmaceutical compounds vary; however, it is common to include, as part of the HTA, a comparative effectiveness evaluation. This type of clinical data might go beyond that required for market authorization, thus creating an additional evidence gap between the regulatory and the reimbursement submission. The relevance of submissions to HTA agencies is consistently increasing in a pharmaceutical company’s perspective, as market prospects are strongly influenced by third-party payers’ coverage. In this study, we aim to describe current HTA activities with a potential impact throughout the drug development process of pharmaceuticals, with a comparative emphasis on the systems in place in Italy and in the UK. Based on an extensive literature and website review, we identified three major classes of HTA activities, beyond mainstream HTA, with the potential to influence the drug development program: 1) horizon scanning and early HTA; 2) bipartite and tripartite early dialogue between manufacturers, regulators, and HTA assessors; and 3) managed market entry agreements. From early stages of clinical research up to postauthorization studies, there is a trend toward increased collaboration between parties, anticipation of market access evidence collection, and postmarketing risk-sharing. Heterogeneity of HTA practices increases the complexity of the market access environment. Overall, there are signals that market access departments are gaining importance in the pharmaceutical companies, but there is still a lack of evidence and reporting on how the increasing relevance of HTA has reshaped the way clinical development is designed and managed.