Reported barriers to evaluation in chronic care: experiences in six European countries

The co-production process of an assessment programme: Between clarifying identity and developing the quality of French-speaking Belgian community health centres

BACKGROUND

The assessment of primary care organizations is considered to be essential for improving care. However, the assessments' acceptability to professionals poses a challenge. Developing assessment programmes in collaboration with the end-users is a strategy that is widely encouraged to make interventions better targeted. By doing so, it can help to prevent resistance and encourage adherence to the assessment. This process, however, is rarely reported. This paper aims to fill this gap by describing the process of the co-production of an assessment programme for community health centres (CHCs) affiliated to the Federation of Community Health Centres (FCHC) in French-speaking Belgium.

METHODS

We conducted a documentary study on the co-production of the assessment programme before carrying out semi-structured interviews with the stakeholders involved in its development.

RESULTS

CHCs in French-speaking Belgium are increasing in number and are becoming more diverse. For the FCHC, this growth and diversification pose challenges for the meaning of CHC (an identity challenge) and what beneficiaries can expect in terms of the quality of organizations declaring themselves CHC (a quality challenge). Faced with this double challenge, the FCHC decided to develop an assessment programme, initially called Label, using participatory action research. During the co-production process, this initial programme version was abandoned in favour of a new name "DEQuaP". This new name embodies new objectives and new design regarding the assessment programme. When studying the co-production process, we attributed these changes to two controversies. The first concerns how much and which type of variety is desired among CHCs part of the FCHC. The second concerns the organization of the FCHC in its capacity as a federation. It shed light on tensions between two professional segments that, in this paper, we called "political professionalism" and "pragmatic professionalism".

CONCLUSIONS

These controversies show the importance of underlying challenges behind the development of an assessment programme for CHCs. This provided information about the evolution of the identity of multidisciplinary organizations in primary care. Issues raised in the development of this assessment programme also show the importance of considering assessment methods that reflect and embody the current realities of these organizations and the way of developing these assessment methods.

Exploring the Role of Leadership in Facilitating Change to Improve Cancer Survival: An Analysis of Experiences in Seven High Income Countries in the International Cancer Benchmarking Partnership (ICBP)

BACKGROUND

The differences in cancer survival across countries and over time are well recognised, with progress varying even among high-income countries with comparable health systems. Previous research has examined several possible explanations, but the role of leadership in systems providing cancer care has attracted little attention. As part of the International Cancer Benchmarking Partnership (ICBP), this study looked at diverse aspects of leadership to identify drivers of change and opportunities for improvement across seven high-income countries.

METHODS

Key informants in 13 jurisdictions were interviewed: Australia (2 states), Canada (3 provinces), Denmark, Ireland, New Zealand, Norway and United Kingdom (4 countries). Participants represented a range of stakeholders at different tiers of the system. They were recruited through a combination of purposive and 'snowball' strategies and participated in semi-structured telephone interviews. Interview transcripts were analysed thematically drawing on the World Health Organization (WHO) health systems framework and previous work analysing national cancer control programmes (NCCPs).

RESULTS

Several facets of leadership were perceived as important for improving outcomes. These included political leadership to initiate and maintain progress, intellectual leadership to support those engaged in local implementation of national policies and drive change, and a coherent vision from leaders at different levels of the system. Clinical leadership was also viewed as vital for translating policy into action.

CONCLUSION

Certain aspects of cancer care leadership emerged as underpinning and sustaining improvements, such as appointing a central agency, involving clinicians at every stage, ensuring strong leadership of cancer care with a consistent political mandate. Improving cancer outcomes is challenging and complex, but it is unlikely to be achieved without effective leadership, both political and clinical.

Direct and Indirect Costs Related to Physical Activity Levels in Patients with Diabetes Mellitus in Spain: A Cross-Sectional Study

Diabetes mellitus (DM) is a global public health concern. DM is importantly linked to the modern lifestyle. Lifestyle-based interventions currently represent a critical preventive and therapeutic approach for patients with DM. Increasing physical activity has proven multiple benefits to prevent this condition; however, there is still room for further progress in this field, especially in terms of the effect of exercise in patients with already established DM. This study intends to examine the economic relationship between physical activity and direct/indirect costs in patients with DM. We analyze a national representative sample (n = 1496) of the general population of Spain, using available data from the National Health Survey of 2017 (NHS 2017). Our results show that 63.7% of the sample engaged in some degree of physical activity, being more frequent in men (67.5%), younger individuals (80.0%), and those with higher educational levels (69.7%). Conversely, lower levels of physical activity were associated with female sex, older subjects, and various comorbidities. Our study estimates that 2151 € per (51% in direct costs) patient may be saved if a minimum level of physical activity is implemented, primarily, due to a decrease in indirect costs (absenteeism and presenteeism). This study shows that physical activity will bring notable savings in terms of direct and indirect costs in patients with DM, particularly in some vulnerable groups.

The economic burden of anxiety and depression on the working age population with diabetes in Spain

Diabetes mellitus (DM) is a complex, chronic, multifactorial, and costly health problem representing 8% of total public health expenditures in Spain. The objective of this study was to analyse the prevalence and costs of Anxiety (AX) and Depression (DP) in the Spanish working population with DM. Data were obtained from the National Health Survey of Spain 2017. A multivariate analysis was conducted to predict the use of resources and absenteeism/presenteeism. Direct and indirect costs were calculated. The final population analysed contained 15,822 subjects (18-65 years old). DM prevalence was 4.8%, and AX-DP 10.6% (50.5% were men). Self-diagnosed health was rated as regular, poor or very poor in 89% of DM subjects with DP-AX. The average costs estimated were €24,643.41 for DM subjects with AX-DP and €20,059.53 for those with only DM. The total estimated 2017 economic impact of DM was 2.4% of Spanish gross domestic product (13% directly related to DP-AX). Indirect costs represented 72.7% of total DP-AX costs. Spanish society is paying a considerable price for the incidence of DP-AX levels with DM in the working population. This global challenge has important repercussions for individuals' quality of life, health systems, and countries' development and economic growth.

Evaluating the Impact of the Diabetes Mellitus Strategy for the National Health System: An Interrupted Time Series Analysis

(1) Background: Diabetes mellitus is a significant public health problem. Macrovascular complications (stroke, acute myocardial infarction (AMI) and lower limb amputations (LLAs) represent the leading cause of morbi-mortality in DM. This work aims to evaluate the impact of the approval of the Diabetes Mellitus Strategy of the National Health System (SDM-NHS) on hospitalizations for those macrovascular complications related to DM; (2) Methods: Interrupted time series applying segmented regression models (Negative Binomial) adjusted for seasonality to data from hospital discharge records with a primary or secondary diagnosis of DM (code 250 ICD9MC); (3) Results: Between 2001 and 2015, there have been 7,302,750 hospital discharges with a primary or secondary diagnosis of DM. After the approval of the SDM-NHS, all the indicators showed a downward trend, modifying the previous trend in the indicators of AMI and LLA. The indicators of stroke and AMI also showed an immediate reduction in their rates; (4) Conclusions: After the approval of the SDM-NHS, an improvement has been observed in all the indicators of macrovascular complications of DM evaluated, although it is difficult to establish a causal relationship between the strategy and the effects observed. Interrupted time series is applicable for evaluating the impact of interventions in public health when experimental designs are not possible.

New Approach to Managing the COVID-19 Pandemic in a Complex Tertiary Care Medical Center in Madrid, Spain

The coronavirus disease 2019 (COVID-19) pandemic is putting health-care systems under unprecedented stress to accommodate unexpected numbers of patients forcing a quick re-organization. This article describes the staff management experience of a third level referral hospital in the city of Madrid, Spain, one of the cities and hospitals with the largest number of COVID-19 cases.A newly created COVID-19-specific clinical management unit (CMU) coordinated all clinical departments and conducted real-time assessments of the availability and needs of medical staff, alongside the hospital's general management board. The CMU was able to (i) redeploy up to 285 physicians every week to bolster medical care in COVID-19 wards and forecast medical staff requirements for the upcoming week so all departments could organize their work while coping with COVID-19 needs, (ii) overview all clinical activities conducted in a medicalized hotel, and (iii) recruit a team of roughly 90 volunteer medical students to accelerate data collection and evidence generation.The main advantage of a CMU composed by a member of every job category-its ability to generate rapid, locally adapted responses to unexpected challenges-made it perfect for the unprecedented increase in health-care need generated by the COVID-19 pandemic.

Pharmacist-led cardiovascular risk prevention in Western Canada: a qualitative study

OBJECTIVES

Preventing cardiovascular diseases (CVD) is a public health and policy priority, including for employers. A novel CVD risk management programme that included medication management was delivered by pharmacists to employees of a Canadian university. This qualitative study describes the experiences and perceptions of participants who received individual health consultations in this programme.

METHODS

A qualitative study design using free-text responses was adopted. Data (5658 words) came from evaluation surveys completed by 119 programme participants were iteratively coded and thematically analysed.

KEY FINDINGS

We identified four themes characterising participant experiences of pharmacist-led CVD prevention. Theme one was labelled self-efficacy because personalised health information and advice on CVD risk factor management empowered participants to make improvements for their health. Participants expressed a range of positive responses about the longer consultations, supportive communication and safe setting of their pharmacist-led encounters; hence, Theme two is labelled pharmacists' interpersonal skills. The wider context of the programme included a number of enabling factors (Theme three) that either supported or limited participant engagement in the programme. A number of changes to behaviour and health measures were identified and participant suggestions to expand and continue the programme further contributed to perceptions of positive programme impact (Theme four).

CONCLUSIONS

This study raises questions about how external resources and broader determinants might enable, or hinder, future programme success and sustainability. It also highlights the need for greater understanding and communication of the importance of primary prevention and the role of pharmacists in CVD risk reduction and workplace health promotion.

Population Health and Health Services: Old Challenges and New Realities in the COVID-19 Era

(1) Background: Health services that were already under pressure before the COVID-19 pandemic to maximize its impact on population health, have not only the imperative to remain resilient and sustainable and be prepared for future waves of the virus, but to take advantage of the learnings from the pandemic to re-configure and support the greatest possible improvements. (2) Methods: A review of articles published by the Special Issue on Population Health and Health Services to identify main drivers for improving the contribution of health services on population health is conducted. (3) Health services have to focus not just on providing the best care to health problems but to improve its focus on health promotion and disease prevention. (4) Conclusions: Implementing innovative but complex solutions to address the problems can hardly be achieved without a multilevel and multisectoral deliberative debate. The CHRODIS PLUS policy dialog method can help standardize policy-making procedures and improve network governance, offering a proven method to strengthen the impact of health services on population health, which in the post-COVID era is more necessary than ever.

The importance of health insurance claims data in creating learning health systems: evaluating care for high-need high-cost patients using the National Patient-Centered Clinical Research Network (PCORNet)

OBJECTIVE

Case management programs for high-need high-cost patients are spreading rapidly among health systems. PCORNet has substantial potential to support learning health systems in rapidly evaluating these programs, but access to complete patient data on health care utilization is limited as PCORNet is based on electronic health records not health insurance claims data. Because matching cases to comparison patients on baseline utilization is often a critical component of high-quality observational comparative effectiveness research for high-need high-cost patients, limited access to claims may negatively affect the quality of the matching process. We sought to determine whether the evaluation of programs for high-need high-cost patients required claims data to match cases to comparison patients.

MATERIALS AND METHODS

A retrospective cohort study design with multiple measures of before-and-after health care utilization for 1935 case management patients and 3833 matched comparison patients aged 18 years and older from 2011 to 2015. EHR and claims data were extracted from 3 health systems participating in PCORNet.

RESULTS

Without matching on claims-based health care utilization, the case management programs at 2 of 3 health systems were associated with fewer hospital admissions and emergency visits over the subsequent 12 months. With matching on claims-based health care utilization, case management was no longer associated with admissions and emergency visits at those 2 programs.

DISCUSSION

The results of a PCORNet-facilitated evaluation of 3 programs for high-need high-cost patients differed substantially depending on whether claims data were available for matching cases to comparison patients.

CONCLUSIONS

Partnering with learning health systems to rapidly evaluate programs for high-need high-cost patients will require that PCORNet facilitates comprehensive and timely access to both electronic health records and health insurance claims data.

Lessons from the Implementation of Pilot Practices to Tackle the Burden of Noncommunicable Diseases in Europe

(1) Background: The gap between research findings and their application in routine practice implies that patients and populations are not benefiting from the investment in scientific research. The objective of this work is to describe the process and main lessons obtained from the pilot practices and recommendation that have been implemented by CHRODIS-PLUS partner organizations; (2) Methods: CHRODIS-PLUS is a Joint Action funded by the European Union Health Programme that continues the work of Joint Action CHRODIS-JA. CHRODIS-PLUS has developed an Implementation Strategy that is being tested to implement innovative practices and recommendations in four main areas of action: health promotion and disease prevention, multimorbidity, fostering quality of care of patients with chronic diseases, and employment and chronic conditions; (3) Results: The Three-Stages CHRODIS-PLUS Implementation Strategy, based on a Local Implementation Working Group, has demonstrated that it can be applied for interventions and in situations and contexts of great diversity, reflecting both its validity and generalizability; (4) Conclusions: Implementation has to recognize the social dynamics associated with implementation, ensuring sympathy toward the culture and values that underpin these processes, which is a key differentiation from more linear improvement approaches.

Methodological Quality of Economic Evaluations in Integrated Care: Evidence from a Systematic Review

INTRODUCTION

The aim of this review is to systematically assess the methodological quality of economic evaluations in integrated care and to identify challenges with conducting such studies.

THEORY AND METHODS

Searches of grey-literature and scientific papers were performed, from January 2000 to December 2018. A checklist was developed to assess the quality of economic evaluations. Authors' statements of challenges encountered during their evaluations were qualitatively coded.

RESULTS

Forty-four articles were eligible for inclusion. The review found that study design, measurement of cost and outcomes, statistical analysis and presentation of data were the areas with most quality variation. Authors identified challenges mostly related to time horizon of the evaluation, inadequate or lack of comparator group, contamination bias, and a post-hoc evaluation culture.

DISCUSSION

Our review found significant differences in quality, with some studies showing poor methodological rigor; challenging conclusions on the cost-effectiveness of integrated care.

CONCLUSION

It is essential for evaluators to use best-practice standards when planning and conducting economic evaluations, in order to build a reliable evidence base for decision-making in integrated care.

Barriers to the evaluation of evidence-based public health policy

Public health policy has the potential to produce great benefits for individuals and communities. There is growing demand that such efforts be rigorously evaluated to ensure that the expected benefits are, in fact, realised. Commonly, public health policy is evaluated by consumer acceptability, reach, or changes in knowledge and attitudes. Non-robust research designs are often used. But these approaches to evaluation do not answer three critical questions: Has a change in the desired outcome occurred? Was it a consequence of the policy and not some extraneous factor? Was the size of the change considered significant and cost-effective? We, a team of government and academic scholars working in research and evaluation, have examined some of the more common impediments to robust evaluation: political impediments, a lack of investment in evaluation capacity within bureaucracy, and the failure of academic researchers to understand the need for the evaluation of public health policy.

How do health care workers manage a patient with multiple care needs from both health and social care services? - A vignette study

Introduction

To assess how health care professionals outline the management of care and explore which health or social care professionals were involved in the patient's treatment.

Methods

A survey with a patient vignette for general practitioners (n = 31) and registered nurses (n = 31) working daily in Finnish health centres located in four cities. Respondents answered structural questions and explained in detail the care process that they tailored for the patient. The care process was examined using content analysis.

Results

A physician–nurse working pair was declared to be in charge of the care process by 27% of respondents, a registered nurse by 9% and a general practitioner by 11%. However, 53% reported that no single person or working pair was in charge of the care process (response rate 72%). The concluding result of the analyses of the presented process was that both treatment practices and the professionals participating in the patient's treatment varied. Collaboration with social services was occasional, and few care processes included referrals to social services.

Conclusion

For the patient who needs both health and social care services, the management of care is a challenge. To improve the chances of patients being actively involved in making treatment plans at least three factors need to be addressed. Firstly, a written treatment plan should explicate the care process. Second, collaboration and interaction between health and social care services should be strengthened, and third, a contact person should be named to avoid care gaps in primary health care. Next-step data from patients need to be collected to get their views on care management and compare these with those from general practitioners and registered nurses.

Analysing a Chinese Regional Integrated Healthcare Organisation Reform Failure using a Complex Adaptive System Approach

Introduction:

China’s organised health system has remained outdated for decades. Current health systems in many less market-oriented countries still adhere to traditional administrative-based directives and linear planning. Furthermore, they neglect the responsiveness and feedback of institutions and professionals, which often results in reform failure in integrated care. Complex adaptive system theory (CAS) provides a new perspective and methodology for analysing the health system and policy implementation.

Methods:

We observed the typical case of Qianjiang’s Integrated Health Organization Reform (IHO) for 2 years to analyse integrated care reforms using CAS theory. Via questionnaires and interviews, we observed 32 medical institutions and 344 professionals. We compared their cooperative behaviours from both organisational and inter-professional levels between 2013 and 2015, and further investigated potential reasons for why medical institutions and professionals did not form an effective IHO. We discovered how interested parties in the policy implementation process influenced reform outcome, and by theoretical induction, proposed a new semi-organised system and corresponding policy analysis flowchart that potentially suits the actual realisation of CAS.

Results:

The reform did not achieve its desired effect. The Qianjiang IHO was loosely integrated rather than closely integrated, and the cooperation levels between organisations and professionals were low. This disappointing result was due to low mutual trust among IHO members, with the main contributing factors being insufficient financial incentives and the lack of a common vision.

Discussion and Conclusions:

The traditional organised health system is old-fashioned. Rather than being completely organised or adaptive, the health system is currently more similar to a semi-organised system. Medical institutions and professionals operate in a middle ground between complete adherence to administrative orders from state-run health systems and completely adapting to the market. Thus, decision-making, implementation and analysis of health policies should also be updated according to this current standing. The simplest way to manage this new system is to abandon linear top-down orders and patiently wait for an explicit picture of IHO mechanisms to be revealed after complete and spontaneous negotiation between IHO allies is reached. In the meantime, bottom-up feedback from members should be paid attention to, and common benefits and fluid information flow should be prioritised in building a successful IHO.

Performing Economic Evaluation of Integrated Care: Highway to Hell or Stairway to Heaven?

Health economists are increasingly interested in integrated care in order to support decision-makers to find cost-effective solutions able to tackle the threat that chronic diseases pose on population health and health and social care budgets. However, economic evaluation in integrated care is still in its early years, facing several difficulties. The aim of this paper is to describe the unique nature of integrated care as a topic for economic evaluation, explore the obstacles to perform economic evaluation, discuss methods and techniques that can be used to address them, and set the basis to develop a research agenda for health economics in integrated care. The paper joins the voices that call health economists to pay more attention to integrated care and argues that there should be no more time wasted for doing it.

Cost-Effectiveness of Disease Management Programs for Cardiovascular Risk and COPD in The Netherlands

BACKGROUND

Disease management programs (DMPs) for cardiovascular risk (CVR) and chronic obstructive pulmonary disease (COPD) are increasingly implemented in The Netherlands to improve care and patient's health behavior.

OBJECTIVE

The aim of this study was to provide evidence about the (cost-) effectiveness of Dutch DMPs as implemented in daily practice.

METHODS

We compared the physical activity, smoking status, quality-adjusted life-years, and yearly costs per patient between the most and the least comprehensive DMPs in four disease categories: primary CVR prevention, secondary CVR prevention, both types of CVR prevention, and COPD (N = 1034). Propensity score matching increased comparability between DMPs. A 2-year cost-utility analysis was performed from the health care and societal perspectives. Sensitivity analysis was performed to estimate the impact of DMP development and implementation costs on cost-effectiveness.

RESULTS

Patients in the most comprehensive DMPs increased their physical activity more (except for primary CVR prevention) and had higher smoking cessation rates. The incremental QALYs ranged from -0.032 to 0.038 across all diseases. From a societal perspective, the most comprehensive DMPs decreased costs in primary CVR prevention (certainty 57%), secondary CVR prevention (certainty 88%), and both types of CVR prevention (certainty 98%). Moreover, the implementation of comprehensive DMPs led to QALY gains in secondary CVR prevention (certainty 92%) and COPD (certainty 69%).

CONCLUSIONS

The most comprehensive DMPs for CVR and COPD have the potential to be cost saving, effective, or cost-effective compared with the least comprehensive DMPs. The challenge for Dutch stakeholders is to find the optimal mixture of interventions that is most suited for each target group.

Readiness to tackle chronicity in Spanish health care organisations: a two-year experience with the Instrumento de Evaluación de Modelos de Atención ante la Cronicidad/Assessment of Readiness for Chronicity in Health Care Organisations instrument

INTRODUCTION

The Instrumento de Evaluación de Modelos de Atención ante la Cronicidad/Assessment of Readiness for Chronicity in Health Care Organisations instrument was developed to implement the conceptual framework of the Chronic Care Model in the Spanish national health system. It has been used to assess readiness to tackle chronicity in health care organisations. In this study, we use self-assessments at macro-, meso- and micro-management levels to (a) describe the two-year experience with the Instrumento de Evaluación de Modelos de Atención ante la Cronicidad/Assessment of Readiness for Chronicity in Health Care Organisations tool in Spain and (b) assess the validity and reliability of this instrument.

METHODS

The results from 55 organisational self-assessments were included and described. In addition to that, the internal consistency, reliability and construct validity of Instrumento de Evaluación de Modelos de Atención ante la Cronicidad/Assessment of Readiness for Chronicity in Health Care Organisations were examined using Cronbach's alpha, the Spearman-Brown coefficient and factorial analysis.

RESULTS

The obtained scores reflect opportunities for improvement in all dimensions of the instrument. Cronbach's alpha ranged between 0.90 and 0.95 and the Spearman-Brown coefficient ranged between 0.77 and 0.94. All 27 components converged in a second-order factorial solution that explained 53.8% of the total variance, with factorial saturations for the components of between 0.57 and 0.94.

CONCLUSIONS

Instrumento de Evaluación de Modelos de Atención ante la Cronicidad/Assessment of Readiness for Chronicity in Health Care Organisations is an instrument that allows health care organisations to perform self-assessments regarding their readiness to tackle chronicity and to identify areas for improvement in chronic care.

Does the Belgian diabetes type 2 care trajectory improve quality of care for diabetes patients?

BACKGROUND

The Belgian care trajectory (CT) for diabetes mellitus type 2 (T2DM), implemented in September 2009, aims at providing integrated, evidence-based, multidisciplinary patient- centred care, based on the chronic care model. The research project ACHIL (Ambulatory Care Health Information Laboratory) studied the adherence of CT patients, in the early phases of CT programme implementation, with CT obligations, their uptake of incentives for self-management, whether the CT programme was targeting the appropriate group of patients, how care processes for these patients evolved over time and whether CT start led to better quality in the processes and outcomes of care.

METHODS

This observational study took place in the period 2006-2011 and covered T2DM patients who started a CT between 01/09/2009 and 31/12/2011. Four data sources were used: outcome data, from electronic patient records (EPRs) on all CT patients, provided by general practitioners (GPs); reimbursement process data on all CT patients and clinically comparable patients; and data from a sample of CT patients and clinically comparable patients from an EPR-based regional GP network and a paper-based national GP network, respectively. Through multilevel analysis of cross-sectional and longitudinal data, the effect of CT inclusion on processes and outcome was estimated, controlling for potential confounders.

RESULTS

By the end of 2011, data on 18,250 CT patients had been collected. Approximately 50 % of these CT patients had received reimbursement for a glucometer and nearly 60 % had had at least one encounter with a diabetes educator. The CT programme recruited T2DM patients who had been difficult to control in the past. In the years prior to CT start, there had been a gradual improvement in the follow up of these patients. Moreover, compared to non-CT patients, the proportion of CT patients adhering to the recommended frequency for monitoring of parameters, such as HbA1c, increased significantly around CT start. Some data sources, albeit not all, suggested there had been an improvement in certain outcomes, such as HbA1c, after CT inclusion.

CONCLUSIONS

According to this study, CT enrolment is associated with better quality of care processes compared to non-CT patients. This improvement was found in several of the data sources used in this study. However, results on outcome parameters remain inconclusive.

Meso level influences on long term condition self-management: stakeholder accounts of commonalities and differences across six European countries

BACKGROUND

European countries are increasingly adopting systems of self -care support (SMS) for long term conditions which focus on enhancing individual, competencies, skills, behaviour and lifestyle changes. To date the focus of policy for engendering greater self- management in the population has been focused in the main on the actions and motivations of individuals. Less attention has been paid to how the broader influences relevant to SMS policy and practice such as those related to food production, distribution and consumption and the structural aspects and economics relating to physical exercise and governance of health care delivery systems might be implicated in the populations ability to self- manage. This study aimed to identify key informants operating with knowledge of both policy and practice related to SMS in order to explore how these influences are seen to impact on the self-management support environment for diabetes type 2.

METHODS

Ninety semi-structured interviews were conducted with key stakeholder informants in Bulgaria, Spain, Greece, Norway, Netherlands and UK. Interviews were transcribed and analysed using thematic and textual analysis.

RESULTS

Stakeholders in the six countries identified a range of influences which shaped diabetes self-management (SM). The infrastructure and culture for supporting self- management practice is viewed as driven by political decision-makers, the socio-economic and policy environment, and the ethos and delivery of chronic illness management in formal health care systems. Three key themes emerged during the analysis of data. These were 1) social environmental influences on diabetes self-management 2) reluctance or inability of policy makers to regulate processes and environments related to chronic illness management 3) the focus of healthcare system governance and gaps in provision of self-management support (SMS). Nuances in the salience and content of these themes between partner countries related to the presence and articulation of dedicated prevention and self- management policies, behavioural interventions in primary care, drug company involvement and the impact of measures resulting from economic crises, and differences between countries with higher versus lower social welfare support and public spending on shaping illness management.

CONCLUSIONS

The results suggest reasons for giving increasing prominence to meso level influences as a means of rebalancing and improving the effectiveness of implementing an agenda for SMS. There is a need to acknowledge the greater economic and policy challenging environment operating in some countries which act as a source of inequality between countries in addressing SMS for chronic illness management and impacts on people's capacity to undertake self-care activities.

The underlying challenges of coordination of chronic care across Europe

An effective response to the rising burden of chronic disease requires a health system environment that is conducive to implementing structured, integrated approaches to chronic disease prevention and management. This study presents some of the reported factors hindering the successful implementation of chronic care approaches in six European healthcare systems and focuses on processes to address these. We conducted 42 semi-structured interviews with key informants in Austria, Denmark, France, Germany, The Netherlands and Spain, representing the decision-maker, payer, provider and/or patient perspective. Despite differences among the healthcare systems studied, a shared set of barriers emerged. These included: (i) a continued focus on complications management and a failure to integrate risk minimisation and disease prevention along the spectrum of care; (ii) care fragmentation acting as a barrier to better coordination; (iii) a mismatch between intent, at national level, to enhance coordination and integration, and ability at regional or local level to translate these ambitions into practice; and (iv) a lack of structures suitable to promote proactive engagement with patients in the management of their own condition. Findings suggest successful implementation of chronic care across Europe will require cross-disciplinary collaboration, raising the profile of general practitioners and nurses, designing care explicitly around the needs of the patient, and the political will to carry forward these chronic care measures.

Evaluating chronic disease management in real-world settings in six European countries: Lessons from the collaborative DISMEVAL project

Objective

To describe the interventions, research methods and main findings of the international DISMEVAL project, in which the “real-world” impact of exemplary European disease management approaches was investigated in six countries using advanced analytic techniques.

Design

Across countries, the project captured a wide range of disease management strategies and settings; approaches to evaluation varied per country, but included, among others, difference-in-differences analysis and regression discontinuity analysis.

Setting

Austria, Denmark, France, Germany, The Netherlands, and Spain.

Participants

Health care providers and/or statutory insurance funds providing routine data from their disease management interventions, mostly retrospectively.

Intervention(s)

This study did not carry out an intervention but evaluated the impact of existing disease management interventions implemented in European care settings.

Main outcome measure(s)

Outcome measures were largely dependent on available routine data, but could concern health care structures, processes, and outcomes.

Results

Data covering 10 to 36 months were gathered concerning more than 154,000 patients with three conditions. The analyses demonstrated considerable positive effects of disease management on process quality (Austria, Germany), but no more than moderate improvements in intermediate health outcomes (Austria, France, Netherlands, Spain) or disease progression (Denmark) in intervention patients, where possible compared with a matched control group.

Conclusions

Assessing the “real-world” impact of chronic disease management remains a challenge. In settings where randomization is not possible and/or desirable, routine health care performance data can provide a valuable resource for practice-based evaluations using advanced analytic techniques.

Changes in costs and effects after the implementation of disease management programs in the Netherlands: variability and determinants

OBJECTIVES

The aim of the study was to investigate the changes in costs and outcomes after the implementation of various disease management programs (DMPs), to identify their potential determinants, and to compare the costs and outcomes of different DMPs.

METHODS

We investigated the 1-year changes in costs and effects of 1,322 patients in 16 DMPs for cardiovascular risk (CVR), chronic obstructive pulmonary disease (COPD), and diabetes mellitus (DMII) in the Netherlands. We also explored the within-DMP predictors of these changes. Finally, a cost-utility analysis was performed from the healthcare and societal perspective comparing the most and the least effective DMP within each disease category.

RESULTS

This study showed wide variation in development and implementation costs between DMPs (range:€16;€1,709) and highlighted the importance of economies of scale. Changes in health care utilization costs were not statistically significant. DMPs were associated with improvements in integration of CVR care (0.10 PACIC units), physical activity (+0.34 week-days) and smoking cessation (8% less smokers) in all diseases. Since an increase in physical activity and in self-efficacy were predictive of an improvement in quality-of-life, DMPs that aim to improve these are more likely to be effective. When comparing the most with the least effective DMP in a disease category, the vast majority of bootstrap replications (range:73%;97) pointed to cost savings, except for COPD (21%). QALY gains were small (range:0.003;+0.013) and surrounded by great uncertainty.

CONCLUSIONS

After one year we have found indications of improvements in level of integrated care for CVR patients and lifestyle indicators for all diseases, but in none of the diseases we have found indications of cost savings due to DMPs. However, it is likely that it takes more time before the improvements in care lead to reductions in complications and hospitalizations.

Evaluating structured care for diabetes: can calibration on margins help to avoid overestimation of the benefits? An illustration from French diabetes provider networks using data from the ENTRED Survey

OBJECTIVE

While there is growing evidence on the effectiveness of structured care for diabetic patients in trial settings, standard population level evaluations may misestimate intervention benefits due to patient selection. In order to account for potential biases in measuring intervention benefits, we tested the impact of calibration on margins as a novel adjustment method in an evaluation context compared with simple poststratification.

RESEARCH DESIGN AND METHODS

We compared the results of a before-after evaluation on HbA1c levels after 1 year of enrollment in a French diabetes provider network (DPN) using an unadjusted sample and samples adjusted by simple poststratification to results obtained after adjustment via calibration on margins to the general diabetic population's characteristics using a national cross-sectional sample of diabetic patients.

RESULTS

Both with and without adjustment, patients in the DPN had significantly lower HbA1c levels after 1 year of enrollment. However, the reductions in HbA1c levels among the adjusted samples were 22-183% lower than those measured in the unadjusted sample, regardless of the poststratification method and characteristics used. Compared with simple poststratification, estimations using calibration on margins exhibited higher performance.

CONCLUSIONS

Evaluations of diabetes management interventions based on uncontrolled before-after experiments may overestimate the actual benefit for patients. This can be corrected by using poststratification approaches when data on the ultimate target population for the intervention are available. In order to more accurately estimate the effect an intervention would have if extended to the target population, calibration on margins seems to be preferable over simple poststratification in terms of performance and usability.