European value-based healthcare benchmarking: moving from theory to practice

BACKGROUND

Value-based healthcare (VBHC) is a conceptual framework to improve the value of healthcare by health, care-process and economic outcomes. Benchmarking should provide useful information to identify best practices and therefore a good instrument to improve quality across healthcare organizations. This paper aims to provide a proof-of-concept of the feasibility of an international VBHC benchmarking in breast cancer, with the ultimate aim of being used to share best practices with a data-driven approach among healthcare organizations from different health systems.

METHODS

In the VOICE community-a European healthcare centre cluster intending to address VBHC from theory to practice-information on patient-reported, clinical-related, care-process-related and economic-related outcomes were collected. Patient archetypes were identified using clustering techniques and an indicator set following a modified Delphi was defined. Benchmarking was performed using regression models controlling for patient archetypes and socio-demographic characteristics.

RESULTS

Six hundred and ninety patients from six healthcare centres were included. A set of 50 health, care-process and economic indicators was distilled for benchmarking. Statistically significant differences across sites have been found in most health outcomes, half of the care-process indicators, and all economic indicators, allowing for identifying the best and worst performers.

CONCLUSIONS

To the best of our knowledge, this is the first international experience providing evidence to be used with VBHC benchmarking intention. Differences in indicators across healthcare centres should be used to identify best practices and improve healthcare quality following further research. Applied methods might help to move forward with VBHC benchmarking in other medical conditions.

Assessment of the Effectiveness, Socio-Economic Impact and Implementation of a Digital Solution for Patients with Advanced Chronic Diseases: The ADLIFE Study Protocol

Due to population ageing and medical advances, people with advanced chronic diseases (ACD) live longer. Such patients are even more likely to face either temporary or permanent reduced functional reserve, which typically further increases their healthcare resource use and the burden of care on their caregiver(s). Accordingly, these patients and their caregiver(s) may benefit from integrated supportive care provided via digitally supported interventions. This approach may either maintain or improve their quality of life, increase their independence, and optimize the healthcare resource use from early stages. ADLIFE is an EU-funded project, aiming to improve the quality of life of older people with ACD by providing integrated personalized care via a digitally enabled toolbox. Indeed, the ADLIFE toolbox is a digital solution which provides patients, caregivers, and health professionals with digitally enabled, integrated, and personalized care, supporting clinical decisions, and encouraging independence and self-management. Here we present the protocol of the ADLIFE study, which is designed to provide robust scientific evidence on the assessment of the effectiveness, socio-economic, implementation, and technology acceptance aspects of the ADLIFE intervention compared to the current standard of care (SoC) when applied in real-life settings of seven different pilot sites across six countries. A quasi-experimental trial following a multicenter, non-randomized, non-concurrent, unblinded, and controlled design will be implemented. Patients in the intervention group will receive the ADLIFE intervention, while patients in the control group will receive SoC. The assessment of the ADLIFE intervention will be conducted using a mixed-methods approach.

Estimation of the epidemiology of dementia and associated neuropsychiatric symptoms by applying machine learning to real-world data

INTRODUCTION

Incidence rates of dementia-related neuropsychiatric symptoms (NPS) are not known and this hampers the assessment of their population burden. The objective of this study was to obtain an approximate estimate of the population incidence and prevalence of both dementia and NPS.

METHODS

Given the dynamic nature of the population with dementia, a retrospective study was conducted within the database of the Basque Health Service (real-world data) at the beginning and end of 2019. Validated random forest models were used to identify separately depressive and psychotic clusters according to their presence in the electronic health records of all patients diagnosed with dementia.

RESULTS

Among the 631,949 individuals over 60 years registered, 28,563 were diagnosed with dementia, of whom 15,828 (55.4%) showed psychotic symptoms and 19,461 (68.1%) depressive symptoms. The incidence of dementia in 2019 was 6.8/1000 person-years. Most incident cases of depressive (72.3%) and psychotic (51.9%) NPS occurred in cases of incident dementia. The risk of depressive-type NPS grows with years since dementia diagnosis, living in a nursing home, and female sex, but falls with older age. In the psychotic cluster model, the effects of male sex, and older age are inverted, both increasing the probability of this type of symptoms.

CONCLUSIONS

The stigmatization factor conditions the social and attitudinal environment, delaying the diagnosis of dementia, preventing patients from receiving adequate care and exacerbating families' suffering. This study evidences the synergy between big data and real-world data for psychiatric epidemiological research.

Quality of life in patients with nonvalvular atrial fibrillation treated with oral anticoagulants

OBJECTIVES

Health-related quality of life (HRQL) is a key factor in making anticoagulant treatment decisions. The objective of this study was to assess the HRQL of patients with nonvalvular atrial fibrillation by treatment type: direct oral anticoagulants (DOACs) or vitamin K antagonists (VKAs).

METHODS

We carried out a cross-sectional observational study with clinical practice data, gathering demographic and clinical variables. HRQL was measured using the 5-level 5-dimension EuroQol questionnaire (EQ-5D-5L). Differences between the study groups in HRQL as measured by the EQ-5D-5L were analyzed using two-part multivariate regression models. First, using logistic regression, the adjusted probability, p(x), of having perfect health was estimated in each subgroup. Secondly, generalized linear models were used to estimate mean disutility values, w(x), in a population that does not have perfect health, i.e. utility less than 1 or 1-w(x).

RESULTS

We recruited 333 patients, of whom 126 were on DOACs and 207 on VKAs. A significant difference was observed in the EQ-5D-5L anxiety/depression dimension, with a higher percentage of patients classified in the 'no problems' category in the DOAC group. The same type of analysis did not identify significant differences in any of the other dimensions (mobility, self-care, usual activities or pain/discomfort).

DISCUSSION

In the multivariate model, utility was significantly higher in the DOAC group than in the VKA group, although the difference was small (0.0121). This difference is attributable to patients on DOACs having less anxiety/depression.

CONCLUSION

Patients treated with DOACs report a slightly better quality of life than those treated with VKAs.

Stratified cost-utility analysis of total hip arthroplasty in displaced femoral neck fracture

OBJECTIVE

To conduct a stratified cost-utility analysis of total versus partial hip arthroplasty as a function of clinical subtype.

METHOD

All cases of this type of intervention were analysed between 2010 and 2016 in the Basque Health Service, gathering data on clinical outcomes and resource use to calculate the cost and utility in quality-adjusted life years (QALYs) at individual level. The statistical analysis included applying the propensity score to balance the groups, and seemingly unrelated regression models to calculate the incremental cost-utility ratio and plot the cost-effectiveness plane. The interaction between age group and American Society of Anesthesiologists (ASA) risk class was assessed in the multivariate analysis.

RESULTS

The study identified 5867 patients diagnosed with femoral neck fracture, of whom 1307 and 4560 were treated with total and partial hip arthroplasty, respectively. In the cost-utility analysis based on the seemingly unrelated regression, total hip arthroplasty was found to have a higher cost and higher utility (2465€ and 0.42 QALYs). Considering a willingness-to-pay threshold of €22,000 per QALY, total hip arthroplasty was cost-effective in the under-80-year-old subgroup. Among patients above this age, hemiarthroplasty was cost-effective in ASA class I-II patients and dominant in ASA class III-IV patients.

CONCLUSIONS

Subgroup analysis supports current daily clinical practice in displaced femoral neck fractures, namely, using partial replacement in most patients and reserving total replacement for younger patients.

Estimation of the epidemiology of dementia and associated neuropsychiatric symptoms by applying machine learning to real-world data

INTRODUCTION

Incidence rates of dementia-related neuropsychiatric symptoms (NPS) are not known and this hampers the assessment of their population burden. The objective of this study was to obtain an approximate estimate of the population incidence and prevalence of both dementia and NPS.

METHODS

Given the dynamic nature of the population with dementia, a retrospective study was conducted within the database of the Basque Health Service (real-world data) at the beginning and end of 2019. Validated random forest models were used to identify separately depressive and psychotic clusters according to their presence in the electronic health records of all patients diagnosed with dementia.

RESULTS

Among the 631,949 individuals over 60 years registered, 28,563 were diagnosed with dementia, of whom 15,828 (55.4%) showed psychotic symptoms and 19,461 (68.1%) depressive symptoms. The incidence of dementia in 2019 was 6.8/1000 person-years. Most incident cases of depressive (72.3%) and psychotic (51.9%) NPS occurred in cases of incident dementia. The risk of depressive-type NPS grows with years since dementia diagnosis, living in a nursing home, and female sex, but falls with older age. In the psychotic cluster model, the effects of male sex, and older age are inverted, both increasing the probability of this type of symptoms.

CONCLUSIONS

The stigmatization factor conditions the social and attitudinal environment, delaying the diagnosis of dementia, preventing patients from receiving adequate care and exacerbating families' suffering. This study evidences the synergy between big data and real-world data for psychiatric epidemiological research.

Dynamic evaluation of the comparative effectiveness of an integrated program for heart failure care

RATIONALE, AIMS AND OBJECTIVES

An integrated care program for heart failure (HF) was developed in the Basque Country in 2013. The objective of this research was to evaluate its effectiveness through the number of hospital admissions in three integrated healthcare organizations (IHOs), taking into account the longitudinal nature of the disease and the intensity of the implementation.

METHODS

A retrospective observational study was carried out, based on data entered in administrative and clinical databases between 2014 and 2018 for a total population of 230 000. In addition to conventional statistical analyses, Andersen-Gill models for recurrent events were used, incorporating dynamic variables that allowed assessment of the intervention's intensity before each hospitalization.

RESULTS

A total of 6768 patients were analysed. Age (hazard ratio [HR] = 1.016; 95% confidence interval [CI] 1.011-1.022), the Charlson index (HR = 1.067, 95% CI 1.047-1.087), and the number of previous hospitalizations (HR = 1.632, 95% CI 1.557-1.712) were risk factors for readmission. Differences between IHOs were also statistically significant. Greater intervention intensity was associated with a lower hospitalization rate (HR = 0.995, 95% CI 0.990-1.000). As indicated by the interaction between intervention intensity and IHO, differences between IHOs disappeared when intensity rose. No inequities in hospitalization were found as a function of deprivation index or sex. Nonetheless, inequity in the implementation of the program by sex was clear, women with HF receiving less intense intervention than men with the same level of comorbidity and age.

CONCLUSIONS

The extent of program implementation measured by intervention intensity is a main driver of the effectiveness of an educational and monitoring program for HF. The evaluation of HF program effectiveness on readmissions must take into account the entire natural history of the disease. Implementation intensity explains differences between IHOs.

Economic evaluation of supplementing the diet with Souvenaid in patients with prodromal Alzheimer's disease

Background

The LipiDiDiet trial showed that Souvenaid, a medical food, might delay progression to dementia in prodromal Alzheimer’s disease (AD). The objective of this study was to assess the cost-utility of Souvenaid compared to placebo in patients with prodromal AD under the conditions applied in that trial.

Methods

A discrete event simulation model was developed based on the LipiDiDiet trial and a literature review to assess the cost-utility of Souvenaid from a societal perspective considering direct and indirect costs. For both intervention and control groups, patient trajectories in terms of functional decline on the Clinical Dementia Rating Sum of Boxes (CDR-SB) scale in LipiDiDiet were reproduced statistically with mixed models by assigning time until events to simulated patients. From the societal perspective, four scenarios were analysed by combining different options for treatment duration and diagnostic test cost. Univariate sensitivity analysis assessed parameter uncertainties.

Results

Validation results at year 2 of disease progression fit with CDR-SB progression in LipiDiDiet. The incremental cost-utility ratio (ICUR) in the baseline case was €22,743/quality-adjusted life year (QALY). All scenarios rendered an ICUR lower than €25,000/QALY (the societal threshold). Moreover, the treatment option was cost-saving and increased health benefits when diagnostic costs were not considered and treatment was only administered during the prodromal stage.

Conclusions

Treating prodromal AD with Souvenaid is a cost-effective intervention in all scenarios analysed. The LipiDiDiet trial showed a modest improvement in disease course but as the social costs of AD are very high, the intervention was efficient. Assessing small benefits at specific stages of AD is relevant because it is reasonable to expect that no effective, safe and affordable disease-modifying therapies will become available in the short to medium term.

Impact of an organised population screening programme for colorectal cancer: Measurement after first and second rounds

OBJECTIVE

The first and second rounds of the Basque programme for organised colorectal cancer screening were implemented between 2009 and 2014. Our objective was to measure the changes in incidence, tumour, node, metastasis staging distribution and tumour, node, metastasis-adjusted survival of patients with colorectal cancer from 2003 to 2014.

METHOD

Colorectal cancer cases with screening (patients <70 years old) and without screening (patients ≥70 years old) were compared during three four-year periods: 2003-2006, 2007-2010 and 2011-2014 (fully implemented phase). Cox regression, five-year relative survival and cancer probability of death were calculated for each four-year period, age group and tumour, node, metastasis stage. Adjusted incidence rates were analysed by joinpoint regression.

RESULTS

In an analysis of 23,301 cases of colorectal cancer, the incidence in patients younger than 70 years in 2013 showed a 17% annual decrease. The survival hazard ratios for stages I, II and III for 2003-2006 and 2007-2010 were compared to those for 2011-2014. From the first to the third period, diagnosis in the early stages (I and II) rose from 45.1% to 50.9% in the younger patient group and remained stable in the older group (49.6% and 49.4%). Additionally, the five-year relative survival rate increased significantly from 0.67 to 0.82 in those patients younger than 70 years, whereas in patients 70 years or older the rate did not change significantly (0.61 and 0.65).

CONCLUSION

The screening reduced incidence and improved survival by anticipating the diagnosis and by reducing mortality for each tumour, node, metastasis stage in the target population. The effect on survival could also be due to lead-time bias.

Validation of Random Forest Machine Learning Models to Predict Dementia-Related Neuropsychiatric Symptoms in Real-World Data

BACKGROUND

Neuropsychiatric symptoms (NPS) are the leading cause of the social burden of dementia but their role is underestimated.

OBJECTIVE

The objective of the study was to validate predictive models to separately identify psychotic and depressive symptoms in patients diagnosed with dementia using clinical databases representing the whole population to inform decision-makers.

METHODS

First, we searched the electronic health records of 4,003 patients with dementia to identify NPS. Second, machine learning (random forest) algorithms were applied to build separate predictive models for psychotic and depressive symptom clusters in the training set (N = 3,003). Third, calibration and discrimination were assessed in the test set (N = 1,000) to assess the performance of the models.

RESULTS

Neuropsychiatric symptoms were noted in the electronic health record of 58% of patients. The area under the receiver operating curve reached 0.80 for the psychotic cluster model and 0.74 for the depressive cluster model. The Kappa index and accuracy also showed better discrimination in the psychotic model. Calibration plots indicated that both types of model had less predictive accuracy when the probability of neuropsychiatric symptoms was <25%. The most important variables in the psychotic cluster model were use of risperidone, level of sedation, use of quetiapine and haloperidol and the number of antipsychotics prescribed. In the depressive cluster model, the most important variables were number of antidepressants prescribed, escitalopram use, level of sedation, and age.

CONCLUSION

Given their relatively good performance, the predictive models can be used to estimate prevalence of NPS in population databases.

Risk factors and prognosis of complicated urinary tract infections caused by Pseudomonas aeruginosa in hospitalized patients: a retrospective multicenter cohort study

Purpose

Complicated urinary tract infections (cUTIs) are among the most frequent health-care-associated infections. In patients with cUTI, Pseudomonas aeruginosa deserves special attention, since it can affect patients with serious underlying conditions. Our aim was to gain insight into the risk factors and prognosis of P. aeruginosa cUTIs in a scenario of increasing multidrug resistance (MDR).

Methods

This was a multinational, retrospective, observational study at 20 hospitals in south and southeastern Europe, Turkey, and Israel including consecutive patients with cUTI hospitalized between January 2013 and December 2014. A mixed-effect logistic regression model was performed to assess risk factors for P. aeruginosa and MDR P. aeruginosa cUTI.

Results

Of 1,007 episodes of cUTI, 97 (9.6%) were due to P. aeruginosa. Resistance rates of P. aeruginosa were: antipseudomonal cephalosporins 35 of 97 (36.1%), aminoglycosides 30 of 97 (30.9%), piperacillin-tazobactam 21 of 97 (21.6%), fluoroquinolones 43 of 97 (44.3%), and carbapenems 28 of 97 (28.8%). The MDR rate was 28 of 97 (28.8%). Independent risk factors for P. aeruginosa cUTI were male sex (OR 2.61, 95% CI 1.60-4.27), steroid therapy (OR 2.40, 95% CI 1.10-5.27), bedridden functional status (OR 1.79, 95% CI 0.99-3.25), antibiotic treatment within the previous 30 days (OR 2.34, 95% CI 1.38-3.94), indwelling urinary catheter (OR 2.41, 95% CI 1.43-4.08), and procedures that anatomically modified the urinary tract (OR 2.01, 95% CI 1.04-3.87). Independent risk factors for MDR P. aeruginosa cUTI were age (OR 0.96, 95% CI 0.93-0.99) and anatomical urinary tract modification (OR 4.75, 95% CI 1.06-21.26). Readmission was higher in P. aeruginosa cUTI patients than in other etiologies (23 of 97 [23.7%] vs 144 of 910 [15.8%], P=0.04), while 30-day mortality was not significantly different (seven of 97 [7.2%] vs 77 of 910 [8.5%], P=0.6).

Conclusion

Patients with P. aeruginosa cUTI had characteristically a serious baseline condition and manipulation of the urinary tract, although their mortality was not higher than that of patients with cUTI caused by other etiologies.

Analysis of uni and bi-parental markers in mixture samples: Lessons from the 22nd GHEP-ISFG Intercomparison Exercise

Since 1992, the Spanish and Portuguese-Speaking Working Group of the ISFG (GHEP-ISFG) has been organizing annual Intercomparison Exercises (IEs) coordinated by the Quality Service at the National Institute of Toxicology and Forensic Sciences (INTCF) from Madrid, aiming to provide proficiency tests for forensic DNA laboratories. Each annual exercise comprises a Basic (recently accredited under ISO/IEC 17043: 2010) and an Advanced Level, both including a kinship and a forensic module. Here, we show the results for both autosomal and sex-chromosomal STRs, and for mitochondrial DNA (mtDNA) in two samples included in the forensic modules, namely a mixture 2:1 (v/v) saliva/blood (M4) and a mixture 4:1 (v/v) saliva/semen (M8) out of the five items provided in the 2014 GHEP-ISFG IE. Discrepancies, other than typos or nomenclature errors (over the total allele calls), represented 6.5% (M4) and 4.7% (M8) for autosomal STRs, 15.4% (M4) and 7.8% (M8) for X-STRs, and 1.2% (M4) and 0.0% (M8) for Y-STRs. Drop-out and drop-in alleles were the main cause of errors, with laboratories using different criteria regarding inclusion of minor peaks and stutter bands. Commonly used commercial kits yielded different results for a micro-variant detected at locus D12S391. In addition, the analysis of electropherograms revealed that the proportions of the contributors detected in the mixtures varied among the participants. In regards to mtDNA analysis, besides important discrepancies in reporting heteroplasmies, there was no agreement for the results of sample M4. Thus, while some laboratories documented a single control region haplotype, a few reported unexpected profiles (suggesting contamination problems). For M8, most laboratories detected only the haplotype corresponding to the saliva. Although the GHEP-ISFG has already a large experience in IEs, the present multi-centric study revealed challenges that still exist related to DNA mixtures interpretation. Overall, the results emphasize the need for further research and training actions in order to improve the analysis of mixtures among the forensic practitioners.

Genetic admixture, relatedness, and structure patterns among Mexican populations revealed by the Y-chromosome

Y-linked markers are suitable loci to analyze genetic diversity of human populations, offering knowledge of medical, forensic, and anthropological interest. In a population sample of 206 Mestizo males from western Mexico, we analyzed two binary loci (M3 and YAP) and six Y-STRs, adding to the analysis data of Mexican Mestizos and Amerindians, and relevant worldwide populations. The paternal ancestry estimated in western Mexican-Mestizos was mainly European (60-64%), followed by Amerindian (25-21%), and African ( approximately 15%). Significant genetic heterogeneity was established between Mestizos from western (Jalisco State) and northern Mexico (Chihuahua State) compared with Mexicans from the center of the Mexican Republic (Mexico City), this attributable to higher European ancestry in western and northern than in central and southeast populations, where higher Amerindian ancestry was inferred. This genetic structure has important implications for medical and forensic purposes. Two different Pre-Hispanic evolutionary processes were evident. In Mesoamerican region, populations presented higher migration rate (N(m) = 24.76), promoting genetic homogeneity. Conversely, isolated groups from the mountains and canyons of the Western and Northern Sierra Madre (Huichols and Tarahumaras, respectively) presented a lower migration rate (N(m) = 10.27) and stronger genetic differentiation processes (founder effect and/or genetic drift), constituting a Pre-Hispanic population substructure. Additionally, Tarahumaras presented a higher frequency of Y-chromosomes without Q3 that was explained by paternal European admixture (15%) and, more interestingly, by a distinctive Native-American ancestry. In Purepechas, a special admixture process involving preferential integration of non-Purepecha women in their communities could explain contrary genetic evidences (autosomal vs. Y-chromosome) for this tribe.

Allele frequencies of the 15 AmpF/Str Identifiler loci in the population of Metztitlán (Estado de Hidalgo), México

The 15 AmpF/STR Identifiler loci (D8S1179, D21S11, D7S820, CSF1PO, D3S1358, TH01, D13S317, D16S539, D2S1338, D19S433, vWA, TPOX, D18S51, D5S818 and FGA) were analyzed in the sample of 180 unrelated autochthonous healthy adults born in Meztitlán City from the valley of Metztitlán (Estado de Hidalgo, México). The agreement with Hardy-Weinberg equilibrium was confirmed for all loci. From the forensic point of view, the heterozygosity value, power of discrimination and the a priori chance of exclusion were calculated.

Characterisation of three Amerindian populations from Hidalgo State (Mexico) by 15 STR-PCR polymorphisms

The purpose of this study is to report allele frequency data of three ethnic Amerindian population samples: the Otomi (Hna-hnu) from eastern Sierra Madre and Ixmiquilpan valley and the Huasteco from La Huasteca. These groups were characterised by 15 STR-PCR polymorphisms (HumTH01, HumvWA, D18S51, HumTPOX, D19S433, D16S539, D13S317, D8S1179, D7S820, D5S818, HumFGA, CSF1PO, D2S1338, D3S1358 and D21S11). No significant deviations in observed allelic frequencies from Hardy-Weinberg equilibrium were found for all the studied systems. From the forensic point of view, the heterozygosity value, power of discrimination and the a priori chance of exclusion were calculated.