Codesign and Feasibility Testing of a Tool to Evaluate Overweight and Obesity Apps

Background: Digital health interventions and mobile technologies can help to reduce the rates of obesity and overweight conditions. Although weight management apps are widely used, they usually lack professional content and evaluation, so the quality of these apps cannot be guaranteed. The EVALAPPS project aims to design and validate a tool to assess the safety and effectiveness of health-related apps whose main goal is to manage and prevent obesity and overweight conditions. Objective: The aim of this paper is two-fold: (a) to co-create and codesign the EVALAPPS assessment tool and (b) to pilot its feasibility among overweight and obese individuals that use weight control apps. Methods: A mixed-methods approach was used. A multidisciplinary team (n = 12) participated in a co-creation workshop to provide proposals and inputs about the look and feel of the content, usability aspects, appearance, sections, and main features of the EVALAPPS tool. The tool was tested for its feasibility among 31 overweight and obese individuals, attending the CP Endocrinologia i Nutrició SL Clinic for the first time. Participants were asked to use a specific weight control app [Yazio (YAZIO GmbH, Erfurt, Germany), My FitnessPal (MyFitnessPal, Austin, TX, USA) or MyPlate (MyPlate, Santa Monica, CA, USA)] for two weeks and then evaluate them by using the EVALAPPS (EVALAPPS, David Ganyan, Barcelona, Spain) (June 2020, David Ganyan, Barcelona, Spain) tool. Seven participants were phone interviewed to gain more insight into the use of the EVALAPPS tool. Results: The co-creation workshop allowed conceptualizing the EVALAPPS tool. The feasibility study showed that all criteria from the Usability and Functionality dimensions had valid answers, while Reliability, Security, Privacy, and Health indicators were the dimensions with less valid answers. In all three apps, the dimension with the highest score was Usability/functionality, followed by app purpose. Clinical effectiveness and Development were the dimensions with the lowest scores in all three tested weight control apps. Conclusions: The participation of the multidisciplinary team and end-users in the conceptualization and testing of a tool to assess health apps was feasible and relevant for the usability of the tool.

Evaluation of integrated care services in Catalonia: population-based and service-based real-life deployment protocols

BACKGROUND

Comprehensive assessment of integrated care deployment constitutes a major challenge to ensure quality, sustainability and transferability of both healthcare policies and services in the transition toward a coordinated service delivery scenario. To this end, the manuscript articulates four different protocols aiming at assessing large-scale implementation of integrated care, which are being developed within the umbrella of the regional project Nextcare (2016-2019), undertaken to foster innovation in technologically-supported services for chronic multimorbid patients in Catalonia (ES) (7.5 M inhabitants). Whereas one of the assessment protocols is designed to evaluate population-based deployment of care coordination at regional level during the period 2011-2017, the other three are service-based protocols addressing: i) Home hospitalization; ii) Prehabilitation for major surgery; and, iii) Community-based interventions for frail elderly chronic patients. All three services have demonstrated efficacy and potential for health value generation. They reflect different implementation maturity levels. While full coverage of the entire urban health district of Barcelona-Esquerra (520 k inhabitants) is the main aim of home hospitalization, demonstration of sustainability at Hospital Clinic of Barcelona constitutes the core goal of the prehabilitation service. Likewise, full coverage of integrated care services addressed to frail chronic patients is aimed at the city of Badalona (216 k inhabitants).

METHODS

The population-based analysis, as well as the three service-based protocols, follow observational and experimental study designs using a non-randomized intervention group (integrated care) compared with a control group (usual care) with a propensity score matching method. Evaluation of cost-effectiveness of the interventions using a Quadruple aim approach is a central outcome in all protocols. Moreover, multi-criteria decision analysis is explored as an innovative method for health delivery assessment. The following additional dimensions will also be addressed: i) Determinants of sustainability and scalability of the services; ii) Assessment of the technological support; iii) Enhanced health risk assessment; and, iv) Factors modulating service transferability.

DISCUSSION

The current study offers a unique opportunity to undertake a comprehensive assessment of integrated care fostering deployment of services at regional level. The study outcomes will contribute refining service workflows, improving health risk assessment and generating recommendations for service selection.

TRIALS REGISTRATION

NCT03130283 (date released 04/06/2018), NCT03768050 (date released 12/05/2018), NCT03767387 (date released 12/05/2018).

Proposals for enhanced health risk assessment and stratification in an integrated care scenario

OBJECTIVES

Population-based health risk assessment and stratification are considered highly relevant for large-scale implementation of integrated care by facilitating services design and case identification. The principal objective of the study was to analyse five health-risk assessment strategies and health indicators used in the five regions participating in the Advancing Care Coordination and Telehealth Deployment (ACT) programme (http://www.act-programme.eu). The second purpose was to elaborate on strategies toward enhanced health risk predictive modelling in the clinical scenario.

SETTINGS

The five ACT regions: Scotland (UK), Basque Country (ES), Catalonia (ES), Lombardy (I) and Groningen (NL).

PARTICIPANTS

Responsible teams for regional data management in the five ACT regions.

PRIMARY AND SECONDARY OUTCOME MEASURES

We characterised and compared risk assessment strategies among ACT regions by analysing operational health risk predictive modelling tools for population-based stratification, as well as available health indicators at regional level. The analysis of the risk assessment tool deployed in Catalonia in 2015 (GMAs, Adjusted Morbidity Groups) was used as a basis to propose how population-based analytics could contribute to clinical risk prediction.

RESULTS

There was consensus on the need for a population health approach to generate health risk predictive modelling. However, this strategy was fully in place only in two ACT regions: Basque Country and Catalonia. We found marked differences among regions in health risk predictive modelling tools and health indicators, and identified key factors constraining their comparability. The research proposes means to overcome current limitations and the use of population-based health risk prediction for enhanced clinical risk assessment.

CONCLUSIONS

The results indicate the need for further efforts to improve both comparability and flexibility of current population-based health risk predictive modelling approaches. Applicability and impact of the proposals for enhanced clinical risk assessment require prospective evaluation.