Implementing learning health systems in the UK NHS: Policy actions to improve collaboration and transparency and support innovation and better use of analytics

Four distinct models of learning health systems: Strength through diversity

The concept of a learning health system (LHS) was established nearly 20 years ago as a unifying commitment to speed the generation and use of evidence primarily by leveraging rapid advances in data and technologies, resulting in optimized care for each patient. In the ensuing decades, vanguard adopters of the LHS who have sought to move the LHS from conceptual to operational have done so in ways that fit with and reflect their organizational structure, mission, and culture-as well as their personal values and experiences. They have also extended the focus from health care to include individual and population health more broadly. This commentary describes four distinctive models that have evolved as learning health system activities have matured. Viewing this diversity as a strength, the features, commonalities, and unique differences of these models are described.

Co-producing a safe mobility and falls informatics platform to drive meaningful quality improvement in the hospital setting: a mixed-methods protocol for the insightFall study

INTRODUCTION

Manual investigation of falls incidents for quality improvement is time-consuming for clinical staff. Routine care delivery generates a large volume of relevant data in disparate systems, yet these data are seldom integrated and transformed into real-time, actionable insights for frontline staff. This protocol describes the co-design and testing of a safe mobility and falls informatics platform for automated, real-time insights to support the learning response to inpatient falls.

METHODS

Underpinned by the learning health system model and human-centred design principles, this mixed-methods study will involve (1) collaboration between healthcare professionals, patients, data scientists and researchers to co-design a safe mobility and falls informatics platform; (2) co-production of natural language processing pipelines and integration with a user interface for automated, near-real-time insights and (3) platform usability testing. Platform features (data taxonomy and insights display) will be co-designed during workshops with lay partners and clinical staff. The data to be included in the informatics platform will be curated from electronic health records and incident reports within an existing secure data environment, with appropriate data access approvals and controls. Exploratory analysis of a preliminary static dataset will examine the variety (structured/unstructured), veracity (accuracy/completeness) and value (clinical utility) of the data. Based on these initial insights and further consultation with lay partners and clinical staff, a final data extraction template will be agreed. Natural language processing pipelines will be co-produced, clinically validated and integrated with QlikView. Prototype testing will be underpinned by the Technology Acceptance Model, comprising a validated survey and think-aloud interviews to inform platform optimisation.

ETHICS AND DISSEMINATION

This study protocol was approved by the National Institute for Health Research Imperial Biomedical Research Centre Data Access and Prioritisation Committee (Database: iCARE-Research Data Environment; REC reference: 21/SW/0120). Our dissemination plan includes presenting our findings to the National Falls Prevention Coordination Group, publication in peer-reviewed journals, conference presentations and sharing findings with patient groups most affected by falls in hospital.

DiScO: novel rapid systems mapping to inform digital transformation of health systems

Background

Global health systems are confronting challenges that intersect climate change with evolving communicable and non-communicable public health risks. Addressing these challenges requires systems integration via citizen big data that exist outside health systems. However, systems integration across jurisdictions is a complex challenge that requires stakeholder input. This study's purpose was to conduct rapid systems mapping with international health system stakeholders to inform the development and implementation of a global digital citizen science observatory (DiScO), which aims to catalyze digital transformation of health systems across jurisdictions.

Methods

A rapid qualitative systems mapping study was conducted during the International Society for Behavioral Nutrition and Physical Activity Annual Global Summit in Uppsala, Sweden, in June 2023. The choice of the venue and approach was informed by three key criteria: (1) Established evidence linking physical activity and nutrition with non-communicable diseases; (2) Concrete existing methods of obtaining citizen big data by physical activity and nutrition researchers; (3) Precedence of physical activity and nutrition researchers conducting citizen science as well behavioral/clinical big data collection. The design of this study was an innovative pre-post systems map development, which consisted of (1) real-time rapid systems mapping (pre/initial map) by engaging with international stakeholders and (2) adjustment of the real-time systems map (post/final map) after analyzing stakeholder discussion data.

Results

Rapid systems mapping resulted in a complex network that included key themes to successfully develop and implement DiScO: priorities, opportunities, risks, challenges, partnerships, and resources. Additionally, a new theme emerged organically through stakeholder group discussions - mitigation strategies. The adapted rapid systems map (i.e., after data analyses) depicts 23 key nodes of intervention across the seven key themes.

Conclusion

Rapid systems mapping at international symposia is a novel methodological approach to capture stakeholder input, particularly to understand complexity across international jurisdictions - an approach that can be replicated across disciplines and sectors to inform digital transformation of health systems. The development and implementation of DiScO, a platform for decentralization and democratization of technology, will take into consideration all the key nodes of intervention identified in the rapid systems map to promote digital health for equity across global jurisdictions.

Learning Health System to rapidly improve the implementation of a school physical activity policy

BACKGROUND

Learning Health Systems (LHS) - characterised by cycles of evidence generation and application - are increasingly recognised for their potential to improve public health interventions and optimise health impacts; however there is little evidence of their application in the context of public health practice. Here, we describe how an Australian public health unit applied a LHS approach to successfully improve a model of support for implementation of a school-based physical activity policy.

METHODS

This body of work was undertaken in the context of a strong research-practice partnership. Core LHS capabilities included: i) partnerships and stakeholder engagement; ii) workforce development and learning health communities; iii) multi-disciplinary scientific expertise; iv) practice data collection and management system; v) evidence surveillance and synthesis; and vi) governance and organisational processes of decision making. Three cycles of data generation and application were used. Within each cycle, randomised controlled trials conducted in NSW primary schools were used to generate data on the support model's effectiveness for improving schools' implementation of a government physical activity policy, its delivery costs, and process measures such as adoption and acceptability. Each type of data were analysed independently, synthesised, and then presented to a multi-disciplinary team of researchers and practitioners, in consult with stakeholders, leading to collaborative decisions for incremental improvements to the support model.

RESULTS

Cycle 1 tested the first version of the support model (composed of five implementation strategies targeting identified barriers of policy implementation) and showed the model's feasibility and efficacy for improving schools' policy implementation. Data-informed changes were made to enhance impact, including the addition of three implementation strategies to address outstanding barriers. Cycle 2 (now, testing a package of eight implementation strategies) established the model's effectiveness and cost-effectiveness for improving school's policy implementation. Data-informed changes were made to reduce delivery costs, specifically adapting the costliest strategies to reduce in-person contact from external support personnel. Cycle 3 showed that the adaptations minimised the relative cost of delivery without adversely impacting on the effect.

CONCLUSIONS

Through this process, we identified an effective, cost-effective, acceptable and scalable policy implementation support model for service delivery. This provides important information to inform or support LHS approaches for other agencies seeking to optimise the health impact of evidence-based interventions.

Leveraging data to support health equity in an integrated delivery and finance system

Introduction

To accelerate healthcare transformation and advance health equity, scientists in learning health systems (LHSs) require ready access to integrated, comprehensive data that includes information on social determinants of health (SDOH).

Methods

We describe how an integrated delivery and finance system leveraged its learning ecosystem to advance health equity through (a) a cross-sector initiative to integrate healthcare and human services data for better meeting clients' holistic needs and (b) a system-level initiative to collect and use patient-reported SDOH data for connecting patients to needed resources.

Results

Through these initiatives, we strengthened our health system's capacity to meet diverse patient needs, address health disparities, and improve health outcomes. By sharing and integrating healthcare and human services data, we identified 281 000 Shared Services Clients and enhanced care management for 100 adult Medicaid/Special Needs Plan members. Over a 1-year period, we screened 9173 (37%) patients across UPMC's Women's Health Services Line and connected over 700 individuals to social services and supports.

Conclusions

Opportunities exist for LHSs to improve, expand, and sustain their innovative data practices. As learnings continue to emerge, LHSs will be well positioned to accelerate healthcare transformation and advance health equity.

Diagnosing an overcrowded emergency department from its Electronic Health Records

Emergency department overcrowding is a complex problem that persists globally. Data of visits constitute an opportunity to understand its dynamics. However, the gap between the collected information and the real-life clinical processes, and the lack of a whole-system perspective, still constitute a relevant limitation. An analytical pipeline was developed to analyse one-year of production data following the patients that came from the ED (n = 49,938) at Uppsala University Hospital (Uppsala, Sweden) by involving clinical experts in all the steps of the analysis. The key internal issues to the ED were the high volume of generic or non-specific diagnoses from non-urgent visits, and the delayed decision regarding hospital admission caused by several imaging assessments and lack of hospital beds. Furthermore, the external pressure of high frequent re-visits of geriatric, psychiatric, and patients with unspecified diagnoses dramatically contributed to the overcrowding. Our work demonstrates that through analysis of production data of the ED patient flow and participation of clinical experts in the pipeline, it was possible to identify systemic issues and directions for solutions. A critical factor was to take a whole systems perspective, as it opened the scope to the boundary effects of inflow and outflow in the whole healthcare system.

eHealth implementation in Europe: a scoping review on legal, ethical, financial, and technological aspects

Background

The evolution of eHealth development has shifted from standalone tools to comprehensive digital health environments, fostering data exchange among diverse stakeholders and systems. Nevertheless, existing research and implementation frameworks have primarily emphasized technological and organizational aspects of eHealth implementation, overlooking the intricate legal, ethical, and financial considerations. It is essential to discover what legal, ethical, financial, and technological challenges should be considered to ensure successful and sustainable implementation of eHealth.

Objective

This review aims to provide insights into barriers and facilitators of legal, ethical, financial, and technological aspects for successful implementation of complex eHealth technologies, which impacts multiple levels and multiple stakeholders.

Methods

A scoping review was conducted by querying PubMed, Scopus, Web of Science, and ACM Digital Library (2018-2023) for studies describing the implementation process of eHealth technologies that facilitate data exchange. Studies solely reporting clinical outcomes or conducted outside Europe were excluded. Two independent reviewers selected the studies. A conceptual framework was constructed through axial and inductive coding, extracting data from literature on legal, ethical, financial, and technological aspects of eHealth implementation. This framework guided systematic extraction and interpretation.

Results

The search resulted in 7.308 studies that were screened for eligibility, of which 35 (0.48%) were included. Legal barriers revolve around data confidentiality and security, necessitating clear regulatory guidelines. Ethical barriers span consent, responsibility, liability, and validation complexities, necessitating robust frameworks. Financial barriers stem from inadequate funding, requiring (commercial) partnerships and business models. Technological issues include interoperability, integration, and malfunctioning, necessitating strategies for enhancing data reliability, improving accessibility, and aligning eHealth technology with existing systems for smoother integration.

Conclusions

This research highlights the multifaceted nature of eHealth implementation, encompassing legal, ethical, financial, and technological considerations. Collaborative stakeholder engagement is paramount for effective decision-making and aligns with the transition from standalone eHealth tools to integrated digital health environments. Identifying suitable stakeholders and recognizing their stakes and values enriches implementation strategies with expertise and guidance across all aspects. Future research should explore the timing of these considerations and practical solutions for regulatory compliance, funding, navigation of responsibility and liability, and business models for reimbursement strategies.

An initial typology of approaches used by policy and practice agencies to achieve sustained implementation of interventions to improve health

BACKGROUND

Scientific investigation of how to sustain the implementation of evidence-based interventions (EBI) is emerging. Sustaining the implementation of EBIs helps ensure their effects on improving health endure. External policy or practice agencies, such as government health departments, are often tasked with supporting individual organisations with sustaining their delivery of EBIs, for example, through financing, training or the provision of other supports. However, to our knowledge, the approaches taken by policy and practice agencies to support the sustainment of EBIs have not been consolidated, categorised and described as a typology.

MAIN BODY

To improve conceptual clarity and support both research and practice, we developed an initial working typology of the practical approaches to sustain implementation of EBIs (i.e. sustainment) in order to improve long term health from the perspective of these agencies. The working typology includes three broad approaches. The first, termed 'Self-Sustainment', is when implementation of the EBI by an organisation (e.g. hospital, clinic, school) is expected to continue (sustain) in the absence of external (agency) support. The second, termed 'Static Sustainment Support', involves the provision of pre-defined external (agency) support to assist organisations to continue implementation of an EBI. The final approach is termed 'Dynamic Sustainment Support', whereby support provided by an external agency is dynamic (continues to be adapted) overtime to assist organisations continue implementation of an intervention which may itself also evolve.

CONCLUSIONS

We describe the contexts and circumstances where each may be most appropriate in achieving sustained implementation and discuss their research and practice implications.

Defining the Learning Health Care System: An International Health System Leadership Perspective

PURPOSE

Over the past 2 decades, many academic health centers (AHCs) have implemented learning health systems (LHSs). However, the LHS has been defined with limited input from AHC leaders. This has implications because these individuals play a critical role in LHS implementation and sustainability. This study aims to demonstrate how an international group of AHC leaders defines the LHS, and to identify key considerations they would pose to their leadership teams to implement and sustain the LHS.

METHOD

A semistructured survey was developed and administered in 2022 to members of the Association of Academic Health Centers President's Council on the Learning Health System to explore how AHC leaders define the LHS in relation to their leadership roles. The authors then conducted a focus group, informed by the survey, with these leaders. The focus group was structured using the nominal group technique to facilitate consensus on an LHS definition and key considerations. The authors mapped the findings to an existing LHS framework, which includes 7 components: organizational, performance, ethics and security, scientific, information technology, data, and patient outcomes.

RESULTS

Thirteen AHC leaders (100%) completed the survey and 10 participated in the focus group. The AHC leaders developed the following LHS definition: "A learning health system is a health care system in which clinical and care-related data are systematically integrated to catalyze discovery and implementation of new knowledge that benefits patients, the community, and the organization through improved outcomes." The key considerations mapped to all LHS framework components, but participants also described as important the ability to communicate the LHS concept and be able to rapidly adjust to unforeseen circumstances.

CONCLUSIONS

The LHS definition and considerations developed in this study provide a shared foundation and road map for future discussions among leaders of AHCs interested in implementing and sustaining an LHS.

Health Information Exchange: Understanding the Policy Landscape and Future of Data Interoperability

OBJECTIVES

To review recent literature on health information exchange (HIE), focusing on the policy approach of five case study nations: the United States of America, the United Kingdom, Germany, Israel, and Portugal, as well as synthesize lessons learned across countries and provide recommendations for future research.

METHODS

A narrative review of each nation's HIE policy frameworks, current state, and future HIE strategy.

RESULTS

Key themes that emerged include the importance of both central decision-making as well as local innovation, the multiple and complex challenges of broad HIE adoption, and the varying role of HIE across different national health system structures.

CONCLUSION

HIE is an increasingly important capability and policy priority as electronic health record (EHR) adoption becomes more common and care delivery is increasingly digitized. While all five case study nations have adopted some level of HIE, there are significant differences across their level of data sharing infrastructure and maturity, and each nation took a different policy approach. While identifying generalizable strategies across disparate international systems is challenging, there are several common themes across successful HIE policy frameworks, such as the importance of central government prioritization of data sharing. Finally, we make several recommendations for future research to expand the breadth and depth of the literature on HIE and guide future decision-making by policymakers and practitioners.

The Science of Learning Health Systems: Scoping Review of Empirical Research

BACKGROUND

The development and adoption of a learning health system (LHS) has been proposed as a means to address key challenges facing current and future health care systems. The first review of the LHS literature was conducted 5 years ago, identifying only a small number of published papers that had empirically examined the implementation or testing of an LHS. It is timely to look more closely at the published empirical research and to ask the question, Where are we now? 5 years on from that early LHS review.

OBJECTIVE

This study performed a scoping review of empirical research within the LHS domain. Taking an "implementation science" lens, the review aims to map out the empirical research that has been conducted to date, identify limitations, and identify future directions for the field.

METHODS

Two academic databases (PubMed and Scopus) were searched using the terms "learning health* system*" for papers published between January 1, 2016, to January 31, 2021, that had an explicit empirical focus on LHSs. Study information was extracted relevant to the review objective, including each study's publication details; primary concern or focus; context; design; data type; implementation framework, model, or theory used; and implementation determinants or outcomes examined.

RESULTS

A total of 76 studies were included in this review. Over two-thirds of the studies were concerned with implementing a particular program, system, or platform (53/76, 69.7%) designed to contribute to achieving an LHS. Most of these studies focused on a particular clinical context or patient population (37/53, 69.8%), with far fewer studies focusing on whole hospital systems (4/53, 7.5%) or on other broad health care systems encompassing multiple facilities (12/53, 22.6%). Over two-thirds of the program-specific studies utilized quantitative methods (37/53, 69.8%), with a smaller number utilizing qualitative methods (10/53, 18.9%) or mixed-methods designs (6/53, 11.3%). The remaining 23 studies were classified into 1 of 3 key areas: ethics, policies, and governance (10/76, 13.2%); stakeholder perspectives of LHSs (5/76, 6.6%); or LHS-specific research strategies and tools (8/76, 10.5%). Overall, relatively few studies were identified that incorporated an implementation science framework.

CONCLUSIONS

Although there has been considerable growth in empirical applications of LHSs within the past 5 years, paralleling the recent emergence of LHS-specific research strategies and tools, there are few high-quality studies. Comprehensive reporting of implementation and evaluation efforts is an important step to moving the LHS field forward. In particular, the routine use of implementation determinant and outcome frameworks will improve the assessment and reporting of barriers, enablers, and implementation outcomes in this field and will enable comparison and identification of trends across studies.

Clinical deployment environments: Five pillars of translational machine learning for health

Machine Learning for Health (ML4H) has demonstrated efficacy in computer imaging and other self-contained digital workflows, but has failed to substantially impact routine clinical care. This is no longer because of poor adoption of Electronic Health Records Systems (EHRS), but because ML4H needs an infrastructure for development, deployment and evaluation within the healthcare institution. In this paper, we propose a design pattern called a Clinical Deployment Environment (CDE). We sketch the five pillars of the CDE: (1) real world development supported by live data where ML4H teams can iteratively build and test at the bedside (2) an ML-Ops platform that brings the rigour and standards of continuous deployment to ML4H (3) design and supervision by those with expertise in AI safety (4) the methods of implementation science that enable the algorithmic insights to influence the behaviour of clinicians and patients and (5) continuous evaluation that uses randomisation to avoid bias but in an agile manner. The CDE is intended to answer the same requirements that bio-medicine articulated in establishing the translational medicine domain. It envisions a transition from "real-world" data to "real-world" development.

Predicting Risk of Hospital Admission in Patients With Suspected COVID-19 in a Community Setting: Protocol for Development and Validation of a Multivariate Risk Prediction Tool

Background

During the pandemic, remote consultations have become the norm for assessing patients with signs and symptoms of COVID-19 to decrease the risk of transmission. This has intensified the clinical uncertainty already experienced by primary care clinicians when assessing patients with suspected COVID-19 and has prompted the use of risk prediction scores, such as the National Early Warning Score (NEWS2), to assess severity and guide treatment. However, the risk prediction tools available have not been validated in a community setting and are not designed to capture the idiosyncrasies of COVID-19 infection.

Objective

The objective of this study is to produce a multivariate risk prediction tool, RECAP-V1 (Remote COVID-19 Assessment in Primary Care), to support primary care clinicians in the identification of those patients with COVID-19 that are at higher risk of deterioration and facilitate the early escalation of their treatment with the aim of improving patient outcomes.

Methods

The study follows a prospective cohort observational design, whereby patients presenting in primary care with signs and symptoms suggestive of COVID-19 will be followed and their data linked to hospital outcomes (hospital admission and death). Data collection will be carried out by primary care clinicians in four arms: North West London Clinical Commissioning Groups (NWL CCGs), Oxford-Royal College of General Practitioners (RCGP) Research and Surveillance Centre (RSC), Covid Clinical Assessment Service (CCAS), and South East London CCGs (Doctaly platform). The study involves the use of an electronic template that incorporates a list of items (known as RECAP-V0) thought to be associated with disease outcome according to previous qualitative work. Data collected will be linked to patient outcomes in highly secure environments. We will then use multivariate logistic regression analyses for model development and validation.

Results

Recruitment of participants started in October 2020. Initially, only the NWL CCGs and RCGP RSC arms were active. As of March 24, 2021, we have recruited a combined sample of 3827 participants in these two arms. CCAS and Doctaly joined the study in February 2021, with CCAS starting the recruitment process on March 15, 2021. The first part of the analysis (RECAP-V1 model development) is planned to start in April 2021 using the first half of the NWL CCGs and RCGP RSC combined data set. Posteriorly, the model will be validated with the rest of the NWL CCGs and RCGP RSC data as well as the CCAS and Doctaly data sets. The study was approved by the Research Ethics Committee on May 27, 2020 (Integrated Research Application System number: 283024, Research Ethics Committee reference number: 20/NW/0266) and badged as National Institute of Health Research Urgent Public Health Study on October 14, 2020.

Conclusions

We believe the validated RECAP-V1 early warning score will be a valuable tool for the assessment of severity in patients with suspected COVID-19 in the community, either in face-to-face or remote consultations, and will facilitate the timely escalation of treatment with the potential to improve patient outcomes.

Trial Registration

ISRCTN registry ISRCTN13953727; https://www.isrctn.com/ISRCTN13953727

International Registered Report Identifier (IRRID)

DERR1-10.2196/29072

Impact of a wound management system on budget optimisation, formulary compliance and variations in care

Optimising budgets in wound care is crucial if local health economy efficiencies are to be realised. How spending is managed and monitored can be difficult for community nursing services due to the variety of supply routes. Online wound management systems not on help tailor supply routes to reduce waste, thereby reducing cost, but also provide an audit platform for transparency across clinical practice. The non-prescription ordering system Formeo was implemented across City Health Care Partnership (CHCP), Hull, through a value-based industry collaboration. With its use, monthly spend on wound care reduced by approximately £5354 (11.9%), with a reduction in the total spend of £64 254. Further, Formeo enabled an audit of clinical practice to minimise products on the formulary. This provided CHCP, Hull, the opportunity to reduce variations in care, and therefore potentially improve clinical outcomes.

Learning health systems using data to drive healthcare improvement and impact: a systematic review

Background

The transition to electronic health records offers the potential for big data to drive the next frontier in healthcare improvement. Yet there are multiple barriers to harnessing the power of data. The Learning Health System (LHS) has emerged as a model to overcome these barriers, yet there remains limited evidence of impact on delivery or outcomes of healthcare.

Objective

To gather evidence on the effects of LHS data hubs or aligned models that use data to deliver healthcare improvement and impact. Any reported impact on the process, delivery or outcomes of healthcare was captured.

Methods

Systematic review from CINAHL, EMBASE, MEDLINE, Medline in-process and Web of Science PubMed databases, using learning health system, data hub, data-driven, ehealth, informatics, collaborations, partnerships, and translation terms. English-language, peer-reviewed literature published between January 2014 and Sept 2019 was captured, supplemented by a grey literature search. Eligibility criteria included studies of LHS data hubs that reported research translation leading to health impact.

Results

Overall, 1076 titles were identified, with 43 eligible studies, across 23 LHS environments. Most LHS environments were in the United States (n = 18) with others in Canada, UK, Sweden and Australia/NZ. Five (21.7%) produced medium-high level of evidence, which were peer-reviewed publications.

Conclusions

LHS environments are producing impact across multiple continents and settings.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12913-021-06215-8.

The three numbers you need to know about healthcare: the 60-30-10 Challenge

BACKGROUND

Healthcare represents a paradox. While change is everywhere, performance has flatlined: 60% of care on average is in line with evidence- or consensus-based guidelines, 30% is some form of waste or of low value, and 10% is harm. The 60-30-10 Challenge has persisted for three decades.

MAIN BODY

Current top-down or chain-logic strategies to address this problem, based essentially on linear models of change and relying on policies, hierarchies, and standardisation, have proven insufficient. Instead, we need to marry ideas drawn from complexity science and continuous improvement with proposals for creating a deep learning health system. This dynamic learning model has the potential to assemble relevant information including patients' histories, and clinical, patient, laboratory, and cost data for improved decision-making in real time, or close to real time. If we get it right, the learning health system will contribute to care being more evidence-based and less wasteful and harmful. It will need a purpose-designed digital backbone and infrastructure, apply artificial intelligence to support diagnosis and treatment options, harness genomic and other new data types, and create informed discussions of options between patients, families, and clinicians. While there will be many variants of the model, learning health systems will need to spread, and be encouraged to do so, principally through diffusion of innovation models and local adaptations.

CONCLUSION

Deep learning systems can enable us to better exploit expanding health datasets including traditional and newer forms of big and smaller-scale data, e.g. genomics and cost information, and incorporate patient preferences into decision-making. As we envisage it, a deep learning system will support healthcare's desire to continually improve, and make gains on the 60-30-10 dimensions. All modern health systems are awash with data, but it is only recently that we have been able to bring this together, operationalised, and turned into useful information by which to make more intelligent, timely decisions than in the past.