The Learning Exchange, a Community Knowledge Commons for Learning Networks: Qualitative Evaluation to Test Acceptability, Feasibility, and Utility

Establishing a Cystic Fibrosis Learning Network: Interventions to promote collaboration and data-driven improvement at scale

Introduction

A learning health network is a type of learning health system in which stakeholders use network organization to improve health and health care. Building on existing resources in the cystic fibrosis (CF) community, the Cystic Fibrosis Learning Network (CFLN) was designed to improve medical outcomes and quality of life through an intentional focus on achieving reliable evidence-based chronic care delivery and creating a system for data-driven collaborative learning.

Methods

We describe the development and growth of the CFLN considering six domains of a Network Maturity Grid: system leadership; governance and policy management; quality improvement (QI); engagement and community building; data and analytics; and research. We illustrate the impact of the CFLN experience on chronic care processes and indicators of collaborative infrastructure.

Results

The CFLN represents 36 accredited care centers in the CF Foundation Care Center Network caring for over 6300 patients. Of 6779 patient clinical care visits/quarter, 77% are entered into the CF Foundation Patient Registry within 30 days, providing timely means to track outcomes. Collaborative visit planning is occurring in 93% of clinical care visits to share agenda setting with patients and families. Almost all CFLN teams (94%, n = 34) have a patient/family partner (PFP), and 74% of PFPs indicate they are actively participating, taking ownership of, or leading QI initiatives with the interdisciplinary care team. In 2022, 97% of centers reported completing 1-13 improvement cycles per month, and 82% contributed to monthly QI progress reports to share learning.

Conclusion

The CFLN is a maturing, collaborative infrastructure. CFLN centers practice at an advanced level of coproduction. The CFLN fosters interdisciplinary and PFP leadership and the performance of consistent data-driven improvement cycles. CFLN centers are positioned to respond to rapid changes in evidence-based care and advance the practice of QI and implementation science on a broader scale.

Point-of-care dashboards promote coproduction of healthcare services for patients with inflammatory bowel disease

BACKGROUND

Coproduction of healthcare services by patients and professionals is seen as an increasingly important mechanism to support person-centred care delivery. Coproduction invites a deeper understanding of what persons sometimes called 'patients' bring to development of a service. Yet, little is known about tools that may help elicit that information.

OBJECTIVE

Our objective was to explore potential benefits and limitations of an electronic pre-visit survey (PVS) and dashboard by studying uptake and experiences within the inflammatory bowel disease (IBD) community.

METHODS

We conducted a mixed-method evaluation of patients and clinicians using the IBD Qorus PVS and dashboard at 24 programmes participating in the IBD Qorus learning health system. We analysed (i) descriptive statistics and thematic analyses of 537 patient surveys, (ii) semi-structured interviews with seven patients and six care teams and (iii) usage data collected between 25 March 2019 and 26 April 2020.

RESULTS

Nearly two-thirds (64%; n = 38) of clinicians enrolled ≥25 patients into IBD Qorus; 59% (n = 29) of clinicians received ≥25 electronic PVS, with 3834 PVS received during the study period. Post-visit evaluation surveys were completed by patients following 26% (n = 993) of PVS completions. Among patients who reported using the dashboard for 1 or more months (n = 537), two-thirds (65%, n = 344) used the dashboard at a clinic visit and one-third used it outside the clinic (33%, n = 176). Most patients who used the dashboard during a clinic visit said it was helpful in discussions with their clinician (82%), in talking about what matters most (76%) and in making healthcare decisions (71%). Patients using the dashboard during the clinic visit reported higher levels of shared decision-making than those who did not use the dashboard (82% vs. 65%, P < 0.001). This relationship remained significant after controlling for receipt of care at a clinic with the highest levels of patient-reported shared decision-making (odds ratio: 2.1; confidence interval: 1.3-3.3). Patients and clinicians found the greatest value in using the PVS and dashboard to share concerns and symptoms, prepare for a visit and support discussions during the visit. The lack of integration with existing electronic health records (EHRs) limited clinician usage of the PVS and dashboard.

CONCLUSIONS

The PVS and dashboard created a shared language, which supported coproduction and shared decision-making and facilitated a shared understanding of goals, concerns, symptoms and well-being. To support uptake, future systems should reduce implementation burden for healthcare professionals and integrate seamlessly with existing EHR systems and workflows.

The role of co-production in Learning Health Systems

Background

Co-production of health is defined as ‘the interdependent work of users and professionals who are creating, designing, producing, delivering, assessing, and evaluating the relationships and actions that contribute to the health of individuals and populations’. It can assume many forms and include multiple stakeholders in pursuit of continuous improvement, as in Learning Health Systems (LHSs). There is increasing interest in how the LHS concept allows integration of different knowledge domains to support and achieve better health. Even if definitions of LHSs include engaging users and their family as active participants in aspects of enabling better health for individuals and populations, LHS descriptions emphasize technological solutions, such as the use of information systems. Fewer LHS texts address how interpersonal interactions contribute to the design and improvement of healthcare services.

Objective

We examined the literature on LHS to clarify the role and contributions of co-production in LHS conceptualizations and applications.

Method

First, we undertook a scoping review of LHS conceptualizations. Second, we compared those conceptualizations to the characteristics of LHSs first described by the US Institute of Medicine. Third, we examined the LHS conceptualizations to assess how they bring four types of value co-creation in public services into play: co-production, co-design, co-construction and co-innovation. These were used to describe core ideas, as principles, to guide development.

Result

Among 17 identified LHS conceptualizations, 3 qualified as most comprehensive regarding fidelity to LHS characteristics and their use in multiple settings: (i) the Cincinnati Collaborative LHS Model, (ii) the Dartmouth Coproduction LHS Model and (iii) the Michigan Learning Cycle Model. These conceptualizations exhibit all four types of value co-creation, provide examples of how LHSs can harness co-production and are used to identify principles that can enhance value co-creation: (i) use a shared aim, (ii) navigate towards improved outcomes, (iii) tailor feedback with and for users, (iv) distribute leadership, (v) facilitate interactions, (vi) co-design services and (vii) support self-organization.

Conclusions

The LHS conceptualizations have common features and harness co-production to generate value for individual patients as well as for health systems. They facilitate learning and improvement by integrating supportive technologies into the sociotechnical systems that make up healthcare. Further research on LHS applications in real-world complex settings is needed to unpack how LHSs are grown through coproduction and other types of value co-creation.

Development and Evaluation of an Innovative Web-based Training, Learning, and Sharing (i-TLS) Platform for Social Workers: Hong Kong Jockey Club SMART Family-Link Project (Preprint)

Background

Information and communication technology (ICT) use may enhance social work practice and continuous professional development. Under the Hong Kong Jockey Club SMART Family-Link Project, we developed an innovative web-based training, learning, and sharing platform (i-TLS) to support not only ICT and other learning needs of Hong Kong social workers but also their practice.

Objective

We developed i-TLS with 3 major components (i-Training, i-Learning, and i-Sharing) and assessed its acceptability and impact on facilitating ICT use in family services.

Methods

We described the i-TLS development based on a 4-phase model and evaluated i-TLS using the platform database, Google Analytics, a self-administered survey, and individual phone interviews 1 year after launching.

Results

i-TLS was launched in 12 nongovernmental organizations on July 1, 2019. The COVID-19 outbreak in December 2019 limited face-to-face services, which galvanized digital transformation in social work practice. By July 31, 2020, 313 social workers had registered with i-TLS. Approximately 79.6% (249/313) of users accessed i-TLS at least once in the past 28 days, averaging 3.2 (SD 1.35) platform visits per day and viewing 4.8 (SD 1.42) pages per visit. i-Training provided 41 mini-modules on applying ICT to family services, with 730 enrollments. Approximately 70% (511/730) of users completed the mini-modules and obtained digital mini-certificates. i-Learning provided 112 items of learning resources centered on ICT use in family services, with nearly 4000 page views. i-Sharing had 25 discussion threads with 59 posts. Approximately 53.7% (168/313) of users completed the 1-year evaluation survey, including 7.1% (12/168) who were phone interviewed. The mean i-TLS satisfaction score (out of 10) increased from light (4.99, SD 1.54) to occasional (6.15, SD 1.34) and frequent (6.31, SD 2.29) users. Frequent users showed higher scores (out of 10) than light users for an increase in knowledge (5.84, SD 1.34 vs 4.09, SD 1.74; P<.001), self-efficacy (5.23, SD 1.92 vs 3.96, SD 1.77; P=.02), and knowledge application (6.46, SD 1.33 vs 1.91, SD 1.40; P<.001). Interviewees reported increased ICT use in services and considered i-TLS an acceptable and supportive tool for learning and practice, especially during the pandemic.

Conclusions

i-TLS is acceptable to social workers and enhances their learning and use of ICT in family services. This was achieved through access to self-directed and collaborative learning and sharing of experiences within their practice. Further research on enhancing web-based platforms is needed to expand participation and capacity building among social workers and other health and social care professionals.

Aiming for quality: a global compass for national learning systems

INTRODUCTION

Transforming a health system into a learning one is increasingly recognized as necessary to support the implementation of a national strategic direction on quality with a focus on frontline experience. The approach to a learning system that bridges the gap between practice and policy requires active exploration.

METHODS

This scoping review adapted the methodological framework for scoping studies from Arksey and O'Malley. The central research question focused on common themes for learning to improve the quality of health services at all levels of the national health system, from government policy to point-of-care delivery.

RESULTS

A total of 3507 records were screened, resulting in 101 articles on strategic learning across the health system: health professional level (19%), health organizational level (15%), subnational/national level (26%), multiple levels (35%), and global level (6%). Thirty-five of these articles focused on learning systems at multiple levels of the health system. A national learning system requires attention at the organizational, subnational, and national levels guided by the needs of patients, families, and the community. The compass of the national learning system is centred on four cross-cutting themes across the health system: alignment of priorities, systemwide collaboration, transparency and accountability, and knowledge sharing of real-world evidence generated at the point of care.

CONCLUSION

This paper proposes an approach for building a national learning system to improve the quality of health services. Future research is needed to validate the application of these guiding principles and make improvements based on the findings.

Learning health systems using data to drive healthcare improvement and impact: a systematic review

Background

The transition to electronic health records offers the potential for big data to drive the next frontier in healthcare improvement. Yet there are multiple barriers to harnessing the power of data. The Learning Health System (LHS) has emerged as a model to overcome these barriers, yet there remains limited evidence of impact on delivery or outcomes of healthcare.

Objective

To gather evidence on the effects of LHS data hubs or aligned models that use data to deliver healthcare improvement and impact. Any reported impact on the process, delivery or outcomes of healthcare was captured.

Methods

Systematic review from CINAHL, EMBASE, MEDLINE, Medline in-process and Web of Science PubMed databases, using learning health system, data hub, data-driven, ehealth, informatics, collaborations, partnerships, and translation terms. English-language, peer-reviewed literature published between January 2014 and Sept 2019 was captured, supplemented by a grey literature search. Eligibility criteria included studies of LHS data hubs that reported research translation leading to health impact.

Results

Overall, 1076 titles were identified, with 43 eligible studies, across 23 LHS environments. Most LHS environments were in the United States (n = 18) with others in Canada, UK, Sweden and Australia/NZ. Five (21.7%) produced medium-high level of evidence, which were peer-reviewed publications.

Conclusions

LHS environments are producing impact across multiple continents and settings.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12913-021-06215-8.

Sharing Patient-Controlled Real-World Data Through the Application of the Theory of Commons: Action Research Case Study

Background

Technological advances have radically changed the opportunities for individuals with chronic conditions to practice self-care and to coproduce health care and research. Digital technologies enable patients to perform tasks traditionally carried out by health care professionals in a more convenient way, at lower costs, and without compromising quality. Patients may also share real-world data with other stakeholders to promote individual and population health. However, there is a need for legal frameworks that enable patient privacy and control in such sharing of real-world data. We believe that this need could be met by the conceptualization of patient-controlled real-world data as knowledge commons, which is a resource shared by a group of people.

Objective

This study aimed to propose a conceptual model that describes how patient-controlled real-world data can be shared effectively in chronic care management, in a way that supports individual and population health, while respecting personal data privacy and control.

Methods

An action research approach was used to develop a solution to enable patients, in a self-determined way, to share patient-controlled data to other settings. We chose the context of cystic fibrosis (CF) care in Sweden, where coproduction between patients, their families, and health care professionals is critical in the introduction of new drugs. The first author, who is a lawyer and parent of children with CF, was a driver in the change process. All coauthors collaborated in the analysis. We collected primary and secondary data reflecting changes during the time period from 2012 to 2020, and performed a qualitative content analysis guided by the knowledge commons framework.

Results

Through a series of changes, a national system for enabling patients to share patient-controlled real-world data to different stakeholders in CF care was implemented. The case analysis resulted in a conceptual model consisting of the following three knowledge commons arenas that contributed to patient-controlled real-world data collection, use, and sharing: (1) patient world arena involving the private sphere of patients and families; (2) clinical microsystem arena involving the professional sphere at frontline health care clinics; and (3) round table arena involving multiple stakeholders from different settings. Based on the specification of property rights, as presented in our model, the patient can keep control over personal health information and may grant use rights to other stakeholders.

Conclusions

Health information exchanges for sharing patient-controlled real-world data are pivotal to enable patients, health care professionals, health care funders, researchers, authorities, and the industry to coproduce high-quality care and to introduce and follow-up novel health technologies. Our model proposes how technical and legal structures that protect the integrity and self-determination of patients can be implemented, which may be applicable in other chronic care settings as well.

Using mHealth to Increase the Reach of Local Guidance to Health Professionals as Part of an Institutional Response Plan to the COVID-19 Outbreak: Usage Analysis Study

BACKGROUND

The ongoing coronavirus disease (COVID-19) pandemic forced health jurisdictions worldwide to significantly restructure and reorganize their medical activities. In response to the rapidly evolving body of evidence, a solid communication strategy is needed to increase the reach of and adherence to locally drafted and validated guidance to aide medical staff with COVID-19-related clinical decisions.

OBJECTIVE

We present a usage analysis of a dedicated mobile health (mHealth) platform as part of an institutional knowledge dissemination strategy of COVID-19-related guidance to all health care workers (HCWs) in a large academic hospital.

METHODS

A multidisciplinary team of experts drafted local guidance related to COVID-19. In total, 60 documents and 17 external links were made available through the platform. Documents were disseminated using a recently deployed mHealth platform for HCWs. Targeted dissemination of COVID-19-related content began on March 22, 2020. Using a third-party statistics tool, data concerning user activity and content use was anonymously collected. A quantitative analysis of user activity was performed over a 4-month period, separated into 3 periods: 2 months before (Period A), 2 weeks after (Period B), and 6 weeks following (Period C) targeted dissemination. Regional epidemiological data (daily new COVID-19 cases and total COVID-19-related hospitalizations) was extracted from an official registry.

RESULTS

During the study period, the platform was downloaded by 1233 new users. Consequently, the total number of users increased from 1766 users before Period A to a total of 2999 users at the end of Period C. We observed 27,046 document views, of which 12,728 (47.1%) were COVID-19-related. The highest increase in activity occurred in Period B, rapidly following targeted dissemination, with 7740 COVID-19-related content views, representing 71.2% of total content views within the abovementioned period and 550 daily views of COVID-19-related documents. Total documents consulted per day increased from 117 (IQR 74-160) to 657 (IQR 481-1051), P<.001. This increase in activity followed the epidemiological curbing of newly diagnosed COVID-19 cases, which peaked during Period B. Total active devices doubled from 684 to 1400, daily user activity increased fourfold, and the number of active devices rose from 53 (IQR 40-70) to 210 (IQR 167-297), P<.001. In addition, the number of sessions per day rose from 166 (IQR 110-246) to 704 (IQR 517-1028), P<.001. A persistent but reduced increase in total documents consulted per day (172 [IQR 131-251] versus 117 [IQR 74-160], P<.001) and active devices (71 [IQR 64-89] versus 53 [IQR 40-70]) was observed in Period C compared to Period A, while only 29.8% of the content accessed was COVID-19-related. After targeted dissemination, an immediate increase in activity was observed after push notifications were sent to users.

CONCLUSIONS

The use of an mHealth solution to disseminate time-sensitive medical knowledge seemed to be an effective solution to increase the reach of validated content to a targeted audience.

Formative evaluation of a dashboard to support coproduction of healthcare services in cystic fibrosis

BACKGROUND

Healthcare coproduction engages patients and clinicians to design and execute services, yet little is known about tools that facilitate coproduction. Our objective was to understand uptake, experiences, benefits, and limitations of a dashboard to support patient-clinician partnerships within the cystic fibrosis (CF) community.

METHODS

People living with CF (PwCF) and clinicians co-designed a dashboard that displayed patient-reported and clinical data. Eight CF programmes, including 21 clinicians, and 131 PwCF participated in a pilot study of the dashboard. We conducted descriptive statistics and thematic analyses of surveys (82 PwCF; 21 clinicians); semi-structured interviews (13 PwCF; 8 care teams); and passively-collected usage data.

RESULTS

Two-thirds of the 82 PwCF used the dashboard during a visit, and 59% used it outside a visit. Among 48 PwCF using the dashboard outside the clinic, 92% viewed their health information and 46% documented concerns or requests. Most of the 21 clinicians used the dashboard to support visit planning (76%); fewer used it during a visit (48%). The dashboard supported discussions of what matters most (69% PwCF; 68% clinicians). Several themes emerged: access to patient outcomes data allows users to learn more deeply; participation in pre-visit planning matters; coproduction is made possible by inviting new ways to partner; and lack of integration with existing information technology (IT) systems is limiting.

CONCLUSIONS

A dashboard was feasible to implement and use. Future iterations should provide patients access to their data, be simple to use, and integrate with IT systems in use by clinicians and PwCF.

Therapeutic Inertia in Pediatric Diabetes: Challenges to and Strategies for Overcoming Acceptance of the Status Quo

Despite significant advances in therapies for pediatric type 1 diabetes, achievement of glycemic targets remains elusive, and management remains burdensome for patients and their families. This article identifies common challenges in diabetes management at the patient-provider and health care system levels and proposes practical approaches to overcoming therapeutic inertia to enhance health outcomes for youth with type 1 diabetes.

Organizing for collaboration: An actor-oriented architecture in ImproveCareNow

BACKGROUND

Collaborative learning health systems (CLHSs) enable patients, clinicians, researchers, and others to collaborate at scale to improve outcomes and generate new knowledge. An organizational framework to facilitate this collaboration is the actor-oriented architecture, composed of (a) actors (people, organizations, and databases) with the values and abilities to self-organize; (b) a commons where they create and share resources; and (c) structures, protocols, and processes that facilitate multiactor collaboration. CLHSs may implement a variety of changes to strengthen the actor-oriented architecture and enable more actors to create and share resources.

OBJECTIVE

To describe and measure implementation of elements of the actor-oriented architecture in an existing Collaborative Learning Health System.

METHODS

We used the case of ImproveCareNow, a CLHS improving outcomes in pediatric inflammatory bowel disease, founded in 2006. We traced several network-level indicators of actor-oriented architecture between 2010 and 2016.

RESULTS

We identified measures of actors, the commons, and ways that have made it easier for network member sites to participate. These indicators show ImproveCareNow has made changes in the three elements of the actor-oriented architecture over time.

CONCLUSION

It is possible to measure the implementation of an actor-oriented architecture in a CLHS. The elements of the actor-oriented architecture may provide a conceptual framework for their development and optimization. Metrics such as those described here may be actionable indicators of the "health of the system."