Training the next generation of learning health system scientists

Introduction

The learning health system (LHS) aligns science, informatics, incentives, stakeholders, and culture for continuous improvement and innovation. The Agency for Healthcare Research and Quality and the Patient‐Centered Outcomes Research Institute designed a K12 initiative to grow the number of LHS scientists. We describe approaches developed by 11 funded centers of excellence (COEs) to promote partnerships between scholars and health system leaders and to provide mentored research training.

Methods

Since 2018, the COEs have enlisted faculty, secured institutional resources, partnered with health systems, developed and implemented curricula, recruited scholars, and provided mentored training. Program directors for each COE provided descriptive data on program context, scholar characteristics, stakeholder engagement, scholar experiences with health system partnerships, roles following program completion, and key training challenges.

Results

To date, the 11 COEs have partnered with health systems to train 110 scholars. Nine (82%) programs partner with a Veterans Affairs health system and 9 (82%) partner with safety net providers. Clinically trained scholars (n = 87; 79%) include 70 physicians and 17 scholars in other clinical disciplines. Non‐clinicians (n = 29; 26%) represent diverse fields, dominated by population health sciences. Stakeholder engagement helps scholars understand health system and patient/family needs and priorities, enabling opportunities to conduct embedded research, improve outcomes, and grow skills in translating research methods and findings into practice. Challenges include supporting scholars through roadblocks that threaten to derail projects during their limited program time, ranging from delays in access to data to COVID‐19‐related impediments and shifts in organizational priorities.

Conclusions

Four years into this novel training program, there is evidence of scholars' accomplishments, both in traditional academic terms and in terms of moving along career trajectories that hold the potential to lead and accelerate transformational health system change. Future LHS training efforts should focus on sustainability, including organizational support for scholar activities.

PROTOCOL: Conflict of interest issues when engaging stakeholders in health and healthcare guideline development: a systematic review

This is the protocol for a Campbell systematic review. The overall objective of this study is to gather and summarize the existing literature on conflict of interest issues when engaging stakeholders in guideline development.

A chart review tool to systematically assess the safety of prehospital care for children with out‐of‐hospital cardiac arrest

Objective

Create an easy‐to‐use pediatric out‐of‐hospital cardiac arrest (OHCA)‐specific chart review tool to reliably detect severe adverse safety events (ASEs) in the prehospital care of children with OHCA.

Methods

We revised our previously validated pediatric prehospital adverse event detection system (PEDS) tool, used to evaluate ASEs in the prehospital care of children during emergent calls, to create an OHCA‐specific chart review tool. We developed decision support for reviewers, reviewer training, and a dedicated section for chart data abstraction. We randomly selected 28 charts for independent review by 2 expert reviewers who determined the presence or absence of a severe ASE for each care episode and identified the domain of care and preventability for each ASE. We calculated inter‐rater agreement in the assessment of the presence or absence of a severe ASE using Gwet's first‐order agreement coefficient (AC1).

Results

The PEDS‐OHCA chart review tool has 6 sections, with a minimum of 70 and maximum of 667 total possible fields. We found inter‐rater agreement of 0.83 (95% confidence interval, 0.63–0.99) between our 2 reviewers for the overall detection of a severe ASE and an average time to complete of 8 minutes (range, 2–25 minutes). Inter‐rater agreement in the detection of a severe ASE in each individual domain ranged from 0.36 to 0.96.

Conclusions

The PEDS‐OHCA is the first chart review tool to systematically evaluate the safety and quality of EMS care for children with OHCA. This tool may help improve understanding of the quality of EMS care for children with OHCA, which is essential to improving outcomes.

Strategies to improve adherence and continuation of shorter-term hormonal methods of contraception

BACKGROUND

Worldwide, hormonal contraceptives are among the most popular reversible contraceptives. Despite high perfect-use effectiveness rates, typical-use effectiveness rates for shorter-term methods such as oral and injectable contraceptives are much lower. In large part, this disparity reflects difficulties in ongoing adherence to the contraceptive regimen and low continuation rates. Correct use of contraceptives to ensure effectiveness is vital to reducing unintended pregnancy.

OBJECTIVES

To determine the effectiveness of strategies aiming to improve adherence to, and continuation of, shorter-term hormonal methods of contraception compared with usual family planning care.

SEARCH METHODS

We searched to July 2018 in the following databases (without language restrictions): The Cochrane Central Register of Controlled Trials (CENTRAL; 2018, Issue 7), PubMed via MEDLINE, POPLINE, Web of Science, ClinicalTrials.gov, and the International Clinical Trials Registry Platform (ICTRP).

SELECTION CRITERIA

We included randomized controlled trials (RCTs) comparing strategies aimed to facilitate adherence and continuation of shorter-term hormonal methods of contraception (such as oral contraceptives (OCs), injectable depot medroxyprogesterone acetate (DMPA or Depo-Provera), intravaginal ring, or transdermal patch) with usual family planning care in reproductive age women seeking to avoid pregnancy.

DATA COLLECTION AND ANALYSIS

We used standard methodological procedures recommended by Cochrane. Primary outcomes were continuation or discontinuation of contraceptive method, rates of discontinuation due to adverse events (menstrual disturbances and all other adverse events), and adherence to method use as indicated by missed pills and on-time/late injections. Pregnancy was a secondary outcome.

MAIN RESULTS

We included 10 RCTs involving 6242 women. Six trials provided direct in-person counseling using either multiple counseling contacts or multiple components during one visit. Four trials provided intensive reminders of appointments or next dosing, of which two provided additional educational health information as well as reminders. All trials stated 'usual care' as the comparison.The certainty of the evidence ranged from very low to moderate. Main limitations were risk of bias (associated with poor reporting of methodological detail, lack of blinding, and incomplete outcome data), inconsistency, indirectness, and imprecision.Continuation of hormonal contraceptive methodsIt is uncertain whether intensive counseling improves continuation of hormonal contraceptive methods compared with usual care (OR 1.28, 95% CI 1.07 to 1.54; 2624 participants; 6 studies; I² = 79%; very low certainty evidence). The evidence suggested: if the chance of continuation with usual care is 39%, the chance of continuation with intensive counseling would be between 41% and 50%. The overall pooled OR suggested continuation of improvement, however, when stratified by contraceptive method type, the positive results were restricted to DMPA.It is uncertain whether reminders (+/- educational information) improve continuation of hormonal contraceptive methods compared with usual care (OR 1.33, 95% CI 1.03 to 1.73; 933 participants; 2 studies; I² = 69%; very low certainty evidence).The evidence suggested: if the chance of continuation with usual care is 52%, the chance of continuation with reminders would be between 52% and 65%.Discontinuation due to adverse eventsThe evidence suggested that counseling may be associated with a decreased rate of discontinuation due to adverse events compared with usual care, with a lower rate of discontinuation due to menstrual disturbances (OR 0.20, 95% CI 0.11 to 0.37; 350 participants; 1 study; low certainty evidence), but may make little or no difference to all other adverse events (OR 0.73, 95% CI 0.36 to 1.47; 350 participants; 1 study; low certainty evidence). The evidence suggested: if the chance of discontinuation with usual care due to menstrual disturbances is 32%, the chance of discontinuation with intensive counseling would be between 5% and 15%; and that if the chance of discontinuation with usual care due to other adverse events is 55%, the chance of discontinuation with intensive counseling would be between 30% and 64%.Discontinuation was not reported among trials that investigated the use of reminders (+/- educational information).Adherence Adherence was not reported among trials that investigated the use of intensive counseling.Among trials that investigated reminders (+/- educational information), there was no conclusive evidence of a difference in adherence as indicated by missed pills (MD 0.80, 95% CI -1.22 to 2.82; 73 participants; 1 study; moderate certainty evidence) or by on-time injections (OR 0.84, 95% CI 0.54 to 1.29; 350 participants; 2 studies; I² = 0%; low certainty evidence). The evidence suggested: if the chance of adherence to method use as indicated by on-time injections with usual care is 50%, the chance of adherence with method use as indicated by on-time injections with reminders would be between 35% and 56%.PregnancyThere was no conclusive evidence of a difference in rates of pregnancy between intensive counseling and usual care (OR 1.24, 95% CI 0.98 to 1.57; 1985 participants; 3 studies; I² = 0%, very low certainty evidence). The evidence suggested: if the chance of pregnancy with usual care is 18%, the chance of pregnancy with counseling would be between 18% and 25%.Pregnancy was not reported among trials that investigated the use of reminders (+/- educational information).

AUTHORS' CONCLUSIONS

Despite the importance of this topic, studies have not been published since the last review in 2013 (nine studies) with only one study added in 2019 that neither changed the results nor improved the certainty of evidence.Overall, the certainty of evidence for strategies to improve adherence and continuation of contraceptives is low. Intensive counseling and reminders (with or without educational information) may be associated with improved continuation of shorter-term hormonal contraceptive methods when compared with usual family planning care. However, this should be interpreted with caution due to the low certainty of the evidence. Included trials used a variety of shorter-term hormonal contraceptive methods which may account for the high heterogeneity. It is possible that the effectiveness of strategies for improving adherence and continuation are contingent on the contraceptive method targeted. There was limited reporting of objectively measurable outcomes (e.g. electronic monitoring device) among included studies. Future trials would benefit from standardized definitions and measurements of adherence, and consistent terminology for describing interventions and comparisons. Further research requires larger studies, follow-up of at least one year, and improved reporting of trial methodology.

A national strategy to develop pragmatic clinical trials infrastructure

An important challenge in comparative effectiveness research is the lack of infrastructure to support pragmatic clinical trials, which compare interventions in usual practice settings and subjects. These trials present challenges that differ from those of classical efficacy trials, which are conducted under ideal circumstances, in patients selected for their suitability, and with highly controlled protocols. In 2012, we launched a 1-year learning network to identify high-priority pragmatic clinical trials and to deploy research infrastructure through the NIH Clinical and Translational Science Awards Consortium that could be used to launch and sustain them. The network and infrastructure were initiated as a learning ground and shared resource for investigators and communities interested in developing pragmatic clinical trials. We followed a three-stage process of developing the network, prioritizing proposed trials, and implementing learning exercises that culminated in a 1-day network meeting at the end of the year. The year-long project resulted in five recommendations related to developing the network, enhancing community engagement, addressing regulatory challenges, advancing information technology, and developing research methods. The recommendations can be implemented within 24 months and are designed to lead toward a sustained national infrastructure for pragmatic trials.

Evaluation of abnormal uterine bleeding: comparison of three outpatient procedures within cohorts defined by age and menopausal status

OBJECTIVES

To compare three outpatient methods of endometrial evaluation in terms of performance, patient acceptability and cost-effectiveness.

DESIGN

Pragmatic unblinded trial randomised separately within three groups determined by risk of endometrial cancer.

SETTING

The gynaecology outpatient clinic of a large city hospital in Edinburgh, Scotland.

PARTICIPANTS

Women referred for investigation and management of abnormal bleeding between January 1999 and May 2001.

INTERVENTIONS

Investigations were: blind biopsy alone, hysteroscopy with biopsy, ultrasound evaluation including transvaginal ultrasound, and, in the low-risk group, the option of no investigation. Within this design, two devices for obtaining endometrial biopsy were compared, the Pipelle sampler and the Tao brush.

MAIN OUTCOME MEASURES

Successful (informative) completion of the investigation, acceptability of the investigation method to women, women's satisfaction with clinic care in the short term and at 10 months and 2 years of follow-up, and cost-effectiveness to the end of investigation.

RESULTS

Minor adverse events (e.g. shock, patient distress) did not occur for ultrasound, but occurred in 16% and 10% of women for hysteroscopy and biopsy procedures respectively. Pipelle biopsy provided an acceptable endometrial sample for 79% of moderate-risk women, but only 43% of high-risk women. The Tao brush gave similar performance in moderate-risk women (77%), but was more successful than the Pipelle sampler in postmenopausal (high-risk) women (72%). There were significantly more successful visualizations for ultrasound than for hysteroscopy in both the low-risk and the moderate-risk group, and a similar but non-significant trend in the high-risk group. Ultrasound was significantly better than hysteroscopy at detecting fibroids, but hysteroscopy significantly better for polyps. At the 10-month follow-up, high-risk women who had been investigated by hysteroscopy (with biopsy) had the most positive views of their clinic experience, but this effect had largely disappeared by 24 months. In the moderate-risk group, the subgroup randomised to biopsy alone gave the most negative responses about their clinic experience and health now. Women wishing they had more investigation comprised 22% of moderate-risk women and 38% of low-risk women, but only 14% of postmenopausal women. At follow-up the moderate-risk women (with menstrual bleeding problems), compared with postmenopausal women, had much worse ratings for clinic experience and health now. Resource use tended to be higher in the moderate- and low-risk women. There was minimal difference in cost-effectiveness between investigation options in the high-risk group, with the option involving hysteroscopy being marginally better than ultrasound. The most cost-effective investigation in the moderate-risk group was biopsy alone and in the low-risk group ultrasound.

CONCLUSIONS

Decision-making about investigation would be clarified if postmenopausal women were studied separately from premenopausal women with menstrual bleeding problems. For postmenopausal women exclusion of cancer is a main objective, so once investigation has been completed discharge follows, but in the woman with abnormal menstrual bleeding, even if serious pathology is excluded, the original presenting symptoms require management. About 60% of premenopausal women with abnormal bleeding reported that their symptoms were not 'much improved' at 10 months. Research is needed to understand this phenomenon, and to explore ways to integrate patient factors into optimising evaluation and treatment. The significance of benign pathologies in this group also requires clarification. Given the relatively small differences observed in cost-effectiveness, there is justification for allowing other issues (such as clinician preferences and women's perspectives) to influence decisions as to the investigation method. There is scope to make better use of patient factors to inform decisions as to the most efficient and acceptable method of investigation for an individual woman. Additional analyses, using data available as a result of this study, will contribute to this agenda.

Poly(A) site choice rather than splice site choice governs the regulated production of IgM heavy-chain RNAs

Alternative processing of the immunoglobulin mu primary transcript results in regulated production of mRNAs encoding the secreted (microseconds) and membrane-bound (micro m) form of IgM heavy chain during B-cell development. To elucidate the basis for this control, we analyzed the expression of altered forms of the mu transcription unit. Deletion of intron sequence between the microseconds and micro m exons, which reduces the distance between the two poly(A) sites as well as the distance between micro m splice sites, enhances production of micro m RNA. Correct expression is restored by insertion of heterologous sequences, demonstrating that spacing is indeed the critical aspect. The altered spacing appears to affect poly(A) site usage rather than splice site usage, since it was the distance between the poly(A) sites rather than the distance between splice sites that was found to be decisive. Finally, removal of either the C mu 4 splice donor or the m1 splice acceptor, thus eliminating normal micro m splicing, does not increase usage of the microseconds poly(A) site. We therefore conclude that the major factor in determining the ratio of microseconds to micro m is a poly(A) site choice rather than a splicing choice.

Monitoring herds for Streptococcus suis type 2 by sampling tonsils of slaughter pigs

Heads were removed soon after slaughter from the dressed carcases of 155 pigs belonging to 12 herds with a history of streptococcal meningitis and from 180 pigs from four herds believed to be free from this disease. Deep scrapings from both tonsils were sown on two selective media. Streptococcus suis type 2 was detected in a proportion of pigs from the 12 herds with a history of the disease, including three herds in which no cases were noted during the year this study was made. Pigs in six of these herds had received therapeutic levels of certain antibiotics in their feed as growers. The confirmed detectable tonsillar carrier rates varied between these 12 herds from 20 to 90 per cent and between batches of heads from one herd from 0 to 100 per cent. Carrier rates could not be correlated with disease levels, herd size or husbandry system. S suis type 2 was also detected in pigs from two herds thought to be free of the disease, at rates of 20 and 1.5 per cent.