The effects of on-screen, point of care computer reminders on processes and outcomes of care

Manually-generated reminders delivered on paper: effects on professional practice and patient outcomes

BACKGROUND

Health professionals sometimes do not use the best evidence to treat their patients, in part due to unconscious acts of omission and information overload. Reminders help clinicians overcome these problems by prompting them to recall information that they already know, or by presenting information in a different and more accessible format. Manually-generated reminders delivered on paper are defined as information given to the health professional with each patient or encounter, provided on paper, in which no computer is involved in the production or delivery of the reminder. Manually-generated reminders delivered on paper are relatively cheap interventions, and are especially relevant in settings where electronic clinical records are not widely available and affordable. This review is one of three Cochrane Reviews focused on the effectiveness of reminders in health care.

OBJECTIVES

1. To determine the effectiveness of manually-generated reminders delivered on paper in changing professional practice and improving patient outcomes. 2. To explore whether a number of potential effect modifiers influence the effectiveness of manually-generated reminders delivered on paper.

SEARCH METHODS

We searched CENTRAL, MEDLINE, Embase, CINAHL and two trials registers on 5 December 2018. We searched grey literature, screened individual journals, conference proceedings and relevant systematic reviews, and reviewed reference lists and cited references of included studies.

SELECTION CRITERIA

We included randomised and non-randomised trials assessing the impact of manually-generated reminders delivered on paper as a single intervention (compared with usual care) or added to one or more co-interventions as a multicomponent intervention (compared with the co-intervention(s) without the reminder component) on professional practice or patients' outcomes. We also included randomised and non-randomised trials comparing manually-generated reminders with other quality improvement (QI) interventions.

DATA COLLECTION AND ANALYSIS

Two review authors screened studies for eligibility and abstracted data independently. We extracted the primary outcome as defined by the authors or calculated the median effect size across all reported outcomes in each study. We then calculated the median percentage improvement and interquartile range across the included studies that reported improvement related outcomes, and assessed the certainty of the evidence using the GRADE approach.

MAIN RESULTS

We identified 63 studies (41 cluster-randomised trials, 18 individual randomised trials, and four non-randomised trials) that met all inclusion criteria. Fifty-seven studies reported usable data (64 comparisons). The studies were mainly located in North America (42 studies) and the UK (eight studies). Fifty-four studies took place in outpatient/ambulatory settings. The clinical areas most commonly targeted were cardiovascular disease management (11 studies), cancer screening (10 studies) and preventive care (10 studies), and most studies had physicians as their target population (57 studies). General management of a clinical condition (17 studies), test-ordering (14 studies) and prescription (10 studies) were the behaviours more commonly targeted by the intervention. Forty-eight studies reported changes in professional practice measured as dichotomous process adherence outcomes (e.g. compliance with guidelines recommendations), 16 reported those changes measured as continuous process-of-care outcomes (e.g. number of days with catheters), eight reported dichotomous patient outcomes (e.g. mortality rates) and five reported continuous patient outcomes (e.g. mean systolic blood pressure). Manually-generated reminders delivered on paper probably improve professional practice measured as dichotomous process adherence outcomes) compared with usual care (median improvement 8.45% (IQR 2.54% to 20.58%); 39 comparisons, 40,346 participants; moderate certainty of evidence) and may make little or no difference to continuous process-of-care outcomes (8 comparisons, 3263 participants; low certainty of evidence). Adding manually-generated paper reminders to one or more QI co-interventions may slightly improve professional practice measured as dichotomous process adherence outcomes (median improvement 4.24% (IQR -1.09% to 5.50%); 12 comparisons, 25,359 participants; low certainty of evidence) and probably slightly improve professional practice measured as continuous outcomes (median improvement 0.28 (IQR 0.04 to 0.51); 2 comparisons, 12,372 participants; moderate certainty of evidence). Compared with other QI interventions, manually-generated reminders may slightly decrease professional practice measured as process adherence outcomes (median decrease 7.9% (IQR -0.7% to 11%); 14 comparisons, 21,274 participants; low certainty of evidence). We are uncertain whether manually-generated reminders delivered on paper, compared with usual care or with other QI intervention, lead to better or worse patient outcomes (dichotomous or continuous), as the certainty of the evidence is very low (10 studies, 13 comparisons). Reminders added to other QI interventions may make little or no difference to patient outcomes (dichotomous or continuous) compared with the QI alone (2 studies, 2 comparisons). Regarding resource use, studies reported additional costs per additional point of effectiveness gained, but because of the different currencies and years used the relevance of those figures is uncertain. None of the included studies reported outcomes related to harms or adverse effects.

AUTHORS' CONCLUSIONS

Manually-generated reminders delivered on paper as a single intervention probably lead to small to moderate increases in outcomes related to adherence to clinical recommendations, and they could be used as a single QI intervention. It is uncertain whether reminders should be added to other QI intervention already in place in the health system, although the effects may be positive. If other QI interventions, such as patient or computerised reminders, are available, they should be preferred over manually-generated reminders, but under close evaluation in order to decrease uncertainty about their potential effect.

Effectiveness of a Hospital-Based Computerized Decision Support System on Clinician Recommendations and Patient Outcomes: A Randomized Clinical Trial

IMPORTANCE

Sophisticated evidence-based information resources can filter medical evidence from the literature, integrate it into electronic health records, and generate recommendations tailored to individual patients.

OBJECTIVE

To assess the effectiveness of a computerized clinical decision support system (CDSS) that preappraises evidence and provides health professionals with actionable, patient-specific recommendations at the point of care.

DESIGN, SETTING, AND PARTICIPANTS

Open-label, parallel-group, randomized clinical trial among internal medicine wards of a large Italian general hospital. All analyses in this randomized clinical trial followed the intent-to-treat principle. Between November 1, 2015, and December 31, 2016, patients were randomly assigned to the intervention group, in which CDSS-generated reminders were displayed to physicians, or to the control group, in which reminders were generated but not shown. Data were analyzed between February 1 and July 31, 2018.

INTERVENTIONS

Evidence-Based Medicine Electronic Decision Support (EBMEDS), a commercial CDSS covering a wide array of health conditions across specialties, was integrated into the hospital electronic health records to generate patient-specific recommendations.

MAIN OUTCOMES AND MEASURES

The primary outcome was the resolution rate, the rate at which medical problems identified and alerted by the CDSS were addressed by a change in practice. Secondary outcomes included the length of hospital stay and in-hospital all-cause mortality.

RESULTS

In this randomized clinical trial, 20 563 patients were admitted to the hospital. Of these, 6480 (31.5%) were admitted to the internal medicine wards (study population) and randomized (3242 to CDSS and 3238 to control). The mean (SD) age of patients was 70.5 (17.3) years, and 54.5% were men. In total, 28 394 reminders were generated throughout the course of the trial (median, 3 reminders per patient per hospital stay; interquartile range [IQR], 1-6). These messages led to a change in practice in approximately 4 of 100 patients. The resolution rate was 38.0% (95% CI, 37.2%-38.8%) in the intervention group and 33.7% (95% CI, 32.9%-34.4%) in the control group, corresponding to an odds ratio of 1.21 (95% CI, 1.11-1.32; P < .001). The length of hospital stay did not differ between the groups, with a median time of 8 days (IQR, 5-13 days) for the intervention group and a median time of 8 days (IQR, 5-14 days) for the control group (P = .36). In-hospital all-cause mortality also did not differ between groups (odds ratio, 0.95; 95% CI, 0.77-1.17; P = .59). Alert fatigue did not differ between early and late study periods.

CONCLUSIONS AND RELEVANCE

An international commercial CDSS intervention marginally influenced routine practice in a general hospital, although the change did not statistically significantly affect patient outcomes.

TRIAL REGISTRATION

ClinicalTrials.gov identifier: NCT02577198.

Systematic review and meta-analysis of the provision of preventive care for modifiable chronic disease risk behaviours by mental health services

People with mental illness experience increased chronic disease burden, contributed to by a greater prevalence of modifiable chronic disease risk behaviours. Policies recommend mental health services provide preventive care for such risk behaviours. Provision of such care has not previously been synthesised. This review assessed the provision of preventive care for modifiable chronic disease risk behaviours by mental health services. Four databases were searched from 2006 to 2017. Eligible studies were observational quantitative study designs conducted in mental health services, where preventive care was provided to clients for tobacco smoking, harmful alcohol consumption, inadequate nutrition, or inadequate physical activity. Two reviewers independently screened studies, conducted data extraction and critical appraisal. Results were pooled as proportions of clients receiving or clinicians providing preventive care using random effects meta-analyses, by risk behaviour and preventive care element (ask/assess, advise, assist, arrange). Subgroup analyses were conducted by mental health service type (inpatient, outpatient, other/multiple). Narrative synthesis was used where meta-analysis was not possible. Thirty-eight studies were included with 26 amenable to meta-analyses. Analyses revealed that rates of assessment were highest for smoking (78%, 95% confidence interval [CI]:59%-96%) and lowest for nutrition (17%, 95% CI:1%-35%); with variable rates of care provision for all behaviours, care elements, and across service types, with substantial heterogeneity across analyses. Findings indicated suboptimal and variable provision of preventive care for modifiable chronic disease risk behaviours in mental health services, but should be considered with caution due to the very low quality of cumulative evidence. PROSPERO registration: CRD42016049889.

Effectiveness of electronic point-of-care reminders versus monthly feedback to improve adherence to 10 clinical recommendations in primary care: a cluster randomized clinical trial

BACKGROUND

Numerous studies have analyzed the effectiveness of electronic reminder interventions to improve different clinical conditions, and most have reported a small to moderate effect. Few studies, however, have analyzed reminder systems targeting multiple conditions, and fewer still have compared electronic point-of-care reminders systems with other forms of feedback designed to improve delivery of care.

METHODS

We performed an unblinded cluster randomized clinical trial to compare the effectiveness of an electronic point-of-care reminder system with that of a well-established system providing monthly feedback on adherence to clinical recommendations. The control group received monthly feedback only while the intervention group received monthly feedback in addition to on-screen point-of-care reminders for 10 clinical conditions. The study targeted all physicians and nurses at the 283 primary care centers managed by the Institut Català de la Salut (approximately 6600 professionals).

RESULTS

Following exclusions and randomization, 132 primary care centers (328,728 patients with reminders) were assigned to the intervention group while 137 centers (317,117 patients with reminders) were randomized to the control group. A 20.6% improvement (OR 1.29, 95% CI: 1.25-1.34) in reminder resolution rates was observed in the intervention group. Results varied according to the clinical condition. The most effective reminder was screening for diabetic retinopathy (OR 1.51, 95% CI:1.46-1.57) while the least effective reminders were measurement of glycated hemoglobin (OR: 1.10, 95% CI: 1.07-1.13) and smoking cessation encouragement (OR 1.12, 95% CI: 1.09-1.16).

CONCLUSIONS

Electronic point-of-care reminders were more effective than the existing monthly feedback system at resolving the 10 clinical situations. However, more studies are needed to investigate the variations of the effect observed.

TRIAL REGISTRATION

Current Controlled Trials ISRCTN42391639, 08/10/2012. Retrospectively registered.

Implementation strategies to improve preconception and antenatal care for tobacco smoking, alcohol consumption and weight management: a systematic review protocol

BACKGROUND

Despite existing best practice care recommendations for addressing tobacco smoking, alcohol consumption and weight management in preconception and antenatal care, such recommendations are often not implemented into routine practice. Effective strategies that target known barriers to implementation are key to reducing this evidence to practice gap. The aim of this review is to synthesise the evidence on the effectiveness of implementation strategies in improving the provision of preconception and antenatal care for these modifiable risk factors.

METHODS

Randomised and non-randomised study designs will be eligible for inclusion if they have a parallel control group. We will include studies that either compare an implementation strategy to usual practice or compare two or more strategies. Participants may include any health service providing preconception or antenatal care to women and/or the health professionals working within such a service. The primary outcome will be any measure of the effectiveness of implementation strategies to improve preconception and/or antenatal care for tobacco smoking, alcohol consumption and/or weight management (including care to improve nutrition and/or physical activity). Secondary outcomes will include the effect of the implementation strategy on women's modifiable risk factors, estimates of absolute costs or cost-effectiveness and any reported unintentional consequences. Eligible studies will be identified via searching Cochrane Central Register of Controlled Trials, MEDLINE, EMBASE, Maternity and Infant Care, CINAHL, ProQuest Dissertations and Theses and other sources (e.g. contacting experts in the field). Study selection, data extraction and risk of bias will be assessed independently by two review authors and differences resolved by a third reviewer. If data permits, we will conduct fixed-effects or random-effects meta-analysis where appropriate. If studies do not report the same outcome or there is significant heterogeneity, results will be summarised narratively.

DISCUSSION

This review will identify which implementation strategies are effective in improving the routine provision of preconception and antenatal care for tobacco smoking, alcohol consumption and weight management. Such a review will be of interest to service providers, policy makers and implementation researchers seeking to improve women's modifiable risk factors in preconception and antenatal care settings.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO CRD42019131691.

Implementation of a behavioral medicine approach in physiotherapy: a process evaluation of facilitation methods

Background

In a quasi-experimental study, facilitation was used to support implementation of the behavioral medicine approach in physiotherapy. The facilitation consisted of an individually tailored multifaceted intervention including outreach visits, peer coaching, educational materials, individual goal-setting, video feedback, self-monitoring in a diary, manager support, and information leaflets to patients. A behavioral medicine approach implies a focus on health related behavior change. Clinical behavioral change was initiated but not maintained among the participating physiotherapists. To explain these findings, a deeper understanding of the implementation process is necessary. The aim was therefore to explore the impact mechanisms in the implementation of a behavioral medicine approach in physiotherapy by examining dose, reach, and participant experiences.

Methods

An explorative mixed-methods design was used as a part of a quasi-experimental trial. Twenty four physiotherapists working in primary health care were included in the quasi-experimental trial, and all physiotherapists in the experimental group (n = 15) were included in the current study. A facilitation intervention based mainly on social cognitive theory was tested during a 6-month period. Data were collected during and after the implementation period by self-reports of time allocation regarding participation in different implementation methods, documentation of individual goals, ranking of the most important implementation methods, and semi-structured interviews. Descriptive statistical methods and inductive content analysis were used.

Results

The physiotherapists participated most frequently in the following implementation methods: outreach visits, peer coaching, educational materials, and individual goal-setting. They also considered these methods to be the most important for implementation, contributing to support for learning, practice, memory, emotions, self-management, and time management. However, time management support from the manager was lacking.

Conclusions

The findings indicate that different mechanisms govern the initiation and maintenance of clinical behavior change. The impact mechanisms for initiation of clinical behavior change refers to the use of externally initiated multiple methods, such as feedback on practice, time management, and extrinsic motivation. The lack of self-regulation capability, intrinsic motivation, and continued support after the implementation intervention period were interpreted as possible mechanisms for the failure of maintaining the behavioral change over time.

Towards a Maturity Model for Clinical Decision Support Operations

Clinical decision support (CDS) systems delivered through the electronic health record are an important element of quality and safety initiatives within a health care system. However, managing a large CDS knowledge base can be an overwhelming task for informatics teams. Additionally, it can be difficult for these informatics teams to communicate their goals with external operational stakeholders and define concrete steps for improvement. We aimed to develop a maturity model that describes a roadmap toward organizational functions and processes that help health care systems use CDS more effectively to drive better outcomes. We developed a maturity model for CDS operations through discussions with health care leaders at 80 organizations, iterative model development by four clinical informaticists, and subsequent review with 19 health care organizations. We ceased iterations when feedback from three organizations did not result in any changes to the model. The proposed CDS maturity model includes three main "pillars": "Content Creation," "Analytics and Reporting," and "Governance and Management." Each pillar contains five levels-advancing along each pillar provides CDS teams a deeper understanding of the processes CDS systems are intended to improve. A "roof" represents the CDS functions that become attainable after advancing along each of the pillars. Organizations are not required to advance in order and can develop in one pillar separately from another. However, we hypothesize that optimal deployment of preceding levels and advancing in tandem along the pillars increase the value of organizational investment in higher levels of CDS maturity. In addition to describing the maturity model and its development, we also provide three case studies of health care organizations using the model for self-assessment and determine next steps in CDS development.

Design Process and Utilization of a Novel Clinical Decision Support System for Neuropathic Pain in Primary Care: Mixed Methods Observational Study

Background

Computerized clinical decision support systems (CDSSs) have emerged as an approach to improve compliance of clinicians with clinical practice guidelines (CPGs). Research utilizing CDSS has primarily been conducted in clinical contexts with clear diagnostic criteria such as diabetes and cardiovascular diseases. In contrast, research on CDSS for pain management and more specifically neuropathic pain has been limited. A CDSS for neuropathic pain has the potential to enhance patient care as the challenge of diagnosing and treating neuropathic pain often leads to tension in clinician-patient relationships.

Objective

The aim of this study was to design and evaluate a CDSS aimed at improving the adherence of interprofessional primary care clinicians to CPG for managing neuropathic pain.

Methods

Recommendations from the Canadian CPGs informed the decision pathways. The development of the CDSS format and function involved participation of multiple stakeholders and end users in needs assessment and usability testing. Clinicians, including family medicine physicians, residents, and nurse practitioners, in three academic teaching clinics were trained in the use of the CDSS. Evaluation over one year included the measurement of utilization of the CDSS; change in reported awareness, agreement, and adoption of CPG recommendations; and change in the observed adherence to CPG recommendations.

Results

The usability testing of the CDSS was highly successful in the prototype environment. Deployment in the clinical setting was partially complete by the time of the study, with some limitations in the planned functionality. The study population had a high level of awareness, agreement, and adoption of guideline recommendations before implementation of CDSS. Nevertheless, there was a small and statistically significant improvement in the mean awareness and adoption scores over the year of observation (P=.01 for mean awareness scores at 6 and 12 months compared with baseline, for mean adoption scores at 6 months compared with baseline, and for mean adoption scores at 12 months). Documenting significant findings related to diagnosis of neuropathic pain increased significantly. Clinicians accessed CPG information more frequently than they utilized data entry functions. Nurse practitioners and first year family medicine trainees had higher utilization than physicians.

Conclusions

We observed a small increase in the adherence to CPG recommendations for managing neuropathic pain. Clinicians utilized the CDSS more as a source of knowledge and as a training tool than as an ongoing dynamic decision support.

Healthcare facility-based strategies to improve tuberculosis testing and linkage to care in non-U.S.-born population in the United States: A systematic review

CONTEXT

An estimated 21% of non-U.S.-born persons in the United States have a reactive tuberculin skin test (TST) and are at risk of progressing to TB disease. The effectiveness of strategies by healthcare facilities to improve targeted TB infection testing and linkage to care among this population is unclear.

EVIDENCE ACQUISITION

Following Cochrane guidelines, we searched several sources to identify studies that assessed strategies directed at healthcare providers and/or non-U.S.-born patients in U.S. healthcare facilities.

EVIDENCE SYNTHESIS

Seven studies were eligible. In a randomized controlled trial (RCT), patients with reactive TST who received reminders for follow-up appointments were more likely to attend appointments (risk ratio, RR = 1.05, 95% confidence interval 1.00-1.10), but rates of return in a quasi-RCT study using patient reminders did not significantly differ between study arms (P = 0.520). Patient-provider language concordance in a retrospective cohort study did not increase provider referrals for testing (P = 0.121) or patient testing uptake (P = 0.159). Of three studies evaluating pre and post multifaceted interventions, two increased TB infection testing (from 0% to 77%, p < .001 and RR 2.28, 1.08-4.80) and one increased provider referrals for TST (RR 24.6, 3.5-174). In another pre-post study, electronic reminders to providers increased reading of TSTs (RR 2.84, 1.53-5.25), but only to 25%. All seven studies were at high risk of bias.

CONCLUSIONS

Multifaceted strategies targeting providers may improve targeted TB infection testing in non-U.S.-born populations visiting U.S. healthcare facilities; uncertainties exist due to low-quality evidence. Additional high-quality studies on this topic are needed.

Improving bone mineral density screening in patients with inflammatory bowel disease: a quality improvement report

The prevalence of osteopenia and osteoporosis in patients with inflammatory bowel disease (IBD) is estimated between 17% and 41%, partly due to repeat courses of glucocorticoids which enhance the risk for bone disease. Multiple gastroenterological and endocrine societies have established guidelines for bone mineral density (BMD) screening in patients with IBD, with estimates suggesting providers vary in their adherence. We aimed to improve the rate of BMD screening in patients with IBD in a large academic outpatient practice. Using the Plan-Do-Study-Act (PDSA) model, we first conducted a retrospective review and determined that only 10.8% of patients with IBD in our practice were adequately undergoing BMD screening. Over the course of five PDSA cycles, we conducted three interventions focusing on education and provider reminders. Through an informative lecture, a flyer and an electronic medical record-based prompt, we were able to increase our rate of BMD screening to 81.8%. Current rates of BMD screening in patients with IBD are not adequate. We demonstrate a simple quality improvement initiative that successfully improved our adherence to standards of practice.

The Effects of Integrated IT Support on the Prehospital Stroke Process: Results from a Realistic Experiment

Stroke is a serious condition and the stroke chain of care is a complex. The present study aims to explore the impact of a computerised decision support system (CDSS) for the prehospital stroke process, with focus on work processes and performance. The study used an exploratory approach with a randomised controlled crossover design in a realistic contextualised simulation experiment. The study compared clinical performance among 11 emergency medical services (EMS) teams of 22 EMS clinicians using (1) a computerised decision support system (CDSS) and (2) their usual paper-based process support. Data collection consisted of video recordings, postquestionnaires and post-interviews, and data were analysed using a combination of qualitative and quantitative approaches. In this experiment, using a CDSS improved patient assessment, decision making and compliance to process recommendations. Minimal impact of the CDSS was found on EMS clinicians' self-efficacy, suggesting that even though the system was found to be cumbersome to use it did not have any negative effects on self-efficacy. Negative effects of the CDSS include increased on-scene time and a cognitive burden of using the system, affecting patient interaction and collaboration with team members. The CDSS's overall process advantage to the prehospital stroke process is assumed to lead to a prehospital care that is both safer and of higher quality. The key to user acceptance of a system such as this CDSS is the relative advantages of improved documentation process and the resulting patient journal. This could improve the overall prehospital stroke process.

Antenatal care for alcohol consumption during pregnancy: pregnant women's reported receipt of care and associated characteristics

Background

Antenatal clinical guidelines recommend that during initial and subsequent antenatal visits all pregnant women: have their alcohol consumption assessed; be advised that it is safest not to consume alcohol during pregnancy and of the potential risks of consumption; and be offered referrals for further support if required. However, the extent to which pregnant women attending public antenatal services receive guideline recommended care at these visits, and the characteristics associated with its receipt, is unknown. The purpose of this study was to examine: 1) pregnant women’s reported receipt of guideline recommended care addressing alcohol consumption during pregnancy; 2) characteristics associated with the receipt of care; and 3) pregnant women’s acceptability of care.

Methods

From July 2017 – February 2018 a survey (telephone or online) was undertaken with 1363 pregnant women who had recently visited a public antenatal service in one health district in Australia. Receipt and acceptability of recommended care were assessed via descriptive statistics and associations via logistic regression analyses.

Results

At the initial antenatal visit, less than two thirds (64.3%) of pregnant women reported that they received an assessment of their alcohol consumption and just over one third (34.9%) received advice and referral appropriate to their self-reported level of alcohol consumption since pregnancy recognition. Less than 10% of women received such care at subsequent antenatal visits. Characteristics that significantly increased the odds of receiving all guideline elements at the initial antenatal visit included: less than university attainment (OR = 1.93; 95% CI:1.12, 3.34), not residing in an advantaged area (OR = 2.11; 95% CI:1.17, 3.79), first pregnancy (OR = 1.91; 95% CI:1.22, 2.99) and regional/rural service location (OR = 2.38; 95% CI:1.26, 4.48); and at subsequent visits: younger age (OR = 0.91; 95% CI:0.84, 0.99) and Aboriginal origin (OR = 3.17; 95% CI:1.22, 8.24). Each of the recommended care elements were highly acceptable to pregnant women (88.3–99.4%).

Conclusions

Although care for alcohol consumption is both recommended by clinical guidelines and highly acceptable to pregnant women, its receipt in public antenatal services is suboptimal. There is a need and an opportunity for interventions to support antenatal care providers to routinely and consistently provide such care to all pregnant women.

Effects of a computerised guideline support tool on child healthcare professionals' response to suspicions of child abuse and neglect: a community-based intervention trial

Background

Healthcare professionals’ adherence to guidelines on child protection is not self-evident. This study assessed the effects of a computerised support tool on child healthcare professionals’ adherence to the seven recommended guideline activities, and on time spent seeking information presented in this guideline.

Methods

A community-based intervention trial design was applied, comparing access to a paper-based guideline (control) with access to a paper-based guideline supplemented with a computerised guideline support tool (intervention). A total of 168 child healthcare doctors and nurses working in one large Dutch organisation were allocated to an intervention or control group. Outcomes were professionals’ performance of seven recommended guideline activities and the amount of time spent seeking information presented in the guideline. Professionals’ adherence was measured using two methods: health record analysis and a self-report questionnaire. The questionnaire was also used to collect data on the amount of time spent seeking guideline information.

Results

In total, 152 health records (102 in the intervention group and 50 in the control group) were available for analysis. The tool was registered in 14% of the records in the intervention group. Performance of activities, corrected for intentional non-adherence, was except for one activity, high (range 80–100%); no differences were found between the control and intervention groups. Forty-nine questionnaires (24 in the intervention group and 25 in the control group) were analysed. Sixty-three percent of the questionnaire respondents (15/24) claimed to have used the tool. No differences in guideline adherence were found between the two groups. Respondents in the intervention and control groups spent, on average, 115 and 153 min respectively seeking relevant information presented in the guideline.

Conclusions

The results regarding use of the tool were inconclusive as the outcomes differed per method. In contrast to expectations, performance of guideline activities was high in both groups. The support tool may decrease the amount of time spent on seeking guideline information. However, given the high adherence scores and small number of questionnaire respondents, the outcomes failed to reach statistical significance. Future research should focus on studying the effects of the tool after a longer period of availability.

Electronic supplementary material

The online version of this article (10.1186/s12911-019-0884-y) contains supplementary material, which is available to authorized users.

Health professions digital education on clinical practice guidelines: a systematic review by Digital Health Education collaboration

BACKGROUND

Clinical practice guidelines are an important source of information, designed to help clinicians integrate research evidence into their clinical practice. Digital education is increasingly used for clinical practice guideline dissemination and adoption. Our aim was to evaluate the effectiveness of digital education in improving the adoption of clinical practice guidelines.

METHODS

We performed a systematic review and searched seven electronic databases from January 1990 to September 2018. Two reviewers independently screened studies, extracted data and assessed risk of bias. We included studies in any language evaluating the effectiveness of digital education on clinical practice guidelines compared to other forms of education or no intervention in healthcare professionals. We used the Grading of Recommendations, Assessment, Development and Evaluations (GRADE) approach to assess the quality of the body of evidence.

RESULTS

Seventeen trials involving 2382 participants were included. The included studies were diverse with a largely unclear or high risk of bias. They mostly focused on physicians, evaluated computer-based interventions with limited interactivity and measured participants' knowledge and behaviour. With regard to knowledge, studies comparing the effect of digital education with no intervention showed a moderate, statistically significant difference in favour of digital education intervention (SMD = 0.85, 95% CI 0.16, 1.54; I2 = 83%, n = 3, moderate quality of evidence). Studies comparing the effect of digital education with traditional learning on knowledge showed a small, statistically non-significant difference in favour of digital education (SMD = 0.23, 95% CI - 0.12, 0.59; I2 = 34%, n = 3, moderate quality of evidence). Three studies measured participants' skills and reported mixed results. Of four studies measuring satisfaction, three studies favoured digital education over traditional learning. Of nine studies evaluating healthcare professionals' behaviour change, only one study comparing email-delivered, spaced education intervention to no intervention reported improvement in the intervention group. Of three studies reporting patient outcomes, only one study comparing email-delivered, spaced education games to non-interactive online resources reported modest improvement in the intervention group. The quality of evidence for outcomes other than knowledge was mostly judged as low due to risk of bias, imprecision and/or inconsistency.

CONCLUSIONS

Health professions digital education on clinical practice guidelines is at least as effective as traditional learning and more effective than no intervention in terms of knowledge. Most studies report little or no difference in healthcare professionals' behaviours and patient outcomes. The only intervention shown to improve healthcare professionals' behaviour and modestly patient outcomes was email-delivered, spaced education. Future research should evaluate interactive, simulation-based and spaced forms of digital education and report on outcomes such as skills, behaviour, patient outcomes and cost.

Designing strategies to implement a blunt chest injury care bundle using the behaviour change wheel: a multi-site mixed methods study

Background

Blunt chest injury can lead to significant morbidity and mortality if not treated appropriately. A blunt chest injury care bundle was to be implemented at two sites to guide care.

Aim

To identify facilitators and barriers to the implementation of a blunt chest injury care bundle and design strategies tailored to promote future implementation.

Methods

1) A mixed-method survey based on the theoretical domains framework (TDF) was used to identify barriers and facilitators to the implementation of a blunt chest injury care bundle. This survey was distributed to 441 staff from 12 departments across two hospitals. Quantitative data were analysed using SPSS and qualitative using inductive content analysis.

2) The quantitative and qualitative results from the survey were integrated and mapped to each of the TDF domains.

3) The facilitators and barriers were evaluated using the Behaviour Change Wheel to extract specific intervention functions, policies, behaviour change techniques and implementation strategies. Each phase was assessed against the Affordability, Practicability, Effectiveness and cost-effectiveness, Acceptability, Side-effects or safety and Equity (APEASE) criteria.

Results

One hundred ninety eight staff completed the survey. All departments surveyed were represented. Nine facilitators and six barriers were identified from eight domains of the TDF. Facilitators (TDF domains) were: understanding evidence-informed patient care and understanding risk factors (Knowledge); patient assessment skills and blunt chest injury management skills (Physical skills); identification with professional role (Professional role and identity); belief of consequences of care bundle (Belief about consequences); provision of training and protocol design (Environmental context and resources); and social supports (Social influences). Barriers were: not understanding the term ‘care bundle’ (Knowledge); lacking regional analgesia skills (Physical skills); not remembering to follow protocol (Memory, attention, and decision processes); negative emotions relating to new protocols (Emotions); equipment and protocol access (Environmental context and resources). Implementation strategies were videos, education sessions, visual prompt for electronic medical records and change champions.

Conclusions

Multiple facilitators and barriers were identified that may affect the implementation of a blunt chest injury care bundle. Implementation strategies developed through this process have been included in a plan for implementation in the emergency departments of two hospitals. Evaluation of the implementation is underway.

Electronic supplementary material

The online version of this article (10.1186/s12913-019-4177-z) contains supplementary material, which is available to authorized users.

Improving the vaccination status of liver transplant patients: Effectiveness of personally addressing patients and written recommendations to family physicians after 3 years

Background

After documenting insufficient vaccinations in 444 liver transplant (LT) patients, we investigated the effects of a combined strategy (addressing both patients and primary care physicians) on immunization prevalences after a 3‐year follow‐up.

Methods

The primary care physicians of all adult LT patients from a university center received a written recommendation addressing immunization needs. Patients were asked for their vaccination documents by phone. Changes in immunization rates for vaccine‐preventable diseases after the intervention were calculated based on patients’ immunization documents from 2014‐2016.

Results

The study cohort consisted of 401 patients. Prevalence rates for all vaccinations improved during the intervention period compared to the baseline study: tetanus from 88.3% to 92.8%, diphtheria from 80.0% to 89.0%, hepatitis A from 50.1% to 60.8%, hepatitis B from 66.3% to 77.1%, and pneumococci from 62.8% to 76.3%. The influenza vaccination rate improved, but remained at a low level before (2010:13%, 2011:11.5%, 2012:19%) and during the intervention (2014:27.4%, 2015:24.4%, 2016:23.2%). Despite these vaccinations, the prevalence rates of the quality indicators standard vaccinations completed (2013:17.2%; 2016:21.2%), indicated vaccinations completed (2013:2.7%, 2016:4.5%), and all vaccinations completed (2013:1%; 2016 1.5%) improved only slightly.

Conclusions

Our results demonstrated that intensified communication by written information to the primary care physician and phone calls to the patients improved the number of vaccinations. Nonetheless, a potential for further improvement persists, especially with regard to annual influenza vaccinations.

Evaluating the Feasibility of a Software Prototype Supporting the Management of Multimorbid Seniors: Mixed Methods Study in General Practices

Background

Longitudinal, patient-centered care represents a challenge for general practices. Decision support and reminder systems can offer targeted support.

Objective

The objective of this study was to follow a user-oriented, stepwise approach to develop an add-on for German electronic health record (EHR) systems, which aims to support longitudinal care management of multimorbid seniors, using a flag system displaying patient-centered information relevant for comprehensive health care management. This study evaluated the prototype’s feasibility from both a technical and users’ perspective.

Methods

The study was conducted with 18 general practitioners (GPs) and practice assistants (PAs) from 9 general practices using a mixed methods approach. In all practices, 1 GP and 1 PA tested the software each for 4 multimorbid seniors selected from the practice patient data. Technical feasibility was evaluated by documenting all technical problems. To evaluate the feasibility from the users’ perspective, participants’ responses during the software test were documented. In addition, they completed a self-administered questionnaire, including the validated System Usability Scale (SUS). Data were merged by transforming qualitative data into quantitative data. Analyses were performed using univariate statistics in IBM SPSS statistics.

Results

From a technical perspective, the new software was easy to install and worked without problems. Difficulties during the installation occurred in practices lacking a 64-bit system or a current version of Microsoft .NET. As EHRs used in German practices do not provide an interface to extract the data needed, additional software was required. Incomplete flags for some laboratory data occurred, although this function was implemented in our software as shown in previous tests. From the users’ perspective, the new add-on provided a better overview of relevant patient information, reminded more comprehensively about upcoming examinations, and better supported guideline-based care when compared with their individual practice strategies. A total of 14 out of 18 participants (78%) were interested in using the software long-term. Furthermore, 8 of 9 GPs were willing to pay 5 to 25 Euros (mean 14.75, SD 5.93) monthly for its use. The usability was rated as 75% (43%-95%).

Conclusions

The new EHR add-on was well accepted and achieved a good usability rating measured by the validated SUS. In perspective, the legally consolidated, standardized interface to German EHRs will facilitate the technical integration. In view of the high feasibility, we plan to study the software’s effectiveness in everyday primary care.

Trial Registration

German Clinical Trials Register DRKS00008777; https://www.drks.de/drks_web/navigate.do? navigationId=trial.HTML&TRIAL_ID=DRKS00008777

Effectiveness on hospital-acquired pressure ulcers prevention: a systematic review

The effective approach on pressure ulcer (PU) prevention regarding patient safety in the hospital context was evaluated. Studies were identified from searches in EBSCO host, PubMed, and WebofScience databases from 2009 up to December 2018. Studies were selected if they were published in English, French, Portuguese, or Spanish; incidence of PUs was the primary outcome; participants were adults (≥18 years) admitted in hospital wards and/or units. The review included 26 studies. Studies related to prophylactic dressings applied in the sacrum, trochanters, and/or heels, education for health care professionals, and preventive skin care and system reminders on-screen inpatient care plan were effective in decreasing PUs. Most of the studies related to multiple intervention programmes were effective in decreasing PU occurrence. Single interventions, namely support surfaces and repositioning, were not always effective in preventing PUs. Repositioning only was effective when supported by technological pressure-mapping feedback or by a patient positioning system. Risk-assessment tools are not effective in preventing PUs. PUs in the hospital context are still a worldwide issue related to patient safety. Multiple intervention programmes were more effective in decreasing PU occurrence than single interventions in isolation. Single interventions (prophylactic dressings, support surfaces, repositioning, preventive skin care, system reminders, and education for health care professionals) were effective in decreasing PUs, which was always in compliance with other preventive measures. These results provide an overview of effective approaches that should be considered when establishing evidence-based guidelines to hospital health care professionals and administrators for clinical practice effective in preventing PUs.

Parent eReferral to Tobacco Quitline: A Pragmatic Randomized Trial in Pediatric Primary Care

INTRODUCTION

Quitlines are effective in helping smokers quit, but pediatrician quitline referral rates are low, and few parents who smoke use the service. This study compared enrollment of parents who smoke in the quitline using electronic referral with that using manual referral.

STUDY DESIGN

The study was designed as a pragmatic RCT.

SETTING/PARTICIPANTS

Participants were recruited from one large, urban pediatric primary care site in Philadelphia, Pennsylvania with a high percentage of low-income families. Participants included adult parents who smoked and were present at their child's healthcare visit.

INTERVENTION

Pediatricians screened for tobacco use; smokers were given brief advice to quit and, if interested in quitting, were referred to the quitline. The eReferral ("warm handoff") involved electronically sending parent information to the quitline (parent received a call within 24-48 hours). Control group procedures were identical to eReferral, except the quitline number was provided to the parent. Data were collected between March 2017 and February 2018 and analyzed in 2018.

MAIN OUTCOME MEASURES

The primary outcome was the proportion of parents enrolled in quitline treatment. Secondary outcomes included parent factors (e.g., demographics, nicotine dependence, and quitting motivation) associated with successful enrollment. Number of quitline contacts was also explored.

RESULTS

During the study period, in the eReferral group, 10.3% (24 of 233) of parents who smoked and were interested in quitting enrolled in the quitline, whereas only 2.0% (5 of 251) of them in the control group enrolled in the quitline-a difference of 8.3% (95% CI=4.0, 12.6). Parents aged ≥50 years enrolled in the quitline more frequently. Although more parents in the eReferral group connected to the quitline, among parents who had at least one quitline contact, there was no significant difference in the mean number of quitline contacts between eReferral and control groups (mean, 2.04 vs 2.40 calls; difference, 0.36 [95% CI=0.35, 1.06]).

CONCLUSIONS

Smoking parent eReferral from pediatric primary care may increase quitline enrollment and could be adopted by practices interested in increasing rates of parent treatment.

TRIAL REGISTRATION

This study is registered at www.clinicaltrials.gov NCT02997735.

Local opinion leaders: effects on professional practice and healthcare outcomes

BACKGROUND

Clinical practice is not always evidence-based and, therefore, may not optimise patient outcomes. Local opinion leaders (OLs) are individuals perceived as credible and trustworthy, who disseminate and implement best evidence, for instance through informal one-to-one teaching or community outreach education visits. The use of OLs is a promising strategy to bridge evidence-practice gaps. This is an update of a Cochrane review published in 2011.

OBJECTIVES

To assess the effectiveness of local opinion leaders to improve healthcare professionals' compliance with evidence-based practice and patient outcomes.

SEARCH METHODS

We searched CENTRAL, MEDLINE, Embase, three other databases and two trials registers on 3 July 2018, together with searching reference lists of included studies and contacting experts in the field.

SELECTION CRITERIA

We considered randomised studies comparing the effects of local opinion leaders, either alone or with a single or more intervention(s) to disseminate evidence-based practice, with no intervention, a single intervention, or the same single or more intervention(s). Eligible studies were those reporting objective measures of professional performance, for example, the percentage of patients being prescribed a specific drug or health outcomes, or both. We included all studies independently of the method used to identify OLs.

DATA COLLECTION AND ANALYSIS

We used standard Cochrane procedures in this review. The main comparison was (i) between any intervention involving OLs (OLs alone, OLs with a single or more intervention(s)) versus any comparison intervention (no intervention, a single intervention, or the same single or more intervention(s)). We also made four secondary comparisons: ii) OLs alone versus no intervention, iii) OLs alone versus a single intervention, iv) OLs, with a single or more intervention(s) versus the same single or more intervention(s), and v) OLs with a single or more intervention(s) versus no intervention.

MAIN RESULTS

We included 24 studies, involving more than 337 hospitals, 350 primary care practices, 3005 healthcare professionals, and 29,167 patients (not all studies reported this information). A majority of studies were from North America, and all were conducted in high-income countries. Eighteen of these studies (21 comparisons, 71 compliance outcomes) contributed to the median adjusted risk difference (RD) for the main comparison. The median duration of follow-up was 12 months (range 2 to 30 months). The results suggested that the OL interventions probably improve healthcare professionals' compliance with evidence-based practice (10.8% absolute improvement in compliance, interquartile range (IQR): 3.5% to 14.6%; moderate-certainty evidence).Results for the secondary comparisons also suggested that OLs probably improve compliance with evidence-based practice (moderate-certainty evidence): i) OLs alone versus no intervention: RD (IQR): 9.15% (-0.3% to 15%); ii) OLs alone versus a single intervention: RD (range): 13.8% (12% to 15.5%); iii) OLs, with a single or more intervention(s) versus the same single or more intervention(s): RD (IQR): 7.1% (-1.4% to 19%); iv) OLs with a single or more intervention(s) versus no intervention: RD (IQR):10.25% (0.6% to 15.75%).It is uncertain if OLs alone, or in combination with other intervention(s), may lead to improved patient outcomes (3 studies; 5 dichotomous outcomes) since the certainty of evidence was very low. For two of the secondary comparisons, the IQR included the possibility of a small negative effect of the OL intervention. Possible explanations for the occasional negative effects are, for example, the possibility that the OLs may have prioritised some outcomes, at the expense of others, or that an unaccounted outcome difference at baseline, may have given a faulty impression of a negative effect of the intervention at follow-up. No study reported on costs or cost-effectiveness.We were unable to determine the comparative effectiveness of different approaches to identifying OLs, as most studies used the sociometric method. Nor could we determine which methods used by OLs to educate their peers were most effective, as the methods were poorly described in most studies. In addition, we could not determine whether OL teams were more effective than single OLs.

AUTHORS' CONCLUSIONS

Local opinion leaders alone, or in combination with other interventions, can be effective in promoting evidence-based practice, but the effectiveness varies both within and between studies.The effect on patient outcomes is uncertain. The costs and the cost-effectiveness of the intervention(s) is unknown. These results are based on heterogeneous studies differing in types of intervention, setting, and outcomes. In most studies, the role and actions of the OL were not clearly described, and we cannot, therefore, comment on strategies to enhance their effectiveness. It is also not clear whether the methods used to identify OLs are important for their effectiveness, or whether the effect differs if education is delivered by single OLs or by multidisciplinary OL teams. Further research may help us to understand how these factors affect the effectiveness of OLs.

Understanding the use of digital technology to promote human papillomavirus vaccination - A RE-AIM framework approach

The human papillomavirus virus (HPV) vaccine is effective at preventing various cancers, but coverage falls short of targets that are needed for community protection. Here, we use the RE-AIM implementation framework (Reach, Effectiveness, Adoption, Implementation, Maintenance) to understand how text, email, and electronic health record (EHR) reminders and social media campaigns can be used as part of policy and practice interventions to increase HPV vaccination. These technology-based interventions could be used together and mainstreamed into clinical and system-based practice to have the greatest impact. Of the interventions explored, text-based, email-based, and EHR reminders have the most evidence behind them to support their effectiveness. While there are several studies of promotion of the HPV vaccine on social media, more studies are needed to demonstrate their effects and better methods are needed to be able to attribute results to these interventions.

The effect of computerized decision support systems on cardiovascular risk factors: a systematic review and meta-analysis

Background

Cardiovascular risk management (CVRM) is notoriously difficult because of multi-morbidity and the different phenotypes and severities of cardiovascular disease. Computerized decision support systems (CDSS) enable the clinician to integrate the latest scientific evidence and patient information into tailored strategies. The effect on cardiovascular risk factor management is yet to be confirmed.

Methods

We performed a systematic review and meta-analysis evaluating the effects of CDSS on CVRM, defined as the change in absolute values and attainment of treatment goals of systolic blood pressure (SBP), low density lipoprotein cholesterol (LDL-c) and HbA1c. Also, CDSS characteristics related to more effective CVRM were identified. Eligible articles were methodologically appraised using the Cochrane risk of bias tool. We calculated mean differences, relative risks, and if appropriate (I² < 70%), pooled the results using a random-effects model.

Results

Of the 14,335 studies identified, 22 were included. Four studies reported on SBP, 3 on LDL-c, 10 on CVRM in patients with type II diabetes and 5 on guideline adherence. The CDSSs varied considerably in technical performance and content. Heterogeneity of results was such that quantitative pooling was often not appropriate. Among CVRM patients, the results tended towards a beneficial effect of CDSS, but only LDL-c target attainment in diabetes patients reached statistical significance. Prompting, integration into the electronical health record, patient empowerment, and medication support were related to more effective CVRM.

Conclusion

We did not find a clear clinical benefit from CDSS in cardiovascular risk factor levels and target attainment. Some features of CDSS seem more promising than others. However, the variability in CDSS characteristics and heterogeneity of the results – emphasizing the immaturity of this research area - limit stronger conclusions. Clinical relevance of CDSS in CVRM might additionally be sought in the improvement of shared decision making and patient empowerment.

Electronic supplementary material

The online version of this article (10.1186/s12911-019-0824-x) contains supplementary material, which is available to authorized users.

Development and Evaluation of a Mobile Decision Support System for Hypertension Management in the Primary Care Setting in Brazil: Mixed-Methods Field Study on Usability, Feasibility, and Utility

Background

Despite being an important cardiovascular risk factor, hypertension has low control levels worldwide. Computerized clinical decision support systems (CDSSs) might be effective in reducing blood pressure with a potential impact in reducing cardiovascular risk.

Objective

The goal of the research was to evaluate the feasibility, usability, and utility of a CDSS, TeleHAS (tele–hipertensão arterial sistêmica, or arterial hypertension system), in the care of patients with hypertension in the context of a primary care setting in a middle-income country.

Methods

The TeleHAS app consists of a platform integrating clinical and laboratory data on a particular patient, from which it performs cardiovascular risk calculation and provides evidence-based recommendations derived from Brazilian and international guidelines for the management of hypertension and cardiovascular risk. Ten family physicians from different primary care units in the city of Montes Claros, Brazil, were randomly selected to use the CDSS for the care of hypertensive patients for 6 months. After 3 and 6 months, the feasibility, usability, and utility of the CDSS in the routine care of the health team was evaluated through a standardized questionnaire and semistructured interviews.

Results

Throughout the study, clinicians registered 535 patients with hypertension, at an average of 1.24 consultations per patient. Women accounted for 80% (8/10) of participant doctors, median age was 31.5 years (interquartile range 27 to 59 years). As for feasibility, 100% of medical users claimed it was possible to use the app in the primary care setting, and for 80% (8/10) of them it was easy to incorporate its use into the daily routine and home visits. Nevertheless, 70% (7/10) of physicians claimed that the time taken to fill out the CDSS causes significant delays in service. Clinicians evaluated TeleHAS as good (8/10, 80% of users), with easy completion and friendly interface (10/10, 100%) and the potential to improve patients’ treatment (10/10, 100%). A total of 90% (9/10) of physicians had access to new knowledge about cardiovascular risk and hypertension through the app recommendations and found it useful to promote prevention and optimize treatment.

Conclusions

In this study, a CDSS developed to assist the management of patients with hypertension was feasible in the context of a primary health care setting in a middle-income country, with good user satisfaction and the potential to improve adherence to evidence-based practices.

An Evidence-Based Health Care Knowledge Integration System: Assessment Protocol

BACKGROUND

The rapid advancements in health care can make it difficult for general physicians and specialists alike to keep their knowledge up to date. In medicine today, there are deficiencies in the application of knowledge translation (KT) in clinical practice. Some medical procedures are not required, and therefore, no value is added to the patient's care. These unnecessary procedures increase pressures on the health care system's resources, reduce the quality of care, and expose the patients to stress and to other potential risks. KT tools and better access to medical recommendations can lead to improvements in physicians' decision-making processes depending on the patient's specific clinical situation. These tools can provide the physicians with the available options and promote an efficient professional practice. Software for the Evolution of Knowledge in MEDicine (SEKMED) is a technological solution providing access to high-quality evidence, based on just-in-time principles, in the application of medical recommendations for clinical decision-making processes recognized by community members, accreditation bodies, the recommendations from medical specialty societies made available through campaigns such as Choosing Wisely, and different standards or accreditive bodies.

OBJECTIVE

The main objective of this protocol is to assess the usefulness of the SEKMED platform used within a real working clinical practice, specifically the Centre intégré de santé et des services sociaux de l'Outaouais in Quebec, Canada. To achieve our main objective, 20 emergency physicians from the Hull and Gatineau Hospitals participate in the project as well as 20 patient care unit physicians from the Hull Hospital. In addition, 10 external students or residents studying family medicine from McGill University will also participate in our study.

METHODS

The project is divided into 4 phases: (1) orientation; (2) data synthesis; (3) develop and validate the recommendations; and (4) implement, monitor, and update the recommendations. These phases will enable us to meet our 6 specific research objectives that aim to measure the integration of recommendations in clinical practices, the before and after improvements in practices, the value attributed by physicians to recommendations, the user's platform experience, the educational benefits according to medical students, and the organizational benefits according to stakeholders. The knowledge gained during each phase will be applied on an iterative and continuous basis to all other phases over a period of 2 years.

RESULTS

This project was funded in April 2018 by the Fonds de soutien à l'innovation en santé et en services sociaux for 24 months. Ethics approval has been attained, the study began in June 2018, the data collection will be complete at the end of December 2019, and the data analysis will start in winter 2020. Both major city hospitals in the Outaouais region, Quebec, Canada, have agreed to participate in the project.

CONCLUSIONS

If results show preliminary efficacy and usability of the system, a large-scale implementation will be conducted.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

PRR1-10.2196/11754.

Developing and evaluating a tool to measure general practice productivity: a multimethod study

Background

Systems for measuring the performance of general practices are extremely limited.

Objectives

The aim was to develop, pilot test and evaluate a measure of productivity that can be applied across all typical general practices in England, and that may result in improvements in practice, thereby leading to better patient outcomes.

Methods

Stage 1 – the approach used was based on the Productivity Measurement and Enhancement System (ProMES). Through 16 workshops with 80 general practice staff and 72 patient representatives, the objectives of general practices were identified, as were indicators that could measure these objectives and systems to convert the indicators into an effectiveness score and a productivity index. This was followed by a consensus exercise involving a face-to-face meeting with 16 stakeholders and an online survey with 27 respondents. An online version of the tool [termed the General Practice Effectiveness Tool (GPET)] and detailed guidance were created. Stage 2 – 51 practices were trained to use the GPET for up to 6 months, entering data on each indicator monthly and getting automated feedback on changes in effectiveness over time. The feasibility and acceptability of the GPET were examined via 38 telephone interviews with practice representatives, an online survey of practice managers and two focus groups with patient representatives.

Results

The workshops resulted in 11 objectives across four performance areas: (1) clinical care, (2) practice management, (3) patient focus and (4) external focus. These were measured by 52 indicators, gathered from clinical information systems, practice records, checklists, a short patient questionnaire and a short staff questionnaire. The consensus exercise suggested that this model was appropriate, but that the tool would be of more benefit in tracking productivity within practices than in performance management. Thirty-eight out of 51 practices provided monthly data, but only 28 practices did so for the full period. Limited time and personnel changes made participation difficult for some. Over the pilot period, practice effectiveness increased significantly. Perceptions of the GPET were varied. Usefulness was given an average rating of 4.5 out of 10.0. Ease of use was more positive, scoring 5.6 out of 10.0. Five indicators were highlighted as problematic to gather, and 27% of practices had difficulties entering data. Feedback from interviews suggested difficulties using the online system and finding time to make use of feedback. Most practices could not provide sufficient monthly financial data to calculate a conventional productivity index.

Limitations

It was not possible to create a measure that provides comparability between all practices, and most practices could not provide sufficient financial data to create a productivity index, leaving an effectiveness measure instead. Having a relatively small number of practices, with no control group, limited this study, and there was a limited timescale for the testing and evaluation.

Implications

The GPET has demonstrated some viability as a tool to aid practice improvement. The model devised could serve as a basis for measuring effectiveness in general practice more widely.

Future work

Some additional research is needed to refine the GPET. Enhanced testing with a control sample would evaluate whether or not it is the use of the GPET that leads to improved performance.

Funding

The National Institute for Health Research Health Services and Delivery Research programme.

Implementation of gestational weight gain guidelines - what's more effective for ensuring weight recording in pregnancy?

Background

Pregnant women who gain weight in accordance with guidelines have the lowest risk of pregnancy and birth-related complications. However, evidence-practice gaps often exist. To address pregnancy weight management barriers, a stepped implementation science approach was used, comprising targeted in-services, provision of scales for clinic rooms, and changes to routine weight recording in a hospital electronic medical record. The aim of this study was to assess the cumulative influence of evidence-based interventions on staff’s compliance to recording of antenatal weights.

Methods

Retrospective data analysis of weight recording over three 15-month cohorts across April 2014–December 2017. Variables calculated from data included: proportion of women with weight recorded at booking and proportion of women who had a weight recorded at each visit. Generalised estimating equation modelling was used to examine differences in weight recording compliance rates between cohorts, pre-pregnancy body mass index categories, model of care and clinicians.

Results

There were approximately 13,000 pregnancies in each cohort. The proportion of women who had a weight recorded at each visit per cohort differed significantly between cohorts from 4.2% (baseline), 18.9% (scales and in-services) to 61.8% (medical record prompts), p < 0.001.

Conclusion

Significant improvements were achieved through systematic barrier analysis and subsequent mapping and implementation of appropriate and effective interventions. Improvements were observed across the entire service, in all models of care with all professional groups demonstrating increased recording of weights.

Exploring the role of competing demands and routines during the implementation of a self-management tool for type 2 diabetes: a theory-based qualitative interview study

BACKGROUND

The implementation of new medical interventions into routine care involves healthcare professionals adopting new clinical behaviours and changing existing ones. Whilst theory-based approaches can help understand healthcare professionals' behaviours, such approaches often focus on a single behaviour and conceptualise its performance in terms of an underlying reflective process. Such approaches fail to consider the impact of non-reflective influences (e.g. habit and automaticity) and how the myriad of competing demands for their time may influence uptake. The current study aimed to apply a dual process theoretical approach to account for reflective and automatic determinants of healthcare professional behaviour while integrating a multiple behaviour approach to understanding the implementation and use of a new self-management tool by healthcare professionals in the context of diabetes care.

METHODS

Following Diabetes UK's national release of the 'Information Prescription' (DUK IP; a self-management tool targeting the management of cholesterol, blood pressure and HbA1c) in January 2015, we conducted semi-structured interviews with 13 healthcare professionals (general practitioners and nurses) who had started to use the DUK IP during consultations to provide self-management advice to people with type 2 diabetes. A theory-based topic guide included pre-specified constructs from a previously developed logic model. We elicited healthcare professionals' views on reflective processes (outcome expectations, self-efficacy, intention, action and coping planning), automatic processes (habit), and multiple behaviour processes (goal priority, goal conflict and goal facilitation). All interviews were audio recorded and transcribed verbatim and all transcripts were independently double coded and analysed using content analysis.

RESULTS

The majority of healthcare professionals interviewed reported strong intentions to use the DUK IP and having formed a habit of using them after a minimum of one month continuous use. Pop-up cues in the electronic patient records were perceived to facilitate the use of the tool. Factors that conflicted with the use of the DUK IP included existing pathways of providing self-management advice.

CONCLUSION

Data suggests that constructs from dual process and multiple behaviour approaches are useful to provide supplemental understanding of the implementation of new self-management tools such as the DUK IP and may help to advance behavioural approaches to implementation science.

Enhancing the Impact of Implementation Strategies in Healthcare: A Research Agenda

The field of implementation science was developed to better understand the factors that facilitate or impede implementation and generate evidence for implementation strategies. In this article, we briefly review progress in implementation science, and suggest five priorities for enhancing the impact of implementation strategies. Specifically, we suggest the need to: (1) enhance methods for designing and tailoring implementation strategies; (2) specify and test mechanisms of change; (3) conduct more effectiveness research on discrete, multi-faceted, and tailored implementation strategies; (4) increase economic evaluations of implementation strategies; and (5) improve the tracking and reporting of implementation strategies. We believe that pursuing these priorities will advance implementation science by helping us to understand when, where, why, and how implementation strategies improve implementation effectiveness and subsequent health outcomes.

Effectiveness of implementation strategies for the improvement of guideline and protocol adherence in emergency care: a systematic review

OBJECTIVE

Guideline and protocol adherence in prehospital and in-hospital emergency departments (EDs) is suboptimal. Therefore, the objective of this systematic review was to identify effective strategies for improving guideline and protocol adherence in prehospital and ED settings.

DESIGN

Systematic review.

DATA SOURCES

PubMed (including MEDLINE), CINAHL, EMBASE and Cochrane.

METHODS

We selected (quasi) experimental studies published between 2004 and 2018 that used strategies to increase guideline and protocol adherence in prehospital and in-hospital emergency care. Pairs of two independent reviewers performed the selection process, quality assessment and data extraction.

RESULTS

Eleven studies were included, nine of which were performed in the ED setting and two studies were performed in a combined prehospital and ED setting. For the ED setting, the studies indicated that educational strategies as sole intervention, and educational strategies in combination with audit and feedback, are probably effective in improving guideline adherence. Sole use of reminders in the ED setting also showed positive effects. The two studies in the combined prehospital and ED setting showed similar results for the sole use of educational interventions.

CONCLUSIONS

Our review does not allow firm conclusion on how to promote guideline and protocol adherence in prehospital emergency care, or the combination of prehospital and ED care. For ED settings, the sole use of reminders or educational interventions and the use of multifaceted strategies of education combined with audit and feedback are all likely to be effective in improving guideline adherence.

What maximizes the effectiveness and implementation of technology-based interventions to support healthcare professional practice? A systematic literature review

Background

Technological support may be crucial in optimizing healthcare professional practice and improving patient outcomes. A focus on electronic health records has left other technological supports relatively neglected. Additionally, there has been no comparison between different types of technology-based interventions, and the importance of delivery setting on the implementation of technology-based interventions to change professional practice. Consequently, there is a need to synthesise and examine intervention characteristics using a methodology suited to identifying important features of effective interventions, and the barriers and facilitators to implementation. Three aims were addressed: to identify interventions with a technological component that are successful at changing professional practice, to determine if and how such interventions are theory-based, and to examine barriers and facilitators to successful implementation.

Methods

A literature review informed by realist review methods was conducted involving a systematic search of studies reporting either: (1) behavior change interventions that included technology to support professional practice change; or (2) barriers and facilitators to implementation of technological interventions. Extracted data was quantitative and qualitative, and included setting, target professionals, and use of Behaviour Change Techniques (BCTs). The primary outcome was a change in professional practice. A thematic analysis was conducted on studies reporting barriers and facilitators of implementation.

Results

Sixty-nine studies met the inclusion criteria; 48 (27 randomized controlled trials) reported behavior change interventions and 21 reported practicalities of implementation. The most successful technological intervention was decision support providing healthcare professionals with knowledge and/or person-specific information to assist with patient management. Successful technologies were more likely to operationalise BCTs, particularly “instruction on how to perform the behavior”. Facilitators of implementation included aligning studies with organisational initiatives, ensuring senior peer endorsement, and integration into clinical workload. Barriers included organisational challenges, and design, content and technical issues of technology-based interventions.

Conclusions

Technological interventions must focus on providing decision support for clinical practice using recognized behavior change techniques. Interventions must consider organizational context, clinical workload, and have clearly defined benefits for improving practice and patient outcomes.

Electronic supplementary material

The online version of this article (10.1186/s12911-018-0661-3) contains supplementary material, which is available to authorized users.

Barriers to a software reminder system for risk assessment of stroke in atrial fibrillation: a process evaluation of a cluster randomised trial in general practice

BACKGROUND

Oral anticoagulants reduce the risk of stroke in patients with atrial fibrillation (AF), but are underused. AURAS-AF (AUtomated Risk Assessment for Stroke in AF) is a software tool designed to identify eligible patients and promote discussions within consultations about initiating anticoagulants.

AIM

To investigate the implementation of the software in UK general practice.

DESIGN AND SETTING

Process evaluation involving 23 practices randomly allocated to use AURAS-AF during a cluster randomised trial.

METHOD

An initial invitation to discuss anticoagulation was followed by screen reminders appearing during consultations until a decision had been made. The reminders required responses, giving reasons for cases where an anticoagulant was not initiated. Qualitative interviews with clinicians and patients explored acceptability and usability.

RESULTS

In a sample of 476 patients eligible for the invitation letter, only 159 (33.4%) were considered suitable for invitation by their GPs. Reasons given were frequently based on frailty, and risk of falls or haemorrhage. Of those invited, 35 (22%) started an anticoagulant (7.4% of those originally identified). A total of 1695 main-screen reminders occurred in 940 patients. In 883 instances, the decision was taken not to initiate and a range of reasons offered. Interviews with 15 patients and seven clinicians indicated that the intervention was acceptable, though the issue of disruptive screen reminders was raised.

CONCLUSION

Automated risk assessment for stroke in atrial fibrillation and prompting during consultations are feasible and generally acceptable, but did not overcome concerns about frailty and risk of haemorrhage as barriers to anticoagulant uptake.

Evidence gap map of performance measurement and management in primary care delivery systems in low- and middle-income countries - Study protocol

Background . For the last two decades there has been growing interest in governmental and global health stakeholders about the role that performance measurement and management systems can play for the production of high-quality and safely delivered primary care services. Despite recognition and interest, the gaps in evidence in this field of research and practice in low- and middle-income countries remain poorly characterized. This study will develop an evidence gap map in the area of performance management in primary care delivery systems in low- and middle-income countries. Methods. The evidence gap map will follow the methodology developed by 3Ie, the International Initiative for Impact Evaluation, to systematically map evidence and research gaps. The process starts with the development of the scope by creating an evidence-informed framework that helps identify the interventions and outcomes of relevance as well as help define inclusion and exclusion criteria. A search strategy is then developed to guide the systematic search of the literature, covering the following databases: Medline (Ovid), Embase (Ovid), CAB Global Health (Ovid), CINAHL (Ebsco), Cochrane Library, Scopus (Elsevier), and Econlit (Ovid). Sources of grey literature are also searched. Studies that meet the inclusion criteria are systematically coded, extracting data on intervention, outcome, measures, context, geography, equity, and study design. Systematic reviews are also critically appraised using an existing standard checklist. Impact evaluations are not appraised but will be coded according to study design. The process of map-building ends with the creation of an evidence gap map graphic that displays the available evidence according to the intervention and outcome framework of interest. Discussion . Implications arising from the evidence map will be discussed in a separate paper that will summarize findings and make recommendations for the development of a prioritized research agenda.

Reducing physician voiding cystourethrogram ordering in children with first febrile urinary tract infection: evaluation of a purposefully sequenced educational intervention

BACKGROUND

Physicians often fail to implement clinical practice guidelines. Our aim was to evaluate whether a purposefully sequenced, multifaceted educational intervention would increase physician adherence to a guideline for voiding cystourethrogram (VCUG) use following first urinary tract infection (UTI) in young children.

METHODS

Using a single centre, pretest-posttest design, we compared the proportion of guideline adherent VCUG orders and the VCUG ordering rate before and after three educational interventions (interactive lecture, clinical pathway, faxed reminder) selected and sequenced according to the PRECEDE (Predisposing, Reinforcing and Enabling Constructs in Educational Diagnosis and Evaluation) health promotion model.

RESULTS

One hundred and nine physicians ordered 219 VCUGs for 219 children. Following the interventions, there was an increase in the monthly proportion of adherent VCUGs ordered by pediatricians (analysis of variance (ANOVA) F(2,29) = 3.38, p = .048) and non-pediatricians (ANOVA F(2,28) = 14.71, p < .001). Also, pediatricians decreased their monthly VCUG ordering rate (linear trend incidence rate ratio 0.74, 95% confidence interval (CI) [0.54, 0.99]). Pediatricians were more likely to adhere with the guideline than were non-pediatricians (odds ratio 2.91, 95% CI [1.5, 5.5]).

CONCLUSION

Exposure to purposefully sequenced educational interventions based on the PRECEDE model was associated with increased adherence to guideline recommendations.

Nudging physicians and patients with autopend clinical decision support to improve diabetes management

OBJECTIVES

To determine the impact on routine glycated hemoglobin (A1C) laboratory test completion of incorporating an autopend laboratory order functionality into clinical decision support, which (1) routed provider alerts to a separate electronic folder, (2) automatically populated preauthorization forms, and (3) linked the timing and content of electronic patient health maintenance topic (HMT) reminders to the provider authorization.

STUDY DESIGN

Observational pre-post study from November 2011 (1 year before autopend) through June 2014 (1.5 years after).

METHODS

The study included HMT reminders concerning an A1C test for patients with type 1 or type 2 diabetes (N = 15,630 HMT reminders; 8792 patients) in a large multispecialty ambulatory healthcare system. A Cox proportional hazard model, adjusted for patient and provider demographics, estimated the likelihood of laboratory test completion based on 3 HMT reminder characteristics: preautopend versus postautopend period, read versus unread, and the patient's time to reading.

RESULTS

In the postautopend period, the median time for patients to read reminders decreased (1 vs 3 days; P <.001) and the median time to complete laboratory tests decreased (40 vs 48 days; P <.001). Comparing preautopend HMT reminders with a similar time to reading, the likelihood of A1C laboratory test completion increased after autopend by between 21.1% (hazard ratio [HR], 1.211; P = .050), when time to reading was 57 days, and 33.9% (HR, 1.339; P = .003), when time to reading was 0 days. This result included 68% of the reminders. There was no statistical difference in A1C laboratory test completion for unread reminders in the preautopend versus postautopend period.

CONCLUSIONS

Automated patient-centered decision support can improve guideline-concordant monitoring of A1C among patients with diabetes, particularly among patients who read reminders in a timely fashion.

Clinical Decision Support Systems for Drug Allergy Checking: Systematic Review

BACKGROUND

Worldwide, the burden of allergies-in particular, drug allergies-is growing. In the process of prescribing, dispensing, or administering a drug, a medication error may occur and can have adverse consequences; for example, a drug may be given to a patient with a documented allergy to that particular drug. Computerized physician order entry (CPOE) systems with built-in clinical decision support systems (CDSS) have the potential to prevent such medication errors and adverse events.

OBJECTIVE

The aim of this review is to provide a comprehensive overview regarding all aspects of CDSS for drug allergy, including documenting, coding, rule bases, alerts and alert fatigue, and outcome evaluation.

METHODS

The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines were followed as much as possible and searches were conducted in 5 databases using CPOE, CDSS, alerts, and allergic or allergy as keywords. Bias could not be evaluated according to PRISMA guidelines due to the heterogeneity of study types included in the review.

RESULTS

Of the 3160 articles considered, 60 met the inclusion criteria. A further 9 articles were added based on expert opinion, resulting in a total of 69 articles. An interrater agreement of 90.9% with a reliability Κ=.787 (95% CI 0.686-0.888) was reached. Large heterogeneity across study objectives, study designs, study populations, and reported results was found. Several key findings were identified. Evidence of the usefulness of clinical decision support for drug allergies has been documented. Nevertheless, there are some important problems associated with their use. Accurate and structured documenting of information on drug allergies in electronic health records (EHRs) is difficult, as it is often not clear to healthcare providers how and where to document drug allergies. Besides the underreporting of drug allergies, outdated or inaccurate drug allergy information in EHRs poses an important problem. Research on the use of coding terminologies for documenting drug allergies is sparse. There is no generally accepted standard terminology for structured documentation of allergy information. The final key finding is the consistently reported low specificity of drug allergy alerts. Current systems have high alert override rates of up to 90%, leading to alert fatigue. Important challenges remain for increasing the specificity of drug allergy alerts. We found only one study specifically reporting outcomes related to CDSS for drug allergies. It showed that adverse drug events resulting from overridden drug allergy alerts do not occur frequently.

CONCLUSIONS

Accurate and comprehensive recording of drug allergies is required for good use of CDSS for drug allergy screening. We found considerable variation in the way drug allergy are recorded in EHRs. It remains difficult to reduce drug allergy alert overload while maintaining patient safety as the highest priority. Future research should focus on improving alert specificity, thereby reducing override rates and alert fatigue. Also, the effect on patient outcomes and cost-effectiveness should be evaluated.

Quality Improvement Initiative to Improve Human Papillomavirus Vaccine Initiation at 9 Years of Age

OBJECTIVE

Adolescent human papillomavirus (HPV) vaccine rates remain low. Early vaccination may improve the efficacy of the vaccine and immunization rates; however, clinicians have not routinely made a strong recommendation for younger adolescents. This study assessed the feasibility of routine vaccination at 9 years of age.

METHODS

Three sequential quality improvement (QI) interventions were implemented to shift the initiation of the HPV vaccine to 9 years of age in a primary care network in low-income neighborhoods in Columbus, Ohio. The first intervention changed the electronic medical record alert for the HPV vaccine from 11 to 9 years of age and focused on cancer prevention when discussing the vaccine with families. The second intervention was formation of an HPV QI team. The third intervention was a clinic incentive for HPV captured opportunity rates. Immunization rates were monitored using statistical process control charts to compare the HPV immunization rate in a sample of 9- and 10-year-old children with a sample of 11- and 12-year-old children.

RESULTS

The percentage of patients receiving an HPV vaccine before 11 years increased from 4.6% to 35.7% during the 6 months after the QI initiative began and to 60.8% 18 months after the project began. In comparison, the HPV vaccination rate in the sample of 11- and 12-year-olds increased from 78.7% to 82.8% 18 months later.

CONCLUSIONS

This QI project used multiple interventions to increase HPV vaccination at 9 years of age in a large primary care network serving a diverse low-income population.

A practice change intervention to improve antenatal care addressing alcohol consumption by women during pregnancy: research protocol for a randomised stepped-wedge cluster trial

Background

Despite clinical guideline recommendations, implementation of antenatal care addressing alcohol consumption by pregnant women is limited. Implementation strategies addressing barriers to such care may be effective in increasing care provision. The aim of this study is to examine the effectiveness, cost and cost-effectiveness of a multi-strategy practice change intervention in increasing antenatal care addressing the consumption of alcohol by pregnant women.

Methods

The study will be a randomised, stepped-wedge controlled trial conducted in three sectors in a health district in New South Wales, Australia. Stepped implementation of a practice change intervention will be delivered to sectors in a random order to support the introduction of a model of care for addressing alcohol consumption by pregnant women. A staged process was undertaken to develop the implementation strategies, which comprise of: leadership support, local clinical practice guidelines, electronic prompts and reminders, opinion leaders, academic detailing (audit and feedback), educational meetings and educational materials, and performance monitoring. Repeated cross-sectional outcome data will be gathered weekly across all sectors for the study duration. The primary outcome measures are the proportion of antenatal appointments at ‘booking in’, 27–28 weeks gestation and 35–36 weeks gestation for which women report (1) being assessed for alcohol consumption, (2) being provided with brief advice related to alcohol consumption during pregnancy, (3) receiving relevant care for addressing alcohol consumption during pregnancy, and (4) being assessed for alcohol consumption and receiving relevant care. Data on resources expended during intervention development and implementation will be collected. The proportion of women who report consuming alcohol since knowing they were pregnant will be measured as a secondary outcome.

Discussion

This will be the first randomised controlled trial to evaluate the effectiveness, cost and cost-effectiveness of implementation strategies in improving antenatal care that addresses alcohol consumption by pregnant women. If positive changes in clinical practice are found, this evidence will support health service adoption of implementation strategies to support improved antenatal care for this recognised risk to the health and wellbeing of the mother and child.

Trial registrations

Australian and New Zealand Clinical Trials Registry, No. ACTRN12617000882325 (date registered: 16/06/2017).

A systematic review of trials evaluating success factors of interventions with computerised clinical decision support

BACKGROUND

Computerised clinical decision support (CDS) can potentially better inform decisions, and it can help with the management of information overload. It is perceived to be a key component of a learning health care system. Despite its increasing implementation worldwide, it remains uncertain why the effect of CDS varies and which factors make CDS more effective.

OBJECTIVE

To examine which factors make CDS strategies more effective on a number of outcomes, including adherence to recommended practice, patient outcome measures, economic measures, provider or patient satisfaction, and medical decision quality.

METHODS

We identified randomised controlled trials, non-randomised trials, and controlled before-and-after studies that directly compared CDS implementation with a given factor to CDS without that factor by searching CENTRAL, MEDLINE, EMBASE, and CINAHL and checking reference lists of relevant studies. We considered CDS with any objective for any condition in any healthcare setting. We included CDS interventions that were either displayed on screen or provided on paper and that were directed at healthcare professionals or targeted at both professionals and patients. The reviewers screened the potentially relevant studies in duplicate. They extracted data and assessed risk of bias in independent pairs or individually followed by a double check by another reviewer. We summarised results using medians and interquartile ranges and rated our certainty in the evidence using the GRADE system.

RESULTS

We identified 66 head-to-head trials that we synthesised across 14 comparisons of CDS intervention factors. Providing CDS automatically versus on demand led to large improvements in adherence. Displaying CDS on-screen versus on paper led to moderate improvements and making CDS more versus less patient-specific improved adherence modestly. When CDS interventions were combined with professional-oriented strategies, combined with patient-oriented strategies, or combined with staff-oriented strategies, then adherence improved slightly. Providing CDS to patients slightly increased adherence versus CDS aimed at the healthcare provider only. Making CDS advice more explicit and requiring users to respond to the advice made little or no difference. The CDS intervention factors made little or no difference to patient outcomes. The results for economic outcomes and satisfaction outcomes were sparse.

CONCLUSION

Multiple factors may affect the success of CDS interventions. CDS may be more effective when the advice is provided automatically and displayed on-screen and when the suggestions are more patient-specific. CDS interventions combined with other strategies probably also improves adherence. Providing CDS directly to patients may also positively affect adherence. The certainty of the evidence was low to moderate for all factors.

TRIAL REGISTRATION

PROSPERO, CRD42016033738.

Systematic Review and Meta-analysis of the Effectiveness of Implementation Strategies for Non-communicable Disease Guidelines in Primary Health Care

BACKGROUND

As clinical practice guidelines represent the most important evidence-based decision support tool, several strategies have been applied to improve their implementation into the primary health care system. This study aimed to evaluate the effect of intervention methods on the guideline adherence of primary care providers (PCPs).

METHODS

The studies selected through a systematic search in Medline and Embase were categorised according to intervention schemes and outcome indicator categories. Harvest plots and forest plots were applied to integrate results.

RESULTS

The 36 studies covered six intervention schemes, with single interventions being the most effective and distribution of materials the least. The harvest plot displayed 27 groups having no effect, 14 a moderate and 21 a strong effect on the outcome indicators in the categories of knowledge transfer, diagnostic behaviour, prescription, counselling and patient-level results. The forest plot revealed a moderate overall effect size of 0.22 [0.15, 0.29] where single interventions were more effective (0.27 [0.17, 0.38]) than multifaceted interventions (0.13 [0.06, 0.19]).

DISCUSSION

Guideline implementation strategies are heterogeneous. Reducing the complexity of strategies and tailoring to the local conditions and PCPs' needs may improve implementation and clinical practice.

Development of a Tailored Intervention With Computerized Clinical Decision Support to Improve Quality of Care for Patients With Knee Osteoarthritis: Multi-Method Study

BACKGROUND

Clinical practice patterns greatly diverge from evidence-based recommendations to manage knee osteoarthritis conservatively before resorting to surgery.

OBJECTIVE

This study aimed to tailor a guideline-based computerized decision support (CDS) intervention that facilitates the conservative management of knee osteoarthritis.

METHODS

Experts with backgrounds in clinical medicine, research, implementation, or health informatics suggested the most important recommendations for implementation, how to develop an implementation strategy, and how to form the CDS algorithms. In 6 focus group sessions, 8 general practitioners and 22 patients from Norway, Belgium, and Finland discussed the suggested CDS intervention and identified factors that would be most critical for the success of the intervention. The focus group moderators used the GUideline Implementation with DEcision Support checklist, which we developed to support consideration of CDS success factors.

RESULTS

The experts prioritized 9 out of 22 recommendations for implementation. We formed the concept for 6 CDS algorithms to support implementation of these recommendations. The focus group suggested 59 unique factors that could affect the success of the presented CDS intervention. Five factors (out of the 59) were prioritized by focus group participants in every country, including the perceived potential to address the information needs of both patients and general practitioners; the credibility of CDS information; the timing of CDS for patients; and the need for personal dialogue about CDS between the general practitioner and the patient.

CONCLUSIONS

The focus group participants supported the CDS intervention as a tool to improve the quality of care for patients with knee osteoarthritis through shared, evidence-based decision making. We aim to develop and implement the CDS based on these study results. Future research should address optimal ways to (1) provide patient-directed CDS, (2) enable more patient-specific CDS within the context of patient complexity, and (3) maintain user engagement with CDS over time.

Evidence gap map of performance measurement and management in primary care delivery systems in low- and middle-income countries - Study protocol

Background. For the last two decades there has been growing interest in governmental and global health stakeholders about the role that performance measurement and management systems can play for the production of high-quality and safely delivered primary care services. Despite recognition and interest, the gaps in evidence in this field of research and practice in low- and middle-income countries remain poorly characterized. This study will develop an evidence gap map in the area of performance management in primary care delivery systems in low- and middle-income countries. Methods. The evidence gap map will follow the methodology developed by 3Ie, the International Initiative for Impact Evaluation, to systematically map evidence and research gaps. The process starts with the development of the scope by creating an evidence-informed framework that helps identify the interventions and outcomes of relevance as well as help define inclusion and exclusion criteria. A search strategy is then developed to guide the systematic search of the literature, covering the following databases: Medline (Ovid), Embase (Ovid), CAB Global Health (Ovid), CINAHL (Ebsco), Cochrane Library, Scopus (Elsevier), and Econlit (Ovid). Sources of grey literature are also searched. Studies that meet the inclusion criteria are systematically coded, extracting data on intervention, outcome, measures, context, geography, equity, and study design. Systematic reviews are also critically appraised using an existing standard checklist. Impact evaluations are not appraised but will be coded according to study design. The process of map-building ends with the creation of an evidence gap map graphic that displays the available evidence according to the intervention and outcome framework of interest. Discussion. Applications arising from the evidence map will be discussed in a separate paper that will summarize findings and make recommendations for the development of a prioritized research agenda.

Mixed methods study of medication-related decision support alerts experienced during electronic prescribing for inpatients at an English hospital

Objectives

Electronic prescribing and medication administration systems are being introduced in many hospitals worldwide, with varying degrees of clinical decision support including pop-up alerts. Previous research suggests that prescribers override a high proportion of alerts, but little research has been carried out in the UK. Our objective was to explore rates of alert overriding in different prescribing situations and prescribers’ perceptions around the use of decision support alerts in a UK hospital.

Methods

We conducted a mixed methods study on three cardiology wards, directly observing medical and non-medical prescribers’ alert override rates during both ward round and non-ward round prescribing; observations were followed by semi-structured interviews with prescribers, which were then transcribed and analysed thematically.

Results

Overall, 69% of 199 observed alerts were overridden. Alerts experienced during ward rounds were significantly more likely to be overridden than those outside of ward rounds (80% of 56 vs 51% of 63; p=0.001, Χ² test). While respondents acknowledged that alerts could be useful, several also described negative unintended consequences. Many were of the view that usefulness of alerts was limited if the alert was reminding them to do something they would do anyway, or suggesting something they did not feel was relevant. Findings suggest that targeting, timing and additional features of alerts are critical factors in determining whether they are acted on or overridden.

Conclusion

The majority of alerts were overridden. Alerts may be less likely to be overridden if they are built into the prescribing workflow.

Systematic review of interventions to increase the provision of care for chronic disease risk behaviours in mental health settings: review protocol

BACKGROUND

People with a mental illness experience a higher morbidity and mortality from chronic diseases relative to the general population. A higher prevalence of risk behaviours, including tobacco smoking, poor nutrition, harmful alcohol consumption and physical inactivity, is a substantial contributor to this health inequity. Clinical practice guidelines recommend that mental health services routinely provide care to their clients to address these risk behaviours. Such care may include the following elements: ask, assess, advise, assist and arrange (the '5As'), which has been demonstrated to be effective in reducing risk behaviours. Despite this potential, the provision of such care is reported to be low internationally and in Australia, and there is a need to identify effective strategies to increase care provision. The proposed review will examine the effectiveness of interventions which aimed to increase care provision (i.e. increase the proportion of clients receiving or clinicians providing the 5As) for the chronic disease risk behaviours of clients within the context of mental health service delivery.

METHODS

Eligible studies will be any quantitative study designs with a comparison group and which report on the effectiveness of an intervention strategy (including delivery arrangements, financial arrangements, governance arrangements and implementation strategies) to increase care provision specifically for chronic disease risk behaviours (tobacco smoking, poor nutrition, harmful alcohol consumption and physical inactivity). Screening for studies will be conducted across seven electronic databases: PsycINFO, MEDLINE, Excerpta Medica database (EMBASE), Psychology and Behavioural Sciences Collection, Scopus, Cochrane Central Register of Controlled Trials (CENTRAL) and Cumulative Index to Nursing and Allied Health Literature (CINAHL). Two authors will independently screen studies for eligibility and extract data from included studies. Where studies are sufficiently homogenous, meta-analysis will be performed. Where considerable heterogeneity exists (I 2  ≥ 75), narrative synthesis will be used.

DISCUSSION

This review will be the first to synthesise evidence for the effectiveness of intervention approaches to facilitate care provision for chronic disease risk behaviours in the context of mental health service delivery. The results have the potential to inform the development of evidenced-based approaches to address the health inequities experienced by this population group.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO CRD42017074360 .

Identifying Which Urban Children With Asthma Benefit Most From Clinician Prompting: Subgroup Analyses From the Prompting Asthma Intervention in Rochester-Uniting Parents and Providers (PAIR-UP) Trial

OBJECTIVE

Clinician prompts increase the likelihood of guideline-recommended corrective actions (preventive medication prescription, dose change, and/or adherence promotion) for symptomatic children with poorly controlled or persistent asthma in the primary care setting, but it is unclear if all children equally benefit. The objectives of this study were to identify whether asthma severity, visit type, and current preventive medication use were predictive of corrective actions during visits for children with symptomatic asthma, and determine whether these factors modified the effect of a prompting intervention.

METHODS

We conducted prespecified subgroup analyses of a cluster randomized controlled trial of physician prompting that promoted guideline-based asthma management for urban children with symptomatic asthma. We tested predictors of corrective actions with bivariate and multivariate multilevel logistic regressions, compared intervention effects across factor categories via stratified analyses, and characterized effect modification with interaction term analyses.

RESULTS

Prompting intervention exposure, moderate/severe disease, asthma-focused visits, and current preventive medication use were predictive of corrective actions. The prompting intervention significantly increased the rate of corrective actions for children across categories of disease severity, visit type, and preventive medication use. However, the intervention effect was significantly smaller for children already using a preventive medication (adjusted odds ratio [OR], 2.01; 95% confidence interval [CI], 1.19-3.38) compared with children without preventive medication use (adjusted OR, 6.25; 95% CI, 3.39-11.54).

CONCLUSIONS

Prompting increases the likelihood of corrective actions during clinic encounters; however, children already using preventive medication benefit less. It is critical for providers to recognize the need for corrective actions among these symptomatic children.

Increasing use of mental health services in remote areas using mobile technology: a pre-post evaluation of the SMART Mental Health project in rural India

Background

About 25% of the Indian population experience common mental disorders (CMD) but only 15–25% of them receive any mental health care. Stigma, lack of adequate mental health professionals and mental health services account for this treatment gap, which is worse in rural areas. Our project evaluated task shifting and mobile–technology based electronic decision support systems to enhance the ability of primary care health workers to provide evidence–based mental health care for stress, depression, and suicidal risk in 30 remote villages in the state of Andhra Pradesh, India.

Methods

The Systematic Medical Appraisal Referral and Treatment (SMART) Mental Health project between May 2014 and April 2016 trained lay village health workers (Accredited Social Health Activists – ASHAs) and primary care doctors to screen, diagnose and manage individuals with common mental disorders using an electronic decision support system. An anti–stigma campaign using multi–media approaches was conducted across the villages at the outset of the project. A pre–post evaluation using mixed methods assessed the change in mental health service utilization by screen positive individuals. This paper reports on the quantitative aspects of that evaluation.

Results

Training was imparted to 21 ASHAs and 2 primary care doctors. 5007 of 5167 eligible individuals were screened, and 238 were identified as being positive for common mental disorders and referred to the primary care doctors for further management. Out of them, 2 (0.8%) had previously utilized mental health services. During the intervention period, 30 (12.6%) visited the primary care doctor for further diagnosis and treatment, as advised. There was a significant reduction in the depression and anxiety scores between start and end of the intervention among those who had screened positive at the beginning. Stigma and mental health awareness in the broader community improved during the project.

Conclusions

The intervention led to individuals being screened for common mental disorders by village health workers and increase in mental health service use by those referred to the primary care doctor. The model was deemed feasible and acceptable. The effectiveness of the intervention needs to be demonstrated using more robust randomized controlled trials, while addressing the issues identified that will facilitate scale up.

[Risk management in anesthesia and critical care medicine]

Throughout its history, anesthesia and critical care medicine has experienced vast improvements to increase patient safety. Consequently, anesthesia has never been performed on such a high level as it is being performed today. As a result, we do not always fully perceive the risks involved in our daily activity. A survey performed in Swiss hospitals identified a total of 169 hot spots which endanger patient safety. It turned out that there is a complex variety of possible errors that can only be tackled through consistent implementation of a safety culture. The key elements to reduce complications are continuing staff education, algorithms and standard operating procedures (SOP), working according to the principles of crisis resource management (CRM) and last but not least the continuous work-up of mistakes identified by critical incident reporting systems.

A systematic review of chronic disease management interventions in primary care

BACKGROUND

Primary and community care are key settings for the effective management of long term conditions. We aimed to evaluate the pattern of health outcomes in chronic disease management interventions for adults with physical health problems implemented in primary or community care settings.

METHODS

The methods were based on our previous review published in 2006. We performed database searches for articles published from 2006 to 2014 and conducted a systematic review with narrative synthesis using the Cochrane Effective Practice and Organisation of Care taxonomy to classify interventions and outcomes. The interventions were mapped to Chronic Care Model elements. The pattern of outcomes related to interventions was summarized by frequency of statistically significant improvements in health care provision and patient outcomes.

RESULTS

A total of 9589 journal articles were retrieved from database searches and snowballing. After screening and verification, 165 articles that detailed 157 studies were included. There were few studies with Health Care Organization (1.9% of studies) or Community Resources (0.6% of studies) as the primary intervention element. Self-Management Support interventions (45.8% of studies) most frequently resulted in improvements in patient-level outcomes. Delivery System Design interventions (22.6% of studies) showed benefits in both professional and patient-level outcomes for a narrow range of conditions. Decision Support interventions (21.3% of studies) had impact limited to professional-level outcomes, in particular use of medications. The small number of studies of Clinical Information System interventions (8.9%) showed benefits for both professional- and patient-level outcomes.

CONCLUSIONS

The published literature has expanded substantially since 2006. This review confirms that Self-Management Support is the most frequent Chronic Care Model intervention that is associated with statistically significant improvements, predominately for diabetes and hypertension.

An overview of systematic reviews on the collaboration between physicians and nurses and the impact on patient outcomes: what can we learn in primary care?

Background

Primary care needs to be strengthened in order to address the many societal challenges. Group practices in primary care foster collaboration with other health care providers, which encourages care co-ordination and leads to a higher quality of primary care. Nursing roles and responsibilities expanded over time and nurses have been found to often provide equal high-quality chronic patient care compared to physicians, even with higher patient satisfaction. Inter-professional collaboration between primary care physicians and nurses is a possible strategy to achieve the desired quality outcomes in a strengthened primary care system. The objective of this research is to synthesize the evidence presented in literature on the impact of collaboration between physicians and nurses on patient outcomes in primary care or in comparable care settings.

Methods

A systematic review of peer-reviewed reviews was performed in four databases: COCHRANE, MEDLINE, EMBASE and CINAHL. All studies from 1970 until May 22 2016 were included in the search strategy. Titles, abstracts and full texts were respectively reviewed. At least two of the three authors independently reviewed each of the 277 abstracts and 58 full texts retrieved in the searches to identify those which contained all the inclusion criteria. Two authors independently appraised the methodological quality of the reviews, using the AMSTAR quality appraisal tool.

Results

A total of eleven systematic reviews met all the inclusion criteria and almost fifty different patient outcomes were described. In most reviews, it was concluded that nurses do have added value. Blood pressure, patient satisfaction and hospitalization are patient outcomes where three or more systematic reviews concluded better results when physicians and nurses collaborated, compared to usual care. Colorectal screening, hospital length of stay and health-related quality of life are outcomes where collaboration appeared not to be effective.

Conclusions

Collaboration between physicians and nurses may have a positive impact on a number of patient outcomes and on a variety of pathologies. To address future challenges of primary care, there is a need for more integrated inter-professional collaboration care models with sufficiently educated nurses.

Electronic supplementary material

The online version of this article (10.1186/s12875-017-0698-x) contains supplementary material, which is available to authorized users.