Strategies for facilitating change in alcohol and other drugs (AOD) professional practice: a systematic review of the effectiveness of reminders and feedback

Clinical decision support systems-based interventions to improve medication outcomes: A systematic literature review on features and effects

Background: Clinical decision support systems (CDSSs) interventions were used to improve the life quality and safety in patients and also to improve practitioner performance, especially in the field of medication. Therefore, the aim of the paper was to summarize the available evidence on the impact, outcomes and significant factors on the implementation of CDSS in the field of medicine. Methods: This study is a systematic literature review. PubMed, Cochrane Library, Web of Science, Scopus, EMBASE, and ProQuest were investigated by 15 February 2017. The inclusion requirements were met by 98 papers, from which 13 had described important factors in the implementation of CDSS, and 86 were medicated-related. We categorized the system in terms of its correlation with medication in which a system was implemented, and our intended results were examined. In this study, the process outcomes (such as; prescription, drug-drug interaction, drug adherence, etc.), patient outcomes, and significant factors affecting the implementation of CDSS were reviewed. Results: We found evidence that the use of medication-related CDSS improves clinical outcomes. Also, significant results were obtained regarding the reduction of prescription errors, and the improvement in quality and safety of medication prescribed. Conclusion: The results of this study show that, although computer systems such as CDSS may cause errors, in most cases, it has helped to improve prescribing, reduce side effects and drug interactions, and improve patient safety. Although these systems have improved the performance of practitioners and processes, there has not been much research on the impact of these systems on patient outcomes.

Alcohol and Other Drug (AOD) Education for Hospital Staff: An Integrative Literature Review

Alcohol and Other Drug (AOD) education amongst hospital staff is often inadequate. This leads to suboptimal care of patients and is a missed opportunity for early identification and treatment. This integrative review evaluates the core features of current education for hospital-based doctors and nurses in AOD, including country of origin, content, duration, and pedagogy. The majority of included studies were conducted in the USA (72%), target alcohol rather than AOD in general (72%), adopted a purely medical model of treatment (94%), and utilised a Screening, Brief Intervention, and Referral to Treatment (SBIRT) model (94%). The overall quality of the studies was weak-moderate, which led to small effect sizes in most studies and limits the generalizability of any conclusions. More high quality research trials are needed to establish the core features of effective AOD education for hospital staff. Future research should include a focus on the psychosocial context of addiction, other drug use and the impact of negative attitudes on care delivery.

Professional interventions for general practitioners on the management of musculoskeletal conditions

BACKGROUND

Musculoskeletal conditions require particular management skills. Identification of interventions which are effective in equipping general practitioners (GPs) with such necessary skills could translate to improved health outcomes for patients and reduced healthcare and societal costs.

OBJECTIVES

To determine the effectiveness of professional interventions for GPs that aim to improve the management of musculoskeletal conditions in primary care. 

SEARCH METHODS

We searched the Cochrane Central Register of Controlled Trials (CENTRAL), 2010, Issue 2; MEDLINE, Ovid (1950 - October 2013); EMBASE, Ovid (1980 - Ocotber 2013); CINAHL, EbscoHost (1980 - November 2013), and the EPOC Specialised Register. We conducted cited reference searches using ISI Web of Knowledge and Google Scholar; and handsearched selected issues of Arthritis and Rheumatism and Primary Care-Clinics in Office Practice. The latest search was conducted in November 2013.

SELECTION CRITERIA

We included randomised controlled trials (RCTs), non-randomised controlled trials (NRCTs), controlled before-and-after studies (CBAs) and interrupted time series (ITS) studies of professional interventions for GPs, taking place in a community setting, aiming to improve the management (including diagnosis and treatment) of musculoskeletal conditions and reporting any objective measure of GP behaviour, patient or economic outcomes. We considered professional interventions of any length, duration, intensity and complexity compared with active or inactive controls.

DATA COLLECTION AND ANALYSIS

Two review authors independently abstracted all data. We calculated the risk difference (RD) and risk ratio (RR) of compliance with desired practice for dichotomous outcomes, and the mean difference (MD) and standardised mean difference (SMD) for continuous outcomes. We investigated whether the direction of the targeted behavioural change affects the effectiveness of interventions.

MAIN RESULTS

Thirty studies met our inclusion criteria.From 11 studies on osteoporosis, meta-analysis of five studies (high-certainty evidence) showed that a combination of a GP alerting system on a patient's increased risk of osteoporosis and a patient-directed intervention (including patient education and a reminder to see their GP) improves GP behaviour with regard to diagnostic bone mineral density (BMD) testing and osteoporosis medication prescribing (RR 4.44; (95% confidence interval (CI) 3.54 to 5.55; 3 studies; 3,386 participants)) for BMD and RR 1.71 (95% CI 1.50 to 1.94; 5 studies; 4,223 participants) for osteoporosis medication. Meta-analysis of two studies showed that GP alerting on its own also probably improves osteoporosis guideline-consistent GP behaviour (RR 4.75 (95% CI 3.62 to 6.24; 3,047 participants)) for BMD and RR 1.52 (95% CI 1.26 to 1.84; 3.047 participants) for osteoporosis medication) and that adding the patient-directed component probably does not lead to a greater effect (RR 0.94 (95% CI 0.81 to 1.09; 2,995 participants)) for BMD and RR 0.93 (95% CI 0.79 to 1.10; 2,995 participants) for osteoporosis medication.Of the 10 studies on low back pain, seven showed that guideline dissemination and educational opportunities for GPs may lead to little or no improvement with regard to guideline-consistent GP behaviour. Two studies showed that the combination of guidelines and GP feedback on the total number of investigations requested may have an effect on GP behaviour and result in a slight reduction in the number of tests, while one of these studies showed that the combination of guidelines and GP reminders attached to radiology reports may result in a small but sustained reduction in the number of investigation requests.Of the four studies on osteoarthritis, one study showed that using educationally influential physicians may result in improvement in guideline-consistent GP behaviour. Another study showed slight improvements in patient outcomes (pain control) after training GPs on pain management.Of three studies on shoulder pain, one study reported that there may be little or no improvement in patient outcomes (functional capacity) after GP education on shoulder pain and injection training.Of two studies on other musculoskeletal conditions, one study on pain management showed that there may be worse patient outcomes (pain control) after GP training on the use of validated assessment scales.The 12 remaining studies across all musculoskeletal conditions showed little or no improvement in GP behaviour and patient outcomes.The direction of the targeted behaviour (i.e. increasing or decreasing a behaviour) does not seem to affect the effectiveness of an intervention. The majority of the studies did not investigate the potential adverse effects of the interventions and only three studies included a cost-effectiveness analysis.Overall, there were important methodological limitations in the body of evidence, with just a third of the studies reporting adequate allocation concealment and blinded outcome assessments. While our confidence in the pooled effect estimate of interventions for improving diagnostic testing and medication prescribing in osteoporosis is high, our confidence in the reported effect estimates in the remaining studies is low.

AUTHORS' CONCLUSIONS

There is good-quality evidence that a GP alerting system with or without patient-directed education on osteoporosis improves guideline-consistent GP behaviour, resulting in better diagnosis and treatment rates.Interventions such as GP reminder messages and GP feedback on performance combined with guideline dissemination may lead to small improvements in guideline-consistent GP behaviour with regard to low back pain, while GP education on osteoarthritis pain and the use of educationally influential physicians may lead to slight improvement in patient outcomes and guideline-consistent behaviour respectively. However, further studies are needed to ascertain the effectiveness of such interventions in improving GP behaviour and patient outcomes.

Achieving change in primary care--effectiveness of strategies for improving implementation of complex interventions: systematic review of reviews

OBJECTIVE

To identify, summarise and synthesise available literature on the effectiveness of implementation strategies for optimising implementation of complex interventions in primary care.

DESIGN

Systematic review of reviews.

DATA SOURCES

MEDLINE, EMBASE, CINAHL, Cochrane Library and PsychINFO were searched, from first publication until December 2013; the bibliographies of relevant articles were screened for additional reports.

ELIGIBILITY CRITERIA FOR SELECTING STUDIES

Eligible reviews had to (1) examine effectiveness of single or multifaceted implementation strategies, (2) measure health professional practice or process outcomes and (3) include studies from predominantly primary care in developed countries. Two reviewers independently screened titles/abstracts and full-text articles of potentially eligible reviews for inclusion.

DATA SYNTHESIS

Extracted data were synthesised using a narrative approach.

RESULTS

91 reviews were included. The most commonly evaluated strategies were those targeted at the level of individual professionals, rather than those targeting organisations or context. These strategies (eg, audit and feedback, educational meetings, educational outreach, reminders) on their own demonstrated a small to modest improvement (2-9%) in professional practice or behaviour with considerable variability in the observed effects. The effects of multifaceted strategies targeted at professionals were mixed and not necessarily more effective than single strategies alone. There was relatively little review evidence on implementation strategies at the levels of organisation and wider context. Evidence on cost-effectiveness was limited and data on costs of different strategies were scarce and/or of low quality.

CONCLUSIONS

There is a substantial literature on implementation strategies aimed at changing professional practices or behaviour. It remains unclear which implementation strategies are more likely to be effective than others and under what conditions. Future research should focus on identifying and assessing the effectiveness of strategies targeted at the wider context and organisational levels and examining the costs and cost-effectiveness of implementation strategies.

PROSPERO REGISTRATION NUMBER

CRD42014009410.

Preventive evidence into practice (PEP) study: implementation of guidelines to prevent primary vascular disease in general practice protocol for a cluster randomised controlled trial

BACKGROUND

There are significant gaps in the implementation and uptake of evidence-based guideline recommendations for cardiovascular disease (CVD) and diabetes in Australian general practice. This study protocol describes the methodology for a cluster randomised trial to evaluate the effectiveness of a model that aims to improve the implementation of these guidelines in Australian general practice developed by a collaboration between researchers, non-government organisations, and the profession.

METHODS

We hypothesise that the intervention will alter the behaviour of clinicians and patients resulting in improvements of recording of lifestyle and physiological risk factors (by 20%) and increased adherence to guideline recommendations for: the management of CVD and diabetes risk factors (by 20%); and lifestyle and physiological risk factors of patients at risk (by 5%). Thirty-two general practices will be randomised in a 1:1 allocation to receive either the intervention or continue with usual care, after stratification by state. The intervention will be delivered through: small group education; audit of patient records to determine preventive care; and practice facilitation visits adapted to the needs of the practices. Outcome data will be extracted from electronic medical records and patient questionnaires, and qualitative evaluation from provider and patient interviews.

DISCUSSION

We plan to disseminate study findings widely and directly inform implementation strategies by governments, professional bodies, and non-government organisations including the partner organisations.

Overview of systematic reviews of the effectiveness of reminders in improving healthcare professional behavior

OBJECTIVE

The purpose of this project was to conduct an overview of existing systematic reviews to evaluate the effectiveness of reminders in changing professional behavior in clinical settings.

MATERIALS AND METHODS

Relevant systematic reviews of reminder interventions were identified through searches in MEDLINE, EMBASE, DARE and the Cochrane Library in conjunction with a larger project examining professional behavioral change interventions. Reviews were appraised using AMSTAR, a validated tool for assessing the quality of systematic reviews. As most reviews only reported vote counting, conclusions about effectiveness for each review were based on a count of positive studies. If available, we also report effect sizes. Conclusions were based on the findings from higher quality and current systematic reviews.

RESULTS

Thirty-five reviews were eligible for inclusion in this overview. Ten reviews examined the effectiveness of reminders generally, 5 reviews focused on specific health care settings, 14 reviews concentrated on specific behaviors and 6 reviews addressed specific patient populations. The quality of the reviews was variable (median = 3, range = 1 to 8). Seven reviews had AMSTAR scores >5 and were considered in detail. Five of these seven reviews demonstrated positive effects of reminders in changing provider behavior. Few reviews used quantitative pooling methods; in one high quality and current review, the overall observed effects were moderate with an absolute median improvement in performance of 4.2% (IQR: 0.5% to 6.6%).

DISCUSSION

The results support that modest improvements can occur with the use of reminders. The effect size is consistent with other interventions that have been used to improve professional behavior.

CONCLUSION

Reminders appear effective in improving different clinical behaviors across a range of settings.

An interdisciplinary knowledge translation intervention in long-term care: study protocol for the vitamin D and osteoporosis study (ViDOS) pilot cluster randomized controlled trial

BACKGROUND

Knowledge translation (KT) research in long-term care (LTC) is still in its early stages. This protocol describes the evaluation of a multifaceted, interdisciplinary KT intervention aimed at integrating evidence-based osteoporosis and fracture prevention strategies into LTC care processes.

METHODS AND DESIGN

The Vitamin D and Osteoporosis Study (ViDOS) is underway in 40 LTC homes (n = 19 intervention, n = 21 control) across Ontario, Canada. The primary objectives of this study are to assess the feasibility of delivering the KT intervention, and clinically, to increase the percent of LTC residents prescribed ≥800 IU of vitamin D daily. Eligibility criteria are LTC homes that are serviced by our partner pharmacy provider and have more than one prescribing physician. The target audience within each LTC home is the Professional Advisory Committee (PAC), an interdisciplinary team who meets quarterly. The key elements of the intervention are three interactive educational sessions led by an expert opinion leader, action planning using a quality improvement cycle, audit and feedback reports, nominated internal champions, and reminders/point-of-care tools. Control homes do not receive any intervention, however both intervention and control homes received educational materials as part of the Ontario Osteoporosis Strategy. Primary outcomes are feasibility measures (recruitment, retention, attendance at educational sessions, action plan items identified and initiated, internal champions identified, performance reports provided and reviewed), and vitamin D (≥800 IU/daily) prescribing at 6 and 12 months. Secondary outcomes include the proportion of residents prescribed calcium supplements and osteoporosis medications, and falls and fractures. Qualitative methods will examine the experience of the LTC team with the KT intervention. Homes are centrally randomized to intervention and control groups in blocks of variable size using a computer generated allocation sequence. Randomization is stratified by home size and profit/nonprofit status. Prescribing data retrieval and analysis are performed by blinded personnel.

DISCUSSION

Our study will contribute to an improved understanding of the feasibility and acceptability of a multifaceted intervention aimed at translating knowledge to LTC practitioners. Lessons learned from this study will be valuable in guiding future research and understanding the complexities of translating knowledge in LTC.

Effective implementation of research into practice: an overview of systematic reviews of the health literature

BACKGROUND

The gap between research findings and clinical practice is well documented and a range of interventions has been developed to increase the implementation of research into clinical practice.

FINDINGS

A review of systematic reviews of the effectiveness of interventions designed to increase the use of research in clinical practice. A search for relevant systematic reviews was conducted of Medline and the Cochrane Database of Reviews 1998-2009. 13 systematic reviews containing 313 primary studies were included. Four strategy types are identified: audit and feedback; computerised decision support; opinion leaders; and multifaceted interventions. Nine of the reviews reported on multifaceted interventions. This review highlights the small effects of single interventions such as audit and feedback, computerised decision support and opinion leaders. Systematic reviews of multifaceted interventions claim an improvement in effectiveness over single interventions, with effect sizes ranging from small to moderate. This review found that a number of published systematic reviews fail to state whether the recommended practice change is based on the best available research evidence.

CONCLUSIONS

This overview of systematic reviews updates the body of knowledge relating to the effectiveness of key mechanisms for improving clinical practice and service development. Multifaceted interventions are more likely to improve practice than single interventions such as audit and feedback. This review identified a small literature focusing explicitly on getting research evidence into clinical practice. It emphasizes the importance of ensuring that primary studies and systematic reviews are precise about the extent to which the reported interventions focus on changing practice based on research evidence (as opposed to other information codified in guidelines and education materials).