Implementing clinical guidelines in the treatment of diabetes mellitus in general practice. Evaluation of effort, process, and patient outcome related to implementation of a computer-based decision support system

Applications of Clinical Decision Support Systems in Diabetes Care: Scoping Review

BACKGROUND

Providing comprehensive and individualized diabetes care remains a significant challenge in the face of the increasing complexity of diabetes management and a lack of specialized endocrinologists to support diabetes care. Clinical decision support systems (CDSSs) are progressively being used to improve diabetes care, while many health care providers lack awareness and knowledge about CDSSs in diabetes care. A comprehensive analysis of the applications of CDSSs in diabetes care is still lacking.

OBJECTIVE

This review aimed to summarize the research landscape, clinical applications, and impact on both patients and physicians of CDSSs in diabetes care.

METHODS

We conducted a scoping review following the Arksey and O'Malley framework. A search was conducted in 7 electronic databases to identify the clinical applications of CDSSs in diabetes care up to June 30, 2022. Additional searches were conducted for conference abstracts from the period of 2021-2022. Two researchers independently performed the screening and data charting processes.

RESULTS

Of 11,569 retrieved studies, 85 (0.7%) were included for analysis. Research interest is growing in this field, with 45 (53%) of the 85 studies published in the past 5 years. Among the 58 (68%) out of 85 studies disclosing the underlying decision-making mechanism, most CDSSs (44/58, 76%) were knowledge based, while the number of non-knowledge-based systems has been increasing in recent years. Among the 81 (95%) out of 85 studies disclosing application scenarios, the majority of CDSSs were used for treatment recommendation (63/81, 78%). Among the 39 (46%) out of 85 studies disclosing physician user types, primary care physicians (20/39, 51%) were the most common, followed by endocrinologists (15/39, 39%) and nonendocrinology specialists (8/39, 21%). CDSSs significantly improved patients' blood glucose, blood pressure, and lipid profiles in 71% (45/63), 67% (12/18), and 38% (8/21) of the studies, respectively, with no increase in the risk of hypoglycemia.

CONCLUSIONS

CDSSs are both effective and safe in improving diabetes care, implying that they could be a potentially reliable assistant in diabetes care, especially for physicians with limited experience and patients with limited access to medical resources.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.37766/inplasy2022.9.0061.

Efficacy of sustained knowledge translation (KT) interventions in chronic disease management in older adults: systematic review and meta-analysis of complex interventions

BACKGROUND

Chronic disease management (CDM) through sustained knowledge translation (KT) interventions ensures long-term, high-quality care. We assessed implementation of KT interventions for supporting CDM and their efficacy when sustained in older adults.

METHODS

Design: Systematic review with meta-analysis engaging 17 knowledge users using integrated KT.

ELIGIBILITY CRITERIA

Randomized controlled trials (RCTs) including adults (> 65 years old) with chronic disease(s), their caregivers, health and/or policy-decision makers receiving a KT intervention to carry out a CDM intervention for at least 12 months (versus other KT interventions or usual care).

INFORMATION SOURCES

We searched MEDLINE, EMBASE, and the Cochrane Central Register of Controlled Trials from each database's inception to March 2020.

OUTCOME MEASURES

Sustainability, fidelity, adherence of KT interventions for CDM practice, quality of life (QOL) and quality of care (QOC). Data extraction, risk of bias (ROB) assessment: We screened, abstracted and appraised articles (Effective Practice and Organisation of Care ROB tool) independently and in duplicate.

DATA SYNTHESIS

We performed both random-effects and fixed-effect meta-analyses and estimated mean differences (MDs) for continuous and odds ratios (ORs) for dichotomous data.

RESULTS

We included 158 RCTs (973,074 participants [961,745 patients, 5540 caregivers, 5789 providers]) and 39 companion reports comprising 329 KT interventions, involving patients (43.2%), healthcare providers (20.7%) or both (10.9%). We identified 16 studies described as assessing sustainability in 8.1% interventions, 67 studies as assessing adherence in 35.6% interventions and 20 studies as assessing fidelity in 8.7% of the interventions. Most meta-analyses suggested that KT interventions improved QOL, but imprecisely (36 item Short-Form mental [SF-36 mental]: MD 1.11, 95% confidence interval [CI] [- 1.25, 3.47], 14 RCTs, 5876 participants, I2 = 96%; European QOL-5 dimensions: MD 0.01, 95% CI [- 0.01, 0.02], 15 RCTs, 6628 participants, I2 = 25%; St George's Respiratory Questionnaire: MD - 2.12, 95% CI [- 3.72, - 0.51] 44 12 RCTs, 2893 participants, I2 = 44%). KT interventions improved QOC (OR 1.55, 95% CI [1.29, 1.85], 12 RCTS, 5271 participants, I2 = 21%).

CONCLUSIONS

KT intervention sustainability was infrequently defined and assessed. Sustained KT interventions have the potential to improve QOL and QOC in older adults with CDM. However, their overall efficacy remains uncertain and it varies by effect modifiers, including intervention type, chronic disease number, comorbidities, and participant age.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO CRD42018084810.

Quality improvement strategies for diabetes care: Effects on outcomes for adults living with diabetes

BACKGROUND

There is a large body of evidence evaluating quality improvement (QI) programmes to improve care for adults living with diabetes. These programmes are often comprised of multiple QI strategies, which may be implemented in various combinations. Decision-makers planning to implement or evaluate a new QI programme, or both, need reliable evidence on the relative effectiveness of different QI strategies (individually and in combination) for different patient populations.

OBJECTIVES

To update existing systematic reviews of diabetes QI programmes and apply novel meta-analytical techniques to estimate the effectiveness of QI strategies (individually and in combination) on diabetes quality of care.

SEARCH METHODS

We searched databases (CENTRAL, MEDLINE, Embase and CINAHL) and trials registers (ClinicalTrials.gov and WHO ICTRP) to 4 June 2019. We conducted a top-up search to 23 September 2021; we screened these search results and 42 studies meeting our eligibility criteria are available in the awaiting classification section.

SELECTION CRITERIA

We included randomised trials that assessed a QI programme to improve care in outpatient settings for people living with diabetes. QI programmes needed to evaluate at least one system- or provider-targeted QI strategy alone or in combination with a patient-targeted strategy. - System-targeted: case management (CM); team changes (TC); electronic patient registry (EPR); facilitated relay of clinical information (FR); continuous quality improvement (CQI). - Provider-targeted: audit and feedback (AF); clinician education (CE); clinician reminders (CR); financial incentives (FI). - Patient-targeted: patient education (PE); promotion of self-management (PSM); patient reminders (PR). Patient-targeted QI strategies needed to occur with a minimum of one provider or system-targeted strategy.

DATA COLLECTION AND ANALYSIS

We dual-screened search results and abstracted data on study design, study population and QI strategies. We assessed the impact of the programmes on 13 measures of diabetes care, including: glycaemic control (e.g. mean glycated haemoglobin (HbA1c)); cardiovascular risk factor management (e.g. mean systolic blood pressure (SBP), low-density lipoprotein cholesterol (LDL-C), proportion of people living with diabetes that quit smoking or receiving cardiovascular medications); and screening/prevention of microvascular complications (e.g. proportion of patients receiving retinopathy or foot screening); and harms (e.g. proportion of patients experiencing adverse hypoglycaemia or hyperglycaemia). We modelled the association of each QI strategy with outcomes using a series of hierarchical multivariable meta-regression models in a Bayesian framework. The previous version of this review identified that different strategies were more or less effective depending on baseline levels of outcomes. To explore this further, we extended the main additive model for continuous outcomes (HbA1c, SBP and LDL-C) to include an interaction term between each strategy and average baseline risk for each study (baseline thresholds were based on a data-driven approach; we used the median of all baseline values reported in the trials). Based on model diagnostics, the baseline interaction models for HbA1c, SBP and LDL-C performed better than the main model and are therefore presented as the primary analyses for these outcomes. Based on the model results, we qualitatively ordered each QI strategy within three tiers (Top, Middle, Bottom) based on its magnitude of effect relative to the other QI strategies, where 'Top' indicates that the QI strategy was likely one of the most effective strategies for that specific outcome. Secondary analyses explored the sensitivity of results to choices in model specification and priors.  Additional information about the methods and results of the review are available as Appendices in an online repository. This review will be maintained as a living systematic review; we will update our syntheses as more data become available.

MAIN RESULTS

We identified 553 trials (428 patient-randomised and 125 cluster-randomised trials), including a total of 412,161 participants. Of the included studies, 66% involved people living with type 2 diabetes only. Participants were 50% female and the median age of participants was 58.4 years. The mean duration of follow-up was 12.5 months. HbA1c was the commonest reported outcome; screening outcomes and outcomes related to cardiovascular medications, smoking and harms were reported infrequently. The most frequently evaluated QI strategies across all study arms were PE, PSM and CM, while the least frequently evaluated QI strategies included AF, FI and CQI. Our confidence in the evidence is limited due to a lack of information on how studies were conducted.  Four QI strategies (CM, TC, PE, PSM) were consistently identified as 'Top' across the majority of outcomes. All QI strategies were ranked as 'Top' for at least one key outcome. The majority of effects of individual QI strategies were modest, but when used in combination could result in meaningful population-level improvements across the majority of outcomes. The median number of QI strategies in multicomponent QI programmes was three.  Combinations of the three most effective QI strategies were estimated to lead to the below effects:  - PR + PSM + CE: decrease in HbA1c by 0.41% (credibility interval (CrI) -0.61 to -0.22) when baseline HbA1c < 8.3%; - CM + PE + EPR: decrease in HbA1c by 0.62% (CrI -0.84 to -0.39) when baseline HbA1c > 8.3%;  - PE + TC + PSM: reduction in SBP by 2.14 mmHg (CrI -3.80 to -0.52) when baseline SBP < 136 mmHg; - CM + TC + PSM: reduction in SBP by 4.39 mmHg (CrI -6.20 to -2.56) when baseline SBP > 136 mmHg;  - TC + PE + CM: LDL-C lowering of 5.73 mg/dL (CrI -7.93 to -3.61) when baseline LDL < 107 mg/dL; - TC + CM + CR: LDL-C lowering by 5.52 mg/dL (CrI -9.24 to -1.89) when baseline LDL > 107 mg/dL. Assuming a baseline screening rate of 50%, the three most effective QI strategies were estimated to lead to an absolute improvement of 33% in retinopathy screening (PE + PR + TC) and 38% absolute increase in foot screening (PE + TC + Other).

AUTHORS' CONCLUSIONS

There is a significant body of evidence about QI programmes to improve the management of diabetes. Multicomponent QI programmes for diabetes care (comprised of effective QI strategies) may achieve meaningful population-level improvements across the majority of outcomes. For health system decision-makers, the evidence summarised in this review can be used to identify strategies to include in QI programmes. For researchers, this synthesis identifies higher-priority QI strategies to examine in further research regarding how to optimise their evaluation and effects. We will maintain this as a living systematic review.

The Impact of Guideline Integration into Electronic Medical Records on Outcomes for Patients with Diabetes: A Systematic Review

Optimal strategies for integration of clinical practice guidelines into electronic medical records and its impact on processes of care and clinical outcomes in diabetic patients are not well understood. A systematic review of CINAHL, MEDLINE, PubMed, and Cochrane Library databases in August 2016, November 2017, and June 2020 was conducted. Studies investigating integration of diabetes guidelines into ambulatory care electronic medical records reporting quantitative results were included. After screening 15,783 records, 21 articles were included. Lipid and blood pressure control consistently improved with guideline integration, but A1c control remained equivocal. Electronic guideline integration improved microvascular complication screening, vaccination, and documentation of cardiovascular risk factors, while medication prescription and blood pressure, lipid, and A1c documentation did not improve. Studies employing a combination of electronic record intervention strategies were associated with improvement in monitoring and attainment of guideline and screening targets. Thus, strategies employing combinations of interventions to incorporate guidelines into electronic records may improve processes of care and some clinical outcomes.

Process evaluations of primary care interventions addressing chronic disease: a systematic review

OBJECTIVE

Process evaluations (PEs) alongside randomised controlled trials of complex interventions are valuable because they address questions of for whom, how and why interventions had an impact. We synthesised the methods used in PEs of primary care interventions, and their main findings on implementation barriers and facilitators.

DESIGN

Systematic review using the UK Medical Research Council guidance for PE as a guide.

DATA SOURCES

Academic databases (MEDLINE, SCOPUS, PsycINFO, Cumulative Index to Nursing and Allied Health Literature, EMBASE and Global Health) were searched from 1998 until June 2018.

ELIGIBILITY CRITERIA

We included PE alongside randomised controlled trials of primary care interventions which aimed to improve outcomes for patients with non-communicable diseases.

DATA EXTRACTION AND SYNTHESIS

Two independent reviewers screened and conducted the data extraction and synthesis, with a third reviewer checking a sample for quality assurance.

RESULTS

69 studies were included. There was an overall lack of consistency in how PEs were conducted and reported. The main weakness is that only 30 studies were underpinned by a clear intervention theory often facilitated by the use of existing theoretical frameworks. The main strengths were robust sampling strategies, and the triangulation of qualitative and quantitative data to understand an intervention's mechanisms. Findings were synthesised into three key themes: (1) a fundamental mismatch between what the intervention was designed to achieve and local needs; (2) the required roles and responsibilities of key actors were often not clearly understood; and (3) the health system context-factors such as governance, financing structures and workforce-if unanticipated could adversely impact implementation.

CONCLUSION

Greater consistency is needed in the reporting and the methods of PEs, in particular greater use of theoretical frameworks to inform intervention theory. More emphasis on formative research in designing interventions is needed to align the intervention with the needs of local stakeholders, and to minimise unanticipated consequences due to context-specific barriers.

PROSPERO REGISTRATION NUMBER

CRD42016035572.

The Effects of Computerized Clinical Decision Support Systems on Laboratory Test Ordering: A Systematic Review

CONTEXT

- Inappropriate laboratory test ordering has been shown to be as high as 30%. This can have an important impact on quality of care and costs because of downstream consequences such as additional diagnostics, repeat testing, imaging, prescriptions, surgeries, or hospital stays.

OBJECTIVE

- To evaluate the effect of computerized clinical decision support systems on appropriateness of laboratory test ordering.

DATA SOURCES

- We used MEDLINE, Embase, CINAHL, MEDLINE In-Process and Other Non-Indexed Citations, Clinicaltrials.gov, Cochrane Library, and Inspec through December 2015. Investigators independently screened articles to identify randomized trials that assessed a computerized clinical decision support system aimed at improving laboratory test ordering by providing patient-specific information, delivered in the form of an on-screen management option, reminder, or suggestion through a computerized physician order entry using a rule-based or algorithm-based system relying on an evidence-based knowledge resource. Investigators extracted data from 30 papers about study design, various study characteristics, study setting, various intervention characteristics, involvement of the software developers in the evaluation of the computerized clinical decision support system, outcome types, and various outcome characteristics.

CONCLUSIONS

- Because of heterogeneity of systems and settings, pooled estimates of effect could not be made. Data showed that computerized clinical decision support systems had little or no effect on clinical outcomes but some effect on compliance. Computerized clinical decision support systems targeted at laboratory test ordering for multiple conditions appear to be more effective than those targeted at a single condition.

Interventions to Educate Family Physicians to Change Test Ordering: Systematic Review of Randomized Controlled Trials

The purpose is to systematically review randomised controlled trials (RCTs) to change family physicians’ laboratory test-ordering. We searched 15 electronic databases (no language/date limitations). We identified 29 RCTs (4,111 physicians, 175,563 patients). Six studies specifically focused on reducing unnecessary tests, 23 on increasing screening tests. Using Cochrane methodology 48.5% of studies were low risk-of-bias for randomisation, 7% concealment of randomisation, 17% blinding of participants/personnel, 21% blinding outcome assessors, 27.5% attrition, 93% selective reporting. Only six studies were low risk for both randomisation and attrition. Twelve studies performed a power computation, three an intention-to-treat analysis and 13 statistically controlled clustering. Unweighted averages were computed to compare intervention/control groups for tests assessed by >5 studies. The results were that fourteen studies assessed lipids (average 10% more tests than control), 14 diabetes (average 8% > control), 5 cervical smears, 2 INR, one each thyroid, fecal occult-blood, cotinine, throat-swabs, testing after prescribing, and urine-cultures. Six studies aimed to decrease test groups (average decrease 18%), and two to increase test groups. Intervention strategies: one study used education (no change): two feedback (one 5% increase, one 27% desired decrease); eight education + feedback (average increase in desired direction >control 4.9%), ten system change (average increase 14.9%), one system change + feedback (increases 5-44%), three education + system change (average increase 6%), three education + system change + feedback (average 7.7% increase), one delayed testing. The conclusions are that only six RCTs were assessed at low risk of bias from both randomisation and attrition. Nevertheless, despite methodological shortcomings studies that found large changes (e.g. >20%) probably obtained real change.

Clinical Decision Support Systems and Prevention: A Community Guide Cardiovascular Disease Systematic Review

CONTEXT

Clinical decision support systems (CDSSs) can help clinicians assess cardiovascular disease (CVD) risk and manage CVD risk factors by providing tailored assessments and treatment recommendations based on individual patient data. The goal of this systematic review was to examine the effectiveness of CDSSs in improving screening for CVD risk factors, practices for CVD-related preventive care services such as clinical tests and prescribed treatments, and management of CVD risk factors.

EVIDENCE ACQUISITION

An existing systematic review (search period, January 1975-January 2011) of CDSSs for any condition was initially identified. Studies of CDSSs that focused on CVD prevention in that review were combined with studies identified through an updated search (January 2011-October 2012). Data analysis was conducted in 2013.

EVIDENCE SYNTHESIS

A total of 45 studies qualified for inclusion in the review. Improvements were seen for recommended screening and other preventive care services completed by clinicians, recommended clinical tests completed by clinicians, and recommended treatments prescribed by clinicians (median increases of 3.8, 4.0, and 2.0 percentage points, respectively). Results were inconsistent for changes in CVD risk factors such as systolic and diastolic blood pressure, total and low-density lipoprotein cholesterol, and hemoglobin A1C levels.

CONCLUSIONS

CDSSs are effective in improving clinician practices related to screening and other preventive care services, clinical tests, and treatments. However, more evidence is needed from implementation of CDSSs within the broad context of comprehensive service delivery aimed at reducing CVD risk and CVD-related morbidity and mortality.

Telemedicine for diabetes care: An Indian perspective - feasibility and efficacy

Diabetes is a chronic and costly disease. In India, the usual practice among patients is to visit the doctor once in every 2-3 months to get advice on changes in the dosages of medications. The Diabetes Tele Management System (DTMS(®)) is a telemedicine based follow-up program originally introduced at Jothydev's Diabetes Research Centre at Trivandrum South India in 1998. It is a chronic disease management system which enables patient to interact lively with a professionally trained multidisciplinary team comprising of diabetes educators, nurses, dieticians, pharmacists, psychologists, physicians, etc., in modifying the dosages of medications, diet, and physical activity either through telephone/email/secure website. The uniquely designed software and the trained multidisciplinary team overcomes the globally recognized major barriers to diabetes management namely fear of hypoglycemia, polypharmacy, discontinuation of stains, and antihypertensives or wrong injection techniques. DTMS is designed to provide individualized therapy advices on glycosylated hemoglobin, blood pressure, and low density lipoprotein customized to multiple patient characteristics which help attain goals of therapy. The system has been tested on various platforms over a decade and was shown to be a patient friendly approach with successful outcomes due to a live "round-the-clock" interactive communication in contrast to text or recorded messages. The major challenge to the widespread use of DTMS(®) is seeking a source of funding this unique telemedicine program.

Description and pilot evaluation of the Metabolic Irregularities Narrowing down Device software: a case analysis of physician programming

Background

There is a gap between the abilities and the everyday applications of Computerized Decision Support Systems (CDSSs). This gap is further exacerbated by the different ‘worlds’ between the software designers and the clinician end-users. Software programmers often lack clinical experience whereas practicing physicians lack skills in design and engineering.

Objective

Our primary objective was to evaluate the performance of Metabolic Irregularities Narrowing down Device (MIND) intelligent medical calculator and differential diagnosis software through end-user surveys and discuss the roles of CDSS in the inpatient setting.

Setting

A tertiary care, teaching community hospital.

Study participants

Thirty-one responders answered the survey. Responders consisted of medical students, 24%; attending physicians, 16%, and residents, 60%.

Results

About 62.5% of the responders reported that MIND has the ability to potentially improve the quality of care, 20.8% were sure that MIND improves the quality of care, and only 4.2% of the responders felt that it does not improve the quality of care. Ninety-six percent of the responders felt that MIND definitely serves or has the potential to serve as a useful tool for medical students, and only 4% of the responders felt otherwise. Thirty-five percent of the responders rated the differential diagnosis list as excellent, 56% as good, 4% as fair, and 4% as poor.

Discussion

MIND is a suggesting, interpreting, alerting, and diagnosing CDSS with good performance and end-user satisfaction. In the era of the electronic medical record, the ongoing development of efficient CDSS platforms should be carefully considered by practicing physicians and institutions.

Effectiveness of computerized decision support systems linked to electronic health records: a systematic review and meta-analysis

We systematically reviewed randomized controlled trials (RCTs) assessing the effectiveness of computerized decision support systems (CDSSs) featuring rule- or algorithm-based software integrated with electronic health records (EHRs) and evidence-based knowledge. We searched MEDLINE, EMBASE, Cochrane Central Register of Controlled Trials, and Cochrane Database of Abstracts of Reviews of Effects. Information on system design, capabilities, acquisition, implementation context, and effects on mortality, morbidity, and economic outcomes were extracted. Twenty-eight RCTs were included. CDSS use did not affect mortality (16 trials, 37395 patients; 2282 deaths; risk ratio [RR] = 0.96; 95% confidence interval [CI] = 0.85, 1.08; I(2) = 41%). A statistically significant effect was evident in the prevention of morbidity, any disease (9 RCTs; 13868 patients; RR = 0.82; 95% CI = 0.68, 0.99; I(2) = 64%), but selective outcome reporting or publication bias cannot be excluded. We observed differences for costs and health service utilization, although these were often small in magnitude. Across clinical settings, new generation CDSSs integrated with EHRs do not affect mortality and might moderately improve morbidity outcomes.

Type 2 diabetes continuing medical education for general practitioners: what works? A systematic review

AIMS

To perform a systematic review of studies that have assessed the effectiveness of interventions designed to improve healthcare professionals' care of patients with diabetes and to assess the effects of educational interventions targeted at general practitioners' diabetes management.

METHODS

A computer search was conducted using the Cochrane Library, PubMed, Ovid MEDLINE, Scopus, EMBASE, Informit, Google scholar and ERIC from the earliest date of each database up until 2013. A supplementary review of reference lists from each article obtained was also carried out. Measured changes in general practitioners' satisfaction, knowledge, practice behaviours and patient outcomes were recorded.

RESULTS

Thirteen out of 1255 studies met the eligibility criteria, but none was specifically conducted in rural or remote areas. Ten studies were randomized trials. Fewer than half of the studies (5/13, 38.5%) reported a significant improvement in at least one of the following outcome categories: satisfaction with the programme, knowledge and practice behaviour. There was little evidence of the impact of general practitioner educational interventions on patient outcomes. Of the five studies that examined patient outcomes, only one reported a positive impact: a reduction in patient HbA1c levels.

CONCLUSIONS

Few studies examined the effectiveness of general practitioner Type 2 diabetes education in improving general practitioner satisfaction, knowledge, practices and/or patient outcomes. Evidence to support the effectiveness of education is partial and weak. To determine effective strategies for general practitioner education related to Type 2 diabetes, further well designed studies, accompanied by valid and reliable evaluation methods, are needed.

Implementation of an electronic surgical referral service. Collaboration, consensus and cost of the surgeon - general practitioner Delphi approach

Background

Poor coordination between levels of care plays a central role in determining the quality and cost of health care. To improve patient coordination, systematic structures, guidelines, and processes for creating, transferring, and recognizing information are needed to facilitate referral routines.

Methods

Prospective observational survey of implementation of electronic medical record (EMR)-supported guidelines for surgical treatment.

Results

One university clinic, two local hospitals, 31 municipalities, and three EMR vendors participated in the implementation project. Surgical referral guidelines were developed using the Delphi method; 22 surgeons and seven general practitioners (GPs) needed 109 hours to reach consensus. Based on consensus guidelines, an electronic referral service supported by a clinical decision support system, fully integrated into the GPs’ EMR, was developed. Fifty-five information technology personnel and 563 hours were needed (total cost 67,000 £) to implement a guideline supported system in the EMR for 139 GPs. Economical analyses from a hospital and societal perspective, showed that 504 (range 401–670) and 37 (range 29–49) referred patients, respectively, were needed to provide a cost-effective service.

Conclusion

A considerable amount of resources were needed to reach consensus on the surgical referral guidelines. A structured approach by the Delphi method and close collaboration between IT personnel, surgeons and primary care physicians were needed to reach consensus.

Structuring clinical workflows for diabetes care: an overview of the OntoHealth approach

BACKGROUND

Electronic health records (EHRs) play an important role in the treatment of chronic diseases such as diabetes mellitus. Although the interoperability and selected functionality of EHRs are already addressed by a number of standards and best practices, such as IHE or HL7, the majority of these systems are still monolithic from a user-functionality perspective. The purpose of the OntoHealth project is to foster a functionally flexible, standards-based use of EHRs to support clinical routine task execution by means of workflow patterns and to shift the present EHR usage to a more comprehensive integration concerning complete clinical workflows.

OBJECTIVES

The goal of this paper is, first, to introduce the basic architecture of the proposed OntoHealth project and, second, to present selected functional needs and a functional categorization regarding workflow-based interactions with EHRs in the domain of diabetes.

METHODS

A systematic literature review regarding attributes of workflows in the domain of diabetes was conducted. Eligible references were gathered and analyzed using a qualitative content analysis. Subsequently, a functional workflow categorization was derived from diabetes-specific raw data together with existing general workflow patterns.

RESULTS

This paper presents the design of the architecture as well as a categorization model which makes it possible to describe the components or building blocks within clinical workflows. The results of our study lead us to identify basic building blocks, named as actions, decisions, and data elements, which allow the composition of clinical workflows within five identified contexts.

CONCLUSIONS

The categorization model allows for a description of the components or building blocks of clinical workflows from a functional view.

Risks to patient safety associated with implementation of electronic applications for medication management in ambulatory care--a systematic review

BACKGROUND

The objective was to find evidence to substantiate assertions that electronic applications for medication management in ambulatory care (electronic prescribing, clinical decision support (CDSS), electronic health record, and computer generated paper prescriptions), while intended to reduce prescribing errors, can themselves result in errors that might harm patients or increase risks to patient safety.

METHODS

Because a scoping search for adverse events in randomized controlled trials (RCTs) yielded few relevant results, we systematically searched nine databases, including MEDLINE, EMBASE, and The Cochrane Database of Systematic Reviews for systematic reviews and studies of a wide variety of designs that reported on implementation of the interventions. Studies that had safety and adverse events as outcomes, monitored for them, reported anecdotally adverse events or other events that might indicate a threat to patient safety were included.

RESULTS

We found no systematic reviews that examined adverse events or patient harm caused by organizational interventions. Of the 4056 titles and abstracts screened, 176 full-text articles were assessed for inclusion. Sixty-one studies with appropriate interventions, settings and participants but without patient safety, adverse event outcomes or monitoring for risks were excluded, along with 77 other non-eligible studies. Eighteen randomized controlled trials (RCTs), 5 non-randomized controlled trials (non-R,CTs) and 15 observational studies were included. The most common electronic intervention studied was CDSS and the most frequent clinical area was cardio-vascular, including anti-coagulants. No RCTS or non-R,CTS reported adverse event. Adverse events reported in observational studies occurred less frequently after implementation of CDSS. One RCT and one observational study reported an increase in problematic prescriptions with electronic prescribing

CONCLUSIONS

The safety implications of electronic medication management in ambulatory care have not been established with results from studies included in this systematic review. Only a minority of studies that investigated these interventions included threats to patients' safety as outcomes or monitored for adverse events. It is therefore not surprising that we found little evidence to substantiate fears of new risks to patient safety with their implementation. More research is needed to focus on the draw-backs and negative outcomes that implementation of these interventions might introduce.

Meta-analysis of the effectiveness of chronic care management for diabetes: investigating heterogeneity in outcomes

PURPOSE

The study aims to support decision making on how best to redesign diabetes care by investigating three potential sources of heterogeneity in effectiveness across trials of diabetes care management.

METHODS

Medline, CINAHL and PsycInfo were searched for systematic reviews and empirical studies focusing on: (1) diabetes mellitus; (2) adult patients; and (3) interventions consisting of at least two components of the chronic care model (CCM). Systematic reviews were analysed descriptively; empirical studies were meta-analysed. Pooled effect measures were estimated using a meta-regression model that incorporated study quality, length of follow-up and number of intervention components as potential predictors of heterogeneity in effects.

RESULTS

Overall, reviews (n = 15) of diabetes care programmes report modest improvements in glycaemic control. Empirical studies (n = 61) show wide-ranging results on HbA1c, systolic blood pressure and guideline adherence. Differences between studies in methodological quality cannot explain this heterogeneity in effects. Variety in length of follow-up can explain (part of) the variability, yet not across all outcomes. Diversity in the number of included intervention components can explain 8-12% of the heterogeneity in effects on HbA1c and systolic blood pressure.

CONCLUSIONS

The outcomes of chronic care management for diabetes are generally positive, yet differ considerably across trials. The most promising results are attained in studies with limited follow-up (<1 year) and by programmes including more than two CCM components. These factors can, however, explain only part of the heterogeneity in effectiveness between studies. Other potential sources of heterogeneity should be investigated to ensure implementation of evidence-based improvements in diabetes care.

Computerized decision support systems in primary care for type 2 diabetes patients only improve patients' outcomes when combined with feedback on performance and case management: a systematic review

PURPOSE

Computerized decision support systems (CDSSs) are often part of a multifaceted intervention to improve diabetes care. We reviewed the effects of CDSSs alone or in combination with other supportive tools in primary care for type 2 diabetes mellitus (T2DM).

MATERIALS AND METHODS

A systematic literature search was conducted for January 1990-July 2011 in PubMed, Embase, and the Cochrane Database and by consulting reference lists. Randomized controlled trials (RCTs) in general practice were selected if the interventions consisted of a CDSS alone or combined with a reminder system and/or feedback on performance and/or case management. The intervention had to be compared with usual care. Two pairs of reviewers independently abstracted all available data. The data were categorized by process of care and patient outcome measures.

RESULTS

Twenty RCTs met inclusion criteria. In 14 studies a CDSS was combined with another intervention. Two studies were left out of the analysis because of low quality. Four studies with a CDSS alone and four studies with a CDSS and reminders showed improvements of the process of care. CDSS with feedback on performance with or without reminders improved the process of care (one study) and patient outcome (two studies). CDSS with case management improved patient outcome (two studies). CDSS with reminders, feedback on performance, and case management improved both patient outcome and the process of care (two studies).

CONCLUSIONS

CDSSs used by healthcare providers in primary T2DM care are effective in improving the process of care; adding feedback on performance and/or case management may also improve patient outcome.

Computer-generated reminders delivered on paper to healthcare professionals; effects on professional practice and health care outcomes

BACKGROUND

Clinical practice does not always reflect best practice and evidence, partly because of unconscious acts of omission, information overload, or inaccessible information. Reminders may help clinicians overcome these problems by prompting the doctor to recall information that they already know or would be expected to know and by providing information or guidance in a more accessible and relevant format, at a particularly appropriate time.

OBJECTIVES

To evaluate the effects of reminders automatically generated through a computerized system and delivered on paper to healthcare professionals on processes of care (related to healthcare professionals' practice) and outcomes of care (related to patients' health condition).

SEARCH METHODS

For this update the EPOC Trials Search Co-ordinator searched the following databases between June 11-19, 2012: The Cochrane Central Register of Controlled Trials (CENTRAL) and Cochrane Library (Economics, Methods, and Health Technology Assessment sections), Issue 6, 2012; MEDLINE, OVID (1946- ), Daily Update, and In-process; EMBASE, Ovid (1947- ); CINAHL, EbscoHost (1980- ); EPOC Specialised Register, Reference Manager, and INSPEC, Engineering Village. The authors reviewed reference lists of related reviews and studies. 

SELECTION CRITERIA

We included individual or cluster-randomized controlled trials (RCTs) and non-randomized controlled trials (NRCTs) that evaluated the impact of computer-generated reminders delivered on paper to healthcare professionals on processes and/or outcomes of care.

DATA COLLECTION AND ANALYSIS

Review authors working in pairs independently screened studies for eligibility and abstracted data. We contacted authors to obtain important missing information for studies that were published within the last 10 years. For each study, we extracted the primary outcome when it was defined or calculated the median effect size across all reported outcomes. We then calculated the median absolute improvement and interquartile range (IQR) in process adherence across included studies using the primary outcome or median outcome as representative outcome.

MAIN RESULTS

In the 32 included studies, computer-generated reminders delivered on paper to healthcare professionals achieved moderate improvement in professional practices, with a median improvement of processes of care of 7.0% (IQR: 3.9% to 16.4%). Implementing reminders alone improved care by 11.2% (IQR 6.5% to 19.6%) compared with usual care, while implementing reminders in addition to another intervention improved care by 4.0% only (IQR 3.0% to 6.0%) compared with the other intervention. The quality of evidence for these comparisons was rated as moderate according to the GRADE approach. Two reminder features were associated with larger effect sizes: providing space on the reminder for provider to enter a response (median 13.7% versus 4.3% for no response, P value = 0.01) and providing an explanation of the content or advice on the reminder (median 12.0% versus 4.2% for no explanation, P value = 0.02). Median improvement in processes of care also differed according to the behaviour the reminder targeted: for instance, reminders to vaccinate improved processes of care by 13.1% (IQR 12.2% to 20.7%) compared with other targeted behaviours. In the only study that had sufficient power to detect a clinically significant effect on outcomes of care, reminders were not associated with significant improvements.

AUTHORS' CONCLUSIONS

There is moderate quality evidence that computer-generated reminders delivered on paper to healthcare professionals achieve moderate improvement in process of care. Two characteristics emerged as significant predictors of improvement: providing space on the reminder for a response from the clinician and providing an explanation of the reminder's content or advice. The heterogeneity of the reminder interventions included in this review also suggests that reminders can improve care in various settings under various conditions.

The Treatment of cardiovascular Risk in Primary care using Electronic Decision supOrt (TORPEDO) study-intervention development and protocol for a cluster randomised, controlled trial of an electronic decision support and quality improvement intervention in Australian primary healthcare

BACKGROUND

Large gaps exist in the implementation of guideline recommendations for cardiovascular disease (CVD) risk management. Electronic decision support (EDS) systems are promising interventions to close these gaps but few have undergone clinical trial evaluation in Australia. We have developed HealthTracker, a multifaceted EDS and quality improvement intervention to improve the management of CVD risk.

METHODS/DESIGN

It is hypothesised that the use of HealthTracker over a 12-month period will result in: (1) an increased proportion of patients receiving guideline-indicated measurements of CVD risk factors and (2) an increased proportion of patients at high risk will receive guideline-indicated prescriptions for lowering their CVD risk. Sixty health services (40 general practices and 20 Aboriginal Community Controlled Health Services (ACCHSs) will be randomised in a 1:1 allocation to receive either the intervention package or continue with usual care, stratified by service type, size and participation in existing quality improvement initiatives. The intervention consists of point-of-care decision support; a risk communication interface; a clinical audit tool to assess performance on CVD-related indicators; a quality improvement component comprising peer-ranked data feedback and support to develop strategies to improve performance. The control arm will continue with usual care without access to these intervention components. Quantitative data will be derived from cross-sectional samples at baseline and end of study via automated data extraction. Detailed process and economic evaluations will also be conducted.

ETHICS AND DISSEMINATION

The general practice component of the study is approved by the University of Sydney Human Research Ethics Committee (HREC) and the ACCHS component is approved by the Aboriginal Health and Medical Research Council HREC. Formal agreements with each of the participating sites have been signed. In addition to the usual scientific forums, results will be disseminated via newsletters, study websites, face-to-face feedback forums and workshops.

TRIAL REGISTRATION

The trial is registered with the Australian Clinical Trials Registry ACTRN 12611000478910.

Provider and systems factors in diabetes quality of care

A gap exists in knowledge and the observed frequency with which patients with diabetes actually receive treatment for optimal cardiovascular risk reduction. Many interventions to improve quality of care have been targeted at the health systems level and provider organizations. Changes in several domains of care and investment in quality by organizational leaders are needed to make long-lasting improvements. In the studies reviewed, the most effective strategies often have multiple components, whereas the use of one single strategy, such as reminders only or an educational intervention, is less effective. More studies are needed to examine the effect of several care management strategies simultaneously, such as use of clinical information systems, provider financial incentives, and organizational model on processes of care and outcomes.

Can computerized clinical decision support systems improve practitioners' diagnostic test ordering behavior? A decision-maker-researcher partnership systematic review

Background

Underuse and overuse of diagnostic tests have important implications for health outcomes and costs. Decision support technology purports to optimize the use of diagnostic tests in clinical practice. The objective of this review was to assess whether computerized clinical decision support systems (CCDSSs) are effective at improving ordering of tests for diagnosis, monitoring of disease, or monitoring of treatment. The outcome of interest was effect on the diagnostic test-ordering behavior of practitioners.

Methods

We conducted a decision-maker-researcher partnership systematic review. We searched MEDLINE, EMBASE, Ovid's EBM Reviews database, Inspec, and reference lists for eligible articles published up to January 2010. We included randomized controlled trials comparing the use of CCDSSs to usual practice or non-CCDSS controls in clinical care settings. Trials were eligible if at least one component of the CCDSS gave suggestions for ordering or performing a diagnostic procedure. We considered studies 'positive' if they showed a statistically significant improvement in at least 50% of test ordering outcomes.

Results

Thirty-five studies were identified, with significantly higher methodological quality in those published after the year 2000 (p = 0.002). Thirty-three trials reported evaluable data on diagnostic test ordering, and 55% (18/33) of CCDSSs improved testing behavior overall, including 83% (5/6) for diagnosis, 63% (5/8) for treatment monitoring, 35% (6/17) for disease monitoring, and 100% (3/3) for other purposes. Four of the systems explicitly attempted to reduce test ordering rates and all succeeded. Factors of particular interest to decision makers include costs, user satisfaction, and impact on workflow but were rarely investigated or reported.

Conclusions

Some CCDSSs can modify practitioner test-ordering behavior. To better inform development and implementation efforts, studies should describe in more detail potentially important factors such as system design, user interface, local context, implementation strategy, and evaluate impact on user satisfaction and workflow, costs, and unintended consequences.

Computerized clinical decision support systems for chronic disease management: a decision-maker-researcher partnership systematic review

Background

The use of computerized clinical decision support systems (CCDSSs) may improve chronic disease management, which requires recurrent visits to multiple health professionals, ongoing disease and treatment monitoring, and patient behavior modification. The objective of this review was to determine if CCDSSs improve the processes of chronic care (such as diagnosis, treatment, and monitoring of disease) and associated patient outcomes (such as effects on biomarkers and clinical exacerbations).

Methods

We conducted a decision-maker-researcher partnership systematic review. We searched MEDLINE, EMBASE, Ovid's EBM Reviews database, Inspec, and reference lists for potentially eligible articles published up to January 2010. We included randomized controlled trials that compared the use of CCDSSs to usual practice or non-CCDSS controls. Trials were eligible if at least one component of the CCDSS was designed to support chronic disease management. We considered studies 'positive' if they showed a statistically significant improvement in at least 50% of relevant outcomes.

Results

Of 55 included trials, 87% (n = 48) measured system impact on the process of care and 52% (n = 25) of those demonstrated statistically significant improvements. Sixty-five percent (36/55) of trials measured impact on, typically, non-major (surrogate) patient outcomes, and 31% (n = 11) of those demonstrated benefits. Factors of interest to decision makers, such as cost, user satisfaction, system interface and feature sets, unique design and deployment characteristics, and effects on user workflow were rarely investigated or reported.

Conclusions

A small majority (just over half) of CCDSSs improved care processes in chronic disease management and some improved patient health. Policy makers, healthcare administrators, and practitioners should be aware that the evidence of CCDSS effectiveness is limited, especially with respect to the small number and size of studies measuring patient outcomes.

Computerized clinical decision support systems for drug prescribing and management: a decision-maker-researcher partnership systematic review

Background

Computerized clinical decision support systems (CCDSSs) for drug therapy management are designed to promote safe and effective medication use. Evidence documenting the effectiveness of CCDSSs for improving drug therapy is necessary for informed adoption decisions. The objective of this review was to systematically review randomized controlled trials assessing the effects of CCDSSs for drug therapy management on process of care and patient outcomes. We also sought to identify system and study characteristics that predicted benefit.

Methods

We conducted a decision-maker-researcher partnership systematic review. We updated our earlier reviews (1998, 2005) by searching MEDLINE, EMBASE, EBM Reviews, Inspec, and other databases, and consulting reference lists through January 2010. Authors of 82% of included studies confirmed or supplemented extracted data. We included only randomized controlled trials that evaluated the effect on process of care or patient outcomes of a CCDSS for drug therapy management compared to care provided without a CCDSS. A study was considered to have a positive effect (i.e., CCDSS showed improvement) if at least 50% of the relevant study outcomes were statistically significantly positive.

Results

Sixty-five studies met our inclusion criteria, including 41 new studies since our previous review. Methodological quality was generally high and unchanged with time. CCDSSs improved process of care performance in 37 of the 59 studies assessing this type of outcome (64%, 57% of all studies). Twenty-nine trials assessed patient outcomes, of which six trials (21%, 9% of all trials) reported improvements.

Conclusions

CCDSSs inconsistently improved process of care measures and seldomly improved patient outcomes. Lack of clear patient benefit and lack of data on harms and costs preclude a recommendation to adopt CCDSSs for drug therapy management.

Interventions in primary care to improve cardiovascular risk factors and glycated haemoglobin (HbA1c) levels in patients with diabetes: a systematic review

Most patients with diabetes are treated in primary care (PC). We performed a systematic review to assess the effect of single and combined interventions on cardiovascular risk factors (CVRFs) and glycated haemoglobin (HbA1c) levels in patients with diabetes in PC settings. We searched the MEDLINE database from January 1990 to October 2008. According to the Cochrane Effective Practice and Organization of Care Group (EPOC) criteria, (cluster-)randomized control studies and controlled before-and-after studies were selected and reviewed. Identified interventions were classified according to a modified EPOC intervention taxonomy. We included 68 studies. Forty-five studies evaluated the effect of any intervention on HbA1c. Seventeen studies presented a significant improvement in HbA1c. Nine out of 27 studies evaluating CVRFs [cholesterol, blood pressure (BP)] and HbA1c showed a significant improvement in at least two of these factors. Audit and feedback on performance, clinical decision support systems, multi-professional teams and patient education seemed to be successful strategies. The increasing evidence regarding the treatment of persons with chronic illnesses, summarized in the Chronic Care Model (CCM), is not reflected in most recent studies about diabetes treatment in PC. Most interventions still seem only partly adapted to the CCM. The methodological quality of many studies is still poor and often the pivotal outcomes, CVRFs and HbA1c, are not appropriately addressed. As a consequence, the potential of PC in the care of patients with diabetes may still be underestimated.

The impact of health information technology on the quality of medical and health care: a systematic review

The aim of this study was to systematically review the published evidence of the impact of health information technology (HIT) or health information systems (HIS) on the quality of healthcare, focusing on clinicians's; adherence to evidence-based guidelines and the corresponding impact this had on patient clinical outcomes. The review covered the use of health information technologies and systems in both medical care (i.e. clinical and surgical) and other areas such as allied health and preventive services. Studies were included in the review if they examined the impact of Electronic Health Record (EHR), Computerised Provider Order-Entry (CPOE), or Decision Support System (DS); and if the primary outcomes of the studies were focused on the level of compliance with evidence-based guidelines among clinicians. Measurements considered relevant to the review were either of changes in clinical processes resulting from a change of the providers' behaviour, or of specific patient outcomes that demonstrated the effectiveness of a particular treatment given by providers. Of 23 studies included in the current review, 17 assessed the impact of HIT/HIS on health care practitioners' performance. A positive improvement, in relation to their compliance with evidence-based guidelines, was seen in 14 studies. Studies that included an assessment of patient outcomes, however, showed insufficient evidence of either clinically or statistically important improvements. Although the number of studies reviewed was relatively small, the findings demonstrated consistency with similar previous reviews of this nature in that wide scale use of HIT has been shown to increase clinician's adherence to guidelines.

The role of standardized data and terminological systems in computerized clinical decision support systems: literature review and survey

INTRODUCTION

Clinical decision support systems (CDSSs) should be seamlessly integrated with existing clinical information systems to enable automatic provision of advice at the time and place where decisions are made. It has been suggested that a lack of agreed data standards frequently hampers this integration. We performed a literature review to investigate whether CDSSs used standardized (i.e. coded or numerical) data and which terminological systems have been used to code data. We also investigated whether a lack of standardized data was considered an impediment for CDSS implementation.

METHODS

Articles reporting an evaluation of a CDSS that provided a computerized advice based on patient-specific data items were identified based on a former literature review on CDSS and on CDSS studies identified in AMIA's 'Year in Review'. Authors of these articles were contacted to check and complete the extracted data. A questionnaire among the authors of included studies was used to determine the obstacles in CDSS implementation.

RESULTS

We identified 77 articles published between 1995 and 2008. Twenty-two percent of the evaluated CDSSs used only numerical data. Fifty one percent of the CDSSs that used coded data applied an international terminology. The most frequently used international terminology were the ICD (International Classification of Diseases), used in 68% of the cases and LOINC (Logical Observation Identifiers Names and Codes) in 12% of the cases. More than half of the authors experienced barriers in CDSS implementation. In most cases these barriers were related to the lack of electronically available standardized data required to invoke or activate the CDSS.

CONCLUSION

Many CDSSs applied different terminological systems to code data. This diversity hampers the possibility of sharing and reasoning with data within different systems. The results of the survey confirm the hypothesis that data standardization is a critical success factor for CDSS development.

Translation of personalized decision support into routine diabetes care

OBJECTIVE

The aim of this study was to evaluate the impact of personalized decision support (PDS) on metabolic control in people with diabetes and cardiovascular disease.

RESEARCH DESIGN AND METHODS

The German health insurance fund BKK TAUNUS offers to its insured people with diabetes and cardiovascular disease the possibility to participate in the Diabetiva® program, which includes PDS. Personalized decision support is generated by the expert system KADIS® using self-control data and continuous glucose monitoring (CGM) as its data source. The physician of the participating person receives the PDS once a year, decides about use or nonuse, and reports his/her decision in a questionnaire. Metabolic control of participants treated by use or nonuse of PDS for one year and receiving CGM twice was analyzed in a retrospective observational study. The primary outcome was hemoglobin A1c (HbA1c); secondary outcomes were mean sensor glucose (MSG), glucose variability, and hypoglycemia.

RESULTS

A total of 323 subjects received CGM twice, 289 had complete data sets, 97% (280/289) were type 2 diabetes patients, and 74% (214/289) were treated using PDS, resulting in a decrease in HbA1c [7.10±1.06 to 6.73±0.82%; p<.01; change in HbA1ct0-t12 months -0.37 (95% confidence interval -0.46 to -0.28)] and MSG (7.7±1.6 versus 7.4±1.2 mmol/liter; p=.003) within one year. Glucose variability was also reduced, as indicated by lower high blood glucose index (p=.001), Glycemic Risk Assessment Diabetes Equation (p=.009), and time of hyper-glycemia (p=.003). Low blood glucose index and time spent in hypoglycemia were not affected. In contrast, nonuse of PDS (75/289) resulted in increased HbA1c (p<.001). Diabetiva outcome was strongly related to baseline HbA1c (HbA1ct0; p<.01) and use of PDS (p<.01). Acceptance of PDS was dependent on HbA1ct0 (p=.049).

CONCLUSIONS

Personalized decision support has potential to improve metabolic outcome in routine diabetes care.

Effective population management practices in diabetes care - an observational study

BACKGROUND

Ensuring that evidence based medicine reaches patients with diabetes in the US and internationally is challenging. The chronic care model includes evidence based management practices which support evidence based care. However, despite numerous studies, it is unclear which practices are most effective. Few studies assess the effect of simultaneous practices implemented to varying degrees. The present study evaluates the effect of fifteen practices applied concurrently and takes variation in implementation levels into account while assessing the impact of diabetes care management practices on glycemic and lipid monitoring.

METHODS

Fifteen management practices were identified. Implementation levels of the practices in 41 medical centres caring for 553,556 adults with diabetes were assessed from structured interviews with key informants. Stepwise logistic regression models with management practices as explanatory variables and glycemic and lipid monitoring as outcome variables were used to identify the diabetes care practices most associated with high performance.

RESULTS

Of the 15 practices studied, only provider alerts were significantly associated with higher glycemic and lipid monitoring rates. The odds ratio for glycemic monitoring was 4.07 (p < 0.00001); the odds ratio for lipid monitoring was 1.63 (p < 0.006). Weaker associations were found between action plans and glycemic monitoring (odds ratio = 1.44; p < 0.03) and between guideline distribution and training and lipid monitoring (odds ratio = 1.46; p < 0.03). The covariates of gender, age, cardiac disease and depression significantly affected monitoring rates.

CONCLUSIONS

Of fifteen diabetes care management practices, our data indicate that high performance is most associated with provider alerts and more weakly associated with action plans and with guideline distribution and training. Lack of convergence in the literature on effective care management practices suggests that factors contributing to high performance may be highly context-dependent or that the factors involved may be too numerous or their implementation too nuanced to be reliably identified in observational studies.

The effectiveness of computerized clinical guidelines in the process of care: a systematic review

BACKGROUND

Clinical practice guidelines have been developed aiming to improve the quality of care. The implementation of the computerized clinical guidelines (CCG) has been supported by the development of computerized clinical decision support systems.This systematic review assesses the impact of CCG on the process of care compared with non-computerized clinical guidelines.

METHODS

Specific features of CCG were studied through an extensive search of scientific literature, querying electronic databases: Pubmed/Medline, Embase and Cochrane Controlled Trials Register. A multivariable logistic regression was carried out to evaluate the association of CCG's features with positive effect on the process of care.

RESULTS

Forty-five articles were selected. The logistic model showed that Automatic provision of recommendation in electronic version as part of clinician workflow (Odds Ratio [OR]= 17.5; 95% confidence interval [CI]: 1.6-193.7) and Publication Year (OR = 6.7; 95%CI: 1.3-34.3) were statistically significant predictors.

CONCLUSIONS

From the research that has been carried out, we can conclude that after implementation of CCG significant improvements in process of care are shown. Our findings also suggest clinicians, managers and other health care decision makers which features of CCG might improve the structure of computerized system.

Effectiveness of electronic guideline-based implementation systems in ambulatory care settings - a systematic review

Background

Electronic guideline-based decision support systems have been suggested to successfully deliver the knowledge embedded in clinical practice guidelines. A number of studies have already shown positive findings for decision support systems such as drug-dosing systems and computer-generated reminder systems for preventive care services.

Methods

A systematic literature search (1990 to December 2008) of the English literature indexed in the Medline database, Embase, the Cochrane Central Register of Controlled Trials, and CRD (DARE, HTA and NHS EED databases) was conducted to identify evaluation studies of electronic multi-step guideline implementation systems in ambulatory care settings. Important inclusion criterions were the multidimensionality of the guideline (the guideline needed to consist of several aspects or steps) and real-time interaction with the system during consultation. Clinical decision support systems such as one-time reminders for preventive care for which positive findings were shown in earlier reviews were excluded. Two comparisons were considered: electronic multidimensional guidelines versus usual care (comparison one) and electronic multidimensional guidelines versus other guideline implementation methods (comparison two).

Results

Twenty-seven publications were selected for analysis in this systematic review. Most designs were cluster randomized controlled trials investigating process outcomes more than patient outcomes. With success defined as at least 50% of the outcome variables being significant, none of the studies were successful in improving patient outcomes. Only seven of seventeen studies that investigated process outcomes showed improvements in process of care variables compared with the usual care group (comparison one). No incremental effect of the electronic implementation over the distribution of paper versions of the guideline was found, neither for the patient outcomes nor for the process outcomes (comparison two).

Conclusions

There is little evidence at the moment for the effectiveness of an increasingly used and commercialised instrument such as electronic multidimensional guidelines. After more than a decade of development of numerous electronic systems, research on the most effective implementation strategy for this kind of guideline-based decision support systems is still lacking. This conclusion implies a considerable risk towards inappropriate investments in ineffective implementation interventions and in suboptimal care.

An electronic clinical decision support tool to assist primary care providers in cardiovascular disease risk management: development and mixed methods evaluation

BACKGROUND

Challenges remain in translating the well-established evidence for management of cardiovascular disease (CVD) risk into clinical practice. Although electronic clinical decision support (CDS) systems are known to improve practitioner performance, their development in Australian primary health care settings is limited.

OBJECTIVES

Study aims were to (1) develop a valid CDS tool that assists Australian general practitioners (GPs) in global CVD risk management, and (2) preliminarily evaluate its acceptability to GPs as a point-of-care resource for both general and underserved populations.

METHODS

CVD risk estimation (based on Framingham algorithms) and risk-based management advice (using recommendations from six Australian guidelines) were programmed into a software package. Tool validation: Data from 137 patients attending a physician's clinic were analyzed to compare the tool's risk scores with those obtained from an independently programmed algorithm in a separate statistics package. The tool's management advice was compared with a physician's recommendations based on a manual review of the guidelines. Field test: The tool was then tested with 21 GPs from eight general practices and three Aboriginal Medical Services. Customized CDS-based recommendations were generated for 200 routinely attending patients (33% Aboriginal) using information extracted from the health record by a research assistant. GPs reviewed these recommendations during each consultation. Changes in CVD risk factor measurement and management were recorded. In-depth interviews with GPs were conducted.

RESULTS

Validation testing: the tool's risk assessment algorithm correlated very highly with the independently programmed version in the separate statistics package (intraclass correlation coefficient 0.999). For management advice, there were only two cases of disagreement between the tool and the physician. Field test: GPs found 77% (153/200) of patient outputs easy to understand and agreed with screening and prescribing recommendations in 72% and 64% of outputs, respectively; 26% of patients had their CVD risk factor history updated; 73% had at least one CVD risk factor measured or tests ordered. For people assessed at high CVD risk (n = 82), 10% and 9%, respectively, had lipid-lowering and BP-lowering medications commenced or dose adjustments made, while 7% newly commenced anti-platelet medications. Three key qualitative findings emerged: (1) GPs found the tool enabled a systematic approach to care; (2) the tool greatly influenced CVD risk communication; (3) successful implementation into routine care would require integration with practice software, minimal data entry, regular revision with updated guidelines, and a self-auditing feature. There were no substantive differences in study findings for Aboriginal Medical Services GPs, and the tool was generally considered appropriate for use with Aboriginal patients.

CONCLUSION

A fully-integrated, self-populating, and potentially Internet-based CDS tool could contribute to improved global CVD risk management in Australian primary health care. The findings from this study will inform a large-scale trial intervention.

Can primary care professionals' adherence to Evidence Based Medicine tools improve quality of care in type 2 diabetes mellitus? A systematic review

BACKGROUND

Our aim is to review the effectiveness of EBM tools available to primary care professionals to improve the quality of Type 2 diabetes disease management.

METHODS

A systematic review of RCT was performed according to the Cochrane methods.

RESULTS

Starting from an overall number of 1737 references found, a total of 13 studies met all the inclusion criteria.

CONCLUSIONS

The adherence to EBM instruments is likely to improve process of care, rather than patient outcomes. In addition, our review outlines that feedback reports and use of ICT devices are likely to be effective in diabetes disease management.

The effect of feedback to general practitioners on quality of care for people with type 2 diabetes. A systematic review of the literature

Background

There have been numerous efforts to improve and assure the quality of treatment and follow-up of people with Type 2 diabetes (PT2D) in general practice. Facilitated by the increasing usability and validity of guidelines, indicators and databases, feedback on diabetes care is a promising tool in this aspect. Our goal was to assess the effect of feedback to general practitioners (GPs) on the quality of care for PT2D based on the available literature.

Methods

Systematic review searches were conducted using October 2008 updates of Medline (Pubmed), Cochrane library and Embase databases. Additional searches in reference lists and related articles were conducted. Papers were included if published in English, performed as randomized controlled trials, studying diabetes, having general practice as setting and using feedback to GPs on diabetes care. The papers were assessed according to predefined criteria.

Results

Ten studies complied with the inclusion criteria. Feedback improved the care for PT2D, particularly process outcomes such as foot exams, eye exams and Hba1c measurements. Clinical outcomes like lowering of blood pressure, Hba1c and cholesterol levels were seen in few studies. Many process and outcome measures did not improve, while none deteriorated. Meta analysis was unfeasible due to heterogeneity of the studies included. Two studies used electronic feedback.

Conclusion

Based on this review, feedback seems a promising tool for quality improvement in diabetes care, but more research is needed, especially of electronic feedback.

Features predicting the success of computerized decision support for prescribing: a systematic review of randomized controlled trials

Background

Computerized decision support systems (CDSS) are believed to have the potential to improve the quality of health care delivery, although results from high quality studies have been mixed. We conducted a systematic review to evaluate whether certain features of prescribing decision support systems (RxCDSS) predict successful implementation, change in provider behaviour, and change in patient outcomes.

Methods

A literature search of Medline, EMBASE, CINAHL and INSPEC databases (earliest entry to June 2008) was conducted to identify randomized controlled trials involving RxCDSS. Each citation was independently assessed by two reviewers for outcomes and 28 predefined system features. Statistical analysis of associations between system features and success of outcomes was planned.

Results

Of 4534 citations returned by the search, 41 met the inclusion criteria. Of these, 37 reported successful system implementations, 25 reported success at changing health care provider behaviour, and 5 noted improvements in patient outcomes. A mean of 17 features per study were mentioned. The statistical analysis could not be completed due primarily to the small number of studies and lack of diversity of outcomes. Descriptive analysis did not confirm any feature to be more prevalent in successful trials relative to unsuccessful ones for implementation, provider behaviour or patient outcomes.

Conclusion

While RxCDSSs have the potential to change health care provider behaviour, very few high quality studies show improvement in patient outcomes. Furthermore, the features of the RxCDSS associated with success (or failure) are poorly described, thus making it difficult for system design and implementation to improve.

Systematic review of implementation strategies for risk tables in the prevention of cardiovascular diseases

Background

Cardiovascular disease prevention is guided by so-called risk tables for calculating individual’s risk numbers. However, they are not widely used in routine practice and it is important to understand the conditions for their use.

Objectives

Systematic review of the literature on professionals’ performance regarding cardiovascular risk tables, in order to develop effective implementation strategies.

Selection criteria

Studies were eligible for inclusion if they reported quantitative empirical data on the effect of professional, financial, organizational or regulatory strategies on the implementation of cardiovascular risk tables. Participants were physicians or nurses.

Outcome measure

Primary: professionals’ self-reported performance related to actual use of cardiovascular risk tables. Secondary: patients’ cardiovascular risk reduction.

Data collection and analysis

An extensive strategy was used to search MEDLINE, EMBASE, CINAHL, and PSYCHINFO from database inception to February 2007.

Main results

The review included 9 studies, covering 3 types of implementation strategies (or combinations). Reported effects were moderate, sometimes conflicting and contradictory. Although no clear relation was observed between a particular type of strategy and success or failure of the implementation, promising strategies for patient selection and risk assessment seem to be teamwork, nurse led-clinics and integrated IT support.

Conclusions

Implementation strategies for cardiovascular risk tables have been sparsely studied. Future research on implementation of cardiovascular risk tables needs better embedding in the systematic and problem-based approaches developed in implementation science.

Does the routine use of global coronary heart disease risk scores translate into clinical benefits or harms? A systematic review of the literature

BACKGROUND

Guidelines now recommend routine assessment of global coronary heart disease (CHD) risk scores. We performed a systematic review to assess whether global CHD risk scores result in clinical benefits or harms.

METHODS

We searched MEDLINE (1966 through June 13, 2007) for articles relevant to our review. Using predefined inclusion and exclusion criteria, we included studies of any design that provided physicians with global risk scores or allowed them to calculate scores themselves, and then measured clinical benefits and/or harms. Two reviewers reviewed potentially relevant studies for inclusion and resolved disagreement by consensus. Data from each article was then abstracted into an evidence table by one reviewer and the quality of evidence was assessed independently by two reviewers.

RESULTS

11 studies met criteria for inclusion in our review. Six studies addressed clinical benefits and 5 addressed clinical harms. Six studies were rated as "fair" quality and the others were deemed "methodologically limited". Two fair quality studies showed that physician knowledge of global CHD risk is associated with increased prescription of cardiovascular drugs in high risk (but not all) patients. Two additional fair quality studies showed no effect on their primary outcomes, but one was underpowered and the other focused on prescribing of lifestyle changes, rather than drugs whose prescribing might be expected to be targeted by risk level. One of these aforementioned studies showed improved blood pressure in high-risk patients, but no improvement in the proportion of patients at high risk, perhaps due to the high proportion of participants with baseline risks significantly exceeding the risk threshold. Two fair quality studies found no evidence of harm from patient knowledge of global risk scores when they were accompanied by counseling, and optional or scheduled follow-up. Other studies were too methodologically limited to draw conclusions.

CONCLUSION

Our review provides preliminary evidence that physicians' knowledge of global CHD risk scores may translate into modestly increased prescribing of cardiovascular drugs and modest short-term reductions in CHD risk factors without clinical harm. Whether these results are replicable, and translate across other practice settings or into improved long-term CHD outcomes remains to be seen.

Telemedicine and diabetes management: current challenges and future research directions

Telemedicine is lying between fading and future. Several clinical studies and critical reviews have been published recently, but the results are inconclusive and the adoption of telemedicine interventions in clinical practice is slow. This article discusses some of the current problems related to the adoption of telemedicine systems and focuses on the information technology solutions that appear to be most promising for diabetes management in the near future. Context awareness, user modeling, intelligent dialogues, and integrated information systems are presented. Some potential future scenarios for the adoption of telemedicine, which combine novel technologies and new organizational models, are also discussed. Within those scenarios, telemedicine may prove to be a good instrument to support health care providers in the effective management and prevention of diabetes mellitus.

Are we measuring the right end-points? Variables that affect the impact of computerised decision support on patient outcomes: a systematic review

Previous reviews of electronic decision-support systems (EDSS) have often treated them as a single category, and factors that may modify their effectiveness of EDSS have not been examined. The objective was to summarise the evidence associating the use of computerised decision support and improved patient outcomes. PubMed/Medline and the Database of Abstracts were searched for randomised controlled trials (RCT) of EDSS from 1 January 1994 to 31 January 2006. Twenty-four RCT studies from 97 reviewed were selected, eight of them examined systems supporting decisions for patients who presented with an acute illness, and 16 studies enrolled patients with chronic conditions. Overall, 13 (54%) of the studies showed a positive result, and 11 (46%) were with no impact. Critiquing and consultative systems showed the impact in 71% and 47% of studies, respectively. All systems targeting decisions related to acute disease improved patient outcomes compared with 38% of systems focused on the management of chronic conditions (P = 0.005). Provision of EDSS improves prescribing practices and treatment outcomes of patients with acute illnesses; however, EDSS were less effective in primary care. Complex interventions as clinical EDSS may require new metrics of assessment to describe the impact on patient outcomes.

Task delegation and computerized decision support reduce coronary heart disease risk factors in type 2 diabetes patients in primary care

BACKGROUND

Reducing cardiovascular risk in patients with diabetes mellitus type 2 (DM2) is important in diabetes care. However, treating patients according to clinical guidelines appears to be difficult. Delegating routine tasks to a practice nurse combined with computerized decision support systems (CDSS) may be helpful. The objective was to study the effectiveness of practice nurse-managed CDSS for diabetes care on improving cardiovascular risk factors in DM2 patients.

METHODS

In 113 primary care practices (n = 7,893 DM2 patients) across the Netherlands, the diabetes care protocol (DCP) was assessed in a before-after study, lasting 1 year. All practices implemented DCP, which is characterized by delegation of routine tasks in diabetes care to a practice nurse, software that supports diabetes management, medical decisions, and benchmarking (CDSS). All DM2 patients treated by their primary care physician were asked to attend the program. Primary outcome was the percentage of patients achieving treatment targets: hemoglobin A1c (HbA1c) <or=7%, blood pressure <or= 150/85 mm Hg, and total cholesterol <or= 5 mmol/L.

RESULTS

The percentage of DM2 patients who achieved targets increased significantly, from 60.6% to 66.5% for HbA1c, from 48.7% to 61.9% for blood pressure, and from 47.4 % to 60.6% for total cholesterol. The percentage of patients achieving all three targets increased from 15.3% to 26.9% (all P < 0.01).

CONCLUSION

Delegating routine tasks in diabetes care to a practice nurse combined with CDSS and benchmarking helps achieve treatment goals for HbA1c, blood pressure, and cholesterol and reduce cardiovascular risk of DM2 patients in primary care.

Adoption of order entry with decision support for chronic care by physician organizations

OBJECTIVE

This study sought to explore physician organizations' adoption of chronic care guidelines in order entry systems and to investigate the organizational and market-related factors associated with this adoption.

DESIGN

A quantitative nationwide survey of all primary care medical groups in the United States with 20 or more physicians; data were collected on 1,104 physician organizations, representing a 70% response rate.

MEASUREMENTS

Measurements were the presence of an asthma, diabetes, or congestive heart failure guideline in a physician organization's order entry system; size; age of the organization; number of clinic locations; type of ownership; health maintenance organization market penetration; urban/rural location; and presence of external incentives to improve quality of care.

RESULTS

Only 27% of organizations reported access to order entry with decision support for chronic disease care. External incentives for quality is the only factor significantly associated with adoption of these tools. Organizations experiencing greater external incentives for quality are more likely to adopt order entry with decision support.

CONCLUSION

Because external incentives are strong drivers of adoption, policies requiring reporting of chronic care measurements and rewarding improvement as well as financial incentives for use of specific information technology tools are likely to accelerate adoption of order entry with decision support.

Determinants of physician use of an ambulatory prescription expert system

PURPOSE

To determine whether physician experience with and attitude towards computers is associated with adoption of a voluntary ambulatory prescription writing expert system.

METHODS

A prescription expert system was implemented in an academic internal medicine residency training clinic and physician utilization was tracked electronically. A physician attitude and behavior survey (response rate=89%) was conducted six months after implementation.

RESULTS

There was wide variability in system adoption and degree of usage, though 72% of physicians reported predominant usage (> or =50% of prescriptions) of the expert system six months after implementation. Self-reported and measured technology usage were strongly correlated (r=0.70, p<0.0001). Variation in use was strongly associated with physician attitude toward issues of system efficiency and effect on quality, but not with prior computer experience, level of training, or satisfaction with their primary care practice. Non-adopters felt that electronic prescribing was more time consuming and also more likely to believe that their patients preferred hand-written prescriptions.

CONCLUSION

A voluntary electronic prescription system was readily adopted by a majority of physicians who believed it would have a positive impact on the quality and efficiency of care. However, dissatisfaction with system capabilities among both adopters and non-adopters suggests the importance of user education and expectation management following system selection.

Influence of guideline adherence on outcome in a randomised controlled trial on the efficacy of methotrexate with folate supplementation in rheumatoid arthritis

OBJECTIVE

To study the influence of rheumatologists' adherence to a methotrexate guideline on efficacy and toxicity in the treatment of rheumatoid arthritis.

METHODS

In a 48 week randomised controlled trial of methotrexate, comparing folates with placebo, rheumatologists were advised on methotrexate dosage using a guideline reflecting daily practice. The influence of guideline non-adherence on outcome was analysed using generalised estimating equations and survival analysis.

RESULTS

In 51% of the 411 study patients the guidelines were always followed. Non-adherence resulted in lower doses of methotrexate in 25% of cases, and higher doses in 24%. The reduction in the disease activity score was significantly greater (mean -0.4; p = 0.0085) in the adherent group than in the "low dose" group; the "high dose" group did not differ from the adherent group. Dropout caused by severe adverse events did not differ between the three groups.

CONCLUSIONS

There is an indication that adherence to guidelines on methotrexate dosage may benefit patients with rheumatoid arthritis by improving disease activity without increasing toxicity. For definite proof, a randomised controlled trial comparing guideline supported dosing with usual care is needed.

Selecting, presenting and delivering clinical guidelines: are there any "magic bullets"?

There are internationally agreed optimal methods for developing clinical practice guidelines. The quality of published guidelines varies. A validated assessment instrument should be used to identify well developed guidelines that can be used with confidence. There are multiple ways of presenting guidelines, including computerised systems. Computerisation of guidelines can cover a range of formats, from brief prompts through to complex decision-support systems. Integrating guidelines into computerised reminder systems has been shown to be effective in improving patient care, but there is less evidence to support the effectiveness of guidelines integrated into computerised decision-support systems.

Effectiveness of a measurement feedback system on outcome in rheumatoid arthritis: a controlled clinical trial

BACKGROUND

With the help of a measurement feedback system, the treatment strategy for individual patients with rheumatoid arthritis (RA) can be adjusted to achieve optimal control of disease activity.

OBJECTIVE

To study whether a measurement feedback system is effective in reducing disease activity in patients with RA.

METHODS

Forty eight rheumatologists and 264 patients participated in a controlled clinical trial. A three month control period was followed by a 12 month period, where feedback on disease activity, disability, and damage was provided to the rheumatologist. The primary outcome measure was the rheumatoid arthritis disease activity index (RADAI).

RESULTS

The feedback system was used for 142/228 (62%) patients. Disease modifying antirheumatic drug changes occurred in 69/169 (41%) patients. In patients with high disease activity and feedback use (n=70), the RADAI decreased in the feedback period by -0.27 points per 30 days (p<0.05), as compared with the control period. Patients for whom the feedback system was used had a better outcome than non-users.

CONCLUSION

Much more training on the use of a feedback system and outcome measures, as well as the inclusion of explicit treatment guidelines will be necessary to increase the clinical use of measurement feedback and, possibly, to reduce disease activity for a larger number of patients with RA.

Effects of an automated electronic reminder in changing the antiplatelet drug-prescribing behavior among Italian general practitioners in diabetic patients: an intervention trial

OBJECTIVE

To evaluate whether an electronic reminder integrated into a routine computer system increases the use of antiplatelet drugs for diabetic patients among Italian general practitioners (GPs).

RESEARCH DESIGN AND METHODS

A randomized controlled trial was carried out among 300 GPs and their patients selected from the Health Search Database. Among these, 150 GPs (intervention group) received instructions to activate an electronic reminder plus a letter summarizing the beneficial effects of antiplatelet drugs in diabetic patients with at least one additional cardiovascular risk factor ("high risk"), whereas the other 150 GPs (control group) received only the letter. The electronic reminder, integrated into a standard software system for the management of the daily clinical practice, was displayed when every participating GP opened the medical record of diabetic patients aged > or =30 years. Only high-risk diabetic patients were included in the analysis. Patients were considered under antiplatelet treatment if they received two or more prescriptions at baseline and during the follow-up.

RESULTS

We selected 15,343 high-risk diabetic patients, 7,313 belonging to GPs of the control group and 8,030 belonging to GPs of the intervention group. Overall, 1,672 patients (22.9%) of the control group and 1,886 (23.5%) patients of the intervention group received antiplatelet drugs at baseline (P = N.S.). At the end of the follow-up, the number of treated patients was significantly increased in the intervention group (odds ratio 1.99, 95% CI 1.79-2.22) versus the control group. The effect of the electronic reminder was more relevant among those patients with one or more cardiovascular risk factors but without previous cardiovascular diseases (CVDs), compared with those with CVDs.

CONCLUSIONS

These findings provide evidence for the effect of an electronic reminder in affecting the prescriptive behavior of GPs.

Decision support software for dementia diagnosis and management in primary care: relevance and potential

Dementia, which affects a large and growing number of older people, presents particular challenges to primary care. There is an acknowledged need to develop interventions that address practitioners' needs for information and guidance regarding the diagnosis and management of dementia. This paper examines the potential usefulness and constraints of a Computer Decision Support System (CDSS) to assist practitioners in diagnosing and managing dementia. Questionnaire information was obtained from 97 primary care practitioners regarding their current practice and views on dementia care, priority given to training and familiarity with computer use. Implications of these findings for the relevance and value of CDSS are discussed. The paper is part of a larger ongoing study, the aim of which is the evaluation of three educational interventions for primary care practitioners.

Effect of computerised evidence based guidelines on management of asthma and angina in adults in primary care: cluster randomised controlled trial

OBJECTIVE

To evaluate the use of a computerised support system for decision making for implementing evidence based clinical guidelines for the management of asthma and angina in adults in primary care.

DESIGN

A before and after pragmatic cluster randomised controlled trial utilising a two by two incomplete block design.

SETTING

60 general practices in north east England.

PARTICIPANTS

General practitioners and practice nurses in the study practices and their patients aged 18 or over with angina or asthma.

MAIN OUTCOME MEASURES

Adherence to the guidelines, based on review of case notes and patient reported generic and condition specific outcome measures.

RESULTS

The computerised decision support system had no significant effect on consultation rates, process of care measures (including prescribing), or any patient reported outcomes for either condition. Levels of use of the software were low.

CONCLUSIONS

No effect was found of computerised evidence based guidelines on the management of asthma or angina in adults in primary care. This was probably due to low levels of use of the software, despite the system being optimised as far as was technically possible. Even if the technical problems of producing a system that fully supports the management of chronic disease were solved, there remains the challenge of integrating the systems into clinical encounters where busy practitioners manage patients with complex, multiple conditions.