Efficacy of a clinical decision-support system in an HIV practice: a randomized trial

Digital tracking, provider decision support systems, and targeted client communication via mobile devices to improve primary health care

BACKGROUND

Digital tracking on mobile devices, combined with clinical decision support systems and targeted client communication, can facilitate service delivery and potentially improve outcomes.

OBJECTIVES

To assess the effects of using a mobile device to track service use when combined with clinical decision support (Tracking + CDSS), with targeted client communications (Tracking + TCC), or both (Tracking + CDSS + TCC).

SEARCH METHODS

Cochrane CENTRAL, MEDLINE, Embase, Ovid Population Information Online (POPLINE), K4Health and WHO Global Health Library (2000 to November 2022).

SELECTION CRITERIA

Randomised and non-randomised trials in community/primary care settings.

PARTICIPANTS

primary care providers and clients Interventions: 1. Tracking + CDSS 2. Tracking + TCC 3. Tracking + CDSS + TCC Comparators: usual care (without digital tracking) DATA COLLECTION AND ANALYSIS: Two authors independently screened trials, extracted data and assessed risk of bias using the RoB 1 tool. We used a random-effects model to meta-analyse data producing risk differences (RD), risk ratios (RR), or odds ratios (OR) for dichotomous outcomes and mean differences (MD) for continuous outcomes. Evidence certainty was assessed using GRADE.

MAIN RESULTS

We identified 18 eligible studies (11 randomised, seven non-randomised) conducted in Bangladesh, China, Ethiopia, India, Kenya, Palestine, Uganda, and the USA. All non-randomised studies had a high risk of bias. These results are from randomised studies. 'Probably/may/uncertain' indicates 'moderate/low/very low' certainty evidence. Tracking + CDSS Relating to antenatal/ postnatal care: Providers' adherence to recommendations May slightly increase home visits in the week following delivery (2 studies, 4531 participants; RD 0.10 [0.07, 0.14]) May slightly increase counselling for initiating complementary feeding (2 studies, 4397 participants; RD 0.12 [0.08, 0.15]) May slightly increase the mean number of home visits in the month following delivery (1 study, 3023 participants; MD 0.75 [0.47, 1.03]) Uncertain effect on home visits within 24 hours of delivery Clients' health behaviours May slightly increase skin-to-skin care (1 study, 1544 participants; RD 0.05 [0.00, 0.10]) May slightly increase early breastfeeding (2 studies, 4540 participants; RD 0.08 [0.05, 0.12]) Uncertain effects on applying nothing to the umbilical cord, taking ≥ 90 iron-folate tablets during pregnancy, exclusively breastfeeding for six months, delaying the newborn's bath at least two days and Kangaroo Mother Care. Clients' health status May reduce low birthweight babies (1 study, 3023 participants; RR 0.53 [0.38, 0.73]) May increase infants with pneumonia or fever seeking care (1 study, 3470 participants; RR 1.13 [1.03, 1.24]) Uncertain effects on stillbirths, neonatal and infant deaths, or testing positive for HIV during antenatal testing Tracking + TCC Clients' health status In stroke patients over 12 months: May slightly increase blood pressure (BP) medication adherence (1 study, 1226 participants; RR 1.10 [1.00, 1.21]) May reduce deaths (1 study, 1226 participants; RR 0.52 [0.28, 0.96]) May slightly reduce systolic BP (1 study, 1226 participants; MD -2.80 mmHg [-4.90, -0.70]) May slightly improve EQ-5D scores (1 study, 1226 participants; MD 0.04 [0.02, 0.06]) May reduce stroke hospitalisations (1 study, 1226 participants; RR 0.45 [0.32, 0.64]). Tracking + CDSS + TCC Providers' adherence to recommendations Probably increases guideline adherence for antenatal screening and management of anaemia (1 study, 10,502 participants; OR 1.88 [1.52, 2.32]), diabetes (1 study, 8669 participants; OR 1.45 [1.14, 1.84}), hypertension (1 study, 15,555 participants; OR 1.62 [1.29, 2.04]) and probably leads to lower adherence for abnormal foetal growth (1 study, 1165 participants; OR 0.59 [0.37, 0.95]). May slightly increase nevirapine prophylaxis in infants of HIV+ve mothers (1 study, 609 participants; OR 1.75 [0.73, 4.19]) Data quality In pregnant women (1 study, 6367 participants), tracking + CDSS + TCC: Probably slightly reduces missing data for haemoglobin (RR 0.77 [0.71, 0.84]) but slightly more for BP at delivery (RR 1.16 [1.08, 1.24]) May have little or no effect on missing data on gestational age (RR 0.96 [0.81, 1.14]) or birthweight (RR 0.90 [0.77, 1.04]) Clients' health behaviour May have little or no effect on being on anti-retroviral therapy at delivery (1 study, 438 participants; OR 1.41 [0.81, 2.45]) or exclusive breastfeeding for six months (1 study, 695 participants; OR 1.74 [0.95, 3.17]) in HIV+ve mothers Uncertain effects on physical activity in high cardiovascular-risk adults Clients' health status May reduce the number of deaths in patients with hypertension and diabetes (1 study, 3698 participants; OR 0.61 [0.35, 1.06]) May reduce new cardiovascular events in high-cardiovascular risk adults over 6-18 months (1 study, 8642 participants; OR 0.58 [0.42, 0.80}) May slightly decrease in antenatal women severe hypertension, but the confidence interval includes both a decrease and increase (1 study, 6367 participants; OR 0.61 [0.27, 1.37]) In women receiving antenatal care (1 study, 6367 participants), tracking + CDSS + TCC maymake little or no difference to adverse pregnancy outcomes (OR 0.99 [0.87, 1.12]), moderate or severe anaemia (OR 0.82 [0.51, 1.31]), or large-for-gestational-age babies (OR 1.06 [0.90, 1.25]). In adults with hypertension or diabetes (1 study, 3324 participants), tracking + CDSS + TCC maymake little or no difference to HbA1c (MD 0.08 [-0.27, 0.43]), total cholesterol (MD -2.50 [-7.10, 2.10]), 10-year cardiovascular risk (MD -0.40 [-2.30, 1.50]), tobacco use (MD-0.05 [-0.47, 0.37]), alcohol use (MD 0.70 [-3.70, 5.10]), or PHQ-9 (MD -1.60 [-4.40, 1.20]). Uncertain effects on maternal or infant mortality before the baby reaches 18 months in HIV-positive mothers, patients who achieve optimal BP, BP controlled at five years, diastolic or systolic BP, body mass index, fasting glucose and quality of life in adults with hypertension or diabetes Client service utilisation May have little or no effect on missed early infant diagnosis visits (1 study, 1183 participants; OR 0.92 [0.63, 1.35]). Uncertain effects on linkage to care Client satisfaction Probably increases slightly the number of adults with hypertension or diabetes reporting "slightly/much better" change in the quality of care (1 study, 3324 participants; RR 1.02 [1.00, 1.03]). No studies evaluated time between presentation and appropriate management, timeliness of receiving/accessing care, provider acceptability/satisfaction, resource use, or unintended consequences.

AUTHORS' CONCLUSIONS

Digital tracking may improve primary care workers' ability to follow recommended antenatal and chronic disease practices, quality of patient records, patient health outcomes and service use. However, these interventions led to small or no outcome differences in most studies.

Prioritization of Evidence-Based and Evidence-Informed Interventions for Retention in Medical Care for Persons with HIV

Up to 50% of those diagnosed with HIV in the U.S. are not retained in medical care. Care retention provides opportunity to monitor benefits of HIV therapy and enable viral suppression. To increase retention, there is a need to prioritize best practices appropriate for translation and dissemination for real-world implementation. Eighteen interventions from CDC's Compendium of Evidence-Based Interventions were scored using the RE-AIM framework to determine those most suitable for dissemination. A CDC Division of HIV Prevention workgroup developed a RE-AIM scale with emphasis on the Implementation and Maintenance dimensions and less emphasis on the Efficacy dimension since all 18 interventions were already identified as evidence-based or evidence-informed. Raters referenced primary efficacy publications and scores were averaged for a ranked RE-AIM score for interventions. Of 18 interventions, four included care linkage and 7 included viral suppression outcomes. Interventions received between 20.6 and 35.3 points (45 maximum). Scores were converted into a percentage of the total possible with ranges between 45.8 and 78.4%. Top four interventions were ARTAS (78.4%); Routine Screening for HIV (RUSH) (73.2%); Optn4Life (67.4%) and Virology Fast Track (65.9%). All four scored high on Implementation and Maintenance dimensions. Select items within the scale were applicable to health equity, covering topics such as reaching under-served focus populations and acceptability to that population. Navigation-enhanced Case Management (NAV) scored highest on the health equity subscale. RE-AIM prioritization scores will inform dissemination and translation efforts, help clinical staff select feasible interventions for implementation, and support sustainability for those interventions.

HIV retention in care: results and lessons learned from the Positive Pathways Implementation Trial

BACKGROUND

Sustained, routine care is vital to the health of people with HIV (PWH) and decreasing transmission of HIV. We evaluated whether the identification of PWH at-risk of falling out of care and prompts for outreach were effective in retaining PWH in care in the United States.

METHODS

In this cluster randomized controlled trial, 20 AIDS Healthcare Foundation Healthcare Centers (HCCs) were randomized to the intervention (n = 10) or control (n = 10) arm; all maintained existing retention efforts. The intervention included daily automated flags in CHORUS™, a mobile app and web-based reporting solution utilizing electronic health record data, that identified PWH at-risk of falling out of care to clinic staff. Among flagged PWH, the association between the intervention and visits after a flag was assessed using logistic regression models fit with generalized estimating equations (independent correlation structure) to account for clustering. To adjust for differences between HCCs, models included geographic region, number of PWH at HCC, and proportions of PWH who self-identified as Hispanic or had the Ryan White Program as a payer.

RESULTS

Of 15,875 PWH in care, 56% were flagged; 76% (intervention) and 75% (control) resulted in a visit, of which 76% were within 2 months of the flag. In adjusted analyses, flags had higher odds of being followed by a visit (odds ratio [OR]: 1.08, 95% confidence interval [CI]: 0.97, 1.21) or a visit within 2 months (OR: 1.07, 95% CI: 0.97, 1.17) at intervention than control HCCs. Among at-risk PWH with viral loads at baseline and study end, the proportion with < 50 copies/mL increased in both study arms, but more so at intervention (65% to 74%) than control (62% to 67%) HCCs.

CONCLUSION

Despite challenges of the COVID-19 pandemic, adding an intervention to existing retention efforts, and the reality that behavior change takes time, PWH flagged as at-risk of falling out of care were marginally more likely to return for care at intervention than control HCCs and a greater proportion achieved undetectability. Sustained use of the retention module in CHORUS™ has the potential to streamline retention efforts, retain more PWH in care, and ultimately decrease transmission of HIV.

TRIAL REGISTRATION

The study was first registered at Clinical Trials.gov (NCT04147832, https://clinicaltrials.gov/show/NCT04147832 ) on 01/11/2019.

Conceptualizing clinical decision support as complex interventions: a meta-analysis of comparative effectiveness trials

OBJECTIVES

Complex interventions with multiple components and behavior change strategies are increasingly implemented as a form of clinical decision support (CDS) using native electronic health record functionality. Objectives of this study were, therefore, to (1) identify the proportion of randomized controlled trials with CDS interventions that were complex, (2) describe common gaps in the reporting of complexity in CDS research, and (3) determine the impact of increased complexity on CDS effectiveness.

MATERIALS AND METHODS

To assess CDS complexity and identify reporting gaps for characterizing CDS interventions, we used the Preferred Reporting Items for Systematic Reviews and Meta-Analyses reporting tool for complex interventions. We evaluated the effect of increased complexity using random-effects meta-analysis.

RESULTS

Most included studies evaluated a complex CDS intervention (76%). No studies described use of analytical frameworks or causal pathways. Two studies discussed use of theory but only one fully described the rationale and put it in context of a behavior change. A small but positive effect (standardized mean difference, 0.147; 95% CI, 0.039-0.255; P < .01) in favor of increasing intervention complexity was observed.

DISCUSSION

While most CDS studies should classify interventions as complex, opportunities persist for documenting and providing resources in a manner that would enable CDS interventions to be replicated and adapted. Unless reporting of the design, implementation, and evaluation of CDS interventions improves, only slight benefits can be expected.

CONCLUSION

Conceptualizing CDS as complex interventions may help convey the careful attention that is needed to ensure these interventions are contextually and theoretically informed.

Strategies to improve HIV care outcomes for people with HIV who are out of care

OBJECTIVE

The aim of this study was to evaluate the effectiveness of five intervention strategies: patient navigation, appointment help/alerts, psychosocial support, transportation/appointment accompaniment, and data-to-care on HIV care outcomes among persons with HIV (PWH) who are out of care (OOC).

DESIGN

A systematic review with meta-analysis.

METHODS

We searched CDC's Prevention Research Synthesis (PRS) Project's cumulative HIV database to identify intervention studies conducted in the U.S., published between 2000 and 2020 that included comparisons between groups or prepost, and reported at least one relevant outcome (i.e. re-engagement or retention in HIV care, and viral suppression). Effect sizes were meta-analyzed using random-effect models to assess intervention effectiveness.

RESULTS

Thirty-nine studies reporting on 42 unique interventions met the inclusion criteria. Overall, intervention strategies are effective in improving re-engagement in care [odds ratio (OR) = 1.79;95% confidence interval (95% CI): 1.36-2.36, k = 14], retention in care (OR = 2.01; 95% CI: 1.64-2.64, k = 22), and viral suppression (OR = 2.50;95% CI: 1.87-3.34, k = 27). Patient navigation, appointment help/alerts, psychosocial support, and transportation/appointment accompaniment improved all three HIV care outcomes. Data-to-care improved re-engagement and retention but had insufficient evidence for viral suppression.

CONCLUSION

Several strategies are effective for improving HIV care outcomes among PWH who are OOC. More work is still needed for consistent definitions of OOC and HIV care outcomes, better reporting of intervention and cost data, and identifying how best to implement and scale-up effective strategies to engage and retain OOC PWH in care and reach the ending the HIV epidemic goals.

Safety and Pharmacokinetic Profiles of Long-Acting Injectable Antiretroviral Drugs for HIV-1 Pre-Exposure Prophylaxis: A Systematic Review and Meta-analysis of Randomized Trials

Objectives: To investigate the safety and pharmacokinetic profiles of long-acting injectable pre-exposure prophylaxis (LAI PrEP), notably cabotegravir (CAB-LA) and rilpivirine (RPV-LA), for the prevention of human immunodeficiency virus-1 (HIV-1) infection.

Methods: Eligible randomized trials of LAI PrEP in HIV-uninfected and/or healthy patients were included and assessed with the Revised Cochrane risk-of-bias tool for randomized trials. Where feasible, a meta-analysis was performed for safety outcomes by using a random-effects model with risk ratios and their 95% confidence intervals as the common effect measure. The protocol was registered with PROSPERO CRD42020154772.

Results: Eight studies cumulating a total of 666 participants were included in this systematic review, including five (362 intervention-arm volunteers) and four trials (194 intervention-arm volunteers) that investigated CAB-LA and RPV-LA, respectively. We found that both CAB-LA and RPV-LA were generally well-tolerated as their safety profiles were similar to placebo in terms of any adverse event (AE), serious AE, and AE-related withdrawals. Furthermore, pharmacokinetic analyses revealed favorable prospects in viral inhibitory activity of CAB-LA and RPV-LA. Intramuscular (IM) injection of CAB-LA 600 mg Q8W was superior to CAB-LA 800 mg Q12W in male participants, while the same was true for RPV-LA 1200 mg IM Q8W over other dosing regimens. Although these results are promising, further research is required to confirm the findings on RPV-LA as current evidence is limited.

Conclusion: CAB-LA and RPV-LA have promising safety and pharmacokinetic profiles. The preventive efficacy of these agents is being evaluated in Phase 3 trials.

Economic impact on direct healthcare costs of missing opportunities for diagnosing HIV within healthcare settings

BACKGROUND

The economic consequences of a missed opportunity for HIV testing at an earlier stage of infection within a healthcare setting are poorly described.

METHODS

For all newly diagnosed HIV patients followed at the Southern Alberta HIV/AIDS Clinic (SAC), Calgary, Canada, between 1 April 2011 and 1 April 2016, all clinical encounters occurring < 3 years prior to diagnosis within the region were obtained. The direct costs of HIV care after diagnosis to 31 March 2019 were determined from a payers' perspective and reported as mean cost per patient per month (PPPM) in 2019 Canadian dollars (CDN$). Patients with no encounters for 3 years prior to diagnosis were compared with patients with encounters, with special attention to patients with HIV clinical indicator conditions (HCICs).

RESULTS

Of 388 patients, 60% had one or more prior encounter without HIV testing; 14% had been treated for an HCIC. Females, older patients and heterosexuals were more likely to have prior encounters. At diagnosis, patients with previous encounters presented with lower CD4 counts and higher rates of AIDS. The mean PPPM costs for patients with any prior encounter or for an HCIC-based encounter were 16% and 33% higher, respectively, than for patients with no prior encounters. While mean PPPM costs for antiretroviral drugs and outpatient visits were slightly higher, in-patient costs were 10 times higher for people with HIV who had a previous HCIC encounter vs. those with no encounters (CDN$316 vs. $31, respectively).

CONCLUSIONS

Any healthcare visit, especially for an HCIC, represents relatively easy opportunities for HIV testing. Not testing can result in poorer health and higher costs. Targeted clinical testing and novel interventions to correct overlooked testing opportunities within healthcare settings may be an easy way to implement cost savings.

Ending the HIV Epidemic Among Persons Who Inject Drugs: A Cost-Effectiveness Analysis in Six US Cities

BACKGROUND

Persons who inject drugs (PWID) are at a disproportionately high risk of HIV infection. We aimed to determine the highest-valued combination implementation strategies to reduce the burden of HIV among PWID in 6 US cities.

METHODS

Using a dynamic HIV transmission model calibrated for Atlanta, Baltimore, Los Angeles, Miami, New York City, and Seattle, we assessed the value of implementing combinations of evidence-based interventions at optimistic (drawn from best available evidence) or ideal (90% coverage) scale-up. We estimated reduction in HIV incidence among PWID, quality-adjusted life-years (QALYs), and incremental cost-effectiveness ratios (ICERs) for each city (10-year implementation; 20-year horizon; 2018 $ US).

RESULTS

Combinations that maximized health benefits contained between 6 (Atlanta and Seattle) and 12 (Miami) interventions with ICER values ranging from $94 069/QALY in Los Angeles to $146 256/QALY in Miami. These strategies reduced HIV incidence by 8.1% (credible interval [CI], 2.8%-13.2%) in Seattle and 54.4% (CI, 37.6%-73.9%) in Miami. Incidence reduction reached 16.1%-75.5% at ideal scale.

CONCLUSIONS

Evidence-based interventions targeted to PWID can deliver considerable value; however, ending the HIV epidemic among PWID will require innovative implementation strategies and supporting programs to reduce social and structural barriers to care.

An EMR-Based Alert with Brief Provider-Led ART Adherence Counseling: Promising Results of the InfoPlus Adherence Pilot Study Among Haitian Adults with HIV Initiating ART

To promote HIV antiretroviral therapy (ART) outcomes in Haiti, we developed a culturally relevant intervention (InfoPlus Adherence) that combines an electronic medical record alert identifying patients at elevated risk of treatment failure and provider-delivered brief problem-solving counseling. We conducted a quasi-experimental mixed-methods study among 146 patients at two large ART clinics in Haiti with 728 historical controls. We conducted quantitative assessments of patients at baseline and intervention completion (6 months) as well as focus groups with health workers and exit interviews with patients. The primary quantitative outcome measures were HIV viral suppression according to medical record and ART adherence in terms of ≥ 90% for "proportion of days covered" (PDC) according to pharmacy dispensing data. Results indicated that the proportion of intervention patients with suppressed VL during the study/historical periods was 80.0%/86.0% and 76.8%/87.4% for controls. In a difference-in-differences (DID) analytic model, the adjusted relative risk for viral suppression with the intervention was 1.15 (95% CI 0.92-1.45, p = 0.21), representing favorable but non-significant association between the intervention and the trajectory of VL outcomes. PDC ≥ 90% during the study/historical periods was 30.9%/11.0% among intervention participants and 16.9%/19.4% among controls. In the adjusted DID model, the relative risk for of PDC ≥ 90% with the intervention was 4.00 (95% CI 1.91-8.38, p < 0.001), representing a highly favorable association between the intervention and the trajectory of PDC outcomes. Qualitative data affirmed acceptability of the intervention, although providers reported some challenges consistently implementing it. Future research is needed to demonstrate efficacy and explore optimal implementation strategies.

Effects of Computerized Decision Support Systems on Practitioner Performance and Patient Outcomes: Systematic Review

Background

Computerized decision support systems (CDSSs) are software programs that support the decision making of practitioners and other staff. Other reviews have analyzed the relationship between CDSSs, practitioner performance, and patient outcomes. These reviews reported positive practitioner performance in over half the articles analyzed, but very little information was found for patient outcomes.

Objective

The purpose of this review was to analyze the relationship between CDSSs, practitioner performance, and patient medical outcomes. PubMed, CINAHL, Embase, Web of Science, and Cochrane databases were queried.

Methods

Articles were chosen based on year published (last 10 years), high quality, peer-reviewed sources, and discussion of the relationship between the use of CDSS as an intervention and links to practitioner performance or patient outcomes. Reviewers used an Excel spreadsheet (Microsoft Corporation) to collect information on the relationship between CDSSs and practitioner performance or patient outcomes. Reviewers also collected observations of participants, intervention, comparison with control group, outcomes, and study design (PICOS) along with those showing implicit bias. Articles were analyzed by multiple reviewers following the Kruse protocol for systematic reviews. Data were organized into multiple tables for analysis and reporting.

Results

Themes were identified for both practitioner performance (n=38) and medical outcomes (n=36). A total of 66% (25/38) of articles had occurrences of positive practitioner performance, 13% (5/38) found no difference in practitioner performance, and 21% (8/38) did not report or discuss practitioner performance. Zero articles reported negative practitioner performance. A total of 61% (22/36) of articles had occurrences of positive patient medical outcomes, 8% (3/36) found no statistically significant difference in medical outcomes between intervention and control groups, and 31% (11/36) did not report or discuss medical outcomes. Zero articles found negative patient medical outcomes attributed to using CDSSs.

Conclusions

Results of this review are commensurate with previous reviews with similar objectives, but unlike these reviews we found a high level of reporting of positive effects on patient medical outcomes.

[Improved patient safety through a clinical decision support system in laboratory medicine]

BACKGROUND

Laboratory diagnostics are essential for diagnosis, initiation of therapy, and monitoring of patients. Laboratory results that are overlooked or incorrectly interpreted lead to adverse events and endanger patient safety. Clinical decision support systems (CDSSs) may facilitate appropriate interpretation of results and subsequent medical response.

OBJECTIVES

The research project on digital laboratory medicine (AMPEL) aims at developing a CDSS based on laboratory diagnostics, which supports practitioners in ensuring the necessary medical consequences.

MATERIALS AND METHODS

A literature review of CDSSs describes the current state of research. The research project AMPEL is presented with its objectives, challenges, and first results. Furthermore, the development of a framework and reporting system is illustrated through the clinical example of severe hypokalemia.

RESULTS AND CONCLUSION

Through interdisciplinary development and constant optimization, a specific CDSS with high acceptance among clinicians was developed. Initial results in the case of severe hypokalemia show a positive effect on patient care. Thereby, more complex frameworks such as sepsis diagnostics or acute coronary syndrome are implemented. The limited availability of standardized and digital clinical data is challenging. In addition to the application of classic decision trees in CDSS, the use of machine learning offers a promising perspective for future developments.

Oncologists' Perceptions of a Digital Tool to Improve Cancer Survivors' Cardiovascular Health

Background

Cardiovascular (CV) disease continues to be a leading cause of morbidity and mortality with higher rates among cancer survivors than in the general population.

Objective

This study was aimed to understand oncology providers' attitudes toward a digital CV health tool, delivered via a tablet, to promote CV health in cancer survivors.

Methods

Using qualitative methods, 14 oncologists, from community and academic practice sites, were interviewed while they used the tool. Interviews were videotaped then analyzed using NVivo 11 software. Themes were inductively developed from the interviews.

Results

Three major themes emerged from the interviews as follows: (1) system functionality, (2) facilitators and barriers to integration, and (3) appropriate end-users. Oncologists recognized the critical role of CV health promotion among cancer survivors and identified features about the tool that would be helpful for CV health promotion. Workflow (subtheme) was a barrier to tool use. This feedback enabled tool redesign for further testing in the context of survivorship care.

Conclusion

Our findings emphasized the importance of identifying appropriate End-users which may include other survivorship care providers, patients, and primary care providers.

Implications

Our research addresses the knowledge gap in the use of digital tools in cancer survivorship care, specifically digital tools to promote CV health. Future research is needed to evaluate digital tools in cancer survivorship care. Research investigating patients as users of digital tools may provide additional insight.

Improving HIV Care Engagement in the South from the Patient and Provider Perspective: The Role of Stigma, Social Support, and Shared Decision-Making

Initial linkage to medical care is a critical step in the HIV care continuum leading to improved health outcomes, reduced morbidity and mortality, and decreased HIV transmission risk. We explored differences in perspectives on engagement in HIV care between people living with HIV who attended (Arrived) their initial medical provider visit (IMV) and those who did not (Missed), and between patients and providers. The study was conducted in two large majority/minority HIV treatment centers in the United States (US) south, a geographical region disproportionately impacted by HIV. The Theory of Planned Behavior informed semistructured interviews eliciting facilitators and barriers to engagement in care from 53 participants: 40 patients in a structured sample of 20 Missed and 20 Arrived, and 13 care providers. Using Grounded Theory to frame analysis, we found similar perspectives for all groups, including beliefs in the following: patients' control over care engagement, a lack of knowledge regarding HIV within the community, and the impact of structural barriers to HIV care such as paperwork, transportation, housing, and substance use treatment. Differences were noted by care engagement status. Missed described HIV-related discrimination, depression, and lack of social support. Arrived worried what others think about their HIV status. Providers focused on structural barriers and process, while patients focused on relational aspects of HIV care and personal connection with clinics. Participants proposed peer navigation and increased contact from clinics as interventions to reduce missed IMV. Context-appropriate interventions informed by these perspectives are needed to address the expanding southern HIV epidemic.

Successful implementation of an automated electronic support system for patient safety monitoring: The alemtuzumab in multiple sclerosis safety systems (AMS3) study

BACKGROUND

Alemtuzumab is a highly effective treatment for relapsing-remitting multiple sclerosis (MS) but requires ongoing pathology monitoring for autoimmune adverse effects. The Alemtuzumab in MS Safety Systems (AMS3) study evaluated the implementation of an automated pathology-monitoring system.

OBJECTIVES

To develop an efficient automated clinical decision support system (CDSS) to electronically prompt and track pathology collection and to provide prescribers and patients with customised alerts of abnormal results for identified risks.

METHODS

A total of 10 patients with relapsing-remitting MS treated with alemtuzumab were enrolled to test the system. Standard care laboratory monitoring was performed and compared to the performance of the CDSS.

RESULTS

The automated CDSS, an integrated patient smartphone application and an additional pre-screening tool were all successfully developed. Compliance with pathology monitoring was 96.7%. The automated analysis of pathology results was significantly faster than standard care neurologist review (p < 0.001). The system correctly identified and alerted abnormalities, including one case of immune thrombocytopenia (ITP) while the treating neurologist was on leave, enabling prompt treatment of serious adverse events. During the course of the study, the CDSS was deployed throughout Australia.

CONCLUSION

We successfully developed automated pathology monitoring with a CDSS, demonstrating real-world benefits of high compliance and timely alerting of important results.

Health Information Technology Continues to Show Positive Effect on Medical Outcomes: Systematic Review

Background

Health information technology (HIT) has been introduced into the health care industry since the 1960s when mainframes assisted with financial transactions, but questions remained about HIT’s contribution to medical outcomes. Several systematic reviews since the 1990s have focused on this relationship. This review updates the literature.

Objective

The purpose of this review was to analyze the current literature for the impact of HIT on medical outcomes. We hypothesized that there is a positive association between the adoption of HIT and medical outcomes.

Methods

We queried the Cumulative Index of Nursing and Allied Health Literature (CINAHL) and Medical Literature Analysis and Retrieval System Online (MEDLINE) by PubMed databases for peer-reviewed publications in the last 5 years that defined an HIT intervention and an effect on medical outcomes in terms of efficiency or effectiveness. We structured the review from the Primary Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA), and we conducted the review in accordance with the Assessment for Multiple Systematic Reviews (AMSTAR).

Results

We narrowed our search from 3636 papers to 37 for final analysis. At least one improved medical outcome as a result of HIT adoption was identified in 81% (25/37) of research studies that met inclusion criteria, thus strongly supporting our hypothesis. No statistical difference in outcomes was identified as a result of HIT in 19% of included studies. Twelve categories of HIT and three categories of outcomes occurred 38 and 65 times, respectively.

Conclusions

A strong majority of the literature shows positive effects of HIT on the effectiveness of medical outcomes, which positively supports efforts that prepare for stage 3 of meaningful use. This aligns with previous reviews in other time frames.

60 Minutes for health: examining the feasibility and acceptability of a low-resource behavioral intervention designed to promote retention in HIV care

Sustained retention in HIV medical care is a key health behavior for the long-term health of people living with HIV (PLWH). Approximately 60% of PLWH in the U.S. are poorly retained in HIV care, yet to date, the few available evidence-based retention-promoting interventions are resource and time intensive to implement. The current study describes the feasibility and acceptability of a theory-based retention-promoting intervention designed to meet the needs of a busy clinical care setting. 60 Minutes for Health reflects a low-resource single-session intervention, implemented by a health educator, to PLWH who have had a recent gap in care (≥6-months) in the past 18-months. Intervention content was informed by a situated application of the Information Motivation Behavioral Skills Model and delivered using a Motivational Interviewing-based format. The intervention uses a workbook to guide a series of activities that: (1) Identify and reduce misinformation guiding HIV care attendance. (2) Enhance motivation to maintain care via personal health goals. (3) Build skills for coping with emotional distress related to living with HIV. (4) Increase self-efficacy for navigating the logistics of maintaining care amidst competing priorities. A small feasibility pilot of this intervention protocol was conducted to assess its potential to improve retention in care and to obtain estimates for a larger-scale efficacy trial. Participants were randomized to the 60-minute intervention session (n = 8), or a theory-based time-and-attention control session focused on diet and nutrition (n = 8). Medical records were abstracted to evaluate changes in participants' retention in care status at 12- and 24-months post-intervention. Findings suggest the intervention is both feasible and acceptable to implement with poorly retained PLWH in a clinic setting. Post-intervention a larger proportion of intervention participants were retained in care (12-months: 87.5%, 24-months: 62.5%), compared control participants (12-months: 50.0%, 24-months: 25.0%). Future work should aim to evaluate a larger-scale efficacy trial.

A Rapid Review of eHealth Interventions Addressing the Continuum of HIV Care (2007-2017)

National HIV prevention goals call for interventions that address Continuum of HIV Care (CoC) for persons living with HIV. Electronic health (eHealth) can leverage technology to rapidly develop and disseminate such interventions. We conducted a qualitative review to synthesize (a) technology types, (b) CoC outcomes, (c) theoretical frameworks, and (d) behavior change mechanisms. This rapid review of eHealth, HIV-related articles (2007-2017) focused on technology-based interventions that reported CoC-related outcomes. Forty-five studies met inclusion criteria. Mobile texting was the most commonly reported technology (44.4%, k = 20). About 75% (k = 34) of studies showed proven or preliminary efficacy for improving CoC-related outcomes. Most studies (60%, k = 27) focused on medication adherence; 20% (k = 9) measured virologic suppression. Many eHealth interventions with preliminary or proven efficacy relied on mobile technology and integrated knowledge/cognition as behavior change mechanisms. This review identified gaps in development and application of eHealth interventions regarding CoC.

Structural Interventions in HIV Prevention: A Taxonomy and Descriptive Systematic Review

One of the four national HIV prevention goals is to incorporate combinations of effective, evidence-based approaches to prevent HIV infection. In fields of public health, techniques that alter environment and affect choice options are effective. Structural approaches may be effective in preventing HIV infection. Existing frameworks for structural interventions were lacking in breadth and/or depth. We conducted a systematic review and searched CDC's HIV/AIDS Prevention Research Synthesis Project's database for relevant interventions during 1988-2013. We used an iterative process to develop the taxonomy. We identified 213 structural interventions: Access (65%), Policy/Procedure (32%), Mass Media (29%), Physical Structure (27%), Capacity Building (24%), Community Mobilization (9%), and Social Determinants of Health (8%). Forty percent targeted high-risk populations (e.g., people who inject drugs [12%]). This paper describes a comprehensive, well-defined taxonomy of structural interventions with 7 categories and 20 subcategories. The taxonomy accommodated all interventions identified.

Personalization and Patient Involvement in Decision Support Systems: Current Trends

OBJECTIVES

This survey aims at highlighting the latest trends (2012-2014) on the development, use, and evaluation of Information and Communication Technologies (ICT) based decision support systems (DSSs) in medicine, with a particular focus on patient-centered and personalized care.

METHODS

We considered papers published on scientific journals, by querying PubMed and Web of ScienceTM. Included studies focused on the implementation or evaluation of ICT-based tools used in clinical practice. A separate search was performed on computerized physician order entry systems (CPOEs), since they are increasingly embedding patient-tailored decision support.

RESULTS

We found 73 papers on DSSs (53 on specific ICT tools) and 72 papers on CPOEs. Although decision support through the delivery of recommendations is frequent (28/53 papers), our review highlighted also DSSs only based on efficient information presentation (25/53). Patient participation in making decisions is still limited (9/53), and mostly focused on risk communication. The most represented medical area is cancer (12%). Policy makers are beginning to be included among stakeholders (6/73), but integration with hospital information systems is still low. Concerning knowledge representation/management issues, we identified a trend towards building inference engines on top of standard data models. Most of the tools (57%) underwent a formal assessment study, even if half of them aimed at evaluating usability and not effectiveness.

CONCLUSIONS

Overall, we have noticed interesting evolutions of medical DSSs to improve communication with the patient, consider the economic and organizational impact, and use standard models for knowledge representation. However, systems focusing on patient-centered care still do not seem to be available at large.

Challenges in the Evaluation of Interventions to Improve Engagement Along the HIV Care Continuum in the United States: A Systematic Review

In the United States (US), there are high levels of disengagement along the HIV care continuum. We sought to characterize the heterogeneity in research studies and interventions to improve care engagement among people living with diagnosed HIV infection. We performed a systematic literature search for interventions to improve HIV linkage to care, retention in care, reengagement in care and adherence to antiretroviral therapy (ART) in the US published from 2007-mid 2015. Study designs and outcomes were allowed to vary in included studies. We grouped interventions into categories, target populations, and whether results were significantly improved. We identified 152 studies, 7 (5%) linkage studies, 33 (22%) retention studies, 4 (3%) reengagement studies, and 117 (77%) adherence studies. 'Linkage' studies utilized 11 different outcome definitions, while 'retention' studies utilized 39, with very little consistency in effect measurements. The majority (59%) of studies reported significantly improved outcomes, but this proportion and corresponding effect sizes varied substantially across study categories. This review highlights a paucity of assessments of linkage and reengagement interventions; limited generalizability of results; and substantial heterogeneity in intervention types, outcome definitions, and effect measures. In order to make strides against the HIV epidemic in the US, care continuum research must be improved and benchmarked against an integrated, comprehensive framework.

Boosting Quality Registries with Clinical Decision Support Functionality*. User Acceptance of a Prototype Applied to HIV/TB Drug Therapy

BACKGROUND

The care of HIV-related tuberculosis (HIV/TB) is complex and challenging. Clinical decision support (CDS) systems can contribute to improve quality of care, but more knowledge is needed on factors determining user acceptance of CDS.

OBJECTIVES

To analyze physicians' and nurses' acceptance of a CDS prototype for evidence-based drug therapy recommendations for HIV/TB treatment.

METHODS

Physicians and nurses were involved in designing a CDS prototype intended for future integration with the Swedish national HIV quality registry. Focus group evaluation was performed with ten nurses and four physicians, respectively. The Unified Theory of Acceptance and Use of Technology (UTAUT) was used to analyze acceptance.

RESULTS

We identified several potential benefits with the CDS prototype as well as some concerns that could be addressed by redesign. There was also concern about dependence on physician attitudes, as well as technical, organizational, and legal issues.

CONCLUSIONS

Acceptance evaluation at a prototype stage provided rich data to improve the future design of a CDS prototype. Apart from design and development efforts, substantial organizational efforts are needed to enable the implementation and maintenance of a future CDS system.

The Effects of Computerized Clinical Decision Support Systems on Laboratory Test Ordering: A Systematic Review

CONTEXT

- Inappropriate laboratory test ordering has been shown to be as high as 30%. This can have an important impact on quality of care and costs because of downstream consequences such as additional diagnostics, repeat testing, imaging, prescriptions, surgeries, or hospital stays.

OBJECTIVE

- To evaluate the effect of computerized clinical decision support systems on appropriateness of laboratory test ordering.

DATA SOURCES

- We used MEDLINE, Embase, CINAHL, MEDLINE In-Process and Other Non-Indexed Citations, Clinicaltrials.gov, Cochrane Library, and Inspec through December 2015. Investigators independently screened articles to identify randomized trials that assessed a computerized clinical decision support system aimed at improving laboratory test ordering by providing patient-specific information, delivered in the form of an on-screen management option, reminder, or suggestion through a computerized physician order entry using a rule-based or algorithm-based system relying on an evidence-based knowledge resource. Investigators extracted data from 30 papers about study design, various study characteristics, study setting, various intervention characteristics, involvement of the software developers in the evaluation of the computerized clinical decision support system, outcome types, and various outcome characteristics.

CONCLUSIONS

- Because of heterogeneity of systems and settings, pooled estimates of effect could not be made. Data showed that computerized clinical decision support systems had little or no effect on clinical outcomes but some effect on compliance. Computerized clinical decision support systems targeted at laboratory test ordering for multiple conditions appear to be more effective than those targeted at a single condition.

Identifying Best Practices for Increasing Linkage to, Retention, and Re-engagement in HIV Medical Care: Findings from a Systematic Review, 1996-2014

A systematic review was conducted to identify best practices for increasing linkage, retention and re-engagement in HIV care (LRC) for persons living with HIV (PLWH). Our search strategy consisted of automated searches of electronic databases and hand searches of journals, reference lists and listservs. We developed two sets of criteria: evidence-based to identify evidence-based interventions (EBIs) tested with a comparison group and evidence-informed to identify evidence-informed interventions (EIs) tested with a one-group design. Eligible interventions included being published between 1996 and 2014, U.S.-based studies with a comparison or one-group designs with pre-post data, international randomized controlled trials, and having objective measures of LRC-relevant outcomes. We identified 10 best practices: 5 EBIs and 5 EIs. None focused on re-engagement. Providers and prevention planners can use the review findings to identify best practices suitable for their clinics, agencies, or communities to increase engagement in care for PLWH, ultimately leading to viral suppression.

Re-engagement in HIV Care: A Clinical and Public Health Priority

As many as 40-50% of persons living with HIV (PLWH) who once were in HIV care are no longer in care. It is estimated that these individuals account for over 60% of HIV transmissions. So, preventing the leaving of care and re-engaging PLWH with care are crucial if the HIV epidemic is to be brought under control. Clinicians can improve retention by keeping in close contact with patients. Governmental public health agencies have great expertise in finding and engaging in care persons with sexually transmitted infections. This expertise can be used to re-engage PLWH with HIV care, but it can only be utilized if the agencies know that someone is out of care. Data on who has left care are in the hands of HIV providers. This requires a close working relationship between HIV providers and public health agencies.

Bacterial sexually transmitted infections among HIV-infected patients in the United States: estimates from the Medical Monitoring Project

BACKGROUND

Bacterial sexually transmitted infections may facilitate HIV transmission. Bacterial sexually transmitted infection testing is recommended for sexually active HIV-infected patients annually and more frequently for those at elevated sexual risk. We estimated percentages of HIV-infected patients in the United States receiving at least one syphilis, gonorrhea, or chlamydia test, and repeat (≥2 tests, ≥3 months apart) tests for any of these sexually transmitted infections from mid-2008 through mid-2010.

DESIGN

The Medical Monitoring Project collects behavioral and clinical characteristics of HIV-infected adults receiving medical care in the United States using nationally representative sampling.

METHODS

Sexual activity included self-reported oral, vaginal, or anal sex in the past 12 months. Participants reporting more than 1 sexual partner or illicit drug use before/during sex in the past year were classified as having elevated sexual risk. Among participants with only 1 sex partner and no drug use before/during sex, those reporting consistent condom use were classified as low risk; those reporting sex without a condom (or for whom this was unknown) were classified as at elevated sexual risk only if they considered their sex partner to be a casual partner, or if their partner was HIV-negative or partner HIV status was unknown. Bacterial sexually transmitted infection testing was ascertained through medical record abstraction.

RESULTS

Among sexually active patients, 55% were tested at least once in 12 months for syphilis, whereas 23% and 24% received at least one gonorrhea and chlamydia test, respectively. Syphilis testing did not vary by sex/sexual orientation. Receipt of at least 3 CD4+ T-lymphocyte cell counts and/or HIV viral load tests in 12 months was associated with syphilis testing in men who have sex with men (MSM), men who have sex with women only, and women. Chlamydia testing was significantly higher in sexually active women (30%) compared with men who have sex with women only (19%), but not compared with MSM (22%). Forty-six percent of MSM were at elevated sexual risk; 26% of these MSM received repeat syphilis testing, whereas repeat testing for gonorrhea and chlamydia was only 7% for each infection.

CONCLUSIONS

Bacterial sexually transmitted infection testing among sexually active HIV-infected patients was low, particularly for those at elevated sexual risk. Patient encounters in which CD4+ T-lymphocyte cell counts and/or HIV viral load testing occurs present opportunities for increased bacterial sexually transmitted infection testing.

EHR-based Visualization Tool: Adoption Rates, Satisfaction, and Patient Outcomes

BACKGROUND

Electronic health records (EHRs) have the potential to enhance patient-provider communication and improve patient outcomes. However, in order to impact patient care, clinical decision support (CDS) and communication tools targeting such needs must be integrated into clinical workflow and be flexible with regard to the changing health care landscape.

DESIGN

The Stroke Prevention in Healthcare Delivery Environments (SPHERE) team developed and implemented the SPHERE tool, an EHR-based CDS visualization, to enhance patient-provider communication around cardiovascular health (CVH) within an outpatient primary care setting of a large academic medical center.

IMPLEMENTATION

We describe our successful CDS alert implementation strategy and report adoption rates. We also present results of a provider satisfaction survey showing that the SPHERE tool delivers appropriate content in a timely manner. Patient outcomes following implementation of the tool indicate one-year improvements in some CVH metrics, such as body mass index and diabetes.

DISCUSSION

Clinical decision-making and practices change rapidly and in parallel to simultaneous changes in the health care landscape and EHR usage. Based on these observations and our preliminary results, we have found that an integrated, extensible, and workflow-aware CDS tool is critical to enhancing patient-provider communications and influencing patient outcomes.

Effectiveness of computerized decision support systems linked to electronic health records: a systematic review and meta-analysis

We systematically reviewed randomized controlled trials (RCTs) assessing the effectiveness of computerized decision support systems (CDSSs) featuring rule- or algorithm-based software integrated with electronic health records (EHRs) and evidence-based knowledge. We searched MEDLINE, EMBASE, Cochrane Central Register of Controlled Trials, and Cochrane Database of Abstracts of Reviews of Effects. Information on system design, capabilities, acquisition, implementation context, and effects on mortality, morbidity, and economic outcomes were extracted. Twenty-eight RCTs were included. CDSS use did not affect mortality (16 trials, 37395 patients; 2282 deaths; risk ratio [RR] = 0.96; 95% confidence interval [CI] = 0.85, 1.08; I(2) = 41%). A statistically significant effect was evident in the prevention of morbidity, any disease (9 RCTs; 13868 patients; RR = 0.82; 95% CI = 0.68, 0.99; I(2) = 64%), but selective outcome reporting or publication bias cannot be excluded. We observed differences for costs and health service utilization, although these were often small in magnitude. Across clinical settings, new generation CDSSs integrated with EHRs do not affect mortality and might moderately improve morbidity outcomes.

Development of an electronic medical record based alert for risk of HIV treatment failure in a low-resource setting

Background

The adoption of electronic medical record systems in resource-limited settings can help clinicians monitor patients' adherence to HIV antiretroviral therapy (ART) and identify patients at risk of future ART failure, allowing resources to be targeted to those most at risk.

Methods

Among adult patients enrolled on ART from 2005–2013 at two large, public-sector hospitals in Haiti, ART failure was assessed after 6–12 months on treatment, based on the World Health Organization's immunologic and clinical criteria. We identified models for predicting ART failure based on ART adherence measures and other patient characteristics. We assessed performance of candidate models using area under the receiver operating curve, and validated results using a randomly-split data sample. The selected prediction model was used to generate a risk score, and its ability to differentiate ART failure risk over a 42-month follow-up period was tested using stratified Kaplan Meier survival curves.

Results

Among 923 patients with CD4 results available during the period 6–12 months after ART initiation, 196 (21.2%) met ART failure criteria. The pharmacy-based proportion of days covered (PDC) measure performed best among five possible ART adherence measures at predicting ART failure. Average PDC during the first 6 months on ART was 79.0% among cases of ART failure and 88.6% among cases of non-failure (p<0.01). When additional information including sex, baseline CD4, and duration of enrollment in HIV care prior to ART initiation were added to PDC, the risk score differentiated between those who did and did not meet failure criteria over 42 months following ART initiation.

Conclusions

Pharmacy data are most useful for new ART adherence alerts within iSanté. Such alerts offer potential to help clinicians identify patients at high risk of ART failure so that they can be targeted with adherence support interventions, before ART failure occurs.

The next therapeutic challenge in HIV: polypharmacy

With the adoption of combination antiretroviral therapy (ART), most HIV-infected individuals in care are on five or more medications and at risk of harm from polypharmacy, a risk that likely increases with number of medications, age, and physiologic frailty. Established harms of polypharmacy include decreased medication adherence and increased serious adverse drug events, including organ system injury, hospitalization, geriatric syndromes (falls, fractures, and cognitive decline) and mortality. The literature on polypharmacy among those with HIV infection is limited, and the literature on polypharmacy among non-HIV patients requires adaptation to the special issues facing those on chronic ART. First, those aging with HIV infection often initiate ART in their 3rd or 4th decade of life and are expected to remain on ART for the rest of their lives. Second, those with HIV may be at higher risk for age-associated comorbid disease, further increasing their risk of polypharmacy. Third, those with HIV may have an enhanced susceptibility to harm from polypharmacy due to decreased organ system reserve, chronic inflammation, and ongoing immune dysfunction. Finally, because ART is life-extending, nonadherence to ART is particularly concerning. After reviewing the relevant literature, we propose an adapted framework with which to address polypharmacy among those on lifelong ART and suggest areas for future work.

The effects of on-screen, point of care computer reminders on processes and outcomes of care

BACKGROUND

The opportunity to improve care by delivering decision support to clinicians at the point of care represents one of the main incentives for implementing sophisticated clinical information systems. Previous reviews of computer reminder and decision support systems have reported mixed effects, possibly because they did not distinguish point of care computer reminders from e-mail alerts, computer-generated paper reminders, and other modes of delivering 'computer reminders'.

OBJECTIVES

To evaluate the effects on processes and outcomes of care attributable to on-screen computer reminders delivered to clinicians at the point of care.

SEARCH STRATEGY

We searched the Cochrane EPOC Group Trials register, MEDLINE, EMBASE and CINAHL and CENTRAL to July 2008, and scanned bibliographies from key articles.

SELECTION CRITERIA

Studies of a reminder delivered via a computer system routinely used by clinicians, with a randomised or quasi-randomised design and reporting at least one outcome involving a clinical endpoint or adherence to a recommended process of care.

DATA COLLECTION AND ANALYSIS

Two authors independently screened studies for eligibility and abstracted data. For each study, we calculated the median improvement in adherence to target processes of care and also identified the outcome with the largest such improvement. We then calculated the median absolute improvement in process adherence across all studies using both the median outcome from each study and the best outcome.

MAIN RESULTS

Twenty-eight studies (reporting a total of thirty-two comparisons) were included. Computer reminders achieved a median improvement in process adherence of 4.2% (interquartile range (IQR): 0.8% to 18.8%) across all reported process outcomes, 3.3% (IQR: 0.5% to 10.6%) for medication ordering, 3.8% (IQR: 0.5% to 6.6%) for vaccinations, and 3.8% (IQR: 0.4% to 16.3%) for test ordering. In a sensitivity analysis using the best outcome from each study, the median improvement was 5.6% (IQR: 2.0% to 19.2%) across all process measures and 6.2% (IQR: 3.0% to 28.0%) across measures of medication ordering. In the eight comparisons that reported dichotomous clinical endpoints, intervention patients experienced a median absolute improvement of 2.5% (IQR: 1.3% to 4.2%). Blood pressure was the most commonly reported clinical endpoint, with intervention patients experiencing a median reduction in their systolic blood pressure of 1.0 mmHg (IQR: 2.3 mmHg reduction to 2.0 mmHg increase).

AUTHORS' CONCLUSIONS

Point of care computer reminders generally achieve small to modest improvements in provider behaviour. A minority of interventions showed larger effects, but no specific reminder or contextual features were significantly associated with effect magnitude. Further research must identify design features and contextual factors consistently associated with larger improvements in provider behaviour if computer reminders are to succeed on more than a trial and error basis.