Telehealth-guided provider-to-provider communication to improve rural health: A systematic review

INTRODUCTION

Telehealth may address healthcare disparities for rural populations. This systematic review assesses the use, effectiveness, and implementation of telehealth-supported provider-to-provider collaboration to improve rural healthcare.

METHODS

We searched Ovid MEDLINE®, CINAHL®, EMBASE, and Cochrane CENTRAL from 1 January 2010 to 12 October 2021 for trials and observational studies of rural provider-to-provider telehealth. Abstracts and full text were dual-reviewed. We assessed the risk of bias for individual studies and strength of evidence for studies with similar outcomes.

RESULTS

Seven studies of rural uptake of provider-to-provider telehealth documented increases over time but variability across geographic regions. In 97 effectiveness studies, outcomes were similar with rural provider-to-provider telehealth versus without for inpatient consultations, neonatal care, outpatient depression and diabetes, and emergency care. Better or similar results were reported for changes in rural clinician behavior, knowledge, confidence, and self-efficacy. Evidence was insufficient for other clinical uses and outcomes. Sixty-seven (67) evaluation and qualitative studies identified barriers and facilitators to implementing rural provider-to-provider telehealth. Success was linked to well-functioning technology, sufficient resources, and adequate payment. Barriers included lack of understanding of rural context and resources. Methodologic weaknesses of studies included less rigorous study designs and small samples.

DISCUSSION

Rural provider-to-provider telehealth produces similar or better results versus care without telehealth. Barriers to rural provider-to-provider telehealth implementation are common to practice change but include some specific to rural adaptation and adoption. Evidence gaps are partially due to studies that do not address differences in the groups compared or do not include sufficient sample sizes.

Telehealth Strategies for the Delivery of Maternal Health Care : A Rapid Review

BACKGROUND

Telehealth strategies to supplement or replace in-person maternity care may affect maternal health outcomes.

PURPOSE

To conduct a rapid review of the effectiveness and harms of telehealth strategies for maternal health care given the recent expansion of telehealth arising from the COVID-19 pandemic, and to produce an evidence map.

DATA SOURCES

Systematic searches of MEDLINE, the Cochrane Library, CINAHL, Embase, and Scopus for English-language studies (January 2015 to April 2022).

STUDY SELECTION

Randomized controlled trials (RCTs) and observational studies of maternal care telehealth strategies versus usual care.

DATA EXTRACTION

Dual data extraction and risk-of-bias assessment of studies, with disagreements resolved through consensus.

DATA SYNTHESIS

28 RCTs and 14 observational studies (n = 44 894) were included. Maternal telehealth interventions supplemented in-person care for most studies of mental health and diabetes during pregnancy, primarily resulting in similar, and sometimes better, clinical and patient-reported outcomes versus usual care. Supplementing in-person mental health care with phone- or web-based platforms or mobile applications resulted in similar or better mental health outcomes versus in-person care. A reduced-visit prenatal care schedule using telehealth to replace in-person general maternity care for low-risk pregnancies resulted in similar clinical outcomes and higher patient satisfaction versus usual care. Overall, telehealth strategies were heterogeneous and resulted in similar obstetric and patient satisfaction outcomes. Few studies addressed disparities, health equity, or harms.

LIMITATIONS

Interventions varied, and evidence was inadequate for some clinical outcomes.

CONCLUSION

Replacing or supplementing in-person maternal care with telehealth generally results in similar, and sometimes better, clinical outcomes and patient satisfaction compared with in-person care. The effect on access to care, health equity, and harms is unclear.

PRIMARY FUNDING SOURCE

Patient-Centered Outcomes Research Institute. (PROSPERO: CRD42021276347).

Cannabis-Based Products for Chronic Pain : A Systematic Review

BACKGROUND

Contemporary data are needed about the utility of cannabinoids in chronic pain.

PURPOSE

To evaluate the benefits and harms of cannabinoids for chronic pain.

DATA SOURCES

Ovid MEDLINE, PsycINFO, EMBASE, the Cochrane Library, and Scopus to January 2022.

STUDY SELECTION

English-language, randomized, placebo-controlled trials and cohort studies (≥1 month duration) of cannabinoids for chronic pain.

DATA EXTRACTION

Data abstraction, risk of bias, and strength of evidence assessments were dually reviewed. Cannabinoids were categorized by THC-to-CBD ratio (high, comparable, or low) and source (synthetic, extract or purified, or whole plant).

DATA SYNTHESIS

Eighteen randomized, placebo-controlled trials (n = 1740) and 7 cohort studies (n = 13 095) assessed cannabinoids. Studies were primarily short term (1 to 6 months); 56% enrolled patients with neuropathic pain, with 3% to 89% female patients. Synthetic products with high THC-to-CBD ratios (>98% THC) may be associated with moderate improvement in pain severity and response (≥30% improvement) and an increased risk for sedation and are probably associated with a large increased risk for dizziness. Extracted products with high THC-to-CBD ratios (range, 3:1 to 47:1) may be associated with large increased risk for study withdrawal due to adverse events and dizziness. Sublingual spray with comparable THC-to-CBD ratio (1.1:1) probably is associated with small improvement in pain severity and overall function and may be associated with large increased risk for dizziness and sedation and moderate increased risk for nausea. Evidence for other products and outcomes, including longer-term harms, were not reported or were insufficient.

LIMITATION

Variation in interventions; lack of study details, including unclear availability in the United States; and inadequate evidence for some products.

CONCLUSION

Oral, synthetic cannabis products with high THC-to-CBD ratios and sublingual, extracted cannabis products with comparable THC-to-CBD ratios may be associated with short-term improvements in chronic pain and increased risk for dizziness and sedation. Studies are needed on long-term outcomes and further evaluation of product formulation effects.

PRIMARY FUNDING SOURCE

Agency for Healthcare Research and Quality, U.S. Department of Health and Human Services. (PROSPERO: CRD42021229579).

Psychosocial Interventions for Adults With Schizophrenia: An Overview and Update of Systematic Reviews

OBJECTIVE

The authors of this systematic review (SR) sought to provide evidence for effects of commonly used psychosocial interventions on several outcomes among adults with schizophrenia.

METHODS

MEDLINE, the Cochrane Library, and PsycINFO databases were searched through July 2020. Eligible studies were SRs and trials of at least 12 weeks duration and with ≥50 participants that compared psychosocial interventions with treatment as usual among adults with schizophrenia. Study design, year, setting, country, sample size, eligibility criteria, population, clinical and intervention characteristics, results, and funding source were extracted, along with quality criteria. The evidence was evaluated on quality and strength of evidence stratified by intervention area and outcome, according to the Evidence-Based Practice Centers Methods Guide of the Agency for Healthcare Research and Quality.

RESULTS

Nine SRs and 30 trials (N=23,921 patients) in 11 intervention areas were included. Trials were mostly of fair quality and had low-to-moderate strength of evidence. Compared with treatment as usual, most psychosocial interventions were more effective in improving intervention-targeted outcomes, including core illness symptoms. Compared with treatment as usual, assertive community treatment, cognitive-behavioral therapy (CBT), family interventions, psychoeducation, social skills training, supported employment, and early interventions for first-episode psychosis (FEP) improved various functional outcomes. CBT and early interventions for FEP improved quality of life. Family interventions, psychoeducation, illness self-management, and early interventions for FEP reduced relapse.

CONCLUSIONS

Compared with treatment as usual, most psychosocial interventions improved functional outcomes, quality of life, and core illness symptoms, and several reduced relapse frequency among adults with schizophrenia.

Testing a filtering strategy for systematic reviews: evaluating work savings and recall

Systematic reviews are extremely time-consuming. The goal of this work is to assess work savings and recall for a publication type filtering strategy that uses the output of two machine learning models, Multi-Tagger and web RCT Tagger, applied retrospectively to 10 systematic reviews on drug effectiveness. Our filtering strategy resulted in mean work savings of 33.6% and recall of 98.3%. Of 363 articles finally included in any of the systematic reviews, 7 were filtered out by our strategy, but 1 "error" was actually an article using a publication type that the SR team had not pre-specified as relevant for inclusion. Our analysis suggests that automated publication type filtering can potentially provide substantial work savings with minimal loss of included articles. Publication type filtering should be personalized for each systematic review and might be combined with other filtering or ranking methods to provide additional work savings for manual triage.

Outpatient Treatment of Low-risk Pulmonary Embolism in the Era of Direct Oral Anticoagulants: A Systematic Review

BACKGROUND

Clinical guidelines have supported outpatient treatment of low-risk pulmonary embolism (PE) since 2014, but adoption of this practice has been slow. Direct oral anticoagulant (DOAC) therapy for venous thromboembolism (VTE) is now as common as vitamin K antagonist treatment, but data are sparse regarding outcomes for patients with low-risk PE treated with DOACs as outpatients. We conducted a systematic review of literature on outcomes of outpatient management for PE, including comparisons to inpatient treatment and differences by anticoagulant class.

METHODS

We searched Medline, Embase, PubMed, CENTRAL, clinicaltrials.gov, and ICTRN for studies published from January 1980 through February 2019 using a predefined strategy developed with a medical librarian. We included English-language randomized controlled trials (RCTs) and prospective nonrandomized trials (NRTs) of adult patients diagnosed with acute, symptomatic PE, and discharged from the emergency department or within 48 hours. Our primary outcome included four major adverse outcomes (all-cause mortality, PE-related mortality, recurrent VTE, and major bleeding) within 30 and 90 days. A preplanned subanalysis of high-quality studies assessed outcomes associated with different anticoagulation treatment classes.

RESULTS

Our initial search identified 6,818 records, of which 12 studies (four RCT, eight NRT) with a total of 3,191 patients were included in the review. All RCTs and six NRTs were determined to have low to moderate risk of bias and were classified as high quality. Outpatients in these studies (n = 1,814) had rates of 90-day major adverse outcomes below 1%, including all-cause mortality (0.7%, 95% confidence interval [CI] = 0.4% to 1.2%), PE-related mortality (0.06%, 95% CI = 0.01% to 0.3%), recurrent VTE (0.8%, 95% CI = 0.5% to 1.4%), and major bleeding (0.8%, 95% CI = 0.5% to 1.4%). Exploratory analysis revealed no association between anticoagulant treatment class and rates of major adverse outcomes.

CONCLUSION

Among patients with low-risk PE treated as outpatients, few patients experienced major adverse outcomes such as mortality, recurrent VTE, or major bleeding within 90 days.

Updating the Comparative Evidence on Second‐Generation Antipsychotic Use With Schizophrenia

Objective

The objective of this study was to conduct a systematic review of literature comparing second‐generation antipsychotics (SGAs) with each other and with first‐generation antipsychotics (FGAs) in treating schizophrenia.

Methods

MEDLINE, the Cochrane Library, and PsycINFO databases were searched through January 2020. Following standard methods, recent high‐quality systematic reviews of each drug comparison and subsequently published primary studies were included to update the meta‐analyses with any new data. Two reviewers independently conducted study selection, abstraction, and quality assessment.

Results

Two systematic reviews and 29 newer trials (total of 162 trials of SGAs, N=53,861; 116 trials of SGAs versus FGAs, N=119,558) were included. Most trials were of fair quality, industry‐funded, and included older SGAs and a few recently approved SGAs (asenapine, lurasidone, iloperidone, cariprazine, brexpiprazole and long‐acting injection [LAI] formulations of aripiprazole and paliperidone). Older SGAs had similar effects on function, quality of life, mortality, and adverse event incidence, although clozapine improved symptoms more than most other drugs and olanzapine and risperidone were superior to some other drugs. Olanzapine, risperidone, ziprasidone, and aripiprazole performed similarly on outcomes of benefit compared with haloperidol. Risperidone LAI and olanzapine resulted in fewer withdrawals due to adverse events, but risk of diabetes increased with olanzapine. Haloperidol had greater incidence of adverse events than did olanzapine and risperidone, but similar effects on other outcomes.

Conclusions

Most comparative evidence favored older SGAs, with clozapine, olanzapine, and risperidone superior on more outcomes than other SGAs. Older SGAs had similar benefits as haloperidol but with fewer adverse events.

Use of the second‐generation antipsychotics olanzapine, aripiprazole, risperidone, quetiapine, and ziprasidone resulted in similar function, quality of life, mortality, and overall incidence of adverse events.

Core illness symptoms improved more with olanzapine and risperidone than asenapine, quetiapine, or ziprasidone, and more with paliperidone than lurasidone or iloperidone.

Haloperidol showed similar benefits but more adverse events than did olanzapine or risperidone.

Masks for Prevention of Respiratory Virus Infections, Including SARS-CoV-2, in Health Care and Community Settings : A Living Rapid Review

BACKGROUND

Recommendations on masks for preventing coronavirus disease 2019 (COVID-19) vary.

PURPOSE

To examine the effectiveness of N95, surgical, and cloth masks in community and health care settings for preventing respiratory virus infections, and effects of reuse or extended use of N95 masks.

DATA SOURCES

Multiple electronic databases, including the World Health Organization COVID-19 database and medRxiv preprint server (2003 through 14 April 2020; surveillance through 2 June 2020), and reference lists.

STUDY SELECTION

Randomized trials of masks and risk for respiratory virus infection, including severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), and observational studies of mask use and coronavirus infection risk were included. New evidence will be incorporated by using living review methods.

DATA EXTRACTION

One reviewer abstracted data and assessed methodological limitations; a second reviewer provided verification.

DATA SYNTHESIS

39 studies (18 randomized controlled trials and 21 observational studies; 33 867 participants) were included. No study evaluated reuse or extended use of N95 masks. Evidence on SARS-CoV-2 was limited to 2 observational studies with serious limitations. Community mask use was possibly associated with decreased risk for SARS-CoV-1 infection in observational studies. In high- or moderate-risk health care settings, observational studies found that risk for infection with SARS-CoV-1 and Middle East respiratory syndrome coronavirus probably decreased with mask use versus nonuse and possibly decreased with N95 versus surgical mask use. Randomized trials in community settings found possibly no difference between N95 versus surgical masks and probably no difference between surgical versus no mask in risk for influenza or influenza-like illness, but compliance was low. In health care settings, N95 and surgical masks were probably associated with similar risks for influenza-like illness and laboratory-confirmed viral infection; clinical respiratory illness had inconsistency. Bothersome symptoms were common.

LIMITATIONS

There were few SARS-CoV-2 studies, observational studies have methodological limitations, and the review was done by using streamlined methods.

CONCLUSION

Evidence on mask effectiveness for respiratory infection prevention is stronger in health care than community settings. N95 respirators might reduce SARS-CoV-1 risk versus surgical masks in health care settings, but applicability to SARS-CoV-2 is uncertain.

PRIMARY FUNDING SOURCE

Agency for Healthcare Research and Quality.

Development of the PTSD-Repository: A Publicly Available Repository of Randomized Controlled Trials for Posttraumatic Stress Disorder

Given the extensive research on posttraumatic stress disorder (PTSD) treatment, a single, updatable repository of data from PTSD treatment studies would be useful for clinical, research, and policy stakeholders. To meet this need, we established a preliminary dataset of abstracted PTSD trial data, which serve as the basis for the PTSD Trials Standardized Data Repository (PTSD-Repository), maintained by the National Center for PTSD (NCPTSD). We followed systematic review methods to identify published randomized controlled trials (RCTs) of PTSD interventions. We consulted with a panel of experts to determine a priori inclusion criteria, ensure that we captured all relevant studies, and identify variables for abstraction. We searched multiple databases for materials published from 1980 to 2018 and reviewed reference lists of relevant systematic reviews and clinical practice guidelines. In total, 318 RCTs of PTSD interventions that enrolled almost 25,000 participants were included. We abstracted 337 variables across all studies, including study, participant, and intervention characteristics as well as results. In the present paper, we describe our methods and define data elements included in the data tables. We explain coding challenges, identify inconsistencies in reporting across study types, and discuss ways stakeholders can use PTSD-Repository data to enhance research, education, and policy. The abstracted data are currently publicly available on the NCPTSD website and can be used for future systematic reviews and identifying research gaps and as an information resource for clinicians, patients, and family members.

Depression in Children and Adolescents: Evaluation and Treatment

The prevalence of major unipolar depression in children and adolescents is increasing in the United States. In 2016, approximately 5% of 12-year-olds and 17% of 17-year-olds reported experiencing a major depressive episode in the previous 12 months. Screening for depression in adolescents 12 years and older should be conducted annually using a validated instrument, such as the Patient Health Questionnaire-9: Modified for Teens. If the diagnosis is confirmed, treatment should be initiated for persistent, moderate, and severe depression. Active support and monitoring may be sufficient for mild, self-limited depression. For more severe depression, evidence indicates greater response to treatment when psychotherapy (e.g., cognitive behavior therapy) and an antidepressant are used concurrently, compared with either treatment alone. Fluoxetine and escitalopram are the only antidepressants approved by the U.S. Food and Drug Administration for treatment of depression in children and adolescents. Fluoxetine may be used in patients older than eight years, and escitalopram may be used in patients 12 years and older. Monitoring for suicidality is necessary in children and adolescents receiving pharmacotherapy, with frequency of monitoring based on each patient's individual risk. The decision to modify treatment (add, increase, change the medication or add psychotherapy) should be made after about four to eight weeks. Consultation with or referral to a mental health subspecialist is warranted if symptoms worsen or do not improve despite treatment and for those who become a risk to themselves or others.

Screening for Elevated Blood Lead Levels in Childhood and Pregnancy: Updated Evidence Report and Systematic Review for the US Preventive Services Task Force

IMPORTANCE

Elevated blood lead level is associated with serious, often irreversible, health consequences.

OBJECTIVE

To synthesize evidence on the effects of screening, testing, and treatment for elevated blood lead level in pregnant women and children aged 5 years and younger in the primary care setting to inform the US Preventive Services Task Force.

DATA SOURCES

Cochrane CENTRAL and Cochrane Database of Systematic Reviews (through June 2018) and Ovid MEDLINE (1946 to June 2018); surveillance through December 5, 2018.

STUDY SELECTION

English-language trials and observational studies of screening for and treating elevated lead levels in asymptomatic children and pregnant women.

DATA EXTRACTION AND SYNTHESIS

Independent critical appraisal and data abstraction by 2 reviewers using predefined criteria.

MAIN OUTCOMES AND MEASURES

Elevated blood lead level, morbidity, mortality, clinical prediction tools, test accuracy, adverse events.

RESULTS

A total of 24 studies (N = 11 433) were included in this review. No studies evaluated the benefits or harms of screening vs no screening in children. More than 1 positive answer on the 5-item 1991 Centers for Disease Control and Prevention (CDC) screening questionnaire was associated with a pooled sensitivity of 48% (95% CI, 31.4% to 65.6%) and specificity of 58% (95% CI, 39.9% to 74.0%) for identifying children with a venous blood lead level greater than 10 μg/dL (5 studies [n = 2265]). Adapted versions of the CDC questionnaire did not demonstrate improved accuracy. Capillary blood lead testing demonstrated sensitivity of 87% to 91% and specificity greater than 90%, compared with venous measurement (4 studies [n = 1431]). Counseling and nutritional interventions or residential lead hazard control techniques did not reduce blood lead concentrations in asymptomatic children, but studies were few and had methodological limitations (7 studies [n = 1419]). One trial (n = 780) of dimercaptosuccinic acid (DMSA) chelation therapy found reduced blood lead levels in children at 1 week to 1 year but not at 4.5 to 6 years, while another trial (n = 39) found no effect at 1 and 6 months. Seven-year follow-up assessments showed no effect on neuropsychological development, a small deficit in linear growth (height difference, 1.17 cm [95% CI, 0.41 to 1.93]), and poorer cognitive outcomes reported as the Attention and Executive Functions subscore of the Developmental Neuropsychological Assessment (unadjusted difference, -1.8 [95% CI, -4.5 to 1.0]; adjusted P = .045) in children treated with DMSA chelation. Evidence was too limited to determine the accuracy of screening questionnaires or benefits and harms of treatment in pregnant women.

CONCLUSIONS AND RELEVANCE

Screening questionnaires were not accurate for identifying children with elevated blood lead levels. Chelating agents in children were not significantly associated with sustained effects on blood level levels but were associated with harms.

Comparative effectiveness and harms of long-acting insulins for type 1 and type 2 diabetes: A systematic review and meta-analysis

AIM

To review evidence comparing benefits and harms of long-acting insulins in patients with type 1 and 2 diabetes.

METHODS

MEDLINE and two Cochrane databases were searched during February 2018. Two authors selected studies meeting inclusion criteria and assessed their quality. Comparative studies of adult or paediatric patients with diabetes treated with insulin degludec, detemir or glargine were included. Meta-analysis was used to combine results of similar studies, and the I² statistic calculated to assess statistical heterogeneity.

RESULTS

Of 2534 citations reviewed, 70 studies met the inclusion criteria. No statistically significant differences in HbA1c were seen between any two insulins or formulations. Hypoglycaemia was less probable with degludec than with glargine, including nocturnal hypoglycaemia in type 1 (rate ratio 0.68, 95% CI 0.56-0.81) and type 2 diabetes (rate ratio 0.73, 95% CI 0.65-0.82), and severe hypoglycaemia in type 2 diabetes (relative risk 0.72, 95% CI 0.54-0.96). Patients with type 2 diabetes had higher rates of withdrawal because of adverse events when treated with detemir compared with glargine (relative risk 2.1, 95% CI 1.4-3.3). Adults taking detemir gained about 1 kg less body weight than those taking degludec (type 1) or glargine (type 2).

CONCLUSIONS

No differences in glycaemic control were seen between insulin degludec, detemir and glargine. Hypoglycaemia was less probable with degludec than glargine, and patients taking detemir gained less body weight than those given degludec or glargine. In type 2 diabetes, withdrawals as a result of adverse events were more probable with detemir than glargine.

Pharmacologic Treatments for Sleep Disorders in Children: A Systematic Review

Sleep problems are common in children, especially those with neurodevelopmental disorders, and can lead to consequences in behavior, functioning, and quality of life. We systematically reviewed the efficacy and harms of pharmacologic treatments for sleep disorders in children and adolescents. We searched MEDLINE, Cochrane library databases, and PsycINFO through June 2018. We included 22 placebo-controlled randomized controlled trials (1-13 weeks' duration), involving 1758 children (mean age 8.2 years). Single randomized controlled trials of zolpidem and eszopiclone in children with attention-deficit/hyperactivity disorder (ADHD) showed no improvement in sleep or ADHD ratings. Clinical Global Impression Improvement/Severity scores significantly improved with zolpidem ( P = .03 and P = .006, respectively). A single, small randomized controlled trial of diphenhydramine reported small improvements in sleep outcomes (8-10 minutes' better sleep latency and duration) after 1 week. In 19 randomized controlled trials, melatonin significantly improved sleep latency (median 28 minutes; range 11-51 minutes), sleep duration (median 33 minutes; range 14-68 minutes), and wake time after sleep onset (range 12-43 minutes), but not number of awakenings per night (range 0-2.7). Function and behavior improvement varied. Improvement in sleep was greatest in children with autism or other neurodevelopmental disorders, and smaller in adolescents and children with chronic delayed sleep onset. Adverse events were infrequent with melatonin, but more frequent than placebo in children taking eszopiclone or zolpidem. These findings show that melatonin was useful in improving some sleep outcomes in the short term, particularly those with comorbid ASD and neurodevelopmental disorders. Other drugs and outcomes are inadequately studied.

A study of the value of requesting information from drug manufacturers for systematic reviews; 9 years of experience from the drug effectiveness review project

BACKGROUND

Systematic reviews (SRs) depend on comprehensive searches for evidence to provide balanced, accurate results. Requesting published and unpublished studies from pharmaceutical manufacturers has been proposed as a method to engage industry stakeholders and potentially reduce reporting bias. The Drug Effectiveness Review Project (DERP) has been requesting such evidence since 2003; the purpose of this study was to retrospectively evaluate the type and impact of the evidence received.

METHODS

Data from "dossiers" submitted by pharmaceutical manufacturers for a set of 40 SRs conducted for DERP from July 2006 to June 2015 were retrospectively evaluated. Characteristics of data submitted in dossiers, including numbers, types, and characteristics of studies submitted and then included in DERP SRs, were abstracted. Time trends, study quality, publication status, and whether the submission represented a unique study or supplemental data to a published study were assessed. The impact of this evidence on SR conclusions was assessed using dual review. Differences were resolved through a consensus.

RESULTS

Over 9 years, 160 dossiers were received, relating to 40 DERP SRs. Out of 7360 studies/datasets submitted, 2.2% (160) were included in a SR. The ratio of submitted-to-included increased over time. Most were unique studies (23% were supplemental data sets), and almost 42% of the studies were unpublished. The majority of the studies were rated fair quality, with 7.3% rated good and 14% rated poor quality by the original SR authors. Considering all literature search sources, 7.2% of all studies included in the 40 SRs came from a dossier, and 16% of dossier studies were included in a meta-analysis. The dossier studies resulted in changes to conclusions in 42% of the SRs. Out of 46 unpublished unique studies included in a SR, 25 (54%) influenced the conclusions in favor of the manufacturers drug, 8% favored a competitor drug, and 40% favored neither. In 92% of cases favoring the manufacturer's drug, the dossier study was the only evidence for that drug in a specific population or outcome.

CONCLUSIONS

In SRs conducted for DERP, few studies submitted by pharmaceutical manufacturers were ultimately included in a SR. The included data helped to reduce reporting and publication bias by filling important gaps and in some cases led to altered conclusions.

Interventions to reduce inappropriate prescribing of antibiotics for acute respiratory tract infections: summary and update of a systematic review

Objective

Antibiotic overuse contributes to antibiotic resistance and adverse consequences. Acute respiratory tract infections (RTIs) are the most common reason for antibiotic prescribing in primary care, but such infections often do not require antibiotics. We summarized and updated a previously performed systematic review of interventions to reduce inappropriate use of antibiotics for acute RTIs.

Methods

To update the review, we searched MEDLINE®, the Cochrane Library (until January 2018), and reference lists. Two reviewers selected the studies, extracted the study data, and assessed the quality and strength of evidence.

Results

Twenty-six interventions were evaluated in 95 mostly fair-quality studies. The following four interventions had moderate-strength evidence of improved/reduced antibiotic prescribing and low-strength evidence of no adverse consequences: parent education (21% reduction, no increase return visits), combined patient/clinician education (7% reduction, no change in complications/satisfaction), procalcitonin testing for adults with RTIs of the lower respiratory tract (12%–72% reduction, no increased adverse consequences), and electronic decision support systems (24%–47% improvement in appropriate prescribing, 5%–9% reduction, no increased complications).

Conclusions

The best evidence supports use of specific educational interventions, procalcitonin testing in adults, and electronic decision support to reduce inappropriate antibiotic prescribing for acute RTIs without causing adverse consequences.

Comparative Risk of Harm Associated With the Use of Targeted Immunomodulators: A Systematic Review

OBJECTIVE

To systematically compare the risk of adverse events (AEs) for 13 targeted immunomodulators (TIMs) indicated for ankylosing spondylitis (AS), inflammatory bowel diseases, juvenile idiopathic arthritis, plaque psoriasis, psoriatic arthritis (PsA), or rheumatoid arthritis (RA).

METHODS

We searched electronic databases through July 2015 to retrieve randomized controlled trials (RCTs) and observational studies comparing AEs between 2 or more TIMs head-to-head. We reported on the following outcomes: number of AEs, discontinuation due to AEs, serious AEs, mortality, serious infections, tuberculosis, herpes zoster, and malignancies. We qualitatively synthesized the literature and conducted random-effects meta-analyses if 3 or more studies provided data for an outcome.

RESULTS

Ten head-to-head RCTs and 51 observational studies were included in this systematic review. A majority of the studies (70%) were conducted in RA patients. Risk of treatment discontinuation due to AEs was higher with infliximab than with adalimumab or etanercept in RA, PsA, and AS. A higher risk for serious infections was noted with infliximab than with abatacept, adalimumab, or etanercept in RA. Risk for treatment discontinuation due to AEs, serious infections, and tuberculosis was lower with etanercept than with adalimumab in RA. Limited evidence suggested no comparative differences in risk for mortality, malignancies, and herpes zoster for adalimumab, etanercept, and infliximab in RA.

CONCLUSION

Important differences were noted in the safety profile of TIMs in RA, generally favoring abatacept, adalimumab, and etanercept over infliximab. Head-to-head comparative evidence for other TIMs and non-RA populations was insufficient to draw conclusions for most of the safety outcomes.

Use of patient decision aids increased younger women's reluctance to begin screening mammography: a systematic review and meta-analysis

BACKGROUND

As breast cancer screening guidelines have changed recently, additional investigation is needed to understand changes in women's behavior after using breast cancer screening patient decision aids (BCS-PtDAs) and the potential effect on mammography utilization. This systematic review and meta-analysis sought to evaluate the effect of BCS-PtDAs on changes in women's intentions to undergo screening mammography and whether women deciding to begin or discontinue screening mammography displayed similar changes in screening intentions after using a BCS-PtDA.

METHODS

We searched Medline, Scopus, PsycINFO, CENTRAL, Health and Psychosocial Instruments, Health Technology Assessment Database, PsycARTICLES, and cited references in eligible papers for randomized controlled trials (RCTs) and observational studies, published through August 24, 2016. The proportions of women who did and not intend to undergo screening and who were uncertain about undergoing screening mammography were pooled, using risk ratios (RR) and random effects. According to the protocol, RCTs or observational studies and any language were considered eligible for systematic review if they included data about women for which shared decision making is recommended.

RESULTS

We ultimately included six studies with screening intention data for 2040 women. Compared to usual care, the use of BCS-PtDAs in three RCTs resulted in significantly more women deciding not to undergo screening mammography (RR 1.48 [95% CI 1.04-2.13]; P = 0.03), particularly for younger (38-50 years) women (1.77 [1.34-2.34]; P < 0.001). The use of BCS-PtDAs had a non-significant effect on the intentions of older women (69-89 years) to discontinue screening.

CONCLUSIONS

The use of BCS-PtDAs increased younger women's reluctance to undergo screening for breast cancer. The implementation of such BCS-PtDAs in clinical practice would be expected to result in a 77% increase in the number of younger women (aged 38-50) who do not intend to be screened, and as a consequence, may reduce utilization of screening mammography.

REGISTRATION

The protocol of this review is registered in the PROSPERO database, #CRD42016036695.

Barriers and facilitators to exchanging health information: a systematic review

OBJECTIVES

We conducted a systematic review of studies assessing facilitators and barriers to use of health information exchange (HIE).

METHODS

We searched MEDLINE, PsycINFO, CINAHL, and the Cochrane Library databases between January 1990 and February 2015 using terms related to HIE. English-language studies that identified barriers and facilitators of actual HIE were included. Data on study design, risk of bias, setting, geographic location, characteristics of the HIE, perceived barriers and facilitators to use were extracted and confirmed.

RESULTS

Ten cross-sectional, seven multiple-site case studies, and two before-after studies that included data from several sources (surveys, interviews, focus groups, and observations of users) evaluated perceived barriers and facilitators to HIE use. The most commonly cited barriers to HIE use were incomplete information, inefficient workflow, and reports that the exchanged information that did not meet the needs of users. The review identified several facilitators to use.

DISCUSSION

Incomplete patient information was consistently mentioned in the studies conducted in the US but not mentioned in the few studies conducted outside of the US that take a collective approach toward healthcare. Individual patients and practices in the US may exercise the right to participate (or not) in HIE which effects the completeness of patient information available to be exchanged. Workflow structure and user roles are key but understudied.

CONCLUSIONS

We identified several facilitators in the studies that showed promise in promoting electronic health data exchange: obtaining more complete patient information; thoughtful workflow that folds in HIE; and inclusion of users early in implementation.

Outcomes From Health Information Exchange: Systematic Review and Future Research Needs

BACKGROUND

Health information exchange (HIE), the electronic sharing of clinical information across the boundaries of health care organizations, has been promoted to improve the efficiency, cost-effectiveness, quality, and safety of health care delivery.

OBJECTIVE

To systematically review the available research on HIE outcomes and analyze future research needs.

METHODS

Data sources included citations from selected databases from January 1990 to February 2015. We included English-language studies of HIE in clinical or public health settings in any country. Data were extracted using dual review with adjudication of disagreements.

RESULTS

We identified 34 studies on outcomes of HIE. No studies reported on clinical outcomes (eg, mortality and morbidity) or identified harms. Low-quality evidence generally finds that HIE reduces duplicative laboratory and radiology testing, emergency department costs, hospital admissions (less so for readmissions), and improves public health reporting, ambulatory quality of care, and disability claims processing. Most clinicians attributed positive changes in care coordination, communication, and knowledge about patients to HIE.

CONCLUSIONS

Although the evidence supports benefits of HIE in reducing the use of specific resources and improving the quality of care, the full impact of HIE on clinical outcomes and potential harms are inadequately studied. Future studies must address comprehensive questions, use more rigorous designs, and employ a standard for describing types of HIE.

TRIAL REGISTRATION

PROSPERO Registry No CRD42014013285; http://www.crd.york.ac.uk/PROSPERO/ display_record.asp?ID=CRD42014013285 (Archived by WebCite at http://www.webcitation.org/6dZhqDM8t).

Health Information Exchange

OBJECTIVES

This review sought to systematically review the available literature on health information exchange (HIE), the electronic sharing of clinical information across the boundaries of health care organizations. HIE has been promoted as an important application of technology in medicine that can improve the efficiency, cost-effectiveness, quality, and safety of health care delivery. However, HIE also requires considerable investment by sponsors, which have included governments as well as health care organizations. This review aims to synthesize the currently available research addressing HIE effectiveness, use, usability, barriers and facilitators to actual use, implementation, and sustainability, and to present this information as a foundation on which future implementation, expansion, and research can be based.

DATA SOURCES

A research librarian designed and conducted searches of electronic databases, including MEDLINE® (1990 to February 2015), PsycINFO® (1990 to February 2015), CINAHL® (1990 through February 2015), the Cochrane Central Register of Controlled Trials (through January 2015), the Cochrane Database of Systematic Reviews (through January 2015), the Database of Abstracts of Reviews of Effects (through the first quarter of 2015), and the National Health Sciences Economic Evaluation Database (through the first quarter of 2015). The searches were supplemented by reviewing reference lists and the table of contents of journals not indexed in the databases we searched.

REVIEW METHODS

Two investigators reviewed abstracts and the selected full-text articles for inclusion based on predefined criteria. Discrepancies were resolved through discussion and consensus, with a third investigator making the final decision as needed. Data were abstracted from each included article by one person and verified by another. All analyses were qualitative, and they were customized according to the topic.

RESULTS

We included 136 studies overall, with 34 on effectiveness, 26 of which reported intermediate clinical, economic, or patient outcomes, and 8 that reported on clinical perceptions of HIE. We also found 58 studies on the use of HIE, 22 on usability and other facilitators and barriers to actual use of HIE, 45 on facilitators or barriers to HIE implementation, and 17 on factors related to sustainability of HIE.

No studies of HIE effectiveness reported impact on primary clinical outcomes (e.g., mortality and morbidity) or identified harms. Low-quality evidence somewhat supports the value of HIE for reducing duplicative laboratory and radiology test ordering, lowering emergency department costs, reducing hospital admissions (less so for readmissions), improving public health reporting, increasing ambulatory quality of care, and improving disability claims processing. In studies of clinician perceptions of HIE, most respondents attributed positive changes to HIE, such as improvements in coordination, communication, and knowledge about the patient. However in one study clinicians reported that the HIE did not save time and may not be worth the cost.

Studies of HIE use found that HIE adoption has increased over time, with 76 percent of U.S. hospitals exchanging information in 2014, an 85-percent increase since 2008 and a 23-percent increase since 2013. HIE systems were used by 38 percent of office-based physicians in 2012, while use remains low, less than 1 percent, among long-term care providers.

Within organizations with HIE, the number of users or the number of visits in which the HIE was used was generally very low. The degree of usability of an HIE was associated with increased rates of use but was not associated with effectiveness outcomes. The most commonly cited barriers to HIE use were lack of critical mass electronically exchanging data, inefficient workflow, and poorly designed interface and update features. Information was insufficient to allow us to assess usability by HIE function or architecture.

Studies provided information on both external environmental and internal organizational characteristics that affect implementation and sustainability. General characteristics of the HIE organization (e.g., strong leadership) or specific characteristics of the HIE system were the most frequently cited facilitators, while disincentives such as competition or lack of a business case for HIE were the most frequently identified barriers.

LIMITATIONS

The scope of studies identified was limited compared with the actual uses and capabilities of HIE. The outcomes measured and methods of measurement and analysis, for example, were limited and narrowly defined; the issue of potential confounders was not addressed in most studies of effectiveness, and harms were not adequately studied. There was a high degree of heterogeneity in study designs, outcomes, HIE types, and settings across the studies, limiting the ability to synthesize the evidence; no quantitative analyses were possible. The applicability of this evidence base is uncertain because the HIE systems studied were so diverse, and many in existence have not contributed to research in this field.

CONCLUSIONS

The full impact of HIE on clinical outcomes and potential harms is inadequately studied, although evidence provides some support for benefit in reducing use of some specific resources and achieving improvements in quality-of-care measures. Use of HIE has risen over time, and is highest in hospitals and lowest in long-term care settings. However, use of HIE within organizations that offer it is still low. Barriers to HIE use include lack of critical mass participating in the exchange, inefficient workflow, and poorly designed interface and update features. Studies have identified numerous facilitators and barriers to implementation and sustainability, but the studies have not ranked or compared their impact. To advance our understanding of HIE, future studies need to address comprehensive questions, use more rigorous designs, use a standard for describing types of HIE, and be part of a coordinated systematic approach to studying HIE.

Screening and routine supplementation for iron deficiency anemia: a systematic review

BACKGROUND AND OBJECTIVES

Supplementation and screening for iron-deficiency anemia (IDA) in young children may improve growth and development outcomes. The goal of this study was to review the evidence regarding the benefits and harms of screening and routine supplementation for IDA for the US Preventive Services Task Force.

METHODS

We searched Medline and Cochrane databases (1996-August 2014), as well as reference lists of relevant systematic reviews. We included trials and controlled observational studies regarding the effectiveness and harms of routine iron supplementation and screening in children ages 6 to 24 months conducted in developed countries. One author extracted data, which were checked for accuracy by a second author. Dual quality assessment was performed.

RESULTS

No studies of iron supplementation in young children reported on the diagnosis of neurodevelopmental delay. Five of 6 trials sparsely reporting various growth outcomes found no clear benefit of supplementation. After 3 to 12 months, Bayley Scales of Infant Development scores were not significantly different in 2 trials. Ten trials assessing iron supplementation in children reported inconsistent findings for hematologic measures. Evidence regarding the harms of supplementation was limited but did not indicate significant differences. No studies assessed the benefits or harms of screening or the association between improvement in impaired iron status and clinical outcomes. Studies may have been underpowered, and control factors varied and could have confounded results.

CONCLUSIONS

Although some evidence on supplementation for IDA in young children indicates improvements in hematologic values, evidence on clinical outcomes is lacking. No randomized controlled screening studies are available.

Interventions that may reduce depressive symptoms among prostate cancer patients: a systematic review and meta-analysis

OBJECTIVE

Prostate cancer patients are at increased risk of depression yet there is no standard intervention to address this. The purpose of this meta-analysis is to examine the efficacy of interventions in reducing depressive symptoms in men with prostate cancer.

METHODS

Searches for studies were conducted in four databases and by hand. Randomized controlled trials of any intervention relative to control for depression in prostate cancer patients at any stage of their cancer treatment were included.

RESULTS

We identified 11 studies that randomized men with prostate cancer to either an intervention meant to improve some aspect of quality of life or control and reported depressive symptoms scores before and after the intervention or control condition. Two of these were not used in our meta-analysis either for concerns about quality or for lack of depression scores. The interventions identified in the remaining nine articles were exercise (four), information (three), psychotherapy or peer support (three), massage therapy (one), and medication (one). Several publications included more than one type of intervention. A meta-analysis of all studies showed that an intervention of some types significantly improved depressive symptom scores relative to the control condition (improvement in depression score by -0.86 unit (95% CI: -1.42, -0.31)). Isolating the peer support/psychotherapy studies also showed significant improvement (improvement in depression score by -1.09 unit (95% CI: -2.05, -0.13)).

CONCLUSION

Treatments to improve depressive symptoms in men with prostate cancer may be effective, with the best evidence supporting the use of peer support/psychotherapy.

Aggregator: a machine learning approach to identifying MEDLINE articles that derive from the same underlying clinical trial

OBJECTIVE

It is important to identify separate publications that report outcomes from the same underlying clinical trial, in order to avoid over-counting these as independent pieces of evidence.

METHODS

We created positive and negative training sets (comprised of pairs of articles reporting on the same condition and intervention) that were, or were not, linked to the same clinicaltrials.gov trial registry number. Features were extracted from MEDLINE and PubMed metadata; pairwise similarity scores were modeled using logistic regression.

RESULTS

Article pairs from the same trial were identified with high accuracy (F1 score=0.843). We also created a clustering tool, Aggregator, that takes as input a PubMed user query for RCTs on a given topic, and returns article clusters predicted to arise from the same clinical trial.

DISCUSSION

Although painstaking examination of full-text may be needed to be conclusive, metadata are surprisingly accurate in predicting when two articles derive from the same underlying clinical trial.

Automated confidence ranked classification of randomized controlled trial articles: an aid to evidence-based medicine

Objective: For many literature review tasks, including systematic review (SR) and other aspects of evidence-based medicine, it is important to know whether an article describes a randomized controlled trial (RCT). Current manual annotation is not complete or flexible enough for the SR process. In this work, highly accurate machine learning predictive models were built that include confidence predictions of whether an article is an RCT.

Materials and Methods: The LibSVM classifier was used with forward selection of potential feature sets on a large human-related subset of MEDLINE to create a classification model requiring only the citation, abstract, and MeSH terms for each article.

Results: The model achieved an area under the receiver operating characteristic curve of 0.973 and mean squared error of 0.013 on the held out year 2011 data. Accurate confidence estimates were confirmed on a manually reviewed set of test articles. A second model not requiring MeSH terms was also created, and performs almost as well.

Discussion: Both models accurately rank and predict article RCT confidence. Using the model and the manually reviewed samples, it is estimated that about 8000 (3%) additional RCTs can be identified in MEDLINE, and that 5% of articles tagged as RCTs in Medline may not be identified.

Conclusion: Retagging human-related studies with a continuously valued RCT confidence is potentially more useful for article ranking and review than a simple yes/no prediction. The automated RCT tagging tool should offer significant savings of time and effort during the process of writing SRs, and is a key component of a multistep text mining pipeline that we are building to streamline SR workflow. In addition, the model may be useful for identifying errors in MEDLINE publication types. The RCT confidence predictions described here have been made available to users as a web service with a user query form front end at: http://arrowsmith.psych.uic.edu/cgi-bin/arrowsmith_uic/RCT_Tagger.cgi.

Observational evidence and strength of evidence domains: case examples

BACKGROUND

Systematic reviews of healthcare interventions most often focus on randomized controlled trials (RCTs). However, certain circumstances warrant consideration of observational evidence, and such studies are increasingly being included as evidence in systematic reviews.

METHODS

To illustrate the use of observational evidence, we present case examples of systematic reviews in which observational evidence was considered as well as case examples of individual observational studies, and how they demonstrate various strength of evidence domains in accordance with current Agency for Healthcare Research and Quality (AHRQ) Evidence-based Practice Center (EPC) methods guidance.

RESULTS

In the presented examples, observational evidence is used when RCTs are infeasible or raise ethical concerns, lack generalizability, or provide insufficient data. Individual study case examples highlight how observational evidence may fulfill required strength of evidence domains, such as study limitations (reduced risk of selection, detection, performance, and attrition); directness; consistency; precision; and reporting bias (publication, selective outcome reporting, and selective analysis reporting), as well as additional domains of dose-response association, plausible confounding that would decrease the observed effect, and strength of association (magnitude of effect).

CONCLUSIONS

The cases highlighted in this paper demonstrate how observational studies may provide moderate to (rarely) high strength evidence in systematic reviews.

Systematic review of the benefits and risks of metformin in treating obesity in children aged 18 years and younger

IMPORTANCE

Childhood obesity is an important public health problem with increasing prevalence. Because treatment often has limited success, new approaches must be identified.

OBJECTIVE

To evaluate the effectiveness and safety of metformin for treating obesity in children aged 18 years and younger without a diagnosis of diabetes mellitus.

EVIDENCE REVIEW

We included randomized clinical trials identified through searches of MEDLINE, the Cochrane Library, and ClinicalTrials.gov. Our primary outcome measure was change in body mass index (BMI, calculated as weight in kilograms divided by height in meters squared). We assessed study quality, pooled data using a random-effects model, and performed subgroup and sensitivity analyses.

FINDINGS

Fourteen randomized clinical trials were eligible. For BMI, moderate-strength evidence indicated a reduction of -1.38 (95% CI, -1.93 to -0.82) from baseline compared with control at 6 months. A similar, if less dramatic, effect was observed in studies less than 6 months, but the pooled estimate from studies of 1 year of treatment was not statistically significant. Subgroup analyses indicated smaller, but significant, effects for those with baseline BMI below 35, those of Hispanic ethnicity, those with acanthosis nigricans, those who had tried and failed diet and exercise programs, and in studies with more girls or higher mean age (adolescents). Moderate-strength evidence indicated that with metformin, 26% reported a gastrointestinal event compared with 13% in control groups (relative risk, 2.05; 95% CI, 1.19-3.54), although there was no difference in discontinuations due to adverse events. No serious adverse events were reported.

CONCLUSIONS AND RELEVANCE

Metformin provides a statistically significant, but very modest reduction in BMI when combined with lifestyle interventions over the short term. A large trial is needed to determine the benefits to subgroups or impacts of confounders. In the context of other options for treating childhood obesity, metformin has not been shown to be clinically superior.

Design and implementation of Metta, a metasearch engine for biomedical literature retrieval intended for systematic reviewers

Background

Individuals and groups who write systematic reviews and meta-analyses in evidence-based medicine regularly carry out literature searches across multiple search engines linked to different bibliographic databases, and thus have an urgent need for a suitable metasearch engine to save time spent on repeated searches and to remove duplicate publications from initial consideration. Unlike general users who generally carry out searches to find a few highly relevant (or highly recent) articles, systematic reviewers seek to obtain a comprehensive set of articles on a given topic, satisfying specific criteria. This creates special requirements and challenges for metasearch engine design and implementation.

Methods

We created a federated search tool that is connected to five databases: PubMed, EMBASE, CINAHL, PsycINFO, and the Cochrane Central Register of Controlled Trials. Retrieved bibliographic records were shown online; optionally, results could be de-duplicated and exported in both BibTex and XML format.

Results

The query interface was extensively modified in response to feedback from users within our team. Besides a general search track and one focused on human-related articles, we also added search tracks optimized to identify case reports and systematic reviews. Although users could modify preset search options, they were rarely if ever altered in practice. Up to several thousand retrieved records could be exported within a few minutes. De-duplication of records returned from multiple databases was carried out in a prioritized fashion that favored retaining citations returned from PubMed.

Conclusions

Systematic reviewers are used to formulating complex queries using strategies and search tags that are specific for individual databases. Metta offers a different approach that may save substantial time but which requires modification of current search strategies and better indexing of randomized controlled trial articles. We envision Metta as one piece of a multi-tool pipeline that will assist systematic reviewers in retrieving, filtering and assessing publications. As such, Metta may find wide utility for anyone who is carrying out a comprehensive search of the biomedical literature.

Electronic supplementary material

The online version of this article (doi:10.1186/2047-2501-2-1) contains supplementary material, which is available to authorized users.

Use of administrative data to identify off-label use of second-generation antipsychotics in a Medicaid population

OBJECTIVE The use of second-generation antipsychotics for conditions not approved by the U.S. Food and Drug Administration (FDA) is a prevalent phenomenon with important implications. The objective of this study was to determine the accuracy of administrative claims for identifying off-label use of second-generation antipsychotics in a Medicaid population in 2009. METHODS The authors estimated the sensitivity, specificity, positive predictive values (PPV), and negative predictive values of Medicaid claims data for detecting off-label use of second-generation antipsychotics in the electronic health records of 788 patients. Separate estimates were calculated for patients without schizophrenia and bipolar disorder, the two most long-standing FDA indications for use of second-generation antipsychotics, and for a subset of patients using a second-generation antipsychotic with indications for treatment-resistant depression. RESULTS Medicaid claims determined a lack of schizophrenia and bipolar disorder in the medical record with a sensitivity of 72% and a specificity of 85%. The prevalence of identifying neither diagnosis was 83%, which was associated with a predictive ability (PPV) of 96%. Among those using a second-generation antipsychotic with an indication for treatment-resistant depression, the sensitivity, specificity, and PPV of Medicaid claims for identifying off-label use were 41%, 86%, and 87%, respectively. CONCLUSIONS Medicaid claims data had high predictive ability for identifying users of second-generation antipsychotics who did not have documentation of schizophrenia or bipolar disorder in the medical record. The predictive utility of the claims was diminished when the analyses were limited to patients using a second-generation antipsychotic with an indication for treatment-resistant depression.

US Food and Drug Administration documents can provide unpublished evidence relevant to systematic reviews

OBJECTIVES

A key systematic review (SR) methodology is comprehensive searching. The Drug Effectiveness Review Project (DERP) SRs search US Food and Drug Administration (FDA) documents to identify unpublished evidence. This study evaluates the success of those efforts.

STUDY DESIGN AND SETTING

We examined DERP reports published since 2003 for the use of FDA preapproval and postmarketing documents. We categorized evidence as (1) unique unpublished studies, (2) supplemental unpublished data, or (3) FDA postmarketing data analysis. Three reviewers independently assigned predetermined impact categories (e.g., qualitative or quantitative usage, fills gaps, confirms findings, and alters conclusions), resolving disagreements through consensus.

RESULTS

Among 114 DERP reports, 19% included unpublished studies and/or supplemental data and 10% included postmarketing analyses. From 175 preapproval documents, 14% provided eligible unpublished studies and 4.0% supplemental unpublished data that helped confirm previous findings, identify important harms, and fill gaps in knowledge about understudied subpopulations, outcomes, and comparisons. Report conclusion statements changed in 9 of 33 instances of premarketing documents compared with 4 of 12 postmarketing analyses.

CONCLUSIONS

The FDA documents can provide important unpublished evidence for SRs, although in a small proportion of cases. Future research should identify attributes that predict which reviews may benefit most from review of FDA documents.

Methods for the drug effectiveness review project

The Drug Effectiveness Review Project was initiated in 2003 in response to dramatic increases in the cost of pharmaceuticals, which lessened the purchasing power of state Medicaid budgets. A collaborative group of state Medicaid agencies and other organizations formed to commission high-quality comparative effectiveness reviews to inform evidence-based decisions about drugs that would be available to Medicaid recipients. The Project is coordinated by the Center for Evidence-based Policy (CEbP) at Oregon Health & Science University (OHSU), and the systematic reviews are undertaken by the Evidence-based Practice Centers (EPCs) at OHSU and at the University of North Carolina. The reviews adhere to high standards for comparative effectiveness reviews. Because the investigators have direct, regular communication with policy-makers, the reports have direct impact on policy and decision-making, unlike many systematic reviews. The Project was an innovator of methods to involve stakeholders and continues to develop its methods in conducting reviews that are highly relevant to policy-makers. The methods used for selecting topics, developing key questions, searching, determining eligibility of studies, assessing study quality, conducting qualitative and quantitative syntheses, rating the strength of evidence, and summarizing findings are described. In addition, our on-going interactions with the policy-makers that use the reports are described.

Methodology for the development of antithrombotic therapy and prevention of thrombosis guidelines: Antithrombotic Therapy and Prevention of Thrombosis, 9th ed: American College of Chest Physicians Evidence-Based Clinical Practice Guidelines

BACKGROUND

To develop the Antithrombotic Therapy and Prevention of Thrombosis, 9th ed: ACCP Evidence-Based Clinical Practice Guidelines (AT9), the American College of Chest Physicians (ACCP) assembled a panel of clinical experts, information scientists, decision scientists, and systematic review and guideline methodologists.

METHODS

Clinical areas were designated as articles, and a methodologist without important intellectual or financial conflicts of interest led a panel for each article. Only panel members without significant conflicts of interest participated in making recommendations. Panelists specified the population, intervention and alternative, and outcomes for each clinical question and defined criteria for eligible studies. Panelists and an independent evidence-based practice center executed systematic searches for relevant studies and evaluated the evidence, and where resources and evidence permitted, they created standardized tables that present the quality of the evidence and key results in a transparent fashion.

RESULTS

One or more recommendations relate to each specific clinical question, and each recommendation is clearly linked to the underlying body of evidence. Judgments regarding the quality of evidence and strength of recommendations were based on approaches developed by the Grades of Recommendations, Assessment, Development, and Evaluation Working Group. Panel members constructed scenarios describing relevant health states and rated the disutility associated with these states based on an additional systematic review of evidence regarding patient values and preferences for antithrombotic therapy. These ratings guided value and preference decisions underlying the recommendations. Each topic panel identified questions in which resource allocation issues were particularly important and, for these issues, experts in economic analysis provided additional searches and guidance.

CONCLUSIONS

AT9 methodology reflects the current science of evidence-based clinical practice guideline development, with reliance on high-quality systematic reviews, a standardized process for quality assessment of individual studies and the body of evidence, an explicit process for translating the evidence into recommendations, disclosure of financial as well as intellectual conflicts of interest followed by management of disclosed conflicts, and extensive peer review.

SYRIAC: The systematic review information automated collection system a data warehouse for facilitating automated biomedical text classification

Automatic document classification can be valuable in increasing the efficiency in updating systematic reviews (SR). In order for the machine learning process to work well, it is critical to create and maintain high-quality training datasets consisting of expert SR inclusion/exclusion decisions. This task can be laborious, especially when the number of topics is large and source data format is inconsistent.To approach this problem, we build an automated system to streamline the required steps, from initial notification of update in source annotation files to loading the data warehouse, along with a web interface to monitor the status of each topic. In our current collection of 26 SR topics, we were able to standardize almost all of the relevance judgments and recovered PMIDs for over 80% of all articles. Of those PMIDs, over 99% were correct in a manual random sample study. Our system performs an essential function in creating training and evaluation data sets for SR text mining research.

Comparative benefits and harms of competing medications for adults with attention-deficit hyperactivity disorder: a systematic review and indirect comparison meta-analysis

RATIONALE

Recommended medication prescribing hierarchies for adult attention-deficit hyperactivity disorder (ADHD) vary between different guideline committees. Few trials directly compare competing ADHD medications in adults and provide little insight for clinicians making treatment choices.

OBJECTIVE

The objective of this study was to assess comparative benefits and harms of competing medications for adult ADHD using indirect comparison meta-analysis.

MATERIALS AND METHODS

Eligible studies were English-language publications of randomized controlled trials comparing ADHD drugs to placebo. Data sources were electronic bibliographic databases, Drugs@FDA, manufacturer data, and reference lists. Two reviewers independently abstracted data on design, internal validity, population, and results. Benefits and harms were compared between drug types using indirect comparison meta-regression (ratio of relative risks).

RESULTS

Twenty-two placebo-controlled trials were included (n = 2,203). Relative benefit of clinical response for shorter-acting stimulants, primarily immediate release methylphenidate, was 3.26 times greater than for patients taking longer-acting stimulants (95% CI 2.03, 5.22) and 2.24 times greater than for patients taking longer-acting forms of bupropion (95% CI 1.23, 4.08). Immediate release methylphenidate is also the only drug shown to reduce ADHD symptoms in adults with substance abuse disorders. Neither non-stimulants nor longer-acting stimulants reduced adverse effects compared to shorter-acting stimulants. Key gaps in evidence were academic, occupational, social functioning, cardiovascular toxicity, and longer-term outcomes, influences of ADHD subtype and/or comorbidities, and misuse/diversion of the drugs.

CONCLUSIONS

Current best evidence supports using immediate release methylphenidate as first-line treatment for most adults with ADHD.

Systematic review of hyperbaric oxygen therapy for cerebral palsy: the state of the evidence

A systematic review of the evidence was conducted on the benefits and adverse effects of hyperbaric oxygen treatment (HBOT) for cerebral palsy (CP). Studies of any HBOT regimen in patients with CP were included except for case reports and case series. Electronic databases (e.g. MEDLINE, EMBASE), professional society databases, and reference lists were searched to identify studies. Study quality was assessed using predefined criteria relevant to the study design. Two randomized controlled trials and four observational studies were identified. Best evidence came from a randomized controlled trial which found that HBOT at 1.75 atmospheres (atm) and 1.3 atm of room air resulted in similar improvements in motor function (5-6%). Other outcomes also indicated no difference between the HBOT and room air. Observational studies reported improvements in motor function to a similar degree. Other evidence was insufficient to clarify the benefits and/or adverse effects of HBOT for CP. Both HBOT and pressurized room air resulted in improvements in motor function compared with baseline. Similar improvements were seen in the observational studies. Children undergoing HBOT were reported to experience adverse events, including seizures and the need for ear pressure equalization tube placement, but the incidence was unclear. Future research is needed to determine the efficacy of pressurized room air or non-pressurized oxygen in equivalent amounts by mask, compared with standard treatments.

A Systematic Review of the Efficacy and Safety of Atypical Antipsychotics in Patients with Psychological and Behavioral Symptoms of Dementia

Although the Food and Drug Administration (FDA) has not approved atypical antipsychotics for use in patients with dementia, they are commonly prescribed in this population. Recent concerns about increased risk of cerebrovascular events and mortality have led to warnings. A systematic review was conducted to assess the benefits and harms of atypical antipsychotics when used in patients with behavioral and psychological symptoms of dementia. Electronic searches (through March 2005) of the Cochrane Library, Medline, Embase, and PsycINFO were supplemented with hand searches of reference lists, dossiers submitted by pharmaceutical companies, and a review of the FDA Website and industry-sponsored results database. Using predetermined criteria, each study was assessed for inclusion, and data about study design, population, interventions, and outcomes were abstracted. An overall quality rating (good, fair, or poor) was assigned based on internal validity. The evidence for olanzapine and risperidone supports their effectiveness compared with placebo. Short-term adverse events were similar to placebo. Risperidone had no advantage over haloperidol on efficacy measures in the better-quality studies. Risperidone had an advantage over haloperidol on some measures of extrapyramidal symptoms. Evidence for the other atypical antipsychotics is too limited to assess efficacy and safety. Trials were short term and conducted in highly selected populations. The potential for increased risk of cerebrovascular adverse events and mortality is a serious concern. To make judgments about when the benefits of atypical antipsychotics outweigh the potential harms, clinicians need more information. Additional data from existing trials and more-complete reporting of trial results could provide this information.

The benefits and risks of inducing labour in patients with prior caesarean delivery: a systematic review

OBJECTIVE

To evaluate the risks and benefits of inducing labour in women with a prior caesarean delivery.

DESIGN

Systematic review.

SAMPLE

Pregnant women with prior caesarean delivery.

METHODS

Studies were identified using MEDLINE, EMBASE, HealthSTAR, Cochrane Database of Systematic Reviews, Cochrane Controlled Trials Register, Database of Abstracts of Reviews of Effectiveness, reference lists and experts.

MAIN OUTCOME MEASURES

All studies reporting data for outcomes in women with induced labours and prior caesarean were eligible. Methodologic quality was evaluated using the criteria of the U.S. Preventive Services Task Force and the NHS Centre for Reviews and Dissemination. We assigned studies good, fair or poor rating.

RESULTS

We reviewed 162 full text articles, identified 14 fair-quality studies, and found no good-quality studies. Compared with spontaneous labour, induction was more likely to result in caesarean delivery. Of women undergoing spontaneous labour, 20% had a caesarean (range 11-35%) compared with 32% receiving oxytocin (range 18-44%). In studies of PGE2, spontaneous labour resulted in caesarean delivery in 24% (range 18-51%) compared with 48% with PGE2 (range 28-51%). There was a non-significant increase in uterine ruptures among those induced compared with spontaneous labours. There were no maternal deaths; other maternal complications were infrequently reported. Only four studies reported on infant deaths; other infant outcomes were inadequately reported.

CONCLUSION

Women with a history of caesarean attempting trial of labour who require induction have a higher rate of caesarean delivery and have a slightly elevated risk of rupture compared with similar women with spontaneous labour. More consideration is needed for potential confounders: dose, reasons for induction and appropriate comparison groups.

Systematic review of the incidence and consequences of uterine rupture in women with previous caesarean section

OBJECTIVE

To evaluate the incidence and consequences of uterine rupture in women who have had a delivery by caesarean section.

DESIGN

Systematic review.

DATA SOURCES

Medline, HealthSTAR, Cochrane Database of Systematic Reviews, Cochrane Controlled Trials Register, National Centre for Reviews and Dissemination, reference lists, and national experts. Studies in all languages were eligible if published in full.

REVIEW METHODS

Methodological quality was evaluated for each study by using criteria from the United States Preventive Services Task Force and the National Health Service Centre for Reviews and Dissemination. Uterine rupture was categorised as asymptomatic or symptomatic.

RESULTS

We reviewed 568 full text articles to identify 71 potentially eligible studies, 21 of which were rated at least fair in quality. Compared with elective repeat caesarean delivery, trial of labour increased the risk of uterine rupture by 2.7 (95% confidence interval 0.73 to 4.73) per 1000 cases. No maternal deaths were related to rupture. For women attempting vaginal delivery, the additional risk of perinatal death from rupture of a uterine scar was 1.4 (0 to 9.8) per 10,000 and the additional risk of hysterectomy was 3.4 (0 to 12.6) per 10 000. The rates of asymptomatic uterine rupture in trial of labour and elective repeat caesarean did not differ significantly.

CONCLUSIONS

Although the literature on uterine rupture is imprecise and inconsistent, existing studies indicate that 370 (213 to 1370) elective caesarean deliveries would need to be performed to prevent one symptomatic uterine rupture.

A rapid and systematic review of the effectiveness and cost-effectiveness of the taxanes used in the treatment of advanced breast and ovarian cancer

SECOND-LINE TREATMENT, PACLITAXEL (MEDIAN PROGRESSION-FREE SURVIVAL): The median progression-free survival in the paclitaxel arm was 3.5 months. This was significantly longer than the mitomycin control arm (1.6 months, p = 0.026). BREAST CANCER - SECOND-LINE TREATMENT, PACLITAXEL (MEDIAN OVERALL SURVIVAL): The median length of overall survival in the paclitaxel arm was 12.7 months, compared with 8.4 months in the mitomycin arm. BREAST CANCER - SECOND-LINE TREATMENT, PACLITAXEL (QUALITY OF LIFE): Quality of life was not reported. BREAST CANCER - SECOND-LINE TREATMENT, PACLITAXEL (ECONOMIC EVALUATION): The only economic evaluation that compared paclitaxel with control (mitomycin) was submitted in confidence and has been removed from this report. Six economic evaluations involved comparisons of paclitaxel and docetaxel, which are given below. BREAST CANCER - SECOND-LINE TREATMENT, DOCETAXEL: Four randomised controlled Phase III trials were identified: 303 Study, 304 Study, Scand and Bonneterre. A total of 1092 patients were included. One of these was a preliminary report of a study before completion of accrual (Bonneterre). Patients in the 303 Study had previously received chemotherapy involving alkylating agents; those in the other three had received anthracyclines. There were six economic evaluations on docetaxel. BREAST CANCER - SECOND-LINE TREATMENT, DOCETAXEL (QUALITY OF TRIALS): The 303 and 304 Studies were analysed on an intention to treat basis; the Scand trial excluded a single patient. The length of follow-up ranged from 11 months (Scand) to 23 months (303 Study). At least two-thirds of the participants in these trials had died. The Scand study recommended cross-over to alternate treatment on objective signs of disease progression. Patients crossing over in this way were violating the randomisation; however, no details were given concerning whether or not such patients were censored. In the economic analyses, there were no direct comparisons for the estimation of benefits. BREAST CANCER - SECOND-LINE TREATMENT, DOCETAXEL (MEDIAN PROGRESSION-FREE SURVIVAL): The median progression-free survival in the docetaxel arm ranged from 4.75 months (304 Study) to 7 months (Bonneterre). Patients in the docetaxel arms of the 304 and Scand studies had significantly longer progression-free survivals than controls (4.75 months versus 2.75 months, p = 0.001; 6.3 months versus 3 months, p = 0.001). BREAST CANCER - SECOND-LINE TREATMENT, DOCETAXEL (MEDIAN OVERALL SURVIVAL): The median overall survival in the docetaxel arm ranged from 10.4 months (Scand) to 15 months (303 Study). Patients in the docetaxel arms of the 304 Study survived for significantly longer than the mitomycin plus vinblastine arm (11.4 months versus 8.7 months, p = 0.03). BREAST CANCER - SECOND-LINE TREATMENT, DOCETAXEL (QUALITY OF LIFE): Quality of life was evaluated in two of the trials: the 303 and 304 Studies. There were no significant differences between docetaxel and control in either of these trials in terms of global health status, although differences were apparent on some subscales. These did not appear to follow a consistent pattern across the trials. BREAST CANCER - SECOND-LINE TREATMENT, DOCETAXEL (ECONOMIC EVALUATIONS): All six of these involved comparisons of paclitaxel and docetaxel, where the range of cost-utility ratios for incremental quality-adjusted life-years (QALYs) gained was pound 1990-pound 2431. In addition, three analyses compared docetaxel and vinorelbine. The cost-utility ratio for incremental QALYs gained was pound 14,050 in the only one of these carried out in the UK. OVARIAN CANCER - FIRST-LINE TREATMENT, PACLITAXEL: Four randomised controlled Phase III trials were identified: EORTC, TITGANZ, E1193 and CA139-278. (ABSTRACT TRUNCATED)

Systematic review of water fluoridation

OBJECTIVE

To review the safety and efficacy of fluoridation of drinking water.

DESIGN

Search of 25 electronic databases and world wide web. Relevant journals hand searched; further information requested from authors. Inclusion criteria were a predefined hierarchy of evidence and objectives. Study validity was assessed with checklists. Two reviewers independently screened sources, extracted data, and assessed validity.

MAIN OUTCOME MEASURES

Decayed, missing, and filled primary/permanent teeth. Proportion of children without caries. Measure of effect was the difference in change in prevalence of caries from baseline to final examination in fluoridated compared with control areas. For potential adverse effects, all outcomes reported were used.

RESULTS

214 studies were included. The quality of studies was low to moderate. Water fluoridation was associated with an increased proportion of children without caries and a reduction in the number of teeth affected by caries. The range (median) of mean differences in the proportion of children without caries was -5.0% to 64% (14.6%). The range (median) of mean change in decayed, missing, and filled primary/permanent teeth was 0.5 to 4.4 (2.25) teeth. A dose-dependent increase in dental fluorosis was found. At a fluoride level of 1 ppm an estimated 12.5% (95% confidence interval 7.0% to 21.5%) of exposed people would have fluorosis that they would find aesthetically concerning.

CONCLUSIONS

The evidence of a beneficial reduction in caries should be considered together with the increased prevalence of dental fluorosis. There was no clear evidence of other potential adverse effects.

Measuring appropriate use of acute beds. A systematic review of methods and results

A systematic review of the methods used to assess appropriateness of acute bed use and the evidence on the scale of inappropriate use in different patient groups is presented. Issues of generalisability of the findings are also addressed. Criteria based tools are the accepted way of measuring inappropriate days of stay and admissions, although opinion based classification is very common. While a number of tools exist, few have been adequately tested for reliability and validity. The Appropriateness Evaluation Protocol (AEP) is the most commonly used tool, and has been tested more widely. It appears to be both reliable and valid. An estimated 29% of admissions to acute psychiatric may be inappropriate. Regarding days of care after admission, between 24 and 58% of stays were not judged to be appropriate for continued stay on an acute ward. The need for continued acute psychiatric care may become lower as patients experience continued stay in the acute setting. A lack of housing and community support was the most commonly cited reason preventing discharge. Rates of inappropriate use appear to be higher for older patients than for the general population. Wide variation in rates of inappropriate days of stay was found, but it may be safe to assume that inappropriate use is greater than 20% across a wide variety of settings. Reasons for older patients to remain in an acute hospital bed after medically necessary are typically moderate nursing care needs (i.e. long-term care). The estimates of inappropriate use in other groups was found to be highly variable. Before definitive conclusions on the inappropriate use of acute beds can be made, future research needs to take into account the methodological problems discussed here.

Costs and savings of investigational drug services

The costs and savings resulting from two pharmacy-based investigational drug services (IDSs) for fiscal year 1996-97 were studied. The costs and savings associated with IDSs at two joint institutions were calculated by adding the cost-avoidance figures (money that would most likely have been spent, but was not because of a specific intervention or program) to the money received from services charged to study investigators or patients and subtracting salaries and overhead costs. Only drugs for which the authors could obtain prices were used to calculate cost-avoidance figures. The number of doses of marketed drugs that were provided free or for which the pharmacy was reimbursed by a drug study sponsor between July 1996 and June 1997 was tabulated from pharmacy dispensing records for each study. Investigational drugs that were not marketed or for which no marketed alternative was available were not included in the cost-avoidance calculation but were included in the charges for IDSs. The total cost of IDSs at the two institutions was $249,112. Income (representing cost avoidance and payments received) totaled $2,958,774, giving the IDSs an overall saving of $2,709,662. The two disease categories with the largest cost-avoidance figures were AIDS and oncology. In total, there was a cost avoidance of $2.9 million in drug costs, which is equivalent to 8% of the institutions' annual drug budget for 1996-97. IDSs in two institutions accounted for a combined one-year saving of over $2.7 million, most of which was attributable to cost avoidance from not having to purchase study drugs.