A simplified search strategy for identifying randomised controlled trials for systematic reviews of health care interventions: a comparison with more exhaustive strategies

An exploration of available methods and tools to improve the efficiency of systematic review production: a scoping review

BACKGROUND

Systematic reviews (SRs) are time-consuming and labor-intensive to perform. With the growing number of scientific publications, the SR development process becomes even more laborious. This is problematic because timely SR evidence is essential for decision-making in evidence-based healthcare and policymaking. Numerous methods and tools that accelerate SR development have recently emerged. To date, no scoping review has been conducted to provide a comprehensive summary of methods and ready-to-use tools to improve efficiency in SR production.

OBJECTIVE

To present an overview of primary studies that evaluated the use of ready-to-use applications of tools or review methods to improve efficiency in the review process.

METHODS

We conducted a scoping review. An information specialist performed a systematic literature search in four databases, supplemented with citation-based and grey literature searching. We included studies reporting the performance of methods and ready-to-use tools for improving efficiency when producing or updating a SR in the health field. We performed dual, independent title and abstract screening, full-text selection, and data extraction. The results were analyzed descriptively and presented narratively.

RESULTS

We included 103 studies: 51 studies reported on methods, 54 studies on tools, and 2 studies reported on both methods and tools to make SR production more efficient. A total of 72 studies evaluated the validity (n = 69) or usability (n = 3) of one method (n = 33) or tool (n = 39), and 31 studies performed comparative analyses of different methods (n = 15) or tools (n = 16). 20 studies conducted prospective evaluations in real-time workflows. Most studies evaluated methods or tools that aimed at screening titles and abstracts (n = 42) and literature searching (n = 24), while for other steps of the SR process, only a few studies were found. Regarding the outcomes included, most studies reported on validity outcomes (n = 84), while outcomes such as impact on results (n = 23), time-saving (n = 24), usability (n = 13), and cost-saving (n = 3) were less often evaluated.

CONCLUSION

For title and abstract screening and literature searching, various evaluated methods and tools are available that aim at improving the efficiency of SR production. However, only few studies have addressed the influence of these methods and tools in real-world workflows. Few studies exist that evaluate methods or tools supporting the remaining tasks. Additionally, while validity outcomes are frequently reported, there is a lack of evaluation regarding other outcomes.

Management of atrial fibrillation in older adults

Most people with atrial fibrillation are older adults, in whom atrial fibrillation co-occurs with other chronic conditions, polypharmacy, and geriatric syndromes such as frailty. Yet most randomized controlled trials and expert guidelines use an age agnostic approach. Given the heterogeneity of aging, these data may not be universally applicable across the spectrum of older adults. This review synthesizes the available evidence and applies rigorous principles of aging science. After contextualizing the burden of comorbidities and geriatric syndromes in people with atrial fibrillation, it applies an aging focused approach to the pillars of atrial fibrillation management, describing screening for atrial fibrillation, lifestyle interventions, symptoms and complications, rate and rhythm control, coexisting heart failure, anticoagulation therapy, and left atrial appendage occlusion devices. Throughout, a framework is suggested that prioritizes patients' goals and applies existing evidence to all older adults, whether atrial fibrillation is their sole condition, one among many, or a bystander at the end of life.

Treating Executive Function in Youth With Attention Deficit Hyperactivity Disorder: A Review of Pharmacological and Non-Pharmacological Interventions

INTRODUCTION

Executive function (EF) deficits are common in youth with ADHD and pose significant functional impairments. The extent and effect of interventions addressing EF in youth with ADHD remain unclear.

METHODS

We conducted a systematic literature review using PRISMA guidelines. Included studies were randomized controlled trials of interventions to treat EF in youth with ADHD.

RESULTS

Our search returned 136 studies representing 11,443 study participants. We identified six intervention categories: nonstimulant pharmacological (N = 3,576 participants), neurological (N = 1,935), psychological (N = 2,387), digital (N = 2,416), physiological (N = 680), and combination (N = 366). The bulk of the evidence supported pharmacological interventions as most effective in mitigating EF, followed by psychological and digital interventions.

CONCLUSION

A breadth of treatments exists for EF in youth with ADHD. Pharmacological, psychotherapeutic, and digital interventions had the most favorable, replicable outcomes. A lack of outcome standardization across studies limited treatment comparison. More data on the persistence of intervention effects are necessary.

Qigong and Tai Chi for ME/CFS: A Systematic Review of Randomized Controlled Trials

Objective

Myalgic encephalomyelitis/chronic fatigue syndrome (ME/CFS) is a chronic and debilitating illness with symptoms such as post-exertional malaise and cognitive dysfunction that can be challenging for patients to manage independently. Randomized controlled trials (RCTs) have examined mind-body and psychological approaches that teach patients coping skills for mitigating ME/CFS symptoms, including emerging literature on Qigong or Tai Chi instruction programs. This systematic review aims to summarize the characteristics of these trials and highlight potential areas for future optimization and refinement.

Methods

Ovid MEDLINE, Embase.com, Web of Science Core Collection, Cochrane CENTRAL, PsycINFO via Ovid, and ClinicalTrials.gov were searched in April 2023 using controlled vocabulary and keywords for the following eligibility criteria: Sample (ME/CFS), Design (RCT), Behavioral Intervention (mind-body or psychological interventions). Data extraction and reporting followed Cochrane and Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines.

Results

"Qigong" and "Tai Chi" yielded 142 and 80 abstracts, respectively. Of the 222 abstracts, full texts were available for 5 RCTs of Qigong (k = 5; N = 481). Notably, no trials of Tai Chi utilized a randomized control design. Among the 5 Qigong RCTs, the publication range was from 2012 to 2023. Details regarding intervention components and effects were summarized. Qigong intervention sessions (median = 12, mode = 10, 12) tended to last between 1-2 hours and occur across 5-12 weeks (median = 7, mode = 5). The Qigong interventions were all delivered in groups and incorporated at-home practice. Daily practice was a requirement (k = 4) or an advisement (k = 1). Patient-reported outcomes suggest an emerging evidence base for diffuse benefits on physical and emotional health outcomes.

Conclusions

Qigong interventions are promising, yet relatively understudied, in improving ME/CFS symptom severity and frequency. Future trials must implement standardized eligibility criteria for ME/CFS history, integrate Qigong or Tai Chi with other empirically supported mind-body and psychological practices, and assess long-term resiliency outcomes relevant to ME/CFS survivorship.

A Tailored Approach: A model for literature searching in complex systematic reviews

Our previous work identified that nine leading guidance documents for seven different types of systematic review advocated the same process of literature searching. We defined and illustrated this process and we named it ‘the Conventional Approach’. The Conventional Approach appears to meet the needs of researchers undertaking literature searches for systematic reviews of clinical interventions. In this article, we report a new and alternate process model of literature searching called ‘A Tailored Approach’. A Tailored Approach is indicated as a search process for complex reviews which do not focus on the evaluation of clinical interventions. The aims of this article are to (1) explain the rationale for, and the theories behind, the design of A Tailored Approach; (2) report the current conceptual illustration of A Tailored Approach and to describe a user’s interaction with the process model; and (3) situate the elements novel to A Tailored Approach (when compared with the Conventional Approach) in the relevant literature. A Tailored Approach suggests investing time at the start of a review, to develop the information needs from the research objectives, and to tailor the search approach to studies or data. Tailored Approaches should be led by the information specialist (librarian) but developed by the research team. The aim is not necessarily to focus on comprehensive retrieval. Further research is indicated to evaluate the use of supplementary search methods, methods of team-working to define search approaches, and to evaluate the use of conceptual models of information retrieval for testing and evaluation.

The impact of topiramate, botulinum toxin type A, and CGRP-antibodies on medication overuse headache in patients with chronic migraine: A protocol for systematic review and meta-analysis

Medication overuse headache (MOH) is defined as headache occurring ≥15 days/month developing as a consequence of regular overuse of acute or symptomatic headache medication for more than 3 months. MOH is present in more than 50% of patients with chronic migraine (CM). Although, studies have shown a positive impact for MOH patients of early introduction of preventive treatment and withdrawal of overused medication, uncertainties remain. The main purpose of this systematic review and meta-analysis is to assess the relative impact of topiramate, botulinum toxin type A, and human monoclonal antibodies (mAbs) targeting calcitonin gene-related peptide (CGRP) or its receptor (CGRPr) among MOH patients with CM. The PRISMA guideline for conducting systematic review will be followed. CENTRAL, MEDLINE, Embase and Web of Science databases will be searched. RCTs reporting outcomes such as change in migraine/headache frequency, change from MOH to no MOH, and ≥50% response rate will be included. The effect will be measured as mean difference (MD) for continuous data and odds ratio (OR) for dichotomous data. Heterogeneity across studies will be assessed using the Cochrane I2 statistics. The Cochrane RoB2 tool will be used to assess risk of bias, and the quality of evidence for outcomes will be rated according to five factors defined in Cochrane GRADE approach. The revision of the included articles, data extraction, risk of bias assessment, and quality rating of evidence will be independently done by two reviewers. Any discrepancies will be resolved through consensus with the third reviewer.

How to appraise the literature: basic principles for the busy clinician - part 2: systematic reviews and meta-analyses

With the increasing numbers of primary research papers being published in dentistry and healthcare in general, it is almost impossible for busy clinicians to keep up with the literature. Reviews summarising the outcomes of trials can therefore be a considerably efficient tool for obtaining the relevant information about what works and what does not. To this end, systematic reviews are critical in summarising the best available evidence and providing an indication of its strength. However, as with clinical trials, they can be difficult to interpret, of varying quality and dependent on the studies they include. This is the second part of a two-part series and will discuss the principles of critically appraising systematic reviews and meta-analyses. It follows on from part one, which focused on appraising randomised controlled trials.

What you see depends on where you sit: The effect of geographical location on web-searching for systematic reviews: A case study

There is limited guidance on how to web-search in systematic reviews and concern relates to the reproducibility of searches using search engines such as Google. The aim of this paper is to address one potential source of variation in Google searches: does the geographical location of a researcher affect Google search returns? Using a virtual private network, we ran the same web-search for the medical technology Dasatinib in 12 different countries. Two researchers independently extracted the search returns by country organised by page rank. We compared: C1. any difference in the items returned by Google searches between countries and C2. any difference in the page rank of items returned between countries. Searches were undertaken on Monday September 28th 2020. From 12 countries, 43 items were identified. For C1: 19 items were common to all 12 countries. Twenty-four items were missed by searches in some countries. This means that there were differences in search returns between countries. For C2: a randomised trial reported by Raddich et al was the first search return for all countries. All other items, common to all countries, varied in their page-rank. We find that geographic location would appear to influence Google search returns based on the findings of this case study. The findings suggest that recording the location of the researcher undertaking web-searching may now be an important factor to report alongside detail on steps taken to minimise personalisation of web-searches covered by recent guidance. This finding also has implications for stopping-rules.

The role of relapse prevention for depression in collaborative care: A systematic review

BACKGROUND

Relapse (the re-emergence of depression symptoms before full recovery) is common in depression and relapse prevention strategies are not well researched in primary care settings. Collaborative care is effective for treating acute phase depression but little is known about the use of relapse prevention strategies in collaborative care. We undertook a systematic review to identify and characterise relapse prevention strategies in the context of collaborative care.

METHODS

We searched for Randomised Controlled Trials (RCTs) of collaborative care for depression. In addition to published material, we obtained provider and patient manuals from authors to provide more detail on intervention content. We reported the extent to which collaborative care interventions addressed four relapse prevention components.

RESULTS

93 RCTs were identified. 31 included a formal relapse prevention plan; 42 had proactive monitoring and follow-up after the acute phase; 39 reported strategies for optimising sustained medication adherence; and 20 of the trials reported psychological or psycho-educational treatments persisting beyond the acute phase or focussing on long-term health/relapse prevention. 30 (32.3%) did not report relapse prevention approaches.

LIMITATIONS

We did not receive trial materials for approximately half of the trials, which limited our ability to identify relevant features of intervention content.

CONCLUSION

Relapse is a significant risk amongst people treated for depression and interventions are needed that specifically address and minimise this risk. Given the advantages of collaborative care as a delivery system for depression care, there is scope for more consistency and increased effort to implement and evaluate relapse prevention strategies.

Multicomponent hospital-led interventions to reduce hospital stay for older adults following elective surgery: a systematic review

Background

Elective older adult inpatient admissions are increasingly common. Older adults are at an elevated risk of adverse events in hospital, potentially increasing with lengthier hospital stay. Hospital-led organisational strategies may optimise hospital stay for elective older adult inpatients.

Objectives

To evaluate the effectiveness and cost-effectiveness of hospital-led multicomponent interventions to reduce hospital stay for older adults undergoing elective hospital admissions.

Data sources

Seven bibliographic databases (MEDLINE, MEDLINE In-Process & Other Non-Indexed Citations, EMBASE, Health Management Information Consortium, Cochrane Central Register of Controlled Trials, Cumulative Index to Nursing and Allied Health Literature and Allied and Complementary Medicine Database) were searched from inception to date of search (August 2017), alongside carrying out of web searches, citation searching, inspecting relevant reviews, consulting stakeholders and contacting authors. This search was duplicated, with an additional cost-filter, to identify cost-effectiveness evidence.

Review methods

Comparative studies were sought that evaluated the effectiveness or cost-effectiveness of relevant interventions in elective inpatients with a mean or median age of ≥ 60 years. Study selection, data extraction and quality assessment were completed independently by two reviewers. The main outcome was length of stay, but all outcomes were considered. Studies were sorted by procedure, intervention and outcome categories. Where possible, standardised mean differences or odds ratios were calculated. Meta-analysis was performed when multiple randomised controlled trials had the same intervention, treatment procedure, comparator and outcome. Findings were explored using narrative synthesis.

Findings

A total of 218 articles were included, with 80 articles from 73 effectiveness studies (n = 26,365 patients) prioritised for synthesis, including 34 randomised controlled trials conducted outside the UK and 39 studies from the UK, of which 12 were randomised controlled trials. Fifteen studies included cost-effectiveness data. The evidence was dominated by enhanced recovery protocols and prehabilitation, implemented to improve recovery from either colorectal surgery or lower limb arthroplasty. Six other surgical categories and four other intervention types were identified. Meta-analysis found that enhanced recovery protocols were associated with 1.5 days’ reduction in hospital stay among patients undergoing colorectal surgery (Cohen’sd = –0.51, 95% confidence interval –0.78 to –0.24;p < 0.001) and with 5 days’ reduction among those undergoing upper abdominal surgery (Cohen’sd = –1.04, 95% confidence interval –1.55 to –0.53;p < 0.001). Evidence from the UK was not pooled (owing to mixed study designs), but it echoed findings from the international literature. Length of stay usually was reduced with intervention or was no different. Other clinical outcomes also improved or were no worse with intervention. Patient-reported outcomes were not frequently reported. Cost and cost-effectiveness evidence came from 15 highly heterogeneous studies and was less conclusive.

Limitations

Studies were usually of moderate or weak quality. Some intervention or treatment types were under-reported or absent. The reporting of variance data often precluded secondary analysis.

Conclusions

Enhanced recovery and prehabilitation interventions were associated with reduced hospital stay without detriment to other clinical outcomes, particularly for patients undergoing colorectal surgery, lower limb arthroplasty or upper abdominal surgery. The impacts on patient-reported outcomes, health-care costs or additional service use are not well known.

Future work

Further studies evaluating of the effectiveness of new enhanced recovery pathways are not required in colorectal surgery or lower limb arthroplasty. However, the applicability of these pathways to other procedures is uncertain. Future studies should evaluate the implementation of interventions to reduce service variation, in-hospital patient-reported outcomes, impacts on health and social care service use, and longer-term patient-reported outcomes.

Study registration

This study is registered as PROSPERO CRD42017080637.

Funding

The National Institute for Health Research Health Services and Delivery Research programme.

Effects of probiotics on nonalcoholic fatty liver disease: a systematic review and meta-analysis

BACKGROUND

Nonalcoholic fatty liver disease (NAFLD) has become prevalent in recent decades, especially in developed countries, and approaches for the prevention and treatment of NAFLD are not clear. The aim of this research was to analyze and summarize randomized controlled trials that investigated the effects of probiotics on NAFLD.

METHODS

Seven databases (PubMed, Embase, the Web of Science, the Cochrane Library, China National Knowledge Infrastructure, Wan Fang Data, and VIP Database) were searched. Then, eligible studies were identified. Finally, proper data extraction, synthesis and analysis were performed by trained researchers.

RESULTS

Anthropometric parameters: with use of probiotics weight was reduced by 2.31 kg, and body mass index (BMI) was reduced by 1.08 kg/m². Liver function: probiotic treatment reduced the alanine aminotransferase level by 7.22 U/l, the aspartate aminotransferase level by 7.22 U/l, the alkaline phosphatase level by 25.87 U/l, and the glutamyl transpeptidase level by -5.76 U/l. Lipid profiles: total cholesterol, low-density lipoprotein cholesterol, and triglycerides were significantly decreased after probiotic treatment. Their overall effects (shown as standard mean difference) were -0.73, -0.54, and -0.36, respectively. Plasma glucose: probiotics reduced the plasma glucose level by 4.45 mg/dl and the insulin level by 0.63. Cytokines: probiotic treatment decreased tumor necrosis factor alpha by 0.62 and leptin by 1.14. Degree of liver fat infiltration (DFI): the related risk of probiotics for restoring DFI was 2.47 (95% confidence interval, 1.61-3.81, p < 0.001).

CONCLUSION

Probiotic treatment or supplementation is a promising therapeutic method for NAFLD.

Interventions to enhance self-efficacy in cancer patients: A meta-analysis of randomized controlled trials

OBJECTIVE

Self-efficacy expectations are associated with improvements in problematic outcomes widely considered clinically significant (ie, emotional distress, fatigue, and pain), related to positive health behaviors, and as a type of personal agency, inherently valuable. Self-efficacy expectancies, estimates of confidence to execute behaviors, are important in that changes in self-efficacy expectations are positively related to future behaviors that promote health and well-being. The current meta-analysis investigated the impact of psychological interventions on self-efficacy expectations for a variety of health behaviors among cancer patients.

METHODS

Ovid Medline, PsycINFO, CINAHL, EMBASE, Cochrane Library, and Web of Science were searched with specific search terms for identifying randomized controlled trials (RCTs) that focused on psychologically based interventions. Included studies had (a) an adult cancer sample, (b) a self-efficacy expectation measure of specific behaviors, and (c) an RCT design. Standard screening and reliability procedures were used for selecting and coding studies. Coding included theoretically informed moderator variables.

RESULTS

Across 79 RCTs, 223 effect sizes, and 8678 participants, the weighted average effect of self-efficacy expectations was estimated as g = 0.274 (P < .001). Consistent with the self-efficacy theory, the average effect for in-person intervention delivery (g = 0.329) was significantly greater than for all other formats (g = 0.154, P = .023; eg, audiovisual, print, telephone, and Web/internet).

CONCLUSIONS

The results establish the impact of psychological interventions on self-efficacy expectations as comparable in effect size with commonly reported outcomes (distress, fatigue, pain). Additionally, the result that in-person interventions achieved the largest effect is supported by the social learning theory and could inform research related to the development and evaluation of interventions.

Electronic search strategies fail to identify randomized controlled trials (RCTs) in neurosurgery

Randomized controlled trials (RCTs) are the gold standard studies to evaluate the efficacy of therapeutic interventions. Although they are frequently identified through open searches in electronic databases, no studies have evaluated how easy it is to identify RCTs in neurosurgery using electronic search strategies. The present study evaluated the sensitivity and specificity of different search strategies applied to commonly used databases to identify RCTs in neurosurgery. The total number of RCTs in neurosurgery published between 1960 and 2013 was determined through a detailed search involving open keyword searches in PubMed, Cochrane Library and Center for Reviews and Dissemination (CRD) databases, a PubMed search based on clinical entity-related keywords and hand-searches on the reference list of identified articles. The sensitivity and specificity were calculated for the open keyword searches on PubMed, the Cochrane Library and the CRD database and for the Cochrane's HSSS, based on the total number of the identified RCTs. Compared to the total of 1102 RCTs identified, PubMed open search yielded 4660 articles, among which 365 were RCTs (sensitivity: 33.1%; specificity: 7.8%). Cochrane open search yielded 621 among which 36 were RCTs (sensitivity: 3.2%; specificity: 5.8%) and CRD open search returned 78 articles, among which 4 were RCTs (sensitivity: 0.4% sensitivity; specificity: 5.1%). The Cochrane HSSS retrieved 10702 results, among which 340 were RCTs (sensitivity: 30.9%; specificity: 3.2%). Most RCTs in neurosurgery cannot be identified by commonly used search strategies, which emphasizes the need to improve their indexing.

Impact of telephone delivered case-management on the effectiveness of collaborative care for depression and anti-depressant use: A systematic review and meta-regression

BACKGROUND

The health service delivery framework collaborative care is an effective intervention for depression. However, uncertainties remain about how to optimise its delivery at scale. Structured case management is a core component of collaborative care; its delivery via the telephone may improve access.

AIMS

To examine using meta-regression if telephone delivered case management diminishes the clinical effectiveness of collaborative care on depressive symptoms and anti-depressant use relative to face-to-face delivery methods.

METHODS

Randomised controlled trials were eligible if they included collaborative care interventions for adults with depression identified using self-report measures or diagnostic interviews and reported depression outcomes. Sociodemographics, intervention characteristics, depressive symptoms, and anti-depressant use were extracted. Random effects univariable and multivariable meta-regression analyses were used to examine the moderating effect of telephone delivered case-management on outcomes.

RESULTS

Ninety-four trials were identified comprising of 103 comparisons across 24, 132 participants with depression outcomes and 67 comparisons from 15,367 participants with anti-depressant use outcomes. Telephone delivered case management did not diminish the effects of collaborative care on depressive symptoms (β = -0.01, 95% CI -0.12 to 0.10; p = 0.86). Telephone delivered case management decreased anti-depressant medication use (relative risk 0.76, 95% CI 0.63 to 0.92; p = 0.005); this effect remained when assessed simultaneously alongside other study-level moderators of collaborative care.

CONCLUSION

Using remote platforms such as the telephone to deliver case management may be a feasible way to implement collaborative care with no loss of effectiveness on depressive symptoms. However, adherence to anti-depressant medication may decrease when telephone case management is used.

Mind-body interventions for fear of cancer recurrence: A systematic review and meta-analysis

OBJECTIVE

Fear of cancer recurrence (FCR) is a common existential concern and source of distress among adults with a cancer history. Multiple randomized controlled trials (RCTs) have examined mind-body approaches to mitigating FCR. We summarized characteristics of these trials and calculated their pooled effects on decreasing FCR.

METHODS

Six electronic databases were systematically searched from inception to May 2017, using a strategy that included multiple terms for RCTs, cancer, mind-body medicine, and FCR. Data extraction and reporting followed Cochrane and Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. Pooled effect sizes on self-report measures of FCR were computed by using random-effects models.

RESULTS

Nineteen RCTs (pooled N = 2806) were included. Most studies (53%) were published since 2015 and targeted a single cancer type (84%; mostly breast). Intervention sessions (median = 6, mode = 4) tended to last 120 minutes and occur across 1.5 months. Delivery was predominantly in-person (63%) to either groups (42%) or individuals (42%). Most interventions incorporated multiple mind-body components (53%), commonly cognitive-behavioral skills (58%), or meditative practices (53%). Small-to-medium pooled effect sizes were observed postintervention (Hedges' g = -0.36, 95% CI = -0.49, -0.23, P < .001) and at follow-up assessments (median = 8 months, P < .001). Potential modifiers (control group design, group/individual delivery, use of cognitive-behavioral or mindfulness skills, number of mind-body components, cancer treatment status, and number of sessions) did not reach statistical significance.

CONCLUSIONS

Mind-body interventions are efficacious for reducing FCR, with small-to-medium effect sizes that persist after intervention delivery ends. Recommendations include testing effects among survivors of various cancers and exploring the optimal integration of mind-body practices for managing fundamental uncertainties and fears during cancer survivorship.

Effects of supervised exercise compared to non-supervised exercise early after total hip replacement on patient-reported function, pain, health-related quality of life and performance-based function – a systematic review and meta-analysis of randomized controlled trials

Background:

The rehabilitation after a total hip replacement varies in degree of supervision; however, it remains unknown whether supervised programmes are more effective than non-supervised.

Objective:

This study compared the effectiveness of supervised exercise compared to non-supervised home-based exercise after total hip replacement on patient-reported function, hip-pain, health-related quality of life and performance-based function.

Methods:

A systematic review and meta-analysis of randomized controlled trials investigating the effect of supervised exercise compared to non-supervised home-based exercise. An electronic search was performed in Medline, Embase and CINAHL on 14 March 2018. The methodological quality was assessed using the Cochrane Risk of Bias tool.

Results:

Seven studies were included with a total of 389 participants. A small and non-significant difference in favour of the supervised groups was found in patient-reported function (standardized mean difference (SMD) −0.22 (95% confidence interval (CI) −0.46 to 0.02)), hip-related pain (SMD −0.03 (95% CI −0.27 to 0.21)), health-related quality of life (mean difference (MD) −3.08 (95% CI −6.29 to 0.14)) and performance-based function (SMD −0.26 (95% CI −0.68 to 0.17)) at end of treatment and in patient-reported function (MD −1.31 (95% CI −3.79 to 1.16)) at the 6- to 12-month follow-up.

Limitations:

The literature search was systematic, but limited to three databases. The overall quality of evidence was downgraded to moderate due to lack of blinding in included studies.

Conclusion:

Supervised exercise was not significantly effective compared to non-supervised home-based exercise on patient-reported function, pain, health-related quality of life and performance-based function after primary total hip replacement.

Others:

PROSPERO registration number: CRD42017055604.

Assessing the performance of methodological search filters to improve the efficiency of evidence information retrieval: five literature reviews and a qualitative study

BACKGROUND

Effective study identification is essential for conducting health research, developing clinical guidance and health policy and supporting health-care decision-making. Methodological search filters (combinations of search terms to capture a specific study design) can assist in searching to achieve this.

OBJECTIVES

This project investigated the methods used to assess the performance of methodological search filters, the information that searchers require when choosing search filters and how that information could be better provided.

METHODS

Five literature reviews were undertaken in 2010/11: search filter development and testing; comparison of search filters; decision-making in choosing search filters; diagnostic test accuracy (DTA) study methods; and decision-making in choosing diagnostic tests. We conducted interviews and a questionnaire with experienced searchers to learn what information assists in the choice of search filters and how filters are used. These investigations informed the development of various approaches to gathering and reporting search filter performance data. We acknowledge that there has been a regrettable delay between carrying out the project, including the searches, and the publication of this report, because of serious illness of the principal investigator.

RESULTS

The development of filters most frequently involved using a reference standard derived from hand-searching journals. Most filters were validated internally only. Reporting of methods was generally poor. Sensitivity, precision and specificity were the most commonly reported performance measures and were presented in tables. Aspects of DTA study methods are applicable to search filters, particularly in the development of the reference standard. There is limited evidence on how clinicians choose between diagnostic tests. No published literature was found on how searchers select filters. Interviewing and questioning searchers via a questionnaire found that filters were not appropriate for all tasks but were predominantly used to reduce large numbers of retrieved records and to introduce focus. The Inter Technology Appraisal Support Collaboration (InterTASC) Information Specialists' Sub-Group (ISSG) Search Filters Resource was most frequently mentioned by both groups as the resource consulted to select a filter. Randomised controlled trial (RCT) and systematic review filters, in particular the Cochrane RCT and the McMaster Hedges filters, were most frequently mentioned. The majority indicated that they used different filters depending on the requirement for sensitivity or precision. Over half of the respondents used the filters available in databases. Interviewees used various approaches when using and adapting search filters. Respondents suggested that the main factors that would make choosing a filter easier were the availability of critical appraisals and more detailed performance information. Provenance and having the filter available in a central storage location were also important.

LIMITATIONS

The questionnaire could have been shorter and could have included more multiple choice questions, and the reviews of filter performance focused on only four study designs.

CONCLUSIONS

Search filter studies should use a representative reference standard and explicitly report methods and results. Performance measures should be presented systematically and clearly. Searchers find filters useful in certain circumstances but expressed a need for more user-friendly performance information to aid filter choice. We suggest approaches to use, adapt and report search filter performance. Future work could include research around search filters and performance measures for study designs not addressed here, exploration of alternative methods of displaying performance results and numerical synthesis of performance comparison results.

FUNDING

The National Institute for Health Research (NIHR) Health Technology Assessment programme and Medical Research Council-NIHR Methodology Research Programme (grant number G0901496).

Exercise in the treatment of clinical anxiety in general practice - a systematic review and meta-analysis

BACKGROUND

Anxiety disorders are common, yet treatment options in general practice are often limited to medication or CBT. There is a lack of evidence for the effectiveness of exercise in the treatment of anxiety in patients who present to general practice and also about the intensity of exercise required to lead to improvement. The aim of this systematic review was to assess the use of exercise versus waiting list control groups in the treatment of anxiety and also to assess the benefit of high intensity exercise vs low intensity exercise. Long term follow up scores were also analysed. We included patients who met diagnostic criteria for anxiety disorders or had clinically raised anxiety levels on a validated rating scale and performed a subgroup analysis of the outcomes between the two groups. The intervention was any aerobic exercise programme carried out for at least two weeks, or exercise carried out at high intensity for at least two weeks. The comparison groups were either a waiting list control group or low intensity exercise.

METHOD

Systematic review of randomised controlled trials. Three databases were searched; CENTRAL, Medline and Embase. Outcome assessment was based on validated anxiety rating scales. The quality of the studies was appraised according to the Cochrane Risk of Bias tool. Effect sizes were calculated using the standardised mean difference.

RESULTS

Fifteen studies were identified with a total of 675 patients. Nine trials had participants with diagnosed anxiety disorders and six trials had participants with raised anxiety on a validated rating scale. Aerobic exercise was effective in the treatment of raised anxiety compared to waiting list control groups (effect size - 0.41, 95% CI = - 0.70 to - 0.12). High intensity exercise programmes showed greater effects than low intensity programmes. There was no significant difference in outcomes between groups of patients with diagnosed anxiety disorders and patients who had raised anxiety on a rating scale. Conclusions were limited by the small number of studies and wide variation in the delivery of exercise interventions.

CONCLUSION

Exercise programmes are a viable treatment option for the treatment of anxiety. High intensity exercise regimens were found to be more effective than low intensity regimens. The results have implications for the use of exercise schemes in General Practice.

A Systematic Review and Meta-analysis of the Effects of Meditation on Empathy, Compassion, and Prosocial Behaviors

Increased attention has focused on methods to increase empathy, compassion, and pro-social behavior. Meditation practices have traditionally been used to cultivate pro-social outcomes, and recently investigations have sought to evaluate their efficacy for these outcomes. We conducted a systematic review and meta-analysis of meditation for pro-social emotions and behavior. A literature search was conducted in PubMed, MEDLINE, PsycINFO, CINAHL, Embase, and Cochrane databases (inception-April 2016) using the search terms: mindfulness, meditation, mind-body therapies, tai chi, yoga, MBSR, MBCT, empathy, compassion, love, altruism, sympathy, or kindness. Randomized controlled trials in any population were included (26 studies with 1,714 subjects). Most were conducted among healthy adults (n=11) using compassion or loving kindness meditation (n=18) over 8-12weeks (n=12) in a group format (n=17). Most control groups were wait-list or no-treatment (n=15). Outcome measures included self-reported emotions (e.g., composite scores, validated measures) and observed behavioral outcomes (e.g., helping behavior in real-world and simulated settings). Many studies showed a low risk of bias. Results demonstrated small to medium effects of meditation on self-reported (SMD = .40, p < .001) and observable outcomes (SMD = .45, p < .001) and suggest psychosocial and neurophysiological mechanisms of action. Subgroup analyses also supported small to medium effects of meditation even when compared to active control groups. Clinicians and meditation teachers should be aware that meditation can improve positive pro-social emotions and behaviors.

Advances in the treatment of anorexia nervosa: a review of established and emerging interventions

BACKGROUND

Anorexia nervosa (AN) is a disabling, deadly and costly mental disorder. Until recently, treatment recommendations were based on expert opinion and limited evidence. The aim of this systematic review is to synthesise recent evidence on established and emerging AN treatments and to forecast trends for future developments.

METHODS

We systematically review trials of established treatments and associated process outcome studies from the last 5 years, published since a previous review in this journal. 'Established' treatments were those that are widely used in AN, recommended by guidelines and/or have been tested in at least one large randomised controlled trial. Secondly, we summarise emerging treatments for AN, i.e. those that have only been (or are currently being) tested in proof-of concept, feasibility or pilot trials.

RESULTS

We identified 19 published trials of established treatments (15 of high or moderate quality), mostly assessing psychological therapies (n = 17). We also found 11 published trials of emerging treatments, and a total of 34 registered, as yet unpublished trials. Promising emerging treatments include cognitive remediation therapy, exposure therapy and non-invasive neuromodulation.

CONCLUSIONS

Evidence generation on the treatment of AN has dramatically accelerated, with our understanding of the role of family-based approaches for adolescents more nuanced and a range of psychological approaches available for the treatment of adults. Evidence on emerging treatments and from forthcoming trials suggests that there is a shift towards more targeted brain-based interventions. Future studies need to focus on elucidating mechanisms of action of treatments and what works best for whom.

Do Exercise Interventions Improve Participation in Life Roles in Older Adults? A Systematic Review and Meta-Analysis

Background

The World Health Organization recognizes participation in meaningful life roles as a key component of health. However, the evidence base for interventions to improve participation remains inconclusive. In particular, whether exercise interventions improve participation in life roles is unclear.

Purpose

The aim of this review was to evaluate the effect of physical exercise interventions on participation in life roles in older adults residing in the community.

Data sources

The PubMed, Embase, CINAHL, Cochrane, and PEDro databases were searched from inception through March 2015.

Study selection

Randomized controlled trials comparing the effects of an exercise intervention to usual care on participation in life roles in adults who were 60 years of age or older were included in this review.

Data extraction

Teams of 2 investigators independently extracted data on participation. Methodological quality was appraised using the Cochrane tool for assessing the risk of bias. The protocol was registered with Prospero (CRD42014014880).

Data synthesis

Eighteen randomized controlled trials with a total of 2,315 participants met the inclusion criteria. Standardized mean differences (SMDs) with 95% CIs were calculated using a random-effects model. A meta-analysis of 16 studies showed no overall effect of the exercise interventions on participation (SMD = 0.03; 95% CI = -0.10 to 0.16). Subgroup analysis showed that exercise interventions lasting 12 months or more had a small positive effect on participation (SMD = 0.15; 95% CI = 0.02 to 0.28).

Limitations

Limitations included variability in definitions and measures of participation.

Conclusions

In general, exercise interventions do not improve participation in life roles in older adults. The results do not support the implicit assumption that exercise-based interventions associated with improved function/activity also result in improved participation. Investigation of complex interventions that go beyond exercise to address participation in life roles for older adults is warranted.

Characteristics of effective collaborative care for treatment of depression: a systematic review and meta-regression of 74 randomised controlled trials

BACKGROUND

Collaborative care is a complex intervention based on chronic disease management models and is effective in the management of depression. However, there is still uncertainty about which components of collaborative care are effective. We used meta-regression to identify factors in collaborative care associated with improvement in patient outcomes (depressive symptoms) and the process of care (use of anti-depressant medication).

METHODS AND FINDINGS

Systematic review with meta-regression. The Cochrane Collaboration Depression, Anxiety and Neurosis Group trials registers were searched from inception to 9th February 2012. An update was run in the CENTRAL trials database on 29th December 2013. Inclusion criteria were: randomised controlled trials of collaborative care for adults ≥18 years with a primary diagnosis of depression or mixed anxiety and depressive disorder. Random effects meta-regression was used to estimate regression coefficients with 95% confidence intervals (CIs) between study level covariates and depressive symptoms and relative risk (95% CI) and anti-depressant use. The association between anti-depressant use and improvement in depression was also explored. Seventy four trials were identified (85 comparisons, across 21,345 participants). Collaborative care that included psychological interventions predicted improvement in depression (β coefficient -0.11, 95% CI -0.20 to -0.01, p = 0.03). Systematic identification of patients (relative risk 1.43, 95% CI 1.12 to 1.81, p = 0.004) and the presence of a chronic physical condition (relative risk 1.32, 95% CI 1.05 to 1.65, p = 0.02) predicted use of anti-depressant medication.

CONCLUSION

Trials of collaborative care that included psychological treatment, with or without anti-depressant medication, appeared to improve depression more than those without psychological treatment. Trials that used systematic methods to identify patients with depression and also trials that included patients with a chronic physical condition reported improved use of anti-depressant medication. However, these findings are limited by the observational nature of meta-regression, incomplete data reporting, and the use of study aggregates.

Efficiency and contribution of strategies for finding randomized controlled trials: a case study from a systematic review on therapeutic interventions of chronic depression

Background

Identifying all existing evidence is a crucial aspect in conducting systematic reviews. Since the retrieval of electronic database searches alone is limited, guidelines recommend the use of additional search strategies. The aim of this investigation was to assess the efficiency and contribution of additional search strategies for identifying randomized controlled trials in conducting a systematic review on interventions after performing a sensitive electronic database search.

Design and Methods

Seven electronic databases, 3 journals and 11 systematic reviews were searched. All first authors of the included studies were contacted; citation tracking and a search in clinical trial registers were performed. A priori defined evaluation criteria were calculated for each search strategy.

Results

A total of 358 full-text articles were identified; 50 studies were included in the systematic review, wherefrom 84.0% (42) were acquired by the sensitive electronic database search and 16.0% (8) through additional search strategies. Screening reference lists of related systematic reviews was the most beneficial additional search strategy, with an efficiency of 31.3% (5) and a contribution of 10.0% (5/50), whereas hand-searching and author contacts contributed two and one additional studies, respectively. Citation tracking and searching clinical trial registers did not lead to any further inclusion of primary studies.

Conclusions

Based on our findings, hand-searching contents of relevant journals and screening reference lists of related systematic reviews may be helpful additional strategies to identify an extensive body of evidence. In case of limited resources, a sensitive electronic database search may constitute an appropriate alternative for identifying relevant trials.

Value of databases other than medline for rapid health technology assessments

OBJECTIVES

The objective of this study was to explore the degree to which databases other than MEDLINE contribute studies relevant for inclusion in rapid health technology assessments (HTA).

METHODS

We determined the extent to which the clinical, economic, and social studies included in twenty-one full and four rapid HTAs published by three Canadian HTA agencies from 2007 to 2012 were indexed in MEDLINE. Other electronic databases, including EMBASE, were then searched, in sequence, to assess whether or not they indexed studies not found in MEDLINE. Assessment topics ranged from purely clinical (e.g., drug-eluting stents) to those with broader social implications (e.g., spousal violence).

RESULTS

MEDLINE contributed the majority of studies in all but two HTA reports, indexing a mean of 89.6 percent of clinical studies across all HTAs, and 88.3 percent of all clinical, economic, and social studies in twenty-four of twenty-five HTAs. While EMBASE contributed unique studies to twenty-two of twenty-five HTAs, three rapid HTAs did not include any EMBASE studies. In some instances, PsycINFO and CINAHL contributed as many, if not more, non-MEDLINE studies than EMBASE.

CONCLUSIONS

Our findings highlight the importance of assessing the topic-specific relative value of including EMBASE, or more specialized databases, in HTA search protocols. Although MEDLINE continues to be a key resource for HTAs, the time and resource limitations inherent in the production of rapid HTAs require that researchers carefully consider the value and limitations of other information sources to identify relevant studies.

Telephone based self-management support by 'lay health workers' and 'peer support workers' to prevent and manage vascular diseases: a systematic review and meta-analysis

Background

Improved prevention and management of vascular disease is a global priority. Non-health care professionals (such as, ‘lay health workers’ and ‘peer support workers’) are increasingly being used to offer telephone support alongside that offered by conventional services, to reach disadvantaged populations and to provide more efficient delivery of care. However, questions remain over the impact of such interventions, particularly on a wider range of vascular related conditions (such as, chronic kidney disease), and it is unclear how different types of telephone support impact on outcome. This study assessed the evidence on the effectiveness and cost-effectiveness of telephone self-management interventions led by ‘lay health workers’ and ‘peer support workers’ for patients with vascular disease and long-term conditions associated with vascular disease.

Methods

Systematic review of randomised controlled trials. Three electronic databases were searched. Two authors independently extracted data according to the Cochrane risk of bias tool. Random effects meta-analysis was used to pool outcome measures.

Results

Ten studies were included, primarily based in community settings in the United States; with participants who had diabetes; and used ‘peer support workers’ that shared characteristics with patients. The included studies were generally rated at risk of bias, as many methodological criteria were rated as ‘unclear’ because of a lack of information.

Overall, peer telephone support was associated with small but significant improvements in self-management behaviour (SMD = 0.19, 95% CI 0.05 to 0.33, I² = 20.4%) and significant reductions in HbA1c level (SMD = -0.26, 95% CI −0.41 to −0.11, I² = 47.6%). There was no significant effect on mental health quality of life (SMD = 0.03, 95% CI −0.12 to 0.18, I² = 0%). Data on health care utilisation were very limited and no studies reported cost effectiveness analyses.

Conclusions

Positive effects were found for telephone self-management interventions via ‘lay workers’ and ‘peer support workers’ for patients on diabetes control and self-management outcomes, but the overall evidence base was limited in scope and quality. Well designed trials assessing non-healthcare professional delivered telephone support for the prevention and management of vascular disease are needed to identify the content of effective components on health outcomes, and to assess cost effectiveness, to determine if such interventions are potentially useful alternatives to professionally delivered care.

Characteristics of psychological interventions that improve depression in people with coronary heart disease: a systematic review and meta-regression

OBJECTIVE

Despite previous intervention trials, it is unclear which psychological treatments are most effective for people with coronary heart disease (CHD). We have conducted a systematic review with meta-regression to identify the characteristics of psychological interventions that improve depression and depressive symptoms among people with CHD.

METHODS

Searches of multiple electronic databases up to March 2012 were conducted, supplemented by hand-searching of identified reviews and citation tracing of eligible studies. Studies were included if they reported a randomized controlled trial of a psychological intervention for people with CHD and included depression as an outcome. Data on main effects and characteristics of interventions were extracted from eligible studies. Standardized mean differences (SMDs) were calculated for each study and pooled using random-effects models. Random-effects multivariate meta-regression was performed to identify treatment characteristics associated with improvements in depression.

RESULTS

Sixty-four independent treatment comparisons were identified. Psychological interventions improved depression, although the effect was small (SMD=0.18, p<.001). Problem solving (SMD=0.34), general education (SMD=0.19), skills training (SMD=0.25), cognitive-behavioral therapy (CBT; SMD=0.23), and relaxation (SMD=0.15) had small effects on CHD patients who were recruited irrespective of their depression status. Among high-quality trials of depressed CHD patients, only CBT showed significant but small effects (SMD=0.31). When entered into multivariable analysis, no individual treatment component significantly improved depression.

CONCLUSIONS

CBT and problem solving should be considered for inclusion in future treatment developments and randomized controlled trials. However, the effects are small in magnitude, and there is room to develop new interventions that may be more effective.

Identifying psychosocial interventions that improve both physical and mental health in patients with diabetes: a systematic review and meta-analysis

OBJECTIVE

Patients with diabetes suffer high rates of mental health problems, and this combination is associated with poor outcomes. Although effective treatments exist for both diabetes and mental health problems, delivering services for physical and mental health problems separately ignores their interaction and may be inefficient. This systematic review sought to identify psychosocial interventions that could improve both the physical and mental health of patients with diabetes.

RESEARCH DESIGN AND METHODS

Studies were identified from the following databases: CENTRAL, MEDLINE, Excerpta Medica (EMBASE), Psychinfo, and Cumulative Index to Nursing and Allied Health Literature (CINAHL). The review included randomized controlled trials in patients with type 1 and type 2 diabetes who received psychosocial interventions and where both mental health and physical health outcomes were reported. Data were extracted on study quality, the content and process of interventions, and outcomes.

RESULTS

Eighty-five eligible comparisons were identified, of which 49 reported sufficient data for analysis. Psychosocial interventions modestly improved A1C (standardized mean difference -0.29 [95% CI -0.37 to -0.21]) and mental health outcomes (-0.16 [-0.25 to -0.07]). However, there was a limited association between the effects on A1C and mental health, and no intervention characteristics predicted benefit on both outcomes.

CONCLUSIONS

Managing physical and mental health in long-term conditions are increasingly important. The review did not identify types of interventions that consistently provide benefits for both physical and mental health. Developing such interventions remains an important challenge. The findings have implications for understanding the interaction between physical and mental health problems and for the coordination of care.

Enhancing access to reports of randomized trials published world-wide--the contribution of EMBASE records to the Cochrane Central Register of Controlled Trials (CENTRAL) in The Cochrane Library

Background

Randomized trials are essential in assessing the effects of healthcare interventions and are a key component in systematic reviews of effectiveness. Searching for reports of randomized trials in databases is problematic due to the absence of appropriate indexing terms until the 1990s and inconsistent application of these indexing terms thereafter.

Objectives

The objectives of this study are to devise a search strategy for identifying reports of randomized trials in EMBASE which are not already indexed as trials in MEDLINE and to make these reports easily accessible by including them in the Cochrane Central Register of Controlled Trials (CENTRAL) in The Cochrane Library, with the permission of Elsevier, the publishers of EMBASE.

Methods

A highly sensitive search strategy was designed for EMBASE based on free-text and thesaurus terms which occurred frequently in the titles, abstracts, EMTREE terms (or some combination of these) of reports of trials indexed in EMBASE. This search strategy was run against EMBASE from 1980 to 2005 (1974 to 2005 for four of the terms) and records retrieved by the search, which were not already indexed as randomized trials in MEDLINE, were downloaded from EMBASE, printed and read. An analysis of the language of publication was conducted for the reports of trials published in 2005 (the most recent year completed at the time of this study).

Results

Twenty-two search terms were used (including nine which were later rejected due to poor cumulative precision). More than a third of a million records were downloaded and scanned and approximately 80,000 reports of trials were identified which were not already indexed as randomized trials in MEDLINE. These are now easily identifiable in CENTRAL, in The Cochrane Library. Cumulative sensitivity ranged from 0.1% to 60% and cumulative precision ranged from 8% to 61%. The truncated term 'random$' identified 60% of the total number of reports of trials but only 35% of the more than 130,000 records retrieved by this term were reports of trials. The language analysis for the sample year 2005 indicated that of the 18,427 reports indexed as randomized trials in MEDLINE, 959 (5%) were in languages other than English. The EMBASE search identified an additional 658 reports in languages other than English, of which the highest number were in Chinese (320).

Conclusion

The results of the search to date have greatly increased access to reports of trials in EMBASE, especially in some languages other than English. The search strategy used was subjectively derived from a small 'gold standard' set of test records and was not validated in an independent test set. We intend to design an objectively-derived validated search strategy using logistic regression based on the frequency of occurrence of terms in the approximately 80,000 reports of randomized trials identified compared with the frequency of these terms across the entire EMBASE database.

Can the feedback of patient assessments, brief training, or their combination, improve the interpersonal skills of primary care physicians? A systematic review

BACKGROUND

Improving quality of primary care is a key focus of international health policy. Current quality improvement efforts place a large focus on technical, clinical aspects of quality, but a comprehensive approach to quality improvement should also include interpersonal care. Two methods of improving the quality of interpersonal care in primary care have been proposed. One involves the feedback of patient assessments of interpersonal care to physicians, and the other involves brief training and education programmes. This study therefore reviewed the efficacy of (i) feedback of real patient assessments of interpersonal care skills, (ii) brief training focused on the improvement of interpersonal care (iii) interventions combining both (i) and (ii)

METHODS

Systematic review of randomised controlled trials. Three electronic databases were searched (CENTRAL, Medline and Embase) and augmented by searches of the bibliographies of retrieved articles. The quality of studies was appraised and results summarised in narrative form.

RESULTS

Nine studies were included (two patient based feedback studies and seven brief training studies). Of the two feedback studies, one reported a significant positive effect. Only one training study reported a significant positive effect.

CONCLUSION

There is limited evidence concerning the effects of patient based feedback. There is reasonable evidence that brief training as currently delivered is not effective, although the evidence is not definitive, due to the small number of trials and the variation in the training methods and goals. The lack of effectiveness of these methods may reflect a number of issues, such as differences in the effectiveness of the interventions in experienced practitioners and those in training, the lack of theory linking feedback to behaviour change, failure to provide sufficient training or to use a comprehensive range of behaviour change techniques. Further research into both feedback and brief training interventions is required before these interventions are routinely introduced to improve patient satisfaction with interpersonal care in primary care. The interventions to be tested in future research should consider using insights from the wider literature on communication outside primary care, might benefit from a clearer theoretical basis, and should examine the use of combined brief training and feedback.

What makes self-help interventions effective in the management of depressive symptoms? Meta-analysis and meta-regression

BACKGROUND

Although self-help interventions are effective in treating depression, less is known about the factors that determine effectiveness (i.e. moderators of effect). This study sought to determine whether the content of self-help interventions, the study populations or aspects of study design were the most important moderators.

METHOD

Randomized trials of the effectiveness of self-help interventions versus controls in the treatment of depressive symptoms were identified using previous reviews and electronic database searches. Data on moderators (i.e. patient populations, study design, intervention content) and outcomes were extracted and analysed using meta-regression.

RESULTS

Thirty-four studies were identified with 39 comparisons. Study design factors associated with greater effectiveness were unclear allocation concealment, observer-rated outcome measures and waiting-list control groups. Greater effectiveness was also associated with recruitment in non-clinical settings, patients with existing depression (rather than those 'at risk'), contact with a therapist (i.e. guided self-help) and the use of cognitive behavioural therapy (CBT) techniques. However, only guided self-help remained significant in the multivariate analysis [regression coefficient 0.36, 95% confidence interval (CI) 0.05-0.68, p=0.03]. In the subset of guided studies, there were no significant associations between outcomes and the session length, content, delivery mode or therapist background.

CONCLUSIONS

The results provide some insights into moderators of self-help interventions, which might assist in the design of future interventions. However, the present study did not provide a comprehensive description, and other research methods might be required to identify factors associated with the effectiveness of self-help.

Association of study type, sample size, and follow-up length with type of recommendation produced by the National Institute for Health and Clinical Excellence Interventional Procedures Programme

OBJECTIVES

The association between type and amount of clinical evidence and type of National Institute for Health and Clinical Excellence recommendations for interventional procedures was examined.

METHODS

The evidence about 736 studies (including 183,729 patients) relating to 130 different interventional procedures and about relevant recommendations was analyzed. Associations were examined between type of recommendation ("normal arrangements" or "cautionary guidance") and evidence type, total number of treated patients, and mean follow-up length. Evidence type was categorized as (a) randomized, (b) nonrandomized controlled, and (c) case series/reports. The main outcome measures were frequency of evidence type, total number of patients treated, and mean follow-up length, by type of recommendation.

RESULTS

"Normal arrangements" recommendations were made for 70 (54 percent) procedures and "cautionary guidance" was issued for 60 (46 percent) procedures. Procedures supported by at least one randomized study (34 percent, n = 44) were more likely to receive a "normal arrangements" recommendation (relative risk 1.38, p = .063). Overall, there were 85 (12 percent), 135 (18 percent), and 516 (70 percent) studies in categories a-c, respectively. The number of treated patients was significantly larger among procedures with "normal arrangements" (median, 605; range, 26-6,842) than among those with "cautionary guidance" (median, 240; range, 1-3,261; p < .001) recommendation. Mean follow-up length was longer in studies relating to procedures with "normal arrangements" recommendation (median, 16.7; range, 0-84 months) compared with those with "cautionary guidance" (median, 14.6; range, 0-67 months; p = .160).

CONCLUSIONS

Procedures supported by randomized studies, and with larger numbers of patients and longer follow-up length, were more likely to receive positive guidance. Future research and development on interventional procedures should aim to produce better and more relevant evidence to optimize the possibility of such procedures being accepted by policy makers.

Identifying observational studies of surgical interventions in MEDLINE and EMBASE

BACKGROUND

Health technology assessments of surgical interventions frequently require the inclusion of non-randomised evidence. Literature search strategies employed to identify this evidence often exclude a methodological component because of uncertainty surrounding the use of appropriate search terms. This can result in the retrieval of a large number of irrelevant records. Methodological filters would help to minimise this, making literature searching more efficient.

METHODS

An objective approach was employed to develop MEDLINE and EMBASE filters, using a reference standard derived from screening the results of an electronic literature search that contained only subject-related terms. Candidate terms for MEDLINE (N = 37) and EMBASE (N = 35) were derived from examination of the records of the reference standard. The filters were validated on two sets of studies that had been included in previous health technology assessments.

RESULTS

The final filters were highly sensitive (MEDLINE 99.5%, EMBASE 100%, MEDLINE/EMBASE combined 100%) with precision ranging between 16.7%-21.1%, specificity 35.3%-43.5%, and a reduction in retrievals of over 30%. Against the validation standards, the individual filters retrieved 85.2%-100% of records. In combination, however, the MEDLINE and EMBASE filters retrieved 100% against both validation standards with a reduction in retrieved records of 28.4% and 30.1%

CONCLUSION

The MEDLINE and EMBASE filters were highly sensitive and substantially reduced the number of records retrieved, indicating that they are useful tools for efficient literature searching.