Best Practice Guidelines and Essential Methodological Steps to Conduct Rigorous and Systematic Meta-Reviews

A meta-review of screening and treatment of electronic "addictions"

Concerns surrounding electronic addictions, an umbrella term including any clinically significant technology-based addictive problem, have increased as technology has advanced. Although researchers and clinicians have observed detrimental effects associated with excessive technology use, there is no agreed-on definition or set of criteria for these problems. The lack of a consistent understanding of electronic addictions has led to a lack of consistency in both assessment and treatment studies, precluding strong recommendations for effective screening and clinical intervention. This meta-review integrates findings from 22 systematic reviews and meta-analyses of electronic addictions to determine which measures and interventions may effectively measure and treat electronic addictions. We conducted a meta-review using Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. Findings suggest that although some measures may have good internal consistency and reliability among college students, there was a general lack of consistency in how measures were used across studies, making comparison difficult. Psychological and exercise-based interventions were shown to reduce symptoms of electronic addictions short-term, but no treatment was superior to others in overall symptom reduction. Most included reviews raise serious concerns about the lack of consensus on what constitutes an electronic addiction. Consequently, it was not possible to draw conclusions about the overall efficacy of any measurement tools or interventions. We provide suggestions for next steps to establish the phenomenology of electronic addictions before additional research on assessment and intervention is conducted.

Platelet rich plasma for facial rejuvenation: an overview of systematic reviews

BACKGROUND

Platelet-rich plasma (PRP) as a non-surgical therapy for facial rejuvenation is increasingly adopted. This article aims to review the literature and critically appraise the available evidence regarding the efficacy and safety of PRP for facial rejuvenation.

MATERIAL AND METHODS

An overview of systematic reviews (SRs) of PRP use for facial rejuvenation. The methodological quality of the SRs was assessed using the AMSTAR-2 checklist; quality of the evidence from the trials included in each SR was appraised following the GRADE approach.

RESULTS

Thirteen SRs published between 2015 and 2023, reporting data from 114 overlapping reports, based on 28 individual primary studies (18 uncontrolled reports), were included in this umbrella review. Eight primary studies evaluated PRP in combination with other treatments (laser therapy, fat grafting, hyaluronic acid, basic fibroblast growth factor), and 20 PRP monotherapy. Most of the included primary studies were uncontrolled, and meta-analysis for outcomes related to facial rejuvenation was conducted in only 1 of the 13 SRs, showing that patients treated with PRP as an adjunct treatment have increased satisfaction over controls without PRP (mean difference, 0.63; 95% confidence intervals (CIs) 0.25/1; p=0-001; low certainty of evidence due to risk of bias (ROB) and inconsistency). No other quantitative data were available from the SRs, although 4 SRs concluded in a descriptive way reveal that PRP combined with laser therapy increased subject satisfaction and skin elasticity, and decreased the erythema index (very low certainty of evidence due to imprecision, unsystematic clinical observations, and ROB). The occurrence of adverse events was a predefined outcome in only 2 SRs (15%). Almost all the SRs demonstrated poor compliance with the AMSTAR 2 items, and the confidence in the results of SRs was graded as low or critically low in 12 of the 13 SRs.

DISCUSSION

The available evidence is insufficient to suggest firm conclusions about the use of PRP, alone or in combination with other treatments, in promoting facial rejuvenation.

Uncertainty in tuberculosis clinical decision-making: An umbrella review with systematic methods and thematic analysis

Tuberculosis is a major infectious disease worldwide, but currently available diagnostics have suboptimal accuracy, particularly in patients unable to expectorate, and are often unavailable at the point-of-care in resource-limited settings. Test/treatment decision are, therefore, often made on clinical grounds. We hypothesized that contextual factors beyond disease probability may influence clinical decisions about when to test and when to treat for tuberculosis. This umbrella review aimed to identify such factors, and to develop a framework for uncertainty in tuberculosis clinical decision-making. Systematic reviews were searched in seven databases (MEDLINE, CINAHL Complete, Embase, Scopus, Cochrane, PROSPERO, Epistemonikos) using predetermined search criteria. Findings were classified as barriers and facilitators for testing or treatment decisions, and thematically analysed based on a multi-level model of uncertainty in health care. We included 27 reviews. Study designs and primary aims were heterogeneous, with seven meta-analyses and three qualitative evidence syntheses. Facilitators for decisions to test included providers' advanced professional qualification and confidence in tests results, availability of automated diagnostics with quick turnaround times. Common barriers for requesting a diagnostic test included: poor provider tuberculosis knowledge, fear of acquiring tuberculosis through respiratory sampling, scarcity of healthcare resources, and complexity of specimen collection. Facilitators for empiric treatment included patients' young age, severe sickness, and test inaccessibility. Main barriers to treatment included communication obstacles, providers' high confidence in negative test results (irrespective of negative predictive value). Multiple sources of uncertainty were identified at the patient, provider, diagnostic test, and healthcare system levels. Complex determinants of uncertainty influenced decision-making. This could result in delayed or missed diagnosis and treatment opportunities. It is important to understand the variability associated with patient-provider clinical encounters and healthcare settings, clinicians' attitudes, and experiences, as well as diagnostic test characteristics, to improve clinical practices, and allow an impactful introduction of novel diagnostics.

Technology-based suicide prevention: An umbrella review

Background

The objective is to summarize evidence from systematic reviews, scoping reviews, and meta-analyses evaluating the effects of any format of Internet-based, mobile-, or telephone-based intervention as a technology-based intervention in suicide prevention.

Materials and Methods

This is an umbrella review, that followed Preferred Reporting Items for Systematic Reviews and Meta-Analyses 2020 statement guidelines. An electronic search was done on September 29, 2022. Data were extracted by reviewers and then methodological quality and risk of bias were assessed by A Measurement Tool to Assess Systematic Reviews-2. Statistical analysis was done by STATA version 17. Standard mean difference was extracted from these studies and by random effect model, the overall pooled effect size (ES) was calculated. I2 statistic was used to assess the heterogeneity between studies. For publication bias, the Egger test was used.

Results

Six reviews were included in our study, all with moderate quality. The overall sample size was 24631. The ES for standard mean differences of the studies is calculated as - 0.20 with a confidence interval of (-0.26, -0.14). The heterogeneity is found as 58.14%, indicating a moderate-to-substantial one. The Egger test shows publication bias.

Conclusion

Our results show that technology-based interventions are effective. We propose more rigorous randomized controlled trials with different control groups to assess the effectiveness of these interventions.

Melatonin improves fertilization rate in assisted reproduction: Systematic review and meta-analysis

BACKGROUND

Melatonin is a hormone produced by the pineal gland and it has antioxidant properties.

AIM

This study aimed to evaluate the effects of melatonin on assisted reproductive technologies through a systematic review and a meta-analysis.

MATERIALS AND METHODS

Search strategies were used in PubMed and in other databases covering the last 15 years. After screening for eligibility, 17 articles were selected for the systematic review. For the meta-analysis statistics, two groups were formed, the treatment group (with melatonin) and the control group (without melatonin) for various assisted reproduction outcomes.

RESULTS

The main results were that no statistical differences were found concerning the clinical pregnancy outcome (p = 0.64), but there was a statistical difference with respect to Mature Oocytes (MII) (p = 0.001), antral follicle count (p = 0.0002), and the fertilization rate (p ≤ 0.0001).

CONCLUSIONS

Melatonin had beneficial effects such as the improvement in the fertilization rate, although the authors did not obtain significance in the clinical pregnancy rate.

A Meta-Review to Guide Military Screening and Treatment of Gambling Problems

INTRODUCTION

Excessive gambling can cause substantial biopsychosocial problems (e.g., difficulties with finances, relationships, mental, and physical health). For military Service Members, it can also result in security clearance denial or revocation, failure to achieve promotions, and premature career termination. Recent congressional mandates have obligated the U.S. Department of Defense to screen for problematic gambling, the predictive values of which are a function of (i) problem prevalence and (ii) tool sensitivity and specificity. This meta-review (i.e., systematic review of systematic reviews) on the screening properties of gambling assessment tools and the effectiveness of treatments for gambling disorder is to inform military services on responding to Service Members' gambling problems.

MATERIALS AND METHODS

EBSCO Discovery Service, PubMed, PsycINFO, Ovid Medline, Social Care Online, Epistemonikos, International Health Technology Assessment, and the Cochrane Central Register of Controlled Trials electronic databases were searched up to December 2022 for systematic reviews and meta-analyses on measurements of adult subclinical or gambling, and interventions targeting individuals with GD. Three and four studies were included in each section of the current meta-review (i.e., assessment tools and treatment). For review 1, the estimated risk of bias was assessed using the Risk of Bias in Systematic Reviews.

RESULTS

Thirty-one tools were identified through the three systematic reviews. All had modest sensitivities and specificities; combined with low prevalences in the general SM population, positive results would be incorrect 64-99% of the time. However, if screening were conducted with SMs referred for alcohol problems, a positive result on the best screening tools would be correct 76% of the time. Several commonly used treatment approaches had demonstrated efficacy for GD.

CONCLUSIONS

The combination of low prevalence of GD and subclinical gambling problems in the general population, coupled with modest sensitivity and specificity, makes screening unfeasible in the general SM population. However, dual-phase screening in higher-prevalence subpopulations (i.e., SMs already identified with substance-abuse or mental-health problems) would be viable. Regarding treatment, several interventions-already used in military healthcare-with extensive empirical track records have been successfully used to treat adults with GD.

Systematic review and meta-analysis of physical activity interventions to increase elementary children's motor competence: a comprehensive school physical activity program perspective

BACKGROUND

Regular participation in physical activity (PA) benefits children's health and well-being and protects against the development of unhealthy body weight. A key factor in children's PA participation is their motor competence (MC). The comprehensive school physical activity program (CSPAP) framework offers a way to classify existing PA interventions that have included children's MC development and understand the potential avenues for supporting children's MC. However, there have been no systematic reviews or meta-analyses of PA interventions and their effects on the MC of elementary school children (aged 5-12 years) from a CSPAP perspective.

METHODS

This study was conducted in accordance with the Preferred Reporting Items for Systematic Review and Meta-Analysis (PRISMA) statement. We searched seven electronic databases (PubMed/Medline, Embase, ERIC, SPORTDiscus, CINAHL, Web of Science, and PsycINFO) for articles on 29 November 2021. The CSPAP framework was used to categorize the different intervention approaches. This review was registered with PROSPERO (CRD42020179866).

RESULTS

Twenty-seven studies were included in the review, and twenty-six studies were included in the meta-analysis. A wide range of PA intervention approaches (e.g., single component or multicomponent) within the context of the CSPAP framework appear to be promising pathways in enhancing children's MC. The results of the aggregate meta-analysis presented that effect sizes for the development of MC from pre-and post- intervention ranged from moderate to large (Hedges' g = 0.41-0.79). The analysis revealed that the predicted moderators, including study length, delivery agent, and study design, did not result in statistically significant moderate variations in MC outcomes. There was, however, considerable heterogeneity in study design, instruments, and study context, and studies were implemented in over 11 countries across diverse settings.

CONCLUSIONS

This study uniquely contributes to the literature through its primary focus on the effectiveness of PA interventions on elementary children's MC. This review emphasizes the importance of customizing CSPAP to fit the specific characteristics of each school setting, including its environmental, demographic, and resource attributes. The effectiveness of CSPAP, particularly its physical education (PE) component, is significantly enhanced when these programs are adapted to address the unique needs of each school. This adaptation can be effectively achieved through targeted professional teacher training, ensuring that PE programs are not only contextually relevant but also optimized for maximum impact in diverse educational environments. Researchers and practitioners should pursue how to effectively translate the evidence into practice to better conceptualize CSPAPs designed for children's MC development.

State of the art of the literature on definitions of self-criticism: a meta-review

Background

Several authors have developed important theoretical models on an important transdiagnostic factor in psychopathology: self-criticism (SC). Currently, there are substantial variations in the theoretical definition of SC. The lack of awareness of similarities and differences between models may in turn impact the comparison between empirical results, limiting their clinical implications.

Purpose

The purpose of this study was to identify current trends in the field of SC and to explore whether these were approached and shaped by different conceptualizations of SC.

Methods

Core components of the most influential models of SC were identified. A meta-review was conducted searching for systematic reviews and/or meta-analyses in the following databases: PsycINFO, PsycARTICLES, MEDLINE, Scopus, Web of Science, and PubMed (all years up to 28 April 2023).

Results

Contributions were heterogeneous with respect to the definition of SC and the theoretical framework. Almost all systematic reviews poorly addressed the multidimensionality of SC. In addition, discrepancies between the definitions of SC provided and their operationalizations emerged.

Conclusions

The lack of dialogue between the different theoretical perspectives emerged from key contributions in the field of SC. Potential research questions to answer to stimulate this dialogue are proposed.

Disease-Related Stigma, Stigmatizers, Causes, and Consequences: A Systematic Review

Background

Stigma is a sociological concept that is important in medicine and health because it threatens health as much as the disease itself. We aimed to explore the causes, stigmatizers, consequences and coping strategies related to the stigma of diseases by systematically analyzing relevant literature.

Methods

This systematic review examined 65 articles on Disease-Related Stigma by searching Noormags, Magiran, SID, Google Scholar, and PubMed databases. The articles were published in Persian and English between 2001 and 2022 and conducted in Iran. We used a three-step systematic review process to select articles that met the research criteria.

Results

Conflict in society, lack of knowledge, specific characteristics of the disease, and the contagious nature of disease are the main causes of stigma, leading to stigmatization by different groups such as significant others, generalized others, institutional others, and macro others. Patients experiencing stigma face various psychological, physical, and social complications, and they may use concealment as a coping strategy, which can pose a potential threat to society's general health.

Conclusion

By knowing the causes and stigmatizers of disease-related, it is possible to reduce stigma with less cost and time.

Non-pharmacological interventions for the management of perinatal anxiety in primary care: a meta-review of systematic reviews

BACKGROUND

Perinatal anxiety (PNA), anxiety that occurs during pregnancy and/or up to 12 months postpartum, is estimated to affect up to 21% of women, and may impact negatively on mothers, children, and their families. The National Institute for Health and Care Excellence (NICE) has called for further research around non-pharmacological interventions in primary care for PNA.

AIM

To summarise the available international evidence on non-pharmacological interventions for women with PNA in a primary care population.

DESIGN & SETTING

A meta-review of systematic reviews (SRs) with narrative synthesis was performed following Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidance.

METHOD

Systematic literature searches were conducted in 11 health-related databases up to June 2022. Titles, abstracts, and full-text articles were dual-screened against pre-defined eligibility criteria. A variety of study designs were included. Data were extracted about study participants, intervention design, and context. Quality appraisal was performed using the AMSTAR 2 tool (A MeaSurement Tool to Assess systematic Reviews). A patient and public involvement group informed and contributed towards this meta-review.

RESULTS

Twenty-four SRs were included in the meta-review. Interventions were grouped into the following six categories for analysis purposes: psychological therapies; mind-body activities; emotional support from healthcare professionals (HCPs); peer support; educational activities; and alternative or complementary therapies.

CONCLUSION

In addition to pharmacological and psychological therapies, this meta-review has demonstrated that there are many more options available for women to choose from that might be effective to manage their PNA. Evidence gaps are present in several intervention categories. Primary care clinicians and commissioners should endeavour to provide patients with a choice of these management options, promoting individual choice and patient-centred care.

Exercise training and experimental myocardial ischemia and reperfusion: A systematic review and meta-analysis

Background

Despite the success of interventional coronary reperfusion strategies, morbidity and mortality from acute myocardial infarction are still substantial. Physical exercise is a well-recognized effective non-pharmacological therapy for cardiovascular diseases. Therefore, the objective of this systematic review was to analyze studies in animal models of ischemia-reperfusion in association with physical exercise protocols.

Search strategy

Articles published on the topic over a 13-year period (2010-2022) were searched in two databases (PubMed and Google Scholar) using the keywords exercise training, ischemia/reperfusion or ischemia reperfusion injury. Meta-analysis and quality assessment of the studies were performed using the Review Manager 5.3 program.

Results

From the 238 articles retrieved from PubMed and 200 from Google Scholar, after screening and eligibility assessment, 26 articles were included in the systematic review and meta-analysis. For meta-analysis comparing the group of previously exercised animals with the non-exercised animals and then submitted to ischemia-reperfusion, the infarct size was significantly decreased by exercise (p < 0.00001). In addition, the group exercised had increased heart-to-body weight ratio (p < 0.00001) and improved ejection fraction as measured by echocardiography (p < 0.0004) in comparison to non-exercised animals.

Conclusion

We concluded that the animal models of ischemia-reperfusion indicates that exercise reduce infarct size and preserve ejection fraction, associated with beneficial myocardial remodeling.

Strategies used to manage overlap of primary study data by exercise-related overviews: protocol for a systematic methodological review

INTRODUCTION

One of the most conflicting methodological issues when conducting an overview is the overlap of primary studies across systematic reviews (SRs). Overlap in the pooled effect estimates across SRs may lead to overly precise effect estimates in the overview. SRs that focus on exercise-related interventions are often included in overviews aimed at grouping and determining the effectiveness of various interventions for managing specific health conditions. The aim of this systematic methodological review is to describe the strategies used by authors of overviews focusing on exercise-related interventions to manage the overlap of primary studies.

METHODS AND ANALYSIS

A comprehensive search strategy has been developed for different databases and their platforms. The databases to be consulted will be MEDLINE (Ovid), Embase (Ovid), The Cochrane Database of Systematic Reviews (Cochrane Library) and Epistemonikos. Two reviewers will independently screen the records identified through the search strategy and extract the information from the included overviews. The frequency and the type of overlap management strategies of the primary studies included in the SRs will be considered as the main outcome. In addition, the recognition of the lack of use of any overlap management strategy and the congruence between planning and conducting the overview focusing on overlap management strategies will be assessed. A subgroup analysis will be carried out according to the journal impact factor, year of publication and compliance with the Preferred Reporting Items for Overviews of Reviews statement.

ETHICS AND DISSEMINATION

This study will not involve human subjects and therefore does not require ethics committee approval. However, the conduct and reporting of the findings of this review will be conducted in a rigorous, systematic and transparent manner, which relates to research ethics.The findings of this review will be presented at scientific conferences and published as one or more studies in peer-review scientific journals related to rehabilitation or research methods.

COVID-19 and common mental health symptoms in the early phase of the pandemic: An umbrella review of the evidence

BACKGROUND

There remains uncertainty about the impact of the Coronavirus Disease 2019 (COVID-19) pandemic on mental health. This umbrella review provides a comprehensive overview of the association between the pandemic and common mental disorders. We qualitatively summarized evidence from reviews with meta-analyses of individual study-data in the general population, healthcare workers, and specific at-risk populations.

METHODS AND FINDINGS

A systematic search was carried out in 5 databases for peer-reviewed systematic reviews with meta-analyses of prevalence of depression, anxiety, and post-traumatic stress disorder (PTSD) symptoms during the pandemic published between December 31, 2019 until August 12, 2022. We identified 123 reviews of which 7 provided standardized mean differences (SMDs) either from longitudinal pre- to during pandemic study-data or from cross-sectional study-data compared to matched pre-pandemic data. Methodological quality rated with the Assessment of Multiple Systematic Reviews checklist scores (AMSTAR 2) instrument was generally low to moderate. Small but significant increases of depression, anxiety, and/or general mental health symptoms were reported in the general population, in people with preexisting physical health conditions, and in children (3 reviews; SMDs ranged from 0.11 to 0.28). Mental health and depression symptoms significantly increased during periods of social restrictions (1 review; SMDs of 0.41 and 0.83, respectively) but anxiety symptoms did not (SMD: 0.26). Increases of depression symptoms were generally larger and longer-lasting during the pandemic (3 reviews; SMDs depression ranged from 0.16 to 0.23) than those of anxiety (2 reviews: SMDs 0.12 and 0.18). Females showed a significantly larger increase in anxiety symptoms than males (1 review: SMD 0.15). In healthcare workers, people with preexisting mental disorders, any patient group, children and adolescents, and in students, no significant differences from pre- to during pandemic were found (2 reviews; SMD's ranging from -0.16 to 0.48). In 116 reviews pooled cross-sectional prevalence rates of depression, anxiety, and PTSD symptoms ranged from 9% to 48% across populations. Although heterogeneity between studies was high and largely unexplained, assessment tools and cut-offs used, age, sex or gender, and COVID-19 exposure factors were found to be moderators in some reviews. The major limitations are the inability to quantify and explain the high heterogeneity across reviews included and the shortage of within-person data from multiple longitudinal studies.

CONCLUSIONS

A small but consistent deterioration of mental health and particularly depression during early pandemic and during social restrictions has been found in the general population and in people with chronic somatic disorders. Also, associations between mental health and the pandemic were stronger in females and younger age groups than in others. Explanatory individual-level, COVID-19 exposure, and time-course factors were scarce and showed inconsistencies across reviews. For policy and research, repeated assessments of mental health in population panels including vulnerable individuals are recommended to respond to current and future health crises.

Benefits and Risks of Antidepressant Drugs During Pregnancy: A Systematic Review of Meta-analyses

BACKGROUND

The prescription of antidepressant drugs during pregnancy has been steadily increasing for several decades. Meta-analyses (MAs), which increase the statistical power and precision of results, have gained interest for assessing the safety of antidepressant drugs during pregnancy.

OBJECTIVE

We aimed to provide a meta-review of MAs assessing the benefits and risks of antidepressant drug use during pregnancy.

METHODS

Following Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines, a literature search on PubMed and Web of Science databases was conducted on 25 October, 2021, on MAs assessing the association between antidepressant drug use during pregnancy and health outcomes for the pregnant women, embryo, fetus, newborn, and developing child. Study selection and data extraction were carried out independently and in duplicate by two authors. The methodological quality of included studies was evaluated with the AMSTAR-2 tool. Overlap among MAs was assessed by calculating the corrected covered area. Data were presented in a narrative synthesis, using four levels of evidence.

RESULTS

Fifty-one MAs were included, all but one assessing risks. These provided evidence for a significant increase in the risks for major congenital malformations (selective serotonin reuptake inhibitors, paroxetine, fluoxetine, no evidence for sertraline; eight MAs), congenital heart defects (paroxetine, fluoxetine, sertraline; 11 MAs), preterm birth (eight MAs), neonatal adaptation symptoms (eight MAs), and persistent pulmonary hypertension of the newborn (three MAs). There was limited evidence (only one MA for each outcome) for a significant increase in the risks for postpartum hemorrhage, and with a high risk of bias, for stillbirth, impaired motor development, and intellectual disability. There was inconclusive evidence, i.e., discrepant results, for an increase in the risks for spontaneous abortion, small for gestational age and low birthweight, respiratory distress, convulsions, feeding problems, and for a subsequent risk for autism with an early antidepressant drug exposure. Finally, MAs provided no evidence for an increase in the risks for gestational hypertension, preeclampsia, and for a subsequent risk for attention-deficit/hyperactivity disorder. Only one MA assessed benefits, providing limited evidence for preventing relapse in severe or recurrent depression. Effect sizes were small, except for neonatal symptoms (small to large). Results were based on MAs in which overall methodological quality was low (AMSTAR-2 score = 54.8% ± 12.9%, [19-81%]), with a high risk of bias, notably indication bias. The corrected covered area was 3.27%, which corresponds to a slight overlap.

CONCLUSIONS

This meta-review has implications for clinical practice and future research. First, these results suggest that antidepressant drugs should be used as a second-line treatment during pregnancy (after first-line psychotherapy, according to the guidelines). The risk of major congenital malformations could be prevented by observing guidelines that discourage the use of paroxetine and fluoxetine. Second, to decrease heterogeneity and bias, future MAs should adjust for maternal psychiatric disorders and antidepressant drug dosage, and perform analyses by timing of exposure.

Clinical Effectiveness of Dry Needling in Patients with Musculoskeletal Pain-An Umbrella Review

The number of systematic reviews (SR) summarizing the literature regarding the clinical effects of Dry Needling (DN) has increased rapidly. Yet, rigorous evidence about the clinical effectiveness of this technique is still lacking. The aim of this umbrella review is to summarize the evidence about the clinical effects of trigger point DN on musculoskeletal disorders across all body regions. PubMed, Web of Science and Embase were searched to identify SRs examining the effect of DN (as a stand-alone intervention or combined with another treatment modality) compared to sham/no intervention or a physical therapy (PT) intervention with at least one clinical outcome in the domain of pain or physical functioning. Risk of bias (RoB) was assessed with the AMSTAR-2 tool. Quantification of the overlap in primary studies was calculated using the corrected covered area (CCA). The electronic search yielded 2286 results, of which 36 SRs were included in this review. Overall, DN is superior to sham/no intervention and equally effective to other interventions for pain reduction at short-term regardless of the body region. Some SRs favored wet needling (WN) over DN for short-term pain reductions. Results on physical functioning outcomes were contradictory across body regions. Limited data is available for mid- and long-term effects. DN has a short-term analgesic effect in all body regions and may be of additional value to the interventions that are used to date in clinical practice. Several studies have shown an additional treatment effect when combining DN to physiotherapeutic interventions compared to these interventions in isolation. There is a substantial need for the standardization of DN protocols to address the problem of heterogeneity and to strengthen the current evidence.

Is research on 'smart living environments' based on unobtrusive technologies for older adults going in circles? Evidence from an umbrella review

CONTEXT AND AIMS

To enable ageing in place, innovative and integrative technologies such as smart living environments may be part of the solution. Despite extensive published literature reviews on this topic, the effectiveness of smart living environments in supporting ageing in place, and in particular involving unobtrusive technologies, remains unclear. The main objective of our umbrella review was to synthesize evidence on this topic.

METHODS

According to the PRIOR process, we included reviews from multiple databases that focused on unobtrusive technologies used to analyze and share information about older adults' behaviors and assessed the effectiveness of unobtrusive technologies to support ageing in place. Selection, extraction and quality appraisal were done independently by two reviewers.

RESULTS

By synthesizing 17 published reviews that covered 191 distinct primary studies, we found that smart living environments based on unobtrusive technologies had low to moderate effectiveness to support older adults to age in place. Effectiveness appears to be strongest in the recognition of activities of daily living. The results must, however, be interpreted in light of the low overall level of evidence, i.e., low methodological value of the primary studies and poor methodological quality of the literature reviews. Most reviews concluded that unobtrusive technologies are not mature enough for widespread adoption.

CONCLUSION

There is a necessity to support primary studies that can move beyond the proof-of-concept or pilot stages and expand scientific knowledge significantly on the topic. There is also an urgent need to publish high quality literature reviews to better support policy makers and funding agencies in the field of smart living environments.

Types and associated methodologies of overviews of reviews in health care: a methodological study with published examples

OBJECTIVES

To provide a descriptive insight into the different types of research questions/objectives and associated methodologies of overviews of reviews, supplemented by representative examples from the health care literature.

STUDY DESIGN AND SETTING

We searched in methodological articles for information on types and methodologies used in overviews and we explored the typology of reviews to identify similar types in literature of overviews. We categorized the types of overviews based on the research question/objective and the methodological approach used. Indicative examples for each category were selected from a sample of 2,121 overviews that were retrieved between 2000 and 2022 from MEDLINE, Scopus, and Cochrane Database of Systematic Reviews.

RESULTS

Based on type of research question, overviews were classified as overviews of reviews of interventions, associations, prediction, diagnostic accuracy, prevalence/incidence, experiences/views, economic evaluation, and measurement properties. Based on the methodological approach, we identified a variety of methods (systematic, living, rapid, scoping, evidence mapping, framework, and methodological) used in overviews.

CONCLUSION

The proposed classification and examples provide an essential starting point for future theory-building research on typologies and study designs of overviews of reviews. It is important for methodologists to make vigorous effort to create consensus-based methodological and reporting guidelines to cover these diverse types and key methodological challenges.

The Influence of Sex, Gender, or Age on Outcomes of Digital Technologies for Treatment and Monitoring of Chronic Obstructive Pulmonary Disease: Protocol for an Overview of Systematic Reviews

BACKGROUND

Chronic obstructive pulmonary disease (COPD) is a common chronic disease that can be treated and monitored with various digital technologies. Digital technologies offer unique opportunities for treating and monitoring people with chronic diseases, but little is known about whether the outcomes of such technologies depend on sex, gender, or age in people with COPD.

OBJECTIVE

The general objective of this study is to assess the possible influence of sex, gender, or age on outcomes of digital technologies for treatment and monitoring of COPD through an overview of systematic reviews.

METHODS

The study is planned as an overview of systematic reviews. Study reporting is based on the PRISMA (Preferred Reporting Items for Systematic reviews and Meta-Analyses) 2020 guidelines because guidelines for overviews are not available as of this writing. The information sources for the overview will include 4 bibliographic databases (MEDLINE, Cochrane Library, Epistemonikos, and Web of Science) as well as the bibliographies of the included systematic reviews. The electronic search strategy will be developed and conducted in collaboration with an experienced database specialist. The search results will be presented in accordance with the PRISMA 2020 guidelines. The eligibility of studies is based on the population, intervention, comparison, outcomes, and study design (PICOS) criteria: (1) people with COPD (population), (2) digital technology intervention for treatment or monitoring (intervention), (3) any control group or no control group (comparison), (4) any outcome, and (5) systematic review of randomized controlled trials or non-randomized controlled trials with or without a meta-analysis (study design). Critical appraisal of the included systematic reviews will be performed using A Measurement Tool to Assess Systematic Reviews, version 2 (AMSTAR 2). Data will be extracted using a standardized data extraction sheet.

RESULTS

The literature search is scheduled for June 2022. We expect to select the relevant systematic reviews, code the data, and appraise the systematic reviews by December 2022.

CONCLUSIONS

There is a growing recognition that the influence of sex, gender, or age should be considered in research design and outcome reporting in the context of health care interventions. Our overview will identify systematic reviews of various digital technologies for treatment or monitoring of COPD. The most interesting aspect of the overview will be to investigate if any systematic reviews considered the influence of sex, gender, or age on the outcomes of such digital technologies in COPD. Evidence from the overview could be used to guide more individualized (sex, gender, or age-based) recommendations for the use of digital technologies among people with COPD.

TRIAL REGISTRATION

PROSPERO International Prospective Register of Systematic Reviews CRD42022322924; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=322924.

Social, economic, political, and geographical context that counts: meta-review of implementation determinants for policies promoting healthy diet and physical activity

BACKGROUND

This meta-review investigated the context-related implementation determinants from seven domains (geographical, epidemiological, sociocultural, economic, ethics-related, political, and legal) that were systematically indicated as occurring during the implementation of obesity prevention policies targeting a healthy diet and a physically active lifestyle.

METHODS

Data from nine databases and documentation of nine major stakeholders were searched for the purpose of this preregistered meta-review (#CRD42019133341). Context-related determinants were considered strongly supported if they were indicated in ≥60% of the reviews/stakeholder documents. The ROBIS tool and the Methodological Quality Checklist-SP were used to assess the quality-related risk of bias.

RESULTS

Published reviews (k = 25) and stakeholder documents that reviewed the evidence of policy implementation (k = 17) were included. Across documents, the following six determinants from three context domains received strong support: economic resources at the macro (66.7% of analyzed documents) and meso/micro levels (71.4%); sociocultural context determinants at the meso/micro level, references to knowledge/beliefs/abilities of target groups (69.0%) and implementers (73.8%); political context determinants (interrelated policies supported in 71.4% of analyzed reviews/documents; policies within organizations, 69.0%).

CONCLUSIONS

These findings indicate that sociocultural, economic, and political contexts need to be accounted for when formulating plans for the implementation of a healthy diet and physical activity/sedentary behavior policies.

Harms in Systematic Reviews Paper 3: Given the same data sources, systematic reviews of gabapentin have different results for harms

OBJECTIVE

In this methodologic study (Part 2 of 2), we examined the overlap in sources of evidence and the corresponding results for harms in systematic reviews for gabapentin.

STUDY DESIGN & SETTING

We extracted all citations referenced as sources of evidence for harms of gabapentin from 70 systematic reviews, as well as the harms assessed and numerical results. We assessed consistency of harms between pairs of reviews with a high degree of overlap in sources of evidence (>50%) as determined by corrected covered area (CCA).

RESULTS

We found 514 reports cited across 70 included reviews. Most reports (244/514, 48%) were not cited in more than one review. Among 18 pairs of reviews, we found reviews had differences in which harms were assessed and their choice to meta-analyze estimates or present descriptive summaries. When a specific harm was meta-analyzed in a pair of reviews, we found similar effect estimates.

CONCLUSION

Differences in harms results across reviews can occur because the choice of harms is driven by reviewer preferences, rather than standardized approaches to selecting harms for assessment. A paradigm shift is needed in the current approach to synthesizing harms.

Effectiveness of smart living environments to support older adults to age in place in their community: an umbrella review protocol

INTRODUCTION

Frailty is a vulnerable condition exposing older adults to incidental adverse health events that negatively impact their quality of life and increase health and social costs. Digital solutions may play a key role in addressing this global problem and in particular, smart living environments. Smart living environments involve a notion of measurement or collection of data via several sensors, capturing the person's behaviours in the home or the person's health status over a long period of time. It thus has great potential for home support for older adults. The objective of this umbrella review will be: (1) to document the effectiveness of smart living environments to support ageing in place for frail older adults and (2) among the reviews assessing the effectiveness of smart living environment, to gather evidence on what factors and strategies were identified as influencing the implementation process.

METHODS AND ANALYSIS

We will include systematic and scoping reviews of both quantitative and qualitative primary studies with or without meta-analysis focusing on assessing the effectiveness of interventions through smart living environments to support older adults in the community to age in place. The literature search will be done through the following biomedical, technological and sociological citation databases: MEDLINE, Embase, CINAHL, Web of Science and PsycINFO, and quality assessment of the reviews will be done thought AMSTAR2 checklist. The analysis of the results will be presented in narrative form.

ETHICS AND DISSEMINATION

Our review will rely exclusively on published data from secondary sources and will thus not involve any interactions with human subjects. The results will be presented at international conferences and publications.

PROSPERO REGISTRATION NUMBER

CRD42021249849.

Meta-review of implementation determinants for policies promoting healthy diet and physically active lifestyle: application of the Consolidated Framework for Implementation Research

BACKGROUND

Although multiple systematic reviews indicate that various determinants (barriers and facilitators) occur in the implementation processes of policies promoting healthy diet, physical activity (PA), and sedentary behavior (SB) reduction, the overarching synthesis of such reviews is missing. Applying the Consolidated Framework for Implementation Research (CFIR), this meta-review aims to (1) identify determinants that were systematically indicated as occurring during the implementation processes and (2) identify differences in the presence of determinants across reviews versus stakeholder documents on healthy diet/PA/SB policies, reviews/stakeholder documents addressing healthy diet policies versus PA/SB policies targeting any population/setting, and healthy diet/PA/SB policies focusing on school settings.

METHODS

A meta-review of published systematic scoping or realist reviews (k = 25) and stakeholder documents (k = 17) was conducted. Data from nine bibliographic databases and documentation of nine major stakeholders were systematically searched. Included reviews (72%) and stakeholder documents (100%) provided qualitative synthesis of original research on implementation determinants of policies promoting healthy diet or PA or SB reduction, and 28% of reviews provided some quantitative synthesis. Determinants were considered strongly supported if they were indicated by ≥ 60.0% of included reviews/stakeholder documents.

RESULTS

Across the 26 CFIR-based implementation determinants, seven were supported by 66.7-76.2% of reviews/stakeholder documents. These determinants were cost, networking with other organizations/communities, external policies, structural characteristics of the setting, implementation climate, readiness for implementation, and knowledge/beliefs of involved individuals. Most frequently, published reviews provided support for inner setting and individual determinants, whereas stakeholder documents supported outer and inner setting implementation determinants. Comparisons between policies promoting healthy diet with PA/SB policies revealed shared support for only three implementation determinants: cost, implementation climate, and knowledge/beliefs. In the case of healthy diet/PA/SB policies targeting school settings, 14 out of 26 implementation determinants were strongly supported.

CONCLUSIONS

The strongly supported (i.e., systematically indicated) determinants may guide policymakers and researchers who need to prioritize potential implementation determinants when planning and monitoring the implementation of respective policies. Future research should quantitatively assess the importance or role of determinants and test investigate associations between determinants and progress of implementation processes.

TRIAL REGISTRATION

PROSPERO, # CRD42019133341.

The efficacy of psychological interventions for depressed primary caregivers of patients with Alzheimer's disease: A systematic review and meta-analysis

OBJECTIVES

To systematically evaluate the effectiveness of psychological intervention durations and different psychological interventions on treating depression in primary caregivers of Alzheimer's disease (AD) patients.

METHODS

A computerized search of PubMed, Cochrane Library, Embase, Ebsco, Web of Science, CNKI, CSBD, and CSTJ databases on randomized controlled trials (RCTs) of psychological interventions for depressed primary caregivers of AD patients was performed. Depression scores were derived from the Self-rated Depression Scale (SDS) and the Centre for Epidemiological Studies Depression Scale (CES-D). The results were analyzed using Revman 5.3 utilizing Trial Sequential Analysis (TSA) software for data analysis.

RESULTS

Eight RCTs involving 857 depressed primary caregivers of AD patients were included in the study. Of the four psychological interventions studied, only three (i.e., cognitive-behavioral psychological, integrated psychological, and psychological interview intervention) were shown to significantly reduce depression levels in primary caregivers of AD patients after 2-months, 10-weeks, and 6-months of treatment (p ≤ 0.05). It is uncertain that a supportive psychological intervention or a 3-months psychological intervention reduced the level of depression. Sequential and sensitivity analyses confirmed the reliability of the outcome measures.

CONCLUSION

Cognitive-behavioral psychological, integrated psychological, and psychological interview interventions were able to significantly reduce depression levels in primary caregivers of AD patients. These findings reveal that psychological interventions may be a promising means for depressed primary caregivers of patients with AD.

CLINICAL RELEVANCE

For the primary caregivers of AD patients, effective interventions can help reduce psycho-depressive symptoms and improve the quality of life for the caregivers and the patients. Medical staff may want to use this information to help to provide a more effective guide for primary caregivers in an effort to reduce possible levels of depression.

Best Practices for Meta-Reviews in Physical Activity and Health Research: Insights From the Physical Activity Guidelines for Americans Advisory Committee Scientific Report

BACKGROUND

Systematic reviews (SRs) and meta-analyses (MAs) have proliferated with a concomitant increase in reviews of SRs/MAs or "meta-reviews" (MRs). As uncovered by the 2018 US Physical Activity Guidelines Advisory Committee (PAGAC), there is a paucity of best practice guidance on MRs on physical activity health-related research. This manuscript aims to fill this gap.

METHODS

In total, the PAGAC conducted 38 literature searches across 3 electronic databases and triaged 20,838 titles, 4913 abstracts, and 2139 full texts from which 1130 articles qualified for the PAGAC Scientific Report.

RESULTS

During the MR process, the following challenges were encountered: (1) if the SR/MA authors had limited experience in synthesis methodology, they likely did not account for risk of bias in the conclusions they reached; (2) many SRs/MAs reviewed the same primary-level studies; (3) many SRs/MAs failed to disclose effect modifier analyses; (4) source populations varied; (5) physical activity exposures were nonstandardized; and (6) dose-response effects or effect modification of the physical activity exposure could not be identified.

CONCLUSIONS

Using examples from the PAGAC Scientific Report, we provide (1) a high-level introduction to MRs; (2) recommended steps in conducting a MR; (3) challenges that can be encountered; and (4) guidance in addressing these challenges.

Applied Research in Quality of Life: A Computational Literature Review

As quality of life (QoL) is a highly interdisciplinary topic with a multitude of related research areas, it is beneficial to avail researchers of an overview of the different streams explored in the field. Furthermore, knowledge of prominent sub-domains helps researchers identify links and overlaps between QoL and their fields of interest. To meet these needs, a text-mining-based computational literature review (CLR) of the journal of Applied Research in Quality of Life (ARQOL) was conducted using a machine learning process, latent Dirichlet allocation (LDA), in combination with selection criteria for the decision on the number of topics. The outcome provides the reader with a list of the twelve most heavily discussed topics: 1) consumption & materialism, 2) character strength, 3) spirituality, religiousness & personal beliefs, 4) inequality, 5) leisure & tourism, 6) health related QoL (HRQoL) I, 7) quality of working life (QWL), 8) childhood & adolescence, 9) disparity & development, 10) disorder, 11) community issues, and 12) health related QoL (HRQoL) II. In addition, authors, titles, and publication dates are listed for the top-5-ranked papers that most typify these topics. Subsequent content summaries of these papers reveal more detailed information, such as measurement constructs and theories.

Managing overlap of primary study results across systematic reviews: practical considerations for authors of overviews of reviews

BACKGROUND

Overviews often identify and synthesise a large number of systematic reviews on the same topic, which is likely to lead to overlap (i.e. duplication) in primary studies across the reviews. Using a primary study result multiple times in the same analysis overstates its sample size and number of events, falsely leading to greater precision in the analysis. This paper aims to: (a) describe types of overlapping data that arise from the same primary studies reported across multiple reviews, (b) describe methods to identify and explain overlap of primary study data, and (c) present six case studies illustrating different approaches to manage overlap.

METHODS

We first updated the search in PubMed for methods from the MOoR framework relating to overlap of primary studies. One author screened the studies titles and abstracts, and any full-text articles retrieved, extracted methods data relating to overlap of primary studies and mapped it to the overlap methods from the MOoR framework. We also describe six case studies as examples of overviews that use specific overlap methods across the steps in the conduct of an overview. For each case study, we discuss potential methodological implications in terms of limitations, efficiency, usability, and resource use.

RESULTS

Nine methods studies were found and mapped to the methods identified by the MOoR framework to address overlap. Overlap methods were mapped across four steps in the conduct of an overview - the eligibility criteria step, the data extraction step, the assessment of risk of bias step, and the synthesis step. Our overview case studies used multiple methods to reduce overlap at different steps in the conduct of an overview.

CONCLUSIONS

Our study underlines that there is currently no standard methodological approach to deal with overlap in primary studies across reviews. The level of complexity when dealing with overlap can vary depending on the yield, trends and patterns of the included literature and the scope of the overview question. Choosing a method might be dependent on the number of included reviews and their primary studies. Gaps in evaluation of methods to address overlap were found and further investigation in this area is needed.

Global mapping of overviews of systematic reviews in healthcare published between 2000 and 2020: a bibliometric analysis

OBJECTIVE

To conduct a bibliometric analysis using a large sample of overviews of systematic reviews (OoSRs) and reveal research trends and areas of interest about these studies.

STUDY DESIGN AND SETTING

We searched MEDLINE, Scopus and Cochrane Database of Systematic Reviews from 1/1/2000 to 15/10/2020. We used Scopus meta-data and two authors recorded supplementary information independently. We summarized the data using frequencies with percentages.

RESULTS

A total of 1558 studies were considered eligible for analysis. We found that the publications have been increasing yearly and their nomenclature was not uniform (the most frequent label in the title was "overview of systematic reviews"). The largest number of papers and the most cited ones were published by corresponding authors from the UK. The publications were distributed across 737 scholarly journals and many of them were published in the field of complementary/alternative medicine, psychiatry/psychology, nutrition/dietetics, and pediatrics. The co-authorship analysis revealed collaborations among countries. The most common clinical conditions were depression, diabetes, cancer, dementia, pain, cardiovascular disease, stroke, obesity, and schizophrenia.

CONCLUSION

OoSRs have recently become a popular approach of evidence synthesis. International collaborations between overview authors from countries with increased research productivity and countries with less research activity should be encouraged.

A Systematic Overview of Meta-Analyses on Socioeconomic Status, Cognitive Ability, and Achievement: The Need to Focus on Specific Pathways

Meta-analyses on the relation between socioeconomic status (SES) and performance on measures of cognitive ability and achievement arrive at the same general conclusion of a small to medium association. Advancements in methods make possible for meta-analyses to examine specific pathways linking SES to cognitive ability and achievement, as well as the moderators of these pathways. In this study, we conducted a systematic overview of meta-analyses on SES to address three research questions: 1) what is the direction and overall strength of association between SES and performance on measures of cognitive ability and achievement, and how precise are the effect sizes reported? 2) to what extent have meta-analyses examined moderation by components of SES, age, sex, and race/ethnicity? and 3) to what extent have meta-analyses examined mechanisms linking SES to cognitive ability and achievement? We conducted a systematic search using online archives (i.e., PsycINFO, ERIC, PubMed, Sociological Abstracts, and Web of Science), searching issues in Psychological Bulletin and Review of Educational Research, and examining references and citations. We identified 14 meta-analyses published between 1982 and 2019. These meta-analyses consistently reported positive associations of small to medium magnitude, indicating that SES is a meaningful contributor to the development of cognitive ability and achievement. Fewer meta-analyses reported evidence of moderation by age, sex, and race/ethnicity. None of the meta-analyses directly examined mechanisms, but provided evidence of possible mechanisms for future research. We suggest that meta-analyses can increase their contribution to future research, interventions, and policy by narrowing their focus on specific pathways.

Methods for depicting overlap in overviews of systematic reviews: An introduction to static tabular and graphical displays

BACKGROUND AND OBJECTIVE

To introduce potential static tabular and graphical techniques for visually presenting overlap between systematic reviews (SRs) included in overviews of systematic reviews (OoSRs).

METHODS

The graphical approaches described include Venn and Euler diagrams, as well as matrix-based, node-link, and aggregation-based techniques. We used fundamental concepts of mathematics from set and network theory to develop our novel graphical approaches. The graphical displays were created using R.

RESULTS

Overview authors have the flexibility to choose from a variety of visualizations, depending on the characteristics of their study. If the OoSRs include few SRs, a Venn or an Euler diagram can be used. In case of OoSRs with more SRs, Upset plots, heatmaps, and node-link graphs are more appropriate for visualizing overlapping SRs. Stacked bar plots constitute an aggregation-based technique of illustrating overlap. Strengths and limitations of each graphical approach are presented.

CONCLUSION

The degree of overlap should be explored for the entire study and for specific outcomes of interest. The proposed graphical techniques may assist methodologists and authors in identifying overlap, which in turn may improve validity and transparency in OoSRs. More research is needed to understand which technique would be most useful and easiest to understand.

A comprehensive meta-review of systematic reviews and meta-analyses on nonpharmacological interventions for informal dementia caregivers

Background

Many reviews with conflicting findings on dementia caregiver interventions have been published. A meta-review was conducted to synthesize the findings of systematic reviews and meta-analyses.

Methods

MEDLINE, PsycINFO, CINAHL and Cochrane Library were searched to identify reviews published during 2006–2018.

Results

Sixty reviews covering > 500 intervention studies were selected and appraised with Assessment of Multiple Systematic Reviews (AMSTAR) II. The great majority of studies were of low quality according to AMSTAR II, but quality factors appeared unrelated to the conclusions obtained. Depression was most modifiable, with effects found across a spectrum of interventions (psychoeducation, counseling/psychotherapy, occupational therapy, mindfulness-based interventions, multicomponent interventions, etc.). Evidence of intervention effect was also found for quality of life (psychoeducation), mastery (psychoeducation, occupational therapy and multicomponent interventions) and communication skills (communication training). Null or weak results were found for anxiety, social support and burden. Support groups and respite were generally ineffective. There was no evidence that dyadic programs were better than caregiver-only programs, or that programs delivered individually or in groups would differ in their impacts. The evidence also does not support multicomponent interventions to have broader impacts than single-component programs. Methodological issues in the existing reviews (e.g., selective use of studies to serve different research purposes and inconsistent classification of interventions) were noted and taken into account when interpreting findings.

Conclusions

This meta-review clarified variations in review methodology and identified a few potent groups of intervention (most notably psychoeducation, psychotherapy, occupational therapy, and multicomponent interventions), although no intervention type had broad effects on caregiver outcomes. We note that improvements are needed in the reporting of intervention studies and in making the classification of interventions more transparent and consistent. We further recommend fewer and larger-scale reviews and more attention to positive outcomes in order to better inform the field. Developing interventions with broader impacts and packaging them to meet caregivers’ changing needs in the course of dementia should be a priority for researchers and practitioners.

Effectiveness of interventions targeting self-regulation to improve adherence to chronic disease medications: a meta-review of meta-analyses

Adherence to chronic disease medication regimens depends in part on successful self-regulation. However, the overall benefit of interventions targeting self-regulatory mechanisms is not well-understood. Accordingly, we conducted a meta-review of meta-analyses assessing the effect of interventions targeting self-regulation on medication adherence. For this meta-review, meta-analyses appearing between January 2006 and March 2019 were eligible if they included experimental trials that assessed the effect of an intervention targeting self-regulation on adherence to chronic disease medication. A systematic literature search of multiple databases for published and unpublished literature identified 16,001 abstracts. Twelve meta-analyses met eligibility criteria and had variable quality according to AMSTAR 2 item completion (M = 50%; range: 31-66%). Overall, meta-reviews showed small to medium effect sizes for interventions that targeted self-monitoring, provided personalised feedback on adherence, or involved complete self-management. Other interventions, such as goal setting, barrier identification and problem solving, and stress management showed little evidence of improving adherence. Only a limited number of self-regulation intervention components were able to be evaluated. Additional research is needed to advance the understanding of the efficacy of adherence interventions focussed on self-regulation by expanding the scope of self-regulation elements targeted (e.g., emotion regulation).

Examining overlap of included studies in meta-reviews: Guidance for using the corrected covered area index

Overlap in meta-reviews results from the use of multiple identical primary studies in similar reviews. It is an important area for research synthesists because overlap indicates the degree to which reviews address the same or different literatures of primary research. Current guidelines to address overlap suggest that assessing and documenting the degree of overlap in primary studies, calculated via the corrected covered area (CCA) is a promising method. Yet, the CCA is a simple percentage of overlap and current guidelines do not detail ways that reviewers can use the CCA as a diagnostic tool while also comprehensively incorporating these findings into their conclusions. Furthermore, we maintain that meta-review teams must address non-independence via overlap more thoroughly than by simply estimating and reporting the CCA. Instead, we recommend and elaborate five steps to take when examining overlap, illustrating these steps through the use of an empirical example of primary study overlap in a recently conducted meta-review. This work helps to show that overlap of primary studies included in a meta-review is not necessarily a bias but often can be a benefit. We also highlight further areas of caution in this task and potential for the development of new tools to address non-independence issues.

Systematic reviews and meta-analyses in the health sciences: Best practice methods for research syntheses

RATIONALE

The journal Social Science & Medicine recently adopted the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA; Moher et al., 2009) as guidelines for authors to use when disseminating their systematic reviews (SRs).

APPROACH

After providing a brief history of evidence synthesis, this article describes why reporting standards are important, summarizes the sequential steps involved in conducting SRs and meta-analyses, and outlines additional methodological issues that researchers should address when conducting and reporting results from their SRs.

RESULTS AND CONCLUSIONS

Successful SRs result when teams of reviewers with appropriate expertise use the highest scientific rigor in all steps of the SR process. Thus, SRs that lack foresight are unlikely to prove successful. We advocate that SR teams consider potential moderators (M) when defining their research problem, along with Time, Outcomes, Population, Intervention, Context, and Study design (i.e., TOPICS + M). We also show that, because the PRISMA reporting standards only partially overlap dimensions of methodological quality, it is possible for SRs to satisfy PRISMA standards yet still have poor methodological quality. As well, we discuss limitations of such standards and instruments in the face of the assumptions of the SR process, including meta-analysis spanning the other SR steps, which are highly synergistic: Study search and selection, coding of study characteristics and effects, analysis, interpretation, reporting, and finally, re-analysis and criticism. When a SR targets an important question with the best possible SR methods, its results can become a definitive statement that guides future research and policy decisions for years to come.