Dissemination and publication of research findings: an updated review of related biases

A systematic review case study of urgent and emergency care configuration found citation searching of Web of Science and Google Scholar of similar value

BACKGROUND

Supplementary search methods, including citation searching, are essential if systematic reviews are to avoid producing biased conclusions. Little evidence exists on how to prioritise databases for citation searching or to establish whether using multiple sources is beneficial.

OBJECTIVES

A systematic review examining urgent and emergency care reconfiguration was used to investigate the utility of citation searching on Web of Science (WOS) and/or Google Scholar (GS).

METHODS

This case study investigated numbers of studies, additional studies and unique studies retrieved from both sources. In addition, the time to search, the ease of adding references to reference management software and obtaining abstracts of studies for screening are briefly considered.

RESULTS

WOS retrieved 62 references after deduplication of the results, 52 being additional references not retrieved during the database searching. GS retrieved 134 unique references with 63 additional references. WOS and GS retrieved the same three additional included studies. WOS was less time intensive to search given the facility to restrict to English language papers and availability of abstracts.

CONCLUSIONS

In a single systematic review case study, citation searching was required to identify all included studies. Citation searching on WOS is more efficient, where a subscription is available. Both databases identified the same studies but GS required additional time to remove non-English language studies and locate abstracts.

Abortion and mental health outcomes: A systematic review and meta-analysis

This is a protocol for a systematic review and meta-analysis of research on mental health outcomes of abortion. Does abortion increase the risk of adverse mental health outcomes? That is the central question for this review. Our review aims to inform policy and practice by locating, critically appraising, and synthesizing empirical evidence on associations between abortion and subsequent mental health outcomes. Given the controversies surrounding this topic and the complex social, political, legal, and ideological contexts in which research and reviews on abortion are conducted, it is especially important to conduct this systematic review and meta-analysis with comprehensive, rigorous, unbiased, and transparent methods. We will include a variety of study designs to enhance understanding of studies' methodological strengths and weaknesses and to identify potential explanations for conflicting results. We will follow open science principles, providing access to our methods, measures, and results, and making data available for re-analysis.

The Logic of Generalization From Systematic Reviews and Meta-Analyses of Impact Evaluations

Systematic reviews and meta-analyses are viewed as potent tools for generalized causal inference. These reviews are routinely used to inform decision makers about expected effects of interventions. However, the logic of generalization from research reviews to diverse policy and practice contexts is not well developed. Building on sampling theory, concerns about epistemic uncertainty, and principles of generalized causal inference, this article presents a pragmatic approach to generalizability assessment for use with systematic reviews and meta-analyses. This approach is applied to two systematic reviews and meta-analyses of effects of "evidence-based" psychosocial interventions for youth and families. Evaluations included in systematic reviews are not necessarily representative of populations and treatments of interest. Generalizability of results is limited by high risks of bias, uncertain estimates, and insufficient descriptive data from impact evaluations. Systematic reviews and meta-analyses can be used to test generalizability claims, explore heterogeneity, and identify potential moderators of effects. These reviews can also produce pooled estimates that are not representative of any larger sets of studies, programs, or people. Further work is needed to improve the conduct and reporting of impact evaluations and systematic reviews, and to develop practical approaches to generalizability assessment and guide applications of interventions in diverse policy and practice contexts.

Examining the application of the IDEAL framework in the reporting and evaluation of innovative invasive procedures: secondary qualitative analysis of a systematic review

OBJECTIVES

The development of new surgical procedures is fundamental to advancing patient care. The Idea, Developments, Exploration, Assessment and Long-term (IDEAL) framework describes study designs for stages of innovation. It can be difficult to apply due to challenges in defining and identifying innovative procedures. This study examined how the IDEAL framework is operationalised in real-world settings; specifically, the types of innovations evaluated using the framework and how authors justify their choice of IDEAL study design.

DESIGN

Secondary qualitative analysis of a systematic review.

DATA SOURCES

Citation searches (Web of Science and Scopus) identified studies following the IDEAL framework and citing any of the ten key IDEAL/IDEAL_D papers.

ELIGIBILITY CRITERIA

Studies of invasive procedures/devices of any design citing any of the ten key IDEAL/IDEAL_D papers.

DATA EXTRACTION AND SYNTHESIS

All relevant text was extracted. Three frameworks were developed, namely: (1) type of innovation under evaluation; (2) terminology used to describe stage of innovation and (3) reported rationale for IDEAL stage.

RESULTS

48 articles were included. 19/48 described entirely new procedures, including those used for the first time in a different clinical context (n=15/48), reported as IDEAL stage 2a (n=8, 53%). Terminology describing stage of innovation was varied, inconsistent and ambiguous and was not defined. Authors justified their choice of IDEAL study design based on limitations in published evidence (n=36) and unknown feasibility and safety (n=32) outcomes.

CONCLUSION

Identifying stage of innovation is crucial to inform appropriate study design and governance decisions. Authors' rationale for choice of IDEAL stage related to the existing evidence base or lack of sufficient outcome data for procedures. Stage of innovation was poorly defined with inconsistent descriptions. Further work is needed to develop methods to identify innovation to inform practical application of the IDEAL framework. Defining the concept of innovation in terms of uncertainty, risk and degree of evidence may help to inform decision-making.

Environmental stewardship: A systematic scoping review

Environmental stewardship is a term describing both the philosophy and the actions required to protect, restore, and sustainably use natural resources for the future benefit of the environment and society. In this paper, we review the environmental science literature to map the types of practical actions that are identified as 'environmental stewardship' using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines for scoping reviews. We specifically mapped: 1) the type of actions and outcomes targeting the natural environment that have been categorized as environmental stewardship, 2) the main actors, and the underlying factors influencing their environmental stewardship actions, and 3) the methods used to mobilize environmental stewardship actions once these factors are known. From the 77 selected articles, we found the term environmental stewardship encompassed a multitude of different actions, undertaken by a range of actors and addressing an array of issues that impact biodiversity on the land and in the water. These stewardship actions were conducted on both privately-owned and publicly managed lands and waterways, and across rural and urban landscapes. Despite many studies identifying characteristics and underlying behavioral factors that predicted actors' participation in stewardship actions, there were few studies formally evaluating interventions to increase stewardship. Our review highlighted the term environmental stewardship is not embraced by all and is viewed by some as being inconsistent with aspects of indigenous worldviews. A better understanding of the concept of environmental stewardship and continued practical research into its practice is fundamental to empowering people to demand and enact environmental stewardship as well as for evaluating the success of their actions.

A systematic review and meta-analysis of oncological outcomes with transanal total mesorectal excision for rectal cancer

AIM

Transanal total mesorectal (taTME) excision is a method used to assist in the radical removal of the rectum. By adopting the concept of natural orifice surgery, it offers potential benefits over conventional techniques. Early enthusiasm for this strategy led to its rapid and widespread adoption. The imposing of a local moratorium was precipitated by the discovery in Norway of an uncommon multifocal pattern of locoregional recurrence. The aim of this systematic review and meta-analysis was to determine the incidence of local recurrence after taTME for rectal cancer.

METHOD

Conforming to the Cochrane Handbook for Systematic Reviews of Interventions and Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines checklist, a systematic review and meta-analysis was conducted. This included case series and comparative studies between taTME and preferentially laparoscopic procedures published between 2010 and 2021.

RESULTS

There were a total of 1175 studies retrieved. After removal and screening for quality and relevance, the final analysis contained 40 studies. The local recurrence rate following taTME was 3.4% (95% CI 2.9%-3.9%, I2 = 0%) in 4987 patients with follow-up durations ranging from 0.7 to 5.5 years. Compared with laparoscopic TME, local recurrence was not statistically different for the taTME group (p = 0.076); however, it was less probable (OR = 0.51, 95% CI 0.24-1.09, I2 = 0%). Systemic recurrence and circumferential resection margin status were secondary outcomes; however, the differences were not statistically significant.

CONCLUSION

Our data suggest that the local recurrence for regular laparoscopic and transanal TME surgeries may be comparable, suggesting that taTME can be performed without influencing locoregional oncological outcomes in patients treated at specialized institutions and who have been cautiously selected.

Barriers and best practices to improving clinical trials transparency at UK public research institutions: A qualitative interview study

OBJECTIVES

Since 2017, the UK government has made concerted efforts to ensure the dissemination of clinical trials conducted at public research institutions. This study aims to understand how stakeholders within these institutions responded to these pressures and modified internal policies and processes while identifying best practices and barriers to improved transparency practice.

METHODS

Research governance and trial management staff from UK public research institutions (i.e., Universities and NHS Trusts) in England, Scotland and Wales participated in semi-structured interviews. Interviews were analysed using thematic analysis, aided by the framework method.

RESULTS

Between November 2020 and July 2021, 14 individual participants were recruited from 11 different institutions. They worked in research governance, administration, and management. Almost universally, new policies and procedures have been established to ensure investigators are aware of, and supported in, fulfilling their transparency commitments, however challenges remain. Trials of medicinal products, as the most closely regulated research, consequently received the most attention. National professional networks aid in sharing knowledge and best practice within this community.

CONCLUSIONS

Investment in the institutional governance of transparency is essential to achieving optimal transparency practices. Universities and hospitals share responsibility for ensuring research is performed and reported to regulatory standards. Facing political pressure, public research institutions in the UK have made efforts to improve their transparency practice which can provide key insights for similar efforts elsewhere.

An evaluation of the replicability of analyses using synthetic health data

Synthetic data generation is being increasingly used as a privacy preserving approach for sharing health data. In addition to protecting privacy, it is important to ensure that generated data has high utility. A common way to assess utility is the ability of synthetic data to replicate results from the real data. Replicability has been defined using two criteria: (a) replicate the results of the analyses on real data, and (b) ensure valid population inferences from the synthetic data. A simulation study using three heterogeneous real-world datasets evaluated the replicability of logistic regression workloads. Eight replicability metrics were evaluated: decision agreement, estimate agreement, standardized difference, confidence interval overlap, bias, confidence interval coverage, statistical power, and precision (empirical SE). The analysis of synthetic data used a multiple imputation approach whereby up to 20 datasets were generated and the fitted logistic regression models were combined using combining rules for fully synthetic datasets. The effects of synthetic data amplification were evaluated, and two types of generative models were used: sequential synthesis using boosted decision trees and a generative adversarial network (GAN). Privacy risk was evaluated using a membership disclosure metric. For sequential synthesis, adjusted model parameters after combining at least ten synthetic datasets gave high decision and estimate agreement, low standardized difference, as well as high confidence interval overlap, low bias, the confidence interval had nominal coverage, and power close to the nominal level. Amplification had only a marginal benefit. Confidence interval coverage from a single synthetic dataset without applying combining rules were erroneous, and statistical power, as expected, was artificially inflated when amplification was used. Sequential synthesis performed considerably better than the GAN across multiple datasets. Membership disclosure risk was low for all datasets and models. For replicable results, the statistical analysis of fully synthetic data should be based on at least ten generated datasets of the same size as the original whose analyses results are combined. Analysis results from synthetic data without applying combining rules can be misleading. Replicability results are dependent on the type of generative model used, with our study suggesting that sequential synthesis has good replicability characteristics for common health research workloads.

Overcoming publication and dissemination bias in infectious diseases clinical trials

Non-timely reporting, selective reporting, or non-reporting of clinical trial results are prevalent and serious issues. WHO mandates that summary results be available in registries within 12 months of study completion and published in full text within 24 months. However, only a limited number of clinical trials in infectious diseases, including those done during the COVID-19 pandemic, have their results posted on ClinicalTrials.gov. An analysis of 50 trials of eight antiviral drugs tested against COVID-19 with a completion date of at least 2 years ago revealed that only 18% had their results published in the registry, with 40% not publishing any results. Non-timely and non-reporting practices undermine patient participation and are ethically unacceptable. Strategies should include obligatory reporting of summary results within 12 months in clinical trial registries, with progress towards peer-reviewed publication within 24 months indicated. Timely publication of research papers should be encouraged through an automated flagging mechanism in clinical trial registries that draws attention to the status of results reporting, such as a green tick for trials that have reported summary results within 12 months and a red tick in case of failure to do so. We propose the inclusion of mandatory clinical trial reporting standards in the International Conference on Harmonization Good Clinical Practice guidelines, which should prohibit sponsor contract clauses that restrict reporting (referred to as gag clauses) and require timely reporting of results as part of the ethics committees' clearance process for clinical trial protocols.

Automated diagnosis of autism with artificial intelligence: State of the art

Autism spectrum disorder (ASD) represents a panel of conditions that begin during the developmental period and result in impairments of personal, social, academic, or occupational functioning. Early diagnosis is directly related to a better prognosis. Unfortunately, the diagnosis of ASD requires a long and exhausting subjective process. We aimed to review the state of the art for automated autism diagnosis and recognition in this research. In February 2022, we searched multiple databases and sources of gray literature for eligible studies. We used an adapted version of the QUADAS-2 tool to assess the risk of bias in the studies. A brief report of the methods and results of each study is presented. Data were synthesized for each modality separately using the Split Component Synthesis (SCS) method. We assessed heterogeneity using the I 2 statistics and evaluated publication bias using trim and fill tests combined with ln DOR. Confidence in cumulative evidence was assessed using the GRADE approach for diagnostic studies. We included 344 studies from 186,020 participants (51,129 are estimated to be unique) for nine different modalities in this review, from which 232 reported sufficient data for meta-analysis. The area under the curve was in the range of 0.71-0.90 for all the modalities. The studies on EEG data provided the best accuracy, with the area under the curve ranging between 0.85 and 0.93. We found that the literature is rife with bias and methodological/reporting flaws. Recommendations are provided for future research to provide better studies and fill in the current knowledge gaps.

Anticancer drug-induced interstitial lung disease: a critical appraisal of clinical practice guidelines and consensus statements

Anticancer drug-induced interstitial lung disease (DIILD) has received increasing clinical attention, and the quality of relevant guidance documents has become critical. Our purpose was to assess the quality of documents for anticancer DIILD and summarize the recommendations. Clinical practice guidelines (CPGs) and consensus statements with recommendations were searched in electronic databases, websites of guideline organizations, and professional societies. The quality of documents was assessed using the Appraisal of Guidelines for Research & Evaluation II (AGREE II) methodology, and the specific recommendations were aggregated and compared. A total of 11 documents were eligible, including 6 CPGs and 5 consensus statements, and the quality of AGREE II assessments differed greatly. The domains of scope and purpose and clarity of presentation received the highest median scores, while the stakeholder involvement domain received the lowest score. Recommendations were inconsistent between documents, particularly regarding the selection of steroid regimens. The methodological quality of the guidance documents needs to be enhanced, especially in the domain of stakeholder involvement. Inconsistencies exist in documents, and further discussions among multidisciplinary experts are needed. Particularly, differences in steroid regimens require attentions, and researches on the risks of adverse events and discovery of precise biomarkers are necessary.

Effects of internet-based digital health interventions on the physical activity and quality of life of colorectal cancer survivors: a systematic review and meta-analysis

PURPOSE

The recent trend of Internet-based digital health interventions has driven researchers to implement them to promote physical activity (PA) and improve patients' health outcomes. This systematic review and meta-analysis aim to evaluate the effects of Internet-based digital health interventions on PA and quality of life (QoL) in colorectal cancer (CRC) survivors.

METHODS

We searched for relevant studies investigating the effects of internet-based digital health interventions published until Dec. 2022 in electronic databases (PubMed, CINAHL, EMBASE, Cochrane Central Register of Controlled Trials, and CEPS) according to PRISMA guidelines. The Joanna Briggs Institute critical appraisal checklist was used to examine the quality of the included studies. We performed the fixed and random effects model for meta-analysis.

RESULTS

Among 746 identified studies, eight published between 2018 and 2022 were included. These covered 991 internet-based digital health interventions and 875 controls. After 6 months of internet-based digital health interventions, CRC survivors' performance in PA (standardized mean difference (SMD) = 0.23, 95% confidence interval [CI] = 0.09-0.38) and QoL (SMD = 0.11, 95% CI = 0.01-0.22) indicators improved significantly.

CONCLUSIONS

Internet-based digital health improved the PA behaviour and QoL of patients with CRC. Because of differences in intervention outcomes, additional randomized controlled trials are warranted to provide suggestions for clinical practice. Internet-based digital health interventions are promising for promoting PA in CRC survivors.

Variation observed in consensus judgments between pairs of reviewers when assessing the risk of bias due to missing evidence in a sample of published meta-analyses of nutrition research

OBJECTIVES

To evaluate the risk of bias due to missing evidence in a sample of published meta-analyses of nutrition research using the Risk Of Bias due to Missing Evidence (ROB-ME) tool and determine inter-rater agreement in assessments.

STUDY DESIGN AND SETTING

We assembled a random sample of 42 meta-analyses of nutrition research. Eight assessors were randomly assigned to one of four pairs. Each pair assessed 21 randomly assigned meta-analyses, and each meta-analysis was assessed by two pairs. We calculated raw percentage agreement and chance corrected agreement using Gwet's Agreement Coefficient (AC) in consensus judgments between pairs.

RESULTS

Across the eight signaling questions in the ROB-ME tool, raw percentage agreement ranged from 52% to 100%, and Gwet's AC ranged from 0.39 to 0.76. For the risk-of-bias judgment, the raw percentage agreement was 76% (95% confidence interval 60% to 92%) and Gwet's AC was 0.47 (95% confidence interval 0.14 to 0.80). In seven (17%) meta-analyses, either one or both pairs judged the risk of bias due to missing evidence as "low risk".

CONCLUSION

Our findings indicated substantial variation in assessments in consensus judgments between pairs for the signaling questions and overall risk-of-bias judgments. More tutorials and training are needed to help researchers apply the ROB-ME tool more consistently.

Unpublished clinical trials of common rheumatic diseases

OBJECTIVES

Randomized controlled trials (RCTs) provide high-quality evidence for treatment efficacy, but many RCTs remain unpublished. The objective of this study was to describe the proportion of unpublished RCTs in five rheumatic diseases and to identify factors associated with publication.

METHODS

Registered RCTs for five rheumatic diseases (SLE, vasculitis, spondyloarthritis, SS and PsA) with over 30 months since study completion were identified using ClinicalTrials.gov. Index publications were identified by NCT ID numbers and structured text searches of publication databases. The results of unpublished studies were identified in abstracts and press releases; reasons for non-publication were assessed by surveying corresponding authors.

RESULTS

Out of 203 studies that met eligibility criteria, 17.2% remained unpublished, representing data from 4281 trial participants. Higher proportions of published trials were phase 3 RCTs (57.1% vs 28.6% unpublished, P < 0.05) or had a positive primary outcome measure (64.9% vs 25.7% unpublished, P < 0.001). In a multivariable Cox proportional hazards model, a positive outcome was independently associated with publication (hazard ratio 1.55; 95% CI: 1.09, 2.22). Corresponding authors of 10 unpublished trials cited ongoing preparation of the manuscript (50.0%), sponsor/funder issues (40.0%) and unimportant/negative result (20.0%) as reasons for lack of publication.

CONCLUSIONS

Nearly one in five RCTs in rheumatology remain unpublished 2 years after trial completion, and publication is associated with positive primary outcome measures. Efforts to encourage universal publication of rheumatology RCTs and reanalysis of previously unpublished trials should be undertaken.

The importance of appraising articles and conducting psychiatric journal clubs

OBJECTIVE

To describe the importance of scientifically rigorous journal clubs in psychiatric education, and to provide a framework to effectively run journal clubs and appraise articles in a journal club format. This paper explores the concept of journal clubs and describes issues with the current state of academic science. It then lists factors associated with effectiveness of journal clubs and outlines a structure for appraising articles relevant to psychiatric practice in a journal club format.

CONCLUSIONS

Current models of academic research and publishing, which can reward practices vulnerable to multiple forms of bias, make the consistent and valued use of journal clubs in psychiatric education and continuing professional development more important than ever. The literature shows that journal clubs can provide a valuable forum for mental health clinicians to update themselves on recent medical and scientific knowledge, while practicing and teaching skills in critical appraisal of research, statistics, clinical decision-making and epidemiology.

The Relative Age Effect at Different Age Periods in Soccer: A Meta-Analysis

In the selection of young athletes, earlier-born adolescents often leverage their temporary biological advantage over their later-born peers from the same cohort, giving rise to the phenomenon known as the Relative Age Effect (RAE). In this study, we delved into the complexities of the RAE in soccer by reviewing 563 independent research samples across 90 articles. Our analysis showed that age period and performance level are pivotal factors influencing the magnitude of the RAE. The adolescent age period emerged as a significant RAE determinant, showcasing the highest effect size magnitudes in our findings. Among athletes of different performance levels, adult European soccer players have been extensively studied, and they have exhibited the most pronounced RAE magnitudes. Intriguingly, our findings reveal another compelling trend: the frequency of players born early versus late in the eligible birth year escalated as player performance levels increased, particularly during adolescence. Coaches and players appear to capitalize unconsciously on this maturational advantage, though this strategy wanes post-adolescence. While there are currently no penalties for this team selection practice, our findings stress the need for coaches to comprehend the ramifications of selecting athletes with an age bias We offer insights into RAE complexities, highlight the synergy of age and performance in these transitory advantages, and advance arguments for more fairly selecting and developing youth athletes.

A systematic review of Intensive Comprehensive Aphasia Programmes - who takes part, what is measured, what are the outcomes?

PURPOSE

This study synthesizes participant and outcome data from peer-reviewed Intensive Comprehensive Aphasia Programme (ICAP) studies.

METHODS

A systematic review was conducted following PRISMA guidelines. Study eligibility criteria were specified in relation to population, intervention, comparison, outcome, and design considerations. Data were extracted according to six research questions. Narrative synthesis was used.

RESULTS

Twenty-one studies were included covering 13 ICAPs (N = 485, aged 18-86 years, between 11 and 335 months post-stroke). Twenty-seven participant selection criteria were identified. Fifty-six outcome measures spanning the WHO-ICF were used, with the majority assessing the body function domain. Only eight studies employed an experimental design with data appropriate for analysis and synthesis. Risk of bias was noted across this sub-group. Participants improved in word-finding, communication, activity/participation, and communication-related quality of life, and maintained their gains; however, except for word finding, evidence of effect came from isolated studies. Factors influencing outcomes were rarely considered. Some drop-outs, missed sessions, and fatigue were noted. Some studies reported IPD alongside group analyses.

CONCLUSIONS

ICAP selection criteria need justification and should contribute to the understanding of candidacy for this treatment model. Rationalisation of ICAP treatment content and outcome measurement is required, spanning all WHO-ICF domains. Employment of the core outcome set for aphasia would enable data synthesis and facilitate comparisons between the ICAP and other therapy models.

The role of results in deciding to publish: A direct comparison across authors, reviewers, and editors based on an online survey

BACKGROUND

Publishing study results in scientific journals has been the standard way of disseminating science. However, getting results published may depend on their statistical significance. The consequence of this is that the representation of scientific knowledge might be biased. This type of bias has been called publication bias. The main objective of the present study is to get more insight into publication bias by examining it at the author, reviewer, and editor level. Additionally, we make a direct comparison between publication bias induced by authors, by reviewers, and by editors. We approached our participants by e-mail, asking them to fill out an online survey.

RESULTS

Our findings suggest that statistically significant findings have a higher likelihood to be published than statistically non-significant findings, because (1) authors (n = 65) are more likely to write up and submit articles with significant results compared to articles with non-significant results (median effect size 1.10, BF10 = 1.09*107); (2) reviewers (n = 60) give more favourable reviews to articles with significant results compared to articles with non-significant results (median effect size 0.58, BF10 = 4.73*102); and (3) editors (n = 171) are more likely to accept for publication articles with significant results compared to articles with non-significant results (median effect size, 0.94, BF10 = 7.63*107). Evidence on differences in the relative contributions to publication bias by authors, reviewers, and editors is ambiguous (editors vs reviewers: BF10 = 0.31, reviewers vs authors: BF10 = 3.11, and editors vs authors: BF10 = 0.42).

DISCUSSION

One of the main limitations was that rather than investigating publication bias directly, we studied potential for publication bias. Another limitation was the low response rate to the survey.

Open Science Standards at Journals that Inform Evidence-Based Policy

Evidence-based policy uses intervention research to inform consequential decisions about resource allocation. Research findings are often published in peer-reviewed journals. Because detrimental research practices associated with closed science are common, journal articles report more false-positives and exaggerated effect sizes than would be desirable. Journal implementation of standards that promote open science-such as the transparency and openness promotion (TOP) guidelines-could reduce detrimental research practices and improve the trustworthiness of research evidence on intervention effectiveness. We evaluated TOP implementation at 339 peer-reviewed journals that have been used to identify evidence-based interventions for policymaking and programmatic decisions. Each of ten open science standards in TOP was not implemented in most journals' policies (instructions to authors), procedures (manuscript submission systems), or practices (published articles). Journals implementing at least one standard typically encouraged, but did not require, an open science practice. We discuss why and how journals could improve implementation of open science standards to safeguard evidence-based policy.

Depression screening tool accuracy individual participant data meta-analyses: data contribution was associated with multiple factors

OBJECTIVES

To examine the proportion of eligible primary studies that contributed data, study characteristics associated with data contribution, and reasons for noncontribution using diagnostic test accuracy Individual Participant Data Meta-Analysis (IPDMA) data sets from the DEPRESsion Screening Data project.

STUDY DESIGN AND SETTING

We reviewed data set contributions from four IPDMAs. A multivariable logistic regression model was fitted to evaluate study factors associated with data contribution.

RESULTS

Of 456 eligible studies from four included IPDMAs, 295 (65%) contributed data. More recent year of publication and higher journal impact factor were associated with greater odds of data contribution. Studies conducted in Europe (excluding the United Kingdom), Oceania, Canada, the Middle East, Africa, and Central or South America (reference = the United States), that have recruitment from inpatient care or nonmedical settings (reference = outpatient), that reported screening accuracy results, or that drew negative conclusions (reference = positive conclusions) were more likely to contribute data. Studies of the Geriatric Depression Scale (reference = the Patient Health Questionnaire) or lacking funding information were negatively associated with data contribution. Over 80% of noncontributions were due to authors being unreachable or data being unavailable.

CONCLUSION

The study identified factors associated with data contribution that may support future research to promote data contribution to IPDMAs.

Functional Family Therapy for families of youth (age 11-18) with behaviour problems: A systematic review and meta-analysis

Background

Functional Family Therapy (FFT) is a short-term family-based intervention for youth with behaviour problems. FFT has been widely implemented in the USA and other high-income countries. It is often described as an evidence-based program with consistent, positive effects.

Objectives

We aimed to synthesise the best available data to assess the effectiveness of FFT for families of youth with behaviour problems.

Search Methods

Searches were performed in 2013-2014 and August 2020. We searched 22 bibliographic databases (including PsycINFO, ERIC, MEDLINE, Science Direct, Sociological Abstracts, Social Services Abstracts, World CAT dissertations and theses, and the Web of Science Core Collection), as well as government policy databanks and professional websites. Reference lists of articles were examined, and experts were contacted to search for missing information.

Selection Criteria

We included randomised controlled trials (RCTs) and quasi-experimental designs (QEDs) with parallel cohorts and statistical controls for between-group differences at baseline. Participants were families of young people aged 11-18 with behaviour problems. FFT programmes were compared with usual services, alternative treatment, and no treatment. There were no publication, geographic, or language restrictions.

Data Collection and Analysis

Two reviewers independently screened 1039 titles and abstracts, read all available study reports, assessed study eligibility, and extracted data onto structured electronic forms. We assessed risks of bias (ROB) using modified versions of the Cochrane ROB tool and the What Works Clearinghouse standards. Where possible, we used random effects models with inverse variance weights to pool results across studies. We used odds ratios for dichotomous outcomes and standardised mean differences for continuous outcomes. We used Hedges g to adjust for small sample sizes. We assessed the heterogeneity of effects with χ 2 and I 2. We produced separate forest plots for conceptually distinct outcomes and for different endpoints (<9, 9-14, 15-23, and 24-42 months after referral). We grouped studies by study design (RCT or QED), and then assessed differences between these two subgroups of studies with χ 2 tests. We generated robust variance estimates, using correlated effects (CE) models with small sample corrections to synthesise all available outcome data. Exploratory CE analyses assessed potential moderators of effects within these domains. We used GRADE guidelines to assess the certainty of evidence on six primary outcomes at 1 year after referral.

Main Results

Twenty studies (14 RCTs and 6 QEDs) met our inclusion criteria. Fifteen of these studies provided some valid data for meta-analysis; these studies included 10,980 families in relevant FFT and comparison groups. All included studies had high risks of bias on at least one indicator. Half of the studies had high risks of bias on baseline equivalence, support for intent-to-treat analysis, selective reporting, and conflicts of interest. Fifteen studies had incomplete reporting of outcomes and endpoints. Using the GRADE rubric, we found that the certainty of evidence for FFT was very low for all of our primary outcomes. Using pairwise meta-analysis, we found no evidence of effects of FFT compared with other active treatments on any primary or secondary outcomes. Primary outcomes were: recidivism, out-of-home placement, internalising behaviour problems, external behaviour problems, self-reported delinquency, and drug or alcohol use. Secondary outcomes were: peer relations and prosocial behaviour, youth self esteem, parent symptoms and behaviour, family functioning, school attendance, and school performance. There were few studies in the pairwise meta-analysis (k < 7) and little heterogeneity of effects across studies in most of these analyses. There were few differences between effect estimates obtained in RCTs versus QEDs. More comprehensive CE models showed positive results of FFT in some domains and negative results in others, but these effects were small (standardised mean difference [SMD] <|0.20|) and not significantly different from no effect with one exception: Two studies found positive effects of FFT on youth substance abuse and two studies found null results in this domain, and the overall effect estimate for this outcome was statistically different from zero. Over all outcomes (15 studies and 293 effect sizes), small positive effects were detected (SMD = 0.19, SE = 0.09), but these were not significantly different from zero effect. Prediction intervals showed that future FFT evaluations are likely to produce a wide range of results, including moderate negative effects and strong positive results (-0.37 to 0.75).

Authors’ Conclusions

Results of 10 RCTs and five QEDs show that FFT does not produce consistent benefits or harms for youth with behavioural problems and their families. The positive or negative direction of results is inconsistent within and across studies. Most outcomes are not fully reported, the quality of available evidence is suboptimal, and the certainty of this evidence is very low. Overall estimates of effects of FFT may be inflated, due to selective reporting and publication biases.

Artificial Intelligence in Scientific Writing: A Deuteragonistic Role?

In this article, we reflect on the pros and cons of artificial intelligence (AI)-augmented scientific writing for more comprehensible research towards society to gain trust for science-led policy. For this purpose, we integrated our thoughts into the Factors of Perceived Trustworthiness from Mayer, Davis, and Schoorman's Model of Trust and made propositions to define AI's role in trustful scholarly communication.

Atrial fibrillation in vascular surgery: a systematic review and meta-analysis on prevalence, incidence and outcome implications

AIMS

To know the prevalence of atrial fibrillation (AF), as well as the incidence of postoperative AF (POAF) in vascular surgery for arterial diseases and its outcome implications.

METHODS

We performed a systematic review and meta-analysis following the PRISMA statement.

RESULTS

After the selection process, we analyzed 44 records (30 for the prevalence of AF history and 14 for the incidence of POAF).The prevalence of history of AF was 11.5% [95% confidence interval (CI) 1-13.3] with high heterogeneity (I2 = 100%). Prevalence was higher in the case of endovascular procedures. History of AF was associated with a worse outcome in terms of in-hospital death [odds ratio (OR) 3.29; 95% CI 2.66-4.06; P < 0.0001; I2 94%] or stroke (OR 1.61; 95% CI 1.39-1.86; P < 0.0001; I2 91%).The pooled incidence of POAF was 3.6% (95% CI 2-6.4) with high heterogeneity (I2 = 100%). POAF risk was associated with older age (mean difference 4.67 years, 95% CI 2.38-6.96; P = 0.00007). The risk of POAF was lower in patients treated with endovascular procedures as compared with an open surgical procedure (OR 0.35; 95% CI 0.13-0.91; P = 0.03; I2 = 61%).

CONCLUSIONS

In the setting of vascular surgery for arterial diseases a history of AF is found overall in 11.5% of patients, more frequently in the case of endovascular procedures, and is associated with worse outcomes in terms of short-term mortality and stroke.The incidence of POAF is overall 3.6%, and is lower in patients treated with an endovascular procedure as compared with open surgery procedures. The need for oral anticoagulants for preventing AF-related stroke should be evaluated with randomized clinical trials.

Adolescents' needs for information and psychosocial support during their mother's breast cancer trajectory: A systematic review

OBJECTIVE

Breast cancer is the most common cancer diagnosis among women. The acute crisis and uncertainty that often follow diagnosis put the family at risk of exhaustion and dysfunction. Adolescents have been identified as a particularly vulnerable group of relatives. To investigate how to prevent distress in this group, we systematically reviewed research on adolescents' (11-21 years) needs for information and psycho-social support during their mothers' breast cancer trajectory.

METHOD

Systematic searches were conducted in five bibliometric databases. Peer-reviewed, original research of adolescents aged 11-21 with a mother diagnosed with breast cancer was included. Two researchers conducted screening, quality assessment, and data extraction independently. Thematic synthesis was applied to the included studies.

RESULTS

A total of 8066 studies were screened, and five quantitative and six qualitative studies were included. The results indicated that adolescents' information and psycho-social support needs were poorly met. Many were reluctant to share feelings with family and peers and experienced abandonment during the crisis. Adolescents who were not well informed experienced distress. Poor family functioning increased the level of adolescents' distress.

CONCLUSIONS

Despite limitations regarding heterogeneity among the studies, eligibility criteria, and quality assessment, this review provides clear clinical implications. Encounter groups may support adolescents during their mother's breast cancer trajectory. Furthermore, healthcare professionals could provide more indirect support to adolescents by providing support and clearer guidelines to parents. Finally, adolescents from poor-functioning families need extra attention.

Characterization of controlled trials on probiotic supplementation to dairy calves: A scoping review

The objective of this scoping review was to identify, describe, and characterize the literature on probiotic supplementation in dairy calves. Eligible studies were nonrandomized, quasi-randomized and randomized controlled trials in English, Spanish, or Portuguese that evaluated the effect of probiotic supplementation on growth and health of dairy calves. The search strategies were based on a modification of the PICO (Population, Intervention, Comparator, Outcome) framework and used synonyms and words related to "dairy calves" (population), "probiotics" (intervention), and "growth and health measurements" (outcomes). No restrictions for publication year or language were applied. Searches were conducted in Biosis, CAB Abstracts, Medline, Scopus, and the Dissertations and Theses Database. In total, the search identified 4,467 records, of which 103 studies (110 controlled trials) met the inclusion criteria. The studies were published between 1980 and 2021 and originated from 28 countries. Trials were randomized (80.0%), nonrandomized (16.4%), and quasi-randomized (3.6%), ranging in sample size from 5 to 1,801 dairy calves (mode = 24; average = 64). Enrolled calves were frequently Holstein (74.5%), males (43.6%), and younger than 15 d at the beginning of probiotic supplementation (71.8%). Often, trials were conducted in research facilities (47.3%). Trials evaluated probiotics with single or multiple species of the same genus: Lactobacillus (26.4%), Saccharomyces (15.4%), Bacillus (10.0%), Enterococcus (3.6%), or multiple species of various genera (31.8%). Eight trials did not report the probiotic species used. Lactobacillus acidophilus and Enterococcus faecium were the species most supplemented to calves. The duration of probiotic supplementation ranged from 1 to 462 d (mode = 56; average = 50). In trials with a constant dose, it ranged from 4.0 × 106 to 3.7 × 1011 cfu/calf per day. Most probiotics were administered mixed solely into feed (88.5%; whole milk, milk replacer, starter, or total mixed ration) and less frequently orally as a drench or oral paste (7.9%). Most trials evaluated weight gain (88.2%) as a growth indicator and fecal consistency score (64.5%) as a health indicator. Our scoping review summarizes the breadth of controlled trials evaluating probiotic supplementation in dairy calves. Differences in intervention design (mode of probiotic administration, dose, and duration of probiotic supplementation) and outcomes evaluation (type and methods) justify future efforts toward standardized guidelines in clinical trials.

Revegetation through seeding or planting: A worldwide systematic map

Roughly 2 billion ha of land are degraded and in need of ecological restoration worldwide. Active restoration frequently involves revegetation, which leads to the dilemma of whether to conduct direct seeding or to plant nursery-grown seedlings. The choice of revegetation method can regulate plant survival and performance, with economic implications that ultimately feed back to our capacity to conduct restoration. We followed a peer-reviewed protocol to develop a systematic map that collates, describes and catalogues the available studies on how seeding compares to planting in achieving restoration targets. We compiled a database with the characteristics of all retrieved studies, which can be searched to identify studies of particular locations and habitats, objectives of restoration, plant material, technical aspects, and outcomes measured. The search was made in eight languages and retrieved 3355 publications, of which 178 were retained. The systematic map identifies research gaps, such as a lack of studies in the global South, in tropical rainforests, and covering a long time period, which represent opportunities to expand field-based research. Additionally, many studies overlooked reporting on important technical aspects such as seed provenance and nursery cultivation methods, and others such as watering or seedling protection were more frequently applied for planting than for seeding, which limits our capacity to learn from past research. Most studies measured outcomes related to the target plants but avoided measuring general restoration outcomes or economic aspects. This represents a relevant gap in research, as the choice of revegetation method is greatly based on economic aspects and the achievement of restoration goals goes beyond the establishment of plants. Finally, we identified a substantial volume of studies conducted in temperate regions and over short periods (0-5 y). This research cluster calls for a future in-depth synthesis, potentially through meta-analysis, to reveal the overall balance between seeding and planting and assess whether the response to this question is mediated by species traits, environmental characteristics, or technical aspects. Besides identifying research clusters and gaps, the systematic map database allows managers to find the most relevant scientific literature on the appropriateness of seeding vs. planting for particular conditions, such as certain species or habitats.

Statistical power in clinical trials of interventions for mood, anxiety, and psychotic disorders

BACKGROUND

Previous research has suggested that statistical power is suboptimal in many biomedical disciplines, but it is unclear whether power is better in trials for particular interventions, disorders, or outcome types. We therefore performed a detailed examination of power in trials of psychotherapy, pharmacotherapy, and complementary and alternative medicine (CAM) for mood, anxiety, and psychotic disorders.

METHODS

We extracted data from the Cochrane Database of Systematic Reviews (Mental Health). We focused on continuous efficacy outcomes and estimated power to detect predetermined effect sizes (standardized mean difference [SMD] = 0.20-0.80, primary SMD = 0.40) and meta-analytic effect sizes (ESMA). We performed meta-regression to estimate the influence of including underpowered studies in meta-analyses.

RESULTS

We included 256 reviews with 10 686 meta-analyses and 47 384 studies. Statistical power for continuous efficacy outcomes was very low across intervention and disorder types (overall median [IQR] power for SMD = 0.40: 0.32 [0.19-0.54]; for ESMA: 0.23 [0.09-0.58]), only reaching conventionally acceptable levels (80%) for SMD = 0.80. Median power to detect the ESMA was higher in treatment-as-usual (TAU)/waitlist-controlled (0.49-0.63) or placebo-controlled (0.12-0.38) trials than in trials comparing active treatments (0.07-0.13). Adequately-powered studies produced smaller effect sizes than underpowered studies (B = -0.06, p ⩽ 0.001).

CONCLUSIONS

Power to detect both predetermined and meta-analytic effect sizes in psychiatric trials was low across all interventions and disorders examined. Consistent with the presence of reporting bias, underpowered studies produced larger effect sizes than adequately-powered studies. These results emphasize the need to increase sample sizes and to reduce reporting bias against studies reporting null results to improve the reliability of the published literature.

Objective response rate targets for recurrent glioblastoma clinical trials based on the historic association between objective response rate and median overall survival

Durable objective response rate (ORR) remains a meaningful endpoint in recurrent cancer; however, the target ORR for single-arm recurrent glioblastoma trials has not been based on historic information or tied to patient outcomes. The current study reviewed 68 treatment arms comprising 4793 patients in past trials in recurrent glioblastoma in order to judiciously define target ORRs for use in recurrent glioblastoma trials. ORR was estimated at 6.1% [95% CI 4.23; 8.76%] for cytotoxic chemothera + pies (ORR = 7.59% for lomustine, 7.57% for temozolomide, 0.64% for irinotecan, and 5.32% for other agents), 3.37% for biologic agents, 7.97% for (select) immunotherapies, and 26.8% for anti-angiogenic agents. ORRs were significantly correlated with median overall survival (mOS) across chemotherapy (R2= 0.4078, P < .0001), biologics (R2= 0.4003, P = .0003), and immunotherapy trials (R2= 0.8994, P < .0001), but not anti-angiogenic agents (R2= 0, P = .8937). Pooling data from chemotherapy, biologics, and immunotherapy trials, a meta-analysis indicated a strong correlation between ORR and mOS (R2= 0.3900, P < .0001; mOS [weeks] = 1.4xORR + 24.8). Assuming an ineffective cytotoxic (control) therapy has ORR = 7.6%, the average ORR for lomustine and temozolomide trials, a sample size of ≥40 patients with target ORR>25% is needed to demonstrate statistical significance compared to control with a high level of confidence (P < .01) and adequate power (>80%). Given this historic data and potential biases in patient selection, we recommend that well-controlled, single-arm phase II studies in recurrent glioblastoma should have a target ORR >25% (which translates to a median OS of approximately 15 months) and a sample size of ≥40 patients, in order to convincingly demonstrate antitumor activity. Crucially, this response needs to have sufficient durability, which was not addressed in the current study.

PROTOCOL: Assessment of outcome reporting bias in studies included in Campbell systematic reviews

This is the protocol for a Campbell systematic review. The objectives are as follows: To identify methods used to assess the risk of outcome reporting bias (ORB) in studies included in recent Campbell systematic reviews of intervention effects. The review will answer the following questions: What proportion of recent Campbell reviews included assessment of ORB? How did recent reviews define levels of risk of ORB (what categories, labels, and definitions did they use)? To what extent and how did these reviews use study protocols as sources of data on ORB? To what extent and how did reviews document reasons for judgments about risk of ORB? To what extent and how did reviews assess the inter-rater reliability of ORB ratings? To what extent and how were issues of ORB considered in the review's abstract, plain language summary, and conclusions?

Efficacy of Percutaneous Adhesiolysis in Managing Low Back and Lower Extremity Pain: A Systematic Review and Meta-analysis of Randomized Controlled Trials

INTRODUCTION

Chronic refractory low back and lower extremity pain recalcitrant to conservative management and epidural injections secondary to postsurgery syndrome, spinal stenosis, and disc herniation are sometimes managed with percutaneous adhesiolysis. Consequently, this systematic review and meta-analysis was undertaken to assess the efficacy of percutaneous adhesiolysis in managing low back and lower extremity pain.

METHODS

A systematic review and meta-analysis of randomized controlled trials (RCTs) utilizing the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) checklist was performed. A comprehensive literature search of multiple databases from 1966 to July 2022, including manual searches of the bibliography of known review articles was performed. Quality assessment of the included trials, meta-analysis, and best evidence synthesis was performed. The primary outcome measure was a significant reduction in pain (short term up to 6 months and long term more than 6 months).

RESULTS

The search identified 26 publications, with 9 trials meeting the inclusion criteria. The results of dual-arm and single-arm analyses showed significant improvement in pain and function at 12 months. Opioid consumption was also significantly reduced at 6 months with dual-arm analysis, whereas single-arm analysis showed a significant decrease from baseline to treatment at the 3-, 6-, and 12-month analyses. At 1 year follow-up, seven of seven trials were positive for improvements in pain relief, function, and diminution of opioid use.

DISCUSSION

Based on the present systematic review of nine RCTs, the evidence level is I to II, with moderate to strong recommendation for percutaneous adhesiolysis in managing low back and lower extremity pain. The limitations of the evidence include paucity of literature, lack of placebo-controlled trials, and the majority of the trials studying post lumbar surgery syndrome.

CONCLUSION

The evidence is level I to II or strong to moderate based on five high-quality and two moderate-quality RCTs, with 1 year follow-up that percutaneous adhesiolysis is efficacious in the treatment of chronic refractory low back and lower extremity pain.

Safety and feasibility of exercise interventions in patients with hematological cancer undergoing chemotherapy: a systematic review

OBJECTIVE

Exercise during and after cancer treatment has established quality of life and health benefits. However, particularly for patients with hematological cancer clear recommendations regarding the safety and feasibility of exercise are under-investigated. The aim of our systematic review was to summarize the literature regarding the feasibility and safety of exercise interventions in patients diagnosed with hematological cancer undergoing chemotherapy.

METHOD

A systematic literature review was conducted using PubMed, SPORTDiscus, MEDLINE, Science Direct, and Web of Science electronic databases. Eligible studies were scientific publications reporting the feasibility and/or safety of an exercise intervention program carried out in inpatient patients diagnosed with hematological cancer undergoing chemotherapy.

RESULT

Out of 12 studies (six RCTs) included in this review, six investigations reported results with regard to safety and 10 with regard to feasibility. While all studies claim that their exercise interventions were safe and/or feasible, it is noteworthy that this claim often remains unsupported as detailed information on how the feasibility of the intervention was asserted is missing.

CONCLUSION

Exercise appears to be safe and feasible in hematological cancer patients. However, due to a striking lack of information on how the feasibility of the intervention was asserted, contextualizing the results and deducing recommendations for further studies remains challenging. Further research should therefore incorporate information on the execution of the exercise intervention in more detail.

The Consistency between Registered Acupuncture-Moxibustion Clinical Studies and Their Published Studies and Update Status of Registered Information

BACKGROUND

Few studies have analyzed the consistency between registered acupuncture-moxibustion clinical studies and their published research results as well as their update status of registered information.

METHODS

We searched for acupuncture-moxibustion clinical studies that were registered at the World Health Organization International Clinical Trials Registry Platform between 2013 and 2015 and collected data regarding their characteristics and update status. Published results of these registered studies were identified and compared with registered information.

RESULTS

A total of 425 registered acupuncture-moxibustion clinical studies were included; 379 (89.2%) of them were interventional studies, and the remaining 46 (10.8%) were observational studies. Forty-six studies (10.8%) were found to have published results, and 51 published articles were identified. Overall, 73.2% (311) of registered studies did not update the research status in time; 46.6% (198) stopped updating before recruiting; 21.6% (92) stopped updating after recruiting; and 4.9% (21) stopped updating after completion. Regarding the 46 studies with published results, 29 (63.0%) were considered to be affected by reporting bias. These reporting biases predominantly involved the omission of some predefined outcomes or endpoints (16 studies), contradictions regarding descriptions of sample sizes (9 studies), discrepancies in treatment measurements or group distribution (7 studies), and inconsistent treatment durations (4 studies). When compared with other studies, significant and various reporting biases could also be commonly found in fields other than acupuncture-moxibustion.

CONCLUSIONS

There were many discrepancies between registered information and published reports on acupuncture-moxibustion, which could also be commonly observed in other fields. Moreover, a large proportion of registered studies did not update their research status in time. Efforts should be made to improve the reporting quality and timely updates.

Hintergrund

Es gibt nur wenige Studien, in denen die Übereinstimmung zwischen den registrierten klinischen Studien zur Akupunktur und Moxibustion mit den veröffentlichten Studienergebnissen und dem Aktualisierungsstand der Informationen im Register untersucht wurde.

Methoden

Wir suchten nach klinischen Studien zur Akupunktur und Moxibustion, die zwischen 2013 und 2015 auf der International Clinical Trials Registry Platform der Weltgesundheitsorganisation registriert wurden, und erhoben Daten zu ihren Merkmalen und ihrem Aktualisierungsstand. Die veröffentlichten Ergebnisse der registrierten Studien wurden identifiziert und mit den Informationen im Register verglichen.

Ergebnisse

Insgesamt wurden 425 registrierte klinische Studien zur Akupunktur und Moxibustion eingeschlossen, davon waren 379 (89,2 %) Interventionsstudien und die restlichen 46 (10,8 %) waren Beobachtungsstudien. Es wurden 46 Studien (10,8 %) mit veröffentlichten Ergebnissen gefunden und 51 veröffentlichte Artikel identifiziert. Insgesamt wurde bei 73,2 % (311) der registrierten Studien der Forschungsstand nicht zeitnah aktualisiert; bei 46,6 % (198) wurde die Aktualisierung vor der Rekrutierung eingestellt; bei 21,6 % (92) wurde die Aktualisierung nach der Rekrutierung eingestellt und bei 4,9 % (21) wurde die Aktualisierung nach Abschluss der Studie eingestellt. Von den 46 Studien mit veröffentlichten Ergebnissen wurden 29 (63,0 %) als von Publikationsverzerrung betroffen angesehen. Diese Publikationsverzerrung betraf vor allem die Auslassung einiger vordefinierter Zielkriterien oder Endpunkte (16 Studien), Widersprüche bei der Beschreibung des Stichprobenumfangs (9 Studien), Diskrepanzen bei den Behandlungsmessungen oder der Gruppenverteilung (7 Studien) und Inkonsistenzen bei der Behandlungsdauer (4 Studien). Beim Vergleich mit anderen Studien wurden auch in anderen Bereichen als Akupunktur und Moxibustion häufig signifikante und unterschiedliche Publikationsverzerrungen festgestellt.

Schlussfolgerungen

Es bestanden zahlreiche Diskrepanzen zwischen den Informationen im Register und den veröffentlichten Berichten über Akupunktur und Moxibustion, die auch in anderen Bereichen häufig zu beobachten waren. Darüber hinaus wurde bei einem Großteil der registrierten Studien der Forschungsstand nicht zeitnah aktualisiert. Es sollten Anstrengungen unternommen werden, um die Qualität der Berichterstattung und die zeitnahe Aktualisierung zu verbessern.

One-Piece Zirconia Oral Implants for Single Tooth Replacement: Five-Year Results from a Prospective Cohort Study

The intention of this 5-year prospective cohort investigation was to clinically and radiographically investigate the outcomes of a one-piece zirconia implant system for single tooth replacement. Sixty-five patients received a total of 66 single-tooth implants. All implants immediately received temporary restorations and were finally restored with all-ceramic crowns. Follow-ups were performed at the prosthetic delivery, after 1, 3, and 5 years. Peri-implant and dental soft-tissue parameters were evaluated and patient-reported outcomes recorded. To monitor peri-implant bone remodelling, standardised radiographs were taken at the implant insertion and at the 1-, 3-, and 5-year follow-ups. In the course of 5 years, 14 implants were lost, resulting in a cumulative implant survival rate of 78.2%. The mean marginal bone loss from the implant insertion to the 5-year follow-up amounted to 1.12 mm. Probing depth, clinical attachment level, bleeding, and plaque index increased over time. In 91.5% of the implants, the papilla index showed levels of 1 or 2, respectively. At the end of the study, the patient satisfaction was higher compared to the pre-treatment measurements. Due to the low survival rate after five years and the noticeably high frequency of advanced bone loss observed in this study, the implant has not met the launch criteria, as it would have not been recommended for routine clinical use.

A Systematic Literature Review of Complementary and Alternative Veterinary Medicine: Laser Therapy

Light therapy, or photobiomodulation, is a collective name for methods where tissue is irradiated with different types of light, with the aim of stimulating healing. Despite being frequently used, there is no consensus regarding the optimal treatment protocols for light therapy, nor its clinical efficacy. A systematic literature review was conducted, searching the relevant literature regarding light therapy in three databases, published between 1980-2020. The risk of bias in each article was evaluated. Forty-five articles met the inclusion criteria; 24 articles were regarding dogs, 1 was regarding cats, and the rest were regarding horses. The indications for treatment were musculoskeletal and neurologic conditions, skin disease and wounds, and pain. The literature review showed conflicting study results and unclear application for clinical use. This can be explained by the wide variety of treatment parameters used in the searched studies, such as wavelength, laser class, dose, and effect, as well as the frequency and duration of treatment. Although some beneficial effects were reported for light therapy, the studies also had limited scientific quality regarding these therapies, with a high or moderate risk of bias.

Publication bias, time-lag bias, and place-of-publication bias in social intervention research: An exploratory study of 527 Swedish articles published between 1990-2019

Publication and related biases constitute serious threats to the validity of research synthesis. If research syntheses are based on a biased selection of the available research, there is an increased risk of producing misleading results. The purpose fo this study is to explore the extent of positive outcome bias, time-lag bias, and place-of-publication bias in published research on the effects of psychological, social, and behavioral interventions. The results are based on 527 Swedish outcome trials published in peer-reviewed journals between 1990 and 2019. We found no difference in the number of studies reporting significant compared to non-significant findings or in the number of studies reporting strong effect sizes in the published literature. We found no evidence of time-lag bias or place-of-publication bias in our results. The average reported effect size remained constant over time as did the proportion of studies reporting significant effects.

Is It Time to Re-Shift the Research Agenda? A Scoping Review of Participation Rates in Workplace Health Promotion Programs

Workplace health promotion programmes (WHPPs) are among the most important measures to improve the health and motivation of the ageing workforce. However, they are accompanied with certain challenges, such as low participation rates and higher participation levels of the more health-conscious workers, often failing to engage those who need such interventions the most. Following the PRISMA guidelines, this scoping review examined participation rates reported in articles on WHPPs to identify potential knowledge gaps. The results are worrying: participation rates are not only infrequently reported, but also low. Of the 58 articles, 37 report participation rates, with the majority (20) reporting an average participation rate of less than 50%. Reported participation rates refer either to different target groups, the type of intervention, or to single points in time, which makes it difficult to establish consistent criteria for comparison. We argue that despite the importance of WHPP efficacy, research focus should shift to the determinants of participation, as well as the issue of standardising the reporting of participation rates, alongside the potential problem of reporting bias.

Improving evidence-based practice through preregistration of applied research: Barriers and recommendations

Preregistration is the practice of publicly publishing plans on central components of the research process before access to, or collection, of data. Within the context of the replication crisis, open science practices like preregistration have been pivotal in facilitating greater transparency in research. However, such practices have been applied nearly exclusively to basic academic research, with rare consideration of the relevance to applied and consultancy-based research. This is particularly problematic as such research is typically reported with very low levels of transparency and accountability despite being disseminated as influential gray literature to inform practice. Evidence-based practice is best served by an appreciation of multiple sources of quality evidence, thus the current review considers the potential of preregistration to improve both the accessibility and credibility of applied research toward more rigorous evidence-based practice. The current three-part review outlines, first, the opportunities of preregistration for applied research, and second, three barriers - practical challenges, stakeholder roles, and the suitability of preregistration. Last, this review makes four recommendations to overcome these barriers and maximize the opportunities of preregistration for academics, industry, and the structures they are held within - changes to preregistration templates, new types of templates, education and training, and recognition and structural changes.

Surgical versus non-surgical interventions for treating patellar dislocation

BACKGROUND

Patellar (knee cap) dislocation occurs when the patella disengages completely from the trochlear (femoral) groove. It affects up to 42/100,000 people, and is most prevalent in those aged 20 to 30 years old. It is uncertain whether surgical or non-surgical treatment is the best approach. This is important as recurrent dislocation occurs in up to 40% of people who experience a first time (primary) dislocation. This can reduce quality of life and as a result people have to modify their lifestyle. This review is needed to determine whether surgical or non-surgical treatment should be offered to people after patellar dislocation.

OBJECTIVES

To assess the effects (benefits and harms) of surgical versus non-surgical interventions for treating people with primary or recurrent patellar dislocation.

SEARCH METHODS

We searched the Cochrane Bone, Joint and Muscle Trauma Group's Specialised Register, the Cochrane Central Register of Controlled Trials (CENTRAL), MEDLINE, Embase, AMED, CINAHL, Physiotherapy Evidence Database and trial registries in December 2021. We contacted corresponding authors to identify additional studies.

SELECTION CRITERIA

We included randomised and quasi-randomised controlled clinical trials evaluating surgical versus non-surgical interventions for treating primary or recurrent lateral patellar dislocation in adults or children.

DATA COLLECTION AND ANALYSIS

We used standard Cochrane methods. Our primary outcomes were recurrent patellar dislocation, and patient-rated knee and physical function scores. Our secondary outcomes were health-related quality of life, return to former activities, knee pain during activity or at rest, adverse events, patient-reported satisfaction, patient-reported knee instability symptoms and subsequent requirement for knee surgery. We used GRADE to assess the certainty of evidence for each outcome.

MAIN RESULTS

We included 10 studies (eight randomised controlled trials (RCTs) and two quasi-RCTs) of 519 participants with patellar dislocation. The mean ages in the individual studies ranged from 13.0 to 27.2 years. Four studies included children, mainly adolescents, as well as adults; two only recruited children. Study follow-up ranged from one to 14 years. We are unsure of the evidence for all outcomes in this review because we judged the certainty of the evidence to be very low. We downgraded each outcome by three levels. Reasons included imprecision (when fewer than 100 events were reported or the confidence interval (CI) indicated appreciable benefits as well as harms), risk of bias (when studies were at high risk of performance, detection and attrition bias), and inconsistency (in the event that pooled analysis included high levels of statistical heterogeneity). We are uncertain whether surgery lowers the risk of recurrent dislocation following primary patellar dislocation compared with non-surgical management at two to nine year follow-up. Based on an illustrative risk of recurrent dislocation in 348 people per 1000 in the non-surgical group, we found that 157 fewer people per 1000 (95% CI 209 fewer to 87 fewer) had recurrent dislocation between two and nine years after surgery (8 studies, 438 participants). We are uncertain whether surgery improves patient-rated knee and function scores. Studies measured this outcome using different scales (the Tegner activity scale, Knee Injury and Osteoarthritis Outcome Score, Lysholm, Kujala Patellofemoral Disorders score and Hughston visual analogue scale). The most frequently reported score was the Kujala Patellofemoral Disorders score. This indicated people in the surgical group had a mean score of 5.73 points higher at two to nine year follow-up (95% CI 2.91 lower to 14.37 higher; 7 studies, 401 participants). On this 100-point scale, higher scores indicate better function, and a change score of 10 points is considered to be clinically meaningful; therefore, this CI includes a possible meaningful improvement. We are uncertain whether surgery increases the risk of adverse events. Based on an assumed risk of overall incidence of complications during the first two years in 277 people out of 1000 in the non-surgical group, 335 more people per 1000 (95% CI 75 fewer to 723 more) had an adverse event in the surgery group (2 studies, 144 participants). Three studies (176 participants) assessed participant satisfaction at two to nine year follow-up, reporting little difference between groups. Based on an assumed risk of 763 per 1000 non-surgical participants reporting excellent or good outcomes, seven more participants per 1000 (95% CI 199 fewer to 237 more) reported excellent or good satisfaction. Four studies (256 participants) assessed recurrent patellar subluxation at two to nine year follow-up. Based on an assumed risk of patellar subluxation in 292 out of 1000 in the non-surgical group, 73 fewer people per 1000 (95% CI 146 fewer to 35 more) had patellar subluxation as a result of surgery. Slightly more people had subsequent surgery in the non-surgical group. Pooled two to nine year follow-up data from three trials (195 participants) indicated that, based on an assumed risk of subsequent surgery in 215 people per 1000 in the non-surgical group, 118 fewer people per 1000 (95% CI 200 fewer to 372 more) had subsequent surgery after primary surgery.

AUTHORS' CONCLUSIONS

We are uncertain whether surgery improves outcome compared to non-surgical management as the certainty of the evidence was very low. No sufficiently powered trial has examined people with recurrent patellar dislocation. Adequately powered, multicentre, randomised trials are needed. To inform the design and conduct of these trials, expert consensus should be achieved on the minimal description of both surgical and non-surgical interventions, and the pathological variations that may be relevant to both choice of these interventions.

An artificial neural network (ANN) model for publication bias: a machine learning-based study on PubMed meta-analyses

Purpose

No study has investigated the effects of different parameters on publication bias in meta-analyses using a machine learning approach. Therefore, this study aims to evaluate the impact of various factors on publication bias in meta-analyses.

Design/methodology/approach

An electronic questionnaire was created according to some factors extracted from the Cochrane Handbook and AMSTAR-2 tool to identify factors affecting publication bias. Twelve experts were consulted to determine their opinion on the importance of each factor. Each component was evaluated based on its content validity ratio (CVR). In total, 616 meta-analyses comprising 1893 outcomes from PubMed that assessed the presence of publication bias in their reported outcomes were randomly selected to extract their data. The multilayer perceptron (MLP) technique was used in IBM SPSS Modeler 18.0 to construct a prediction model. 70, 15 and 15% of the data were used for the model's training, testing and validation partitions.

Findings

There was a publication bias in 968 (51.14%) outcomes. The established model had an accuracy rate of 86.1%, and all pre-selected nine variables were included in the model. The results showed that the number of databases searched was the most important predictive variable (0.26), followed by the number of searches in the grey literature (0.24), search in Medline (0.17) and advanced search with numerous operators (0.13).

Practical implications

The results of this study can help clinical researchers minimize publication bias in their studies, leading to improved evidence-based medicine.

Originality/value

To the best of the author’s knowledge, this is the first study to model publication bias using machine learning.

Association between Sugar-Sweetened Beverage Consumption and the Risk of the Metabolic Syndrome: A Systematic Review and Meta-Analysis

(1) Background: The increasing occurrence of the metabolic syndrome (MetS) is largely related to harmful food habits. Among them, the consumption of sugar-sweetened beverages (SSBs) is noteworthy. However, to our knowledge, there are not enough high-quality methodological studies summarizing the association between the intake of SSBs and the MetS. Therefore, the aim of this study is to examine the existing published results on this association among adults by synthesizing the existing evidence. (2) Methods: Systematic review and meta-analysis of observational studies following the PRISMA guidelines. Relevant information was extracted and presented following the PRISMA recommendations. PubMed and SCOPUS databases were searched for studies published until June 2022 that assessed the association between SSB consumption (including soft drinks, bottled fruit juices, energy drinks, and milkshakes) and the occurrence of MetS. Random effect models were used to estimate pooled odds ratios (ORs) with their 95% coefficient interval, and I² was used to assess heterogeneity. (3) Results: A total of 14 publications from 6 different countries were included in this meta-analysis (9 cross-sectional and 5 cohort studies). For the cross-sectional studies, which included 62,693 adults, the pooled OR for the risk of MetS was 1.35 (95% CI 1.15, 1.58; I² 57%) when the highest versus the lowest categories of SSB consumption were compared. For the cohort studies, which included 28,932 adults, the pooled OR was 1.18 (95% CI 1.06, 1.32; I² 70%). (4) Conclusions: The consumption of SSBs was positively associated with an increased risk of MetS. The published literature supports public health strategies and the need to reduce the consumption of SSBs to prevent MetS.

Characteristics and result reporting of registered COVID-19 clinical trials of Chinese and Indian traditional medicine: A comparative analysis

Objective

To assess the main characteristics and result reporting of registered COVID-19 interventional trials of traditional Chinese medicine and traditional Indian medicine.

Materials and methods

We assessed design quality and result reporting of COVID-19 trials of traditional Chinese medicine (TCM) and traditional Indian medicine (TIM) registered before 10 February 2021, respectively, on Chinese Clinical Trial Registry (ChiCTR) and Clinical Trial Registry-India (CTRI). Comparison groups included registered COVID-19 trials of conventional medicine conducted in China (WMC), India (WMI), and in other countries (WMO). Cox regression analysis was used to assess the association between time from trial onset to result reporting and trial characteristics.

Results

The proportion of COVID-19 trials investigating traditional medicine was 33.7% (130/386) among trials registered on ChiCTR, and 58.6% (266/454) on CTRI. Planned sample sizes were mostly small in all COVID-19 trials (median 100, IQR: 50-200). The proportion of trials that were randomized was 75.4 and 64.8%, respectively, for the TCM and TIM trials. Blinding measures were used in 6.2% of the TCM trials, and 23.6% of the TIM trials. Cox regression analysis revealed that planned COVID-19 clinical trials of traditional medicine were less likely to have results reported than trials of conventional medicine (hazard ratio 0.713, 95% confidence interval: 0.541-0.939; p = 0.0162).

Conclusion

There were considerable between-country and within-country differences in design quality, target sample size, trial participants, and reporting of trial results. Registered COVID-19 clinical trials of traditional medicine were less likely to report results than trials of conventional medicine.

Has the degree of outcome reporting bias in surgical randomized trials changed? A meta-regression analysis

BACKGROUND

Outcome reporting bias in individual trials can compromise the validity of pooled estimates within systematic reviews. Recent strategies have attempted to address outcome reporting bias, which favours the full reporting of statistically significant outcomes over non-significant outcomes. We examined whether the association between full outcome reporting and statistical significance in surgical trials has changed from 2009 to 2019.

METHODS

We systematically searched for 350 surgical randomized controlled trials (RCTs) from 2009 and 350 surgical RCTs from 2019. Outcomes were classified as fully reported, partially reported, qualitatively reported or unreported. For each outcome, a contingency table was populated with full outcome reporting (yes/no) and statistical significance (yes/no). We combined odds ratios in random effects meta-analysis to estimate the association between full outcome reporting and statistical significance in 2009 compared with 2019.

RESULTS

Twenty-eight percent of outcomes in 2009 were incompletely reported, compared with 30% in 2019. In 2009, significant outcomes were more likely to be fully reported than non-significant outcomes (OR = 2.4, 95% CI 1.7-3.4, I²  = 35%), but the opposite association was seen in 2019 (OR = 0.51, 95% CI 0.34-0.77, I²  = 43%). RCTs from 2019 were less likely to demonstrate outcome reporting bias favouring significant outcomes (OR = 0.21, 95% CI 0.12-0.35, P < 0.001).

CONCLUSION

Outcome reporting bias favouring the full reporting of significant over non-significant outcomes was demonstrated in 2009, but the opposite association was seen in 2019. There remains a high prevalence of incomplete outcome reporting. We recommend ongoing adherence to trial protocol guidelines to improve outcome reporting transparency and completeness.

E-cigarette manufacturers' compliance with clinical trial reporting expectations: a case series of registered trials by Juul Labs

BACKGROUND

Electronic cigarettes (e-cigarettes) are a frequently debated topic in public health. It is essential that clinical trials examining e-cigarettes are fully and accurately reported, especially given long-standing concerns about tobacco industry research. We assess the reporting of clinical trials sponsored by Juul Labs, the largest e-cigarette company in the USA, against accepted reporting standards.

METHODS

We searched ClinicalTrials.gov for all trials sponsored by Juul Labs and determined those with registry data consistent with coverage by the Food and Drug Administration (FDA) Amendments Act 2007 (FDAAA). For trials with a primary completion date more than 1 year earlier, we searched ClinicalTrials.gov, the academic literature and a Juul-funded research database (JLI Science) for results. For located results, we compared reported outcomes with registered outcomes in line with Consolidated Standards of Reporting Trials (CONSORT) reporting guidelines.

RESULTS

We located five registered trials sponsored by Juul Labs that appeared covered by the FDAAA 2007 in the public data. All five trials did not have results available on ClinicalTrials.gov. We found one publication and four poster presentations reporting results for four of the five covered trials outside of ClinicalTrials.gov. Of 61 specified outcomes, 28 were CONSORT compliant. Specific outcome reporting issues are detailed.

DISCUSSION

Our findings raise substantial concerns regarding these trials. Clinicians, public health professionals, and the public cannot make informed choices about the benefits or hazards of e-cigarettes if the results of clinical trials are not completely and transparently reported. Clarification and potential enforcement of reporting laws may be required.

The trends for the "trend toward significance" in the pediatric literature

Purpose This study is to examine whether the term "trend toward statistical significance" is used to describe statistically nonsignificant results in biomedical literature. We examined articles published in five high-impact pediatric journals, including The Lancet Child & Adolescent Health, The Journal of Pediatrics, Early Human Development, Frontiers in Pediatrics, and BMC Pediatrics to identify manuscripts where a "trend" was used to describe a statistically nonsignificant result, from January 2020 to December 2021, and, furthermore, for The Journal of Pediatrics, Early Human Development, and BMC Pediatrics from January 2010 to December 2011. We detected that a "trend toward significance" was used to describe a statistically nonsignificant result at least once in 146 articles (2.7%) during the period between 2020 and 2021 and in 97 articles (4.0%) during the period between 2010 and 2011. We found no significant difference in the proportion of published articles with inappropriate use of "trend" across journals belonging to the first quartile of impact compared to the second quartile or across journals publishing under the subscription model or open access policy compared to journals publishing solely under the open access policy, in any period. The overall proportion of the inappropriate use of "trend" declined significantly between 2010 and 2011 to 2020 and 2021 (p = 0.002, RR 0.66 95% CI 0.51-0.86).

CONCLUSION

"Trend" statements were sporadically used to describe statistically nonsignificant results across pediatric literature. The inappropriate use of "trend" to describe almost significant differences could be misleading, and "trend" should be reserved only when a specific statistical test for trend has been performed, or in relation to appropriate scientific definitions.

WHAT IS KNOWN

•Previously, researchers have reported inappropriate use of "trend" in articles across anaesthesia or major oncology journals. •In many cases, hypothesized results that are close but not lower than the statistical significance threshold are emphasized as "almost" significant.

WHAT IS NEW

•"Trend" statements were sporadically used to describe statistically nonsignificant results across pediatric literature. •Inappropriate use of  "trend" was similar in journals with a subscription model compared to those having an open access policy and decreased within a 10-year period.

Child attachment and ADHD: a systematic review

Attention Deficit/Hyperactivity Disorder (ADHD) is a frequent neurodevelopmental disorder in children. ADHD has a multifactorial origin, combining genetic and environmental factors. Several studies suggested an influence of early parent-child relationships on the symptomatic expression of ADHD. In this review, we examine the studies that have investigated the links between attachment and ADHD in children. We searched for studies published between January 2000 and November 2019 on PsychInfo, PubMed, and Scopus. Selected studies included a theoretically based measure of attachment and an explicit measure of ADHD symptoms or an ADHD diagnosis. Studies that included children from adoption, institutionalization, or mistreatment were not included. We found only 26 studies meeting the inclusion criteria. Almost all these studies indicated a link between the attachment type and the presence of attentional difficulties and hyperactivity. However, associations were better explained, in several studies, by confounding factors such as comorbidities, cognitive difficulties, or contextual factors. The method used to assess attachment and parental mental health also had an impact. An increasing number of studies show a link between the type of attachment and the presence of attentional difficulties and hyperactivity in children. However, the nature of this link remains unclear. Implications for future research are discussed.

Long-term outcomes and clinical safety of expanded indication early gastric cancer treated with endoscopic submucosal dissection versus surgical resection: a meta-analysis

BACKGROUND AND AIMS

Endoscopic submucosal dissection (ESD) remains an investigational issue for early gastric cancer (EGC) with expanded indications owing to the risk of lymph node metastasis. In this study, we aimed to evaluate the clinical outcomes and safety of ESD versus surgical resection (SR) for EGC with expanded indications.

METHODS

The systematic review selected studies from PubMed, Embase, Cochrane and Web of Science databases from 2010 to 2020, and compared survival and clinical safety data of ESD with those of surgical resection for EGC with expanded indications. The fixed-effects or random-effects model was used to calculate the differences between the two groups. To assess the validity of the eligible studies, risk of bias was measured using the Newcastle-Ottawa Quality Assessment Scale.

RESULTS

Nine retrospective studies were used to calculate the differences in survival and clinical safety data between the two groups for EGC with expanded indications. Differences were not significant between the groups in terms of age, sex, tumour size, tumour histology or lesion morphology. Regarding tumour site, tumours located in the L area (the lower third of the stomach) were more likely to be found in the ESD group. With regard to metachronous and synchronous carcinomas, there was a significant difference favouring SR treatment (metachronous: OR=0.12, 95% CI=0.05 to 0.25, p<0.00001; synchronous: OR=0.11, 95% CI=0.02 to 0.46, p=0.003). Adverse event data were identified in six studies showing a significant difference favouring ESD treatment (ESD vs SR, OR=0.49, 95% CI=0.34 to 0.72. p=0.002). Additionally, six studies evaluating 5-year overall survival showed no significant differences between the two groups (HR=1.22, 95% CI=0.66 to 2.25, p=0.53). With regard to 5-year disease-free survival, patients with expanded indication EGC undergoing SR showed better survival (ESD vs SR, HR=3.29, 95% CI=1.60 to 6.76, p=0.001).

CONCLUSION

ESD provided favourable results for patients with EGC with expanded indications regarding clinical outcomes and safety in retrospective studies. Further, to detect synchronous or metachronous lesions, endoscopic surveillance should be performed following ESD. However, the included studies were observational, some did not have adequate adjustment for confounding factors and their results lacked generalisability due to their origin. Thus, further related randomised controlled trials are urgently encouraged.

PROSPERO REGISTRATION NUMBER

CRD42021251068.

Case studies to explore the optimal use of randomized and nonrandomized studies in evidence syntheses that use GRADE

OBJECTIVES

Randomized controlled trials (RCTs) are the preferred source of evidence for the relative effect of healthcare interventions summarized in knowledge syntheses. Nonrandomized studies of interventions (NRSI) may provide replacement, sequential, or complementary evidence to RCTs. The Grading of Recommendations, Assessment, Development and Evaluation (GRADE) approach can provide different options for properly using RCTs and NRSI integrated in health syntheses. In this article, we discuss different implications on the certainty of evidence when authors consider the use of NRSI and RCTs in systematic reviews using GRADE. Although this is a GRADE-related article, it is not an official GRADE guidance or concept article.

STUDY DESIGN AND SETTING

We present case studies used during GRADE working group meetings for discussion of the effects of using NRSI and RCTs on GRADE domains and on the certainty of evidence. Several concepts were discussed through iterative feedback with experts in GRADE methods and Cochrane authors. We compared suggested solutions for possible scenarios that can be met in evidence syntheses informing decisions and future guidance.

RESULTS

Different scenarios for the use of RCTs and NRSI in evidence syntheses are presented, focusing on how different GRADE ratings between RCTs and NRSI affect the overall assessment of the evidence and possible health recommendations.

CONCLUSIONS

Considering differences and similarities grounded in the GRADE approach between NRSI and RCTs may help complement one another and maximize the value of knowledge syntheses and health recommendations.

Publish without bias or perish without replications

There is mounting evidence that a large portion of experimental results cannot be replicated, leading many to believe that science is now in the throes of a replicability crisis. In response, there have been calls to reduce publication bias against negative results because of the effect that publication bias has on the publication record. Others, however, argue that publication bias need not be detrimental to scientific progress. Here, we propose a novel mechanism by dint of which reducing publication bias can benefit science regardless of the effect that publication bias has on the publication record. To do so, we introduce a series of increasingly complex mathematical models. Our models represent a scientific community consisting of discovery researchers who test novel hypotheses, and confirmation researchers who test known hypotheses. Results show that reducing publication bias can have the surprising consequence of increasing the share of confirmation researchers who conduct replications. When a large share of scientists conduct confirmation research, scientists have an incentive to conduct high-quality research as others are likely to check their findings. Our models therefore suggest an underappreciated reasons why reducing publication bias might benefit science.

Marital satisfaction in Iranian infertile women: A systematic review and meta-analysis

Background

Infertility is a severe crisis in life that, in addition to creating psychological problems and disrupting a parent's identity and role, negatively impacts couples' marital satisfaction. Different studies in this field have reported different results, so this systematic review and meta-analysis was conducted to estimate the marital satisfaction standard score among infertile Iranian women.

Method

The databases of PubMed, Scopus, Web of Science, Embase, Scientific Information Database, and MagIran were searched without a time limit. We used the meta-analysis and a random-effects model to estimate the marital satisfaction pooled score. The heterogeneity of studies was examined with the I ² index and Cochrane's Q test. The correlation between the pooled score with the publication year and the mean age of women was evaluated using meta-regression. We assessed the publication bias by the Egger test.

Results

Seventeen studies with a sample size of 2,421 people were analyzed. The marital satisfaction pooled score of infertile women was 49% (95% CI: 39-60%). The marital satisfaction score in region 1 of the country (54, 95% CI: 42.7-65.3%) was higher than in other regions (45, 95% CI: 40-58%). Also, the marital satisfaction pooled score based on the Enrich scale (54, 95% CI: 39-69%) was higher than the score reported on other scales (45, 95% CI: 29-61%). Publication bias was not significant.

Conclusion

Infertile women have moderate to low marital satisfaction, rooted in the culture and context of Iranian society. It seems necessary to provide measures to strengthen marital satisfaction, strengthen family relationships and prevent family disintegration in these women.