What is the quality of reporting in randomized controlled trials in spinal conditions

Purpose

Substandard quality across published randomized controlled trials (RCTs) is a major concern. Imperfect reporting has the potential to distort the evidence landscape and waste valuable health-care resources. In this study, we aim to assess the current quality of reporting in the field of spine using a modified version of the Consolidated Standards of Reporting Trials (CONSORT) checklist.

Materials and Methods

A list of published RCTs in the field of spine disease from January 1, 2013, to December 31, 2020, was built. Two reviewers scored the published RCTs against a modified CONSORT checklist. The mean adjusted CONSORT scores for each study, reporting category, and checklist item were calculated.

Results

The mean and median scores across all of the RCTs were 0.72 and 0.74 out of 1.00, respectively. The spectrum of scores was wide, ranging from 0.45 to 0.94. The reporting categories with the lowest score included randomization, blinding, and abstract. The items which were most under-reported included allocation sequence generation, type of randomization used, full trial protocol details, and abstract methodology. The inter-rater reliability between our reviewers was substantial (κ = 0.7, κ = 0.71).

Conclusion

Our findings correlate with only a moderate level of compliance to the CONSORT criteria on the quality of reporting for RCTs in spinal conditions. This is in line with previous reports on compliance, both within and outside the field of spinal conditions. Further continued and sustained efforts are still required to enhance the quality and consistency of RCT reporting, ultimately reducing health-care resource wastage and improving patient safety.

Publication bias, statistical power and reporting practices in the Journal of Sports Sciences: potential barriers to replicability

Two factors that decrease the replicability of studies in the scientific literature are publication bias and studies with underpowered desgins. One way to ensure that studies have adequate statistical power to detect the effect size of interest is by conducting a-priori power analyses. Yet, a previous editorial published in the Journal of Sports Sciences reported a median sample size of 19 and the scarce usage of a-priori power analyses. We meta-analysed 89 studies from the same journal to assess the presence and extent of publication bias, as well as the average statistical power, by conducting a z-curve analysis. In a larger sample of 174 studies, we also examined a) the usage, reporting practices and reproducibility of a-priori power analyses; and b) the prevalence of reporting practices of t-statistic or F-ratio, degrees of freedom, exact p-values, effect sizes and confidence intervals. Our results indicate that there was some indication of publication bias and the average observed power was low (53% for significant and non-significant findings and 61% for only significant findings). Finally, the usage and reporting practices of a-priori power analyses as well as statistical results including test statistics, effect sizes and confidence intervals were suboptimal.

Correlation Between Breast Arterial Calcifications and Higher Cardiovascular Risk: Awareness and Attitudes Amongst Canadian Radiologists Who Report Mammography

Background: Breast arterial calcification (BAC) on mammography correlates with increased cardiovascular risk. Reporting BAC is not standard practice. Our study evaluates the awareness of Canadian radiologists who report mammography of the clinical significance of BAC and their attitudes towards reporting BAC compared to their European and American counterparts. Methods: Following local institutional ethics approval, a 25 question survey (SurveyMonkey) was disseminated to Canadian radiologists via provincial and national society email lists. Responses were collected over 5 weeks (April-June 2022). Results: One hundred and eighty-six complete responses were collected. Sixty percent (112/186) were aware of the association between BAC and cardiovascular risk and 16% (29/186) document its presence in mammogram reports. Thirty five percent (65/186) occasionally document BAC if severe or in a young patient. Four percent (7/186) had local departmental guidelines on BAC reporting and 82% (153/186) agreed there is a need for national BAC reporting guidelines. Fewer Canadian radiologists were aware of the association between BAC and cardiovascular risk compared to European radiologists (60% vs 81%), report the presence of BAC compared to both European (15% vs 62%) and American (15% vs 35%) radiologists, and inform the patient of the presence of BAC compared to European radiologists (1% vs 46%). Conclusion: Canadian radiologists who report mammography were less aware of the association between BAC and cardiovascular risk than their European and American counterparts and were less likely to document the presence of BAC. Given the correlation of BAC with increased cardiovascular event risk, there is increased need for awareness as well as national BAC reporting guidelines.

A neuroscientist's guide to using murine brain atlases for efficient analysis and transparent reporting

Brain atlases are widely used in neuroscience as resources for conducting experimental studies, and for integrating, analyzing, and reporting data from animal models. A variety of atlases are available, and it may be challenging to find the optimal atlas for a given purpose and to perform efficient atlas-based data analyses. Comparing findings reported using different atlases is also not trivial, and represents a barrier to reproducible science. With this perspective article, we provide a guide to how mouse and rat brain atlases can be used for analyzing and reporting data in accordance with the FAIR principles that advocate for data to be findable, accessible, interoperable, and re-usable. We first introduce how atlases can be interpreted and used for navigating to brain locations, before discussing how they can be used for different analytic purposes, including spatial registration and data visualization. We provide guidance on how neuroscientists can compare data mapped to different atlases and ensure transparent reporting of findings. Finally, we summarize key considerations when choosing an atlas and give an outlook on the relevance of increased uptake of atlas-based tools and workflows for FAIR data sharing.

Child Maltreatment Reporting Practices by a Person Most Knowledgeable for Children and Youth: A Rapid Scoping Review

Child maltreatment is a global public health and child rights crisis made worse by the ongoing COVID-19 pandemic. While understanding the breadth of the child maltreatment crisis is foundational to informing prevention and response efforts, determining accurate estimates of child maltreatment remains challenging. Alternative informants (parents, caregivers, a Person Most Knowledgeable-PMK) are often tasked with reporting on children's maltreatment experiences in surveys to mitigate concerns associated with reporting child maltreatment. The overall purpose of this study was to examine child maltreatment reporting practices in surveys by PMKs for children and youth. The research question is: "What is the nature of the evidence of child maltreatment reporting practices in general population surveys by PMKs for children and youth?" A rapid scoping review was conducted to achieve the study's purpose. A search strategy was conducted in nine databases (e.g., MEDLINE, EBSCO, Scopus, Global Health, ProQuest). The findings from this review indicate that most studies involved PMK informants (i.e., maternal caregivers), included representative samples from primarily Western contexts, and utilized validated measures to assess child maltreatment. Half of the studies assessed involved multi-informant reports, including the PMKs and child/youth. Overall, the congruence between PMK-reported and child/youth-reported child maltreatment experiences was low-to-fair/moderate, and children/youth reported more maltreatment than the PMKs.

Use of directed acyclic graphs (DAGs) to identify confounders in applied health research: review and recommendations

Background

Directed acyclic graphs (DAGs) are an increasingly popular approach for identifying confounding variables that require conditioning when estimating causal effects. This review examined the use of DAGs in applied health research to inform recommendations for improving their transparency and utility in future research.

Methods

Original health research articles published during 1999–2017 mentioning ‘directed acyclic graphs’ (or similar) or citing DAGitty were identified from Scopus, Web of Science, Medline and Embase. Data were extracted on the reporting of: estimands, DAGs and adjustment sets, alongside the characteristics of each article’s largest DAG.

Results

A total of 234 articles were identified that reported using DAGs. A fifth (n = 48, 21%) reported their target estimand(s) and half (n = 115, 48%) reported the adjustment set(s) implied by their DAG(s). Two-thirds of the articles (n = 144, 62%) made at least one DAG available. DAGs varied in size but averaged 12 nodes [interquartile range (IQR): 9–16, range: 3–28] and 29 arcs (IQR: 19–42, range: 3–99). The median saturation (i.e. percentage of total possible arcs) was 46% (IQR: 31–67, range: 12–100). 37% (n = 53) of the DAGs included unobserved variables, 17% (n = 25) included ‘super-nodes’ (i.e. nodes containing more than one variable) and 34% (n = 49) were visually arranged so that the constituent arcs flowed in the same direction (e.g. top-to-bottom).

Conclusion

There is substantial variation in the use and reporting of DAGs in applied health research. Although this partly reflects their flexibility, it also highlights some potential areas for improvement. This review hence offers several recommendations to improve the reporting and use of DAGs in future research.

Primary Study Quality in Psychological Meta-Analyses: An Empirical Assessment of Recent Practice

As meta-analytic research has come to occupy a sizeable contingent of published work in the psychological sciences, clarity in the reporting of such work is crucial to its interpretability and reproducibility. This is especially true regarding the assessment of primary study quality, as notions of study quality can vary across research domains. The present study examines the general state of reporting practices related to primary study quality in a sample of 382 published psychological meta-analyses, as well as the reporting decisions and motivations of the authors that published them. Our findings suggest adherence to reporting standards has remained poor for assessments of primary study quality and that the discipline remains inconsistent in its reporting practices generally. We discuss several potential reasons for the poor adherence to reporting standards in our sample, including whether quality assessments are being conducted in the first place, whether standards are well-known within the discipline, and the potential conflation of assessing primary study quality with other facets of conducting a meta-analysis. The implications of suboptimal reporting practices related to primary study quality are discussed.

Evaluating Whole Grain Intervention Study Designs and Reporting Practices Using Evidence Mapping Methodology

Consumption of whole grains have been associated with reduced risk of chronic diseases in many observational studies; yet, results of intervention studies are mixed. We aimed to use evidence mapping to capture the methodological and reporting variability in whole grain intervention studies that may contribute to this inconsistency. We conducted a reproducible search in OVID Medline for whole grain human intervention studies (published 1946 to February 2018). After screening based on a priori criteria, we identified 202 publications describing a total of 213 unique trials. Over half (55%) were acute trials, lasting ≤1 day, 30% were moderate duration studies (up to 6 weeks) and 15% were of longer duration (more than 6 weeks). The majority of acute trials (75%) examined measures of glycaemia and/or insulinemia, while most of the longer trials included measures of cardiometabolic health (71%), appetite/satiety (57%) and weight/adiposity (56%). Among the moderate and long duration trials, there was a wide range of how whole grains were described but only 10 publications referenced an established definition. Only 55% of trials reported the actual amount of whole grains (in grams or servings), while 36% reported the amount of food/product and 9% did not report a dose at all. Of the interventions that provided a mixture of whole grains, less than half (46%) reported the distribution of the different grain types. Reporting of subject compliance also varied and only 22% used independent biomarkers of whole grain intake. This evidence map highlights the need to standardize both study protocols and reporting practices to support effective synthesis of study results and provide a stronger foundation to better inform nutrition scientists and public health policy.

Reporting Practices and Use of Quantitative Methods in Canadian Journal Articles in Psychology

With recent focus on the state of research in psychology, it is essential to assess the nature of the statistical methods and analyses used and reported by psychological researchers. To that end, we investigated the prevalence of different statistical procedures and the nature of statistical reporting practices in recent articles from the four major Canadian psychology journals. The majority of authors evaluated their research hypotheses through the use of analysis of variance (ANOVA), t-tests, and multiple regression. Multivariate approaches were less common. Null hypothesis significance testing remains a popular strategy, but the majority of authors reported a standardized or unstandardized effect size measure alongside their significance test results. Confidence intervals on effect sizes were infrequently employed. Many authors provided minimal details about their statistical analyses and less than a third of the articles presented on data complications such as missing data and violations of statistical assumptions. Strengths of and areas needing improvement for reporting quantitative results are highlighted. The paper concludes with recommendations for how researchers and reviewers can improve comprehension and transparency in statistical reporting.

Police reporting practices for sexual assault cases in which "the victim does not wish to pursue charges"

Prior research examining sexual assault case attrition has focused on the processing of cases across the justice system. Studies have examined arrest decision making and prosecutorial decision making in an attempt to better understand where and when cases drop out of the system. Less explored are police reporting practices during the initial stage of processing for cases in which the officer stated that the victim chose to drop her case. We addressed this gap in the literature by reviewing law enforcement incident reports at their onset, specifically; we examine reports of cases in which the officer reported the victim chose to drop the case. Results indicated that of the 125 cases of sexual assault reported to the police, 41 reports (32.8%) stated that the victim decided to no longer pursue charges. However, few police reports (30.2%) provided a clear rationale for why the victim decided to no longer pursue charges. Results of this study call for more standardized police reporting practices and point to the need for future research into the initial stage of law enforcement involvement in adult sexual assault cases.

Reliability of self-reported childhood physical abuse by adults and factors predictive of inconsistent reporting

Little is known about the reliability of self-reported child physical abuse (CPA) or CPA reporting practices. We estimated reliability and prevalence of self-reported CPA and identified factors predictive of inconsistent CPA reporting among 2,256 participants using surveys administered in 1995 and 2000. Reliability of CPA was fair to moderate (kappa = 0.41). Using a positive report from either survey, the prevalence of moderate (61.8%) and severe (12.0%) CPA was higher than at either survey alone. Compared to consistent reporters of having experienced CPA, inconsistent reporters were less likely to be > or = 30 years old (vs. 18-29) or Black (vs. White) and more likely to have < 12 years of education (vs. 12), have no alcohol-related problems (vs. having problems), or report one type (vs. > or = 2) of CPA. These findings may assist researchers conducting and interpreting studies of CPA.