Quality Reporting of Systematic Review and Meta-Analysis According to PRISMA 2020 Guidelines: Results from Recently Published Papers in the Korean Journal of Radiology

Substituting with alternative iodinated contrast medium to prevent recurrent adverse drug reactions associated with its use: a meta-analysis

OBJECTIVES

To systematically review and meta-analyze the recurrent rate of iodinated contrast medium (ICM)-associated adverse drug reactions (ADRs) and the preventive effect of using alternative ICM lacking a common carbamoyl side chain.

MATERIALS AND METHODS

A systematic literature search was conducted in the MEDLINE and EMBASE databases to identify studies that investigated the recurrence rate of ICM-associated ADRs or hypersensitivity reactions (HSRs). Studies that included patients who subsequently underwent contrast-enhanced computed tomography scans after their index reactions were included, while studies with overlapping cohorts were excluded. The first search was conducted on November 10, 2023. The pooled recurrence rate of ICM-associated ADR was determined using the DerSimonian-Laird random-effects model. Subgroup analyses were also conducted based on the substitution of ICM, with particular consideration given to the N-(2,3-dihydroxypropyl) carbamoyl side chain.

RESULTS

A total of ten original articles were included in the analysis, collectively spanning from June 2001 to March 2021. The pooled recurrence rate of ICM-associated ADR was not significantly different from that of ICM-associated HSR (16.6% [95% CI, 7.8-31.9%] vs. 15.5% [95% CI, 10.8-21.8%], p = 0.87). In the subgroup analyses, the pooled odds ratio for ICM-associated recurrent ADR when using a different ICM compared with using the same ICM was 0.31 (95% CI, 0.21-0.45), which means a 69% reduction. Moreover, the pooled odds ratio for ICM-associated recurrent ADR when substituting ICMs with different side chains compared with substituting with common side chains was 0.65 (95% CI, 0.52-0.82), which means an additional 35% reduction.

CONCLUSION

Substituting with an alternative ICM led to a 69% reduction in recurrent ADRs, with an additional 35% reduction observed when using ICM lacking a common carbamoyl side chain.

KEY POINTS

Question No standardized guidelines exist for replacing previously used iodinated contrast medium (ICM) to prevent recurrent adverse reactions. Findings Using alternative contrast medium with a different carbamoyl side chain prevents adverse drug reactions effectively. Clinical relevance This study advocates using alternative ICM without a common carbamoyl side chain to prevent recurrent adverse drug reactions in patients with a history of such events.

Reporting and Methodological Qualities of Systematic Reviews in Rehabilitation Journals After 2020: A Cross-Sectional Meta-Epidemiological Study

OBJECTIVES

The aim of this study was to investigate the reporting and methodological qualities in systematic reviews (SRs) of rehabilitation journals following updating to the use of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) 2020 statement.

METHODS

SRs with pairwise meta-analyses on the effects of health interventions were selected, which were published in rehabilitation journals in 2020, 2021, and 2022 using MEDLINE (PubMed). Exposure was defined as reporting use of the PRISMA 2020 statement. A comparison group consisted of SRs that did not use the PRISMA 2020 statement. The adherence of the PRISMA 2020 items, PRISMA 2020 for abstracts, and A MeaSurement Tool to Assess systematic Reviews (AMSTAR) 2 items were evaluated.

RESULTS

Thirteen thousand, three hundred eighty-one articles were identified after conducting a search on April 2, 2023. The study included 100 articles each that used and those that did not use the PRISMA 2020 statement. Of 41 items in the PRISMA 2020 statement, 48.8% (20/41) adhered to ≥80% of each item for those that used the PRISMA 2020 statement and 41.5% (17/41) in those that did not use the PRISMA 2020 statement. The PRISMA 2020 statement did not lead to any major improvement, and only a slight improvement of 9.8% (4/41) was observed when compared with those that did not use the PRISMA 2020 statement. Similarly, no item improved in the PRISMA 2020 for abstracts, and only 5.6% (1/18) improved in the AMSTAR 2 items.

CONCLUSION

This study showed that reporting use of the PRISMA 2020 statement did not result in any major improvements; however, only a slight improvement was observed in the reporting and methodological qualities of SRs in rehabilitation journals. Researchers should adhere to each item in the PRISMA 2020 statement in SRs published in rehabilitation journals.

IMPACT

The reporting and methodological quality of systematic reviews in rehabilitation journals is insufficient. It is important to improve the reporting and methodological quality of systematic reviews in rehabilitation journals. It is recommended that researchers not only declare their reporting use of the PRISMA 2020 statement, but also adhere to each item correctly.

Adherence of Studies on Large Language Models for Medical Applications Published in Leading Medical Journals According to the MI-CLEAR-LLM Checklist

OBJECTIVE

To evaluate the adherence of large language model (LLM)-based healthcare research to the Minimum Reporting Items for Clear Evaluation of Accuracy Reports of Large Language Models in Healthcare (MI-CLEAR-LLM) checklist, a framework designed to enhance the transparency and reproducibility of studies on the accuracy of LLMs for medical applications.

MATERIALS AND METHODS

A systematic PubMed search was conducted to identify articles on LLM performance published in high-ranking clinical medicine journals (the top 10% in each of the 59 specialties according to the 2023 Journal Impact Factor) from November 30, 2022, through June 25, 2024. Data on the six MI-CLEAR-LLM checklist items: 1) identification and specification of the LLM used, 2) stochasticity handling, 3) prompt wording and syntax, 4) prompt structuring, 5) prompt testing and optimization, and 6) independence of the test data-were independently extracted by two reviewers, and adherence was calculated for each item.

RESULTS

Of 159 studies, 100% (159/159) reported the name of the LLM, 96.9% (154/159) reported the version, and 91.8% (146/159) reported the manufacturer. However, only 54.1% (86/159) reported the training data cutoff date, 6.3% (10/159) documented access to web-based information, and 50.9% (81/159) provided the date of the query attempts. Clear documentation regarding stochasticity management was provided in 15.1% (24/159) of the studies. Regarding prompt details, 49.1% (78/159) provided exact prompt wording and syntax but only 34.0% (54/159) documented prompt-structuring practices. While 46.5% (74/159) of the studies detailed prompt testing, only 15.7% (25/159) explained the rationale for specific word choices. Test data independence was reported for only 13.2% (21/159) of the studies, and 56.6% (43/76) provided URLs for internet-sourced test data.

CONCLUSION

Although basic LLM identification details were relatively well reported, other key aspects, including stochasticity, prompts, and test data, were frequently underreported. Enhancing adherence to the MI-CLEAR-LLM checklist will allow LLM research to achieve greater transparency and will foster more credible and reliable future studies.

Systematic Review of the Diagnostic Imaging Evaluation of Pulsatile Tinnitus

Objective

Aggregate published data on the imaging of pulsatile tinnitus as a step toward building a framework for an evidence-based approach to diagnostic imaging for this symptom.

Materials & Methods

A systematic review was performed. PUBMED and EMBASE were searched on December 1, 2021 for English-language articles on diagnostic imaging of pulsatile tinnitus. Articles that involved non-standard imaging techniques and those that focused on management of pulsatile tinnitus were excluded. Extracted data included: number of males and females; signs, symptoms, and physical examination findings with associated patient counts; imaging findings; count of patients with imaging-identified cause of pulsatile tinnitus; reported associated interventions and outcomes.

Results

41 articles were included with a total of 2,633 reported patients. 10 studies were prospective. MRA appears to be capable of identifying many of the same pathologies traditionally diagnosed with DSA. Few head-to-head comparisons were performed. In head-to-head comparisons of MRI and MRA, MRA was often able to identify more pathology. There was no clear relationship identified between specific symptoms and the imaging modality chosen, indicating that the imaging evaluation of pulsatile tinnitus is likely sensitive to the preferences of the evaluating provider.

Conclusion

There is limited evidence to inform best practices for the initial imaging evaluation of pulsatile tinnitus and preference-sensitive provider decisions will continue to guide the pulsatile tinnitus workup. We encourage prospective studies with multimodality imaging comparisons to build evidence that would support the development of more effective, efficient, and equitable protocols and pathways for the imaging evaluation of pulsatile tinnitus.

Double burden of malnutrition among households in Ethiopia: a systematic review and meta-analysis

Introduction

The double burden of malnutrition (DBM) at the household level has increased in sub-Saharan African countries as a result of rapid changes in global food systems and growing urbanization. The presence of overweight or obese mothers with undernourished (stunted, wasted, or underweight) children within the same household holds particular significance. However, no comprehensive study or meta-analysis has been conducted to summarize the national evidence of the double burden of malnutrition in mother-child pairs. Therefore, the purpose of this study was to determine the pooled prevalence of the double burden of malnutrition at the household level in Ethiopia in 2024.

Methods

This systematic review and meta-analysis was conducted on the prevalence of the double burden of malnutrition and associated factors among households in Ethiopia, using an advanced search of electronic databases and search engines. The standardized Joanna Briggs Institute (JBI) method was used to extract data from a Microsoft Excel spreadsheet and evaluate the quality of each article. The analysis was performed using STATA V.17. A random-effects model was used to conduct the meta-analysis. Heterogeneity was assessed using the I2 and Q tests.

Results

A total of seven publications met the inclusion criteria, including data from 56,877 and 43,770 mother-child pairs for the systematic review and meta-analysis, respectively. The pooled prevalence of the double burden of malnutrition among the mother-child pairs was 8.30% (95% confidence interval (CI): 1.51, 15.09). The heterogeneity test revealed extremely high heterogeneity (I2 = 99.91%; p = 0.00). In the subgroup analysis based on sample size, the pooled estimated prevalence of the double burden of malnutrition was high for a sample size of fewer than 1,000 mother-child pairs (11.69% (95% CI: 3.11, 20.28)). The pooled estimate from the subgroup analysis of the data collected 8 years ago was 8.61% (95% CI: 1.11, 22.33). Residence, household size, housing quality, wealth index, household food security status, mother's age and educational status, and child's age are some of the factors that influence the double burden of malnutrition among mother-child pairs.

Conclusion

In Ethiopia, the double burden of malnutrition among mother-child pairs is rapidly emerging. As a result, double-duty interventions should be implemented to address this issue, taking into account multiple factors at the household level.

Systematic review registration

The protocol for the systematic review and meta-analysis was registered under the registration ID CRD42024517778 with the PROSPERO (International Prospective Register of Systematic Review and Meta-analysis).

Enhancing Reporting Quality Using the Preferred Reporting Items for Systematic Review and Meta-Analysis 2020 in Systematic Reviews of Emergency Medicine Journals: A Cross-Sectional Study

BACKGROUND

Systematic reviews (SRs) with thorough reporting and rigorous methodology lead to less biased outcomes. The Priority Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement was developed to enhance SRs and meta-analysis reporting. While it was updated to PRISMA 2020, the impact on emergency medicine remains unexplored. Therefore, we aimed to investigate whether using PRISMA 2020 improves the reporting quality of SRs in the emergency medicine field.

METHODS

This study is a cross-sectional meta-epidemiological analysis of SRs published in emergency medicine journals between 2021 and 2023. We selected SRs with pairwise meta-analyses of health interventions included in MEDLINE. We evaluated adherence to PRISMA 2020 items with and without the use of the PRISMA 2020 statement.

RESULTS

A total of 695 articles were analyzed, ultimately including 31 that used PRISMA 2020 and 100 that did not. Adherence rates to PRISMA 2020 items were higher in papers using PRISMA 2020 (925/1270, 72.8%, odds ratio: 1.24, 95% confidence interval: 1.08-1.43) than in papers not using it (2758/4034, 68.4%). No SRs met all of the PRISMA 2020 criteria. Adherence to PRISMA 2020 for Abstracts was slightly higher in the group that used the PRISMA 2020 (182/372, 48.9%, odds ratio: 1.17, 95% confidence interval: 0.92-1.47), compared to those that had not (541/1200, 45.1%). Adherence was highest in the introduction and lowest in the methods section. Agreement between the first author and other reviewers' ratings averaged 89.6% (4815/5371).

CONCLUSION

Implementing PRISMA 2020 significantly improved the reporting quality of SRs in emergency medicine-related journals. Declaring the use of PRISMA 2020 is insufficient, and researchers must strictly adhere to each item.

REGISTRATION

The study protocol was registered in the Open Science Framework on September 22, 2023 (https://doi.org/10.17605/OSF.IO/DQ5W6).

Evolution of Research Reporting Standards: Adapting to the Influence of Artificial Intelligence, Statistics Software, and Writing Tools

Reporting standards are essential to health research as they improve accuracy and transparency. Over time, significant changes have occurred to the requirements for reporting research to ensure comprehensive and transparent reporting across a range of study domains and foster methodological rigor. The establishment of the Declaration of Helsinki, Consolidated Standards of Reporting Trials (CONSORT), Strengthening the Reporting of Observational Studies in Epidemiology (STROBE), and Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) are just a few of the historic initiatives that have increased research transparency. Through enhanced discoverability, statistical analysis facilitation, article quality enhancement, and language barrier reduction, artificial intelligence (AI)-in particular, large language models like ChatGPT-has transformed academic writing. However, problems with errors that could occur and the need for transparency while utilizing AI tools still exist. Modifying reporting rules to include AI-driven writing tools such as ChatGPT is ethically and practically challenging. In academic writing, precautions for truth, privacy, and responsibility are necessary due to concerns about biases, openness, data limits, and potential legal ramifications. The CONSORT-AI and Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT)-AI Steering Group expands the CONSORT guidelines for AI clinical trials-new checklists like METRICS and CLEAR help to promote transparency in AI studies. Responsible usage of technology in research and writing software adoption requires interdisciplinary collaboration and ethical assessment. This study explores the impact of AI technologies, specifically ChatGPT, on past reporting standards and the need for revised guidelines for open, reproducible, and robust scientific publications.

The policies on the use of large language models in radiological journals are lacking: a meta-research study

OBJECTIVE

To evaluate whether and how the radiological journals present their policies on the use of large language models (LLMs), and identify the journal characteristic variables that are associated with the presence.

METHODS

In this meta-research study, we screened Journals from the Radiology, Nuclear Medicine and Medical Imaging Category, 2022 Journal Citation Reports, excluding journals in non-English languages and relevant documents unavailable. We assessed their LLM use policies: (1) whether the policy is present; (2) whether the policy for the authors, the reviewers, and the editors is present; and (3) whether the policy asks the author to report the usage of LLMs, the name of LLMs, the section that used LLMs, the role of LLMs, the verification of LLMs, and the potential influence of LLMs. The association between the presence of policies and journal characteristic variables was evaluated.

RESULTS

The LLM use policies were presented in 43.9% (83/189) of journals, and those for the authors, the reviewers, and the editor were presented in 43.4% (82/189), 29.6% (56/189) and 25.9% (49/189) of journals, respectively. Many journals mentioned the aspects of the usage (43.4%, 82/189), the name (34.9%, 66/189), the verification (33.3%, 63/189), and the role (31.7%, 60/189) of LLMs, while the potential influence of LLMs (4.2%, 8/189), and the section that used LLMs (1.6%, 3/189) were seldomly touched. The publisher is related to the presence of LLM use policies (p < 0.001).

CONCLUSION

The presence of LLM use policies is suboptimal in radiological journals. A reporting guideline is encouraged to facilitate reporting quality and transparency.

CRITICAL RELEVANCE STATEMENT

It may facilitate the quality and transparency of the use of LLMs in scientific writing if a shared complete reporting guideline is developed by stakeholders and then endorsed by journals.

KEY POINTS

The policies on LLM use in radiological journals are unexplored. Some of the radiological journals presented policies on LLM use. A shared complete reporting guideline for LLM use is desired.

Comparative Efficacy and Safety of Radiofrequency Ablation and Microwave Ablation in the Treatment of Benign Thyroid Nodules: A Systematic Review and Meta-Analysis

OBJECTIVE

The current body of evidence lacks clarity regarding the comparative efficacy and safety of radiofrequency ablation (RFA) and microwave ablation (MWA) as minimally invasive treatments for benign thyroid nodules. The primary objective of this study is to clarify these concerns.

MATERIALS AND METHODS

A comprehensive search was conducted using the Cochrane Library, Scopus, Europe PMC, and Medline databases until October 10th, 2023, using a combination of relevant keywords. This study incorporated literature that compared RFA and MWA for benign thyroid nodules. The primary outcome was the volume reduction ratio (VRR) from baseline to follow-up. Secondary outcomes were symptom score, cosmetic score, ablation time, major complications rate, hemorrhage, hoarseness, skin burn, cough, and sympathetic nerve injury. We used Risk of Bias in Non-randomized Studies - of Interventions (ROBINS-I) tool to assess the risk of bias in the included studies. We employed random effects models to analyze the standardized mean difference (SMD) and odds ratio for the presentation of outcomes.

RESULTS

Nine studies with 2707 nodules were included. The results of our meta-analysis indicated similar efficacy between RFA and MWA in terms of VRR during the 1 (SMD 0.06; 95% confidence interval [CI]: -0.13 to 0.26; P = 0.52) and 3 (SMD 0.11; 95% CI: -0.03 to 0.25; P = 0.12) months of follow-up. VRR was significantly higher in RFA than in MWA at the 6 (SMD 0.25; 95% CI: 0.06-0.43; P = 0.008) and 12 month of follow-up (SMD 0.38; 95% CI: 0.17 to 0.59; P < 0.001). There were no significant differences between RFA and MWA in symptom scores, cosmetic scores, or the incidence of complications, including hemorrhage, hoarseness, skin burn, cough, and sympathetic nerve injury.

CONCLUSION

RFA showed a higher VRR than MWA at 6 and 12-month follow-ups, with a comparable safety profile.

Reporting quality and risk of bias of systematic reviews of ultra-processed foods: a methodological study

A dramatic shift in the global food system is occurring with the rapid growth of ultra-processed foods (UPFs) consumption, which poses potentially serious health risks. Systematic review (SR) method has been used to summarise the association between UPF consumption and multiple health outcomes; however, a suboptimal-quality SR may mislead the decision-making in clinical practices and health policies. Therefore, a methodological review was conducted to identify the areas that can be improved regarding the risk of bias and reporting quality of relevant SRs. Systematic searches to collect SRs with meta-analyses of UPFs were performed using four databases from their inception to April 14, 2023. The risk of bias and reporting quality were evaluated using ROBIS and PRISMA 2020, respectively. The key characteristics of the included SRs were summarised descriptively. Excel 2019 and R 4.2.3 were used to analyse the data and draw graphs. Finally, 16 relevant SRs written in English and published between 2020 and 2023 in 12 academic journals were included. Only one SR was rated as low risk of bias, and the others were rated as higher risk of bias mainly because the risk of bias in the original studies was not explicitly addressed when synthesising the evidence. The reporting was required to be advanced significantly, involving amendments of registration and protocol, data and analytic code statement, and lists of excluded studies with justifications. The reviews' results could improve the quality, strengthen future relevant SRs' robustness, and further underpin the evidence base for supporting clinical decisions and health policies.

The endorsement of general and artificial intelligence reporting guidelines in radiological journals: a meta-research study

BACKGROUND

Complete reporting is essential for clinical research. However, the endorsement of reporting guidelines in radiological journals is still unclear. Further, as a field extensively utilizing artificial intelligence (AI), the adoption of both general and AI reporting guidelines would be necessary for enhancing quality and transparency of radiological research. This study aims to investigate the endorsement of general reporting guidelines and those for AI applications in medical imaging in radiological journals, and explore associated journal characteristic variables.

METHODS

This meta-research study screened journals from the Radiology, Nuclear Medicine & Medical Imaging category, Science Citation Index Expanded of the 2022 Journal Citation Reports, and excluded journals not publishing original research, in non-English languages, and instructions for authors unavailable. The endorsement of fifteen general reporting guidelines and ten AI reporting guidelines was rated using a five-level tool: "active strong", "active weak", "passive moderate", "passive weak", and "none". The association between endorsement and journal characteristic variables was evaluated by logistic regression analysis.

RESULTS

We included 117 journals. The top-five endorsed reporting guidelines were CONSORT (Consolidated Standards of Reporting Trials, 58.1%, 68/117), PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses, 54.7%, 64/117), STROBE (STrengthening the Reporting of Observational Studies in Epidemiology, 51.3%, 60/117), STARD (Standards for Reporting of Diagnostic Accuracy, 50.4%, 59/117), and ARRIVE (Animal Research Reporting of In Vivo Experiments, 35.9%, 42/117). The most implemented AI reporting guideline was CLAIM (Checklist for Artificial Intelligence in Medical Imaging, 1.7%, 2/117), while other nine AI reporting guidelines were not mentioned. The Journal Impact Factor quartile and publisher were associated with endorsement of reporting guidelines in radiological journals.

CONCLUSIONS

The general reporting guideline endorsement was suboptimal in radiological journals. The implementation of reporting guidelines for AI applications in medical imaging was extremely low. Their adoption should be strengthened to facilitate quality and transparency of radiological study reporting.

Diagnostic Accuracy of Magnetic Resonance Imaging Features and Tumor-to-Nipple Distance for the Nipple-Areolar Complex Involvement of Breast Cancer: A Systematic Review and Meta-Analysis

OBJECTIVE

This systematic review and meta-analysis evaluated the accuracy of preoperative breast magnetic resonance imaging (MRI) features and tumor-to-nipple distance (TND) for diagnosing occult nipple-areolar complex (NAC) involvement in breast cancer.

MATERIALS AND METHODS

The MEDLINE, Embase, and Cochrane databases were searched for articles published until March 20, 2022, excluding studies of patients with clinically evident NAC involvement or those treated with neoadjuvant chemotherapy. Study quality was assessed using the Quality Assessment of Diagnostic Accuracy Studies 2 tool. Two reviewers independently evaluated studies that reported the diagnostic performance of MRI imaging features such as continuity to the NAC, unilateral NAC enhancement, non-mass enhancement (NME) type, mass size (> 20 mm), and TND. Summary estimates of the sensitivity and specificity curves and the summary receiver operating characteristic (SROC) curve of the MRI features for NAC involvement were calculated using random-effects models. We also calculated the TND cutoffs required to achieve predetermined specificity values.

RESULTS

Fifteen studies (n = 4002 breast lesions) were analyzed. The pooled sensitivity and specificity (with 95% confidence intervals) for NAC involvement diagnosis were 71% (58-81) and 94% (91-96), respectively, for continuity to the NAC; 58% (45-70) and 97% (95-99), respectively, for unilateral NAC enhancement; 55% (46-64) and 83% (75-88), respectively, for NME type; and 88% (68-96) and 58% (40-75), respectively, for mass size (> 20 mm). TND had an area under the SROC curve of 0.799 for NAC involvement. A TND of 11.5 mm achieved a predetermined specificity of 85% with a sensitivity of 64%, and a TND of 12.3 mm yielded a predetermined specificity of 83% with a sensitivity of 65%.

CONCLUSION

Continuity to the NAC and unilateral NAC enhancement may help predict occult NAC involvement in breast cancer. To achieve the desired diagnostic performance with TND, a suitable cutoff value should be considered.

Prevalence and predictors of data and code sharing in the medical and health sciences: systematic review with meta-analysis of individual participant data

OBJECTIVES

To synthesise research investigating data and code sharing in medicine and health to establish an accurate representation of the prevalence of sharing, how this frequency has changed over time, and what factors influence availability.

DESIGN

Systematic review with meta-analysis of individual participant data.

DATA SOURCES

Ovid Medline, Ovid Embase, and the preprint servers medRxiv, bioRxiv, and MetaArXiv were searched from inception to 1 July 2021. Forward citation searches were also performed on 30 August 2022.

REVIEW METHODS

Meta-research studies that investigated data or code sharing across a sample of scientific articles presenting original medical and health research were identified. Two authors screened records, assessed the risk of bias, and extracted summary data from study reports when individual participant data could not be retrieved. Key outcomes of interest were the prevalence of statements that declared that data or code were publicly or privately available (declared availability) and the success rates of retrieving these products (actual availability). The associations between data and code availability and several factors (eg, journal policy, type of data, trial design, and human participants) were also examined. A two stage approach to meta-analysis of individual participant data was performed, with proportions and risk ratios pooled with the Hartung-Knapp-Sidik-Jonkman method for random effects meta-analysis.

RESULTS

The review included 105 meta-research studies examining 2 121 580 articles across 31 specialties. Eligible studies examined a median of 195 primary articles (interquartile range 113-475), with a median publication year of 2015 (interquartile range 2012-2018). Only eight studies (8%) were classified as having a low risk of bias. Meta-analyses showed a prevalence of declared and actual public data availability of 8% (95% confidence interval 5% to 11%) and 2% (1% to 3%), respectively, between 2016 and 2021. For public code sharing, both the prevalence of declared and actual availability were estimated to be <0.5% since 2016. Meta-regressions indicated that only declared public data sharing prevalence estimates have increased over time. Compliance with mandatory data sharing policies ranged from 0% to 100% across journals and varied by type of data. In contrast, success in privately obtaining data and code from authors historically ranged between 0% and 37% and 0% and 23%, respectively.

CONCLUSIONS

The review found that public code sharing was persistently low across medical research. Declarations of data sharing were also low, increasing over time, but did not always correspond to actual sharing of data. The effectiveness of mandatory data sharing policies varied substantially by journal and type of data, a finding that might be informative for policy makers when designing policies and allocating resources to audit compliance.

SYSTEMATIC REVIEW REGISTRATION

Open Science Framework doi:10.17605/OSF.IO/7SX8U.

Meditative movement for breathlessness in advanced COPD or cancer: a systematic review and meta-analysis

The effect of meditative movement, which includes yoga, tai chi and qi gong, on breathlessness in advanced disease is unknown. This systematic review aims to comprehensively assess the evidence on the effect of meditative movement on breathlessness (primary outcome), health-related quality of life, exercise capacity, functional performance and psychological symptoms (secondary outcomes) in advanced disease. 11 English and Chinese language databases were searched for relevant trials. Risk of bias was assessed using the Cochrane tool. Standardised mean differences (SMDs) with 95% confidence intervals were computed. 17 trials with 1125 participants (n=815 COPD, n=310 cancer), all with unclear or high risk of bias, were included. Pooled estimates (14 studies, n=671) showed no statistically significant difference in breathlessness between meditative movement and control interventions (SMD (95% CI) 0.10 (-0.15-0.34); Chi2=30.11; I2=57%; p=0.45), irrespective of comparator, intervention or disease category. Similar results were observed for health-related quality of life and exercise capacity. It was not possible to perform a meta-analysis for functional performance and psychological symptoms. In conclusion, in people with advanced COPD or cancer, meditative movement does not improve breathlessness, health-related quality of life or exercise capacity. Methodological limitations lead to low levels of certainty in the results.

An overview of meta-analyses on radiomics: more evidence is needed to support clinical translation

OBJECTIVE

To conduct an overview of meta-analyses of radiomics studies assessing their study quality and evidence level.

METHODS

A systematical search was updated via peer-reviewed electronic databases, preprint servers, and systematic review protocol registers until 15 November 2022. Systematic reviews with meta-analysis of primary radiomics studies were included. Their reporting transparency, methodological quality, and risk of bias were assessed by PRISMA (Preferred Reporting Items for Systematic reviews and Meta-Analyses) 2020 checklist, AMSTAR-2 (A MeaSurement Tool to Assess systematic Reviews, version 2) tool, and ROBIS (Risk Of Bias In Systematic reviews) tool, respectively. The evidence level supporting the radiomics for clinical use was rated.

RESULTS

We identified 44 systematic reviews with meta-analyses on radiomics research. The mean ± standard deviation of PRISMA adherence rate was 65 ± 9%. The AMSTAR-2 tool rated 5 and 39 systematic reviews as low and critically low confidence, respectively. The ROBIS assessment resulted low, unclear and high risk in 5, 11, and 28 systematic reviews, respectively. We reperformed 53 meta-analyses in 38 included systematic reviews. There were 3, 7, and 43 meta-analyses rated as convincing, highly suggestive, and weak levels of evidence, respectively. The convincing level of evidence was rated in (1) T2-FLAIR radiomics for IDH-mutant vs IDH-wide type differentiation in low-grade glioma, (2) CT radiomics for COVID-19 vs other viral pneumonia differentiation, and (3) MRI radiomics for high-grade glioma vs brain metastasis differentiation.

CONCLUSIONS

The systematic reviews on radiomics were with suboptimal quality. A limited number of radiomics approaches were supported by convincing level of evidence.

CLINICAL RELEVANCE STATEMENT

The evidence supporting the clinical application of radiomics are insufficient, calling for researches translating radiomics from an academic tool to a practicable adjunct towards clinical deployment.

Accelerated Brain Volume Loss Caused by Anti-β-Amyloid Drugs: A Systematic Review and Meta-analysis

BACKGROUND AND OBJECTIVES

To evaluate brain volume changes caused by different subclasses of anti-β-amyloid (Aβ) drugs trailed in patients with Alzheimer disease.

METHODS

PubMed, Embase, and ClinicalTrials.gov databases were searched for clinical trials of anti-Aβ drugs. This systematic review and meta-analysis included adults enrolled in randomized controlled trials of anti-Aβ drugs (n = 8,062-10,279). The inclusion criteria were as follows: (1) randomized controlled trials of patients treated with anti-Aβ drugs that have demonstrated to favorably change at least one biomarker of pathologic Aβ and (2) detailed MRI data sufficient to assess the volumetric changes in at least one brain region. MRI brain volumes were used as the primary outcome measure; brain regions commonly reported include hippocampus, lateral ventricle, and whole brain. Amyloid-related imaging abnormalities (ARIAs) were investigated when reported in clinical trials. Of the 145 trials reviewed, 31 were included in the final analyses.

RESULTS

A meta-analysis on the highest dose of each trial on hippocampus, ventricle, and whole brain revealed drug-induced acceleration of volume changes that varied by anti-Aβ drug class. Secretase inhibitors accelerated atrophy to the hippocampus (Δ placebo - Δ drug: -37.1 µL [19.6% more than placebo]; 95% CI -47.0 to -27.1) and whole brain (Δ placebo - Δ drug: -3.3 mL [21.8% more than placebo]; 95% CI -4.1 to 2.5). Conversely, ARIA-inducing monoclonal antibodies accelerated ventricular enlargement (Δ placebo - Δ drug: +2.1 mL [38.7% more than placebo]; 95% CI 1.5-2.8) where a striking correlation between ventricular volume and ARIA frequency was observed (r = 0.86, p = 6.22 × 10-7). Mild cognitively impaired participants treated with anti-Aβ drugs were projected to have a material regression toward brain volumes typical of Alzheimer dementia ∼8 months earlier than if they were untreated.

DISCUSSION

These findings reveal the potential for anti-Aβ therapies to compromise long-term brain health by accelerating brain atrophy and provide new insight into the adverse impact of ARIA. Six recommendations emerge from these findings.

Incidence and severity of nonionic low-osmolar iodinated contrast medium-related adverse drug reactions in the Republic of Korea: Comparison by generic

We aimed to report the incidence and severity of nonionic low-osmolar iodine contrast medium (ICM)-related adverse drug reactions (ADRs) in the Republic of Korea, by analyzing data from our single tertiary institution and published Korean reports, and to determine whether there is a difference in the incidence of ICM-related ADR by ICM generics. A total of 1,161,419 consecutive contrast-enhanced computed tomography (CT) examinations between January 2016 and December 2021 at Asan Medical Center were included. A systematic search of the literature investigating the incidence of ICM-related ADR in the Republic of Korea published up to December 31, 2021 was performed. We pooled these outcomes with those of our study using a binomial-normal model, and the pooled incidences of ADRs were compared among ICM generics using chi-square tests. Seven studies with a total of 2,570,986 contrast-enhanced CT examinations from 12 institutions were included. The pooled incidences of overall, mild, moderate, and severe ICM-related ADRs in the Republic of Korea were 0.82% (95% CI: 0.61%-1.10%), 0.72% (95% CI: 0.50%-1.04%), 0.11% (95% CI: 0.08%-0.15%), and 0.013% (95% CI: 0.010%-0.018%), respectively. In multiple pairwise comparisons, there were no significant differences in the overall incidence of ADRs between ICM generics, except iomeprol versus iobitridol and iomeprol versus iohexol. For moderate and severe ADRs, there were no significant differences in ADR incidence between ICM generics. The incidence of moderate and severe ICM-related ADRs did not differ among ICM generics. Our results suggest that no restriction is required for selection among nonionic low-osmolar ICMs.

Diagnostic yield of MR myelography in patients with newly diagnosed spontaneous intracranial hypotension: a systematic review and meta-analysis

OBJECTIVES

To investigate the pooled diagnostic yield of MR myelography in patients with newly diagnosed spontaneous intracranial hypotension (SIH).

METHODS

A literature search of the MEDLINE/PubMed and Embase databases was conducted until July 25, 2021, including studies with the following inclusion criteria: (a) population: patients with newly diagnosed SIH; (b) diagnostic modality: MR myelography or MR myelography with intrathecal gadolinium for evaluation of CSF leakage; (c) outcomes: diagnostic yield of MR myelography or MR myelography with intrathecal gadolinium. The risk of bias was evaluated using the Quality Assessment of Diagnostic Accuracy Studies-2 tool. DerSimonian-Laird random-effects modeling was used to calculate the pooled estimates. Subgroup analysis regarding epidural fluid collection and meta-regression were additionally performed.

RESULTS

Fifteen studies with 643 patients were included. Eight studies used MR myelography with intrathecal gadolinium, and 11 used MR myelography. The overall quality of the included studies was moderate. The pooled diagnostic yield of MR myelography was 86% (95% CI, 80-91%) and that of MR myelography with intrathecal gadolinium was 83% (95% CI, 51-96%). There was no significant difference in pooled diagnostic yield between MR myelography and MR myelography with intrathecal gadolinium (p = 0.512). In subgroup analysis, the pooled diagnostic yield of the epidural fluid collection was 91% (95% CI, 84-94%). In meta-regression, the diagnostic yield was unaffected regardless of consecutive enrollment, magnet strength, or 2D/3D.

CONCLUSIONS

MR myelography had a high diagnostic yield in patients with SIH. MR myelography is non-invasive and not inferior to MR myelography with intrathecal gadolinium.

KEY POINTS

• The pooled diagnostic yield of MR myelography was 86% (95% CI, 80-91%) in patients with spontaneous intracranial hypotension. • There was no significant difference in pooled diagnostic yield between MR myelography and MR myelography with intrathecal gadolinium. • MR myelography is non-invasive and not inferior to MR myelography with intrathecal gadolinium.

Diagnostic performance of hippocampal volumetry in Alzheimer's disease or mild cognitive impairment: a meta-analysis

OBJECTIVE

To evaluate the diagnostic performance of hippocampal volumetry for Alzheimer's disease (AD) or mild cognitive impairment (MCI).

METHODS

The MEDLINE and Embase databases were searched for articles that evaluated the diagnostic performance of hippocampal volumetry in differentiating AD or MCI from normal controls, published up to March 6, 2022. The quality of the articles was evaluated by the QUADAS-2 tool. A bivariate random-effects model was used to pool sensitivity, specificity, and area under the curve. Sensitivity analysis and meta-regression were conducted to explain study heterogeneity. The diagnostic performance of entorhinal cortex volumetry was also pooled.

RESULTS

Thirty-three articles (5157 patients) were included. The pooled sensitivity and specificity for AD were 82% (95% confidence interval [CI], 77-86%) and 87% (95% CI, 82-91%), whereas those for MCI were 60% (95% CI, 51-69%) and 75% (95% CI, 67-81%), respectively. No difference in the diagnostic performance was observed between automatic and manual segmentation (p = 0.11). MMSE scores, study design, and the reference standard being used were associated with study heterogeneity (p < 0.01). Subgroup analysis demonstrated a higher diagnostic performance of entorhinal cortex volumetry for both AD (pooled sensitivity: 88% vs. 79%, specificity: 92% vs. 89%, p = 0.07) and MCI (pooled sensitivity: 71% vs. 55%, specificity: 83% vs. 68%, p = 0.06).

CONCLUSIONS

Our meta-analysis demonstrated good diagnostic performance of hippocampal volumetry for AD or MCI. Entorhinal cortex volumetry might have superior diagnostic performance to hippocampal volumetry. However, due to a small number of studies, the diagnostic performance of entorhinal cortex volumetry is yet to be determined.

KEY POINTS

• The pooled sensitivity and specificity of hippocampal volumetry for Alzheimer's disease were 82% and 87%, whereas those for mild cognitive impairment were 60% and 75%, respectively. • No significant difference in the diagnostic performance was observed between automatic and manual segmentation. • Subgroup analysis demonstrated superior diagnostic performance of entorhinal cortex volumetry for AD (pooled sensitivity: 88%, specificity: 92%) and MCI (pooled sensitivity: 71%, specificity: 83%).