1
|
Lim SJ, Suh PS, Suh CH, Kim PH, Park KJ, Park HJ, Lee CW. Substituting with alternative iodinated contrast medium to prevent recurrent adverse drug reactions associated with its use: a meta-analysis. Eur Radiol 2025; 35:2569-2579. [PMID: 39419863 DOI: 10.1007/s00330-024-11114-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2024] [Revised: 07/07/2024] [Accepted: 09/11/2024] [Indexed: 10/19/2024]
Abstract
OBJECTIVES To systematically review and meta-analyze the recurrent rate of iodinated contrast medium (ICM)-associated adverse drug reactions (ADRs) and the preventive effect of using alternative ICM lacking a common carbamoyl side chain. MATERIALS AND METHODS A systematic literature search was conducted in the MEDLINE and EMBASE databases to identify studies that investigated the recurrence rate of ICM-associated ADRs or hypersensitivity reactions (HSRs). Studies that included patients who subsequently underwent contrast-enhanced computed tomography scans after their index reactions were included, while studies with overlapping cohorts were excluded. The first search was conducted on November 10, 2023. The pooled recurrence rate of ICM-associated ADR was determined using the DerSimonian-Laird random-effects model. Subgroup analyses were also conducted based on the substitution of ICM, with particular consideration given to the N-(2,3-dihydroxypropyl) carbamoyl side chain. RESULTS A total of ten original articles were included in the analysis, collectively spanning from June 2001 to March 2021. The pooled recurrence rate of ICM-associated ADR was not significantly different from that of ICM-associated HSR (16.6% [95% CI, 7.8-31.9%] vs. 15.5% [95% CI, 10.8-21.8%], p = 0.87). In the subgroup analyses, the pooled odds ratio for ICM-associated recurrent ADR when using a different ICM compared with using the same ICM was 0.31 (95% CI, 0.21-0.45), which means a 69% reduction. Moreover, the pooled odds ratio for ICM-associated recurrent ADR when substituting ICMs with different side chains compared with substituting with common side chains was 0.65 (95% CI, 0.52-0.82), which means an additional 35% reduction. CONCLUSION Substituting with an alternative ICM led to a 69% reduction in recurrent ADRs, with an additional 35% reduction observed when using ICM lacking a common carbamoyl side chain. KEY POINTS Question No standardized guidelines exist for replacing previously used iodinated contrast medium (ICM) to prevent recurrent adverse reactions. Findings Using alternative contrast medium with a different carbamoyl side chain prevents adverse drug reactions effectively. Clinical relevance This study advocates using alternative ICM without a common carbamoyl side chain to prevent recurrent adverse drug reactions in patients with a history of such events.
Collapse
Affiliation(s)
- Su Jin Lim
- Department of Radiology, National Cancer Center, Seoul, Republic of Korea
| | - Pae Sun Suh
- Department of Radiology and Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yonsei University College of Medicine, Seoul, Republic of Korea
| | - Chong Hyun Suh
- Department of Radiology and Research Institute of Radiology, University of Ulsan College of Medicine, Asan Medical Center, Seoul, Republic of Korea.
| | - Pyeong Hwa Kim
- Department of Radiology and Research Institute of Radiology, University of Ulsan College of Medicine, Asan Medical Center, Seoul, Republic of Korea
| | - Kye Jin Park
- Department of Radiology and Research Institute of Radiology, University of Ulsan College of Medicine, Asan Medical Center, Seoul, Republic of Korea
| | - Hyo Jung Park
- Department of Radiology and Research Institute of Radiology, University of Ulsan College of Medicine, Asan Medical Center, Seoul, Republic of Korea
| | - Choong Wook Lee
- Department of Radiology and Research Institute of Radiology, University of Ulsan College of Medicine, Asan Medical Center, Seoul, Republic of Korea
| |
Collapse
|
2
|
Tsuge T, Yamamoto N, Tomita Y, Hagiyama A, Shiratsuchi D, Kato Y, Taito S, Yorifuji T. Reporting and Methodological Qualities of Systematic Reviews in Rehabilitation Journals After 2020: A Cross-Sectional Meta-Epidemiological Study. Phys Ther 2025; 105:pzaf032. [PMID: 40089987 DOI: 10.1093/ptj/pzaf032] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/03/2024] [Revised: 12/23/2024] [Accepted: 01/24/2025] [Indexed: 03/18/2025]
Abstract
OBJECTIVES The aim of this study was to investigate the reporting and methodological qualities in systematic reviews (SRs) of rehabilitation journals following updating to the use of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) 2020 statement. METHODS SRs with pairwise meta-analyses on the effects of health interventions were selected, which were published in rehabilitation journals in 2020, 2021, and 2022 using MEDLINE (PubMed). Exposure was defined as reporting use of the PRISMA 2020 statement. A comparison group consisted of SRs that did not use the PRISMA 2020 statement. The adherence of the PRISMA 2020 items, PRISMA 2020 for abstracts, and A MeaSurement Tool to Assess systematic Reviews (AMSTAR) 2 items were evaluated. RESULTS Thirteen thousand, three hundred eighty-one articles were identified after conducting a search on April 2, 2023. The study included 100 articles each that used and those that did not use the PRISMA 2020 statement. Of 41 items in the PRISMA 2020 statement, 48.8% (20/41) adhered to ≥80% of each item for those that used the PRISMA 2020 statement and 41.5% (17/41) in those that did not use the PRISMA 2020 statement. The PRISMA 2020 statement did not lead to any major improvement, and only a slight improvement of 9.8% (4/41) was observed when compared with those that did not use the PRISMA 2020 statement. Similarly, no item improved in the PRISMA 2020 for abstracts, and only 5.6% (1/18) improved in the AMSTAR 2 items. CONCLUSION This study showed that reporting use of the PRISMA 2020 statement did not result in any major improvements; however, only a slight improvement was observed in the reporting and methodological qualities of SRs in rehabilitation journals. Researchers should adhere to each item in the PRISMA 2020 statement in SRs published in rehabilitation journals. IMPACT The reporting and methodological quality of systematic reviews in rehabilitation journals is insufficient. It is important to improve the reporting and methodological quality of systematic reviews in rehabilitation journals. It is recommended that researchers not only declare their reporting use of the PRISMA 2020 statement, but also adhere to each item correctly.
Collapse
Affiliation(s)
- Takahiro Tsuge
- Department of Rehabilitation, Kurashiki Medical Centre, Kurashiki, Okayama 710-8522, Japan
- Department of Epidemiology, Graduate School of Medicine, Dentistry, and Pharmaceutical Sciences, Okayama University, Okayama 700-8558, Japan
- Scientific Research WorkS Peer Support Group (SRWS-PSG), Osaka 541-0043, Japan
| | - Norio Yamamoto
- Scientific Research WorkS Peer Support Group (SRWS-PSG), Osaka 541-0043, Japan
- Department of Orthopedic Surgery, Minato Medical Coop-Kyoritsu General Hospital, Nagoya, Aichi 456-8611, Japan
| | - Yosuke Tomita
- Department of Physical Therapy, Faculty of Health Care, Takasaki University of Health and Welfare, Takasaki, Gunma 370-0033, Japan
| | - Akikazu Hagiyama
- Department of Epidemiology, Graduate School of Medicine, Dentistry, and Pharmaceutical Sciences, Okayama University, Okayama 700-8558, Japan
- Scientific Research WorkS Peer Support Group (SRWS-PSG), Osaka 541-0043, Japan
- Division of Physical Medicine and Rehabilitation, Okayama University Hospital, Okayama 700-8558, Japan
| | - Daijo Shiratsuchi
- Department of Physical Therapy, School of Health Sciences, Faculty of Medicine, Kagoshima University, Kagoshima 890-8544, Japan
| | - Yukiko Kato
- Faculty of Nursing and Medical Care, Keio University, Fujisawa, Kanagawa 252-0883, Japan
| | - Shunsuke Taito
- Scientific Research WorkS Peer Support Group (SRWS-PSG), Osaka 541-0043, Japan
- Division of Rehabilitation, Department of Clinical Practice and Support, Hiroshima University Hospital, Hiroshima 734-8551, Japan
| | - Takashi Yorifuji
- Department of Epidemiology, Graduate School of Medicine, Dentistry, and Pharmaceutical Sciences, Okayama University, Okayama 700-8558, Japan
| |
Collapse
|
3
|
Ko JS, Heo H, Suh CH, Yi J, Shim WH. Adherence of Studies on Large Language Models for Medical Applications Published in Leading Medical Journals According to the MI-CLEAR-LLM Checklist. Korean J Radiol 2025; 26:304-312. [PMID: 40015560 PMCID: PMC11955383 DOI: 10.3348/kjr.2024.1161] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/12/2024] [Revised: 12/25/2024] [Accepted: 01/03/2025] [Indexed: 03/01/2025] Open
Abstract
OBJECTIVE To evaluate the adherence of large language model (LLM)-based healthcare research to the Minimum Reporting Items for Clear Evaluation of Accuracy Reports of Large Language Models in Healthcare (MI-CLEAR-LLM) checklist, a framework designed to enhance the transparency and reproducibility of studies on the accuracy of LLMs for medical applications. MATERIALS AND METHODS A systematic PubMed search was conducted to identify articles on LLM performance published in high-ranking clinical medicine journals (the top 10% in each of the 59 specialties according to the 2023 Journal Impact Factor) from November 30, 2022, through June 25, 2024. Data on the six MI-CLEAR-LLM checklist items: 1) identification and specification of the LLM used, 2) stochasticity handling, 3) prompt wording and syntax, 4) prompt structuring, 5) prompt testing and optimization, and 6) independence of the test data-were independently extracted by two reviewers, and adherence was calculated for each item. RESULTS Of 159 studies, 100% (159/159) reported the name of the LLM, 96.9% (154/159) reported the version, and 91.8% (146/159) reported the manufacturer. However, only 54.1% (86/159) reported the training data cutoff date, 6.3% (10/159) documented access to web-based information, and 50.9% (81/159) provided the date of the query attempts. Clear documentation regarding stochasticity management was provided in 15.1% (24/159) of the studies. Regarding prompt details, 49.1% (78/159) provided exact prompt wording and syntax but only 34.0% (54/159) documented prompt-structuring practices. While 46.5% (74/159) of the studies detailed prompt testing, only 15.7% (25/159) explained the rationale for specific word choices. Test data independence was reported for only 13.2% (21/159) of the studies, and 56.6% (43/76) provided URLs for internet-sourced test data. CONCLUSION Although basic LLM identification details were relatively well reported, other key aspects, including stochasticity, prompts, and test data, were frequently underreported. Enhancing adherence to the MI-CLEAR-LLM checklist will allow LLM research to achieve greater transparency and will foster more credible and reliable future studies.
Collapse
Affiliation(s)
- Ji Su Ko
- Department of Radiology and Research Institute of Radiology, University of Ulsan College of Medicine, Asan Medical Center, Seoul, Republic of Korea
| | - Hwon Heo
- Department of Medical Science, Asan Medical Institute of Convergence Science and Technology, University of Ulsan College of Medicine, Asan Medical Center, Seoul, Republic of Korea
| | - Chong Hyun Suh
- Department of Radiology and Research Institute of Radiology, University of Ulsan College of Medicine, Asan Medical Center, Seoul, Republic of Korea.
| | - Jeho Yi
- Asan Medical Library, University of Ulsan College of Medicine, Seoul, Republic of Korea
| | - Woo Hyun Shim
- Department of Radiology and Research Institute of Radiology, University of Ulsan College of Medicine, Asan Medical Center, Seoul, Republic of Korea
- Department of Medical Science, Asan Medical Institute of Convergence Science and Technology, University of Ulsan College of Medicine, Asan Medical Center, Seoul, Republic of Korea
| |
Collapse
|
4
|
Jairam MP, Kidanemariam S, Malik A, Corrales CE, Suh CH, Guenette JP. Systematic Review of the Diagnostic Imaging Evaluation of Pulsatile Tinnitus. MEDRXIV : THE PREPRINT SERVER FOR HEALTH SCIENCES 2025:2025.02.25.25322858. [PMID: 40061335 PMCID: PMC11888499 DOI: 10.1101/2025.02.25.25322858] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 03/19/2025]
Abstract
Objective Aggregate published data on the imaging of pulsatile tinnitus as a step toward building a framework for an evidence-based approach to diagnostic imaging for this symptom. Materials & Methods A systematic review was performed. PUBMED and EMBASE were searched on December 1, 2021 for English-language articles on diagnostic imaging of pulsatile tinnitus. Articles that involved non-standard imaging techniques and those that focused on management of pulsatile tinnitus were excluded. Extracted data included: number of males and females; signs, symptoms, and physical examination findings with associated patient counts; imaging findings; count of patients with imaging-identified cause of pulsatile tinnitus; reported associated interventions and outcomes. Results 41 articles were included with a total of 2,633 reported patients. 10 studies were prospective. MRA appears to be capable of identifying many of the same pathologies traditionally diagnosed with DSA. Few head-to-head comparisons were performed. In head-to-head comparisons of MRI and MRA, MRA was often able to identify more pathology. There was no clear relationship identified between specific symptoms and the imaging modality chosen, indicating that the imaging evaluation of pulsatile tinnitus is likely sensitive to the preferences of the evaluating provider. Conclusion There is limited evidence to inform best practices for the initial imaging evaluation of pulsatile tinnitus and preference-sensitive provider decisions will continue to guide the pulsatile tinnitus workup. We encourage prospective studies with multimodality imaging comparisons to build evidence that would support the development of more effective, efficient, and equitable protocols and pathways for the imaging evaluation of pulsatile tinnitus.
Collapse
Affiliation(s)
- Meghan P. Jairam
- Division of Neuroradiology, Brigham and Women’s Hospital, Boston, MA, USA
| | - Simon Kidanemariam
- Division of Neuroradiology, Brigham and Women’s Hospital, Boston, MA, USA
- The Warren Alpert Medical School of Brown University, Providence, RI, USA
| | | | - C. Eduardo Corrales
- Division of Otolaryngology-Head and Neck Surgery, Brigham and Women’s Hospital, Boston, MA, USA
| | - Chong Hyun Suh
- Department of Radiology and Research Institute of Radiology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Korea
| | - Jeffrey P Guenette
- Division of Neuroradiology, Brigham and Women’s Hospital, Boston, MA, USA
| |
Collapse
|
5
|
Belay MA, Bogale EK, Haile MT, Bogale SK, Getachew E, Andarge GA, Seid K, Lakew G, Yirsaw AN, Gebreegziabher ZA, Semagn BE, Alemu AT. Double burden of malnutrition among households in Ethiopia: a systematic review and meta-analysis. Front Public Health 2025; 12:1417289. [PMID: 39949342 PMCID: PMC11822474 DOI: 10.3389/fpubh.2024.1417289] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/14/2024] [Accepted: 12/16/2024] [Indexed: 02/16/2025] Open
Abstract
Introduction The double burden of malnutrition (DBM) at the household level has increased in sub-Saharan African countries as a result of rapid changes in global food systems and growing urbanization. The presence of overweight or obese mothers with undernourished (stunted, wasted, or underweight) children within the same household holds particular significance. However, no comprehensive study or meta-analysis has been conducted to summarize the national evidence of the double burden of malnutrition in mother-child pairs. Therefore, the purpose of this study was to determine the pooled prevalence of the double burden of malnutrition at the household level in Ethiopia in 2024. Methods This systematic review and meta-analysis was conducted on the prevalence of the double burden of malnutrition and associated factors among households in Ethiopia, using an advanced search of electronic databases and search engines. The standardized Joanna Briggs Institute (JBI) method was used to extract data from a Microsoft Excel spreadsheet and evaluate the quality of each article. The analysis was performed using STATA V.17. A random-effects model was used to conduct the meta-analysis. Heterogeneity was assessed using the I2 and Q tests. Results A total of seven publications met the inclusion criteria, including data from 56,877 and 43,770 mother-child pairs for the systematic review and meta-analysis, respectively. The pooled prevalence of the double burden of malnutrition among the mother-child pairs was 8.30% (95% confidence interval (CI): 1.51, 15.09). The heterogeneity test revealed extremely high heterogeneity (I2 = 99.91%; p = 0.00). In the subgroup analysis based on sample size, the pooled estimated prevalence of the double burden of malnutrition was high for a sample size of fewer than 1,000 mother-child pairs (11.69% (95% CI: 3.11, 20.28)). The pooled estimate from the subgroup analysis of the data collected 8 years ago was 8.61% (95% CI: 1.11, 22.33). Residence, household size, housing quality, wealth index, household food security status, mother's age and educational status, and child's age are some of the factors that influence the double burden of malnutrition among mother-child pairs. Conclusion In Ethiopia, the double burden of malnutrition among mother-child pairs is rapidly emerging. As a result, double-duty interventions should be implemented to address this issue, taking into account multiple factors at the household level. Systematic review registration The protocol for the systematic review and meta-analysis was registered under the registration ID CRD42024517778 with the PROSPERO (International Prospective Register of Systematic Review and Meta-analysis).
Collapse
Affiliation(s)
- Mahider Awoke Belay
- Department of Public Health, College of Medicine and Health Science, Injibara University, Injibara, Ethiopia
| | - Eyob Ketema Bogale
- Departments of Health Promotion and Behavioral Science, School of Public Health, College of Medicine and Health Science, Bahir Dar University, Bahir Dar, Ethiopia
| | - Mitiku Tefera Haile
- Department of Midwifery School of Nursing and Midwifery, Asrat Woldeyes Health Science Campus, Debre Berhan University, Debre Berhan, Ethiopia
| | | | - Eyob Getachew
- Departments of Health Promotion and Communication, School of Public Health, College of Medicine and Health Sciences, University of Gondar, Gondar, Ethiopia
| | - Getnet Alemu Andarge
- Department of Nutrition, Antsokiya Gemza Wereda Health Office, Antsokiya, Ethiopia
| | - Kedir Seid
- Bati Primary Hospital, Oromia Special Zone, Bati, Ethiopia
| | - Gebeyehu Lakew
- Departments of Health Promotion and Communication, School of Public Health, College of Medicine and Health Sciences, University of Gondar, Gondar, Ethiopia
| | - Amlaku Nigusie Yirsaw
- Departments of Health Promotion and Communication, School of Public Health, College of Medicine and Health Sciences, University of Gondar, Gondar, Ethiopia
| | - Zenebe Abebe Gebreegziabher
- Department of Epidemiology and Biostatistics, School of Public Health, Asrat Woldeyes Health Science Campus, Debre Berhan University, Debre Berhan, Ethiopia
| | - Birhan Ewunu Semagn
- Department of Public Health, School of Public Health, Asrat Woldeyes Health Science Campus, Debre Berhan University, Debre Berhan, Ethiopia
| | - Ayenew Takele Alemu
- Department of Public Health, College of Medicine and Health Science, Injibara University, Injibara, Ethiopia
| |
Collapse
|
6
|
Suda C, Yamamoto N, Tsuge T, Hayashi M, Suzuki K, Ikuta Y, Banno M. Enhancing Reporting Quality Using the Preferred Reporting Items for Systematic Review and Meta-Analysis 2020 in Systematic Reviews of Emergency Medicine Journals: A Cross-Sectional Study. Cureus 2025; 17:e78255. [PMID: 40027066 PMCID: PMC11871967 DOI: 10.7759/cureus.78255] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 01/30/2025] [Indexed: 03/05/2025] Open
Abstract
BACKGROUND Systematic reviews (SRs) with thorough reporting and rigorous methodology lead to less biased outcomes. The Priority Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement was developed to enhance SRs and meta-analysis reporting. While it was updated to PRISMA 2020, the impact on emergency medicine remains unexplored. Therefore, we aimed to investigate whether using PRISMA 2020 improves the reporting quality of SRs in the emergency medicine field. METHODS This study is a cross-sectional meta-epidemiological analysis of SRs published in emergency medicine journals between 2021 and 2023. We selected SRs with pairwise meta-analyses of health interventions included in MEDLINE. We evaluated adherence to PRISMA 2020 items with and without the use of the PRISMA 2020 statement. RESULTS A total of 695 articles were analyzed, ultimately including 31 that used PRISMA 2020 and 100 that did not. Adherence rates to PRISMA 2020 items were higher in papers using PRISMA 2020 (925/1270, 72.8%, odds ratio: 1.24, 95% confidence interval: 1.08-1.43) than in papers not using it (2758/4034, 68.4%). No SRs met all of the PRISMA 2020 criteria. Adherence to PRISMA 2020 for Abstracts was slightly higher in the group that used the PRISMA 2020 (182/372, 48.9%, odds ratio: 1.17, 95% confidence interval: 0.92-1.47), compared to those that had not (541/1200, 45.1%). Adherence was highest in the introduction and lowest in the methods section. Agreement between the first author and other reviewers' ratings averaged 89.6% (4815/5371). CONCLUSION Implementing PRISMA 2020 significantly improved the reporting quality of SRs in emergency medicine-related journals. Declaring the use of PRISMA 2020 is insufficient, and researchers must strictly adhere to each item. REGISTRATION The study protocol was registered in the Open Science Framework on September 22, 2023 (https://doi.org/10.17605/OSF.IO/DQ5W6).
Collapse
Affiliation(s)
- Chiaki Suda
- Department of Public Health, Gunma University Graduate School of Medicine, Maebashi, JPN
| | - Norio Yamamoto
- Department of Orthopedic Surgery, Minato Medical Coop-Kyoritsu General Hospital, Nagoya, JPN
- Department of systematic reviewers, Systematic Review Workshop Peer Support Group (SRWS-PSG), Osaka, JPN
| | - Takahiro Tsuge
- Department of Epidemiology, Graduate School of Medicine, Dentistry and Pharmaceutical Sciences, Okayama University, Okayama, JPN
- Department of Systematic Reviewers, Systematic Review Workshop Peer Support Group (SRWS-PSG), Osaka, JPN
| | - Minoru Hayashi
- Department of Emergency Medicine, Fukui Prefectural Hospital, Fukui, JPN
| | - Kosuke Suzuki
- Department of Rehabilitation, Yamagata Saisei Hospital, Yamagata, JPN
| | - Yasuhisa Ikuta
- Division of Neonatology, Center for Maternal-Fetal, Neonatal and Reproductive Medicine, National Center for Child Health and Development, Tokyo, JPN
| | - Masahiro Banno
- Department of Systematic Reviewers, Systematic Review Workshop Peer Support Group (SRWS-PSG), Osaka, JPN
- Department of Psychiatry, Seichiryo Hospital, Nagoya, JPN
| |
Collapse
|
7
|
Alnaimat F, Al-Halaseh S, AlSamhori ARF. Evolution of Research Reporting Standards: Adapting to the Influence of Artificial Intelligence, Statistics Software, and Writing Tools. J Korean Med Sci 2024; 39:e231. [PMID: 39164055 PMCID: PMC11333804 DOI: 10.3346/jkms.2024.39.e231] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/20/2024] [Accepted: 07/01/2024] [Indexed: 08/22/2024] Open
Abstract
Reporting standards are essential to health research as they improve accuracy and transparency. Over time, significant changes have occurred to the requirements for reporting research to ensure comprehensive and transparent reporting across a range of study domains and foster methodological rigor. The establishment of the Declaration of Helsinki, Consolidated Standards of Reporting Trials (CONSORT), Strengthening the Reporting of Observational Studies in Epidemiology (STROBE), and Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) are just a few of the historic initiatives that have increased research transparency. Through enhanced discoverability, statistical analysis facilitation, article quality enhancement, and language barrier reduction, artificial intelligence (AI)-in particular, large language models like ChatGPT-has transformed academic writing. However, problems with errors that could occur and the need for transparency while utilizing AI tools still exist. Modifying reporting rules to include AI-driven writing tools such as ChatGPT is ethically and practically challenging. In academic writing, precautions for truth, privacy, and responsibility are necessary due to concerns about biases, openness, data limits, and potential legal ramifications. The CONSORT-AI and Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT)-AI Steering Group expands the CONSORT guidelines for AI clinical trials-new checklists like METRICS and CLEAR help to promote transparency in AI studies. Responsible usage of technology in research and writing software adoption requires interdisciplinary collaboration and ethical assessment. This study explores the impact of AI technologies, specifically ChatGPT, on past reporting standards and the need for revised guidelines for open, reproducible, and robust scientific publications.
Collapse
Affiliation(s)
- Fatima Alnaimat
- Division of Rheumatology, Department of Internal Medicine, School of Medicine, University of Jordan, Amman, Jordan.
| | - Salameh Al-Halaseh
- Department of Internal Medicine, School of Medicine, University of Jordan, Amman, Jordan
| | | |
Collapse
|
8
|
Zhong J, Xing Y, Hu Y, Lu J, Yang J, Zhang G, Mao S, Chen H, Yin Q, Cen Q, Jiang R, Chu J, Song Y, Lu M, Ding D, Ge X, Zhang H, Yao W. The policies on the use of large language models in radiological journals are lacking: a meta-research study. Insights Imaging 2024; 15:186. [PMID: 39090273 PMCID: PMC11294318 DOI: 10.1186/s13244-024-01769-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/12/2024] [Accepted: 07/07/2024] [Indexed: 08/04/2024] Open
Abstract
OBJECTIVE To evaluate whether and how the radiological journals present their policies on the use of large language models (LLMs), and identify the journal characteristic variables that are associated with the presence. METHODS In this meta-research study, we screened Journals from the Radiology, Nuclear Medicine and Medical Imaging Category, 2022 Journal Citation Reports, excluding journals in non-English languages and relevant documents unavailable. We assessed their LLM use policies: (1) whether the policy is present; (2) whether the policy for the authors, the reviewers, and the editors is present; and (3) whether the policy asks the author to report the usage of LLMs, the name of LLMs, the section that used LLMs, the role of LLMs, the verification of LLMs, and the potential influence of LLMs. The association between the presence of policies and journal characteristic variables was evaluated. RESULTS The LLM use policies were presented in 43.9% (83/189) of journals, and those for the authors, the reviewers, and the editor were presented in 43.4% (82/189), 29.6% (56/189) and 25.9% (49/189) of journals, respectively. Many journals mentioned the aspects of the usage (43.4%, 82/189), the name (34.9%, 66/189), the verification (33.3%, 63/189), and the role (31.7%, 60/189) of LLMs, while the potential influence of LLMs (4.2%, 8/189), and the section that used LLMs (1.6%, 3/189) were seldomly touched. The publisher is related to the presence of LLM use policies (p < 0.001). CONCLUSION The presence of LLM use policies is suboptimal in radiological journals. A reporting guideline is encouraged to facilitate reporting quality and transparency. CRITICAL RELEVANCE STATEMENT It may facilitate the quality and transparency of the use of LLMs in scientific writing if a shared complete reporting guideline is developed by stakeholders and then endorsed by journals. KEY POINTS The policies on LLM use in radiological journals are unexplored. Some of the radiological journals presented policies on LLM use. A shared complete reporting guideline for LLM use is desired.
Collapse
Affiliation(s)
- Jingyu Zhong
- Laboratory of Key Technology and Materials in Minimally Invasive Spine Surgery, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China.
- Center for Spinal Minimally Invasive Research, Shanghai Jiao Tong University, Shanghai, China.
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China.
| | - Yue Xing
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Yangfan Hu
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Junjie Lu
- Department of Epidemiology and Population Health, Stanford University School of Medicine, Stanford, CA, USA
| | - Jiarui Yang
- Department of Biomedical Engineering, Boston University, Boston, MA, USA
| | - Guangcheng Zhang
- Department of Orthopedics, Shanghai Sixth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Shiqi Mao
- Department of Medical Oncology, Shanghai Pulmonary Hospital, Tongji University School of Medicine, Shanghai, China
| | - Haoda Chen
- Department of General Surgery, Pancreatic Disease Center, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Qian Yin
- Department of Pathology, Shanghai Sixth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Qingqing Cen
- Department of Dermatology, Shanghai Ninth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Run Jiang
- Department of Pharmacovigilance, Shanghai Hansoh BioMedical Co., Ltd., Shanghai, China
| | - Jingshen Chu
- Editorial Office of Journal of Diagnostics Concepts & Practice, Department of Science and Technology Development, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Yang Song
- MR Scientific Marketing, Siemens Healthineers Ltd., Shanghai, China
| | - Minda Lu
- MR Application, Siemens Healthineers Ltd., Shanghai, China
| | - Defang Ding
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Xiang Ge
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Huan Zhang
- Department of Radiology, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China.
| | - Weiwu Yao
- Laboratory of Key Technology and Materials in Minimally Invasive Spine Surgery, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China.
- Center for Spinal Minimally Invasive Research, Shanghai Jiao Tong University, Shanghai, China.
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China.
| |
Collapse
|
9
|
Zufry H, Hariyanto TI. Comparative Efficacy and Safety of Radiofrequency Ablation and Microwave Ablation in the Treatment of Benign Thyroid Nodules: A Systematic Review and Meta-Analysis. Korean J Radiol 2024; 25:301-313. [PMID: 38413114 PMCID: PMC10912499 DOI: 10.3348/kjr.2023.1004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2023] [Revised: 11/29/2023] [Accepted: 12/29/2023] [Indexed: 02/29/2024] Open
Abstract
OBJECTIVE The current body of evidence lacks clarity regarding the comparative efficacy and safety of radiofrequency ablation (RFA) and microwave ablation (MWA) as minimally invasive treatments for benign thyroid nodules. The primary objective of this study is to clarify these concerns. MATERIALS AND METHODS A comprehensive search was conducted using the Cochrane Library, Scopus, Europe PMC, and Medline databases until October 10th, 2023, using a combination of relevant keywords. This study incorporated literature that compared RFA and MWA for benign thyroid nodules. The primary outcome was the volume reduction ratio (VRR) from baseline to follow-up. Secondary outcomes were symptom score, cosmetic score, ablation time, major complications rate, hemorrhage, hoarseness, skin burn, cough, and sympathetic nerve injury. We used Risk of Bias in Non-randomized Studies - of Interventions (ROBINS-I) tool to assess the risk of bias in the included studies. We employed random effects models to analyze the standardized mean difference (SMD) and odds ratio for the presentation of outcomes. RESULTS Nine studies with 2707 nodules were included. The results of our meta-analysis indicated similar efficacy between RFA and MWA in terms of VRR during the 1 (SMD 0.06; 95% confidence interval [CI]: -0.13 to 0.26; P = 0.52) and 3 (SMD 0.11; 95% CI: -0.03 to 0.25; P = 0.12) months of follow-up. VRR was significantly higher in RFA than in MWA at the 6 (SMD 0.25; 95% CI: 0.06-0.43; P = 0.008) and 12 month of follow-up (SMD 0.38; 95% CI: 0.17 to 0.59; P < 0.001). There were no significant differences between RFA and MWA in symptom scores, cosmetic scores, or the incidence of complications, including hemorrhage, hoarseness, skin burn, cough, and sympathetic nerve injury. CONCLUSION RFA showed a higher VRR than MWA at 6 and 12-month follow-ups, with a comparable safety profile.
Collapse
Affiliation(s)
- Hendra Zufry
- Department of Internal Medicine, Faculty of Medicine, Universitas Syiah Kuala, Banda Aceh, Indonesia
- Innovation and Research Center of Endocrinology, Faculty of Medicine, Universitas Syiah Kuala, Banda Aceh, Indonesia.
| | | |
Collapse
|
10
|
Wang Z, Wang Y, Shang W, Liu W, Lu C, Huang J, Lei C, Chen Z, Wang Z, Yang K, Li X, Lu C. Reporting quality and risk of bias of systematic reviews of ultra-processed foods: a methodological study. Eur J Clin Nutr 2024; 78:171-179. [PMID: 38093096 DOI: 10.1038/s41430-023-01383-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2023] [Revised: 11/22/2023] [Accepted: 11/27/2023] [Indexed: 03/13/2024]
Abstract
A dramatic shift in the global food system is occurring with the rapid growth of ultra-processed foods (UPFs) consumption, which poses potentially serious health risks. Systematic review (SR) method has been used to summarise the association between UPF consumption and multiple health outcomes; however, a suboptimal-quality SR may mislead the decision-making in clinical practices and health policies. Therefore, a methodological review was conducted to identify the areas that can be improved regarding the risk of bias and reporting quality of relevant SRs. Systematic searches to collect SRs with meta-analyses of UPFs were performed using four databases from their inception to April 14, 2023. The risk of bias and reporting quality were evaluated using ROBIS and PRISMA 2020, respectively. The key characteristics of the included SRs were summarised descriptively. Excel 2019 and R 4.2.3 were used to analyse the data and draw graphs. Finally, 16 relevant SRs written in English and published between 2020 and 2023 in 12 academic journals were included. Only one SR was rated as low risk of bias, and the others were rated as higher risk of bias mainly because the risk of bias in the original studies was not explicitly addressed when synthesising the evidence. The reporting was required to be advanced significantly, involving amendments of registration and protocol, data and analytic code statement, and lists of excluded studies with justifications. The reviews' results could improve the quality, strengthen future relevant SRs' robustness, and further underpin the evidence base for supporting clinical decisions and health policies.
Collapse
Affiliation(s)
- Ziyi Wang
- Health Technology Assessment Center, Evidence-Based Social Science Research Center, School of Public Health, Lanzhou University, Lanzhou, 730000, China
- Evidence Based Medicine Center, School of Basic Medical Sciences, Lanzhou University, Lanzhou, 730000, China
- Key Laboratory of Evidence Based Medicine and Knowledge Translation of Gansu Province, Lanzhou, 730000, China
| | - Yan Wang
- Shangluo Central Hospital of Shaanxi Provincial, Shangluo, 726000, China
| | - Wenru Shang
- Health Technology Assessment Center, Evidence-Based Social Science Research Center, School of Public Health, Lanzhou University, Lanzhou, 730000, China
- Evidence Based Medicine Center, School of Basic Medical Sciences, Lanzhou University, Lanzhou, 730000, China
- Key Laboratory of Evidence Based Medicine and Knowledge Translation of Gansu Province, Lanzhou, 730000, China
| | - Wendi Liu
- Health Technology Assessment Center, Evidence-Based Social Science Research Center, School of Public Health, Lanzhou University, Lanzhou, 730000, China
- Evidence Based Medicine Center, School of Basic Medical Sciences, Lanzhou University, Lanzhou, 730000, China
- Key Laboratory of Evidence Based Medicine and Knowledge Translation of Gansu Province, Lanzhou, 730000, China
| | - Cui Lu
- Health Technology Assessment Center, Evidence-Based Social Science Research Center, School of Public Health, Lanzhou University, Lanzhou, 730000, China
- Evidence Based Medicine Center, School of Basic Medical Sciences, Lanzhou University, Lanzhou, 730000, China
- Key Laboratory of Evidence Based Medicine and Knowledge Translation of Gansu Province, Lanzhou, 730000, China
| | - Jiayi Huang
- Health Technology Assessment Center, Evidence-Based Social Science Research Center, School of Public Health, Lanzhou University, Lanzhou, 730000, China
- Evidence Based Medicine Center, School of Basic Medical Sciences, Lanzhou University, Lanzhou, 730000, China
- Key Laboratory of Evidence Based Medicine and Knowledge Translation of Gansu Province, Lanzhou, 730000, China
| | - Chao Lei
- Institute of Basic Research in Clinical Medicine, China Academy of Chinese Medical Sciences, 100700, Beijing, China
| | - Zijia Chen
- Institute of Basic Research in Clinical Medicine, China Academy of Chinese Medical Sciences, 100700, Beijing, China
| | - Zhifei Wang
- Institute of Basic Research in Clinical Medicine, China Academy of Chinese Medical Sciences, 100700, Beijing, China
| | - Kehu Yang
- Health Technology Assessment Center, Evidence-Based Social Science Research Center, School of Public Health, Lanzhou University, Lanzhou, 730000, China
- Evidence Based Medicine Center, School of Basic Medical Sciences, Lanzhou University, Lanzhou, 730000, China
- Key Laboratory of Evidence Based Medicine and Knowledge Translation of Gansu Province, Lanzhou, 730000, China
| | - Xiuxia Li
- Health Technology Assessment Center, Evidence-Based Social Science Research Center, School of Public Health, Lanzhou University, Lanzhou, 730000, China.
- Evidence Based Medicine Center, School of Basic Medical Sciences, Lanzhou University, Lanzhou, 730000, China.
- Key Laboratory of Evidence Based Medicine and Knowledge Translation of Gansu Province, Lanzhou, 730000, China.
| | - Cuncun Lu
- Institute of Basic Research in Clinical Medicine, China Academy of Chinese Medical Sciences, 100700, Beijing, China.
| |
Collapse
|
11
|
Zhong J, Xing Y, Lu J, Zhang G, Mao S, Chen H, Yin Q, Cen Q, Jiang R, Hu Y, Ding D, Ge X, Zhang H, Yao W. The endorsement of general and artificial intelligence reporting guidelines in radiological journals: a meta-research study. BMC Med Res Methodol 2023; 23:292. [PMID: 38093215 PMCID: PMC10717715 DOI: 10.1186/s12874-023-02117-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2023] [Accepted: 12/01/2023] [Indexed: 12/17/2023] Open
Abstract
BACKGROUND Complete reporting is essential for clinical research. However, the endorsement of reporting guidelines in radiological journals is still unclear. Further, as a field extensively utilizing artificial intelligence (AI), the adoption of both general and AI reporting guidelines would be necessary for enhancing quality and transparency of radiological research. This study aims to investigate the endorsement of general reporting guidelines and those for AI applications in medical imaging in radiological journals, and explore associated journal characteristic variables. METHODS This meta-research study screened journals from the Radiology, Nuclear Medicine & Medical Imaging category, Science Citation Index Expanded of the 2022 Journal Citation Reports, and excluded journals not publishing original research, in non-English languages, and instructions for authors unavailable. The endorsement of fifteen general reporting guidelines and ten AI reporting guidelines was rated using a five-level tool: "active strong", "active weak", "passive moderate", "passive weak", and "none". The association between endorsement and journal characteristic variables was evaluated by logistic regression analysis. RESULTS We included 117 journals. The top-five endorsed reporting guidelines were CONSORT (Consolidated Standards of Reporting Trials, 58.1%, 68/117), PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses, 54.7%, 64/117), STROBE (STrengthening the Reporting of Observational Studies in Epidemiology, 51.3%, 60/117), STARD (Standards for Reporting of Diagnostic Accuracy, 50.4%, 59/117), and ARRIVE (Animal Research Reporting of In Vivo Experiments, 35.9%, 42/117). The most implemented AI reporting guideline was CLAIM (Checklist for Artificial Intelligence in Medical Imaging, 1.7%, 2/117), while other nine AI reporting guidelines were not mentioned. The Journal Impact Factor quartile and publisher were associated with endorsement of reporting guidelines in radiological journals. CONCLUSIONS The general reporting guideline endorsement was suboptimal in radiological journals. The implementation of reporting guidelines for AI applications in medical imaging was extremely low. Their adoption should be strengthened to facilitate quality and transparency of radiological study reporting.
Collapse
Affiliation(s)
- Jingyu Zhong
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200336, China
| | - Yue Xing
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200336, China
| | - Junjie Lu
- Department of Epidemiology and Population Health, Stanford University School of Medicine, Stanford, CA, 94305, USA
| | - Guangcheng Zhang
- Department of Orthopedics, Shanghai Sixth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200233, China
| | - Shiqi Mao
- Department of Medical Oncology, Shanghai Pulmonary Hospital, Tongji University School of Medicine, Shanghai, 200433, China
| | - Haoda Chen
- Department of General Surgery, Pancreatic Disease Center, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200025, China
| | - Qian Yin
- Department of Pathology, Shanghai Sixth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200233, China
| | - Qingqing Cen
- Department of Dermatology, Shanghai Ninth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200011, China
| | - Run Jiang
- Department of Pharmacovigilance, Shanghai Hansoh BioMedical Co., Ltd., Shanghai, 201203, China
| | - Yangfan Hu
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200336, China
| | - Defang Ding
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200336, China
| | - Xiang Ge
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200336, China
| | - Huan Zhang
- Department of Radiology, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200025, China.
| | - Weiwu Yao
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200336, China.
| |
Collapse
|
12
|
Byon JH, Hwang S, Choi H, Choi EJ. Diagnostic Accuracy of Magnetic Resonance Imaging Features and Tumor-to-Nipple Distance for the Nipple-Areolar Complex Involvement of Breast Cancer: A Systematic Review and Meta-Analysis. Korean J Radiol 2023; 24:739-751. [PMID: 37500575 PMCID: PMC10400374 DOI: 10.3348/kjr.2022.0846] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2022] [Revised: 05/02/2023] [Accepted: 05/19/2023] [Indexed: 07/29/2023] Open
Abstract
OBJECTIVE This systematic review and meta-analysis evaluated the accuracy of preoperative breast magnetic resonance imaging (MRI) features and tumor-to-nipple distance (TND) for diagnosing occult nipple-areolar complex (NAC) involvement in breast cancer. MATERIALS AND METHODS The MEDLINE, Embase, and Cochrane databases were searched for articles published until March 20, 2022, excluding studies of patients with clinically evident NAC involvement or those treated with neoadjuvant chemotherapy. Study quality was assessed using the Quality Assessment of Diagnostic Accuracy Studies 2 tool. Two reviewers independently evaluated studies that reported the diagnostic performance of MRI imaging features such as continuity to the NAC, unilateral NAC enhancement, non-mass enhancement (NME) type, mass size (> 20 mm), and TND. Summary estimates of the sensitivity and specificity curves and the summary receiver operating characteristic (SROC) curve of the MRI features for NAC involvement were calculated using random-effects models. We also calculated the TND cutoffs required to achieve predetermined specificity values. RESULTS Fifteen studies (n = 4002 breast lesions) were analyzed. The pooled sensitivity and specificity (with 95% confidence intervals) for NAC involvement diagnosis were 71% (58-81) and 94% (91-96), respectively, for continuity to the NAC; 58% (45-70) and 97% (95-99), respectively, for unilateral NAC enhancement; 55% (46-64) and 83% (75-88), respectively, for NME type; and 88% (68-96) and 58% (40-75), respectively, for mass size (> 20 mm). TND had an area under the SROC curve of 0.799 for NAC involvement. A TND of 11.5 mm achieved a predetermined specificity of 85% with a sensitivity of 64%, and a TND of 12.3 mm yielded a predetermined specificity of 83% with a sensitivity of 65%. CONCLUSION Continuity to the NAC and unilateral NAC enhancement may help predict occult NAC involvement in breast cancer. To achieve the desired diagnostic performance with TND, a suitable cutoff value should be considered.
Collapse
Affiliation(s)
- Jung Hee Byon
- Department of Radiology, Ulsan University Hospital, University of Ulsan College of Medicine, Ulsan, Republic of Korea
| | - Seungyong Hwang
- Department of Genetics, Stanford University, Stanford, CA, USA
| | - Hyemi Choi
- Department of Statistics and Institute of Applied Statistics, Jeonbuk National University, Jeonju, Republic of Korea.
| | - Eun Jung Choi
- Department of Radiology, Research Institute of Clinical Medicine of Jeonbuk National University-Biomedical Research Institute of Jeonbuk National University Hospital, Jeonbuk National University Medical School, Jeonju, Republic of Korea.
| |
Collapse
|
13
|
Hamilton DG, Hong K, Fraser H, Rowhani-Farid A, Fidler F, Page MJ. Prevalence and predictors of data and code sharing in the medical and health sciences: systematic review with meta-analysis of individual participant data. BMJ 2023; 382:e075767. [PMID: 37433624 PMCID: PMC10334349 DOI: 10.1136/bmj-2023-075767] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 06/07/2023] [Indexed: 07/13/2023]
Abstract
OBJECTIVES To synthesise research investigating data and code sharing in medicine and health to establish an accurate representation of the prevalence of sharing, how this frequency has changed over time, and what factors influence availability. DESIGN Systematic review with meta-analysis of individual participant data. DATA SOURCES Ovid Medline, Ovid Embase, and the preprint servers medRxiv, bioRxiv, and MetaArXiv were searched from inception to 1 July 2021. Forward citation searches were also performed on 30 August 2022. REVIEW METHODS Meta-research studies that investigated data or code sharing across a sample of scientific articles presenting original medical and health research were identified. Two authors screened records, assessed the risk of bias, and extracted summary data from study reports when individual participant data could not be retrieved. Key outcomes of interest were the prevalence of statements that declared that data or code were publicly or privately available (declared availability) and the success rates of retrieving these products (actual availability). The associations between data and code availability and several factors (eg, journal policy, type of data, trial design, and human participants) were also examined. A two stage approach to meta-analysis of individual participant data was performed, with proportions and risk ratios pooled with the Hartung-Knapp-Sidik-Jonkman method for random effects meta-analysis. RESULTS The review included 105 meta-research studies examining 2 121 580 articles across 31 specialties. Eligible studies examined a median of 195 primary articles (interquartile range 113-475), with a median publication year of 2015 (interquartile range 2012-2018). Only eight studies (8%) were classified as having a low risk of bias. Meta-analyses showed a prevalence of declared and actual public data availability of 8% (95% confidence interval 5% to 11%) and 2% (1% to 3%), respectively, between 2016 and 2021. For public code sharing, both the prevalence of declared and actual availability were estimated to be <0.5% since 2016. Meta-regressions indicated that only declared public data sharing prevalence estimates have increased over time. Compliance with mandatory data sharing policies ranged from 0% to 100% across journals and varied by type of data. In contrast, success in privately obtaining data and code from authors historically ranged between 0% and 37% and 0% and 23%, respectively. CONCLUSIONS The review found that public code sharing was persistently low across medical research. Declarations of data sharing were also low, increasing over time, but did not always correspond to actual sharing of data. The effectiveness of mandatory data sharing policies varied substantially by journal and type of data, a finding that might be informative for policy makers when designing policies and allocating resources to audit compliance. SYSTEMATIC REVIEW REGISTRATION Open Science Framework doi:10.17605/OSF.IO/7SX8U.
Collapse
Affiliation(s)
- Daniel G Hamilton
- MetaMelb Research Group, School of BioSciences, University of Melbourne, Melbourne, VIC, Australia
- Melbourne Medical School, Faculty of Medicine, Dentistry, and Health Sciences, University of Melbourne, Melbourne, VIC, Australia
| | - Kyungwan Hong
- Department of Practice, Sciences, and Health Outcomes Research, University of Maryland School of Pharmacy, Baltimore, MD, USA
| | - Hannah Fraser
- MetaMelb Research Group, School of BioSciences, University of Melbourne, Melbourne, VIC, Australia
| | - Anisa Rowhani-Farid
- Department of Practice, Sciences, and Health Outcomes Research, University of Maryland School of Pharmacy, Baltimore, MD, USA
| | - Fiona Fidler
- MetaMelb Research Group, School of BioSciences, University of Melbourne, Melbourne, VIC, Australia
- School of Historical and Philosophical Studies, University of Melbourne, Melbourne, VIC, Australia
| | - Matthew J Page
- Methods in Evidence Synthesis Unit, School of Public Health and Preventive Medicine, Monash University, Melbourne, VIC, Australia
| |
Collapse
|
14
|
Nolan CM, Brighton LJ, Mo Y, Bayly J, Higginson IJ, Man WDC, Maddocks M. Meditative movement for breathlessness in advanced COPD or cancer: a systematic review and meta-analysis. Eur Respir Rev 2023; 32:220243. [PMID: 37343961 PMCID: PMC10282812 DOI: 10.1183/16000617.0243-2022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2022] [Accepted: 03/23/2023] [Indexed: 06/23/2023] Open
Abstract
The effect of meditative movement, which includes yoga, tai chi and qi gong, on breathlessness in advanced disease is unknown. This systematic review aims to comprehensively assess the evidence on the effect of meditative movement on breathlessness (primary outcome), health-related quality of life, exercise capacity, functional performance and psychological symptoms (secondary outcomes) in advanced disease. 11 English and Chinese language databases were searched for relevant trials. Risk of bias was assessed using the Cochrane tool. Standardised mean differences (SMDs) with 95% confidence intervals were computed. 17 trials with 1125 participants (n=815 COPD, n=310 cancer), all with unclear or high risk of bias, were included. Pooled estimates (14 studies, n=671) showed no statistically significant difference in breathlessness between meditative movement and control interventions (SMD (95% CI) 0.10 (-0.15-0.34); Chi2=30.11; I2=57%; p=0.45), irrespective of comparator, intervention or disease category. Similar results were observed for health-related quality of life and exercise capacity. It was not possible to perform a meta-analysis for functional performance and psychological symptoms. In conclusion, in people with advanced COPD or cancer, meditative movement does not improve breathlessness, health-related quality of life or exercise capacity. Methodological limitations lead to low levels of certainty in the results.
Collapse
Affiliation(s)
- Claire M Nolan
- Brunel University London, College of Medicine, Health and Life Sciences, Department of Health Sciences, London, UK
- Harefield Respiratory Research Group, Royal Brompton and Harefield Hospitals, Guy's and St. Thomas' NHS Foundation Trust, London, UK
| | - Lisa Jane Brighton
- Kings College London, Cicely Saunders Institute of Palliative Care, Policy and Rehabilitation, London, UK
- King's College London, Department of Psychology, Institute of Psychiatry, Psychology and Neuroscience, London, UK
| | - Yihan Mo
- Kings College London, Cicely Saunders Institute of Palliative Care, Policy and Rehabilitation, London, UK
| | - Joanne Bayly
- Kings College London, Cicely Saunders Institute of Palliative Care, Policy and Rehabilitation, London, UK
- St. Barnabas Hospices, Worthing, UK
| | - Irene J Higginson
- Kings College London, Cicely Saunders Institute of Palliative Care, Policy and Rehabilitation, London, UK
| | - William D-C Man
- Harefield Respiratory Research Group, Royal Brompton and Harefield Hospitals, Guy's and St. Thomas' NHS Foundation Trust, London, UK
- King's College London, Faculty of Life Sciences and Medicine, London, UK
- National Heart and Lung Institute, Imperial College London, London, UK
| | - Matthew Maddocks
- Kings College London, Cicely Saunders Institute of Palliative Care, Policy and Rehabilitation, London, UK
| |
Collapse
|
15
|
Zhong J, Lu J, Zhang G, Mao S, Chen H, Yin Q, Hu Y, Xing Y, Ding D, Ge X, Zhang H, Yao W. An overview of meta-analyses on radiomics: more evidence is needed to support clinical translation. Insights Imaging 2023; 14:111. [PMID: 37336830 DOI: 10.1186/s13244-023-01437-2] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2023] [Accepted: 04/14/2023] [Indexed: 06/21/2023] Open
Abstract
OBJECTIVE To conduct an overview of meta-analyses of radiomics studies assessing their study quality and evidence level. METHODS A systematical search was updated via peer-reviewed electronic databases, preprint servers, and systematic review protocol registers until 15 November 2022. Systematic reviews with meta-analysis of primary radiomics studies were included. Their reporting transparency, methodological quality, and risk of bias were assessed by PRISMA (Preferred Reporting Items for Systematic reviews and Meta-Analyses) 2020 checklist, AMSTAR-2 (A MeaSurement Tool to Assess systematic Reviews, version 2) tool, and ROBIS (Risk Of Bias In Systematic reviews) tool, respectively. The evidence level supporting the radiomics for clinical use was rated. RESULTS We identified 44 systematic reviews with meta-analyses on radiomics research. The mean ± standard deviation of PRISMA adherence rate was 65 ± 9%. The AMSTAR-2 tool rated 5 and 39 systematic reviews as low and critically low confidence, respectively. The ROBIS assessment resulted low, unclear and high risk in 5, 11, and 28 systematic reviews, respectively. We reperformed 53 meta-analyses in 38 included systematic reviews. There were 3, 7, and 43 meta-analyses rated as convincing, highly suggestive, and weak levels of evidence, respectively. The convincing level of evidence was rated in (1) T2-FLAIR radiomics for IDH-mutant vs IDH-wide type differentiation in low-grade glioma, (2) CT radiomics for COVID-19 vs other viral pneumonia differentiation, and (3) MRI radiomics for high-grade glioma vs brain metastasis differentiation. CONCLUSIONS The systematic reviews on radiomics were with suboptimal quality. A limited number of radiomics approaches were supported by convincing level of evidence. CLINICAL RELEVANCE STATEMENT The evidence supporting the clinical application of radiomics are insufficient, calling for researches translating radiomics from an academic tool to a practicable adjunct towards clinical deployment.
Collapse
Affiliation(s)
- Jingyu Zhong
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200336, China
| | - Junjie Lu
- Department of Social and Behavioral Sciences, Harvard T.H. Chan School of Public Health, Boston, MA, 02115, USA
| | - Guangcheng Zhang
- Department of Orthopedics, Shanghai Sixth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200233, China
| | - Shiqi Mao
- Department of Medical Oncology, Shanghai Pulmonary Hospital, Tongji University School of Medicine, Shanghai, 200433, China
| | - Haoda Chen
- Department of General Surgery, Pancreatic Disease Center, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200025, China
| | - Qian Yin
- Department of Pathology, Shanghai Sixth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200233, China
| | - Yangfan Hu
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200336, China
| | - Yue Xing
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200336, China
| | - Defang Ding
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200336, China
| | - Xiang Ge
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200336, China
| | - Huan Zhang
- Department of Radiology, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200025, China.
| | - Weiwu Yao
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200336, China.
| |
Collapse
|
16
|
Alves F, Kalinowski P, Ayton S. Accelerated Brain Volume Loss Caused by Anti-β-Amyloid Drugs: A Systematic Review and Meta-analysis. Neurology 2023; 100:e2114-e2124. [PMID: 36973044 PMCID: PMC10186239 DOI: 10.1212/wnl.0000000000207156] [Citation(s) in RCA: 114] [Impact Index Per Article: 57.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2022] [Accepted: 01/20/2023] [Indexed: 03/29/2023] Open
Abstract
BACKGROUND AND OBJECTIVES To evaluate brain volume changes caused by different subclasses of anti-β-amyloid (Aβ) drugs trailed in patients with Alzheimer disease. METHODS PubMed, Embase, and ClinicalTrials.gov databases were searched for clinical trials of anti-Aβ drugs. This systematic review and meta-analysis included adults enrolled in randomized controlled trials of anti-Aβ drugs (n = 8,062-10,279). The inclusion criteria were as follows: (1) randomized controlled trials of patients treated with anti-Aβ drugs that have demonstrated to favorably change at least one biomarker of pathologic Aβ and (2) detailed MRI data sufficient to assess the volumetric changes in at least one brain region. MRI brain volumes were used as the primary outcome measure; brain regions commonly reported include hippocampus, lateral ventricle, and whole brain. Amyloid-related imaging abnormalities (ARIAs) were investigated when reported in clinical trials. Of the 145 trials reviewed, 31 were included in the final analyses. RESULTS A meta-analysis on the highest dose of each trial on hippocampus, ventricle, and whole brain revealed drug-induced acceleration of volume changes that varied by anti-Aβ drug class. Secretase inhibitors accelerated atrophy to the hippocampus (Δ placebo - Δ drug: -37.1 µL [19.6% more than placebo]; 95% CI -47.0 to -27.1) and whole brain (Δ placebo - Δ drug: -3.3 mL [21.8% more than placebo]; 95% CI -4.1 to 2.5). Conversely, ARIA-inducing monoclonal antibodies accelerated ventricular enlargement (Δ placebo - Δ drug: +2.1 mL [38.7% more than placebo]; 95% CI 1.5-2.8) where a striking correlation between ventricular volume and ARIA frequency was observed (r = 0.86, p = 6.22 × 10-7). Mild cognitively impaired participants treated with anti-Aβ drugs were projected to have a material regression toward brain volumes typical of Alzheimer dementia ∼8 months earlier than if they were untreated. DISCUSSION These findings reveal the potential for anti-Aβ therapies to compromise long-term brain health by accelerating brain atrophy and provide new insight into the adverse impact of ARIA. Six recommendations emerge from these findings.
Collapse
Affiliation(s)
- Francesca Alves
- From the The Florey Institute of Neuroscience and Mental Health, The University of Melbourne, Australia
| | - Pawel Kalinowski
- From the The Florey Institute of Neuroscience and Mental Health, The University of Melbourne, Australia
| | - Scott Ayton
- From the The Florey Institute of Neuroscience and Mental Health, The University of Melbourne, Australia.
| |
Collapse
|
17
|
Jang EB, Suh CH, Kim PH, Kim AY, Do KH, Lee JH, Gwon DI, Jung AY, Lee CW. Incidence and severity of nonionic low-osmolar iodinated contrast medium-related adverse drug reactions in the Republic of Korea: Comparison by generic. Medicine (Baltimore) 2023; 102:e33717. [PMID: 37171360 PMCID: PMC10174392 DOI: 10.1097/md.0000000000033717] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/07/2023] [Revised: 04/13/2023] [Accepted: 04/18/2023] [Indexed: 05/13/2023] Open
Abstract
We aimed to report the incidence and severity of nonionic low-osmolar iodine contrast medium (ICM)-related adverse drug reactions (ADRs) in the Republic of Korea, by analyzing data from our single tertiary institution and published Korean reports, and to determine whether there is a difference in the incidence of ICM-related ADR by ICM generics. A total of 1,161,419 consecutive contrast-enhanced computed tomography (CT) examinations between January 2016 and December 2021 at Asan Medical Center were included. A systematic search of the literature investigating the incidence of ICM-related ADR in the Republic of Korea published up to December 31, 2021 was performed. We pooled these outcomes with those of our study using a binomial-normal model, and the pooled incidences of ADRs were compared among ICM generics using chi-square tests. Seven studies with a total of 2,570,986 contrast-enhanced CT examinations from 12 institutions were included. The pooled incidences of overall, mild, moderate, and severe ICM-related ADRs in the Republic of Korea were 0.82% (95% CI: 0.61%-1.10%), 0.72% (95% CI: 0.50%-1.04%), 0.11% (95% CI: 0.08%-0.15%), and 0.013% (95% CI: 0.010%-0.018%), respectively. In multiple pairwise comparisons, there were no significant differences in the overall incidence of ADRs between ICM generics, except iomeprol versus iobitridol and iomeprol versus iohexol. For moderate and severe ADRs, there were no significant differences in ADR incidence between ICM generics. The incidence of moderate and severe ICM-related ADRs did not differ among ICM generics. Our results suggest that no restriction is required for selection among nonionic low-osmolar ICMs.
Collapse
Affiliation(s)
- Eun Bee Jang
- Department of Radiology and Research Institute of Radiology, University of Ulsan College of Medicine, Asan Medical Center, Seoul, Republic of Korea
| | - Chong Hyun Suh
- Department of Radiology and Research Institute of Radiology, University of Ulsan College of Medicine, Asan Medical Center, Seoul, Republic of Korea
| | - Pyeong Hwa Kim
- Department of Radiology and Research Institute of Radiology, University of Ulsan College of Medicine, Asan Medical Center, Seoul, Republic of Korea
| | - Ah Young Kim
- Department of Radiology and Research Institute of Radiology, University of Ulsan College of Medicine, Asan Medical Center, Seoul, Republic of Korea
| | - Kyung-Hyun Do
- Department of Radiology and Research Institute of Radiology, University of Ulsan College of Medicine, Asan Medical Center, Seoul, Republic of Korea
| | - Jeong Hyun Lee
- Department of Radiology and Research Institute of Radiology, University of Ulsan College of Medicine, Asan Medical Center, Seoul, Republic of Korea
| | - Dong-Il Gwon
- Department of Radiology and Research Institute of Radiology, University of Ulsan College of Medicine, Asan Medical Center, Seoul, Republic of Korea
| | - Ah Young Jung
- Department of Radiology and Research Institute of Radiology, University of Ulsan College of Medicine, Asan Medical Center, Seoul, Republic of Korea
| | - Choong Wook Lee
- Department of Radiology and Research Institute of Radiology, University of Ulsan College of Medicine, Asan Medical Center, Seoul, Republic of Korea
| |
Collapse
|
18
|
Diagnostic yield of MR myelography in patients with newly diagnosed spontaneous intracranial hypotension: a systematic review and meta-analysis. Eur Radiol 2022; 32:7843-7853. [PMID: 35538263 DOI: 10.1007/s00330-022-08845-w] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2021] [Revised: 04/18/2022] [Accepted: 04/22/2022] [Indexed: 01/03/2023]
Abstract
OBJECTIVES To investigate the pooled diagnostic yield of MR myelography in patients with newly diagnosed spontaneous intracranial hypotension (SIH). METHODS A literature search of the MEDLINE/PubMed and Embase databases was conducted until July 25, 2021, including studies with the following inclusion criteria: (a) population: patients with newly diagnosed SIH; (b) diagnostic modality: MR myelography or MR myelography with intrathecal gadolinium for evaluation of CSF leakage; (c) outcomes: diagnostic yield of MR myelography or MR myelography with intrathecal gadolinium. The risk of bias was evaluated using the Quality Assessment of Diagnostic Accuracy Studies-2 tool. DerSimonian-Laird random-effects modeling was used to calculate the pooled estimates. Subgroup analysis regarding epidural fluid collection and meta-regression were additionally performed. RESULTS Fifteen studies with 643 patients were included. Eight studies used MR myelography with intrathecal gadolinium, and 11 used MR myelography. The overall quality of the included studies was moderate. The pooled diagnostic yield of MR myelography was 86% (95% CI, 80-91%) and that of MR myelography with intrathecal gadolinium was 83% (95% CI, 51-96%). There was no significant difference in pooled diagnostic yield between MR myelography and MR myelography with intrathecal gadolinium (p = 0.512). In subgroup analysis, the pooled diagnostic yield of the epidural fluid collection was 91% (95% CI, 84-94%). In meta-regression, the diagnostic yield was unaffected regardless of consecutive enrollment, magnet strength, or 2D/3D. CONCLUSIONS MR myelography had a high diagnostic yield in patients with SIH. MR myelography is non-invasive and not inferior to MR myelography with intrathecal gadolinium. KEY POINTS • The pooled diagnostic yield of MR myelography was 86% (95% CI, 80-91%) in patients with spontaneous intracranial hypotension. • There was no significant difference in pooled diagnostic yield between MR myelography and MR myelography with intrathecal gadolinium. • MR myelography is non-invasive and not inferior to MR myelography with intrathecal gadolinium.
Collapse
|
19
|
Park HY, Suh CH, Heo H, Shim WH, Kim SJ. Diagnostic performance of hippocampal volumetry in Alzheimer's disease or mild cognitive impairment: a meta-analysis. Eur Radiol 2022; 32:6979-6991. [PMID: 35507052 DOI: 10.1007/s00330-022-08838-9] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2022] [Revised: 04/18/2022] [Accepted: 04/22/2022] [Indexed: 11/25/2022]
Abstract
OBJECTIVE To evaluate the diagnostic performance of hippocampal volumetry for Alzheimer's disease (AD) or mild cognitive impairment (MCI). METHODS The MEDLINE and Embase databases were searched for articles that evaluated the diagnostic performance of hippocampal volumetry in differentiating AD or MCI from normal controls, published up to March 6, 2022. The quality of the articles was evaluated by the QUADAS-2 tool. A bivariate random-effects model was used to pool sensitivity, specificity, and area under the curve. Sensitivity analysis and meta-regression were conducted to explain study heterogeneity. The diagnostic performance of entorhinal cortex volumetry was also pooled. RESULTS Thirty-three articles (5157 patients) were included. The pooled sensitivity and specificity for AD were 82% (95% confidence interval [CI], 77-86%) and 87% (95% CI, 82-91%), whereas those for MCI were 60% (95% CI, 51-69%) and 75% (95% CI, 67-81%), respectively. No difference in the diagnostic performance was observed between automatic and manual segmentation (p = 0.11). MMSE scores, study design, and the reference standard being used were associated with study heterogeneity (p < 0.01). Subgroup analysis demonstrated a higher diagnostic performance of entorhinal cortex volumetry for both AD (pooled sensitivity: 88% vs. 79%, specificity: 92% vs. 89%, p = 0.07) and MCI (pooled sensitivity: 71% vs. 55%, specificity: 83% vs. 68%, p = 0.06). CONCLUSIONS Our meta-analysis demonstrated good diagnostic performance of hippocampal volumetry for AD or MCI. Entorhinal cortex volumetry might have superior diagnostic performance to hippocampal volumetry. However, due to a small number of studies, the diagnostic performance of entorhinal cortex volumetry is yet to be determined. KEY POINTS • The pooled sensitivity and specificity of hippocampal volumetry for Alzheimer's disease were 82% and 87%, whereas those for mild cognitive impairment were 60% and 75%, respectively. • No significant difference in the diagnostic performance was observed between automatic and manual segmentation. • Subgroup analysis demonstrated superior diagnostic performance of entorhinal cortex volumetry for AD (pooled sensitivity: 88%, specificity: 92%) and MCI (pooled sensitivity: 71%, specificity: 83%).
Collapse
Affiliation(s)
- Ho Young Park
- Department of Radiology and Research Institute of Radiology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, 05505, Republic of Korea
| | - Chong Hyun Suh
- Department of Radiology and Research Institute of Radiology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, 05505, Republic of Korea.
| | - Hwon Heo
- Department of Convergence Medicine, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea
| | - Woo Hyun Shim
- Department of Radiology and Research Institute of Radiology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, 05505, Republic of Korea
| | - Sang Joon Kim
- Department of Radiology and Research Institute of Radiology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, 05505, Republic of Korea
| |
Collapse
|