1
|
Talukdar JR, Chu A, Garg A, Chowdhury F, E. Harnack H, Huang L, Sikorski C, Mbuagbaw L, de Souza RJ. Assessment of reporting quality of randomized controlled trials investigating the effects of inulin-type fructans supplementation on cardiovascular disease risk factors: A systematic survey. PLoS One 2024; 19:e0292184. [PMID: 38166017 PMCID: PMC10760872 DOI: 10.1371/journal.pone.0292184] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/18/2023] [Accepted: 09/11/2023] [Indexed: 01/04/2024] Open
Abstract
BACKGROUND Transparent and detailed reporting of randomized controlled trials (RCTs) is essential to judge its validity and generalizability. We assessed the reporting quality of RCTs examining the effects of inulin-type fructans supplementation on cardiovascular risk factors, before and after the publication of the Consolidated Standards of Reporting Trials (CONSORT) in 2010. METHODS We searched MEDLINE, EMBASE, Emcare, AMED, the Cochrane Library, and CINAHL from inception to May 15, 2022, including the reference lists of selected RCTs. We screened titles and abstracts and extracted the data independently and in duplicate. We included RCTs that investigated the effects of inulin-type fructans on cardiovascular disease risk factors (e.g., low-density lipoprotein cholesterol, triglycerides, fasting blood glucose) in adults (18 years or older). The primary outcomes of this study were: the overall reporting quality of RCTs (defined as the total number of items [0 to 36] present from the CONSORT checklist) published before and after CONSORT; and the study characteristics (e.g., sample size, significance of primary outcome) predictive of the CONSORT score. The secondary outcome was the reporting of each specific item of the CONSORT checklist during pre- and post-CONSORT periods. The mean difference in the total number of reported items in studies published before and after CONSORT were compared using a t-test and Poisson regression to explore the factors associated with overall reporting quality of RCTs. We used Fisher's exact test to compare the adherence to each of the 36 items during pre- and post-CONSORT periods. RESULTS We identified 1,767 citations from our systematic search, of which 55 were eligible. There was a significant increase in the reporting of CONSORT items (mean difference 8.5, 95% confidence interval [CI] 5.24 to 11.71) between studies published before and after publication of CONSORT. The sole variable that was predictive of better reporting quality of RCTs was whether the study was published before or after CONSORT (incidence rate ratio 1.67, 95% CI 1.40 to 2.02). Completeness of reporting of RCTs only improved in 15 out of 36 items (41.6%) after the publication of CONSORT. CONCLUSION The completeness of reporting in RCTs investigating inulin-type fructans supplementation on cardiovascular disease risk factors remains inadequate after the publication of CONSORT. Greater adherence to CONSORT by authors and enforcement of CONSORT by journals may improve the quality of reporting among RCTs.
Collapse
Affiliation(s)
- Jhalok Ronjan Talukdar
- Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada
| | - Alexandro Chu
- Department of Medicine, McMaster University, Hamilton, Ontario, Canada
| | - Anika Garg
- Faculty of Health Sciences, McMaster University, Hamilton, Ontario, Canada
| | - Fariha Chowdhury
- School of Rehabilitation Sciences, McMaster University, Hamilton, Ontario, Canada
| | - Hope E. Harnack
- Department of Kinesiology, McMaster University, Hamilton, Ontario, Canada
| | - Louise Huang
- Faculty of Health Sciences, McMaster University, Hamilton, Ontario, Canada
| | - Claudia Sikorski
- Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada
- Population Health Research Institute, Hamilton Health Sciences Corporation, Hamilton, Ontario, Canada
| | - Lawrence Mbuagbaw
- Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada
- Department of Anesthesia, McMaster University, Hamilton, Ontario, Canada
- Department of Pediatrics, McMaster University, Hamilton, Ontario, Canada
- Biostatistics Unit, Father Sean O’Sullivan Research Centre, St Joseph’s Healthcare, Hamilton, Ontario, Canada
- Centre for Development of Best Practices in Health (CDBPH), Yaoundé Central Hospital, Yaoundé, Cameroon
- Department of Global Health, Stellenbosch University, Cape Town, South Africa
| | - Russell J. de Souza
- Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada
- Population Health Research Institute, Hamilton Health Sciences Corporation, Hamilton, Ontario, Canada
- Toronto 3D Knowledge Synthesis and Clinical Trials Unit, Clinical Nutrition, St Michael’s Hospital, Toronto, ON, Canada
- Clinical Nutrition & Risk Factor Modification Centre, St. Michael’s Hospital, Toronto, Ontario, Canada
- Li Ka Shing Knowledge Institute, St. Michael’s Hospital, Toronto, Ontario, Canada
- Global Health Graduate Program, McMaster University, Hamilton, Ontario, Canada
| |
Collapse
|
2
|
Villa M, Le Pera M, Cassina T, Bottega M. Reporting quality of abstracts from randomised controlled trials published in leading critical care nursing journals: a methodological quality review. BMJ Open 2023; 13:e070639. [PMID: 36921935 PMCID: PMC10030738 DOI: 10.1136/bmjopen-2022-070639] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 03/17/2023] Open
Abstract
OBJECTIVES To evaluate the methodological quality of randomised controlled trial (RCT) abstracts in leading critical care nursing journals against the Consolidated Standards of Reporting Trials-Abstracts (CONSORT-A) checklist and to identify variables related with abstract reporting quality. DESIGN Descriptive methodological quality review. DATA SOURCE We searched the PubMed database and the websites of each included journal. ELIGIBILITY CRITERIA We included RCT abstracts published between 2011 and 2021 in the first 11 Scopus-ranking (2021) critical care nursing journals that reported the results of RCTs in English that referred to the care of adult patients with acute/critical illness or their relatives and/or caregivers and conducted in ICUs. DATA EXTRACTION AND SYNTHESIS Two independent investigators extracted the data using a prespecified 17-item checklist directly derived from CONSORT-A. For the primary outcome, each item was evaluated whether it was adequately reported or not and descriptive statistics were reported. An overall score was calculated by summing the results of all items and multivariate linear regression was conducted to detect potential predictors. RESULTS Seventy-eight RCT abstracts were included in this review. The items with the highest CONSORT-A adherence were authors, objective, conclusion, participants, interventions and outcome. The randomisation item had the lowest CONSORT-A adherence, followed by trial registration, funding source, harms or side effects, recruitment, blinding and outcome results. The average CONSORT-A score was 8.5±1.5 points (of the maximum 17.5 points). Multivariate analysis indicated that the categorised word score and publication date were positively associated with the overall CONSORT-A score, while the first author's country being in Asia was negatively associated with the overall CONSORT-A score. CONCLUSIONS The 78 RCT abstracts showed poor overall adherence to CONSORT-A. The results indicate that the methodological reporting quality of RCT abstracts in critical care nursing journals requires improvement to facilitate assessment of the applicability and relevance of the results reported.
Collapse
Affiliation(s)
- Michele Villa
- Cardiocentro Ticino Institute, Ente Ospedaliero Cantonale, Lugano, Ticino, Switzerland
| | - Massimo Le Pera
- Cardiocentro Ticino Institute, Ente Ospedaliero Cantonale, Lugano, Ticino, Switzerland
| | - Tiziano Cassina
- Cardiocentro Ticino Institute, Ente Ospedaliero Cantonale, Lugano, Ticino, Switzerland
| | - Michela Bottega
- Dipartimento funzionale delle risorse umane, Azienda ULSS n 2 Marca Trevigiana, Treviso, Veneto, Italy
| |
Collapse
|
3
|
Wright EC, Kapuria D, Ben-Yakov G, Sharma D, Basu D, Cho MH, Abijo T, Wilkins KJ. Time to Publication for Randomized Clinical Trials Presented as Abstracts at Three Gastroenterology and Hepatology Conferences in 2017. GASTRO HEP ADVANCES 2023; 2:370-379. [PMID: 36938381 PMCID: PMC10022591 DOI: 10.1016/j.gastha.2022.12.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/03/2022] [Accepted: 12/12/2022] [Indexed: 12/23/2022]
Abstract
Background & Aims Results of randomized clinical trials are often first presented as conference abstracts, but these abstracts may be difficult to find, and trial results included in the abstract may not be followed by subsequent journal publications. In a review of abstracts submitted to eight major medical and surgical conferences in 2017, we identified 237 abstracts reporting primary results of randomized clinical trials accepted for presentation at three major gastroenterology and hepatology conferences. The aims of this new analysis were to determine the publication rate for these abstracts and the proportion of publications that included trial registration numbers in the publication abstract. Methods Clinical trial registries, PubMed, Europe PMC, and Google Scholar were searched through November 1, 2021, for publications reporting trial results for the selected abstracts. Publications were reviewed to determine if they included a trial registration number and if the registration number was in the abstract. Results Publications were found for 157 abstracts (66%) within four years of the conference. Publications were found more frequently for the 194 abstracts reporting results of registered trials (144, 74%) than for the 43 abstracts reporting unregistered trials (13, 30%), but only 67% of these 144 publications included the registration number in the publication abstract. Ten unpublished trials had summary results posted on ClinicalTrials.gov. Conclusions Clinical trial results could be more accessible if all trials were registered, authors included registration numbers in both conference and journal abstracts, and journal editors required the inclusion of registration numbers in publication abstracts for registered clinical trials.
Collapse
Affiliation(s)
- Elizabeth C. Wright
- Office of the Director, National Institute of Diabetes and Digestive and Kidney Diseases, National Institutes of Health, Bethesda, Maryland
| | - Devika Kapuria
- Department of Gastroenterology, Washington University in St. Louis, St. Louis, Missouri
| | - Gil Ben-Yakov
- The Center for liver diseases Sheba, Tel-Hashomer medical center, Ramat Gan, Israel
| | - Disha Sharma
- Liver Diseases Branch, National Institute of Diabetes and Digestive and Kidney Diseases, National Institutes of Health, Bethesda, Maryland
| | - Dev Basu
- Medstar Good Samaritan Hospital, Baltimore, Maryland
| | - Min Ho Cho
- Department of Medicine, Baystate Medical Center, Springfield, Massachusetts
| | - Tomilowo Abijo
- Office of the Director, National Institute of Diabetes and Digestive and Kidney Diseases, National Institutes of Health, Bethesda, Maryland
| | - Kenneth J. Wilkins
- Office of the Director, National Institute of Diabetes and Digestive and Kidney Diseases, National Institutes of Health, Bethesda, Maryland
| |
Collapse
|
4
|
Wiehn J, Nonte J, Prugger C. Reporting quality for abstracts of randomised trials on child and adolescent depression prevention: a meta-epidemiological study on adherence to CONSORT for abstracts. BMJ Open 2022; 12:e061873. [PMID: 35922097 PMCID: PMC9352996 DOI: 10.1136/bmjopen-2022-061873] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
OBJECTIVES This study aimed to investigate adherence to Consolidated Standards of Reporting Trials (CONSORT) for abstracts in reports of randomised trials on child and adolescent depression prevention. Secondary objective was to examine factors associated with overall reporting quality. DESIGN Meta-epidemiological study. DATA SOURCES We searched MEDLINE, EMBASE, PsycINFO, PsycArticles and CENTRAL. ELIGIBILITY CRITERIA Trials were eligible if the sample consisted of children and adolescents under 18 years with or without an increased risk for depression or subthreshold depression. We included reports published from 1 January 2003 to 8 August 2020 on randomised controlled trials (RCTs) and cluster randomised trials (CRTs) assessing universal, selective and indicated interventions aiming to prevent the onset of depression or reducing depressive symptoms. DATA EXTRACTION AND SYNTHESIS As the primary outcome measure, we assessed for each trial abstract whether information recommended by CONSORT was adequately reported, inadequately reported or not reported. Moreover, we calculated a summative score of overall reporting quality and analysed associations with trial and journal characteristics. RESULTS We identified 169 eligible studies, 103 (61%) RCTs and 66 (39%) CRTs. Adequate reporting varied considerably across CONSORT items: while 9 out of 10 abstracts adequately reported the study objective, no abstract adequately provided information on blinding. Important adverse events or side effects were only adequately reported in one out of 169 abstracts. Summative scores for the abstracts' overall reporting quality ranged from 17% to 83%, with a median of 40%. Scores were associated with the number of authors, abstract word count, journal impact factor, year of publication and abstract structure. CONCLUSIONS Reporting quality for abstracts of trials on child and adolescent depression prevention is suboptimal. To help health professionals make informed judgements, efforts for improving adherence to reporting guidelines for abstracts are needed.
Collapse
Affiliation(s)
- Jascha Wiehn
- Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Institute of Public Health, Berlin, Germany
| | - Johanna Nonte
- Department of Population Medicine and Health Services Research, Bielefeld School of Public Health, Universität Bielefeld, Bielefeld, Germany
| | - Christof Prugger
- Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Institute of Public Health, Berlin, Germany
| |
Collapse
|
5
|
Talukdar JR, Cooper MA, Lyutvyn L, Zeraatkar D, Ali R, Bierbrier R, Janes S, Ha V, Darling PB, Sievenpiper JL, Jenkins DJA, Banfield L, Mbuagbaw L, de Souza RJ. Effects of inulin-type fructans supplementation on cardiovascular disease risk factors: a protocol for a systematic review and meta-analysis of randomised controlled trials. BMJ Open 2022; 12:e058875. [PMID: 35793918 PMCID: PMC9260802 DOI: 10.1136/bmjopen-2021-058875] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
INTRODUCTION This review aims to assess the effects of dietary supplementation with inulin-type fructans (ITF) compared with no supplementation on cardiovascular disease risk factors in adults and assess the quality of trial reporting using the Consolidated Standards of Reporting Trials (CONSORT) and CONSORT for abstract (CONSORT-A) checklists. METHODS AND ANALYSIS We will search randomised controlled trials (RCTs) in MEDLINE, EMBASE, CINAHL, Emcare, AMED and the Cochrane Database of Systematic Reviews from inception to 31 March 2022, without any language restrictions. The RCTs need to administer ITF in adults for at least 2 weeks and assess effects on at least one cardiovascular risk factor. We will exclude RCTs that (1) assessed the postprandial effects of ITF; (2) included pregnant or lactating participants; (3) enrolled participants undergoing treatment that might affect the response to ITF. We will assess the study risk of bias (RoB) using V.2 of the Cochrane RoB tool for RCTs (RoB 2) and the certainty of the evidence using the Grading of Recommendations, Assessment, Development and Evaluations (GRADE) approach. We will pool data using a random-effects model. We will use the χ2 test to compare compliance of CONSORT and CONSORT-A checklists and Poisson regression to identify factors associated with better reporting. ETHICS AND DISSEMINATION Ethics approval is not required for secondary analysis of already published data. We will publish the reviews in a peer-review journal. PROSPERO REGISTRATION NUMBER CRD42019136745.
Collapse
Affiliation(s)
- Jhalok Ronjan Talukdar
- Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada
| | | | - Lyuba Lyutvyn
- Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada
| | - Dena Zeraatkar
- Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, USA
| | - Rahim Ali
- Faculty of Law (Common Law Section), University of Ottawa, Ottawa, Ontario, Canada
| | - Rachel Bierbrier
- Department of Dermatology, McGill University Health Centre, Montreal, Québec, Canada
| | | | - Vanessa Ha
- School of Medicine, Faculty of Health Sciences, Queen's University, Kingston, Ontario, Canada
| | - Pauline B Darling
- School of Nutrition Sciences, University of Ottawa, Ottawa, Ontario, Canada
| | - John L Sievenpiper
- Department of Nutritional Sciences, Temerty Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada
- Toronto 3D Knowledge Synthesis and Clinical Trials Unit, Clinical Nutrition and Risk Factor Modification centre, Li Ka Shing Knowledge Institute, St. Michael's Hospital, Toronto, Ontario, Canada
| | - David J A Jenkins
- Department of Nutritional Sciences, Temerty Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada
- Toronto 3D Knowledge Synthesis and Clinical Trials Unit, Clinical Nutrition and Risk Factor Modification centre, Li Ka Shing Knowledge Institute, St. Michael's Hospital, Toronto, Ontario, Canada
- Department of Medicine, Temerty Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada
| | - Laura Banfield
- Health Sciences Library, McMaster University, Hamilton, Ontario, Canada
| | - Lawrence Mbuagbaw
- Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada
- Department of Anesthesia, McMaster University, Hamilton, Ontario, Canada
- Biostatistics Unit, Father Sean O'Sullivan Research Centre, St Joseph's Healthcare, Hamilton, Ontario, Canada
- Department of Pediatrics, McMaster University, Hamilton, Ontario, Canada
- Centre for Development of Best Practices in Health (CDBPH), Yaoundé Central Hospital, Yaoundé, Cameroon
- Department of Global Health, Stellenbosch University, Cape Town, South Africa
| | - Russell J de Souza
- Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada
- Global Health Graduate Program, McMaster University, Hamilton, Ontario, Canada
- Population Health Research Institute, Hamilton Health Sciences Corporation, Hamilton, Ontario, Canada
| |
Collapse
|
6
|
Yin Y, Gao J, Zhang Y, Zhang X, Ye J, Zhang J. Evaluation of reporting quality of abstracts of randomized controlled trials regarding patients with COVID-19 using the CONSORT statement for abstracts. Int J Infect Dis 2022; 116:122-129. [PMID: 34999245 PMCID: PMC8736283 DOI: 10.1016/j.ijid.2022.01.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/16/2021] [Revised: 12/13/2021] [Accepted: 01/03/2022] [Indexed: 10/28/2022] Open
Abstract
OBJECTIVE To evaluate the reporting quality of randomized controlled trial (RCT) abstracts regarding patients with coronavirus disease 2019 (COVID-19) and to analyze the factors influencing the quality. METHODS The PubMed, Embase, Web of Science, and Cochrane Library databases were searched to collect RCTs on patients with COVID-19. The retrieval time was from inception to December 1, 2020. The CONSORT statement for abstracts was used to evaluate the reporting quality of RCT abstracts. RESULTS A total of 53 RCT abstracts were included. The CONSORT statement for abstracts showed that the average reporting rate of all items was 50.2%. The items with a lower reporting quality were mainly the trial design and the details of randomization and blinding (<10%). The mean overall adherence score across all studies was 8.68 ± 2.69 (range 4-13.5). Multivariate linear regression analysis showed that the higher reporting scores were associated with higher journal impact factor (P < 0.01), international collaboration (P = 0.04), and structured abstract format (P < 0.01). CONCLUSIONS Although many RCTs on patients with COVID-19 have been published in different journals, the overall quality of reporting in the included RCT abstracts was suboptimal, thus diminishing their potential usefulness, and this may mislead clinical decision-making. In order to improve the reporting quality, it is necessary to promote and actively apply the CONSORT statement for abstracts.
Collapse
Affiliation(s)
- Yuhuan Yin
- Clinical Educational Department, Gansu Provincial Hospital, Lanzhou, Gansu, China, 730000; School of Nursing, Gansu University of Chinese Medicine, Lanzhou, Gansu, China, 730000
| | - Jiangxia Gao
- Department of Otolaryngology, Gansu Provincial Hospital, Lanzhou, Gansu, China, 730000
| | - Yiyin Zhang
- School of Nursing, Gansu University of Chinese Medicine, Lanzhou, Gansu, China, 730000
| | - Xiaoli Zhang
- School of Nursing, Gansu University of Chinese Medicine, Lanzhou, Gansu, China, 730000
| | - Jianying Ye
- School of Nursing, Gansu University of Chinese Medicine, Lanzhou, Gansu, China, 730000
| | - Juxia Zhang
- Clinical Educational Department, Gansu Provincial Hospital, Lanzhou, Gansu, China, 730000.
| |
Collapse
|
7
|
Bachelet VC, Navarrete MS, Barrera-Riquelme C, Carrasco VA, Dallaserra M, Díaz RA, Ibarra ÁA, Lizana FJ, Meza-Ducaud N, Saavedra MG, Tapia-Davegno C, Vergara AF, Villanueva J. A multiyear systematic survey of the quality of reporting for randomised trials in dentistry, neurology and geriatrics published in journals of Spain and Latin America. BMC Med Res Methodol 2021; 21:153. [PMID: 34311704 PMCID: PMC8314448 DOI: 10.1186/s12874-021-01337-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/04/2020] [Accepted: 06/22/2021] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND The Iberoamerican Cochrane Network is currently developing an extensive project to identify Spanish-language journals that publish original clinical research in Spain and Latin America. The project is called BADERI (Database of Iberoamerican Essays and Journal) and feeds the research articles, mainly randomised clinical trials (RCTs), into CENTRAL (Cochrane Collaboration Central Register of Controlled Trials). This study aims to assess the quality of reporting of RCTs published in Spanish and Latin American journals for three clinical fields and assess changes over time. METHODS We did a systematic survey with time trend analysis of RCTs for dentistry, geriatrics, and neurology. These fields were chosen for pragmatic reasons as they had not yet been completed in BADERI. After screening RCTs from 1990 to 2018 for randomised or quasi-randomised clinical trials, we extracted data for 23 CONSORT items. The primary outcome was the total score of the 23 predefined CONSORT 2010 items for each RCT (score range from 0 to 34). The secondary outcome measure was the score for each one of these 23 items. RESULTS A total of 392 articles from 1990 to 2018 were included as follows: dentistry (282), neurology (80), and geriatrics (30). We found that the overall compliance score for the CONSORT items included in this study for all 392 RCTs analysed was 12.6 on a scale with a maximum score of 34. With time, the quality of reporting improved slightly for all RCTs. None of the articles achieved the complete individual CONSORT item compliance score. The lowest overall compliance percentage was for item 10 (Randomisation implementation) and item 24 (Protocol registration), with a dismal 1% compliance across all included RCTs, regardless of country. CONCLUSIONS CONSORT compliance is very poor in the 392 analysed RCTs. The impact of the CONSORT statement on improving the completeness of RCT reporting in Latin America and Spain is not clear. Iberoamerican journals should become more involved in endorsing and enforcing adherence to the CONSORT guidelines.
Collapse
Affiliation(s)
- Vivienne C Bachelet
- Escuela de Medicina, Facultad de Ciencias Médicas, Universidad de Santiago de Chile (USACH), Avenida Libertador Bernardo OHiggins 3363, Santiago, Estación Central, Chile.
| | - María S Navarrete
- Escuela de Medicina, Facultad de Ciencias Médicas, Universidad de Santiago de Chile (USACH), Avenida Libertador Bernardo OHiggins 3363, Santiago, Estación Central, Chile
| | - Constanza Barrera-Riquelme
- Escuela de Medicina, Facultad de Ciencias Médicas, Universidad de Santiago de Chile (USACH), Avenida Libertador Bernardo OHiggins 3363, Santiago, Estación Central, Chile
| | - Víctor A Carrasco
- Escuela de Medicina, Facultad de Ciencias Médicas, Universidad de Santiago de Chile (USACH), Avenida Libertador Bernardo OHiggins 3363, Santiago, Estación Central, Chile
| | - Matías Dallaserra
- Departamento de Cirugía Maxilofacial, Facultad de Odontología, Universidad de Chile, Santiago, Chile
| | - Rubén A Díaz
- Escuela de Medicina, Facultad de Ciencias Médicas, Universidad de Santiago de Chile (USACH), Avenida Libertador Bernardo OHiggins 3363, Santiago, Estación Central, Chile
| | - Álvaro A Ibarra
- Escuela de Medicina, Facultad de Ciencias Médicas, Universidad de Santiago de Chile (USACH), Avenida Libertador Bernardo OHiggins 3363, Santiago, Estación Central, Chile
| | - Francisca J Lizana
- Escuela de Medicina, Facultad de Ciencias Médicas, Universidad de Santiago de Chile (USACH), Avenida Libertador Bernardo OHiggins 3363, Santiago, Estación Central, Chile
| | - Nicolás Meza-Ducaud
- Escuela de Medicina, Facultad de Ciencias Médicas, Universidad de Santiago de Chile (USACH), Avenida Libertador Bernardo OHiggins 3363, Santiago, Estación Central, Chile
| | - Macarena G Saavedra
- Escuela de Medicina, Facultad de Ciencias Médicas, Universidad de Santiago de Chile (USACH), Avenida Libertador Bernardo OHiggins 3363, Santiago, Estación Central, Chile
| | - Camila Tapia-Davegno
- Escuela de Medicina, Facultad de Ciencias Médicas, Universidad de Santiago de Chile (USACH), Avenida Libertador Bernardo OHiggins 3363, Santiago, Estación Central, Chile
| | - Alonso F Vergara
- Escuela de Medicina, Facultad de Ciencias Médicas, Universidad de Santiago de Chile (USACH), Avenida Libertador Bernardo OHiggins 3363, Santiago, Estación Central, Chile
| | - Julio Villanueva
- Departamento de Cirugía Maxilofacial, Facultad de Odontología, Universidad de Chile, Santiago, Chile
- Hospital Clínico San Borja-Arriarán, Santiago, Chile
| |
Collapse
|
8
|
Nascimento DP, Ostelo RWJG, van Tulder MW, Gonzalez GZ, Araujo AC, Vanin AA, Costa LOP. Do not make clinical decisions based on abstracts of healthcare research: A systematic review. J Clin Epidemiol 2021; 135:136-157. [PMID: 33839242 DOI: 10.1016/j.jclinepi.2021.03.030] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2020] [Revised: 02/10/2021] [Accepted: 03/03/2021] [Indexed: 12/11/2022]
Abstract
OBJECTIVE To summarize the reporting quality of healthcare abstracts and inconsistencies between abstracts and full texts. STUDY DESIGN AND SETTING This systematic review included overviews of randomized controlled trials (RCTs) and systematic reviews (SRs) that summarized data of healthcare abstracts on reporting of abstracts and consistency of abstracts with the full text. Searches were performed in PubMed, CENTRAL, Cochrane Library and EMBASE databases from 1900 to February 2019. Two authors screened the overviews and extracted the data. All analyses were descriptive and divided into two main groups: abstracts' reporting quality and abstracts' consistency with the full text. Abstracts were considered poorly reported and inconsistent with the full text if more than 5% of abstracts' information was not fully reported or not consistent with the full text. RESULTS 27 overviews analyzing 5,194 RCTs and 866 SRs were retrieved for reporting quality of abstracts. A total of 22 overviews analyzing 2,025 RCTs and 551 SRs were included for consistency of abstracts with the full text. Abstracts across all healthcare areas presented poor reporting quality and were inconsistent with the full texts, with results and conclusions as the most inconsistent sections. CONCLUSION Abstracts of healthcare RCTs and SRs have shown a large room for improvement in reporting quality and consistency with the full text. Authors, journal editors and reviewers need to give the highest priority to this matter.
Collapse
Affiliation(s)
- Dafne P Nascimento
- Masters and Doctoral Programs in Physical Therapy, Universidade Cidade de São Paulo, São Paulo, SP, Brazil; Department of Health Sciences, Faculty of Science, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands.
| | - Raymond W J G Ostelo
- Department of Health Sciences, Faculty of Science, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands; Department of Epidemiology and Biostatistics, Amsterdam UMC, location VUmc and the Amsterdam Movement Sciences Research Institute, Amsterdam, The Netherlands
| | - Maurits W van Tulder
- Department of Health Sciences, Faculty of Science, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands; Department of Physiotherapy & Occupational Therapy, Aarhus University Hospital, Aarhus, Denmark.
| | - Gabrielle Z Gonzalez
- Masters and Doctoral Programs in Physical Therapy, Universidade Cidade de São Paulo, São Paulo, SP, Brazil
| | - Amanda C Araujo
- Masters and Doctoral Programs in Physical Therapy, Universidade Cidade de São Paulo, São Paulo, SP, Brazil
| | - Adriane A Vanin
- Masters and Doctoral Programs in Physical Therapy, Universidade Cidade de São Paulo, São Paulo, SP, Brazil
| | - Leonardo O P Costa
- Masters and Doctoral Programs in Physical Therapy, Universidade Cidade de São Paulo, São Paulo, SP, Brazil
| |
Collapse
|
9
|
Saric L, Dosenovic S, Mihanovic J, Puljak L. Biomedical conferences’ author instructions rarely mention guidelines for reporting abstracts of trials and systematic reviews. J Comp Eff Res 2020; 9:83-91. [PMID: 31950848 DOI: 10.2217/cer-2019-0158] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/18/2022] Open
Abstract
Aim: To analyze whether instructions for authors of biomedical conference abstracts mention guidelines for writing randomized controlled trial and systematic review abstracts and to evaluate reasons for their absence from instructions. Materials & methods: We analyzed instructions for authors of biomedical conferences advertized in 2019 and assessed whether they mentioned Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Abstracts and Consolidated Standards of Reporting Trials for Abstracts guidelines. We surveyed contact persons from abstract/publication committees of selected conferences to analyze why relevant guidelines were missing. Results: Instructions for abstracts were available for 819 conferences. Only two (0.2%) had reporting instructions for randomized controlled trial/systematic review authors. Almost half of the contacted conference organizers whose response we received were not aware of Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Abstracts and Consolidated Standards of Reporting Trials for Abstracts guidelines. Conclusion: Conference organizers do not require and are not familiar enough with reporting guidelines.
Collapse
Affiliation(s)
- Lenko Saric
- Department of Anesthesiology & Intensive Care Medicine, University Hospital Split, 21000 Split, Croatia
| | - Svjetlana Dosenovic
- Department of Anesthesiology & Intensive Care Medicine, University Hospital Split, 21000 Split, Croatia
| | - Jakov Mihanovic
- Department of Surgery, General Hospital Zadar, 23000 Zadar, Croatia
- Department of Health Studies, University of Zadar, 23000 Zadar, Croatia
| | - Livia Puljak
- Center for Evidence-Based Medicine & Health Care, Catholic University of Croatia, 10000 Zagreb, Croatia
| |
Collapse
|
10
|
To MS, Jukes A. Reporting trends of p values in the neurosurgical literature. J Neurosurg 2020; 132:662-670. [PMID: 30738384 DOI: 10.3171/2018.8.jns172897] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2017] [Accepted: 08/28/2018] [Indexed: 11/06/2022]
Abstract
OBJECTIVE The objective of this study was to evaluate the trends in reporting of p values in the neurosurgical literature from 1990 through 2017. METHODS All abstracts from the Journal of Neurology, Neurosurgery, and Psychiatry (JNNP), Journal of Neurosurgery (JNS) collection (including Journal of Neurosurgery: Spine and Journal of Neurosurgery: Pediatrics), Neurosurgery (NS), and Journal of Neurotrauma (JNT) available on PubMed from 1990 through 2017 were retrieved. Automated text mining was performed to extract p values from relevant abstracts. Extracted p values were analyzed for temporal trends and characteristics. RESULTS The search yielded 47,889 relevant abstracts. A total of 34,324 p values were detected in 11,171 abstracts. Since 1990 there has been a steady, proportionate increase in the number of abstracts containing p values. There were average absolute year-on-year increases of 1.2% (95% CI 1.1%-1.3%; p < 0.001), 0.93% (95% CI 0.75%-1.1%; p < 0.001), 0.70% (95% CI 0.57%-0.83%; p < 0.001), and 0.35% (95% CI 0.095%-0.60%; p = 0.0091) of abstracts reporting p values in JNNP, JNS, NS, and JNT, respectively. There have also been average year-on-year increases of 0.045 (95% CI 0.031-0.059; p < 0.001), 0.052 (95% CI 0.037-0.066; p < 0.001), 0.042 (95% CI 0.030-0.054; p < 0.001), and 0.041 (95% CI 0.026-0.056; p < 0.001) p values reported per abstract for these respective journals. The distribution of p values showed a positive skew and strong clustering of values at rounded decimals (i.e., 0.01, 0.02, etc.). Between 83.2% and 89.8% of all reported p values were at or below the "significance" threshold of 0.05 (i.e., p ≤ 0.05). CONCLUSIONS Trends in reporting of p values and the distribution of p values suggest publication bias remains in the neurosurgical literature.
Collapse
Affiliation(s)
- Minh-Son To
- 1School of Medicine, Flinders University, Bedford Park
| | - Alistair Jukes
- 2Department of Neurosurgery, Royal Adelaide Hospital, Adelaide
- 3Department of Otolaryngology, Head and Neck Surgery, The Queen Elizabeth Hospital, Woodville; and
- 4School of Medicine, University of Adelaide, South Australia, Australia
| |
Collapse
|
11
|
Germini F, Marcucci M, Fedele M, Galli MG, Heath T, Mbuagbaw L, Salvatori V, Veronese G, Worster A, Thabane L. Quality of reporting in abstracts of RCTs published in emergency medicine journals: a systematic survey of the literature suggests we can do better. Emerg Med J 2019; 37:660-665. [PMID: 31694858 DOI: 10.1136/emermed-2019-208629] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2019] [Revised: 07/26/2019] [Accepted: 08/02/2019] [Indexed: 12/21/2022]
Abstract
OBJECTIVE We investigated the association between the publication of the Consolidated Standards of Reporting Trials extension for abstracts (CONSORT-EA) and other variables of interest on the quality of reporting of abstracts of randomised controlled trials (RCTs) published in emergency medicine (EM) journals. METHODS We performed a survey of the literature, comparing the quality of reporting before (2005-2007) with after (2014-2015) the publication of the dedicated CONSORT-EA in 2008. The quality of reporting was measured as the sum of items of the CONSORT-EA checklist reported in each abstract, ranging from 0 to 15. The main explanatory variable was the period of publication: pre-CONSORT-EA versus post-CONSORT-EA public. Other explanatory variables were journal's endorsement of the CONSORT statement, number of centres participating in the study, study's sample size, type of intervention, significance of results, source of funding and study setting. We analysed the data using generalised estimation equations, performing a univariate and a multivariable analysis. RESULTS We retrieved 844 articles, and randomly selected 60 per period for review, after stratifying for journal. The mean (SD) number of items reported was 6.4 (1.9) in the period before and 6.9 (1.8) in the period after the publication of the CONSORT-EA, with an adjusted mean difference (aMD) of 0.47 (95% CI -0.13 to 1.06). Abstracts of trials of pharmacological interventions had a significantly larger mean number of reported items than those of trials of non-pharmacological interventions (aMD 1.59; 95% CI 0.94 to 2.24). CONCLUSIONS The quality of reporting in abstracts of RCTs published in EM journals is low and was not significantly impacted by the publication of a dedicated CONSORT-EA.
Collapse
Affiliation(s)
- Federico Germini
- Department of Health Research Methods, Evidence and Impact (HEI), McMaster University, Hamilton, Ontario, Canada
- Division of Emergency Medicine, Department of Medicine, McMaster University, Hamilton, Ontario, Canada
- Department of Health Sciences, Università degli Studi di Milano, Milano, Italy
| | - Maura Marcucci
- Department of Health Research Methods, Evidence and Impact (HEI), McMaster University, Hamilton, Ontario, Canada
- Population Health Research Institute, Hamilton Health Sciences, Hamilton, Ontario, Canada
| | - Marta Fedele
- Unità Operativa Complessa di Medicina e Chirurgia d'Accettazione e d'Urgenza, Ospedale Renzetti, Asl Lanciano Vasto Chieti, Lanciano, Italy
| | - Maria Giulia Galli
- Department of Clinical and Experimental Medicine, University of Parma, Parma, Italy
| | - Tevin Heath
- Department of Health Research Methods, Evidence and Impact (HEI), McMaster University, Hamilton, Ontario, Canada
| | - Lawrence Mbuagbaw
- Department of Health Research Methods, Evidence and Impact (HEI), McMaster University, Hamilton, Ontario, Canada
- Biostatistics Unit, Father Sean O'Sullivan Research Centre, St Joseph's Healthcare, Hamilton, Ontario, Canada
| | - Valentina Salvatori
- General Practitioner Course, Regione Marche - Servizio Sanità, Ancona, Italy
| | - Giacomo Veronese
- School of Medicine and Surgery, University of Milano-Bicocca, Monza, Italy
| | - Andrew Worster
- Division of Emergency Medicine, Department of Medicine, McMaster University, Hamilton, Ontario, Canada
| | - Lehana Thabane
- Department of Health Research Methods, Evidence and Impact (HEI), McMaster University, Hamilton, Ontario, Canada
- Population Health Research Institute, Hamilton Health Sciences, Hamilton, Ontario, Canada
- Biostatistics Unit, Father Sean O'Sullivan Research Centre, St Joseph's Healthcare, Hamilton, Ontario, Canada
- Departments of Paediatrics and Anaesthesia, McMaster University, Hamilton, Ontario, Canada
- Centre for Evaluation of Medicine, St Joseph's Healthcare, Hamilton, Ontario, Canada
| |
Collapse
|
12
|
Mbuagbaw L, Kosa SD, Lawson DO, Stalteri R, Olaiya OR, Alotaibi A, Thabane L. The reporting of progression criteria in protocols of pilot trials designed to assess the feasibility of main trials is insufficient: a meta-epidemiological study. Pilot Feasibility Stud 2019; 5:120. [PMID: 31700654 PMCID: PMC6827233 DOI: 10.1186/s40814-019-0500-z] [Citation(s) in RCA: 26] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2018] [Accepted: 09/16/2019] [Indexed: 11/10/2022] Open
Abstract
Introduction Pilot and feasibility trials are conducted to determine feasibility or to collect information that would inform the design of a larger definitive trial. Clear progression criteria are required to determine if a definitive or main trial is feasible and how it should be designed. We sought to determine how often progression criteria are reported and the associated factors. Methods We conducted a methodological review of protocols for pilot randomised trials published in three journals that publish research protocols (BMJ Open, Trials, Pilot and Feasibility Studies), using a PubMed search (2013–2017). We extracted bibliometric information including the country in which the study was conducted, source of funding, type of intervention, use of a primary feasibility outcome, sample size reporting, and justification. We used generalised linear models to determine the factors associated with reporting progression criteria. Results Our search retrieved 276 articles, of which 49 were not eligible. We included 227 articles. Overall, 45/227 (19.8%; 95% confidence interval [CI] 14.8–25.6) reported progression criteria. Protocols published in more recent years were significantly associated with higher odds of reporting progression criteria (adjusted odds ratio [aOR] 1.40; 95% CI 1.03–1.92; p = 0.034). Pilot trials from Europe (aOR 0.19; 95% CI 0.08–0.48; p < 0.001) and the rest of the world (aOR 0.05; 95% CI 0.01–0.18; p < 0.003) compared to North America were significantly associated with lower odds of reporting progression criteria. Journal, source of funding, sample size, intervention type, and having a primary outcome related to feasibility were not significantly associated with reporting progression criteria. Conclusion Progression criteria are not often explicitly stated in protocols of pilot trials leaving room for varied interpretation of findings. The development of formal guidance for progression criteria in protocols of pilot trials is warranted.
Collapse
Affiliation(s)
- Lawrence Mbuagbaw
- 1Department of Health Research Methods, Evidence and Impact, McMaster University, Hamilton, ON Canada.,2Biostatistics Unit, Father Sean O'Sullivan Research Centre, St Joseph's Healthcare-Hamilton, 50 Charlton Avenue East, 3rd Floor Martha Wing, Room H321, Hamilton, ON L8N 4A6 Canada.,Centre for the Development of Best Practices in Health, Yaoundé, Cameroon
| | - Sarah Daisy Kosa
- 1Department of Health Research Methods, Evidence and Impact, McMaster University, Hamilton, ON Canada.,4Toronto General Hospital, University Health Network, Toronto, ON Canada
| | - Daeria O Lawson
- 1Department of Health Research Methods, Evidence and Impact, McMaster University, Hamilton, ON Canada
| | - Rosa Stalteri
- 1Department of Health Research Methods, Evidence and Impact, McMaster University, Hamilton, ON Canada
| | - Oluwatobi R Olaiya
- 5Michael G. DeGroote School of Medicine, McMaster University, Hamilton, ON Canada
| | - Ahlam Alotaibi
- 6Department of Pediatrics, McMaster University, Hamilton, ON Canada
| | - Lehana Thabane
- 1Department of Health Research Methods, Evidence and Impact, McMaster University, Hamilton, ON Canada.,2Biostatistics Unit, Father Sean O'Sullivan Research Centre, St Joseph's Healthcare-Hamilton, 50 Charlton Avenue East, 3rd Floor Martha Wing, Room H321, Hamilton, ON L8N 4A6 Canada.,7Departments of Paediatrics and Anaesthesia, McMaster University, Hamilton, ON Canada.,8Centre for Evaluation of Medicine, St Joseph's Healthcare-Hamilton, Hamilton, ON Canada.,9Population Health Research Institute, Hamilton Health Sciences, Hamilton, ON Canada
| |
Collapse
|
13
|
Speich B, Mc Cord KA, Agarwal A, Gloy V, Gryaznov D, Moffa G, Hopewell S, Briel M. Reporting Quality of Journal Abstracts for Surgical Randomized Controlled Trials Before and After the Implementation of the CONSORT Extension for Abstracts. World J Surg 2019; 43:2371-2378. [PMID: 31222645 PMCID: PMC6722149 DOI: 10.1007/s00268-019-05064-1] [Citation(s) in RCA: 16] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
BACKGROUND Adequate reporting is crucial in full-text publications but even more so in abstracts because they are the most frequently read part of a publication. In 2008, an extension for abstracts of the Consolidated Standards of Reporting Trials (CONSORT-A) statement was published, defining which items should be reported in abstracts of randomized controlled trials (RCTs). Therefore, we compared the adherence of RCT abstracts to CONSORT-A before and after the publication of CONSORT-A. METHODS RCTs published in the five surgical journals with the highest impact factor were identified through PubMed for 2005-2007 and 2014-2016. Adherence to 15 CONSORT-A items and two additional items for abstracts of non-pharmacological trials was assessed in duplicate. We compared the overall adherence to CONSORT-A between the two time periods using an unpaired t test and explored adherence to specific items. RESULTS A total of 192 and 164 surgical RCT abstracts were assessed (2005-2007 and 2014-2016, respectively). In the pre-CONSORT-A phase, the mean score of adequately reported items was 6.14 (95% confidence interval [CI] 5.90-6.38) and 8.11 in the post-CONSORT-A phase (95% CI 7.83-8.39; mean difference 1.97, 95% CI 1.60-2.34; p < 0.0001). The comparison of individual items indicated a significant improvement in 9 of the 15 items. The three least reported items in the post-CONSORT-A phase were randomization (2.4%), blinding (13.4%), and funding (0.0%). Specific items for non-pharmacological trials were rarely reported (approximately 10%). CONCLUSION The reporting in abstracts of surgical RCTs has improved after the implementation of CONSORT-A. More importantly, there is still ample room for improvement.
Collapse
Affiliation(s)
- Benjamin Speich
- Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, UK.
- Basel Institute for Clinical Epidemiology and Biostatistics, Department of Clinical Research, University Hospital Basel and University of Basel, Basel, Switzerland.
| | - Kimberly A Mc Cord
- Basel Institute for Clinical Epidemiology and Biostatistics, Department of Clinical Research, University Hospital Basel and University of Basel, Basel, Switzerland
| | - Arnav Agarwal
- Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, ON, Canada
- School of Medicine, University of Toronto, Toronto, ON, Canada
| | - Viktoria Gloy
- Basel Institute for Clinical Epidemiology and Biostatistics, Department of Clinical Research, University Hospital Basel and University of Basel, Basel, Switzerland
| | - Dmitry Gryaznov
- Basel Institute for Clinical Epidemiology and Biostatistics, Department of Clinical Research, University Hospital Basel and University of Basel, Basel, Switzerland
| | - Giusi Moffa
- Basel Institute for Clinical Epidemiology and Biostatistics, Department of Clinical Research, University Hospital Basel and University of Basel, Basel, Switzerland
| | - Sally Hopewell
- Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, UK
| | - Matthias Briel
- Basel Institute for Clinical Epidemiology and Biostatistics, Department of Clinical Research, University Hospital Basel and University of Basel, Basel, Switzerland
- Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Canada
| |
Collapse
|
14
|
Liampas I, Chlinos A, Siokas V, Brotis A, Dardiotis E. Assessment of the reporting quality of RCTs for novel oral anticoagulants in venous thromboembolic disease based on the CONSORT statement. J Thromb Thrombolysis 2019; 48:542-553. [DOI: 10.1007/s11239-019-01931-9] [Citation(s) in RCA: 17] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/09/2023]
|
15
|
Hua F, Sun Q, Zhao T, Chen X, He H. Reporting quality of randomised controlled trial abstracts presented at the SLEEP Annual Meetings: a cross-sectional study. BMJ Open 2019; 9:e029270. [PMID: 31315871 PMCID: PMC6661648 DOI: 10.1136/bmjopen-2019-029270] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/30/2022] Open
Abstract
OBJECTIVES To evaluate the reporting quality of randomised controlled trial (RCT) abstracts presented at a leading international conference in sleep medicine (the SLEEP Annual Meeting), and to investigate the association between potential predictors and the reporting quality of trial abstracts in this field. DESIGN Cross-sectional, research on research study. METHODS A handsearch of the 2016-2018 SLEEP Annual Meeting abstract books was carried out to identify abstracts describing RCTs. Quality of reporting was assessed with the original 17-item CONSORT for Abstracts checklist. Univariable and multivariable linear regression analyses were performed to identify significant predictors of reporting quality. In addition, risk ratios were used to analyse the adequate reporting rate of each quality item by type of intervention and funding status. PRIMARY AND SECONDARY OUTCOME MEASURES The overall quality score (OQS, range 0-17) in accordance with the CONSORT for Abstracts checklist (primary outcome), and the adequate reporting rate of each checklist item (secondary outcome). RESULTS A total of 176 RCT abstracts were included and assessed. The mean OQS was 5.53 (95% CI 5.30 to 5.76). Only three quality items (objective, conclusions and funding) were adequately reported in most abstracts (>75%). None of the abstracts adequately reported authors, randomisation or outcome in the results section. According to the multivariable analysis, pharmacological interventions (p=0.018) and funding from the industry (p=0.025) were significantly associated with better reporting quality. CONCLUSIONS The reporting quality of RCT abstracts presented at SLEEP Annual Meetings was suboptimal. Pharmacological intervention and funding from industry were significant predictors of better reporting quality. Joint efforts by authors and conference committees are needed to enhance the reporting quality of RCT abstracts presented at sleep medicine conferences, and thereby reduce relevant research waste in this field.
Collapse
Affiliation(s)
- Fang Hua
- Centre for Evidence-Based Stomatology, Hubei-MOST KLOS & KLOBM, School & Hospital of Stomatology, Wuhan University, Wuhan, China
- Cochrane Oral Health, Division of Dentistry, The University of Manchester, Manchester, UK
| | - Qiao Sun
- Department of Orthodontics, Hubei-MOST KLOS & KLOBM, School & Hospital of Stomatology, Wuhan University, Wuhan, China
| | - Tingting Zhao
- Department of Orthodontics, Hubei-MOST KLOS & KLOBM, School & Hospital of Stomatology, Wuhan University, Wuhan, China
| | - Xiong Chen
- Department of Otolaryngology-Head and Neck Surgery, Zhongnan Hospital of Wuhan University, Wuhan, China
| | - Hong He
- Department of Orthodontics, Hubei-MOST KLOS & KLOBM, School & Hospital of Stomatology, Wuhan University, Wuhan, China
| |
Collapse
|
16
|
Scola LFC, Moseley AM, Thabane L, Almeida M, Costa LDCM. A methodological survey on reporting of pilot and feasibility trials for physiotherapy interventions: a study protocol. BMJ Open 2019; 9:e020580. [PMID: 31122962 PMCID: PMC6538092 DOI: 10.1136/bmjopen-2017-020580] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/30/2023] Open
Abstract
INTRODUCTION Pilot and feasibility trials aim to test whether a full trial can be conducted or if any procedures must be changed for the full trial. Pilot trials must be reported in a transparent, accurate and complete way. In this report, we present a protocol for a methodological survey with the following aims: (1) to determine the percentage of physiotherapy trial reports which claim to be pilot or feasibility trials that evaluate feasibility, (2) to determine the aspect of feasibility evaluated in the primary objectives of the pilot or feasibility trials, (3) to describe the completeness of reporting of abstracts and full articles of pilot or feasibility trials using the Consolidated Standards of Reporting Trials (CONSORT) extension to randomised pilot and feasibility trials and (4) to investigate factors associated with completeness of reporting of pilot or feasibility trials. METHODS AND ANALYSIS Reports of randomised controlled trials indexed in the Physiotherapy Evidence Database (PEDro) that claim to be pilot or feasibility trials and published in 2011-2017 will be included. Two independent reviewers will confirm eligibility and classify the aspect of feasibility being evaluated in the objectives of the included pilot or feasibility trials. Completeness of reporting of both the abstract and the full article will be evaluated using the CONSORT extension to randomised pilot and feasibility trials. The primary analysis will be a descriptive analysis about the reporting quality of abstracts and full texts of pilot and feasibility trials. We will use generalised estimating equation analysis to explore factors associated with completeness of reporting. ETHICS AND DISSEMINATION The results of this study will be disseminated by presentation at conferences and will be submitted for publication in a peer-reviewed journal. Ethical approval is not necessary for this study.
Collapse
Affiliation(s)
- Luiz Felicio Cadete Scola
- Masters and Doctoral Programs in Physical Therapy, Universidade Cidade de São Paulo, São Paulo, Brazil
- Department of Physical Therapy, Centro Universitário Anhanguera, São Paulo, Brazil
| | - Anne M Moseley
- Institute for Musculoskeletal Health, School of Public Health, University of Sydney, Sydney, New South Wales, Australia
| | - Lehana Thabane
- Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada
| | - Matheus Almeida
- Masters and Doctoral Programs in Physical Therapy, Universidade Cidade de São Paulo, São Paulo, Brazil
| | | |
Collapse
|
17
|
Janackovic K, Puljak L. Reporting quality of randomized controlled trial abstracts in the seven highest-ranking anesthesiology journals. Trials 2018; 19:591. [PMID: 30373644 PMCID: PMC6206658 DOI: 10.1186/s13063-018-2976-x] [Citation(s) in RCA: 29] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/05/2018] [Accepted: 10/10/2018] [Indexed: 11/10/2022] Open
Abstract
Background The aim of this study was to assess adherence to the Consolidated Standards of Reporting Trials (CONSORT) extension for Abstracts (CONSORT-A) in the highest-impact anesthesiology journals. Methods This was a descriptive, cross-sectional, methodological study. We analyzed whether abstracts of randomized controlled trials (RCTs) published in the highest-impact anesthesiology journals between 2014 and 2016 adhered with CONSORT-A. RCT abstracts published in the seven first-quartile journals in the Journal Citation Reports (JCR) category Anesthesiology were analyzed. The primary outcome was adherence to the 17-item CONSORT-A checklist. Secondary outcomes were adherence to individual checklist items and adherence with the checklist across the individual journals. Results Search results yielded 688 records, of which 622 abstracts were analyzed. Analysis of the total score of the CONSORT-A checklist indicated a per-article median of 41% (interquartile range 35–53%). The European Journal of Anesthesiology had the highest overall adherence rate (53%), whereas Anaesthesia had the lowest (32%). The lowest adherence was observed for the following items: Trial design (18%), Contact of the authors as an e-mail address of the corresponding author (16%), Recruitment status (9%), Number of participants analyzed (8%), Randomization (3%), and Funding (0.2%). Conclusions RCT abstracts published in top anesthesiology journals are poorly reported, providing insufficient information to readers. Interventions are needed to increase adherence to relevant reporting checklists for writing RCT abstracts.
Collapse
Affiliation(s)
| | - Livia Puljak
- Cochrane Croatia, University of Split School of Medicine, Soltanska 2, 21000, Split, Croatia. .,Agency for Quality and Accreditation in Health Care and Social Welfare, Zagreb, Croatia.
| |
Collapse
|