1
|
McKechnie T, Kazi T, Shi V, Wang A, Zhang S, Thabane A, Nanji K, Staibano P, Park LJ, Doumouras A, Eskicioglu C, Thabane L, Parpia S, Bhandari M. Spin Reporting Is Common in Pilot Randomized Controlled Trials in Surgery: A Methodological Survey. J Surg Res 2025; 306:16-25. [PMID: 39742654 DOI: 10.1016/j.jss.2024.12.019] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2024] [Revised: 11/09/2024] [Accepted: 12/07/2024] [Indexed: 01/04/2025]
Abstract
INTRODUCTION Spin reporting has been studied across a variety of study types and domains; however, it has yet to be studied in the context of pilot and feasibility trials. We designed this methodological survey to evaluate spin reporting in surgical pilot and feasibility trials. METHODS Medline, Embase, and Cochrane Central Register of Controlled Trials were searched from January 1, 2011, to December 31, 2011, and January 1, 2021, to December 31, 2021. Studies were included if they were pilot or feasibility randomized trials evaluating a surgical intervention. The primary objective was to determine the proportion of pilot and feasibility trials utilizing spin reporting defined as primary focus on efficacy as opposed to feasibility, focus on statistically significant findings as opposed to feasibility, and/or presentation of results as feasible despite not actually being feasible. Secondary objectives included determining the type of spin reporting and exploring the association between study characteristics and spin reporting. RESULTS After screening 1991 citations, 38 studies from 2011 to 34 studies from 2021 were included. Overall, 59 of the included pilot and feasibility trials (81.9%: 59/72, 95% confidence interval [CI] 71.4-89.3%) utilized spin reporting. Fifty-eight trials (80.6%, 95% CI 69.8-88.2%) primarily focused on efficacy as opposed to feasibility, 34 trials (47.2%, 95% CI 36.1-58.6%) focused on statistically significant findings as opposed to feasibility, and four trials (5.6%, 95% CI 1.8-13.8%) suggested feasibility objectives were met when they were not. Spin was identified in 94.7% (95% CI 81.8-99.5%) and 67.6% (95% CI 50.7-81.0%) of studies published in 2011 and 2021, respectively. CONCLUSIONS Most pilot and feasibility trials in surgery inappropriately focus on clinical outcomes and statistical significance as opposed to feasibility outcomes for the main future trial. This practice is concerning given that pilot trials are not adequately powered and are intended to serve as exploratory study to increase the likelihood of a successful definitive trial.
Collapse
Affiliation(s)
- Tyler McKechnie
- Division of General Surgery, Department of Surgery, McMaster University, Hamilton, ON, Canada; Department of Health Research Methodology, Evidence, and Impact, McMaster University, Hamilton, ON, Canada.
| | - Tania Kazi
- Michael G. DeGroote School of Medicine, McMaster University, Hamilton, ON, Canada
| | - Victoria Shi
- Michael G. DeGroote School of Medicine, McMaster University, Hamilton, ON, Canada
| | - Austine Wang
- Michael G. DeGroote School of Medicine, McMaster University, Hamilton, ON, Canada
| | - Sophia Zhang
- Michael G. DeGroote School of Medicine, McMaster University, Hamilton, ON, Canada
| | - Alex Thabane
- Department of Health Research Methodology, Evidence, and Impact, McMaster University, Hamilton, ON, Canada
| | - Keean Nanji
- Department of Health Research Methodology, Evidence, and Impact, McMaster University, Hamilton, ON, Canada; Division of Ophthalmology, Department of Surgery, McMaster University, Hamilton, ON, Canada
| | - Phillip Staibano
- Department of Health Research Methodology, Evidence, and Impact, McMaster University, Hamilton, ON, Canada; Division of Otolaryngology Head and Neck Surgery, Department of Surgery, McMaster University, Hamilton, ON, Canada
| | - Lily J Park
- Division of General Surgery, Department of Surgery, McMaster University, Hamilton, ON, Canada; Department of Health Research Methodology, Evidence, and Impact, McMaster University, Hamilton, ON, Canada
| | - Aristithes Doumouras
- Division of General Surgery, Department of Surgery, McMaster University, Hamilton, ON, Canada; Department of Health Research Methodology, Evidence, and Impact, McMaster University, Hamilton, ON, Canada; Michael G. DeGroote School of Medicine, McMaster University, Hamilton, ON, Canada
| | - Cagla Eskicioglu
- Division of General Surgery, Department of Surgery, McMaster University, Hamilton, ON, Canada; Michael G. DeGroote School of Medicine, McMaster University, Hamilton, ON, Canada
| | - Lehana Thabane
- Department of Health Research Methodology, Evidence, and Impact, McMaster University, Hamilton, ON, Canada; Biostatistics Unit, St Joseph's Healthcare Hamilton, Hamilton, ON, Canada; Faculty of Health Sciences, University of Johannesburg, Johannesburg, South Africa
| | - Sameer Parpia
- Department of Health Research Methodology, Evidence, and Impact, McMaster University, Hamilton, ON, Canada; Department of Oncology, McMaster University, Hamilton, ON, Canada
| | - Mohit Bhandari
- Department of Health Research Methodology, Evidence, and Impact, McMaster University, Hamilton, ON, Canada; Division of Orthopedic Surgery, Department of Surgery, McMaster University, Hamilton, ON, Canada
| |
Collapse
|
2
|
Walshaw J, Huo B, McClean A, Gajos S, Kwan JY, Tomlinson J, Biyani CS, Dimashki S, Chetter I, Yiasemidou M. Innovation in gastrointestinal surgery: the evolution of minimally invasive surgery-a narrative review. Front Surg 2023; 10:1193486. [PMID: 37288133 PMCID: PMC10242011 DOI: 10.3389/fsurg.2023.1193486] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/24/2023] [Accepted: 05/04/2023] [Indexed: 06/09/2023] Open
Abstract
Background Minimally invasive (MI) surgery has revolutionised surgery, becoming the standard of care in many countries around the globe. Observed benefits over traditional open surgery include reduced pain, shorter hospital stay, and decreased recovery time. Gastrointestinal surgery in particular was an early adaptor to both laparoscopic and robotic surgery. Within this review, we provide a comprehensive overview of the evolution of minimally invasive gastrointestinal surgery and a critical outlook on the evidence surrounding its effectiveness and safety. Methods A literature review was conducted to identify relevant articles for the topic of this review. The literature search was performed using Medical Subject Heading terms on PubMed. The methodology for evidence synthesis was in line with the four steps for narrative reviews outlined in current literature. The key words used were minimally invasive, robotic, laparoscopic colorectal, colon, rectal surgery. Conclusion The introduction of minimally surgery has revolutionised patient care. Despite the evidence supporting this technique in gastrointestinal surgery, several controversies remain. Here we discuss some of them; the lack of high level evidence regarding the oncological outcomes of TaTME and lack of supporting evidence for robotic colorectalrectal surgery and upper GI surgery. These controversies open pathways for future research opportunities with RCTs focusing on comparing robotic to laparoscopic with different primary outcomes including ergonomics and surgeon comfort.
Collapse
Affiliation(s)
- Josephine Walshaw
- Academic Vascular Surgical Unit, Hull University Teaching Hospitals NHS Trust, Hull, United Kingdom
| | - Bright Huo
- Faculty of Medicine, Dalhousie University, Halifax, NS, Canada
| | - Adam McClean
- Department of General Surgery, Bradford Teaching Hospitals NHS Trust, Bradford, United Kingdom
| | - Samantha Gajos
- Emergency Medicine Department, York and Scarborough Teaching Hospitals NHS Foundation Trust, York, United Kingdom
| | - Jing Yi Kwan
- Department of General Surgery, Bradford Teaching Hospitals NHS Trust, Bradford, United Kingdom
- Department of Vascular Surgery, Leeds Teaching Hospitals NHS Trust, Leeds, United Kingdom
| | - James Tomlinson
- Department of Spinal Surgery, SheffieldTeaching Hospitals, Sheffield, United Kingdom
| | - Chandra Shekhar Biyani
- Department of Vascular Surgery, Leeds Teaching Hospitals NHS Trust, Leeds, United Kingdom
| | - Safaa Dimashki
- Department of General Surgery, Bradford Teaching Hospitals NHS Trust, Bradford, United Kingdom
| | - Ian Chetter
- Academic Vascular Surgical Unit, Hull University Teaching Hospitals NHS Trust, Hull, United Kingdom
| | - Marina Yiasemidou
- NIHR Academic Clinical Lecturer General Surgery, University of Hull, Hull, United Kingdom
- Hull York Medical School, University of York, York, United Kingdom
| |
Collapse
|
3
|
Corcoran A, Neale M, Arthur W, Ottwell R, Roberts W, Hartwell M, Cates S, Wright DN, Beaman J, Vassar M. Evaluating spin in the abstracts of systematic reviews and meta-analyses on cannabis use disorder. Subst Abus 2021; 43:1-9. [PMID: 34283700 DOI: 10.1080/08897077.2021.1944953] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/08/2023]
Abstract
BACKGROUND Clinicians rely upon abstracts to provide them quick synopses of research findings that may apply to their practice. Spin can exist within these abstracts that distorts or misrepresents the findings. Our goal was to evaluate the level of spin within systematic reviews (SRs) focused on the treatment of cannabis use disorder (CUD). Methods: A systematic search was conducted in May 2020. To meet inclusion criteria, publications had to be either an SR or meta-analysis related to the treatment of cannabis use. Screening and data extraction was performed in a duplicate and masked fashion. Study quality was assessed using AMSTAR-2 Results: 16/24 SRs (66.7%) contained at least one form of spin in the abstract. The most common forms of spin identified were type 3-selective reporting of or overemphasis on efficacy outcomes or analysis favoring the beneficial effect of the experimental intervention (45.8%)-and type 8-the review's findings from a surrogate marker or a specific outcome to the global improvement of the disease (37.5%). No significant association between spin and intervention type, PRISMA requirements, or funding source was identified. Weak positive correlations were found between the presence of spin and abstract word count (r =.217) and between spin and AMSTAR-2 rating (r = 0.143). "Moderate" was the most common AMSTAR-2 rating (9/24, 37.5%), followed by "low" (7/24, 29.2%) and "critically low" (7/24, 29.2%). One systematic review received an AMSTAR-2 rating of "high" (1/24, 4.2%). Conclusions: Spin was common among abstracts from the SRs focused on the treatments for CUD. Higher quality studies may help reduce the overall rate as well as standardizing treatment outcomes. To facilitate this, we encourage all authors, peer-reviewers, and editors to be more aware of the various types of spin as they can help reduce the overall amount of spin seen within the literature.
Collapse
Affiliation(s)
- Adam Corcoran
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Monika Neale
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
- College of Osteopathic Medicine, Kansas City University of Medicine and Biosciences, Kansas City, Missouri, USA
| | - Wade Arthur
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Ryan Ottwell
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Will Roberts
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Micah Hartwell
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
- Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Stephens Cates
- Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Drew N Wright
- Samuel J. Wood Library & C. V. Starr Biomedical Information Center, Weill Cornell Medical College, New York, New York, USA
| | - Jason Beaman
- Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Matt Vassar
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
- Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| |
Collapse
|
4
|
Statistical, Clinical, Methodological Evaluation of Local Recurrence Following Transanal Total Mesorectal Excision for Rectal Cancer: A Systematic Review. Dis Colon Rectum 2021; 64:899-914. [PMID: 33938532 DOI: 10.1097/dcr.0000000000002110] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/23/2022]
Abstract
BACKGROUND A recent Norwegian moratorium challenged the status quo of transanal total mesorectal excision for rectal cancer by reporting increased early multifocal local recurrences. OBJECTIVE The aim of this systematic review and meta-analysis was to evaluate the local recurrence rates following transanal total mesorectal excision as well as to assess statistical, clinical, and methodological bias in reports published to date. DATA SOURCES The PubMed and MEDLINE (via Ovid) databases were systematically searched. STUDY SELECTION Descriptive or comparative studies reporting rates of local recurrence at a median follow-up of 6 months (or more) after transanal total mesorectal excision were included. INTERVENTIONS Patients underwent transanal total mesorectal excision. MAIN OUTCOME MEASURES Local recurrence was any recurrence located in the pelvic surgery site. The untransformed proportion method of 1-arm meta-analysis was utilized. Untransformed percent proportion with 95% confidence interval was reported. Ad hoc meta-regression with the Omnibus test was utilized to assess risk factors for local recurrence. Among-study heterogeneity was evaluated: statistically by I2 and τ2, clinically by summary tables, and methodologically by a 33-item questionnaire. RESULTS Twenty-nine studies totaling 2906 patients were included. The pooled rate of local recurrence was 3.4% (2.7%-4.0%) at an average of 20.1 months with low statistical heterogeneity (I2 = 0%). Meta-regression yielded no correlation between complete total mesorectal excision quality (p = 0.855), circumferential resection margin (p = 0.268), distal margin (p = 0.886), and local recurrence rates. Clinical heterogeneity was substantial. Methodological heterogeneity was linked to the excitement of novelty, loss aversion, reactivity to criticism, indication for transanal total mesorectal excision, nonprobability sampling, circular reasoning, misclassification, inadequate follow-up, reporting bias, conflict of interest, and self-licensing. LIMITATIONS The studies included had an observational design and limited sample and follow-up. CONCLUSION This systematic review found a pooled rate of local recurrence of 3.4% at 20 months. However, given the substantial clinical and methodological heterogeneity across the studies, the evidence for or against transanal total mesorectal excision is inconclusive at this time.
Collapse
|
5
|
Abstract
OBJECTIVES To identify and calculate the prevalence of spin in studies of spin. DESIGN Meta-research analysis (research on research). SETTING 35 studies of spin in the scientific literature. MAIN OUTCOME MEASURES Spin, categorised as: reporting practices that distort the presentation and interpretation of results, creating misleading conclusions; discordance between results and their interpretation, with presentation of favourable conclusions that are not supported by the data or results; attribution of causality when study design does not support it; and over-interpretation or inappropriate extrapolation of results. RESULTS Five (14%) of 35 spin studies contained spin categorised as reporting practices that distort the presentation and interpretation of results (n=2) or categorised as over-interpretation or inappropriate extrapolation of results (n=3). CONCLUSION Spin occurs in research on spin. Although researchers on this topic should be sensitive to spinning their findings, our study does not undermine the need for rigorous interventions to reduce spin across various research fields. CONCLUSION WITH SPIN Our hypothesis that spin will be less prevalent in spin studies than in studies on other topics has been proven. Spin scholars are less likely to spin their conclusions than other researchers, and they should receive substantial resources to launch and test interventions to reduce spin and research waste in reporting.
Collapse
Affiliation(s)
- Lisa Bero
- The University of Sydney, Charles Perkins Centre, School of Pharmacy, Faculty of Medicine and Health, Sydney, NSW 2006, Australia
| | - Kellia Chiu
- The University of Sydney, Charles Perkins Centre, School of Pharmacy, Faculty of Medicine and Health, Sydney, NSW 2006, Australia
| | - Quinn Grundy
- The University of Sydney, Charles Perkins Centre, School of Pharmacy, Faculty of Medicine and Health, Sydney, NSW 2006, Australia
- University of Toronto, Faculty of Nursing, Toronto, ON, Canada
| |
Collapse
|
6
|
Wasmuth HH, Færden AE, Myklebust TÅ, Pfeffer F, Norderval S, Riis R, Olsen OC, Lambrecht JR, Kørner H, Larsen SG, Forsmo HM, Bækkelund O, Lavik S, Knapp JC, Sjo O, Rashid G. Transanal total mesorectal excision for rectal cancer has been suspended in Norway. Br J Surg 2019; 107:121-130. [DOI: 10.1002/bjs.11459] [Citation(s) in RCA: 129] [Impact Index Per Article: 21.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2019] [Revised: 11/06/2019] [Accepted: 11/12/2019] [Indexed: 12/21/2022]
Abstract
Abstract
Background
Transanal total mesorectal excision (TaTME) for rectal cancer has emerged as an alternative to the traditional abdominal approach. However, concerns have been raised about local recurrence. The aim of this study was to evaluate local recurrence after TaTME. Secondary aims included postoperative mortality, anastomotic leak and stoma rates.
Methods
Data on all patients who underwent TaTME were recorded and compared with those from national cohorts in the Norwegian Colorectal Cancer Registry (NCCR) and the Norwegian Registry for Gastrointestinal Surgery (NoRGast). Kaplan–Meier estimates were used to compare local recurrence.
Results
In Norway, 157 patients underwent TaTME for rectal cancer between October 2014 and October 2018. Three of seven hospitals abandoned TaTME after a total of five procedures. The local recurrence rate was 12 of 157 (7·6 per cent); eight local recurrences were multifocal or extensive. The estimated local recurrence rate at 2·4 years was 11·6 (95 per cent c.i. 6·6 to 19·9) per cent after TaTME compared with 2·4 (1·4 to 4·3) per cent in the NCCR (P < 0·001). The adjusted hazard ratio was 6·71 (95 per cent c.i. 2·94 to 15·32). Anastomotic leaks resulting in reoperation occurred in 8·4 per cent of patients in the TaTME cohort compared with 4·5 per cent in NoRGast (P = 0·047). Fifty-six patients (35·7 per cent) had a stoma at latest follow-up; 39 (24·8 per cent) were permanent.
Conclusion
Anastomotic leak rates after TaTME were higher than national rates; local recurrence rates and growth patterns were unfavourable.
Collapse
Affiliation(s)
- H H Wasmuth
- Department of Gastrointestinal Surgery, St Olav's Hospital, Trondheim University Hospital, Trondheim, Norway
| | - A E Færden
- Department of Gastrointestinal Surgery, Akershus University Hospital, Lørenskog, Norway
| | - T Å Myklebust
- Department of Registration, Cancer Registry Norway, Oslo, Norway
- Department of Research and Innovation, Møre and Romsdal Hospital Trust, Ålesund, Norway
| | - F Pfeffer
- Department of Surgery, Haukeland University Hospital, Bergen, Norway
- Department of Clinical Medicine, University of Bergen, Bergen, Norway
| | - S Norderval
- Department of Gastrointestinal Surgery, Tromsø University Hospital, University of Northern Norway, Tromsø, Norway
| | - R Riis
- Department of Gastrointestinal Surgery, Akershus University Hospital, Lørenskog, Norway
| | - O C Olsen
- Department of Gastrointestinal Surgery, Drammen Hospital, Vestre Viken Hospital Trust, Drammen, Norway
| | - J R Lambrecht
- Department of Surgery, Gjøvik Hospital, Innlandet Hospital Trust, Gjøvik, Norway
| | - H Kørner
- Department of Clinical Medicine, University of Bergen, Bergen, Norway
- Department of Gastrointestinal Surgery, Stavanger University Hospital, Stavanger, Norway
| | - S G Larsen
- Department of Gastrointestinal Surgery, Norwegian Radium Hospital, Oslo University Hospital, Oslo, Norway
| | | | | | | | | | | | | | | |
Collapse
|
7
|
Mahendran B, Caiazzo A, Coleman M, Celentano V. Transanal total mesorectal excision (TaTME): are we doing it for the right indication? An assessment of the external validity of published online video resources. Int J Colorectal Dis 2019; 34:1823-1826. [PMID: 31489443 DOI: 10.1007/s00384-019-03377-0] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 08/23/2019] [Indexed: 02/04/2023]
Abstract
BACKGROUND The steep learning curve for safe introduction of transanal total mesorectal excision (TaTME) highlights the need for mentored training reserved for surgeons with expertise in minimally invasive colorectal surgery and transanal surgery. Video-based education in minimally invasive surgery is considered by surgical trainers as a useful teaching aid to maximize learning. This study aims to systematically assess the availability and quality of online TaTME videos. METHODS TaTME videos were systematically searched on YouTube.com , Colorectal diseases video channel, WebSurg.com , and AIS channel. Data collected included video characteristics, presence of supplementary educational content, patient details, indication for surgery, different steps of TaTME presented, and surgical outcomes. RESULTS Forty-six videos were included with a median of 92 views per month. Nineteen videos (41.3%) reported the age of the participants and 29 patients were male (63%). Body mass index (BMI) was reported in 20 videos (43.5%) with a median of 27 and it indicated obesity (BMI ≥ 30) in 2 cases only. The use of neoadjuvant treatment was reported in 8 cases (17.4%). Eighteen videos (39.1%) reported the distance of the tumor from the anal verge, with a median of 6.4 cm and in 9 out of 18 cases, the tumor distance from the anal verge was 7 cm or higher. Pathological staging was reported in 17 videos (37.0%), with 1 T1, 3 T2, 10 T3, and 3 T4 tumors. CONCLUSIONS There is considerable interest in TaTME videos. Lack of consensus on reporting of these videos limits the educational value of these resources, which are missing important patient details and postoperative outcomes.
Collapse
Affiliation(s)
- Balaji Mahendran
- Department of Colorectal Surgery, Derriford Hospital, University Hospitals Plymouth NHS Trust, Plymouth, PL6 8DH, UK.
| | - Anna Caiazzo
- University of Campania "Luigi Vanvitelli", Naples, Italy
| | - Mark Coleman
- Department of Colorectal Surgery, Derriford Hospital, University Hospitals Plymouth NHS Trust, Plymouth, PL6 8DH, UK
| | - Valerio Celentano
- Portsmouth Hospitals NHS Trust, Portsmouth, UK.,University of Portsmouth, Portsmouth, UK
| |
Collapse
|