A systematic review and in-depth analysis of outcome reporting in early phase studies of colorectal cancer surgical innovation

A systematic review of clinical outcome reporting for curative surgical treatment of patients with pancreatic adenocarcinoma

BACKGROUND

Pancreatic cancer is a leading cause of cancer-related death. Surgery (with systemic therapy) provides the only chance for long-term survival, but carries a high risk of morbidity and mortality. Robust evidence from meta-analyses, essential in informing decisions, is thwarted by inconsistencies between studies. This systematic review determines the nature and degree of heterogenous outcome reporting in research evaluating curative pancreatic cancer surgery.

METHODS

A literature search of Medline, Embase, Cochrane Central and clinicaltrials.gov from 2017 to 2023 for eligible randomised and prospective studies adhering to a PROSPERO registered protocol.

RESULTS

Included were 156 studies reporting a total of 2088 outcomes which deduplicated to 399 unique endpoints. No single outcome was reported in all studies. 45 % were not defined. Adverse events and delivery of care measures (typically technical aspects of surgery) accounted for 60 % and 32 % of outcomes respectively, compared to 6 % evaluating physical functioning post-surgery.

CONCLUSION

The vast number and diversity of outcomes in use demonstrates lack of discernment in choice and disparity over domains of importance. Further work is needed to embed uniform outcome definitions, harmonise data collection and refocus research on fewer outcomes of proven relevance. Developing consensus on these critical outcomes through a Core Outcome Set is recommended.

Development of a conceptual framework for reporting modifications in surgical innovation: scoping review

BACKGROUND

Innovative surgical procedures and devices are often modified throughout their development and introduction into clinical practice. A systematic approach to reporting modifications may support shared learning and foster safe and transparent innovation. Definitions of 'modifications', and how they are conceptualized and classified so they can be reported and shared effectively, however, are lacking. This study aimed to explore and summarize existing definitions, perceptions, classifications and views on modification reporting to develop a conceptual framework for understanding and reporting modifications.

METHODS

A scoping review was conducted in accordance with PRISMA Extension for Scoping Reviews (PRISMA-ScR) guidelines. Targeted searches and two database searches were performed to identify relevant opinion pieces and review articles. Included were articles relating to modifications to surgical procedures/devices. Data regarding definitions, perceptions and classifications of modifications, and views on modification reporting were extracted verbatim. Thematic analysis was undertaken to identify themes, which informed development of the conceptual framework.

RESULTS

Forty-nine articles were included. Eight articles included systems for classifying modifications, but no articles reported an explicit definition of modifications. Some 13 themes relating to perception of modifications were identified. The derived conceptual framework comprises three overarching components: baseline data about modifications, details about modifications and impact/consequences of modifications.

CONCLUSION

A conceptual framework for understanding and reporting modifications that occur during surgical innovation has been developed. This is a first necessary step to support consistent and transparent reporting of modifications, to facilitate shared learning and incremental innovation of surgical procedures/devices. Testing and operationalization is now needed to realize the value of this framework.

A standardized measurement instrument was recommended for evaluating operator experience in complex healthcare interventions

OBJECTIVE

During development of complex surgical innovations, modifications occur to optimize safety and efficacy. Operators' experiences (how professionals feel undertaking the innovation) drive this process but comprehensive overviews of measures of this concept are lacking. This study identified and appraised measures to assess operators' experience of surgical innovation.

STUDY DESIGN AND SETTING

There were three phases: (1) Literature reviews identified measures of operators' experience and concepts measured were extracted and grouped into domains. (2) Quality appraisal was conducted to assess content validity of identified instruments and was supported by COnsensus-based Standards for the selection of health Measurement Instruments methodology. Self-reported measurement instruments that had underdone formal development were eligible. Content validity was assessed using COnsensus-based Standards for the selection of health Measurement Instruments criteria for good content validity (rated sufficient/insufficient/indeterminate/inconsistent), informed by standards for measurement development and domains identified in phase 1. (3) Instruments determined suitable and of sufficient quality underwent supplemental appraisal in interviews with international multidisciplinary professionals and a focus group.

RESULTS

Literature reviews identified 16 measurement instruments from 243 studies. Most assessed 'psychological' experiences and 'usability'. No instrument was specifically validated for innovative surgery. Three instruments were rated 'sufficient' (Surgery Task Load Index [SURG-TLX]) or 'indeterminate' (Spielberger State-Trait Anxiety Inventory, Imperial Stress Assessment Tool). Twenty professionals were interviewed (seven female; 15 specialties; six countries) and the focus group included 10 participants (four professionals, six researchers). The SURG-TLX was considered the most relevant, comprehensive, and comprehensible instrument.

CONCLUSION

The SURG-TLX is preliminarily recommended to measure operators' experiences of innovation. Further work exploring its role and impact on surgical innovation is required.

Shared Learning Utilizing Digital Methods in Surgery to Enhance Transparency in Surgical Innovation: Protocol for a Scoping Review

BACKGROUND

Surgical innovation can lead to important improvements in patient outcomes. Currently, information and knowledge about novel procedures and devices are disseminated informally and in an unstandardized way (eg, through social media). This can lead to ineffective and inefficient knowledge sharing among surgeons, which can result in the harmful repetition of mistakes and delay in the uptake of promising innovation. Improvements are needed in the way that learning in surgical innovation is shared through the development of novel, real-time methods, informed by a contemporary and comprehensive investigation of existing methods.

OBJECTIVE

The aim of this scoping review is to explore the application of existing digital methods for training/education and feedback to surgeons in the context of performing invasive surgical procedures. This work will (1) summarize existing methods for shared learning in surgery and how they are characterized and operationalized, (2) examine the impact of their application, and (3) explore their benefits and barriers to implementation. The findings of this scoping review will inform the development of novel, real-time methods to optimize shared learning in surgical innovation.

METHODS

This study will adhere to the recommended guidelines for conducting scoping reviews. A total of 6 different searches will be conducted within multiple sources (2 electronic databases, journals, social media, gray literature, commercial websites, and snowball searches) to comprehensively identify relevant articles and data. Searches will be limited to articles published in the English language within the last 5 years. Wherever possible, a 2-stage study selection process will be followed whereby the eligibility of articles will be assessed through the title, abstract, and full-text screening independently by 2 reviewers. Inclusion criteria will be articles providing data on (1) fully qualified theater staff involved in performing invasive procedures, (2) one or more methods for shared learning (ie, digital means for training/education and feedback), and (3) qualitative or quantitative evaluations of this method. Data will be extracted (10% double data extraction by an independent reviewer) into a piloted proforma and analyzed using descriptive statistics, narrative summaries, and principles of thematic analysis.

RESULTS

The study commenced in October 2021 and is planned to be completed in 2023. To date, systematic searches were applied to 2 electronic databases (MEDLINE and Web of Science) and returned a total of 10,093 records. The results of this scoping review will be published as open access in a peer-reviewed journal.

CONCLUSIONS

This scoping review of methods for shared learning in surgery is, to our knowledge, the most comprehensive and up-to-date investigation that maps current information on this topic. Ultimately, efficient and effective sharing of information and knowledge of novel procedures and devices has the potential to optimize the evaluation of early-phase surgical research and reduce harmful innovation.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

PRR1-10.2196/37544.

Identification of outcomes to inform the development of a core outcome set for surgical innovation: a targeted review of case studies of novel surgical devices

OBJECTIVE

Outcome selection and reporting in studies of novel surgical procedures and devices lacks standardisation, hindering safe and effective evaluation. A core outcome set (COS) to measure and report in all studies of surgical innovation is needed. We explored outcomes in a specific sample of innovative surgical device case studies to identify outcome domains specifically relevant to innovation to inform the development of a COS.

DESIGN

A targeted review of 11 purposive selected case studies of innovative surgical devices.

METHODS

Electronic database searches in PubMed (July 2018) identified publications reporting the introduction and evaluation of each device. Outcomes were extracted and categorised into domains until no new domains were conceptualised. Outcomes specifically relevant to evaluating innovation were further scrutinised.

RESULTS

112 relevant publications were identified, and 5926 outcomes extracted. Heterogeneity in study type, outcome selection and reporting was observed across surgical devices. Categorisation of outcomes was performed for 2689 (45.4%) outcomes into five broad outcome domains. Outcomes considered key to the evaluation of innovation (n=66; 2.5%) were further categorised as surgeon/operator experience (n=40; 1.5%), unanticipated events (n=15, 0.6%) and modifications (n=11; 0.4%).

CONCLUSION

Outcome domains unique to evaluating innovative surgical devices have been identified. Findings have been combined with multiple other data sources relevant to the evaluation of surgical innovation to inform the development of a COS to measure and report in all studies evaluating novel surgical procedures/devices.

Reporting Modifications in Surgical Innovation: A Systematic Scoping Review Protocol

INTRODUCTION

Innovation in surgery drives improvements to patient care. New surgical procedures and devices typically undergo a series of modifications as they are developed and refined during their introduction into clinical practice. These changes should ideally be reported and shared between surgeon-innovators to promote efficient, safe and transparent innovation. Currently, agreement on how modifications should be defined, conceptualised and classified, so they can be reported and shared efficiently and transparently, is lacking. The aim of this review is to examine and summarise existing literature on definitions, perceptions and classifications of modifications to surgical procedures/devices, including views on how to measure and report them. The findings will inform future work to standardise reporting and sharing of modifications in surgical innovation.

MATERIALS AND METHODS

A systematic scoping review will be conducted adhering to PRISMA-ScR guidelines. Included articles will focus on review articles and opinion pieces relevant to modifications to new surgical procedures or devices introduced to clinical practice. Methods to identify relevant literature will include systematic searches in MEDLINE (Ovid version), targeted internet searches (Google Scholar) and snowball searches. A two-stage screening process (titles/abstracts/keywords and full-texts) will use specified exclusion/inclusion criteria to identify eligible articles. Data on how modifications are i) defined, ii) perceived, and iii) classified, and iv) views on how modifications should be measured and reported, will be extracted verbatim. Inductive thematic analysis will be applied to extracted data where appropriate. Results will be presented as a narrative summary including descriptive characteristics of included articles. Findings will inform a preliminary conceptual framework to facilitate the systematic reporting and sharing of modifications to novel procedures and devices.

HIGHLIGHTS

This work will generate an in-depth understanding of how modifications are currently defined, perceived and classified, and views on how they may be reported, in the context of surgical innovation.Rigorous and comprehensive search methods will be applied to identify a wide range of diverse data sources for inclusion in the review.A summary of existing relevant literature on modifications is a necessary step to inform development of a framework for transparent, real-time reporting and sharing of modifications in future studies of innovative invasive procedures/devices.