Video is better: why aren't we using it? A mixed-methods study of the barriers to routine procedural video recording and case review

Video recording in GI endoscopy

The current approach to procedure reporting in endoscopy aims to capture essential findings and interventions but inherently sacrifices the rich detail and nuance of the entire endoscopic experience. Endoscopic video recording (EVR) provides a complete archive of the procedure, extending the utility of the encounter beyond diagnosis and intervention, and potentially adding significant value to the care of the patient and the field in general. This white paper outlines the potential of EVR in clinical care, quality improvement, education, and artificial intelligence-driven innovation, and addresses critical considerations surrounding technology, regulation, ethics, and privacy. As with other medical imaging modalities, growing adoption of EVR is inevitable, and proactive engagement of professional societies and practitioners is essential to harness the full potential of this technology toward improving clinical care, education, and research.

Barriers to the adoption of routine surgical video recording: a mixed-methods qualitative study of a real-world implementation of a video recording platform

BACKGROUND

Routine surgical video recording has multiple benefits. Video acts as an objective record of the operative record, allows video-based coaching and is integral to the development of digital technologies. Despite these benefits, adoption is not widespread. To date, only questionnaire studies have explored this failure in adoption. This study aims to determine the barriers and provide recommendations for the implementation of routine surgical video recording.

MATERIALS AND METHODS

A pre- and post-pilot questionnaire surrounding a real-world implementation of a C-SATS©, an educational recording and surgical analytics platform, was conducted in a university teaching hospital trust. Usage metrics from the pilot study and descriptive analyses of questionnaire responses were used with the non-adoption, abandonment, scale-up, spread, sustainability (NASSS) framework to create topic guides for semi-structured interviews. Transcripts of interviews were evaluated in an inductive thematic analysis.

RESULTS

Engagement with the C-SATS© platform failed to reach consistent levels with only 57 videos uploaded. Three attending surgeons, four surgical residents, one scrub nurse, three patients, one lawyer, and one industry representative were interviewed, all of which perceived value in recording. Barriers of 'change,' 'resource,' and 'governance,' were identified as the main themes. Resistance was centred on patient misinterpretation of videos. Participants believed availability of infrastructure would facilitate adoption but integration into surgical workflow is required. Regulatory uncertainty was centred around anonymity and data ownership.

CONCLUSION

Barriers to the adoption of routine surgical video recording exist beyond technological barriers alone. Priorities for implementation include integration recording into the patient record, engaging all stakeholders to ensure buy-in, and formalising consent processes to establish patient trust.

Introducing surgical intelligence in gynecology: Automated identification of key steps in hysterectomy

OBJECTIVE

The analysis of surgical videos using artificial intelligence holds great promise for the future of surgery by facilitating the development of surgical best practices, identifying key pitfalls, enhancing situational awareness, and disseminating that information via real-time, intraoperative decision-making. The objective of the present study was to examine the feasibility and accuracy of a novel computer vision algorithm for hysterectomy surgical step identification.

METHODS

This was a retrospective study conducted on surgical videos of laparoscopic hysterectomies performed in 277 patients in five medical centers. We used a surgical intelligence platform (Theator Inc.) that employs advanced computer vision and AI technology to automatically capture video data during surgery, deidentify, and upload procedures to a secure cloud infrastructure. Videos were manually annotated with sequential steps of surgery by a team of annotation specialists. Subsequently, a computer vision system was trained to perform automated step detection in hysterectomy. Analyzing automated video annotations in comparison to manual human annotations was used to determine accuracy.

RESULTS

The mean duration of the videos was 103 ± 43 min. Accuracy between AI-based predictions and manual human annotations was 93.1% on average. Accuracy was highest for the dissection and mobilization step (96.9%) and lowest for the adhesiolysis step (70.3%).

CONCLUSION

The results of the present study demonstrate that a novel AI-based model achieves high accuracy for automated steps identification in hysterectomy. This lays the foundations for the next phase of AI, focused on real-time clinical decision support and prediction of outcome measures, to optimize surgeon workflow and elevate patient care.

Current trends and barriers to video management and analytics as a tool for surgeon skilling

BACKGROUND

The benefits of intraoperative recording are well published in the literature; however, few studies have identified current practices, barriers, and subsequent solutions. The objective of this study was to better understand surgeon's current practices and perceptions of video management and gather blinded feedback on a new surgical video recording product with the potential to address these barriers effectively.

METHODS

A structured questionnaire was used to survey 230 surgeons (general, gynecologic, and urologic) and hospital administrators across the US and Europe regarding their current video recording practices. The same questionnaire was used to evaluate a blinded concept describing a new intraoperative recording solution.

RESULTS

54% of respondents reported recording eligible cases, with the majority recording less than 35% of their total eligible caseload. Reasons for not recording included finding no value in recording simple procedures, forgetting to record, lack of access to equipment, legal concerns, labor intensity, and difficulty accessing videos. Among non-recording surgeons, 65% reported considering recording cases to assess surgical techniques, document practice, submit to conferences, share with colleagues, and aid in training. 35% of surgeons rejected recording due to medico-legal concerns, lack of perceived benefit, concerns about secure storage, and price. Regarding the concept of a recording solution, 74% of all respondents were very likely or quite likely to recommend the product for adoption at their facility. Appealing features to current recorders included the product's ease of use, use of AI to maintain patient and staff privacy, lack of manual downloads, availability of full-length procedural videos, and ease of access and storage. Non-recorders found the immediate access to videos and maintenance of patient/staff privacy appealing.

CONCLUSION

Tools that address barriers to recording, accessing, and managing surgical case videos are critical for improving surgical skills. Touch Surgery Enterprise is a valuable tool that can help overcome these barriers.

Charting Tomorrow's Healthcare: A Traditional Literature Review for an Artificial Intelligence-Driven Future

Electronic health record (EHR) systems have developed over time in parallel with general advancements in mainstream technology. As artificially intelligent (AI) systems rapidly impact multiple societal sectors, it has become apparent that medicine is not immune from the influences of this powerful technology. Particularly appealing is how AI may aid in improving healthcare efficiency with note-writing automation. This literature review explores the current state of EHR technologies in healthcare, specifically focusing on possibilities for addressing EHR challenges through the automation of dictation and note-writing processes with AI integration. This review offers a broad understanding of existing capabilities and potential advancements, emphasizing innovations such as voice-to-text dictation, wearable devices, and AI-assisted procedure note dictation. The primary objective is to provide researchers with valuable insights, enabling them to generate new technologies and advancements within the healthcare landscape. By exploring the benefits, challenges, and future of AI integration, this review encourages the development of innovative solutions, with the goal of enhancing patient care and healthcare delivery efficiency.

Adoption of routine surgical video recording: a nationwide freedom of information act request across England and Wales

Background

Surgical video contains data with significant potential to improve surgical outcome assessment, quality assurance, education, and research. Current utilisation of surgical video recording is unknown and related policies/governance structures are unclear.

Methods

A nationwide Freedom of Information (FOI) request concerning surgical video recording, technology, consent, access, and governance was sent to all acute National Health Service (NHS) trusts/boards in England/Wales between 20th February and 20th March 2023.

Findings

140/144 (97.2%) trusts/boards in England/Wales responded to the FOI request. Surgical procedures were routinely recorded in 22 trusts/boards. The median estimate of consultant surgeons routinely recording their procedures was 20%. Surgical video was stored on internal systems (n = 27), third-party products (n = 29), and both (n = 9). 32/140 (22.9%) trusts/boards ask for consent to record procedures as part of routine care. Consent for recording included non-clinical purposes in 55/140 (39.3%) trusts/boards. Policies for surgeon/patient access to surgical video were available in 48/140 (34.3%) and 32/140 (22.9%) trusts/boards, respectively. Surgical video was used for non-clinical purposes in 64/140 (45.7%) trusts/boards. Governance policies covering surgical video recording, use, and/or storage were available from 59/140 (42.1%) trusts/boards.

Interpretation

There is significant heterogeneity in surgical video recording practices in England and Wales. A minority of trusts/boards routinely record surgical procedures, with large variation in recording/storage practices indicating scope for NHS-wide coordination. Revision of surgical video consent, accessibility, and governance policies should be prioritised by trusts/boards to protect key stakeholders. Increased availability of surgical video is essential for patients and surgeons to maximally benefit from the ongoing digital transformation of surgery.

Funding

KL is supported by an NIHR Academic Clinical Fellowship and acknowledges infrastructure support for this research from the National Institute for Health Research (NIHR) Imperial Biomedical Research Centre (BRC).

Enhancing surgical performance in cardiothoracic surgery with innovations from computer vision and artificial intelligence: a narrative review

When technical requirements are high, and patient outcomes are critical, opportunities for monitoring and improving surgical skills via objective motion analysis feedback may be particularly beneficial. This narrative review synthesises work on technical and non-technical surgical skills, collaborative task performance, and pose estimation to illustrate new opportunities to advance cardiothoracic surgical performance with innovations from computer vision and artificial intelligence. These technological innovations are critically evaluated in terms of the benefits they could offer the cardiothoracic surgical community, and any barriers to the uptake of the technology are elaborated upon. Like some other specialities, cardiothoracic surgery has relatively few opportunities to benefit from tools with data capture technology embedded within them (as is possible with robotic-assisted laparoscopic surgery, for example). In such cases, pose estimation techniques that allow for movement tracking across a conventional operating field without using specialist equipment or markers offer considerable potential. With video data from either simulated or real surgical procedures, these tools can (1) provide insight into the development of expertise and surgical performance over a surgeon's career, (2) provide feedback to trainee surgeons regarding areas for improvement, (3) provide the opportunity to investigate what aspects of skill may be linked to patient outcomes which can (4) inform the aspects of surgical skill which should be focused on within training or mentoring programmes. Classifier or assessment algorithms that use artificial intelligence to 'learn' what expertise is from expert surgical evaluators could further assist educators in determining if trainees meet competency thresholds. With collaborative efforts between surgical teams, medical institutions, computer scientists and researchers to ensure this technology is developed with usability and ethics in mind, the developed feedback tools could improve cardiothoracic surgical practice in a data-driven way.

Defining digital surgery: a SAGES white paper

BACKGROUND

Digital surgery is a new paradigm within the surgical innovation space that is rapidly advancing and encompasses multiple areas.

METHODS

This white paper from the SAGES Digital Surgery Working Group outlines the scope of digital surgery, defines key terms, and analyzes the challenges and opportunities surrounding this disruptive technology.

RESULTS

In its simplest form, digital surgery inserts a computer interface between surgeon and patient. We divide the digital surgery space into the following elements: advanced visualization, enhanced instrumentation, data capture, data analytics with artificial intelligence/machine learning, connectivity via telepresence, and robotic surgical platforms. We will define each area, describe specific terminology, review current advances as well as discuss limitations and opportunities for future growth.

CONCLUSION

Digital Surgery will continue to evolve and has great potential to bring value to all levels of the healthcare system. The surgical community has an essential role in understanding, developing, and guiding this emerging field.

Simulated cardiopulmonary bypass: a high fidelity model for developing and accessing clinical perfusion skills

BACKGROUND

Traditionally, novice perfusionists learn and practice clinical skills, during live surgical procedures. The profession's accrediting body is directing schools to implement simulated cardiopulmonary bypass (CPB) into the curriculum. Unfortunately, no CPB simulation models have been validated. Here we describe the design and application of a CPB simulation model.

METHODS

A CPB patient simulator was integrated into a representative operative theater and interfaced with a simple manikin, a heart-lung machine (HLM), clinical perfusion circuitry, and equipment. Participants completed a simulation scenario designed to represent a typical CPB procedure before completing an exit survey to assess the fidelity and validity of the experience. Questions were scored using a 5-point Likert scale.

RESULTS

Participants (n = 81) contributed 953 opinions on 40 questions. The participants reported that the model of simulated CPB (1) realistically presented both the physiologic and technical parameters seen during CPB (n = 347, mean 4.37, SD 0.86), (2) accurately represented the psychological constructs and cognitive mechanisms of the clinical CPB (n = 139, mean 4.24, SD 1.08), (3) requires real clinical skills and reproduces realistic surgical case progression (n = 167, mean 4.38, SD 0.86), and (4) would be effective for teaching, practicing, and assessing the fundamental skills of CPB (n = 300, mean 4.54, SD 0.9). Participants agreed that their performance in the simulation scenario accurately predicted their performance in a real clinical setting (n = 43, mean 4.07, SD 1.03) CONCLUSION: This novel simulation model of CPB reproduces the salient aspects of clinical CPB and may be useful for teaching, practicing, and assessing fundamental skills.

A novel high accuracy model for automatic surgical workflow recognition using artificial intelligence in laparoscopic totally extraperitoneal inguinal hernia repair (TEP)

INTRODUCTION

Artificial intelligence and computer vision are revolutionizing the way we perceive video analysis in minimally invasive surgery. This emerging technology has increasingly been leveraged successfully for video segmentation, documentation, education, and formative assessment. New, sophisticated platforms allow pre-determined segments chosen by surgeons to be automatically presented without the need to review entire videos. This study aimed to validate and demonstrate the accuracy of the first reported AI-based computer vision algorithm that automatically recognizes surgical steps in videos of totally extraperitoneal (TEP) inguinal hernia repair.

METHODS

Videos of TEP procedures were manually labeled by a team of annotators trained to identify and label surgical workflow according to six major steps. For bilateral hernias, an additional change of focus step was also included. The videos were then used to train a computer vision AI algorithm. Performance accuracy was assessed in comparison to the manual annotations.

RESULTS

A total of 619 full-length TEP videos were analyzed: 371 were used to train the model, 93 for internal validation, and the remaining 155 as a test set to evaluate algorithm accuracy. The overall accuracy for the complete procedure was 88.8%. Per-step accuracy reached the highest value for the hernia sac reduction step (94.3%) and the lowest for the preperitoneal dissection step (72.2%).

CONCLUSIONS

These results indicate that the novel AI model was able to provide fully automated video analysis with a high accuracy level. High-accuracy models leveraging AI to enable automation of surgical video analysis allow us to identify and monitor surgical performance, providing mathematical metrics that can be stored, evaluated, and compared. As such, the proposed model is capable of enabling data-driven insights to improve surgical quality and demonstrate best practices in TEP procedures.

Video Recording Patients for Direct Care Purposes: Systematic Review and Narrative Synthesis of International Empirical Studies and UK Professional Guidance

BACKGROUND

Video recordings of patients may offer advantages to supplement patient assessment and clinical decision-making. However, little is known about the practice of video recording patients for direct care purposes.

OBJECTIVE

We aimed to synthesize empirical studies published internationally to explore the extent to which video recording patients is acceptable and effective in supporting direct care and, for the United Kingdom, to summarize the relevant guidance of professional and regulatory bodies.

METHODS

Five electronic databases (MEDLINE, Embase, APA PsycINFO, CENTRAL, and HMIC) were searched from 2012 to 2022. Eligible studies evaluated an intervention involving video recording of adult patients (≥18 years) to support diagnosis, care, or treatment. All study designs and countries of publication were included. Websites of UK professional and regulatory bodies were searched to identify relevant guidance. The acceptability of video recording patients was evaluated using study recruitment and retention rates and a framework synthesis of patients' and clinical staff's perspectives based on the Theoretical Framework of Acceptability by Sekhon. Clinically relevant measures of impact were extracted and tabulated according to the study design. The framework approach was used to synthesize the reported ethico-legal considerations, and recommendations of professional and regulatory bodies were extracted and tabulated.

RESULTS

Of the 14,221 abstracts screened, 27 studies met the inclusion criteria. Overall, 13 guidance documents were retrieved, of which 7 were retained for review. The views of patients and clinical staff (16 studies) were predominantly positive, although concerns were expressed about privacy, technical considerations, and integrating video recording into clinical workflows; some patients were anxious about their physical appearance. The mean recruitment rate was 68.2% (SD 22.5%; range 34.2%-100%; 12 studies), and the mean retention rate was 73.3% (SD 28.6%; range 16.7%-100%; 17 studies). Regarding effectiveness (10 studies), patients and clinical staff considered video recordings to be valuable in supporting assessment, care, and treatment; in promoting patient engagement; and in enhancing communication and recall of information. Observational studies (n=5) favored video recording, but randomized controlled trials (n=5) did not demonstrate that video recording was superior to the controls. UK guidelines are consistent in their recommendations around consent, privacy, and storage of recordings but lack detailed guidance on how to operationalize these recommendations in clinical practice.

CONCLUSIONS

Video recording patients for direct care purposes appears to be acceptable, despite concerns about privacy, technical considerations, and how to incorporate recording into clinical workflows. Methodological quality prevents firm conclusions from being drawn; therefore, pragmatic trials (particularly in older adult care and the movement disorders field) should evaluate the impact of video recording on diagnosis, treatment monitoring, patient-clinician communication, and patient safety. Professional and regulatory documents should signpost to practical guidance on the implementation of video recording in routine practice.

TRIAL REGISTRATION

PROSPERO CRD42022331825: https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=331825.

The Future of Visual Documentation? Assessing the Use of Videography in Facial Plastic Surgery

Recent technological advancements in the field of portable electronics have facilitated the use of videography as a form of visual documentation in facial plastic surgery. Currently, the degree of video adoption and perceptions relating to its use in plastic surgery are not known. This study aimed to evaluate the current use, perceptions, and barriers regarding the adoption of video in the clinical practice of facial plastic surgery. A cross-sectional study of all American Academy of Facial Plastic and Reconstructive Surgery members was conducted through an e-mail-disseminated 24-item online survey. A total of 164 surgeons responded to the survey. Nearly all surgeons reported routinely employing photography for the documentation and marketing of surgical results. Fewer than 25% of respondents acknowledged using video to document surgical outcomes. Younger surgeons (<10 years in practice) and those in academic practices were significantly more likely to adopt videography (32 vs. 17%, p = 0.042 and 38 vs. 18%, p = 0.027, respectively). Most surgeons regarded video as the superior visual documentation format for dynamic facial expression and as being more difficult to deceptively manipulate. Most frequently cited barriers to adoption included time-consuming capture, file editing/storage requirements, and lack of clear standards. Videography holds favorable potential as the future format of visual documentation in facial plastic surgery due to its ability to capture the full range of dynamic facial expression. Establishing standards and setup guidelines for video capture will be essential in increasing its adoption.

SAGES video acquisition framework-analysis of available OR recording technologies by the SAGES AI task force

BACKGROUND

Surgical video recording provides the opportunity to acquire intraoperative data that can subsequently be used for a variety of quality improvement, research, and educational applications. Various recording devices are available for standard operating room camera systems. Some allow for collateral data acquisition including activities of the OR staff, kinematic measurements (motion of surgical instruments), and recording of the endoscopic video streams. Additional analysis through computer vision (CV), which allows software to understand and perform predictive tasks on images, can allow for automatic phase segmentation, instrument tracking, and derivative performance-geared metrics. With this survey, we summarize available surgical video acquisition technologies and associated performance analysis platforms.

METHODS

In an effort promoted by the SAGES Artificial Intelligence Task Force, we surveyed the available video recording technology companies. Of thirteen companies approached, nine were interviewed, each over an hour-long video conference. A standard set of 17 questions was administered. Questions spanned from data acquisition capacity, quality, and synchronization of video with other data, availability of analytic tools, privacy, and access.

RESULTS

Most platforms (89%) store video in full-HD (1080p) resolution at a frame rate of 30 fps. Most (67%) of available platforms store data in a Cloud-based databank as opposed to institutional hard drives. CV powered analysis is featured in some platforms: phase segmentation in 44% platforms, out of body blurring or tool tracking in 33%, and suture time in 11%. Kinematic data are provided by 22% and perfusion imaging in one device.

CONCLUSION

Video acquisition platforms on the market allow for in depth performance analysis through manual and automated review. Most of these devices will be integrated in upcoming robotic surgical platforms. Platform analytic supplementation, including CV, may allow for more refined performance analysis to surgeons and trainees. Most current AI features are related to phase segmentation, instrument tracking, and video blurring.

The Surgical Learning Curve: Does Robotic Technical Skill Explain Differences in Operative Performance?

Background: Prior studies on technical skills use small collections of videos for assessment. However, there is likely heterogeneity of performance among surgeons and likely improvement after training. If technical skill explains these differences, then it should vary among practicing surgeons and improve over time. Materials and Methods: Sleeve gastrectomy cases (n = 162) between July 2018 and January 2021 at one health system were included. Global evaluative assessment of robotic skills (GEARS) scores were assigned by crowdsourced evaluators. Videos were manually annotated. Analysis of variance was used to compare continuous variables between surgeons. Tamhane's post hoc test was used to define differences between surgeons with the eta-squared value for effect size. Linear regression was used for temporal changes. A P value <.05 was considered significant. Results: Variations in operative time discriminated between individuals (e.g., between 2 surgeons, means were 91 and 112 minutes, Tamhane's = 0.001). Overall, GEARS scores did not vary significantly (e.g., between those 2 surgeons, means were 20.32 and 20.6, Tamhane's = 0.151). Operative time and total GEARS score did not change over time (R² = 0.0001-0.096). Subcomponent scores showed idiosyncratic temporal changes, although force sensitivity increased among all (R² = 0.172-0.243). For a novice surgeon, phase-adjusted operative time (R² = 0.24), but not overall GEARS scores (R² = 0.04), improved over time. Conclusions: GEARS scores showed less variability and did not improve with time for a novice surgeon. Improved technical skill does not explain the learning curve of a novice surgeon or variation among surgeons. More work could define valid surrogate metrics for performance analysis.

Computer vision in surgery: from potential to clinical value

Hundreds of millions of operations are performed worldwide each year, and the rising uptake in minimally invasive surgery has enabled fiber optic cameras and robots to become both important tools to conduct surgery and sensors from which to capture information about surgery. Computer vision (CV), the application of algorithms to analyze and interpret visual data, has become a critical technology through which to study the intraoperative phase of care with the goals of augmenting surgeons' decision-making processes, supporting safer surgery, and expanding access to surgical care. While much work has been performed on potential use cases, there are currently no CV tools widely used for diagnostic or therapeutic applications in surgery. Using laparoscopic cholecystectomy as an example, we reviewed current CV techniques that have been applied to minimally invasive surgery and their clinical applications. Finally, we discuss the challenges and obstacles that remain to be overcome for broader implementation and adoption of CV in surgery.