Effect of individualized feedback on learning curves in EGD and colonoscopy: a cluster randomized controlled trial

Varied Trainee Competence in Cold Snare Polypectomy: Results of the COMPLETE Randomized Controlled Trial

INTRODUCTION

Cold snare polypectomy (CSP) is strongly recommended as the optimal technique for the complete removal of small polyps. Though significant variability in polypectomy technique and quality has been established, the learning curve and impact of targeted training on CSP are unknown. Video feedback has shown promise as an effective pedagogy to improve performance among surgical trainees. We aimed to compare CSP performance between trainees who received video-based feedback and those who received conventional apprentice-based concurrent feedback. We hypothesized that video-based feedback would accelerate competence.

METHODS

We conducted a single-blinded, randomized controlled trial on competence for CSP of polyps <1 cm, comparing video-based feedback with conventional feedback. We randomly assigned deidentified consecutively recorded CSP videos to blinded raters to assess using the CSP Assessment Tool. We shared cumulative sum learning curves every 25 CSP with each trainee. The video feedback trainees also received biweekly individualized terminal feedback. Control trainees received conventional feedback during colonoscopy. The primary outcome was CSP competence. We also assessed competence across domains and change over polypectomy volume.

RESULTS

We enrolled and randomized 22 trainees, 12 to video-based feedback and 10 to conventional feedback, and evaluated 2,339 CSP. The learning curve was long; 2 trainees (16.7%) in the video feedback achieved competence, after a mean of 135 polyps, and no one in the control ( P = 0.481) achieved competence. Overall and in all steps of CSP, a higher percentage of the video feedback group met competence, increasing 3% every 20 CSP ( P = 0.0004).

DISCUSSION

Video feedback aided trainees to competence in CSP. However, the learning curve was long. Our findings strongly suggest that current training methods are not sufficient to support trainees to competency by the completion of their fellowship programs. The impact of new training methods, such as simulation-based mastery learning, should be assessed to determine whether such methods can result in achievement of competence at a faster rate; ClinicalTrials.gov : NCT03115008.

Important Quality Metrics and Standardization in Endoscopy

Quality metrics and standardization has become critical as the Affordable Care Act mandates that the Center for Medicare and Medicaid Services change reimbursement from volume to a value-based system. While the most commonly used quality indicators are related to that of colonoscopy, quality metrics for other procedures and endoscopy units have been developed mainly by the American College of Gastroenterology and the American Society of Gastrointestinal Endoscopy. Data to show that these quality metrics, especially in the field of advanced endoscopy as well as in the era of COVID-19 pandemic, can improve patient outcomes, are anticipated.

Evaluating learning curves and competence in colorectal EMR among advanced endoscopy fellows: a pilot multicenter prospective trial using cumulative sum analysis

BACKGROUND AND AIMS

Data on colorectal EMR (C-EMR) training are lacking. We aimed to evaluate C-EMR training among advanced endoscopy fellows (AEFs) by using a standardized assessment tool (STAT).

METHODS

This multicenter prospective study used a STAT to grade AEF training in C-EMR during their 12-month fellowship. Cumulative sum analysis was used to establish learning curves and competence for cognitive and technical components of C-EMR and overall performance. Sensitivity analysis was performed by varying failure rates. AEFs completed a self-assessment questionnaire to assess their comfort level with performing C-EMR at the completion of their fellowship.

RESULTS

Six AEFs (189 C-EMRs; mean per AEF, 31.5 ± 18.5) were included. Mean polyp size was 24.3 ± 12.6 mm, and mean procedure time was 22.6 ± 16.1 minutes. Learning curve analyses revealed that less than 50% of AEFs achieved competence for key cognitive and technical C-EMR endpoints. All 6 AEFs reported feeling comfortable performing C-EMR independently at the end of their training, although only 2 of them achieved competence in their overall performance. The minimum threshold to achieve competence in these 2 AEFs was 25 C-EMRs.

CONCLUSIONS

A relatively low proportion of AEFs achieved competence on key cognitive and technical aspects of C-EMR during their 12-month fellowship. The relatively low number of C-EMRs performed by AEFs may be insufficient to achieve competence, in spite of their self-reported readiness for independent practice. These pilot data serve as an initial framework for competence threshold, and suggest the need for validated tools for formal C-EMR training assessment.