A117 VALIDITY EVIDENCE FOR ENDOSCOPIC RETROGRADE CHOLANGIOPANCREATOGRAPHY COMPETENCY ASSESSMENT TOOLS: A SYSTEMATIC REVIEW

Background

Assessment of competence in endoscopic retrograde cholangiopancreatography (ERCP) is essential to ensure trainees possess the skills needed for independent practice. Traditionally, ERCP training has used the apprenticeship model, whereby novices learn skills under the supervision of an expert. A growing focus on procedural quality, however, has supported the implementation of competency-based medical education models which require documentation of a trainee’s competence for independent practice. Observational assessment tools with strong evidence of validity are critical to this process. Validity evidence supporting ERCP observational assessment tools has not been systematically evaluated.

Purpose

To conduct a systematic review of ERCP assessment tools and identify tools with strong evidence of validity using a unified validity evidence framework

Method

We conducted a systematic search using electronic databases and hand-searching from inception until August 2021 for studies evaluating observational assessment tools of ERCP performance. We used a unified validity framework to characterize validity evidence from five sources: content, response process, internal structure, relations to other variables, and consequences. Each domain was assigned a score of 0-3 (maximum score 15). We assessed educational utility and methodological quality using the Accreditation Council for Graduate Medical Education framework and the Medical Education Research Quality Instrument, respectively.

Result(s)

From 2769 records, we included 17 studies evaluating 7 assessment tools. Five tools were studied for clinical ERCP, one on simulated ERCP, and one on simulated and clinical ERCP. Validity evidence scores ranged from 2-12. The Bethesda ERCP Skills Assessment Tool (BESAT), ERCP Direct Observation of Procedural Skills Tool (ERCP DOPS), and The Endoscopic Ultrasound (EUS) and ERCP Skills Assessment Tool (TEESAT) had the strongest validity evidence with scores of 10, 12, and 11, respectively. Regarding educational utility, most tools were easy to use and interpret, and required minimal additional resources. Overall methodological quality was strong, with scores ranging from 10-12.5 (maximum 13.5).

Conclusion(s)

The BESAT, ERCP DOPS, and TEESAT have strong validity evidence compared to other assessments. Integrating tools into training may help drive learners’ development and support competency decision-making.

Please acknowledge all funding agencies by checking the applicable boxes below

CAG

Disclosure of Interest

None Declared

Status of Competency-Based Medical Education in Endoscopy Training: A Nationwide Survey of US ACGME-Accredited Gastroenterology Training Programs

OBJECTIVES

The Accreditation Council for Graduate Medical Education (ACGME) emphasizes the importance of medical trainees meeting specific performance benchmarks and demonstrating readiness for unsupervised practice. The aim of this study was to examine the readiness of Gastroenterology (GI) fellowship programs for competency-based evaluation in endoscopic procedural training.

METHODS

ACGME-accredited GI program directors (PDs) and GI trainees nationwide completed an online survey of domains relevant to endoscopy training and competency assessment. Participants were queried about current methods and perceived quality of endoscopy training and assessment of competence. Participants were also queried about factors deemed important in endoscopy competence assessment. Five-point Likert items were analyzed as continuous variables by an independent t-test and χ(2)-test was used for comparison of proportions.

RESULTS

Survey response rate was 64% (94/148) for PDs and 47% (546/1,167) for trainees. Twenty-three percent of surveyed PDs reported that they do not have a formal endoscopy curriculum. PDs placed less importance (1—very important to 5—very unimportant) on endoscopy volume (1.57 vs. 1.18, P<0.001), adenoma detection rate (2.00 vs. 1.53, P<0.001), and withdrawal times (1.96 vs. 1.68, P=0.009) in determining endoscopy competence compared with trainees. A majority of PDs report that competence is assessed by procedure volume (85%) and teaching attending evaluations (96%). Only a minority of programs use skills assessment tools (30%) or specific quality metrics (28%). Specific competencies are mostly assessed by individual teaching attending feedback as opposed to official documentation or feedback from a PD. PDs rate the overall quality of their endoscopy training and assessment of competence as better than overall ratings by trainees.

CONCLUSIONS

Although the majority of PDs and trainees nationwide believe that measuring specific metrics is important in determining endoscopy competence, most programs still rely on procedure volume and subjective attending evaluations to determine overall competence. As medical training transitions from an apprenticeship model to competency-based education, there is a need for improved endoscopy curricula which are better suited to demonstrate readiness for unsupervised practice.

Endoscopic ultrasound as an adjunctive evaluation in patients with esophageal motor disorders subtyped by high-resolution manometry

BACKGROUND

Esophageal motor disorders are a heterogeneous group of conditions identified by esophageal manometry that lead to esophageal dysfunction. The aim of this study was to assess the clinical utility of endoscopic ultrasound (EUS) in the further evaluation of patients with esophageal motor disorders categorized using the updated Chicago Classification.

METHODS

We performed a retrospective, single center study of 62 patients with esophageal motor disorders categorized according to the Chicago Classification. All patients underwent standard radial endosonography to assess for extra-esophageal findings or alternative explanations for esophageal outflow obstruction. Secondary outcomes included esophageal wall thickness among the different patient subsets within the Chicago Classification.

KEY RESULTS

EUS identified 9/62 (15%) clinically relevant findings that altered patient management and explained the etiology of esophageal outflow obstruction. We further identified substantial variability in esophageal wall thickness in a proportion of patients including some with a significantly thickened non-muscular layer.

CONCLUSIONS & INFERENCES

EUS findings are clinically relevant in a significant number of patients with motor disorders and can alter clinical management. Variability in esophageal wall thickness of the muscularis propria and non-muscular layers identified by EUS may also explain the observed variability in response to standard therapies for achalasia.

[The three-dimensional spiral scanner and volume rendering technique: importance in craniofacial traumatology and reconstructive surgery]

There are two reconstruction methods for 3D imaging with a helical scanner: a surface rendering process providing a 3D-SSD (Surface Shaded Display) image that looks like a plaster cast skull and 3D-VRD (Volume Rendering Technique) which is more precise and gives 3D images similar to radiographs. We review briefly the techniques used to acquire these images and present 3D volume-rendering scanners, pointing out its usefulness in craniomaxillofacial traumatology and reconstructive surgery.

The crossed femoral nerve stretch test to improve diagnostic sensitivity for the high lumbar radiculopathy: 2 case reports

The femoral nerve stretch test (FNST) is commonly used to assess high lumbar radiculopathy. It may be falsely positive secondary to tight or injured muscles of the anterior thigh, and to osseous or joint pathology in and about the hip. We report on the crossed FNST, which may improve the specificity of the FNST. Two cases that occurred within 2 months are presented. The physical examinations suggested high lumbar radiculopathy, which was confirmed by both the FNST and crossed FNST. The crossed FNST may thus be a valuable screening test that further supports a diagnosis of upper lumbar radiculopathy. Further study is necessary to identify its prevalence in the assessment of the high lumbar radiculopathy.

Long-term enhancement of botulinum toxin injections by upper-eyelid surgery in 14 patients with facial dyskinesias

OBJECTIVES

To determine the effects of upper-eyelid surgery (limited myectomy, blepharoplasty, and levator aponeurotic advancement) on patients who demonstrated a suboptimal response or residual heaviness of the upper eyelids after botulinum toxin eyelid injections for facial dyskinesia.

DESIGN

Retrospective study.

SUBJECTS

Charts of 358 patients with a diagnosis of benign essential blepharospasm, Meige syndrome (with eyelid involvement), and hemifacial spasm were reviewed.

METHODS

Data were retrospectively analyzed and included subjective and objective responses about botulinum toxin injections (number and duration of effect of injections before and after eyelid surgery).

RESULTS

Of 358 patients with facial dyskinesias, 14 (3.91%) underwent upper-eyelid limited myectomy with or without upper-lid blepharoplasty (n = 5), upper-lid blepharoplasty alone (n = 6), or levator advancement with or without blepharoplasty (n = 3). Mean subjective improvement was 68.75% after limited myectomy combined with blepharoplasty and 58.33% after levator and/or blepharoplasty surgery. Average duration of effect of injections increased from 122.1 days in the patients prior to undergoing eyelid surgery to 210.5 days after surgery.

CONCLUSIONS

Upper-eyelid surgery, including limited myectomy, enhanced the effect of the botulinum toxin in this small group of patients. Patients with a suboptimal response to injections in terms or moderate to marked dermatochalasis with subjective heaviness of the eyelids, upper-eyelid blepharoplasty, and/or limited myectomy should be considered.