Bimodal assessment of laparoscopic suturing skills: construct and concurrent validity

Establishing Methods of Defect Closure in Roux-en-Y Gastric Bypass: an International Survey

INTRODUCTION

Internal herniation (IH) can be a life-threatening complication of Roux-en-Y gastric bypass (RYGB). Randomised controlled trials support the routine closure of mesenteric spaces at RYGB. However, there is currently no consensus on the method of closure in clinical practice. The purpose of this survey is to understand bariatric surgeons' practice in this regard.

METHODS

We conducted an international survey, whereby questions were created through collaboration of a consensus group of bariatric surgeons and hosted on the SurveyMonkey platform. The survey was distributed among British Obesity and Metabolic Surgery Society (BOMSS) members and international professional channels including The Upper Gastrointestinal Society (TUGS) and social media.

RESULTS

One hundred and thirty-six surgeons from 34 countries completed the survey. Of these, 49 respondents were UK-based surgeons with a cumulative experience of approximately 2500 RYGB per annum. Forty-five (91.8%) respondents reported always closing mesenteric defects, of whom 57.8% elected to use non-absorbable non-barbed sutures, followed by staples/clips in 28.9% and a selection of other methods. Most respondents used more than one method. A total of 2 UK and 14 non-UK participants reported never closing mesenteric spaces.

CONCLUSIONS

This survey has shown heterogeneity among defect closure and no consensus on preferred type. Additionally, there remains a practice of non-closure of mesenteric defects. We hope these findings help to inform further needed research and consensus building among experts.

Evaluation of minimally invasive surgical skills training: comparing a neonatal esophageal atresia/tracheoesophageal fistula model with a dry box

BACKGROUND

Pediatric surgeons require highly advanced minimally invasive surgical skills to perform rare and complex surgeries in a very vulnerable population. We developed a neonatal esophageal atresia (EA) model to improve thoracoscopic surgical skills. This study aimed to evaluate the concurrent validity of the model by undertaking pre- and post-training skills assessments in two groups of students with no prior experience performing minimally invasive surgery, using the EA model and a dry box (DB).

METHODS

A pilot study was performed. The participants were randomly divided into two groups: one trained using the DB and one trained using the EA model. Both groups practiced a minimally invasive surgical suture task. The task completion time, 29-point checklist score, modified suturing error sheet score, and three-dimensional forceps movement in both groups were compared pre-and post-training by video analysis.

RESULTS

The EA model task was significantly more difficult than that of the DB. Both groups showed significant improvement in the task time, 29-point checklist score, and modified suturing error sheet score; however, the EA model training was more efficient in improving each error item. Regarding forceps movement, the EA model training significantly decreased wasted motion, whereas the DB was limited in this regard.

CONCLUSIONS

Short-term training on the EA model, which was more technically demanding than the DB, decreased technical error and wasted motion, and allowed learners to acquire surgical skills more efficiently than training with the DB model. These facts revealed the concurrent validity of the EA model.

Endoscopic surgery suturing techniques: a randomized study on learning

BACKGROUND

Surgeons have widely adopted endoscopic suturing techniques using conventional laparoscopic instruments and the more advanced robotic systems. The FlexDex is a novel articulating laparoscopic needle driver providing enhanced dexterity in laparoscopic surgery. This study evaluates and compares the learning curve of endoscopic suturing with conventional laparoscopy, the FlexDex and robotic suturing in novices.

METHODS

Participants performed a minimal invasive suturing task in three different ways in a randomized order: with a conventional laparoscopic needle driver, using the FlexDex needle driver and third, using the Da Vinci Si surgical system. Primary outcome was suturing task time. Secondary outcome parameters were assessment of suturing quality and workload perception.

RESULTS

A total of 10 novice participants were included and completed a total of 300 sessions. Median (IQR) suturing time of the first 5 sessions was 231 s (188-291) in the laparoscopic group versus 378 s (282-471) in the FlexDex group versus 189 s (160-247) in the DaVinci Si group. The last 5 sessions showed significant reduction of median suturing time of 143 s (120-190), 232 s (180-265) and 172 s (134-199) respectively. Analysis identified that the learning curve for the laparoscopic needle driver and Da Vinci Si was reached in 5 sessions, compared to 8 sessions for the Flexdex. The laparoscopic needle driver and Da Vinci Si showed a significant shorter median suturing time compared to the FlexDex (p = 0.00). The FlexDex quality assessment scores were significantly lower compared to the laparoscopic (p = 0.00) and robotic (p = 0.00) scores and perceived workload remains high for the FlexDex users.

CONCLUSIONS

Ex vivo endoscopic suturing with the FlexDex demonstrated a prolonged learning curve compared to laparoscopic and robotic suturing. The learning curve of the FlexDex is fundamentally different from conventional laparoscopic and robotic instruments. This study provides further insights in the implementation and training of endoscopic suturing techniques.

Motion analysis for better understanding of psychomotor skills in laparoscopy: objective assessment-based simulation training using animal organs

Background

Our aim was to characterize the motions of multiple laparoscopic surgical instruments among participants with different levels of surgical experience in a series of wet-lab training drills, in which participants need to perform a range of surgical procedures including grasping tissue, tissue traction and dissection, applying a Hem-o-lok clip, and suturing/knotting, and digitize the level of surgical competency.

Methods

Participants performed tissue dissection around the aorta, dividing encountered vessels after applying a Hem-o-lok (Task 1), and renal parenchymal closure (Task 2: suturing, Task 3: suturing and knot-tying), using swine cadaveric organs placed in a box trainer under a motion capture (Mocap) system. Motion-related metrics were compared according to participants’ level of surgical experience (experts: 50 ≤ laparoscopic surgeries, intermediates: 10–49, novices: 0–9), using the Kruskal–Wallis test, and significant metrics were subjected to principal component analysis (PCA).

Results

A total of 15 experts, 12 intermediates, and 18 novices participated in the training. In Task 1, a shorter path length and faster velocity/acceleration/jerk were observed using both scissors and a Hem-o-lok applier in the experts, and Hem-o-lok-related metrics markedly contributed to the 1st principal component on PCA analysis, followed by scissors-related metrics. Higher-level skills including a shorter path length and faster velocity were observed in both hands of the experts also in tasks 2 and 3. Sub-analysis showed that, in experts with 100 ≤  cases, scissors moved more frequently in the “close zone (0  ≤ to < 2.0 cm from aorta)” than those with 50–99 cases.

Conclusion

Our novel Mocap system recognized significant differences in several metrics in multiple instruments according to the level of surgical experience. “Applying a Hem-o-lok clip on a pedicle” strongly reflected the level of surgical experience, and zone-metrics may be a promising tool to assess surgical expertise. Our next challenge is to give completely objective feedback to trainees on-site in the wet-lab.

Electronic supplementary material

The online version of this article (10.1007/s00464-020-07940-7) contains supplementary material, which is available to authorized users.

Competency assessment tool for laparoscopic suturing: development and reliability evaluation

BACKGROUND

Laparoscopic suturing can be technically challenging and requires extensive training to achieve competency. To date no specific and objective assessment method for laparoscopic suturing and knot tying is available that can guide training and monitor performance in these complex surgical skills. In this study we aimed to develop a laparoscopic suturing competency assessment tool (LS-CAT) and assess its inter-observer reliability.

METHODS

We developed a bespoke CAT tool for laparoscopic suturing through a structured, mixed methodology approach, overseen by a steering committee with experience in developing surgical assessment tools. A wide Delphi consultation with over twelve experts in laparoscopic surgery guided the development stages of the tool. Following, subjects with different levels of laparoscopic expertise were included to evaluate this tool, using a simulated laparoscopic suturing task which involved placing of two surgical knots. A research assistant video recorded and anonymised each performance. Two blinded expert surgeons assessed the anonymised videos using the developed LS-CAT. The LS-CAT scores of the two experts were compared to assess the inter-observer reliability. Lastly, we compared the subjects' LS-CAT performance scores at the beginning and end of their learning curve.

RESULTS

This study evaluated a novel LS-CAT performance tool, comprising of four tasks. Thirty-six complete videos were analysed and evaluated with the LS-CAT, of which the scores demonstrated excellent inter-observer reliability. Cohen's Kappa analysis revealed good to excellent levels of agreement for almost all tasks of both instrument handling and tissue handling (0.87; 0.77; 0.75; 0.86; 0.85, all with p < 0.001). Subjects performed significantly better at the end of their learning curve compared to their first attempt for all LS-CAT items (all with p < 0.001).

CONCLUSIONS

We developed the LS-CAT, which is a laparoscopic suturing grading matrix, with excellent inter-rater reliability and to discriminate between experience levels. This LS-CAT has a potential for wider use to objectively assess laparoscopic suturing skills.

Perceptions and experience of veterinary surgery residents with minimally invasive surgery simulation training

OBJECTIVE

To determine access to and use of minimally invasive surgery (MIS) simulators among American College of Veterinary Surgeons (ACVS) small animal residents and to identify barriers to simulator use and perceptions of simulator training.

STUDY DESIGN

Voluntary online survey.

SAMPLE POPULATION

One hundred forty-one ACVS small animal residents.

METHODS

American College of Veterinary Surgeons residents were identified by contacting ACVS residency program directors. An emailed online survey was sent to residents along with a reminder email 2 weeks later. All surveys were collected within 1 month. Participation was voluntary but incentivized.

RESULTS

Response rate to the survey was 79 of 141 (56%) residents. Twenty-eight of 77 (36%) residents have access to a simulator, with box simulators being most common. Lack of time was the most frequent reason for not using the simulator more. Sixty-eight of 77 (88%) and 65 of 77 (65%) residents agreed or strongly agreed that simulator-based training improves laparoscopic skills and that simulator skills are transferable to the operating room, respectively. Residents with access to a simulator were more comfortable with basic laparoscopic surgeries at the end of their residency than those without such access (P = .04).

CONCLUSION

There is substantial room for improved access to and use of MIS simulator training in ACVS residency programs. Despite lack of simulator access, residents believed that simulator training improved their skill and comfort level with basic laparoscopic procedures.

CLINICAL SIGNIFICANCE

The results of this study inform us about access to and perceptions of MIS simulator training among residents. This information is important to surgeons responsible for training residents and may help guide the creation of a surgical skills curriculum.

Simulation platforms to assess laparoscopic suturing skills: a scoping review

BACKGROUND

Laparoscopic suturing (LS) has become a common technique used in a variety of advanced laparoscopic procedures. However, LS is a challenging skill to master, and many trainees may not be competent in performing LS at the end of their training. The purpose of this review is to identify simulation platforms available for assessment of LS skills, and determine the characteristics of the platforms and the LS skills that are targeted.

METHODS

A scoping review was conducted between January 1997 and October 2018 for full-text articles. The search was done in various databases. Only articles written in English or French were included. Additional studies were identified through reference lists. The search terms included "laparoscopic suturing" and "clinical competence."

RESULTS

Sixty-two studies were selected. The majority of the simulation platforms were box trainers with inanimate tissue, and targeted basic suturing and intracorporeal knot-tying techniques. Most of the validation came from internal structure (rater reliability) and relationship to other variables (compare training levels/case experience, and various metrics). Consequences were not addressed in any of the studies.

CONCLUSION

We identified many types of simulation platforms that were used for assessing LS skills, with most being for assessment of basic skills. Platforms assessing the competence of trainees for advanced LS skills were limited. Therefore, future research should focus on development of LS tasks that better reflect the needs of the trainees.

TEACHING MODEL FOR EVALUATION OF THE ABILITY AND COMPETENCE PROGRESS IN ENDOSUTURE IN SURGICAL SKILL LABORATORY

Background:

Laparoscopic manual suturing is probably the most difficult skill to be acquired in minimally invasive surgery. However, laparoscopic exercise endo-sutures can be learned with a simulator and are of great practical importance and clinical applicability, absorbing concepts that are immediately transferred to the operating room.

Aim:

To assess the progression of skills competence in endo-sutures through realistic simulation model of systematized education.

Method:

Evaluation of the progression of competence of students in three sequential stages of training in realistic simulation, pre-test (V.1), teaching concepts (V.2) and training station for absorption of video concepts in surgery - ergonomics, stereotaxia, ambidexterity, haptic touch, fucral effect, applied in the manufacture of points corresponding to a Nissen fundoplication, in endo-suture for realistic simulation.

Results:

All students who attended the course absorbed the video concepts in surgery; most participants showed steady and continued improvement and during the stages of training, obtained progression of appropriate skills, defining competence and validation of the teaching model to achieve proficiency.

Conclusions:

The teaching model was adequate, safe, revealed the profile of the student, the evolutionary powers of the endo-sutures performance and critical analysis of the training to achieve proficiency in bariatric procedures.

Development of a technical checklist for the assessment of suturing in robotic surgery

BACKGROUND

With the increased use of simulation for surgical training, there is a need for objective forms of assessment to evaluate trainees. The Global Evaluative Assessment of Robotic Skills (GEARS) is widely used for assessing skills in robotic surgery, but there are no recognised checklist scoring systems. This study aimed to develop a checklist for suturing in robotic surgery.

METHODS

A suturing checklist for needle driving and knot tying was constructed following evaluation of participants performing urethrovesical anastomoses. Key procedural steps were identified from expert videos, while assessing novice videos allowed identification of common technical errors. 22 novice and 13 expert videos were marked on needle driving, while 18 novices and 10 experts were assessed on knot tying. Validation of the finalised checklist was performed with the assessment of 39 separate novices by an expert surgeon and compared to GEARS scoring.

RESULTS

The internal consistency of the preliminary checklist was high (Cronbach's alpha = 0.870 for needle driving items; 0.736 for knot tying items), and after removal of poorly correlating items, the final checklist contained 23 steps. Both the needle driving and knot tying categories discriminated between novices and experts, p < 0.005. While the GEARS score demonstrated construct validity for needle driving, it could not significantly differentiate between novices and experts for knot tying, p = 0.286. The needle driving category significantly correlated with the corresponding GEARS scores (r_s = 0.613, p < 0.005), but the correlation for knot tying was insignificant (r_s = 0.296, p = 0.127). The pilot data indicates the checklist significantly correlated with the GEARS score (p < 0.005).

CONCLUSION

This study reports the development of a valid assessment tool for suturing in robotic surgery. Given that checklists are simple to use, there is significant scope for this checklist to be used in surgical training.

A scoping review of assessment tools for laparoscopic suturing

BACKGROUND

A needs assessment identified a gap in teaching and assessment of laparoscopic suturing (LS) skills. The purpose of this review is to identify assessment tools that were used to assess LS skills, to evaluate validity evidence available, and to provide guidance for selecting the right assessment tool for specific assessment conditions.

METHODS

Bibliographic databases were searched till April 2017. Full-text articles were included if they reported on assessment tools used in the operating room/simulation to (1) assess procedures that require LS or (2) specifically assess LS skills.

RESULTS

Forty-two tools were identified, of which 26 were used for assessing LS skills specifically and 26 for procedures that require LS. Tools had the most evidence in internal structure and relationship to other variables, and least in consequences.

CONCLUSION

Through identification and evaluation of assessment tools, the results of this review could be used as a guideline when implementing assessment tools into training programs.

Laparoscopic Suturing as a Barrier to Broader Adoption of Laparoscopic Surgery

BACKGROUND

Laparoscopic surgery is increasingly replacing the open procedure because of its many patient-related benefits that are well aligned with policies and programs that seek to optimize health system performance. However, widespread adoption of laparoscopic surgery has been slow, in part, because of the complexity of laparoscopic suturing. The objective of this study was to review the clinical and economic impacts of laparoscopic suturing in key procedures and to assess its role as a barrier to the broader adoption of laparoscopic surgery.

DATABASE

A medical literature search of MEDLINE, EMBASE, and BIOSIS from January 2010 through June 2016 identified 47 relevant articles.

CONCLUSION

Laparoscopic suturing and intracorporeal knot tying may result in extended surgical time, complications, and surgeon errors, while improving patient quality of life through improved cosmesis, diet toleration, and better bowel movements. Despite advancement in surgical techniques and the availability of newer surgical tools, the complexity of laparoscopic suturing continues to be a barrier to greater adoption of MIS. The results of the study underscore the need for development of proficiency in laparoscopic suturing, which may help improve patient outcomes and reduce healthcare costs.

Virtual reality does not meet expectations in a pilot study on multimodal laparoscopic surgery training

BACKGROUND

The purpose of the present study was to determine the value of virtual reality (VR) training for a multimodality training program of basic laparoscopic surgery.

MATERIALS AND METHODS

Participants in a two-day multimodality training for laparoscopic surgery used box trainers, live animal training, and cadaveric training on the pulsating organ perfusion (POP) trainer in a structured and standardized training program. The participants were divided into two groups. The VR group (n = 13) also practiced with VR training during the program, whereas the control group (n = 14) did not use VR training. The training modalities were assessed using questionnaires with a five-point Likert scale after the program. Concerning VR training, members of the control group assessed their expectations, whereas the VR group assessed the actual experience of using it. Skills performance was evaluated with five standardized test tasks in a live porcine model before (pre-test) and after (post-test) the training program. Laparoscopic skills were measured by task completion time and a general performance score for each task. Baseline tests were compared with laparoscopic experience of all participants for construct validity of the skills test.

RESULTS

The expected benefit from VR training of the control group was higher than the experienced benefit of the VR group. Box and POP training received better ratings from the VR group than from the control group for some purposes. Both groups improved their skill parameters significantly from pre-training to post-training tests [score +17 % (P < 0.01), time -29 % (P < 0.01)]. No significant difference was found between the two groups for laparoscopic skills improvement except for the score in the instrument coordination task. Construct validity of the skills test was significant for both time and score.

CONCLUSIONS

At its current level of performance, VR training does not meet expectations. No additional benefit was observed from VR training in our multimodality training program.

Laparoscopic suturing skills acquisition: a comparison between laparoscopy-exposed and laparoscopy-naive surgeons

This study suggests that training improves laparoscopic suturing skills in experienced as well as inexperienced laparoscopic surgeons.

Background:

Laparoscopic suturing is a difficult skill to master but can be acquired with extensive training outside the operating room. This study was done with the primary aim of assessing whether prior exposure to laparoscopic surgery helped trainees in acquiring laparoscopic suturing skills more quickly than trainees with no prior exposure to laparoscopic surgery.

Materials and Methods:

Twenty laparoscopy-exposed and 20 laparoscopy-naïve surgeons performed 5 laparoscopic gastrojejunostomies each on a phantom porcine model. The performance was evaluated for operation time, overall anastomotic score (calculated by adding scores of anastomotic leak, size of the anastomosis, suture placement, and mucosal approximation), and the level of difficulty. The performance at the beginning of training (baseline) was compared to the performance at the end of training.

Results:

All participants showed statistically significant improvement in operation time, overall anastomotic score, and difficulty level. Laparoscopy-exposed surgeons had a significantly better operation time than laparoscopy-naïve surgeons at the beginning of training; however, the difference became insignificant by the end of training. The difference in overall anastomotic score was not significant between laparoscopy-exposed and naïve-surgeons. Laparoscopy-exposed surgeons showed significant improvements in anastomotic leak rate and size of the anastomosis, whereas laparoscopy naïve surgeons showed improvements in all the parameters, although these were not significant statistically.

Conclusion:

Training improves the laparoscopic suturing skills of laparoscopy-exposed as well as laparoscopy-naïve surgeons. Prior experience in laparoscopic surgery does not seem to influence the acquisition of laparoscopic suturing skills as laparoscopic-naïve surgeons manage to catch up with the skills of the laparoscopy-exposed surgeons.

Is motion analysis a valid tool for assessing laparoscopic skill?

BACKGROUND

The use of simulation for laparoscopic training has led to the development of objective tools for skills assessment. Motion analysis represents one area of focus. This study was designed to assess the evidence for the use of motion analysis as a valid tool for laparoscopic skills assessment.

METHODS

Embase, MEDLINE and PubMed were searched using the following domains: (1) motion analysis, (2) validation and (3) laparoscopy. Studies investigating motion analysis as a tool for assessment of laparoscopic skill in general surgery were included. Common endpoints in motion analysis metrics were compared between studies according to a modified form of the Oxford Centre for Evidence-Based Medicine levels of evidence and recommendation.

RESULTS

Thirteen studies were included from 2,039 initial papers. Twelve (92.3 %) reported the construct validity of motion analysis across a range of laparoscopic tasks. Of these 12, 5 (41.7 %) evaluated the ProMIS Augmented Reality Simulator, 3 (25 %) the Imperial College Surgical Assessment Device (ICSAD), 2 (16.7 %) the Hiroshima University Endoscopic Surgical Assessment Device (HUESAD), 1 (8.33 %) the Advanced Dundee Endoscopic Psychomotor Tester (ADEPT) and 1 (8.33 %) the Robotic and Video Motion Analysis Software (ROVIMAS). Face validity was reported by 1 (7.7 %) study each for ADEPT and ICSAD. Concurrent validity was reported by 1 (7.7 %) study each for ADEPT, ICSAD and ProMIS. There was no evidence for predictive validity.

CONCLUSIONS

Evidence exists to validate motion analysis for use in laparoscopic skills assessment. Valid parameters are time taken, path length and number of hand movements. Future work should concentrate on the conversion of motion data into competency-based scores for trainee feedback.

Program for laparoscopic urologic skills: a newly developed and validated educational program

OBJECTIVE

To develop and evaluate a program for laparoscopic urologic skills (PLUS) to determine the face, content, and construct validation to achieve uniformity and standardization in training residents in urology.

METHODS

The PLUS consists of 5 basic laparoscopic tasks. Three tasks were abstracted from the Fundamentals of Laparoscopic Surgery program, and 2 additional tasks were developed under continuous evaluation by expert urologists. Fifty participants were recruited from different hospitals and performed the final PLUS training. They all completed a questionnaire after performance. Three outcome parameters were measured: performance quality, time, and dropped objects. The relationship between laparoscopic experience and the outcome parameters was investigated.

RESULTS

Of the 50 participants, 13 were students, 20 were residents, and 17 were urologists. Double-log linear regression analysis for all 5 tasks showed a significant effect (effect size range 0.53-0.82; P < .0005) for laparoscopic experience on performance time. Substantial correlations were found between experience and quality ratings (log-linear regression effect size 0.37; P = .012) and the number of dropped objects (Spearman correlation effect size 0.49; P < .01). The usefulness of the PLUS model as a training tool for basic laparoscopic skills was rated 4.55 on a scale from 1 (not useful) to 5 (useful) (standard deviation 0.58; range 3-5).

CONCLUSION

The results of the present study indicated the face, content, and construct validity for the PLUS. The training is considered appropriate for use as a primary training tool for an entry test or as part of a step-wise training program in which basic and procedural laparoscopic skills are integrated.

Feasibility of self-appraisal in assessing operative performance in advanced laparoscopic colorectal surgery

AIM

To date there has been no attempt to assess comprehensively generic and specific technical skills in live advanced laparoscopic colorectal surgery. In this study, we aim to develop and validate a new tool which can assess these skills.

METHOD

Weighted Likert scales were constructed individually for generic and specific technical skills on three key laparoscopic colorectal operations: right hemicolectomy, sigmoid colectomy and anterior resection, after expert discussions.

RESULTS

Fifty-two live operations were assessed, performed by four consultants and six trainees. The interclass correlation coefficient between the operating surgeon and first assistant was 0.94, P ≤ 0.05 for generic technical skills and 0.88, P ≤ 0.05 for the specific technical skills. Construct validity for both generic and specific technical skills for consultants and trainees were significant using ANOVA, P ≤ 0.05.

CONCLUSION

This new assessment tool of technical skills in laparoscopic colorectal surgery is reliable, has face content, concurrent and construct validities. The tool could be used as an instant surgical training tool and avoids watching videos retrospectively.

Objective assessment of laparoscopic suturing skills using a motion-tracking system

BACKGROUND

Laparoscopic suturing skills are important for advanced laparoscopic surgery. However, objective assessment of these skills has not yet been established. The aim of this study was to assess the laparoscopic suturing skills of novice and experienced surgeons using an electromagnetic motion-tracking system.

METHODS

A total of 18 surgeons, who were all right-handed, were divided into the following two groups according to their experience as an operator in laparoscopic surgery: 9 novice surgeons (fewer than 10 laparoscopic procedures) and 9 experienced surgeons (more than 50 laparoscopic procedures). The subjects performed an intracorporeal suturing task in an inanimate box laparoscopic trainer while the movements of their forceps were evaluated using an electromagnetic motion-tracking system. Their laparoscopic skills were assessed on the basis of the time, path length, and average speed of the forceps in each hand.

RESULTS

Experienced surgeons completed the suturing task significantly faster than novice surgeons did. The left path length was significantly shorter for experienced surgeons than for novice surgeons, whereas the right path lengths did not differ. The right average speed of knot tying was significantly faster for experienced surgeons than for novice surgeons, whereas the left average speeds did not differ.

CONCLUSIONS

Evaluation of psychomotor skills in laparoscopic suturing using an electromagnetic motion-tracking system revealed better results for experienced surgeons than for novice surgeons in terms of the time taken, left path length, and right speed of knot-tying. Furthermore, surgical proficiency due to experience can affect surgical dexterity of each hand differently. The present study also demonstrates the efficacy of this system for objective evaluation of laparoscopic suturing skills.

Objective classification of residents based on their psychomotor laparoscopic skills

Background

From the clinical point of view, it is important to recognize residents’ level of expertise with regard to basic psychomotor skills. For that reason, surgeons and surgical organizations (e.g., Acreditation Council for Graduate Medical Education, ACGME) are calling for assessment tools that credential residents as technically competent. Currently, no method is universally accepted or recommended for classifying residents as “experienced,” “intermediates,” or “novices” according to their technical abilities. This study introduces a classification method for recognizing residents’ level of experience in laparoscopic surgery based on psychomotor laparoscopic skills alone.

Methods

For this study, 10 experienced residents (>100 laparoscopic procedures performed), 10 intermediates (10–100 procedures performed), and 11 novices (no experience) performed four tasks in a box trainer. The movements of the laparoscopic instruments were recorded with the TrEndo tracking system and analyzed using six motion analysis parameters (MAPs). The MAPs of all participants were submitted to principal component analysis (PCA), a data reduction technique. The scores of the first principal components were used to perform linear discriminant analysis (LDA), a classification method. Performance of the LDA was examined using a leave-one-out cross-validation.

Results

Of 31 participants, 23 were classified correctly with the proposed method, with 7 categorized as experienced, 7 as intermediates, and 9 as novices.

Conclusions

The proposed method provides a means to classify residents objectively as experienced, intermediate, or novice surgeons according to their basic laparoscopic skills. Due to the simplicity and generalizability of the introduced classification method, it is easy to implement in existing trainers.

Construct validity of the ProMIS laparoscopic simulator

BACKGROUND

Laparoscopic surgery challenges both the surgical novice and experienced open surgeon with unique psychomotor adaptations. Surgical skills assessment has historically relied on subjective opinion and case experience. Objective performance metrics have stimulated much interest in surgical education over the last decade and proficiency-based simulation has been proposed as a paradigm shift in surgical skills training. New assessment tools must be subjected to scientific validation. This study examined the construct validity of a hybrid laparoscopic simulator with in-built motion tracking technology.

METHODS

Volunteers were recruited from four experience groups (consultant surgeon, senior trainee, junior trainee, medical student). All subjects completed questionnaires and three tasks on the ProMIS laparoscopic simulator (laparoscope orientation, object positioning, sharp dissection). Motion analysis data was obtained via optical tracking of instrument movements. Objective metrics included time, path length (economy of movement), smoothness (controlled handling) and observer-recorded penalty scores.

RESULTS

One hundred and sixty subjects completed at least one of the three tasks. Significant group differences were confirmed for number of years qualified, age and case experience. Significant differences were found between experts and novices in all three tasks. Sharp dissection was the strongest discriminator of four recognised laparoscopic skill groups: consultants outperformed students and juniors in all three performance metrics and objective penalty score (p < 0.05), and only accuracy of dissection did not distinguish them from senior trainees (p = 0.261). Seniors dissected faster, more efficiently and more accurately than juniors and students (p < 0.05).

CONCLUSIONS

ProMIS provides a construct valid laparoscopic simulator and is a feasible tool to assess skills in a cross-section of surgical experience groups. ProMIS has the potential to objectively measure pre-theatre dexterity practice until an agreed proficiency level of dexterity is achieved. Future work should now examine whether training to expert criterion levels on ProMIS correlates with actual operative performance.