How Surgeons Conceptualize Talent: A Qualitative Study Using Sport Science as a Lens

Development and validation of an objective virtual reality tool for assessing technical aptitude among potential candidates for surgical training

BACKGROUND

Good technical skills are crucial for surgeons. Yet although surgical training programs strive to assess technical aptitude when selecting surgical residents, valid assessments of such aptitude are still lacking. Surgical simulators have been proposed as a potentially effective tool for this purpose. The current study aims to develop a technical aptitude test using a virtual reality surgical simulator, and to validate its use for the selection of surgical residents.

METHODS

The study had three phases. In Phase 1, we developed an initial version of the technical aptitude test using the Lap-X-VR laparoscopic simulator. In Phases 2 and 3 we refined the test and collected empirical data to evaluate four main sources of validity evidence (content, response process, internal structure, and relationships with other variables), and to evaluate the feasibility and acceptability of the test. Specifically, Phase 2 comprised a review of the test by 30 senior surgeons, and in Phase 3 a revised version of the test was administered to 152 interns to determine its psychometric properties.

RESULTS

Both the surgeons and interns rated the test as highly relevant for selecting surgical residents. Analyses of the data obtained from the trial administration of the test supported the appropriateness of the score calculation process and showed good psychometric properties, including reliability (α = 0.83) and task discrimination (mean discrimination = 0.5, SD = 0.1). The correlations between test scores and background variables revealed significant correlations with gender, surgical simulator experience, and video game experience (ps < 0.001). These variables, however, explained together only 10% of the variance in test scores.

CONCLUSIONS

We describe the systematic development of an innovative virtual reality test for assessing technical aptitude in candidates for surgical training, and present evidence for its validity, feasibility and acceptability. Further validation is required to support the application of the test for selection, as well as to discern the impact of gender, surgical simulator experience, and video game experience on the fairness of test results. However, the test appears to be a promising tool that may help training programs assess the suitability of candidates for surgical training.

Factors influencing surgical performance and learning progress in minimally invasive surgery - results of an interdisciplinary multicenter study

BACKGROUND

Advancing surgical techniques require a high level of adaptation and learning skills on the part of surgeons. The authors need selection procedures and decision support systems for the recruitment of medical students and young surgeons. The authors aimed to investigate factors influencing the surgical performance and learning abilities of surgeons and medical students.

MATERIALS AND METHODS

The training scores of persons attending 16 standardized training courses (at three training centers) of the German Working Group for Gynecological Endoscopy (AGE e.V.) from 2017 to 2020, individual characteristics, and the results of psychomotor tests of three-dimensional imagination and hand-eye coordination were correlated. Similar analyses were performed for medical students in their final clinical year from 2019 to 2020. The training concept was evaluated in a prospective, multicenter, interdisciplinary, multinational setting.

RESULTS

In all, 180 of 206 physicians (response rate 87.4%) and 261 medical students (response rate 100%) completed the multistage training concept successfully. Of personal characteristics, the strongest correlation was noted for good surgical performance and learning success, and the absolute number of performed laparoscopic surgeries ( r =0.28-0.45, P <0.001/ r =0.1-0.28, P <0.05). A high score on the spatial visualization ability test was also correlated with good surgical performance ( r =0.18-0.27, P <0.01). Among medical students with no surgical experience, however, age was negatively correlated with surgical performance, that is the higher the age, the lower the surgical performance ( r =0.13/ r =0.22, P <0.05/ P <0.001).

CONCLUSION

Individual factors (e.g. surgical experience, self-assessment, spatial visualization ability, eye-hand coordination, age) influence surgical performance and learning. Further research will be needed to create better decision support systems and selection procedures for prospective physicians. The possibilities of surgical training should be improved, promoted, and made accessible to a maximum number of surgical trainees because individual learning curves can be overcome even by less talented surgeons. Training options should be institutionalized for those attending medical school.

Using Job Analysis for Identifying the Desired Competencies of 21st-Century Surgeons for Improving Trainees Selection

OBJECTIVE

The current selection for surgical training is based on ineffective methods. In order to identify or to develop more valid selection tools to improve the selection, it is necessary to first define what are the competencies that are most important for success in contemporary surgery. Therefore, the current study aims to identify what competencies are required for success as a surgeon in the 21st-century and to evaluate their relative importance for selection for surgical training.

METHODS

Job analysis was conducted using a mixed-methods design. First, 104 senior surgeons from all surgical fields from various hospitals in Israel were interviewed in order to query their perceptions of competencies associated with success as a surgeon. Their answers were coded and analyzed to create a list of important competencies. Next, a larger sample of 1,102 surgeons and residents from all surgical fields completed a questionnaire in which they rated the importance of each competency in the list for success as a surgeon and for selection for surgical training in the 21st-century.

RESULTS

Twenty-four competencies (five technical skills, six cognitive abilities, 13 personality characteristics) were identified in the interview analysis. Analysis of the questionnaire's data revealed that all 24 competencies were perceived as important for success as a surgeon in the 21st-century as well as for selection for surgical training. The perceived importance of personality characteristics was higher than both cognitive abilities (p < 0.001) and technical skills (p < 0.001). The results did not differ between different surgical fields.

CONCLUSIONS

Twenty-four competencies were identified as important for 21st-century surgeons and for selection for surgical training. Although all competencies were perceived as important, personality characteristics were perceived as more important than technical skills and cognitive abilities. This updated definition of required competencies may aid in developing more valid selection methods of candidates for surgical training.