The Hierarchical Clustering of Clinical Psychology Practicum Competencies: A Multisite Study of Supervisor Ratings

Competencies unique to clinical neuropsychology: A consensus statement of educators, practitioners, and professional leaders in Australia

Objective: To delineate the unique role of clinical neuropsychologists in contemporary Australian clinical practice and present a comprehensive consensus-based set of clinical neuropsychology competencies to guide and standardize the training of clinical neuropsychologists. Method: Twenty-four national representatives of the clinical neuropsychology profession (71% female, M = 20.1, SD = 8.1 years clinical practice), including tertiary-level educators, senior practitioners and members of the executive committee of the peak national neuropsychology body, formed the Australian Neuropsychology Alliance of Training and Practice Leaders (ANATPL). Informed by a review of existing international competency frameworks and Australian Indigenous psychology education frameworks, a provisional set of competencies for clinical neuropsychology training and practice were developed, followed by 11 rounds of feedback and revisions. Results: The final set of clinical neuropsychology competencies achieved full consensus and falls into three broad categories: generic foundational (i.e. general professional psychology competencies applied to clinical neuropsychology); specific functional (i.e. specific to clinical neuropsychology areas of practice) competencies relevant to all career stages; and functional competencies relevant to advanced career stages. Competencies span a number of knowledge and skill-based domains including neuropsychological models and syndromes, neuropsychological assessment, neuropsychological intervention, consultation, teaching/supervision and management/administration. Conclusion: The competencies reflect recent advances in the field of clinical neuropsychology, including expanded intervention competencies, culturally-informed neuropsychological practice and use of emerging technologies. They will be available as a resource to guide curriculum development for clinical training, as well as providing a useful framework for professional practice and advocacy more broadly within the discipline of clinical neuropsychology.

Supervisor versus self-assessment of trainee competence: Differences across developmental stages and competency domains

OBJECTIVES

This research aimed to systematically examine supervisor-trainee differences in assessments of trainee competencies across domains and developmental stages.

METHODS

Trainees and supervisors (N = 141 dyads) independently rated trainee performance at the end of placements using the Clinical Psychology Competencies Rating Scale. Based on the number of placement hours completed at the time competence was assessed, the 141 trainees were assigned to three developmental levels (61, 42, and 31 in the groups, respectively). Trajectories of 10 different competencies and trainee-supervisor differences for these competencies were examined across three developmental levels.

RESULTS

Compared to their supervisor ratings, trainees underestimated their competence during early stages of training, with this discrepancy reducing at Level 2 and reversing into an overestimation at Level 3. Compared to their own ratings for overall competence, trainees rated Relational and Communication, Reflective Practice, and Professionalism domains as relative strengths, and rated their competence on assessment and intervention domains as relative weaknesses.

CONCLUSION

Growth trajectories derived from supervisor assessments were much flatter than trajectories derived from trainee assessments. As predicted by the impostor theory of practitioner development, trainees significantly underestimated their competence early in training. The trend for trainees to overestimate their competence toward the end of their training is a potential concern that warrants further research.

Brief Online Training with Standardised Vignettes Reduces Inflated Supervisor Ratings of Trainee Practitioner Competencies

Objective

Supervisor assessments of trainee competence are integral to ensuring that clinical psychology trainees reach competency benchmarks. The commonly used Clinical Psychology Practicum Competencies Rating Scale (CΨPRS) has been shown to elicit inflated ratings of competency. Hence, the aim of this study is to examine whether brief supervisor training reduces ratings by providing objective criteria with which supervisors can assess trainee competency.

Method

The ratings included were of 124 psychology trainees from nine Australian university clinical programmes. Of 170 supervisors, 32 completed the online training immediately prior to commencing the CΨPRS. Training required supervisors to rate the competency level described in five standardised vignettes (Beginner through to Competent). Vignette ratings, as determined by a panel of expert supervisors, were provided as feedback. A sixth calibration vignette was also rated (no feedback provided). Firstly, CΨPRS ratings from the trained and untrained supervisors were compared. Secondly, the difference between supervisor and expert ratings of the calibration vignettes were compared across trained and untrained groups.

Results

Trained supervisors provided lower CΨPRS ratings than untrained supervisors. In addition, trained supervisors (vs untrained supervisors) provided ratings of the calibration vignette that more accurately matched the ratings provided by the expert panel.

Conclusions

Brief online training using standardised vignettes was associated with lower CΨPRS ratings. The standardised vignettes helped calibrate supervisors’ ratings and likely attuned supervisors to the skills and competency levels that are expected at particular developmental stages. As a consequence, training appeared to reduce ratings, arguably resulting in more accurate assessments of trainee performance.