The effects of clinical supervision on supervisees and patients in cognitive behavioral therapy: a systematic review

Interprofessional supervision among allied health professionals: a systematic scoping review

Clinical supervision typically occurs between clinicians who are trained in the same discipline, and this assumption is present across much of the relevant literature. However, the use of interprofessional supervision (IPS), wherein clinicians do not share the same discipline, has increased in recent years. As IPS increases in usage, it is key that the implications of this approach are explored. In order to map the existing evidence, a scoping review was conducted to explore what is known about the use of IPS across five allied health professions (psychology, speech and language therapy, occupational therapy, physiotherapy and social work). A systematic literature search of four electronic databases was conducted, with 27 articles meeting the inclusion criteria. The data were analyzed using thematic synthesis. Six key themes were identified relating to factors impacting the appropriateness of IPS, necessary steps in the IPS process, and impacts of IPS for clinicians. Limited application of standardized tools and theoretical frameworks within the existing research was highlighted. The findings identified within this review present a broad overview of the existing research relating to IPS, which can be used to inform future research in this area.

The establishment and value of peer group clinical supervision: A qualitative study of stakeholders' perspectives

AIMS

Explore perspectives of steering group members and external clinical supervision facilitators of developing and establishing peer group clinical supervision.

BACKGROUND

The climate of healthcare is complex which can lead to staff burnout and challenges to practice. Clinical supervision is suggested as an approach to managing and leadership of such complexities.

DESIGN

Qualitative descriptive.

METHODS

Focus group interviews with 19 members of the peer group clinical supervision steering groups and individual interviews with five external clinical supervision facilitators from the Western region of Ireland were conducted. Data analysis followed Elo and Kyngäs' content analysis method, involving preparation, organising and reporting, to extract meaning and identify patterns from the qualitative data collected.

RESULTS

Developing peer group clinical supervision practice requires, clarity of purpose and function that address the pros and cons of clinical supervision. Organisational leadership is required to support and release staff for peer group clinical supervision and peer group clinical supervisors need to be credible and have a level of expertise in practice. When prepared and supported, the aspects of confidence, leadership, personal development and resilience develop.

CONCLUSION

Peer group clinical supervisors need training and ongoing continual professional development for their role, scope of practice and responsibilities. Sustainability rests on staff awareness and familiarity with the purpose and format of peer group clinical supervision and the regularity of sessions.

IMPLICATIONS FOR THE PROFESSION AND/OR PATIENT CARE

Peer group clinical supervision is a means of supporting improvement of patient care delivery while in parallel supporting personal and professional development of staff, building resilience in the workplace.

IMPACT

This study explored the implementation of peer group clinical supervision for staff across nursing and midwifery disciplines. It found that implementing peer group clinical supervision had a positive impact on staff well-being and morality and on patient care delivery. These findings influence healthcare service providers in implementing peer group clinical supervision in a sustainable way enabling nurses to continue working in complex healthcare environments delivering safe person-centred care.

REPORTING METHOD

The qualitative reporting guidelines Standards for Reporting Qualitative Research (SRQR) were followed.

PATIENT OR PUBLIC CONTRIBUTION

Patient/public involvement was addressed in this study by staff, managers, planners, directors, leaders and educationalists being involved at all stages of the study (concept, design, analysis and reporting).

A tailored psychological intervention for anxiety and depression management in people with chronic obstructive pulmonary disease: TANDEM RCT and process evaluation

Background

People with chronic obstructive pulmonary disease have high levels of anxiety and depression, which is associated with increased morbidity and poor uptake of effective treatments, such as pulmonary rehabilitation. Cognitive-behavioural therapy improves mental health of people with long-term conditions and could potentially increase uptake of pulmonary rehabilitation, enabling synergies that could enhance the mental health of people with chronic obstructive pulmonary disease.

Aim

Our aim was to develop and evaluate the clinical effectiveness and cost effectiveness of a tailored cognitive-behavioural approach intervention, which links into, and optimises the benefits of, routine pulmonary rehabilitation.

Design

We carried out a pragmatic multicentre randomised controlled trial using a 1.25 : 1 ratio (intervention : control) with a parallel process evaluation, including assessment of fidelity.

Setting

Twelve NHS trusts and five Clinical Commissioning Groups in England were recruited into the study. The intervention was delivered in participant's own home or at a local NHS facility, and by telephone.

Participants

Between July 2017 and March 2020 we recruited adults with moderate/very severe chronic obstructive pulmonary disease and mild/moderate anxiety and/or depression, meeting eligibility criteria for assessment for pulmonary rehabilitation. Carers of participants were invited to participate.

Intervention

The cognitive-behavioural approach intervention (i.e. six to eight 40- to 60-minute sessions plus telephone support throughout pulmonary rehabilitation) was delivered by 31 trained respiratory healthcare professionals to participants prior to commencing pulmonary rehabilitation. Usual care included routine pulmonary rehabilitation referral.

Main outcome measures

Co-primary outcomes were Hospital Anxiety and Depression Scale - anxiety and Hospital Anxiety and Depression Scale - depression at 6 months post randomisation. Secondary outcomes at 6 and 12 months included health-related quality of life, smoking status, uptake of pulmonary rehabilitation and healthcare use.

Results

We analysed results from 423 randomised participants (intervention, n = 242; control, n = 181). Forty-three carers participated. Follow-up at 6 and 12 months was 93% and 82%, respectively. Despite good fidelity for intervention delivery, mean between-group differences in Hospital Anxiety and Depression Scale at 6 months ruled out clinically important effects (Hospital Anxiety and Depression Scale - anxiety mean difference -0.60, 95% confidence interval -1.40 to 0.21; Hospital Anxiety and Depression Scale - depression mean difference -0.66, 95% confidence interval -1.39 to 0.07), with similar results at 12 months. There were no between-group differences in any of the secondary outcomes. Sensitivity analyses did not alter these conclusions. More adverse events were reported for intervention participants than for control participants, but none related to the trial. The intervention did not generate quality-of-life improvements to justify the additional cost (adjusted mean difference £770.24, 95% confidence interval -£27.91 to £1568.39) to the NHS. The intervention was well received and many participants described positive affects on their quality of life. Facilitators highlighted the complexity of participants' lives and considered the intervention to be of potential valuable; however, the intervention would be difficult to integrate within routine clinical services. Our well-powered trial delivered a theoretically designed intervention with good fidelity. The respiratory-experienced facilitators were trained to deliver a low-intensity cognitive-behavioural approach intervention, but high-intensity cognitive-behavioural therapy might have been more effective. Our broad inclusion criteria specified objectively assessed anxiety and/or depression, but participants were likely to favour talking therapies. Randomisation was concealed and blinding of outcome assessment was breached in only 15 participants.

Conclusions

The tailored cognitive-behavioural approach intervention delivered with fidelity by trained respiratory healthcare professionals to people with chronic obstructive pulmonary disease was neither clinically effective nor cost-effective. Alternative approaches that are integrated with routine long-term condition care are needed to address the unmet, complex clinical and psychosocial needs of this group of patients.

Trial registration

This trial is registered as ISRCTN59537391.

Funding

This award was funded by the National Institute for Health and Care Research (NIHR) Health Technology Assessment programme (NIHR award ref: 13/146/02) and is published in full in Health Technology Assessment; Vol. 28, No. 1. See the NIHR Funding and Awards website for further award information.

Therapist competence, homework engagement, and client characteristics in CBT for youth depression: A study of mediation and moderation in a community-based trial

OBJECTIVE

Prior studies of Cognitive Behavioral Therapy (CBT) have focused on the quantity and quality of clients' homework completion and only rarely have considered the role of therapist competence.

METHODS

The present study examined (a) therapist competence across the entire process of integrating homework into CBT, including the review, design, and planning of tasks; (b) homework engagement, including client appraisals of the difficulty and obstacles encountered in task completion using the Homework Rating Scale - Revised (HRS-II); (c) pre-post symptom reduction as the index of outcome; and (d) considered client factors such as suicide risk in a community-based trial for adolescent depression. Trained independent observers assessed therapist competence and engagement with homework at two consecutive sessions of CBT for N = 80 young people (Mage = 19.61, SD = 2.60).

RESULTS

Significant complementary mediation effects were obtained; there was an indirect mediation effect of HRS-II Beliefs (b = 1.03, SE B = 0.42, 95% BCa CI [0.35, 2.03]) and HRS-II Perceived Consequences on the Competence-Engagement relationship (b = 0.85, SE B = 0.31, 95% BCa CI [0.39, 1.61]). High levels of suicidal ideation were also shown to moderate this relationship.

CONCLUSIONS

The present findings contribute to the growing body of CBT process research designed to examine the complex interrelationships of client and therapist variables, in a manner that reflects the actual process of therapy, and advances beyond studies of isolated predictors of symptom change.

Free choice of treatment content, support on demand and supervision in internet-delivered CBT for adults with depression: A randomized factorial design trial

Even if much is known regarding the effects of internet-delivered cognitive behaviour therapy (ICBT) for depression there are several topics that have not been studied. In this factorial design trial with 197 participants we investigated if clients in ICBT could select treatment modules themselves based on a selection of 15 tailored treatment modules developed for use in ICBT for depression. We contrasted this against clinician-tailored module selection. We also investigated if support on demand (initiated by the client) could work as well as scheduled support. Finally, we tested if clients that were mentioned in supervision would improve more than clients not mentioned (with the exception of acute cases). The treatment period lasted for 10 weeks, and we measured effects at post-treatment and two-year follow-up. Measures of depression and secondary outcomes were collected at pre-treatment, post-treatment and two-year follow-up. Overall, within-group effects were large across conditions (e.g., d = 1.73 on the BDI-II). We also found a small but significant difference in favour of self-tailored treatment over clinician-tailored (d = 0.26). Within-group effects for the secondary measures were all moderate to large including a test of knowledge about CBT. The other two contrasts "support on demand" and "supervision" yielded mostly non-significant differences, with the exception of a larger dropout rate in the support on demand condition. There were few negative effects (2.2%). Effects were largely maintained at a two-year follow-up. We conclude that clients can choose treatment modules and that support on demand may work. The role of supervision is not yet clear as advice can be transferred across clients.

Telesupervision in Psychotherapy: A Bibliometric and Systematic Review

(1) Background: This systematic review supported by a bibliometric analysis identified quantitative and qualitative empirical studies that allowed us to respond to the objective of identifying and discussing the scope and limitations of the clinical-psychotherapeutic supervision in virtual modality or telesupervision. (2) Methods: The articles were selected according to the Systematic Reviews and Meta-Analyses (PRISMA) guidelines, and the eligibility criteria proposed by the PICOS strategy (population, interventions, comparators, outcomes, and study design) based on 396 records of scientifically identified articles in the Journal Citation Report databases of the Web of Science. (3) Results: The literature review stages allowed the selection of three articles, which were added three others that were already included in a previous review, to enrich the analysis and discussion. The results of the present review highlighted aspects of nonverbal communication, alliance, comfort, preference, trust, and construction of professional identity, among others, both considering only the telesupervision format and comparing it with traditional face-to-face supervision. (4) Conclusions: The contributions that these results are providing to the understanding of the scope and limitations of the practice of telesupervision are discussed, also considering its interference in the construction of the professional identity of supervisors and supervisees.

A Behavior-based Coding Tool for Assessing Supervisors' Adherence and Competence: Findings From a Motivational Interviewing Implementation Study

Supervision seems to be an essential part of therapist training, and thus also of implementing evidence-based practices. However, there is a shortage of valid and reliable instruments for objective assessment of supervision competence that include both global measures and frequency counts of behavior - two essential aspects of supervisory competence. This study tests the internal consistency and inter-rater reliability of an assessment tool that includes both these measures. Additionally, strategies and techniques used by ten supervisors in 35 Motivational interviewing supervision sessions are described. Codings were conducted after two separate coding training sessions. The internal consistency across the global measures was acceptable (α = 0.70; 0.71). After the second training, the inter-rater reliabilities for all frequency counts were in the moderate to good range, except for two that were in the poor range; inter-rater reliability for one of the four global measures was in the moderate range, and three were in the poor range. A prerequisite for identifying specific supervisor skills central to the development of therapist skills, teaching these skills to supervisors, and performing quality assurance of supervision, is to create instruments that can measure these behaviors. This study is a step in that direction.

Enhancing and assessing fidelity in the TANDEM (Tailored intervention for ANxiety and DEpression Management in COPD) trial: development of methods and recommendations for research design

BACKGROUND

Development of complex interventions for management of chronic conditions has become increasingly common, with guidance now provided. Fidelity (whether the intervention is designed, delivered and received as intended) is critical to understanding if, and how an intervention works (or not). However, methods for achieving this are still evolving. This study describes the methods used in the TANDEM trial - a large multicentre study evaluating the impact of a cognitive behavioural intervention preceding routine pulmonary rehabilitation for people with chronic obstructive pulmonary disease and anxiety and or depression. Results for enhancement and training aspects of fidelity, are presented.

METHODS

Using the National Institute for Health Behaviour Change Consortium (NIH BCC) framework of fidelity, a set of enhancement strategies and a fidelity measurement strategy were developed with input from a multidisciplinary team. The Cognitive First Aid Rating Scale (CFARS) was used to assess Facilitator (the respiratory professional delivering TANDEM) therapeutic competence at the end of the initial training and throughout treatment delivery (on a randomly selected set of cases). A TANDEM specific treatment adherence measure was developed following previously recommended procedures. Together these (the CFARS and adherence measure) comprised the TANDEM treatment delivery fidelity tool.

RESULTS

Hiring of respiratory professionals to the initial training programme was successful, with 44% of those expressing initial interest in being a Facilitator successfully completing the process. Video recordings of potential Facilitators conducting standardized patient role plays at the end of the initial training demonstrated fidelity of training.

CONCLUSIONS

Addressing fidelity in complex intervention trials is a time and resource intensive process but has significant potential to increase understanding of results and strengthen the evidence base for effective interventions. By defining a full fidelity assessment method prior to analysis we aimed to minimise bias when interpreting results.

TRIAL REGISTRATION

ISRCTN59537391 . Registered on 20 March 2017. Trial protocol version 6.0, 22 April 2018. Process evaluation protocol version 4.0, 1 November 2020.

In Search of the Common Elements of Clinical Supervision: A Systematic Review

The importance of clinical supervision for supporting effective implementation of evidence-based treatments (EBTs) is widely accepted; however, very little is known about which supervision practice elements contribute to implementation effectiveness. This systematic review aimed to generate a taxonomy of empirically-supported supervision practice elements that have been used in treatment trials and shown to independently predict improved EBT implementation. Supervision practice elements were identified using a two-phase, empirically-validated distillation process. In Phase I, a systematic review identified supervision protocols that had evidence of effectiveness based on (a) inclusion in one or more EBT trials, and (b) independent association with improved EBT implementation in one or more secondary studies. In Phase II, a hybrid deductive-inductive coding process was applied to the supervision protocols to characterize the nature and frequency of supervision practice elements across EBTs. Twenty-one of the 876 identified articles assessed the associations of supervision protocols with implementation or clinical outcomes, representing 13 separate studies. Coding and distillation of the supervision protocols resulted in a taxonomy of 21 supervision practice elements. The most frequently used elements were: reviewing supervisees' practice (92%; n = 12), clinical suggestions (85%; n = 11), behavioral rehearsal (77%; n = 10), elicitation (77%; n = 10), and fidelity assessment (77%; n = 10). This review identified supervision practice elements that could be targets for future research testing which elements are necessary and sufficient to support effective EBT implementation. Discrepancies between supervision practice elements observed in trials as compared to routine practice highlights the importance of research addressing supervision-focused implementation strategies.

A qualitative examination of trainee perspectives on cognitive behavioural supervision

Clinical supervision is the main method by which mental health professionals acquire the competence to deliver safe and effective therapy. The cognitive behavioural supervision (CBS) approach to supervision parallels CBT in structure and form, which may facilitate learning. Although supervision is integral to trainee development, little is known about what CBS interventions trainees consider helpful. Using a qualitative content analysis methodology, we aimed to identify the specific CBS interventions that trainees find most helpful. Eight trainees completing a CBT rotation in an out-patient hospital setting received weekly individual supervision by staff psychiatrists and psychologists. Following each supervision meeting, trainees completed open-ended responses describing what they found most and least helpful. Responses from 127 meetings were coded using a CBS framework. Overall, trainees found many aspects of supervision helpful. The interventions most frequently noted as valuable were teaching, planning, formulating, training/experimenting, and evaluation of their work. When trainees mentioned unhelpful events, insufficient collaboration and a desire for more or less supervision structure were most frequently noted. These results suggest that the perceived helpfulness of supervision may be tied to the use of CBS interventions that provide trainees with concrete skills that facilitate learning. Further suggestions and implications for supervisors are discussed.

Key learning aims

(1)

What matters in mental health care? A co-design approach to developing clinical supervision tools for practitioner competency development

BACKGROUND

Specialised mental health (MH) care providers are often absent or scarcely available in low resource and humanitarian settings (LRHS), making MH training and supervision for general health care workers (using task-sharing approaches) essential to scaling up services and reducing the treatment gap for severe and common MH conditions. Yet, the diversity of settings, population types, and professional skills in crisis contexts complicate these efforts. A standardised, field tested instrument for clinical supervision would be a significant step towards attaining quality standards in MH care worldwide.

METHODS

A competency-based clinical supervision tool was designed by Médecins Sans Frontières (MSF) for use in LRHS. A systematic literature review informed its design and assured its focus on key clinical competencies. An initial pool of behavioural indicators was identified through a rational theoretical scale construction approach, tested through waves of simulation and reviewed by 12 MH supervisors in seven projects where MSF provides care for severe and common MH conditions.

RESULTS

Qualitative analysis yielded two sets of competency grids based on a supervisee's professional background: one for 'psychological/counselling' and another for 'psychiatric/mhGAP' practitioners. Each grid features 22-26 competencies, plus optional items for specific interventions. While the structure and content were assessed as logical by supervisors, there were concerns regarding the adequacy of the tool to field reality.

CONCLUSIONS

Humanitarian settings have specific needs that require careful consideration when developing capacity-building strategies. Clinical supervision of key competencies through a standardised instrument represents an important step towards ensuring progress of clinical skills among MH practitioners.

Clinical supervision in CBT training: what do participants view as effective?

Literature pertaining to cognitive behavioural therapy (CBT) supervision is limited, particularly about CBT supervision during training. This exploratory study outlines the thoughts of supervisors and supervisees in a training context about which elements make supervision effective. Four supervisees and four experienced CBT supervisors (all from a CBT training programme and independent of one another) were interviewed and asked to consider what makes CBT supervision during training effective. Their responses were evaluated using thematic analysis (TA) and key themes identified. The fit with existing literature was considered via the use of an adapted Delphi poll. Two main themes, containing seven subthemes, were identified from the thematic analysis: ‘supervision as structured learning’ and ‘supervisory relations and process’. The adapted Delphi poll was divided into six categories denoting important characteristics of CBT supervision: (1) the supervisory relationship, (2) ethical factors, (3) generic supervisory skills, (4) mirroring the CBT approach, (5) the supervisor’s knowledge and (6) addressing difficulties. There was a good fit between the TA themes and the Delphi categories. For those engaging in CBT supervision, establishing a structure that mirrors a CBT session, alongside a supportive supervisory alliance, may promote effective CBT supervision during training.

Key learning aims

(1)

Effect of cognitive behaviour therapy on the improvement of psychological stress

BACKGROUND

College freshmen, as a special group who are far away from their parents and begin to study and live independently, will face psychological stress in adaption to the college life, which may affect their working and living conditions in the university and even after entering the society if not solved reasonably. Hence, it is necessary to explore how to relieve the psychological stress of freshmen.

OBJECTIVE

The study aimed to analyze the intervention effects of cognitive behavioral therapy on social psychological stress of freshmen under different demographic variables.

METHODS

108 freshmen of Northeast Agricultural University were divided into the experimental group and control group. The correlation between psychological stress and impulse, self-esteem, and loneliness was analyzed using structural equation model and multiple regression. The experimental group received group training for one month, while the control group did not accept any intervention. The Fear of Negative Evaluation (FNE) Scale, Interaction Anxiousness Scale (IAS), and Interpersonal Efficacy Scale (IES) were used to score students before and after activities and three months after activities. The relevant information was collected for students' self-evaluation and the evaluation results from group teachers.

RESULTS

The subjects' social psychological stress was positively correlated with loneliness and unplanned impulse, and negatively correlated with self-esteem (P < 0.001); the IAS and FNE scores of the experimental group after test were greatly lower than those of the control group, while the scores of affinity efficacy, communication efficacy, and emotional control were greatly higher than those of the control group (P < 0.05); the tracking IAS and FNE scores of the experimental group were greatly lower than those of the control group, while the scores of affinity efficacy, self-impression efficacy, communication efficacy, and emotional control were greatly higher than those of the control group (P < 0.05). All students in the experimental group were satisfied with the cognitive behavioral group training. Under the positive guidance of the team teacher, the students' psychological stress was released.

CONCLUSIONS

The cognitive behavior group training based on impulse, self-esteem, and loneliness can effectively improve the affinity efficacy, self-impression efficacy, communication efficacy, and negative evaluation fear of freshmen, which is instrumental in easing the psychological stress of students and can maintain long-term effects.

Clinical Supervision of Mental Health Services: A Systematic Review of Supervision Characteristics and Practices Associated with Formative and Restorative Outcomes

In this review, the authors examined supervision characteristics and practices associated with formative (e.g., skill development) and restorative (e.g., well-being) provider outcomes. We used qualitative review to summarize supervision characteristics associated with desired outcomes. Then, we applied a distillation approach (Chorpita et al., 2005) to identify practices associated with formative and restorative outcomes. The most common practices for promoting formative outcomes were corrective feedback, discussing intervention, and role play. Findings indicate several supervision strategies have demonstrated empirical support for improving formative outcomes. However, more rigorous research is needed in community settings, particularly for understanding which strategies improve restorative outcomes.

Existential Approaches and Cognitive Behavior Therapy: Challenges and Potential

Existential concerns such as death, responsibility, meaninglessness, and isolation not only are the hallmark of existential psychotherapy but also are frequently encountered by CBT therapists-nevertheless, due to epistemological and ideological differences, existential and CBT approaches to psychotherapy had little overlap historically. During recent years, existential issues are increasingly discussed in empirical clinical psychology, e.g., the potential role of the fear of death for a variety of mental disorders by Iverach et al. (Clinical Psychology Review, 34(7), 580-593, 2014), and there is increasing experimental evidence for a causal rather than correlational role of death anxiety discussed by Menzies and Dar-Nimrod (Journal of Abnormal Psychology, 126(4), 367-377, 2017). Further, existential concerns are common themes in CBT discussed by Grober et al. (Psychotherapeut, 61(3), 229-236, 2016) and may play an important role in the training of CBT therapists discussed by Worrell et al. (Journal of Psychotherapy and Counselling Psychology Reflections, 3(1), 9-16, 2018) as well as in personal therapy and supervision.

Preventing harm related to CBT supervision: a theoretical review and preliminary framework

Like any treatment, cognitive behavioural therapy (CBT) may have negative as well as positive outcomes, and the same is true of CBT supervision. This is recognized in definitions of supervision, which prioritize helping supervisees to ‘do no harm’ to their patients. Client harm is associated with personal distress in supervisees (therapists), such as burnout, resulting in sub-standard therapy which causes harm to patients. Some supervisors have contributed to the supervisees’ distress, and consequently to patient harm. Harm may also arise from other staff members, or from situational factors that impact negatively on various aspects of the healthcare environment. At a more distal level, the host organization may create a context that allows such problems to go unchecked (e.g. a failure to train or support supervisors adequately). It follows that a large-scale framework is necessary to fully understand and address this multi-dimensional and systemic context for harm. Therefore, this theoretical review sketches out a preliminary ‘infidelity framework’ in order to classify ten types of problem behaviour that commonly contribute to harm that is linked to supervision. Drawing on related frameworks and neighbouring literatures, the infidelity framework also offers an understanding of the typical antecedents and consequences of each of these ten behaviours. This generic functional analysis leads to examples of evidence-based CBT supervision that might prevent or rectify harm.

Supervision training in healthcare: a realist synthesis

Supervision matters: it serves educational, supportive and management functions. Despite a plethora of evidence on the effectiveness of supervision, scant evidence for the impact of supervision training exists. While three previous literature reviews have begun to examine the effectiveness of supervision training, they fail to explore the extent to which supervision training works, for whom, and why. We adopted a realist approach to answer the question: to what extent do supervision training interventions work (or not), for whom and in what circumstances, and why? We conducted a team-based realist synthesis of the supervision training literature focusing on Pawson's five stages: (1) clarifying the scope; (2) determining the search strategy; (3) study selection; (4) data extraction; and (5) data synthesis. We extracted contexts (C), mechanisms (M) and outcomes (O) and CMO configurations from 29 outputs including short (n = 19) and extended-duration (n = 10) supervision training interventions. Irrespective of duration, interventions including mixed pedagogies involving active and/or experiential learning, social learning and protected time served as mechanisms triggering multiple positive supervisor outcomes. Short-duration interventions also led to positive outcomes through mechanisms such as supervisor characteristics, whereas facilitator characteristics was a key mechanism triggering positive and negative outcomes for extended-duration interventions. Disciplinary and organisational contexts were not especially influential. While our realist synthesis builds on previous non-realist literature reviews, our findings extend previous work considerably. Our realist synthesis presents a broader array of outcomes and mechanisms than have been previously identified, and provides novel insights into the causal pathways in which short and extended-duration supervision training interventions produce their effects. Future realist evaluation should explore further any differences between short and extended-duration interventions. Educators are encouraged to prioritize mixed pedagogies, social learning and protected time to maximize the positive supervisor outcomes from training.

A new tool for rating cognitive behavioural supervision – preliminary findings in a clinical setting

Cognitive behavioural therapy (CBT) is an evidence-based psychotherapy and one of the most widely used treatments for mental health problems. It is generally acknowledged that supervision improves the quality of treatment although systematic descriptions and empirical evaluation of supervision have been sparse. Moreover, there are relatively few valid and reliable instruments to evaluate supervision. Based on a comprehensive review of the supervision literature, six competency domains were identified to cover the scope of CBT supervision: Theory, Focus, Learning strategy, Techniques, Structure, and Interpersonal style. The Moeller, Moerch, Rosenberg Supervision Scale (MMRSS) was developed to evaluate supervisor performance within each of these domains after observation of supervision. The present study examined the psychometric properties of the MMRSS (inter-rater reliability and construct validity), the clinical utility, and satisfaction when using MMRSS to evaluate CBT supervision. CBT supervisors (n = 8) were recruited for the study and provided videos of group supervision. A total of 21 videos were rated using the MMRSS and the Supervisory Competency Scale (SCS) by two independent raters. Supervisees and supervisors completed a satisfaction questionnaire to capture their experience of using the MMRSS during supervision of supervision. The MMRSS showed acceptable internal consistency and validity. Several domains in MMRSS (Structure, Learning strategy, and Interpersonal style) correlated significantly with the corresponding domains in the SCS for cognitive supervision. Preliminary results indicate that the MMRSS may be a valid and clinically useful tool to evaluate CBT supervision, although further systematic evaluation is needed.

Key learning aims

(1)

Can we agree on the quality of clinical supervision? Inter-rater reliability of the Short–SAGE (Supervision: Adherence and Guidance Evaluation) scale

Clinical supervision is a cornerstone in psychotherapist training, but research in this area is hampered by a lack of validated tools for assessing supervision quality. Short–SAGE (Supervision: Adherence and Guidance Evaluation) is an observational instrument designed for evaluating supervision in cognitive behavioural therapy. The aim of this study was to evaluate the inter-rater reliability of Short–SAGE. Four experienced clinical psychologists participated in three 3-hour Short–SAGE coding training sessions, followed by an additional meeting and coding instructions. In a cross-over design, codings of 20 supervision sessions were then assessed with intraclass correlations (ICC), for both the 3- and 7-point scales of the instrument. In the single measure analyses for both scales, only one item showed ICC in the good range, and the rest of the 14 item ICCs were in the poor to fair range. Moreover, on the 3-point scale, five of the 14 inter-rater correlations were non-significant. For research and training purposes, validated tools to assess supervision quality are highly needed. However, instruments for measuring adherence and/or competence are of little value if the coders do not attain inter-rater reliability. Whether quality of supervision is associated with improvements in supervisees’ competencies is not yet clear. Short–SAGE provides a tool that may enable empirical research in this area. Further studies are needed to assess whether extensive training can improve the inter-rater reliability of Short–SAGE.

Key learning aims

(1)

Empirical research in clinical supervision: a systematic review and suggestions for future studies

BACKGROUND

Although clinical supervision is considered to be a major component of the development and maintenance of psychotherapeutic competencies, and despite an increase in supervision research, the empirical evidence on the topic remains sparse.

METHODS

Because most previous reviews lack methodological rigor, we aimed to review the status and quality of the empirical literature on clinical supervision, and to provide suggestions for future research. MEDLINE, PsycInfo and the Web of Science Core Collection were searched and the review was conducted according to current guidelines. From the review results, we derived suggestions for future research on clinical supervision.

RESULTS

The systematic literature search identified 19 publications from 15 empirical studies. Taking into account the review results, the following suggestions for further research emerged: Supervision research would benefit from proper descriptions of how studies are conducted according to current guidelines, more methodologically rigorous empirical studies, the investigation of active supervision interventions, from taking diverse outcome domains into account, and from investigating supervision from a meta-theoretical perspective.

CONCLUSIONS

In all, the systematic review supported the notion that supervision research often lags behind psychotherapy research in general. Still, the results offer detailed starting points for further supervision research.

TRIAL REGISTRATION

PROSPERO; CRD42017072606 , registered on June 20, 2017.

Multi-professional IAPT CBT training: clinical competence and patient outcomes

Background:

There is international interest in the training of psychological therapists to deliver evidence-based treatment for common mental health problems. The UK Improving Access to Psychological Therapies (IAPT) programme, one of the largest training initiatives, relies on competent therapists to successfully deliver cognitive behaviour therapy (CBT) and promote good patient outcome.

Aims:

To evaluate an IAPT CBT training course by assessing if trainees’ clinical skills improve during training and reach competency standards, and to report patient outcome for submitted training cases. To investigate a possible relationship between trainee competence and patient outcome. To explore professional differences during training.

Method:

CBT trainee (n = 252) competence was assessed via audio recordings of therapy sessions at the beginning, middle and end of training. Patient pre- to post-treatment outcomes were extracted from submitted training cases (n = 1927). Differences in professional background were examined across competence, academic final grade and tutorial support.

Results:

CBT trainees attained competence by the end of the course with 77% (anxiety recordings) and 72% (depression recordings) improving reliably. Training cases reported pre- to post-treatment effect sizes of 1.08–2.26 across disorders. CBT competence predicted a small variance in clinical outcome for depression cases. Differences in professional background emerged, with clinical psychologists demonstrating greater competence and higher academic grades. Trainees without a core professional background required more additional support to achieve competence.

Conclusions:

Part of a new CBT therapist workforce was successfully trained to deliver relatively brief treatment effectively. Trainees without a core profession can be successfully trained to competence, but may need additional support. This has implications for workforce training.