Assessment of service provider competency for child and adolescent psychological treatments and psychosocial services in global mental health: evaluation of feasibility and reliability of the WeACT tool in Gaza, Palestine

Competency-based training and supervision: development of the WHO-UNICEF Ensuring Quality in Psychosocial and Mental Health Care (EQUIP) initiative

Globally, there has not been a standardised approach to ensure that the growing number of people who are not licensed clinicians but are delivering psychological interventions and mental health services have the competencies to deliver those interventions and services safely. Therefore, WHO and UNICEF developed Ensuring Quality in Psychosocial and Mental Health Care (EQUIP). EQUIP is a free resource with a digital platform that can be used to guide competency assessment. We describe EQUIP's 5-year development (2018-23) and the rationale supporting its contents and use. Development phases included establishing consensus for competency-based strategies; selecting foundational competencies; evaluating feasibility of assessments, role plays, and technology; piloting EQUIP when training non-specialists; and public dissemination and ongoing adaptations to increase scalability. From the public launch in March, 2022, through to March, 2024, EQUIP's digital platform has been used in 794 training programmes in 36 countries with 3760 trainees resulting in 10 001 competency assessments.

Nurturing families: A feasibility randomised controlled trial of a whole-family intervention with vulnerable families in Jordan

Armed conflict and forced displacement can significantly strain nurturing family environments, which are essential for child well-being. Yet, limited evidence exists on the effectiveness of family-systemic interventions in these contexts. We conducted a two-arm, single-masked, feasibility Randomised Controlled Trial (fRCT) of a whole-family intervention with Syrian, Iraqi and Jordanian families in Jordan. We aimed to determine the feasibility of intervention and study procedures to inform a fully-powered RCT. Eligible families were randomised to receive the Nurturing Families intervention or enhanced usual care (1:1). Masked assessors measured outcomes at baseline and endline; primary outcome measures were caregiver psychological distress, family functioning, and parenting practices. Families and implementing staff participated in qualitative interviews at endline. Of the 62 families screened, 60 (98%) were eligible, 97% completed the baseline and 90% completed the endline. Qualitative feedback indicated specific improvements in adolescent well-being, caregiver distress and parenting, and family relationships. Data highlighted high participant engagement and adequate facilitator fidelity and competence. Outcome measures had good psychometric properties (most α > 0.80) and sensitivity to change, with significant changes seen on most measures in the intervention but not control group. Findings indicate the acceptability and feasibility of intervention and study procedures. Subsequent full-scale evaluation is needed to determine effectiveness.

Peer-delivered Problem-solving Therapy for Adolescent Mental Health in Kenya: Adaptation for Context and Training of Peer-counselors

Peer-delivered interventions for adolescent mental health can help address poor access to mental health interventions. Questions remain about how interventions can be adapted for peer delivery and whether peers can be trained. In this study, we adapted problem solving therapy (PST) for peer-delivery with adolescents in Kenya and explored whether peer counselors can be trained in PST. We adapted treatment prior to and during training using the Cultural Adaptation and Contextualization for Implementation framework. Nine peer counselors (Ages 20-24) were selected and trained over 10 days. Peer competencies and knowledge were measured pre-post using a written exam, a written case study, and role plays rated using a standardized competency measure. We chose a version of PST used in India with secondary school adolescents originally delivered by teachers. All materials were translated into Kiswahili. Language and format were adapted to Kenyan adolescents as well as for delivery by peers with a focus on understandability and relevance (e.g., noting shared experience). Metaphors, examples, and visual materials were adapted for the context to reflect the culture and vernacular of Kenyan youth. Peer counselors were able to be trained in PST. Pre-post competencies and understanding of content showed improvements with peers minimally meeting patient needs (pre) on average to moderate/fully meeting patient needs (post). Post-training written exam score showed an average 90% correct. There is an adapted version of PST for Kenyan adolescents and peer delivery. Peer counselors can be trained to deliver a 5-session PST in a community context.

Identifying Core Competencies for Remote Delivery of Psychological Interventions: A Rapid Review

OBJECTIVE

The COVID-19 pandemic led to a rapid shift toward remote delivery of psychological interventions and transition to voice-only and video communication platforms. However, agreement is lacking on key competencies that are aligned with equitable approaches for standardized training and supervision of remote psychological intervention delivery. A rapid review was conducted to identify and describe competencies that could inform best practices of remote services delivery during and after the COVID-19 pandemic.

METHODS

Scopus, MEDLINE, and PsycINFO were searched for literature published in English (2015-2021) on competencies for synchronous, remote psychological interventions that can be measured through observation.

RESULTS

Of 135 articles identified, 12 met inclusion criteria. Studies targeted populations in high-income countries (11 in the United States and Canada, one in Saudi Arabia) and focused on specialist practitioners, professionals, or trainees in professional or prelicensure programs working with adult populations. Ten skill categories were identified: emergency and safety protocols for remote services, facilitating communication over remote platforms, remote consent procedures, technological literacy, practitioner-client identification for remote services, confidentiality during remote services, communication skills during remote services, engagement and interpersonal skills for remote services, establishing professional boundaries during remote services, and encouraging continuity of care during remote services.

CONCLUSIONS

These 10 skills domains can offer a foundation for refinement of discrete, individual-level competencies that can be aligned with global initiatives promoting use of observational competency assessment during training and supervision programs for psychological interventions. More research is needed on identification of and agreement on remote competencies and on their evaluation.

Competency-based pre-service education for clinical psychology training in low- and middle-income countries: Case study of Makerere University in Uganda

Reducing the global treatment gap for mental health conditions in low- and middle-income countries (LMICs) requires not only an expansion of clinical psychology training but also assuring that graduates of these programs have the competency to effectively and safely deliver psychological interventions. Clinical psychology training programs in LMICs require standardized tools and guidance to evaluate competency. The World Health Organization (WHO) and UNICEF developed the “Ensuring Quality in Psychological Support” (EQUIP) platform to facilitate competency-based training in psychosocial support, psychological treatments, and foundational helping skills, with an initial focus on in-service training for non-specialists. Our goal was to design the first application of EQUIP to implement competency-based training into pre-service education for clinical psychology trainees. With Makerere University in Uganda as a case study, we outline an approach to develop, implement, and evaluate a competency-based curriculum that includes seven steps: (1) Identify core clinical psychology competencies; (2) Identify evaluation methods appropriate to each competency; (3) Determine when competency evaluations will be integrated in the curriculum, who will evaluate competency, and how results will be used; (4) Train faculty in competency-based education including conducting competency assessments and giving competency-based feedback; (5) Pilot test and evaluate the competency-based education strategy with faculty and students; (6) Modify and implement the competency-based education strategy based on pilot results; and (7) Implement ongoing evaluation of the competency-based curriculum with continuous quality improvement. This approach will be formally evaluated and established as a foundation for pre-service training in other low-resource settings.

Measurement and assessment of fidelity and competence in nonspecialist-delivered, evidence-based behavioral and mental health interventions: A systematic review

Nonspecialists have increasingly been used to deliver evidence-based, mental health and behavioral interventions in lower resource settings where there is a dearth of specialized providers and a corresponding gap in service delivery. Recent literature acknowledges that nonspecialist-delivered interventions are shown to be effective. However, few studies report on the fidelity (the degree to which an intervention was implemented as intended) and/or competence (general skills of nonspecialists), key concepts that measure quality of evidence-based intervention delivery. This study seeks to understand how both fidelity and competence have been assessed in nonspecialist-delivered, evidence-based interventions with an intended social or psychological behavior-change outcome. Our search results originally yielded 2317 studies, and ultimately, 16 were included in our final analysis. Generally, results from a narrative synthesis indicated that tools used in the studies demonstrated sufficient inter-rater reliability and intra-class correlation components. Included studies used and described a range of fidelity and competence tools. However, the ENhancing Assessment of Common Therapeutic factors tool was the most commonly used tool that measures competence of nonspecialists, and has been adapted to several other settings. The roles of supervisors in mentoring, monitoring, and supervising nonspecialists emerged as a key ingredient for ensuring fidelity. Most studies assessing fidelity were limited by small sample sizes due to low numbers of nonspecialists implementing interventions, however, more advanced statistical methods may not be needed and may actually impede community-based organizations from assessing fidelity data. Our results suggest interventions can share resources, tools, and compare findings regardless with proper supervision. While the two terms "fidelity" and "competence" are often used interchangeably, their differences are noteworthy. Ultimately, both competency and fidelity are critical for delivering evidence-based interventions, and nonspecialists are most effective when they can be evaluated and mentored on both throughout the course of the intervention.

K. P, Magar J, Pradhan I, Shrestha P, Hassan E, Abou Jaoude GJ, Haghparast-Bidgoli H, Devakumar D, Carrino L, Floridi G, Kohrt BA, Verdeli H, Clougherty K, Klein Rafaeli A, Jordans M, Luitel NP. School-based group interpersonal therapy for adolescents with depression in rural Nepal: a mixed methods study exploring feasibility, acceptability, and cost

Background

Adolescents with depression need access to culturally relevant psychological treatment. In many low- and middle-income countries treatments are only accessible to a minority. We adapted group interpersonal therapy (IPT) for adolescents to be delivered through schools in Nepal. Here we report IPT's feasibility, acceptability, and cost.

Methods

We recruited 32 boys and 30 girls (aged 13-19) who screened positive for depression. IPT comprised of two individual and 12 group sessions facilitated by nurses or lay workers. Using a pre-post design we assessed adolescents at baseline, post-treatment (0-2 weeks after IPT), and follow-up (8-10 weeks after IPT). We measured depressive symptoms with the Depression Self-Rating Scale (DSRS), and functional impairment with a local tool. To assess intervention fidelity supervisors rated facilitators' IPT skills across 27/90 sessions using a standardised checklist. We conducted qualitative interviews with 16 adolescents and six facilitators post-intervention, and an activity-based cost analysis from the provider perspective.

Results

Adolescents attended 82.3% (standard deviation 18.9) of group sessions. All were followed up. Depression and functional impairment improved between baseline and follow-up: DSRS score decreased by 81% (95% confidence interval 70-95); functional impairment decreased by 288% (249-351). In total, 95.3% of facilitator IPT skills were rated superior/satisfactory. Adolescents found the intervention useful and acceptable, although some had concerns about privacy in schools. The estimate of intervention unit cost was US $96.9 with facilitators operating at capacity.

Conclusions

School-based group IPT is feasible and acceptable in Nepal. Findings support progression to a randomised controlled trial to assess effectiveness and cost-effectiveness.

Evaluation of competency-driven training for facilitators delivering a psychological intervention for children in Lebanon: a proof-of-concept study

AIMS

The mounting evidence for effective delivery of psychological interventions by non-specialists in low- and middle-income settings has led to a rapid expansion of mental health and psychosocial support trainings globally. As such, there is a demand for strategies on how to train and implement these services to attain adequate quality. This study aims to evaluate the added value of a competency-driven approach to training of facilitators for a group intervention for children with severe emotional distress in Lebanon.

METHODS

In a controlled before and after study, 24 trainees were randomly allocated to participate in either a competency-driven training (CDT) or training-as-usual (TAU) (1 : 1) for a psychological intervention for children with severe emotional distress. We assessed the change in demonstrated competencies, using standardised role-plays, before and after the training. Measures included the 13-item Working with children-Assessment of Competencies Tool (WeACT), the 15-item ENhancing Assessment of Common Therapeutic factors (ENACT) and the 6-item Group facilitation: Assessment of Competencies Tool (GroupACT). The trainer in the experimental arm used pre-training and during training competency assessment scores to make real-time adjustment to training delivery. Due to COVID-19 pandemic restrictions, all activities were done remotely.

RESULTS

CDT resulted in significantly better outcomes on increasing competencies on the WeACT (repeated measures analysis of variance; F_{(1, 22)} = 6.49, p < 0.018) and on the GroupACT (Mann-Whitney U = 22, p < 0.003), though not statistically significant on the ENACT. There is no significant between-group difference on the reduction of harmful behaviours, mainly because both forms of training appear equally successful in eliminating such behaviours.

CONCLUSIONS

This proof-of-concept study demonstrates the potential of CDT, using standardised assessment of trainee competencies, to contribute to better training outcomes without extending the duration of training. CDT can result in up to 18% greater increase in adequate competency, when compared to TAU. The study also yields recommendations for further enhancing the benefits of competency-driven strategies. A fully powered trial is needed to confirm these findings.

ENhancing Assessment of Common Therapeutic factors (ENACT) tool: adaptation and psychometric properties in South Africa

Background

The ENhancing Assessment of Common Therapeutic factors (ENACT) tool measures a set of therapeutic competencies required for the effective psychological intervention, including delivery by non-specialists. This paper describes the systematic adaptation of the ENACT for the South African (SA) context and presents the tool's initial psychometric properties.

Methods

We employed a four-step process: (1) Item generation: 204 therapeutic factors were generated by SA psychologists and drawn from the original ENACT as potential items; (2) Item relevance: SA therapists identified 96 items that were thematically coded according to their relationship to one another and were assigned to six domains; (3) Item utility: The ENACT-SA scale was piloted by rating recordings of psychological therapy sessions and stakeholder input; and (4) Psychometric properties: Internal consistency and inter-rater reliability of the final 12-item ENACT-SA were explored using Cronbach's alpha and intraclass correlation co-efficient (ICC) for both clinical psychologists and registered counsellors.

Results

Although the original ENACT provided a framework for developing a tool for use in SA, several modifications were made to improve the applicability of the tool for the SA context, and optimise its adaptability other contexts. The adapted 12-item tool's internal consistency was good, while the inter-rater reliability was acceptable for both clinical psychologists and registered counsellors.

Conclusion

The ENACT-SA is a reliable tool to assess common factors in psychological treatments. It is recommended that the tool be used in conjunction with assessment protocols and treatment-specific competency measures to fully assess implementation fidelity and potential mechanisms of therapeutic change.