1
|
Bergvall H, Linde J, Alfonsson S, Sunnhed R, Barber JP, Lundgren T, Andersson G, Bohman B. Quality of cognitive-behavioural therapy in routine psychiatric care: therapist adherence and competence, and patient outcomes for depression and anxiety disorders. BMC Psychiatry 2024; 24:887. [PMID: 39633319 PMCID: PMC11616186 DOI: 10.1186/s12888-024-06328-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/19/2024] [Accepted: 11/22/2024] [Indexed: 12/07/2024] Open
Abstract
BACKGROUND Quality of care is essential for the dissemination of evidence-based practices, yet therapist adherence and competence are seldom assessed. We examined the quality of delivery of cognitive-behavioural therapy (CBT) in routine psychiatric care for depression and anxiety disorders, considering therapist adherence and competence, and therapy effectiveness, as well as their associations. METHODS Twenty-nine therapists recruited 85 patients with a principal diagnosis of depression or anxiety disorder from two routine psychiatric outpatient clinics in Stockholm, Sweden. Therapist adherence was assessed mid-CBT by observers and post-CBT by patients and therapists, respectively, using an instrument developed as part of the present study. Therapist competence was assessed using role-plays with a standardised patient. Patients rated symptoms, functional impairment, and global health pre- and post-CBT. Linear mixed models were used to analyse associations. RESULTS Therapist adherence was high according to patients, moderate to high according to therapists, and moderate according to observers. Most therapists demonstrated competence in CBT, as assessed using the Cognitive Therapy Scale-Revised (M = 40.5, SD = 6.5; 76% passed the ≥ 36 points competence threshold). Patients improved significantly from pre- to post-CBT across outcome measures (Cohen's ds = 0.80 - 1.36). Neither therapist adherence nor competence was associated with patient outcomes. CONCLUSIONS In routine psychiatric care, therapists delivered CBT with adherence, competence, and improvements for patients with depression and anxiety disorders, on par with previous research results in controlled settings. The implications for quality assessment and improvement are discussed. TRIAL REGISTRATION ClinicalTrials.gov NCT03625024 10/08/2018.
Collapse
Affiliation(s)
- Hillevi Bergvall
- Department of Clinical Neuroscience, Centre for Psychiatry Research, Karolinska Institutet and Stockholm Health Care Services, Region Stockholm, Stockholm, Sweden.
| | - Johanna Linde
- Department of Clinical Neuroscience, Centre for Psychiatry Research, Karolinska Institutet and Stockholm Health Care Services, Region Stockholm, Stockholm, Sweden
| | - Sven Alfonsson
- Department of Clinical Neuroscience, Centre for Psychiatry Research, Karolinska Institutet and Stockholm Health Care Services, Region Stockholm, Stockholm, Sweden
| | - Rikard Sunnhed
- Department of Clinical Neuroscience, Centre for Psychiatry Research, Karolinska Institutet and Stockholm Health Care Services, Region Stockholm, Stockholm, Sweden
| | - Jacques P Barber
- Gordon F. Derner School of Psychology, Adelphi University, Garden City, NY, USA
| | - Tobias Lundgren
- Department of Clinical Neuroscience, Centre for Psychiatry Research, Karolinska Institutet and Stockholm Health Care Services, Region Stockholm, Stockholm, Sweden
| | - Gerhard Andersson
- Department of Clinical Neuroscience, Centre for Psychiatry Research, Karolinska Institutet and Stockholm Health Care Services, Region Stockholm, Stockholm, Sweden
- Department of Behavioural Sciences and Learning, Linköping University, Linköping, Sweden
- Department of Biomedical and Clinical Sciences, Linköping University, Linköping, Sweden
| | - Benjamin Bohman
- Department of Clinical Neuroscience, Centre for Psychiatry Research, Karolinska Institutet and Stockholm Health Care Services, Region Stockholm, Stockholm, Sweden
| |
Collapse
|
2
|
Waller G, Beard J. Recent Advances in Cognitive-Behavioural Therapy for Eating Disorders (CBT-ED). Curr Psychiatry Rep 2024; 26:351-358. [PMID: 38717658 PMCID: PMC11211111 DOI: 10.1007/s11920-024-01509-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 04/25/2024] [Indexed: 06/28/2024]
Abstract
PURPOSE OF REVIEW Eating disorders require more effective therapies than are currently available. While cognitive behavioural therapy for eating disorders (CBT-ED) has the most evidence to support its effectiveness, it requires substantial improvement in order to enhance its reach and outcomes, and to reduce relapse rates. Recent years have seen a number of noteworthy developments in CBT-ED, which are summarised in this paper. RECENT FINDINGS The key advances identified here include: improvements in the efficiency and availability of CBT-ED; expansion of applicability to younger cases across durations of eating disorder; and new methodologies. There have been important recent advances in the field of CBT-ED. However, it is important to stress that there remain gaps in our evidence base and clinical skills, and suggestions are made for future research and clinical directions.
Collapse
Affiliation(s)
- Glenn Waller
- Clinical and Applied Psychology Unit, Department of Psychology, University of Sheffield, Cathedral Court, 1 Vicar Lane, Sheffield, S1 2LT, UK.
| | - Jessica Beard
- Clinical and Applied Psychology Unit, Department of Psychology, University of Sheffield, Cathedral Court, 1 Vicar Lane, Sheffield, S1 2LT, UK
| |
Collapse
|
3
|
Beard J, Cooper Z, Masson P, Mountford VA, Murphy R, Raykos B, Tatham M, Thomas JJ, Turner HM, Wade TD, Waller G. Assessing clinician competence in the delivery of cognitive-behavioural therapy for eating disorders: development of the Cognitive-Behavioural Therapy Scale for Eating Disorders (CBTS-ED). Cogn Behav Ther 2024; 53:29-47. [PMID: 37807843 DOI: 10.1080/16506073.2023.2263640] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2022] [Accepted: 09/20/2023] [Indexed: 10/10/2023]
Abstract
Evidence-based cognitive-behaviour therapy for eating disorders (CBT-ED) differs from other forms of CBT for psychological disorders, making existing generic CBT measures of therapist competence inadequate for evaluating CBT-ED. This study developed and piloted the reliability of a novel measure of therapist competence in this domain-the Cognitive Behaviour Therapy Scale for Eating Disorders (CBTS-ED). Initially, a team of CBT-ED experts developed a 26-item measure, with general (i.e. present in every session) and specific (context- or case-dependent) items. To determine statistical properties of the measure, nine CBT-ED experts and eight non-experts independently observed six role-played mock CBT-ED therapy sessions, rating the therapists' performance using the CBTS-ED. The inter-item consistency (Cronbach's alpha and McDonald's omega) and inter-rater reliability (ICC) were assessed, as appropriate to the clustering of the items. The CBTS-ED demonstrated good internal consistency and moderate/good inter-rater reliability for the general items, at least comparable to existing generic CBT scales in other domains. An updated version is proposed, where five of the 16 "specific" items are reallocated to the general group. These preliminary results suggest that the CBTS-ED can be used effectively across both expert and non-expert raters, though less experienced raters might benefit from additional training in its use.
Collapse
Affiliation(s)
- Jessica Beard
- Department of Psychology, University of Sheffield, Sheffield, UK
| | - Zafra Cooper
- Department of Psychiatry, Yale University, New Haven, USA
| | - Philip Masson
- Department of Psychology, Western University, London, Canada
| | - Victoria A Mountford
- Sage Clinics, Dubai, UAE
- Institute of Psychiatry, Psychology & Neuroscience, King's College London, London, UK
| | - Rebecca Murphy
- Department of Psychiatry, University of Oxford, Oxford, UK
| | - Bronwyn Raykos
- Centre for Clinical Interventions, Northbridge, Western Australia
| | - Madeleine Tatham
- Department of Psychology, University of Sheffield, Sheffield, UK
| | - Jennifer J Thomas
- Department of Psychiatry, Harvard Medical School Massachusetts General Hospital, Boston, USA
| | - Hannah M Turner
- Eating Disorders Service, Southern Health NHS Foundation Trust, Southampton, UK
| | - Tracey D Wade
- College of Education, Psychology and Social Work, Flinders University, Bedford Park, South Australia
| | - Glenn Waller
- Department of Psychology, University of Sheffield, Sheffield, UK
| |
Collapse
|
4
|
Mathur S, Michelson D, Shetty T, Patel V, Field AP. Knowledge of Problem Solving (KOPS) Scale: Design and Evaluation of a Digitally Administered Competence Measure for a Common Practice Element in Task-Shared Youth Mental Health Interventions. JOURNAL OF TECHNOLOGY IN BEHAVIORAL SCIENCE 2023; 9:418-427. [PMID: 39161658 PMCID: PMC11330393 DOI: 10.1007/s41347-023-00356-9] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/03/2023] [Revised: 09/19/2023] [Accepted: 10/09/2023] [Indexed: 08/21/2024]
Abstract
There are few reliable and feasible quality assurance methods to support scaling up of psychological interventions delivered by non-specialist providers. This paper reports on the phased development and validation of a digitally administered Knowledge of Problem Solving (KOPS) measure to assess competencies associated with a "task-shared" problem-solving intervention for adolescents with diverse mental health problems in India. Phase 1 established key competencies required to deliver the intervention, followed by item generation for a corresponding knowledge-based competency measure that could be administered efficiently through e-learning systems. In phase 2, items were refined based on responses from an "experienced" reference sample comprising 17 existing counsellors with direct experience of the problem-solving intervention, and a "novice" sample with 14 untrained university students and NGO staff. In phase 3, we evaluated two parallel versions of the measure in a validation sample (N = 277) drawn from universities and NGOs. The resulting 17-item measure was structured around a hypothetical case, followed by multiple-choice questions that asked about the most appropriate response to a practice-based scenario. The difficulty level of the test items was well matched to the ability level of participants (i.e. most items being of moderate difficulty and few items being easy or difficult). Only one item showed a negative discrimination index and was removed from the 17-item forms. The final 16-item version of the KOPS measure provides a scalable digital method to assess key psychotherapeutic competencies among non-specialists, particularly in relation to a transdiagnostic problem-solving intervention. Similar formats could be deployed more widely alongside e-learning programmes to expand the global workforce capable of delivering evidence-based psychological interventions. Supplementary Information The online version contains supplementary material available at 10.1007/s41347-023-00356-9.
Collapse
Affiliation(s)
| | - Daniel Michelson
- Department of Child & Adolescent Psychiatry, Institute of Psychiatry, Psychology & Neuroscience, King’s College London, London, UK
- School of Psychology, University of Sussex, Brighton, UK
| | | | - Vikram Patel
- Department of Global Health and Social Medicine, Harvard Medical School, Boston, USA
- Harvard T.H. Chan School of Public Health, Boston, USA
| | - Andy P. Field
- School of Psychology, University of Sussex, Brighton, UK
| |
Collapse
|
5
|
Lakeman R, Happell B, Hurley J, Sullivan D. The Impact of an Online Post-Graduate Interdisciplinary Mental Health Programme on Graduates' Confidence and Practice. Issues Ment Health Nurs 2023:1-6. [PMID: 37418705 DOI: 10.1080/01612840.2023.2224874] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 07/09/2023]
Abstract
This study aimed to examine the experiences of graduates of online interdisciplinary postgraduate mental health programmes in Australia. The program was delivered in 6-week terms. Seven graduates from diverse backgrounds were interviewed about their experiences with the course and its impact on their practice, confidence, professional identity, views on mental health service users, and their motivation for additional learning. The interviews were recorded and transcribed and underwent thematic content analysis. The graduates reported an increase in confidence and knowledge after completing the course, which led to a change in their views and attitudes towards service users. They appreciated the examination of psychotherapies and motivational interviewing, and applied their newly acquired skills and knowledge in their practice. The course was found to have improved their clinical practice. This study highlights a departure from traditional pedagogical approaches in mental health skill acquisition, as the entire program was delivered online. There is a need for further research to determine who might benefit most from this mode of delivery and to verify the competencies acquired by graduates in real-world situations. Online mental health courses are a feasible option and have been positively received by graduates. To enable graduates to participate in transforming mental health services, systemic change and recognition of their capabilities, particularly those from non-traditional backgrounds, is required. The results of this study suggest the potential for online postgraduate programs to play a significant role in transforming mental health services.
Collapse
Affiliation(s)
- Richard Lakeman
- Faculty of Health, Southern Cross University, Bilinga, QLD, Australia
| | - Brenda Happell
- Faculty of Health, Southern Cross University, Bilinga, QLD, Australia
| | - John Hurley
- Faculty of Health, Southern Cross University, Bilinga, QLD, Australia
| | - Dan Sullivan
- Faculty of Health, Southern Cross University, Bilinga, QLD, Australia
| |
Collapse
|
6
|
Joshi U, Haney JR, Sequeira M, Singla DR, Patel V, Bhan A, Cooper Z, Naslund JA. Adaptation and translation of a scalable measure for assessing health worker competence to deliver a brief psychological intervention: A case study from central India of its comparison to a performance-based measure. Psychiatr Q 2023; 94:33-47. [PMID: 36536268 PMCID: PMC11735022 DOI: 10.1007/s11126-022-10007-6] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 11/12/2022] [Indexed: 12/24/2022]
Abstract
Efforts to reduce the global burden of common mental disorders have focused on scaling up evidence-based training programs for non-specialist providers to deliver brief psychological interventions. To evaluate these provider training programs, appropriate and scalable assessments of competency need to be developed alongside them. We followed a systematic approach for the cultural adaptation and translation into Hindi of a valid, English, multiple-choice applied knowledge measure to assess non-specialists' competence to deliver a brief psychological intervention for depression in rural India. We then explored the relationship between the performance of 30 non-specialist providers on the same written measure compared with a structured performance-based measure consisting of two role-plays. The results of the multiple-choice assessment had an overall mean score of 37.40 (SD = 11.31) compared to the mean scores of role-play A (the easier role-play) of 43.25 (SD = 14.50) and role-play B (the more difficult role-play) of 43.25 (SD = 13.00). Role-play performance-based measures and written applied knowledge measures represent different approaches with unique strengths and challenges to measuring competence. Scaling up training programs requires the development of scalable methods for competency assessment. Exploring the relationship between these two measures, our team found no apparent differences between the two modes of assessment. Continued comparison of these approaches is needed to determine the consistency of outcomes across the two formats and to link the scores on these measures with clinical performance as reflected by the quality of care and patient outcomes.Trial Registration: ClinicalTrials.gov Identifier: NCT04157816; 8th November 2019.
Collapse
Affiliation(s)
| | - Juliana Restivo Haney
- Department of Global Health and Social Medicine, Harvard Medical School, 641 Huntington Ave, 02115, Boston, MA, USA
| | | | - Daisy R Singla
- Campbell Family Mental Health Research Institute, Center of Addiction and Mental Health, Toronto, Canada
- Department of Psychiatry, Temerty Faculty of Medicine, University of Toronto, Toronto, Canada
- Lunenfeld Tanenbaum Research Institute, Sinai Health, Toronto, Canada
| | - Vikram Patel
- Department of Global Health and Social Medicine, Harvard Medical School, 641 Huntington Ave, 02115, Boston, MA, USA
- Department of Global Health and Population, Harvard T.H. Chan School of Public Health, Boston, MA, USA
| | | | - Zafra Cooper
- Department of Psychiatry, Yale School of Medicine, New Haven, USA
| | - John A Naslund
- Department of Global Health and Social Medicine, Harvard Medical School, 641 Huntington Ave, 02115, Boston, MA, USA.
| |
Collapse
|
7
|
Development of competence in cognitive behavioural therapy and the role of metacognition among clinical psychology and psychotherapy students. Behav Cogn Psychother 2023; 51:200-213. [PMID: 36691810 DOI: 10.1017/s1352465822000686] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/25/2023]
Abstract
BACKGROUND There is a paucity of research on therapist competence development following extensive training in cognitive behavioural therapy (CBT). In addition, metacognitive ability (the knowledge and regulation of one's cognitive processes) has been associated with learning in various domains but its role in learning CBT is unknown. AIMS To investigate to what extent psychology and psychotherapy students acquired competence in CBT following extensive training, and the role of metacognition. METHOD CBT competence and metacognitive activity were assessed in 73 psychology and psychotherapy students before and after 1.5 years of CBT training, using role-plays with a standardised patient. RESULTS Using linear mixed modelling, we found large improvements of CBT competence from pre- to post-assessment. At post-assessment, 72% performed above the competence threshold (36 points on the Cognitive Therapy Scale-Revised). Higher competence was correlated with lower accuracy in self-assessment, a measure of metacognitive ability. The more competent therapists tended to under-estimate their performance, while less competent therapists made more accurate self-assessments. Metacognitive activity did not predict CBT competence development. Participant characteristics (e.g. age, clinical experience) did not moderate competence development. CONCLUSIONS Competence improved over time and most students performed over the threshold post-assessment. The more competent therapists tended to under-rate their competence. In contrast to what has been found in other learning domains, metacognitive ability was not associated with competence development in our study. Hence, metacognition and competence may be unrelated in CBT or perhaps other methods are required to measure metacognition.
Collapse
|
8
|
The why, what, when, who and how of assessing CBT competence to support lifelong learning. COGNITIVE BEHAVIOUR THERAPIST 2022. [DOI: 10.1017/s1754470x22000502] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/04/2022]
Abstract
Abstract
Assessment of cognitive behaviour therapy (CBT) competence is a critical component in ensuring optimal clinical care, supporting therapists’ skill acquisition, and facilitating continuing professional development. This article provides a framework to support trainers, assessors, supervisors and therapists when making decisions about selecting and implementing effective strategies for assessing CBT competence. The framework draws on the existing evidence base to address five central questions: Why assess CBT competence?; What is CBT competence?; When should CBT competence be assessed?; Who is best placed to assess CBT competence?; and How should CBT competence be assessed? Various methods of assessing CBT competence are explored and the potential benefits and challenges are outlined. Recommendations are made about which approach to use across different contexts and how to use these effectively to facilitate the acquisition, enhancement and evaluation of CBT knowledge and skills.
Key learning aims
After reading this article you will be able to:
(1)
Identify key issues about why, what, when, who and how to assess CBT competence and use this framework to guide decisions about the best strategy to use.
(2)
Be aware of the range of methods for assessing CBT competence and consider the main benefits and potential challenges of these.
(3)
Consider the most effective ways to implement CBT competence assessment strategies as a tool for evaluation and learning.
Collapse
|
9
|
Marriott BR, Cho E, Tugendrajch SK, Kliethermes MD, McMillen JC, Proctor EK, Hawley KM. Role-Play Assessment of Therapist Adherence and Skill in Implementation of Trauma-Focused Cognitive-Behavioral Therapy. ADMINISTRATION AND POLICY IN MENTAL HEALTH AND MENTAL HEALTH SERVICES RESEARCH 2021; 49:374-384. [PMID: 34546482 DOI: 10.1007/s10488-021-01169-9] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 09/13/2021] [Indexed: 11/24/2022]
Abstract
Numerous efforts are underway to train clinicians in evidence-based practices. Unfortunately, the field has few practical measures of therapist adherence and skill with which to judge the success of these training and implementation efforts. One possible assessment method is using behavioral rehearsal, or role-play, as an analogue for therapist in-session behavior. The current study describes aspects of reliability, validity and utility of a behavioral role-play assessment developed to evaluate therapist adherence and skill in implementing Trauma-Focused Cognitive-Behavioral Therapy (TF-CBT). TF-CBT role-play assessments were conducted with a sample of 43 therapists as part of a larger training study. The TF-CBT role-play assessments were independently coded for TF-CBT adherence and skill by a certified TF-CBT trainer and three clinical psychology doctoral students. Findings indicated good interrater reliability for the individual items (ICC: M = .71, SD = .15). Regarding utility, 67.19% (n = 43/64) of contacted therapists completed the role-play assessment, which took an average of 30 min (M = 31.42, SD = 5.65) to complete and 60 min (M = 62.84, SD = 11.31) to code. Therapists with a master's degree were more likely to complete the role-play assessment than those with other degrees but no other differences in demographic variables, practice characteristics, or TF-CBT knowledge or training were found between participants and nonparticipants. Role-play assessments may offer an alternative to observational coding for assessing therapist adherence and skill, particularly in contexts where session recordings are not feasible.
Collapse
Affiliation(s)
- Brigid R Marriott
- Department of Psychological Sciences, University of Missouri, Columbia, MO, 65211, USA
| | - Evelyn Cho
- Department of Psychological Sciences, University of Missouri, Columbia, MO, 65211, USA
| | - Siena K Tugendrajch
- Department of Psychological Sciences, University of Missouri, Columbia, MO, 65211, USA
| | - Matthew D Kliethermes
- Children's Advocacy Services of Greater St. Louis, Department of Psychological Sciences, University of Missouri-St. Louis (UMSL), St. Louis, MO, USA
| | - J Curtis McMillen
- School of Social Service Administration, University of Chicago, Chicago, IL, USA
| | - Enola K Proctor
- Center for Mental Health Services Research, Brown School of Social Work, Washington University in St. Louis, St. Louis, MO, USA
| | - Kristin M Hawley
- Department of Psychological Sciences, University of Missouri, Columbia, MO, 65211, USA.
| |
Collapse
|
10
|
Restivo JL, Mitchell L, Joshi U, Anand A, Gugiu PC, Singla DR, Hollon SD, Patel V, Naslund JA, Cooper Z. Assessing health worker competence to deliver a brief psychological treatment for depression: development and validation of a scalable measure. JOURNAL OF BEHAVIORAL AND COGNITIVE THERAPY 2020; 30:253-266. [PMID: 33409505 PMCID: PMC7785103 DOI: 10.1016/j.jbct.2020.10.001] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
Abstract
Increased interest in disseminating and implementing psychological treatments has focused on the need for evidence-based training programs for providers, especially those without specialized training. To evaluate provider-training programs, validated outcome measures are necessary; however, the scalable measurement of training outcomes has been largely overlooked. Current methods of assessing providers' ability to deliver psychological treatments are generally time-consuming and costly, representing a major bottleneck in scaling up mental health care for commonly occurring disorders such as depression. The present study describes the development and initial validation of a scalable measure for assessing provider competence in delivering a brief behavioral activation treatment for depression, called the Healthy Activity Program, adapted for primary care settings. The measure focuses on testing knowledge about the treatment and applied knowledge regarding how to skillfully deliver the treatment, both essential features of competence. The measure was tested on a sample of 531 respondents with a variety of educational levels and professional backgrounds and found to meet the requirements of the Rasch model. Three versions of the measure each of equal difficulty were derived to allow repeat testing of training outcomes over time. A scalable measure of provider competence is an essential first step towards supporting the wider dissemination and implementation of brief psychological interventions for depression, especially in low-resource settings.
Collapse
Affiliation(s)
- Juliana L Restivo
- Department of Global Health and Social Medicine, Harvard Medical School, 641 Huntington Ave. Boston, USA 02446
| | - Lauren Mitchell
- Department of Global Health and Social Medicine, Harvard Medical School, 641 Huntington Ave. Boston, USA 02446
| | - Udita Joshi
- Sangath, 120, Deepak Society, Chuna Bhatti, Bhopal Madhya Pradesh, India - 462016
| | - Aditya Anand
- Sangath, 120, Deepak Society, Chuna Bhatti, Bhopal Madhya Pradesh, India - 462016
| | - P Cristian Gugiu
- Clinical Outcomes Solutions, 53 West Jackson Boulevard, Suite 1150, Chicago, IL, USA 60604
| | - Daisy R Singla
- Department of Psychiatry, University of Toronto and Sinai Health, Mount Sinai Hospital, 600 University Ave, 914A, Toronto, ON, M5G 1X5
| | - Steven D Hollon
- Department of Psychology, Vanderbilt University, PMB 407817, 2301 Vanderbilt Place Nashville, TN 37240-7817 USA
| | - Vikram Patel
- Department of Global Health and Social Medicine, Harvard Medical School, 641 Huntington Ave. Boston, USA 02446
- Department of Global Health and Population, Harvard T.H. Chan School of Public Health, 655 Huntington Ave, Boston, MA 02115, USA
| | - John A Naslund
- Department of Global Health and Social Medicine, Harvard Medical School, 641 Huntington Ave. Boston, USA 02446
| | - Zafra Cooper
- Department of Psychiatry, Yale School of Medicine, 300 George St #901, New Haven, CT 06511, USA
| |
Collapse
|
11
|
Muke SS, Tugnawat D, Joshi U, Anand A, Khan A, Shrivastava R, Singh A, Restivo JL, Bhan A, Patel V, Naslund JA. Digital Training for Non-Specialist Health Workers to Deliver a Brief Psychological Treatment for Depression in Primary Care in India: Findings from a Randomized Pilot Study. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2020; 17:E6368. [PMID: 32883018 PMCID: PMC7503742 DOI: 10.3390/ijerph17176368] [Citation(s) in RCA: 32] [Impact Index Per Article: 6.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/30/2020] [Revised: 08/23/2020] [Accepted: 08/28/2020] [Indexed: 12/13/2022]
Abstract
Introduction: Task sharing holds promise for scaling up depression care in countries such as India, yet requires training large numbers of non-specialist health workers. This pilot trial evaluated the feasibility and acceptability of a digital program for training non-specialist health workers to deliver a brief psychological treatment for depression. Methods: Participants were non-specialist health workers recruited from primary care facilities in Sehore, a rural district in Madhya Pradesh, India. A three-arm randomized controlled trial design was used, comparing digital training alone (DGT) to digital training with remote support (DGT+), and conventional face-to-face training. The primary outcome was the feasibility and acceptability of digital training programs. Preliminary effectiveness was explored as changes in competency outcomes, assessed using a self-reported measure covering the specific knowledge and skills required to deliver the brief psychological treatment for depression. Outcomes were collected at pre-training and post-training. Results: Of 42 non-specialist health workers randomized to the training programs, 36 including 10 (72%) in face-to-face, 12 (86%) in DGT, and 14 (100%) in DGT+ arms started the training. Among these participants, 27 (64%) completed the training, with 8 (57%) in face-to-face, 8 (57%) in DGT, and 11 (79%) in DGT+. The addition of remote telephone support appeared to improve completion rates for DGT+ participants. The competency outcome improved across all groups, with no significant between-group differences. However, face-to-face and DGT+ participants showed greater improvement compared to DGT alone. There were numerous technical challenges with the digital training program such as poor connectivity, smartphone app not loading, and difficulty navigating the course content-issues that were further emphasized in follow-up focus group discussions with participants. Feedback and recommendations collected from participants informed further modifications and refinements to the training programs in preparation for a forthcoming large-scale effectiveness trial. Conclusions: This study adds to mounting efforts aimed at leveraging digital technology to increase the availability of evidence-based mental health services in primary care settings in low-resource settings.
Collapse
Affiliation(s)
- Shital S. Muke
- Sangath, 120 Deepak Society, Chuna Bhatti, Kolar Road, Bhopal 462016, India; (S.S.M.); (D.T.); (U.J.); (A.A.); (A.K.); (R.S.); (A.S.); (A.B.)
| | - Deepak Tugnawat
- Sangath, 120 Deepak Society, Chuna Bhatti, Kolar Road, Bhopal 462016, India; (S.S.M.); (D.T.); (U.J.); (A.A.); (A.K.); (R.S.); (A.S.); (A.B.)
| | - Udita Joshi
- Sangath, 120 Deepak Society, Chuna Bhatti, Kolar Road, Bhopal 462016, India; (S.S.M.); (D.T.); (U.J.); (A.A.); (A.K.); (R.S.); (A.S.); (A.B.)
| | - Aditya Anand
- Sangath, 120 Deepak Society, Chuna Bhatti, Kolar Road, Bhopal 462016, India; (S.S.M.); (D.T.); (U.J.); (A.A.); (A.K.); (R.S.); (A.S.); (A.B.)
| | - Azaz Khan
- Sangath, 120 Deepak Society, Chuna Bhatti, Kolar Road, Bhopal 462016, India; (S.S.M.); (D.T.); (U.J.); (A.A.); (A.K.); (R.S.); (A.S.); (A.B.)
| | - Ritu Shrivastava
- Sangath, 120 Deepak Society, Chuna Bhatti, Kolar Road, Bhopal 462016, India; (S.S.M.); (D.T.); (U.J.); (A.A.); (A.K.); (R.S.); (A.S.); (A.B.)
| | - Abhishek Singh
- Sangath, 120 Deepak Society, Chuna Bhatti, Kolar Road, Bhopal 462016, India; (S.S.M.); (D.T.); (U.J.); (A.A.); (A.K.); (R.S.); (A.S.); (A.B.)
| | - Juliana L. Restivo
- Department of Global Health and Social Medicine, Harvard Medical School, Boston, MA 02115, USA; (J.L.R.); (V.P.)
| | - Anant Bhan
- Sangath, 120 Deepak Society, Chuna Bhatti, Kolar Road, Bhopal 462016, India; (S.S.M.); (D.T.); (U.J.); (A.A.); (A.K.); (R.S.); (A.S.); (A.B.)
| | - Vikram Patel
- Department of Global Health and Social Medicine, Harvard Medical School, Boston, MA 02115, USA; (J.L.R.); (V.P.)
- Department of Global Health and Population, Harvard TH Chan School of Public Health, Boston, MA 02115, USA
| | - John A. Naslund
- Department of Global Health and Social Medicine, Harvard Medical School, Boston, MA 02115, USA; (J.L.R.); (V.P.)
| |
Collapse
|
12
|
Development and evaluation of a measure of treatment knowledge in guided self-help for eating disorders in a sample of healthcare students and professionals. Eat Weight Disord 2020; 25:833-839. [PMID: 31243739 PMCID: PMC7399678 DOI: 10.1007/s40519-019-00737-1] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/01/2019] [Accepted: 06/14/2019] [Indexed: 11/13/2022] Open
Abstract
PURPOSE The current study describes the development of a measure designed to assess treatment-specific competence in guided self-help (GSH) for eating disorders. The aim is to assess healthcare professionals' understanding of a popular treatment manual and associated material. METHODS After initial item development from a review of relevant literature, a range of healthcare staff and students (N = 127) completed a knowledge questionnaire. From these data, estimates of psychometric properties were made and a subset of the original sample completed the measure again after 6 weeks. RESULTS The final questionnaire consists of 40 items, demonstrating acceptable content validity, internal consistency, and reliability. Significant differences in the number of questions answered correctly were observed between experts in GSH and those with less experience. CONCLUSIONS This questionnaire offers a means of assessing therapist knowledge of GSH which demonstrates good psychometric properties. Further testing of this instrument is required to establish its full applicability. LEVEL OF EVIDENCE Level IV.
Collapse
|
13
|
Raviola G, Naslund JA, Smith SL, Patel V. Innovative Models in Mental Health Delivery Systems: Task Sharing Care with Non-specialist Providers to Close the Mental Health Treatment Gap. Curr Psychiatry Rep 2019; 21:44. [PMID: 31041554 DOI: 10.1007/s11920-019-1028-x] [Citation(s) in RCA: 92] [Impact Index Per Article: 15.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/28/2022]
Abstract
PURPOSE OF REVIEW Most people do not have access to adequate mental health care, and lack of skilled human resources is a major factor. We provide a narrative review of approaches to implementing task sharing-engaging non-specialist providers-to deliver mental health care. RECENT FINDINGS There is strong evidence both for the effectiveness of task sharing as a means of delivering care for a range of conditions across settings and for the effectiveness of non-specialist providers and health workers in delivering elements of culturally adapted psychosocial and psychological interventions for common and severe mental disorders. Key approaches to facilitate task sharing of care include balanced care, collaborative care, sustained training and supervision, use of trans-diagnostic interventions based on a dimensional approach to wellness and illness, and the use of emerging digital technologies. Non-specialist providers and health workers are well positioned to deliver evidence-based interventions for mental disorders, and a variety of delivery approaches can support, facilitate, and sustain this innovation. These approaches should be used, and evaluated, to increase access to mental health services.
Collapse
Affiliation(s)
- Giuseppe Raviola
- Department of Global Health and Social Medicine, Harvard Medical School, 641 Huntington Avenue, Boston, MA, 02115, USA. .,Department of Psychiatry, Boston Children's Hospital, 300 Longwood Avenue, Boston, MA, 02115, USA.
| | - John A Naslund
- Department of Global Health and Social Medicine, Harvard Medical School, 641 Huntington Avenue, Boston, MA, 02115, USA
| | - Stephanie L Smith
- Department of Psychiatry, Brigham and Women's Hospital, 75 Francis Street, Boston, MA, 02115, USA
| | - Vikram Patel
- Department of Global Health and Social Medicine, Harvard Medical School, 641 Huntington Avenue, Boston, MA, 02115, USA
| |
Collapse
|
14
|
O'Connor M, Morgan KE, Bailey-Straebler S, Fairburn CG, Cooper Z. Increasing the Availability of Psychological Treatments: A Multinational Study of a Scalable Method for Training Therapists. J Med Internet Res 2018; 20:e10386. [PMID: 29884606 PMCID: PMC6015265 DOI: 10.2196/10386] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2018] [Revised: 04/07/2018] [Accepted: 04/08/2018] [Indexed: 11/13/2022] Open
Abstract
BACKGROUND One of the major barriers to the dissemination and implementation of psychological treatments is the scarcity of suitably trained therapists. A highly scalable form of Web-centered therapist training, undertaken without external support, has recently been shown to have promise in promoting therapist competence. OBJECTIVE The aim of this study was to conduct an evaluation of the acceptability and effectiveness of a scalable independent form of Web-centered training in a multinational sample of therapists and investigate the characteristics of those most likely to benefit. METHODS A cohort of eligible therapists was recruited internationally and offered access to Web-centered training in enhanced cognitive behavioral therapy, a multicomponent, evidence-based, psychological treatment for any form of eating disorder. No external support was provided during training. Therapist competence was assessed using a validated competence measure before training and after 20 weeks. RESULTS A total of 806 therapists from 33 different countries expressed interest in the study, and 765 (94.9%) completed a pretraining assessment. The median number of training modules completed was 15 out of a possible 18 (interquartile range, IQR: 4-18), and 87.9% (531/604) reported that they treated at least one patient during training as recommended. Median pretraining competence score was 7 (IQR: 5-10, range: 0-19; N=765), and following training, it was 12 (IQR: 9-15, range: 0-20; N=577). The expected change in competence scores from pretraining to posttraining was 3.5 (95% CI 3.1-3.8; P<.001). After training, 52% (300/574) of therapists with complete competence data met or exceeded the competence threshold, and 45% (95% CI 41-50) of those who had not met this threshold before training did so after training. Compliance with training predicted both an increase in competence scores and meeting or exceeding the competence threshold. Expected change in competence score increased for each extra training module completed (0.19, 95% CI 0.13-0.25), and those who treated a suitable patient during training had an expected change in competence score 1.2 (95% CI 0.4-2.1) points higher than those who did not. Similarly, there was an association between meeting the competence threshold after training and the number of modules completed (odds ratio, OR=1.11, 95% CI 1.07-1.15), and treating at least one patient during training was associated with competence after training (OR=2.2, 95% CI 1.2-4.1). CONCLUSIONS Independent Web-centered training can successfully train large numbers of therapists dispersed across a wide geographical area. This finding is of importance because the availability of a highly scalable method of training potentially increases the number of people who might receive effective psychological treatments.
Collapse
Affiliation(s)
- Marianne O'Connor
- Centre for Research on Dissemination at Oxford, Department of Psychiatry, University of Oxford, Oxford, United Kingdom
| | - Katy E Morgan
- Department of Medical Statistics, London School of Hygiene and Tropical Medicine, University of London, London, United Kingdom
| | - Suzanne Bailey-Straebler
- Centre for Research on Dissemination at Oxford, Department of Psychiatry, University of Oxford, Oxford, United Kingdom
| | - Christopher G Fairburn
- Centre for Research on Dissemination at Oxford, Department of Psychiatry, University of Oxford, Oxford, United Kingdom
| | - Zafra Cooper
- Centre for Research on Dissemination at Oxford, Department of Psychiatry, University of Oxford, Oxford, United Kingdom
- Department of Psychiatry, Yale School of Medicine, Yale University, New Haven, CT, United States
| |
Collapse
|