Attitudes toward standardized assessment tools and their use among clinicians in a public mental health service

Clinicians' perceptions and practices of diagnostic assessment in psychiatric services

BACKGROUND

Diagnostic assessment in psychiatric services typically involves applying clinical judgment to information collected from patients using multiple sources, including anamnesis and structured diagnostic interviews. Research shows that clinicians' perceptions of diagnostic assessment are associated with their diagnostic practices, and that perceptions and practices may vary according to clinician characteristics. Examining clinicians' perceptions and practices of diagnostic assessment is important for quality improvement in psychiatric services, including implementation of evidence-based practice procedures. The purpose of the present study was to evaluate clinicians' perceptions and practices of diagnostic assessment in psychiatric services and examine whether these perceptions and practices varied according to profession and age, with the aim of providing a basis for quality improvement.

METHODS

A total of 183 (53.2%) clinicians in community-based adult psychiatric services in Stockholm, Sweden participated in an online survey. Differences between professions were analyzed using Kruskal-Wallis tests and effect sizes were calculated. Associations of clinicians' perceptions with their age were examined using Spearman correlations.

RESULTS

Overall, clinicians had positive attitudes toward diagnostic assessment, and they considered themselves as competent. Differences were as most pronounced between nurses and other professions. Nursed had conducted fewer assessments, perceived themselves as less competent, and reported to a smaller extent to be able to determine which diagnosis should be the target for treatment in patients with multiple diagnoses. There were no associations of clinicians' perceptions with their age. Some potential areas of improvement were identified, including clinician qualifications, education in diagnostic assessment, and contents of diagnostic assessment.

CONCLUSIONS

The results of the present study may provide a basis for quality improvement in psychiatric services. For example, it may be important to pay attention to potential differences in perceptions and practices between professions in efforts to improve quality of assessment and care.

Routine Outcome Monitoring (ROM) and Feedback: Research Review and Recommendations

OBJECTIVE

To provide a research review of the components and outcomes of routine outcome monitoring (ROM) and recommendations for research and therapeutic practice.

METHOD

A narrative review of the three phases of ROM - data collection, feeding back data, and adapting therapy - and an overview of patient outcomes from 11 meta-analytic studies.

RESULTS

Patients support ROM when its purpose is clear and integrated within therapy. Greater frequency of data collection is more important for shorter-term therapies, and use of graphs, greater specificity of feedback, and alerts are helpful. Overall effects on patient outcomes are statistically significant (g ≈ 0.15) and increase when clinical support tools (CSTs) are used for not-on-track cases (g ≈ 0.36-0.53). Effects are additive to standard effects of psychological therapies. Organizational, personnel, and resource issues remain the greatest obstacles to the successful adoption of ROM.

CONCLUSION

ROM offers a low-cost method for enhancing patient outcomes, on average resulting in an ≈ 8% advantage (success rate difference; SRD) over standard care. CSTs are particularly effective for not-on-track patients (SRD between ≈ 20% and 29%), but ROM does not work for all patients and successful implementation is a major challenge, along with securing appropriate cultural adaptations.

Measurement feedback system implementation in public youth mental health treatment services: a mixed methods analysis

BACKGROUND

Prior studies indicate the effectiveness of measurement-based care (MBC), an evidence-based practice, in improving and accelerating positive outcomes for youth receiving behavioral health services. MBC is the routine collection and use of client-reported progress measures to inform shared decision-making and collaborative treatment adjustments and is a relatively feasible and scalable clinical practice, particularly well-suited for under-resourced community mental health settings. However, uptake of MBC remains low, so information on determinants related to MBC practice patterns is needed.

METHODS

Quantitative and qualitative data from N = 80 clinicians who implemented MBC using a measurement feedback system (MFS) were merged to understand and describe determinants of practice over three study phases. Quantitative, latent class analysis identified clinician groups based on participants' ratings of MFS acceptability, appropriateness, and feasibility and describes similarities/differences between classes in clinician-level characteristics (e.g., age; perceptions of implementation climate; reported MFS use; phase I). Qualitative analyses of clinicians' responses to open-ended questions about their MFS use and feedback about the MFS and implementation supports were conducted separately to understand multi-level barriers and facilitators to MFS implementation (phase II). Mixing occurred during interpretation, examining clinician experiences and opinions across groups to understand the needs of different classes of clinicians, describe class differences, and inform selection of implementation strategies in future research (phase III).

RESULTS

We identified two classes of clinicians: "Higher MFS" and "Lower MFS," and found similarities and differences in MFS use across groups. Compared to Lower MFS participants, clinicians in the Higher MFS group reported facilitators at a higher rate. Four determinants of practice were associated with the uptake of MBC and MFS in youth-serving community mental health settings for all clinicians: clarity, appropriateness, and feasibility of the MFS and its measures; clinician knowledge and skills; client preferences and behaviors; and incentives and resources (e.g., time; continuing educational support). Findings also highlighted the need for individual-level implementation strategies to target clinician needs, skills, and perceptions for future MBC and MFS implementation efforts.

CONCLUSION

This study has implications for the adoption of evidence-based practices, such as MBC, in the context of community-based mental health services for youth.

The Partners for Change Outcome Management System in the psychotherapeutic treatment of cannabis use: a pilot effectiveness randomized clinical trial

PURPOSE

The aim of the study was to investigate the effectiveness of the Partners for Change Outcome Management System (PCOMS) in improving the retention rate and reducing drug use in a clinic for drug use treatment.

MATERIAL AND METHODS

One-hundred outpatients with cannabis use as the primary presenting problem were randomized to either the PCOMS (n = 51) or treatment as usual (TAU; n = 49). Eight weekly psychotherapy sessions were planned in both conditions. The primary outcome was treatment retention measured as the rate of attendance to planned treatment sessions and dropout. The secondary outcomes were current cannabis and other drug use assessed with the European Addiction Severity Index (EuropASI). Several explorative outcomes were analyzed. Blind assessments of drug use were conducted three and six months after baseline. Outcome analyses were conducted on both the treated sample with at least one psychotherapy session (n = 82) and the intention-to-treat sample (n = 100).

RESULTS

The results showed no incremental effect of the PCOMS compared to the TAU condition, for neither treatment retention, drug use, or therapeutic alliance.

CONCLUSION

The main findings align with previous studies that have found no effect of the PCOMS when employing outcome measures independent from the PCOMS intervention. The results are interpreted with caution due to implementation difficulties, which at the same time suggest challenges when employing the PCOMS in large outpatient clinics for drug use treatment.

Applying behaviour change theory to understand the barriers to implementing routine outcome monitoring

BACKGROUND

Routine outcome monitoring (ROM) is a valuable tool for monitoring client progress and pre-empting deterioration, however, there is considerable variation in how data are collected and recorded and uptake in clinical practice remains low. The aim of this study was to develop a self-report measure of practitioner attitudes to ROM in order to better understand the barriers to successful implementation in Child and Adolescent Mental Health Services (CAMHS).

METHODS

An anonymous survey was completed by 184 CAMHS practitioners in the United Kingdom. The survey was designed using the Capability, Opportunity, and Motivation Model of Behaviour (COM-B). Practitioners who reported using ROM frequently in their clinical work (53%) were compared to those who used ROM infrequently (47%) across dimensions of the COM-B survey subscales.

RESULTS

Confirmatory factor analysis confirmed the proposed four-factor structure, showing acceptable model fit, with high factor loadings and good reliability for all subscales. Frequent users of ROM exhibited significantly higher psychological capability, physical opportunity, social opportunity, and motivation, compared to infrequent users F (4, 140) = 14.76, p < .0001; Pillai's Trace = .297, partial η²  = .30. Results highlight several barriers to ROM, including the belief that there is not a strong evidence base for ROM, not receiving external training, and not discussing feedback and outcome data in supervision.

IMPLICATIONS

In the hope of improving the successful implementation of ROM, this research provides an evidence-based tool for assessing practitioners' attitudes to ROM, which map on to intervention functions and represent targets for future implementation efforts.

PRACTITIONER POINTS

The value of routine outcome monitoring (ROM) as a means to measure client progress and to elevate the efficiency and quality of mental health care is well-documented in the research literature, however, uptake in practice remains relatively low. This study applied behaviour change theory to develop a psychometrically sound self-report measure of practitioners' perspectives and practices to understand the barriers to implementation in child and adolescent mental health services in the United Kingdom. The complex and multifaceted nature of the barriers to implementation requires multilevel behaviour change strategies at the client, clinician, and organisational level. Recommendations for practice include the need for integrated, multilevel strategies aimed at improving practitioners' capabilities and motivations, strong organisational leadership and a culture of data gathering and sharing, and implementation interventions, which are tailored to target local barriers.

Introducing a Measurement Feedback System for Youth Mental Health: Predictors and Impact of Implementation in a Community Agency

Measurement feedback systems (MFSs) that routinely collect and report client progress to mental health therapists have demonstrated beneficial impact on outcomes in numerous studies, with evidence that there is a dose-response relationship related to the implementation of the MFS. The current study examined the impact of MFS implementation (Implementation Index) on youth symptom outcomes separately by caregiver and youth self-report. Additionally, we tested the extent to which Implementation Index rates varied by individual therapists and clients, and whether therapist and client characteristics predicted MFS implementation. Methods: Administrative data (client charts, youth- and caregiver-reported Youth Outcome Questionnaires) for 229 youth (52.83% Latinx, 42.79% girls, M age = 10.33) treated during a 1-year period at a community mental health organization in Central Texas were analyzed using multi-level modeling. Caregiver-reported symptoms decreased faster for those with a higher MFS Implementation Index. Between-group differences among therapists accounted for a significant proportion of variance in the Implementation Index for caregiver report, whereas client differences accounted for most of the variance in the Implementation Index for youth self-report. Therapist trainee status predicted a significant increase in the Implementation Index for caregiver-report data. Youth symptom improvement as reported by caregivers varied with the extent of MFS implementation fidelity, and MFS implementation fidelity was higher for clients treated by trainees relative to staff therapists for caregiver report of symptoms.

Schizotypal traits in Swedish speaking psychiatric patients and non-psychiatric controls

Introduction: Recently, schizotypal personality traits were measured in a multinational sample recruited from 14 countries, however no Scandinavian cohort was included. The aim of this study was, therefore, to measure schizotypal personality traits in Swedish-speaking populations, with and without psychiatric disorders, and to investigate the psychometric properties of the Swedish version of the Schizotypal Personality Questionnaire-Brief (SPQ-B).Methods: The SPQ-B results from 50 psychiatric patients were compared to controls (n = 202). An additional sample of 25 controls completed the full SPQ twice and we calculated test-retest reliability for SPQ and SPQ-B. We estimated the internal consistency for SPQ-B and SPQ-B factors with omega. We compared the results of SPQ-B (M and SD) in patient and control groups to corresponding results worldwide.Results: We found similarity between our SPQ-B scores and those from other published samples. SPQ-B showed good internal consistency and acceptable test-retest correlations. The results indicate that the Swedish version of the instrument is valid and can differentiate psychiatric cohorts from non-psychiatric controls.Conclusion: The Swedish version of the SPQ-B exhibit good psychometric properties and is useful for assessing schizotypal traits in clinical and non-clinical populations.

Physician estimated vs. self-reported subjective memory in depressed patients treated with electroconvulsive therapy

Background: Subjective memory deficits are common in depression and during series of treatment with electroconvulsive therapy (ECT). There is a need for feasible assessment of memory deficit. In the Swedish National Quality Register for ECT, patients' subjective memory function is rated by a clinician. Self-ratings would be easier to administer.Objectives: The aim of this study was to analyze the consistency between self-reported and physician estimated subjective memory in depressed patients treated with ECT.Methods: Fifty-two inpatients treated with ECT for major- or bipolar depression were recruited and 41 of them completed the study protocol. Each patient rated their own subjective memory and had it rated in an interview by a physician both before/in the beginning of the ECT series and after the ECT series. The patients' memory was rated and self-rated with the memory item in the Comprehensive Psychopathological Rating Scale (CPRS). We then analyzed correlations, and differences in distributions, between self-reported assessment and physician estimates of patients' subjective memory.Results: The correlations between the self-reported and the physician estimated ratings of subjective memory were 0.699 (p < .01) in baseline ratings and 0.651 (p < .01) in post-treatment ratings. These correlations were relatively high compared to a previous study on self-reported vs. physician estimated CPRS ratings.Conclusions: Based on the results in this study, we propose that patients' self-ratings of subjective memory in association with ECT can be used instead of a physician's rating of patients' subjective memory.

The interRAI Suite of Mental Health Assessment Instruments: An Integrated System for the Continuum of Care

The lives of persons living with mental illness are affected by psychological, biological, social, economic, and environmental factors over the life course. It is therefore unlikely that simple preventive strategies, clinical treatments, therapeutic interventions, or policy options will succeed as singular solutions for the challenges of mental illness. Persons living with mental illness receive services and supports in multiple settings across the health care continuum that are often fragmented, uncoordinated, and inadequately responsive. Appropriate assessment is an important tool that health systems must deploy to respond to the strengths, preferences, and needs of persons with mental illness. However, standard approaches are often focused on measurement of psychiatric symptoms without taking a broader perspective to address issues like growth, development, and aging; physical health and disability; social relationships; economic resources; housing; substance use; involvement with criminal justice; stigma; and recovery. Using conglomerations of instruments to cover more domains is impractical, inconsistent, and incomplete while posing considerable assessment burden. interRAI mental health instruments were developed by a network of over 100 researchers, clinicians, and policy experts from over 35 nations. This includes assessment systems for adults in inpatient psychiatry, community mental health, emergency departments, mobile crisis teams, and long-term care settings, as well as a screening system for police officers. A similar set of instruments is available for child/youth mental health. The instruments form an integrated mental health information system because they share a common assessment language, conceptual basis, clinical emphasis, data collection approach, data elements, and care planning protocols. The key applications of these instruments include care planning, outcome measurement, quality improvement, and resource allocation. The composition of these instruments and psychometric properties are reviewed, and examples related to homeless are used to illustrate the various applications of these assessment systems.