Attitudes of Austrian Psychotherapists Towards Process and Outcome Monitoring

Bridging the feedback implementation gap: A comparison of empirical and rational decision rules in naturalistic psychotherapy

Objective: Previous research indicates positive effects of feedback based on rational or empirical decision rules in psychotherapy. The implementation of these usually session-to-session-based feedback systems into clinical practice, however, remains challenging. This study aims to evaluate decision rules based on routine outcome monitoring with reduced assessment frequency. Method: Data routinely collected every 5-20 sessions of N = 3758 patients treated with CBT in an outpatient clinic (Msessions = 42.8, SD = 15.4) were used to develop feedback decision rules based on the expected treatment response and nearest neighbors approach, the reliable change index, and method of percental improvement. The detection of patients at risk of treatment failure served as primary endpoint. Results: Significantly lower reliable improvement, higher reliable deterioration rates, and smaller effect sizes were found for patients identified at risk of treatment failure by all rules. The nearest neighbors-based approach showed the highest sensitivity regarding the detection of reliably deteriorated cases. Conclusion: Consistent with previous research, the empirical models outperformed the rational rules. Still, the first-time used percental improvement-based rule also showed satisfactory results. Overall, the results point to the potential of basic feedback systems that might be easier to implement in practice than session-to-session based systems.

Routine Outcome Monitoring from Psychotherapists' Perspectives: A Framework Analysis Study of Expected Benefits and Difficulties

Psychotherapists' attitudes and expectations towards routine outcome monitoring can impact the likelihood of its fruitful implementation. While existing studies have predominantly focused on Europe and North America, research in Latin America remains limited. The aim of this study is to explore therapists' expected benefits and difficulties prior to implementing a routine outcome monitoring system in a university psychotherapy service in Ecuador. An exploratory and descriptive cross-sectional qualitative study was carried out with 20 participants aged 21 to 47. Semi-structured interviews were conducted to explore participants' knowledge about routine outcome monitoring, their expectations of the difficulties, benefits, usability and risks of using a monitoring system, as well as their expectations about their role in the process. The data analysis adhered to the framework analysis methodology, leading to the identification of six overarching themes, 36 specific themes and 82 subthemes. The interviews highlighted a spectrum of positive and negative expectations at several levels: institutional/general, therapeutic process, therapists, and clients. Perceived benefits encompassed various aspects, including the availability of supplementary information, continuous adaptation of the therapeutic process, facilitation of organization and treatment planning, opportunities for professional development, and fostering patient trust and empowerment. On the other hand, anticipated difficulties comprised concerns such as discomfort among therapists and clients, increased workload, system usage and technical difficulties, and the risk of excessive quantification. Overall, participants expressed more anticipated benefits than difficulties. We present recommendations that can support and optimize the current local implementation efforts of routine outcome monitoring, both within this service and in other settings. These recommendations consider ways to meet positive expectations and address or mitigate negative ones.

Process and outcome of outpatient psychotherapies under clinically representative conditions in Austria: protocol and feasibility of an ongoing study

Background

While most studies assessing psychotherapy efficacy are randomized-controlled trials conducted in research institutions or short clinical treatments, the understanding of psychotherapy effectiveness under regular, clinically representative conditions, particularly in outpatient practice, remains limited. Representative data examining the effectiveness of psychotherapy under real-world conditions in Austria is lacking.

Aims and Methods

This paper introduces a naturalistic observational combined process- and outcome study, implementing a dual-perspective approach through standardised pre- and post-treatment questionnaires and evaluating changes in the therapeutic alliance after each session. Further, semi-structured qualitative interviews aim to illuminate the personal experiences of patients and therapists. The primary objective of the presented study is to discern whether symptoms markedly decrease following therapy. A significant secondary goal is to trace the therapeutic alliance's evolution from both patient and therapist viewpoints, emphasising the alliance-outcome association and gender dynamics within the pairs. This paper discusses the project's feasibility after three years and shares key insights.

Discussion

Recruitment for this study has posed substantial challenges due to psychotherapists' concerns regarding data protection, extensive documentation, and philosophical reservations about the study design. Consequently, we recruited fewer participants than initially planned. Despite these hurdles, qualitative data collection has shown notable success. Given psychotherapists' busy schedules and reluctance to participate, more potent external incentives or a legal obligation may be necessary to encourage participation in future studies.

Therapists' and patients' experiences of using patients' self-reported data in ongoing psychotherapy processes-A systematic review and meta-analysis of qualitative studies

OBJECTIVE

Using patient-generated quantitative data in psychotherapy (feedback) appears to enhance treatment outcome, but there is variability in its effect. Different ways and reasons to implement routine outcome measurement might explain such variability. The goal of this review is to address the insufficient knowledge on how these data are used by therapists and patients.

METHODS

The present study is a systematic review and meta-analysis of qualitative reports of therapists' and patients' experiences using patient-generated quantitative data during ongoing psychotherapy.

RESULTS

Four main categories of use were identified: (1) uses of patients' self-reported data as nomothetic/objective markers for assessment, process monitoring, and treatment planning; (2) intrapersonal uses that enhance self-awareness, initiate reflection, and influence patients' mood or responses; (3) uses that prompt interactional processes by facilitating communication, supporting exploration, creating ownership in patients, changing treatment focus, enhancing therapeutic alliance, or disturbing the psychotherapy process; and (4) patients responding for specific purposes due to uncertainty and interpersonal motives, or strategic responding to achieve a desired result.

CONCLUSION

These results demonstrate that patient-reported data, when used in active psychotherapy, is very clearly not just an objective measurement of client functioning: the inclusion of patient-data has the potential to influence psychotherapy in numerous ways.

Determinants of psychotherapists' attitudes to online psychotherapy

Introduction

Online psychotherapy is a form of work that is becoming more and more popular. Public health problems, such as COVID-19, forced mental health professionals and patients to incorporate new methodologies such as the use of electronic media and internet to provide follow-up, treatment and also supervision. The aim of this study was to investigate which factors shape the therapists' attitudes toward online psychotherapy during a pandemic taking into account: (1) attitudes toward the COVID-19 pandemic (fear of contagion, pandemic fatigue, etc.), (2) personal characteristics of the psychotherapists (age, gender, feeling of efficacy, anxiety, depression, etc.), and (3) characteristics of the psychotherapeutic practice (guideline procedure, client age group, professional experience, etc).

Materials and methods

Study participants were 177 psychotherapists from four European countries: Poland (n = 48), Germany (n = 44), Sweden (n = 49), and Portugal (n = 36). Data were collected by means of an individual online survey through the original questionnaire and the standardized scales: a modified version of the Attitudes toward Psychological Online Interventions Scale (APOI), Fear of Contagion by COVID-19 Scale (FCS COVID-19), Pandemic Fatigue Scale (PFS), Hospital Anxiety and Depression Scale (HADS), Social Support Questionnaire (F-SozU K-14), and the Sense of Efficiency Test (SET).

Results

Determinants that impacted psychotherapists' attitudes toward online therapy were: COVID-19 belief in prevention-keeping distance and hand disinfection, pandemic behavioral fatigue, previous online therapy experience (including voice call), working with youth and adults. Our study showed that belief in the sense of prevention in the form of taking care of hand disinfection before the session, pandemic behavioral fatigue and experience in working with adults were significant predictors of negative attitudes of therapists toward online psychological interventions. On the other hand, belief in the sense of prevention in the form of keeping distance during the session had a positive effect on general attitudes toward therapy conducted via the internet.

Discussion

The online therapy boom during the COVID-19 pandemic has spawned a powerful tool for psychotherapists. More research in this area and training of psychotherapists are needed for online psychological interventions to become an effective therapy format that is accepted by patients and therapists alike.

How patients and clinicians experience the utility of a personalized clinical feedback system in routine practice

OBJECTIVE

The objective was to explore how a person-adaptive clinical feedback system (CFS) effects its users, and how meaning and relevance are negotiated.

METHODS

We conducted a 10-month case-study of the implementation and practice of Norse Feedback, a personalized CFS. The data material consisted of 12 patient interviews, 22 clinician interviews, 23 field notes, and 16 archival documents.

RESULTS

We identified four main categories or themes: (i) patients' use of clinical feedback for enhanced awareness and insight; (ii) patients work to make clinical feedback a communication mode; (iii) patients and clinicians negotiate clinical feedback as a way to influence treatment; and (iv) clinical feedback requires an interactive sense-making effort.

CONCLUSION

Patients and therapists produced the meaning and relevance of the CFS by interpreting the CFS measures to reflect the unique patient experience of the patient-therapist relationship. Patients regarded CFS as a tool to inform therapy with important issues. Patients became more self-aware and prepared for therapy.

Theory of Planned Behavior: Exploring the Use of Digital Mental Health Interventions in Israel

ABSTRACT

Based on the theory of planned behavior (TPB), this study aimed to examine factors influencing therapist uptake of digital mental health interventions in Israel. Two hundred twenty-nine mental health professionals recruited through a convenience sample completed a background and demographic questionnaire, as well as the TPB-based electronic-therapy attitudes and process questionnaire. Regressions were used to examine the contribution of attitudes, perceived behavioral control, subjective norms, and behavioral intentions. Intention to use and use of digital interventions were significantly predicted by attitudes, subjective norms, and perceived behavioral control, as suggested by the TPB. The use of cognitive behavioral therapy (CBT) and higher perceived behavioral control increased the likelihood of using digital interventions. Having a positive attitude, having expectations/social pressure from one's professional environment, and having a sense of control over the process were found to predict the intent to use, as well as the actual use of, digital interventions.

Implementation facilitation strategies to promote routine progress monitoring among community therapists

Despite substantial support for the importance of routine progress monitoring (RPM) as part of evidence-based practice, few providers utilize measurement-based care. This study sought to identify the relative importance of facilitation strategies viewed as most helpful for increasing intention to use RPM among 388 ethnically diverse community therapists serving children and families. Four types of facilitation strategies were examined: language/interpretability, automation, staffing/access, and requirements. Mixed analyses of variance found that therapists' reported intentions to use RPM were more influenced by strategies of automating assessment administration, provision of clerical assistance, and agency requirements than by making linguistically appropriate measures available. However, the importance of strategies differed depending on therapist race/ethnicity and current RPM use. Language/interpretability of RPM assessments was less emphasized for non-Hispanic White therapists and therapists who have not yet or only minimally adopted RPM compared with ethnic minority therapists and therapists who regularly use RPM, respectively. Furthermore, therapists who were not current RPM users emphasized automation more than staffing/access. Results may inform prioritization of implementation facilitation strategies for agencies to encourage RPM. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Evaluation of an Online System for Routine Outcome Monitoring: Cross-sectional Survey Study

BACKGROUND

The use of routine outcome monitoring (ROM) in the treatment of mental health has emerged as a method of improving psychotherapy treatment outcomes. Despite this, very few clinicians regularly use ROM in clinical practice. Online ROM has been suggested as a solution to increase adoption.

OBJECTIVE

The aim of this study is to identify the influence of moving ROM online on client completion rates of self-reported outcome measures and to identify implementation and utilization barriers to online ROM by assessing clinicians' views on their experience using the online system over previous paper-based methods.

METHODS

Client completion rates of self-reported outcome measures were compared pre- and postimplementation of an online system of ROM. In addition, a survey questionnaire was administered to 324 mental health service providers regarding their perception of the benefits with an online system of ROM.

RESULTS

Client completion rates of self-reported measures increased from 15.62% (427/2734) to 53.98% (1267/2347) after they were moved online. Furthermore, 57% (56/98) of service providers found the new system less time-consuming than the previous paper-based ROM, and 64% (63/98) found that it helped monitor clients. However, the perceived value of the system remains in doubt as only 23% (23/98) found it helped them identify clients at risk for treatment failure, and only 18% (18/98) found it strengthened the therapeutic alliance.

CONCLUSIONS

Although the current study suggests mixed results regarding service providers' views on their experience using an online system for ROM, it has identified barriers and challenges that are actionable for improvement.

Advantages and disadvantages of online and blended therapy: Replication and extension of findings on psychotherapists' appraisals

Therapists hold a key role for the uptake of digital mental health interventions (DMHI) within regular care services but have demonstrated cautious attitudes towards such interventions. It is relevant to explore in detail what factors may positively influence therapists' perception when considering DMHI implementation within routine care. We recently assessed therapist views towards Internet-based and blended treatment in Austria (low implementation level). The present study aims at testing the reliability of previous findings, and moreover, it compares therapists' appraisals to a country with advanced DMHI implementation (Sweden). An online survey was conducted February through June of 2019. Respondents were recruited via email and social media. The survey assessed first-hand experience with Internet-based treatment (IT) and blended treatment (BT). To start, the survey presented a short informational video to half of the respondents, then assessed therapists' views on 17 advantages and 13 disadvantages of IT and BT on 6-point Likert scales. In total N = 300 therapists responded to the invitation, of which N = 165 provided full survey data (Germany 114/220, 52%; Sweden 51/80, 64%). German therapists rated the advantages of IT and BT as neutral (IT, M = 3.6; BT, M = 3.8) and to some extent agreed with disadvantages of IT (IT, M = 4.5; BT, M = 3.5). In comparison, Swedish therapists rated significantly greater advantages (IT, M = 4.6; BT, M = 4.5) and less disadvantages (IT, M = 3.2; BT, M = 2.8). Effect sizes ranged from d = 0.89 to d = 1.83; all P's < .001. Those with first-hand experience with DMHI reported more positive appraisals in both countries. No significant effect was found for exposure to the short informational video. The German sample represented essential characteristics of current German therapists; in comparison Swedish respondents skewed towards younger less experienced therapists (P's < .001). Those confounders accounted for a small non-significant proportion of variance (0.1-4.7%). We found that therapists considered blended treatment to have less disadvantages than Internet treatment, and that first-hand experience with DMHI, but not exposure to an acceptance facilitating video clip, predicted greater acceptability on individual level. The responses among German therapists closely resembled findings from our preceding study in Austria, indicating that reliable results can be achieved in small survey studies if sample and population parameters correspond. Swedish therapists held significantly more favorable attitudes towards both interventions. The comparison between countries, however, is limited by a number of potential confounding variables.

Attitudes Towards the Use of Routine Outcome Monitoring of Psychological Therapies Among Mental Health Providers: The EBPAS-ROM

Implementation of routine outcome monitoring (ROM) in mental health care is progressing slowly. Knowledge about factors influencing ROM implementation, including health providers' attitudes towards ROM, is necessary. Based on a survey of 662 psychologists and nurses, this article describes (1) the development of a short instrument measuring provider attitudes towards ROM, derived from the Evidence-based Practice Attitude Scale (EBPAS), and (2) how attitudinal domains relate to clinicians' current use of standardized instruments for treatment evaluation. The EBPAS-ROM showed concurrent validity in predicting aspects important for the implementation of ROM, including perceived limitations and the value of organizational support.

Effects, Adherence, and Therapists' Perceptions of Web- and Mobile-Supported Group Therapy for Depression: Mixed-Methods Study

BACKGROUND

Blended group therapy (bGT) has been investigated a several times for anxiety and depression, but information on patients' adherence to and therapists' perception of the novel format is nonexistent. Furthermore, many studies investigated mainly female and highly educated populations, limiting the validity of previous findings.

OBJECTIVE

This study aimed to reduce the gaps and limitations of the previous findings by evaluating an integrated internet- and mobile-supported bGT format.

METHODS

A total of 27 patients diagnosed with major depression (14/27, 52% female and 7/27, 25.9% compulsory education) participated in a 7-week treatment at a university outpatient clinic. Furthermore, 8 novice therapists participated in semistructured interviews and a subsequent cross-validation survey.

RESULTS

Primary symptom reduction was high (d=1.31 to 1.51) and remained stable for the follow-up period. Therapists identified advantages (eg, patient engagement, treatment intensification, and improved therapeutic relation) and disadvantages (eg, increased workload, data issues, and undesired effects) of bGT. The required online guidance time was 10.3 min per patient and week, including guidance on exercises (67% or 6.9 min) and intimate communication (33% or 3.4 min). Concerning patients' adherence to bGT, tracked completion of all Web-based and mobile tasks was high and comparable with group attendance.

CONCLUSIONS

Results suggest high feasibility of bGT in a gender-balanced, moderately educated sample. bGT provides group therapists with tools for individual care, resulting in an optimization of the therapy process, and high completion rates of the implemented bGT elements. The limited work experience of the involved therapists restricts the study findings, and potential drawbacks need to be regarded in the development of future bGT interventions.

Process-symptom-bridges in psychotherapy: An idiographic network approach

AIM

real-time monitoring of psychotherapeutic processes was recently described as a promising, new way of tracking periods of change in ongoing treatments. This approach generates complex, multivariate datasets that have to be presented in an intuitive way for clinicians to aid their clinical decision-making. Using network modeling and new approaches in centrality analyses, we examine "bridge nodes" between symptom stress and aspects of the psychotherapeutic process between therapy session (intersession processes, ISP). Method:we recorded intersession processes as well as depressive and anxiety symptoms using daily questionnaires in ten cases. Regularized, thresholded intraindividual dynamic networks were estimated. We applied bridge centrality analysis to identify individual bridges between psychotherapeutic processes and symptoms in the resulting models. Case-wise interpretations of bridge centrality values are offered.

RESULTS

bridge centrality analysis revealed individual bridge nodes between intersession processes and symptom severity. Strength and direction of bridges varied substantially across individuals.

CONCLUSION

given current methodological challenges, idiographic network studies are feasible and offer important insights for psychotherapy process research. In this case, we demonstrated how patients deal with periods of increased symptom stress. In this case we have described how patients deal with their therapy under increased symptom load. Bridges between psychotherapeutic processes and symptom stress are a promising target for monitoring systems based on ISP. Future studies should examine the clinical utility of network-based monitoring and feedback in ongoing therapies. In the near future, process feedback systems based on idiographic models could serve clinicians to improve treatments.

The Advantages and Disadvantages of Online and Blended Therapy: Survey Study Amongst Licensed Psychotherapists in Austria

Background

Web-based and blended (face-to-face plus Web-based) interventions for mental health disorders are gaining significance. However, many licensed psychotherapists still have guarded attitudes toward computer-assisted therapy, hindering dissemination efforts.

Objective

The objective of this study was to provide a therapist-oriented evaluation of Web-based and blended therapies and identify commonalities and differences in attitudes toward both formats. Furthermore, it aimed to test the impact of an information clip on expressed attitudes.

Methods

In total, 95 Austrian psychotherapists were contacted and surveyed via their listed occupational email address. An 8-minute information video was shown to half of the therapists before 19 advantages and 13 disadvantages had to be rated on a 6-point Likert scale.

Results

The sample resembled all assessed properties of Austrian psychotherapists (age, theoretical orientation, and region). Therapists did not hold a uniform overall preference. Instead, perceived advantages of both interventions were rated as neutral (t₉₄=1.89, P=.06; d=0.11), whereas Web-based interventions were associated with more disadvantages and risks (t₉₄=9.86, P<.001; d=0.81). The information clip did not excerpt any detectable effect on therapists’ attitudes (r₉₅=−.109, P=.30). The application of modern technologies in the own therapeutic practice and cognitive behavioral orientation were positively related to the given ratings.

Conclusions

This study is the first to directly compare therapists’ attitudes toward Web-based and blended therapies. Positive attitudes play a pivotal role in the dissemination of new technologies, but unexperienced therapists seem to lack knowledge on how to benefit from technology-aided treatments. To speed up implementation, these aspects need to be addressed in the development of new interventions. Furthermore, the preference of blended treatments over Web-based interventions seems to relate to avoidance of risks. Although this study is likely to represent therapists’ attitudes in countries with less advanced electronic health services, therapists’ attitudes in more advanced countries might present differently.