The effect of patients' feedback on treatment outcome in a child and adolescent psychiatric sample: a randomized controlled trial

Usability of an Automated System for Real-Time Monitoring of Shared Decision-Making for Surgery: Mixed Methods Evaluation

BACKGROUND

Improving shared decision-making (SDM) for patients has become a health policy priority in many countries. Achieving high-quality SDM is particularly important for approximately 313 million surgical treatment decisions patients make globally every year. Large-scale monitoring of surgical patients' experience of SDM in real time is needed to identify the failings of SDM before surgery is performed. We developed a novel approach to automating real-time data collection using an electronic measurement system to address this. Examining usability will facilitate its optimization and wider implementation to inform interventions aimed at improving SDM.

OBJECTIVE

This study examined the usability of an electronic real-time measurement system to monitor surgical patients' experience of SDM. We aimed to evaluate the metrics and indicators relevant to system effectiveness, system efficiency, and user satisfaction.

METHODS

We performed a mixed methods usability evaluation using multiple participant cohorts. The measurement system was implemented in a large UK hospital to measure patients' experience of SDM electronically before surgery using 2 validated measures (CollaboRATE and SDM-Q-9). Quantitative data (collected between April 1 and December 31, 2021) provided measurement system metrics to assess system effectiveness and efficiency. We included adult patients booked for urgent and elective surgery across 7 specialties and excluded patients without the capacity to consent for medical procedures, those without access to an internet-enabled device, and those undergoing emergency or endoscopic procedures. Additional groups of service users (group 1: public members who had not engaged with the system; group 2: a subset of patients who completed the measurement system) completed user-testing sessions and semistructured interviews to assess system effectiveness and user satisfaction. We conducted quantitative data analysis using descriptive statistics and calculated the task completion rate and survey response rate (system effectiveness) as well as the task completion time, task efficiency, and relative efficiency (system efficiency). Qualitative thematic analysis identified indicators of and barriers to good usability (user satisfaction).

RESULTS

A total of 2254 completed surveys were returned to the measurement system. A total of 25 service users (group 1: n=9; group 2: n=16) participated in user-testing sessions and interviews. The task completion rate was high (169/171, 98.8%) and the survey response rate was good (2254/5794, 38.9%). The median task completion time was 3 (IQR 2-13) minutes, suggesting good system efficiency and effectiveness. The qualitative findings emphasized good user satisfaction. The identified themes suggested that the measurement system is acceptable, easy to use, and easy to access. Service users identified potential barriers and solutions to acceptability and ease of access.

CONCLUSIONS

A mixed methods evaluation of an electronic measurement system for automated, real-time monitoring of patients' experience of SDM showed that usability among patients was high. Future pilot work will optimize the system for wider implementation to ultimately inform intervention development to improve SDM.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.1136/bmjopen-2023-079155.

Systematic Client Feedback in Youth Mental Health and Addiction Care: A Controlled Study Comparing Two Treatment Cohorts

INTRODUCTION

We investigated the value of systematic client feedback in youth mental health and addiction care. In the present study, we examined whether a client feedback intervention would result in improved therapeutic alliance and treatment outcomes.

METHODS

Two hundred and four adolescents participated in the study using a - non-randomized - between-group A/B design. In the first study group, 127 patients were offered 4 months of treatment as usual (TAU), and in the second study group, 77 patients received the client feedback intervention as an add-on to TAU during 4 months.

RESULTS

Youths who received systematic client feedback in addition to TAU did not show better treatment outcomes or better alliance ratings after 4 months than youths receiving TAU only. Sensitivity analyses, in which we compared the more adherent patients of the second study group with patients receiving TAU, did not show significant beneficial effects of client feedback either. Also, the client feedback intervention did not result in lower rates of early treatment drop-out.

DISCUSSION/CONCLUSION

Our results cautiously suggest that client feedback does not have incremental effects on alliance and the treatment outcome for youth in mental health and addiction treatment. Moreover, our study highlights the challenges of implementing client feedback in clinical practice and the need for additional research addressing these challenges.

Shared decision-making interventions for people with mental health conditions

BACKGROUND

One person in every four will suffer from a diagnosable mental health condition during their life. Such conditions can have a devastating impact on the lives of the individual and their family, as well as society.  International healthcare policy makers have increasingly advocated and enshrined partnership models of mental health care. Shared decision-making (SDM) is one such partnership approach. Shared decision-making is a form of service user-provider communication where both parties are acknowledged to bring expertise to the process and work in partnership to make a decision.  This review assesses whether SDM interventions improve a range of outcomes. This is the first update of this Cochrane Review, first published in 2010.

OBJECTIVES

To assess the effects of SDM interventions for people of all ages with mental health conditions, directed at people with mental health conditions, carers, or healthcare professionals, on a range of outcomes including: clinical outcomes, participation/involvement in decision-making process (observations on the process of SDM; user-reported, SDM-specific outcomes of encounters), recovery, satisfaction, knowledge, treatment/medication continuation, health service outcomes, and adverse outcomes.

SEARCH METHODS

We ran searches in January 2020 in CENTRAL, MEDLINE, Embase, and PsycINFO (2009 to January 2020). We also searched trial registers and the bibliographies of relevant papers, and contacted authors of included studies.  We updated the searches in February 2022. When we identified studies as potentially relevant, we labelled these as studies awaiting classification.

SELECTION CRITERIA

Randomised controlled trials (RCTs), including cluster-randomised controlled trials, of SDM interventions in people with mental health conditions (by Diagnostic and Statistical Manual of Mental Disorders (DSM) or International Classification of Diseases (ICD) criteria).

DATA COLLECTION AND ANALYSIS

We used standard methodological procedures expected by Cochrane. Two review authors independently screened citations for inclusion, extracted data, and assessed risk of bias. We used GRADE to assess the certainty of the evidence.

MAIN RESULTS

This updated review included 13 new studies, for a total of 15 RCTs. Most participants were adults with severe mental illnesses such as schizophrenia, depression, and bipolar disorder, in higher-income countries. None of the studies included children or adolescents.  Primary outcomes We are uncertain whether SDM interventions improve clinical outcomes, such as psychiatric symptoms, depression, anxiety, and readmission, compared with control due to very low-certainty evidence. For readmission, we conducted subgroup analysis between studies that used usual care and those that used cognitive training in the control group. There were no subgroup differences. Regarding participation (by the person with the mental health condition) or level of involvement in the decision-making process, we are uncertain if SDM interventions improve observations on the process of SDM compared with no intervention due to very low-certainty evidence. On the other hand, SDM interventions may improve SDM-specific user-reported outcomes from encounters immediately after intervention compared with no intervention (standardised mean difference (SMD) 0.63, 95% confidence interval (CI) 0.26 to 1.01; 3 studies, 534 participants; low-certainty evidence). However, there was insufficient evidence for sustained participation or involvement in the decision-making processes. Secondary outcomes We are uncertain whether SDM interventions improve recovery compared with no intervention due to very low-certainty evidence. We are uncertain if SDM interventions improve users' overall satisfaction. However, one study (241 participants) showed that SDM interventions probably improve some aspects of users' satisfaction with received information compared with no intervention: information given was rated as helpful (risk ratio (RR) 1.33, 95% CI 1.08 to 1.65); participants expressed a strong desire to receive information this way for other treatment decisions (RR 1.35, 95% CI 1.08 to 1.68); and strongly recommended the information be shared with others in this way (RR 1.32, 95% CI 1.11 to 1.58). The evidence was of moderate certainty for these outcomes. However, this same study reported there may be little or no effect on amount or clarity of information, while another small study reported there may be little or no change in carer satisfaction with the SDM intervention. The effects of healthcare professional satisfaction were mixed: SDM interventions may have little or no effect on healthcare professional satisfaction when measured continuously, but probably improve healthcare professional satisfaction when assessed categorically. We are uncertain whether SDM interventions improve knowledge, treatment continuation assessed through clinic visits, medication continuation, carer participation, and the relationship between users and healthcare professionals because of very low-certainty evidence. Regarding length of consultation, SDM interventions probably have little or no effect compared with no intervention (SDM 0.09, 95% CI -0.24 to 0.41; 2 studies, 282 participants; moderate-certainty evidence). On the other hand, we are uncertain whether SDM interventions improve length of hospital stay due to very low-certainty evidence. There were no adverse effects on health outcomes and no other adverse events reported.

AUTHORS' CONCLUSIONS

This review update suggests that people exposed to SDM interventions may perceive greater levels of involvement immediately after an encounter compared with those in control groups. Moreover, SDM interventions probably have little or no effect on the length of consultations.  Overall we found that most evidence was of low or very low certainty, meaning there is a generally low level of certainty about the effects of SDM interventions based on the studies assembled thus far. There is a need for further research in this area.

A Dual Perspective of Psycho-Social Barriers and Challenges Experienced by Drug-Resistant TB Patients and Their Caregivers through the Course of Diagnosis and Treatment: Findings from a Qualitative Study in Bengaluru and Hyderabad Districts of South India

Qualitative insights regarding psycho-social barriers and challenges experienced by drug-resistant tuberculosis (DR-TB) patients and their caregivers are understudied in India. We conducted a qualitative study using semi-structured qualitative interviews among treatment-completed DR-TB patients (n = 20) and caregivers (n = 20) in Bengaluru and Hyderabad districts, which represented two different socio-cultural settings in South India. Criterion sampling was used for recruiting the eligible participants who completed treatment with adherence. “Emotional issues and social barriers” were identified to represent a major challenge for patients and caregivers, which occurred acutely after disease diagnosis, characterized by fear and emotional distress due to their perceived loss of life prospects, severity of symptoms, discomfort, and disease denial. Medication intolerance, chronic symptoms, lack of visible signs of treatment progress, loss of weight, and physical concerns caused subsequent fear and distress during the treatment phases for patients along with experiences of stigma. External triggers generated “decisive moments” of hopelessness and life-ending thoughts for patients at the diagnosis and early treatment phase. Medication related challenges included the perceived burden and power of pills which caused emotional distress for patients and intolerance towards caregivers. Pill burden was found as consequential as the side effects of injections. Challenges related to lack of support were another major theme, in which caregivers lacked resources for treatment support and nutrition. Throughout treatment, caregivers and patients expressed concern about a lack of supportive care from family members, sympathy, and intangible social support. Challenges during hospital admission in terms of lack of privacy, quality of services, individual attention, and empathy from health care workers were reported by patients and caregivers. Despite better adherence, DR-TB patients and caregivers experienced considerable emotional and social consequences. Differentiating DR-TB patients and caregivers’ issues at different stages of diagnosis and treatment could help improve patient-centered outcomes in India and other high-burden nations.

Exploring Change in Children’s and Art Therapists’ Behavior during ‘Images of Self’, an Art Therapy Program for Children Diagnosed with Autism Spectrum Disorders: A Repeated Case Study Design

(1) Background: ‘Images of Self’ (IOS) is a recently developed and evaluated art therapy program of 15 sessions to reduce difficulties in ‘sense of self’, ‘emotion regulation’, ‘flexibility’, and ‘social behavior’ of children diagnosed with Autism Spectrum Disorders (ASD). In this paper, it is explored whether change in the child’s behaviors corresponds to the therapist’s actions during IOS and 15 weeks later. (2) Method: In a repeated case study design, twelve children and seven therapists participated. Art therapists monitored their own and the children’s behavior by applying two observation instruments: the OAT (Observation of a child with autism in Art Therapy) and EAT (Evaluation of Art Therapist’s behavior when working with a child with autism). Child behaviors during art making were—individually and as a group—compared with therapist’s actions at three moments during the program. (3) Results: Ten of twelve children showed a substantial or moderate positive behavior change considering all OAT subscales at the end of the program and 15 weeks after treatment. Improvement of ‘social behavior’ stood out. Halfway treatment art therapists most prominently showed support of ‘emotion regulation’, ‘flexibility’, and ‘social behavior’. Clear one-on-one relationships between changes in children’s behavior and actions of therapists could not be identified. (4) Conclusion: The study provides new insights in the AT treatment process by monitoring children’s and therapists’ behavior. The art making itself and the art therapy triangle (child, art making, therapist) offer opportunities to improve verbal and nonverbal communication skills of the child.

Improving treatment outcomes for adolescents with borderline personality disorder through a socioecological approach

BACKGROUND

There is a dearth of studies evaluating treatment efficacy for adolescents diagnosed with borderline personality disorder. The few available randomized controlled trials that have been conducted show modest results and treatments appear to have equivalent effects. The current paper draws on (a) the lessons learnt from the last 50 years of psychotherapy research in general and (b) recent advances in mentalization-based understanding of why treatment works, which together point to the importance of following a socioecological approach in the treatment of personality problems in adolescence - a developmental period that insists on a treatment approach that goes beyond the therapist-client dyad.

CASE PRESENTATION

Here, we describe such an approach, and offer a clinical case example with a young 16-year old girl diagnosed with borderline personality disorder, to illustrate what a shift toward a more socioecological approach would entail.

CONCLUSIONS

The clinical impact of the socioecological approach and the potential benefits as illustrated in the current case illustration, offers a framework that justifies and allows for the expansion of service delivery for youth with borderline personality disorder beyond dyadic therapist-client work.

Improving the patient-centred care of children with life-altering skin conditions using feedback from electronic patient-reported outcome measures: protocol for a hybrid effectiveness-implementation study (PEDS-ePROM)

INTRODUCTION

Using patient-reported outcome measures (PROMs) with children have been described as 'giving a voice to the child'. Few studies have examined the routine use of these measures as potentially therapeutic interventions. This study aims to investigate: (1) the effectiveness of feedback using graphical displays of information from electronic PROMs (ePROMs) that target health-related quality of life, to improve health outcomes, referrals and treatment satisfaction and (2) the implementation of ePROMs and graphical displays by assessing acceptability, sustainability, cost, fidelity and context of the intervention and study processes.

METHODS AND ANALYSIS

A hybrid II effectiveness-implementation study will be conducted from February 2020 with children with life-altering skin conditions attending two outpatient clinics at a specialist paediatric children's hospital. A pragmatic randomised controlled trial and mixed methods process evaluation will be completed. Randomisation will occur at the child participant level. Children or parent proxies completing baseline ePROMs will be randomised to: (1) completion of ePROMs plus graphical displays of ePROM results to treating clinicians in consultations, versus (2) completion of ePROMs without graphical display of ePROM results. The primary outcome of the effectiveness trial will be overall health-related quality of life of children. Secondary outcomes will include other health-related quality of life outcomes (eg, child psychosocial and physical health, parent psychosocial health), referrals and treatment satisfaction. Trial data will be primarily analysed using linear mixed-effects models; and implementation data using inductive thematic analysis of interviews, meeting minutes, observational field notes and study communication mapped to the Consolidated Framework for Implementation Research.

ETHICS AND DISSEMINATION

Ethical approval was obtained from Children's Health Queensland Human Research Ethics Committee (HREC/2019/QCHQ/56290), The University of Queensland (2019002233) and Queensland University of Technology (1900000847). Dissemination will occur through stakeholder groups, scientific meetings and peer-reviewed publications.

TRIAL REGISTRATION NUMBER

Australian New Zealand Clinical Trials Registry (ACTRN12620000174987).

Measurement-Based Care in the Pediatric Primary Care Setting

Challenges associated with the integration of pediatric mental health care in the primary care setting include limitations of training and time, high volume of patients, need for coordination with external specialists, limited infrastructure, and limited funding. All of these issues can negatively influence the quality of mental health service delivery. Measurement-based care (MBC) processes have the potential to mitigate many of these challenges and generate data, allowing practices to evaluate and improve the performance of integrated mental health processes. Implementing MBC requires initial investment of staff resources for planning and training and information technology resources.