A Mixed-Methods Evaluation of the Implementation of a Performance Measurement System for South Africa's Substance Use Treatment Services

A mixed-methods study of staff perspectives on the barriers and facilitators to the implementation of patient-reported routine outcome measures and feedback in alcohol and other drug treatment

INTRODUCTION

Preliminary evidence supports the use of patient-reported outcome measures (PROM) and feedback for enhancing client outcomes in alcohol and other drug (AOD) treatment. However, successful implementation remains challenging. This mixed-methods study applied the Consolidated Framework for Implementation Research (CFIR) framework to examine inner setting and staff characteristics that act as barriers and facilitators to the implementation of PROMs in AOD treatment.

METHODS

To understand CFIR-informed barriers and facilitators to implement PROMs in AOD treatment, qualitative interviews were conducted with N = 23 AOD counsellors. A separate quantitative survey was conducted with N = 108 AOD counsellors.

RESULTS

Four qualitative themes emerged: (i) PROMs and feedback are valuable to AOD treatment; (ii) counsellor resistance towards PROMs and feedback is a barrier to successful implementation; (iii) competing interests and logistical issues are barriers to the implementation of PROMs and feedback; and (iv) PROMs are a burden to clients that may serve to disengage them from treatment. Survey results indicated a positive association between leadership support (CFIR inner setting construct) and counsellor knowledge and beliefs regarding PROMs and feedback (CFIR staff characteristics construct; β = 0.35, 95% CI [0.13, 0.60]). Findings demonstrated a positive association between available PROMs resources (CFIR inner setting construct) and both knowledge and beliefs regarding PROMs and feedback (β = 0.31, 95% CI [0.14, 0.48]) and self-efficacy to implement PROMs and feedback (CFIR staff characteristics construct; β = 0.18, 95% CI [0.04, 0.32]).

DISCUSSION AND CONCLUSIONS

Findings point to the critical need to adopt a whole-of-organisation approach to foster buy-in for PROMs and feedback to support successful implementation.

Residential and inpatient treatment of substance use disorders in Sub-Saharan Africa: a scoping review

BACKGROUND

With substance use rates increasing in Sub-Saharan Africa (SSA), an understanding of the accessibility and effectiveness of rehabilitative services for people who use alcohol and other drugs (AOD) is critical in the global efforts to diagnose and treat substance use disorders (SUD). This scoping review seeks to address the gaps in knowledge related to the types of research that have been conducted regarding inpatient or residential SUD treatment in SSA, the settings in which the research was conducted, and the study countries.

METHODS

A search of three databases, PubMED, Scopus, and African Index Medicus, was conducted for publications related to the treatment of SUD in inpatient or residential settings in SSA. Articles were screened at the title/abstract level and at full text by two reviewers. Articles eligible for inclusion were original research, conducted in SSA, published in English, included populations who received or were currently receiving treatment for SUD in inpatient or residential settings, or documented demand for SUD services.

RESULTS

This scoping review included 82 studies originating from 6 countries in SSA. Three themes emerged within the literature: access and demand for inpatient and residential SUD treatment, quality and outcomes of SUD treatment, and descriptions of the services offered and staffing of these facilities. Barriers to access include financial barriers, limited availability of services, and geographic concentration in cities. Women were shown to access residential and inpatient SUD treatment at lower rates than men, and certain racial groups face unique language and financial barriers in accessing services. Studies indicate mixed success of inpatient and residential SUD treatment in sustained SUD remission for patients.

CONCLUSION

There are significant gaps in the literature, driven by a lack of longitudinal studies focused on patient outcomes following treatment and the use of a narrow definition of treatment success. Both structural and non-structural barriers, such as stigma and discrimination, are barriers to access. Further research is needed to evaluate approaches to mitigate these barriers and expand access to residential and inpatient SUD treatment.

Patient Reported Outcome and Experience Measures (PROMs and PREMs) in substance use disorder treatment services: A scoping review

BACKGROUND

Substance use disorders (SUD) pose significant challenges for healthcare systems, and there is a need to monitor the provision of effective, individualized care to persons accessing treatment. Patient-Reported Outcome Measures (PROMs) and Patient-Reported Experience Measures (PREMs) are increasingly used in healthcare services to measure treatment outcomes and quality of care as perceived by patients, and to guide service improvement.

OBJECTIVES

This review aims to identify and characterize international developments regarding the use and systematic implementation of PROMs and PREMs in SUD treatment services.

METHODS

A scoping review was conducted searching multiple databases to identify studies on the use and routine implementation of PROMs and PREMs in SUD treatment services.

RESULTS

23 articles were selected, all dating from 2016 onwards. There was large variation in the patient-reported measures that were used, how they were developed and how and when patient-reported data were collected. Treatment providers identified leadership support, the presence of an integrated electronic patient record, and regular feedback to be the most important facilitators of successful implementation of patient-reported measures into clinical practice, whilst treatment dropout and burden to staff and patients were the most important barriers to consider.

CONCLUSIONS

PROMs and PREMs are increasingly used in SUD treatment services, but guidance is needed to support researchers and clinicians in selecting and implementing valid, meaningful, and comparable measures if we want to understand the effects of PROM and PREM data collection and feedback on treatment quality and results.

Substance use referral, treatment utilization, and patient costs associated with problematic substance use in people living with HIV in Cape Town, South Africa

Introduction

Despite efforts to detect and treat problematic substance use (SU) among people living with HIV (PLWH) in South Africa, integration of HIV and SU services is limited. We sought to understand whether PLWH and problematic SU were: (a) routinely referred to SU treatment, a co-located Matrix clinic, (b) used SU treatment services when referred, and (c) the individual amount spent on SU.

Methods

Guided by the RE-AIM implementation science framework, we examined patient-level quantitative screening and baseline data from a pilot clinical trial for medication adherence and problematic SU. Qualitative data came from semi-structured interviews with HIV care providers (N = 8), supplemented by patient interviews (N = 15).

Results

None of the screened patient participants (N = 121) who were seeking HIV care and had problematic SU were engaged in SU treatment, despite the freely available co-located SU treatment program. Only 1.5% of the enrolled patient study sample (N = 66) reported lifetime referral to SU treatment. On average, patients with untreated SU spent 33.3% (SD=34.5%) of their monthly household income on substances. HIV care providers reported a lack of clarity about the SU referral process and a lack of direct communication with patients about patients' needs or interest in receiving an SU referral.

Discussion

SU treatment referrals and uptake were rare among PLWH reporting problematic SU, despite the high proportion of individual resources allocated to substances and the co-located Matrix site. A standardized referral policy between the HIV and Matrix sites may improve communication and uptake of SU referrals.

Factors associated with patient-reported experiences and outcomes of substance use disorder treatment in Cape Town, South Africa

Background

Interventions are needed to improve the quality of South Africa’s substance use disorder (SUD) treatment system. This study aimed to identify factors associated with patient-reported suboptimal access, quality, and outcomes of SUD treatment to guide the design of targeted quality improvement initiatives.

Method

We analysed clinical record and patient survey data routinely collected by SUD services in the Western Cape Province, South Africa. The sample included 1097 treatment episodes, representing 32% of all episodes in 2019. Using multivariate logistic regression, we modelled socio-demographic, substance use and treatment correlates of patient-reported suboptimal access to, quality and outcomes of SUD treatment.

Results

Overall, 37.9% of patients reported substantial difficulties in accessing treatment, 28.8% reported suboptimal quality treatment, and 31.1% reported suboptimal SUD outcomes. The odds of reporting poor access were elevated for patients identifying as Black/African, in residential treatment, with comorbid mental health problems, and longer histories of substance use. Length of substance use, comorbid mental health problems, and prior SUD treatment were associated with greater likelihood of reporting suboptimal quality treatment. Patients with comorbid mental health problems, polysubstance use, who did not complete treatment, and who perceived treatment to be of poor quality were more likely to report suboptimal outcomes.

Conclusion

This study is among the first to use patient-reported experiences and outcome measures to identify targets for SUD treatment improvement. Findings suggest substantial room to improve South African SUD treatment services, with targeted efforts needed to reduce disparities in outcomes for patients of Black/African descent, for those with comorbid mental health problems, and for patients who have chronic substance use difficulties. Interventions to enhance the relevance, appropriateness, and acceptability of SUD services for these patient sub-groups are needed to improve system performance.