When programs benefit some people more than others: tests of differential service effectiveness

Intersectional perspectives on the employment rate in Supported Employment for people with psychiatric, neuropsychiatric, or intellectual disabilities: A scoping review

BACKGROUND

Supported Employment (SE) has shown better results in the employment rate for persons with disabilities than other methods within vocational rehabilitation, but how SE affects the employment rate for subgroups in the interventions needs further attention.

OBJECTIVE

To examine previous research regarding the influence of intersecting statuses on the employment rate in SE for people with psychiatric, neuropsychiatric, or intellectual disabilities according to type of diagnosis, sex, race/ethnicity, age, level of education and previous work history.

METHODS

A systematic literature search was conducted in nine databases including peer-reviewed articles from 2000 to April 2021. Articles presenting the employment rate in SE interventions according to the intersecting statuses listed in the objective were included.

RESULTS

The searches identified 3777 unique records, of which 53 articles were included in data extraction. In most of the included articles, intersecting statuses did not affect the employment rate for people in the SE interventions with psychiatric disabilities. Few studies have examined neuropsychiatric and intellectual disabilities. A majority of the studies subjected to full-text analysis were excluded due to a lack of reporting of the effects of intersecting statuses on the employment rate. The studies that reported on the effects of intersecting statuses on the employment rate often had small samples and lacked statistical power.

CONCLUSIONS

Intersecting statuses do not appear to affect the employment rate for people receiving SE interventions, but systematic reviews with pooled samples need to be undertaken because of the low reporting rate and underpowered sample sizes in existing studies.

Motivational Interviewing to prevent dropout from an education and employment program for young adults: A randomized controlled trial

This study tested the efficacy of Motivational Interviewing for improving retention at a "second chance" program in the United States for unemployed young adults who had not graduated high school (ages 18-24; 60% male). We investigated how Motivational Interviewing effects might be mediated by change talk (i.e., arguments for change) and moderated by preference for consistency (PFC). Participants (N = 100) were randomly assigned to (1) Motivational Interviewing designed to elicit change talk, (2) placebo counseling designed not to elicit change talk, or (3) no additional treatment. Motivational Interviewing sessions increased change talk, but did not increase program retention or diploma earning. PFC was a significant moderator of Motivational Interviewing's impact on program retention; Motivational Interviewing was most effective at increasing 8 week retention for high PFC participants, and least effective for low PFC participants. These results suggest that Motivational Interviewing could be a useful tool for improving retention in education and employment programs, but clinicians should be attentive to how participant characteristics might enhance or diminish Motivational Interviewing effects.

Are Single-Item Global Ratings Useful for Assessing Health Status?

The research performance of the single-item self-rating In general, would you say your health is: excellent, very good, good, fair, or poor? was evaluated relative to the SF-36 General Health Scale that contains this item, using data for a sample of psychiatric outpatients who had co-occurring chronic physical conditions (N = 177). The scale was more robust than the single-item in cross-sectional validity tests and for predicting 2-year outcomes, but the single-item had stronger discriminant validity as a measure of physical health, especially in post-baseline analyses. Single-item and scale were both sensitive enough to detect change in perceived health over 2 years and a conditional experimental effect on health self-perceptions in a randomized trial. These findings demonstrate that a global single-item can be as valid, reliable, and sensitive as a multi-item scale for longitudinal research purposes, even if the scale performs better in cross-sectional surveys or as a screening measure.

Are Single-Item Global Ratings Useful for Assessing Health Status?

The research performance of the single-item self-rating In general, would you say your health is: excellent, very good, good, fair, or poor? was evaluated relative to the SF-36 General Health Scale that contains this item, using data for a sample of psychiatric outpatients who had co-occurring chronic physical conditions (N = 177). The scale was more robust than the single-item in cross-sectional validity tests and for predicting 2-year outcomes, but the single-item had stronger discriminant validity as a measure of physical health, especially in post-baseline analyses. Single-item and scale were both sensitive enough to detect change in perceived health over 2 years and a conditional experimental effect on health self-perceptions in a randomized trial. These findings demonstrate that a global single-item can be as valid, reliable, and sensitive as a multi-item scale for longitudinal research purposes, even if the scale performs better in cross-sectional surveys or as a screening measure.

Work reintegration for veterans with mental disorders: a systematic literature review to inform research

BACKGROUND

Some veterans, and especially those with mental disorders, have difficulty reintegrating into the civilian workforce.

PURPOSE

The objectives of this study were to describe the scope of the existing literature on mental disorders and unemployment and to identify factors potentially associated with reintegration of workers with mental disorders into the workforce.

DATA SOURCES

The following databases were searched from their respective inception dates: MEDLINE, EMBASE, Cumulative Index Nursing Allied Health (CINAHL), and PsycINFO.

STUDY SELECTION

In-scope studies had quantitative measures of employment and study populations with well-described mental disorders (eg, anxiety, depression, posttraumatic stress disorder, substance-use disorders).

DATA EXTRACTION

A systematic and comprehensive search of the relevant published literature up to July 2009 was conducted that identified a total of 5,195 articles. From that list, 81 in-scope studies were identified. An update to July 2012 identified 1,267 new articles, resulting in an additional 16 in-scope articles.

DATA SYNTHESIS

Three major categories emerged from the in-scope articles: return to work, supported employment, and reintegration. The literature on return to work and supported employment is well summarized by existing reviews. The reintegration literature included 32 in-scope articles; only 10 of these were conducted in populations of veterans.

LIMITATIONS

Studies of reintegration to work were not similar enough to synthesize, and it was inappropriate to pool results for this category of literature.

CONCLUSIONS

Comprehensive literature review found limited knowledge about how to integrate people with mental disorders into a new workplace after a prolonged absence (>1 year). Even more limited knowledge was found for veterans. The results informed the next steps for our research team to enhance successful reintegration of veterans with mental disorders into the civilian workplace.

Discharge practices in a time-unlimited intervention: the perspectives of practitioners in assertive community treatment

The Assertive Community Treatment (ACT) model for people with severe mental illness has typically been viewed as a time-unlimited intervention. Without a proscribed service duration, discharge from ACT largely depends on individual clients' situations and practitioners' discretion. We conducted semi-structured focus groups and interviews with practitioners to explore their discharge practices and considerations. Results highlight the heterogeneity of the clientele served in ACT, and therefore the importance of individualized treatment and discharge planning, guidance on assessing the timing of discharge for individual cases, practice strategies that balance independence and social connectedness to promote recovery, and the need for substantial system reform to facilitate transition after discharge.

Who benefits from supported employment: a meta-analytic study

AIMS

This meta-analysis sought to identify which subgroups of clients with severe mental illness (SMI) benefited from evidence-based supported employment.

METHODS

We used meta-analysis to pool the samples from 4 randomized controlled trials comparing the Individual Placement and Support (IPS) model of supported employment to well-regarded vocational approaches using stepwise models and brokered services. Meta-analysis was used to determine the magnitude of effects for IPS/control group differences within specific client subgroups (defined by 2 work history, 7 sociodemographic, and 8 clinical variables) on 3 competitive employment outcomes (obtaining a job, total weeks worked, and job tenure).

RESULTS

The findings strongly favored IPS, with large effect sizes across all outcomes: 0.96 for job acquisition, 0.79 for total weeks worked, and 0.74 for job tenure. Overall, 90 (77%) of the 117 effect sizes calculated for the 39 subgroups exceeded 0.70, and all 117 favored IPS.

CONCLUSIONS

IPS produces better competitive employment outcomes for persons with SMI than alternative vocational programs regardless of background demographic, clinical, and employment characteristics.

Profiles of disability among adults with bipolar spectrum disorders

BACKGROUND

Heterogeneous groups of patients with a spectrum of service needs are commonplace in mental health settings. Although comprehensive assessments are available to measure variations in service needs, numerous challenges still exist when confronting this heterogeneity and many assessments used in clinic settings are lengthy and have not been demonstrated to be consistent over time.

OBJECTIVE

The purpose of this study was to identify subgroups of persons with bipolar spectrum disorders, who have similar disability profiles, and to the extent to which the subgrouping is stable over time.

METHODS

Participants were recruited from the Continuous Improvement for Veterans in Care-Mood Disorders. Eligible patients (N = 435) were those who received inpatient or outpatient treatment for bipolar disorder at a large urban VA mental health facility in Western Pennsylvania from July 2004 through July 2006. This was a naturalistic cohort study of patients with bipolar spectrum disorders. Baseline and 1-year follow-up data were collected using face-to-face interviews and recorded abstraction. The World Health Organization Disability Assessment Scale was the primary measure used to identify subgroups within this sample.

RESULTS

Using a classification strategy called latent profile analysis, this study identified three unique subgroups that showed significant differences in various clinical measures at baseline and follow-up. The largest and most consistent subgroup differences were observed in the current bipolar symptomatology.

CONCLUSION

The classification of functional status in the present study can aid clinicians in the identification of bipolar patients, with specific impairment profiles, who may need additional intervention. Future research is needed to understand whether specific interventions targeted at these subgroups can improve the quality of care for this high-need and at-risk population.

Adapting evidence-based interventions to fit usual practice: staff roles and consumer choice in psychiatric rehabilitation

This proof-of-concept study tested the viability of adapting a specialized practice to fit multi-service programs by switching from specialist to generalist staff roles. The intervention under study was supported employment, an evidence-based practice for adults with severe mental illness. Program data on participant characteristics, attendance, staff contact, and employment were retrieved for the 2007 calendar year (N = 99). Two hierarchical regression analyses compared (1) participants with any versus no mainstream employment, and (2) participants who started a new job in 2007 versus all other participants. In both analyses, individual participant counts of days on which employment services were provided and count of different employment service providers independently predicted mainstream employment over and above program attendance and background factors. The study program's employment rate approximated rates published for specialized supported employment programs, suggesting that it is feasible to adapt specialized evidence-based practices to fit multi-service settings without compromising service quality.

Appraising evidence for intervention effectiveness in early psychosis: conceptual framework and review of evaluation approaches

The literature that is relevant to evaluation of treatment effectiveness is large, scattered and difficult to assemble for appraisal. This scoping review first develops a conceptual framework to help organize the field, and second, uses the framework to appraise early psychosis intervention (EPI) studies. Literature searches were used to identify representative study designs, which were then sorted according to evaluation approach. The groupings provided a conceptual framework upon which a map of the field could be drawn. Key words were cross-checked against definitions in dictionaries of scientific terms and the National Library of Medicine Medical Subject Headings (MeSH) browser. Using the final list of key words as search terms, the EPI evaluation literature was appraised. Experimental studies could be grouped into two classes: efficacy and effectiveness randomized controlled trials. Non-experimental studies could be subgrouped into at least four overlapping categories: clinical epidemiological; health service evaluations; quality assurance studies; and, quasi-experimental assessments of treatment effects. Applying this framework to appraise EPI studies indicated promising evidence for the effectiveness of EPI irrespective of study design type, and a clearer picture of where future evaluation efforts should be focused. Reliance on clinical trials alone will restrict the type of information that can inform clinical practice. There is convergent evidence for the benefits of specialized EPI service functions across a range of study designs. Greater investment in health services research and quality assurance approaches in evaluating EPI effectiveness should be made, which will involve scaling up of study sizes and development of an EPI programme fidelity rating template. The degree of complexity of the evaluation field suggests that greater focus on research methodology in the training of Australasian psychiatrists is urgently needed.