Fidelity and IPS: does quality of implementation predict vocational outcomes over time for organizations treating persons with severe mental illness in the Netherlands?

Development of the Clinical High Risk for Psychosis Services Fidelity Scale (CHRPS-FS) for Team-Based Care

OBJECTIVE

This study aimed to develop and pilot the Clinical High Risk for Psychosis Services Fidelity Scale (CHRPS-FS).

METHODS

A literature review was conducted to identify evidence-based treatments for individuals at clinical high risk for psychosis (CHRP). These findings were compared with the First-Episode Psychosis Services Fidelity Scale (FEPS-FS). Common items were retained, and others were added, modified, or deleted. Next, the Delphi process was conducted with 17 clinical and academic experts in CHRP care to determine consensus on the importance and validity of each item. Concurrently, the preliminary tool was piloted in eight coordinated specialty care (CSC) clinics serving individuals with CHRP.

RESULTS

The literature review identified two components of CHRP care that were not detailed in the FEPS-FS and were added to the CHRPS-FS; furthermore, one FEPS-FS item was modified and six were removed. In the Delphi process, clinical and academic experts achieved a consensus of >80% in two rounds, with some changes in item wording and the addition of one item (stepped care approach). A CHRPS-FS assessment was successfully piloted in eight CSC clinics. The mean CHRPS-FS rating score was 3.96 (range 3.75-4.23), and the median proportion of items rated at good to high fidelity was 72% (range 66%-78%).

CONCLUSIONS

The CHRP-FS is feasible to implement, has face validity based on expert consensus, can be completed in conjunction with a FEPS-FS assessment or alone, and captures variability across programs. The CHRPS-FS measures service delivery and is suitable for clinical trials, learning health care systems, and quality improvement efforts.

Comparative Analysis of Independent Reviewer-Rated and Self-Rated Fidelity Scores in Individual Placement and Support Programs: Repeated Cross-Sectional Surveys

Fidelity assessments can contribute to maintaining the adherence to the individual placement and support (IPS) model, which enhances vocational outcomes for individuals with mental illness worldwide. While independent reviews are standard, self-assessments could broaden the implementation of IPS. This study aimed to evaluate reviewer-rated and self-rated fidelity assessments using the Japanese version of the Individualized Supported Employment Fidelity Scale (JiSEF), and to compare the two assessment methods in terms of their correlations with employment outcomes in Japan. Over the 3-year research period, fidelity assessments were conducted by independent reviewers and trained program staff members across 26 programs, totaling 58 assessments. Analyses involved kappa statistics for item-level comparison, the intra-class correlation coefficient (ICC) and paired t-test for the overall fidelity scores, and Pearson's correlations to examine the relationship between the fidelity scores and program-level employment outcomes. Most individual JiSEF items demonstrated fair to good reliability between reviewer-rated and self-rated assessments. The ICC for the overall JiSEF scores between the two assessment methods was 0.756, yet the distribution of self-rated scores was more scattered compared with that of reviewer-rated scores. The mean total scores from self-assessments were significantly lower than those from reviewer assessments (t = 2.072, P = 0.043). While both sets of scores correlated significantly with employment rates (r = 0.640, P < 0.001 for reviewer assessments; r = 0.325, P = 0.013 for self-assessments), the correlation was stronger for reviewer ratings (z = 2.207, P = 0.027). Self-rated fidelity assessments offer several benefits. However, since independent reviews had a more normal distribution and higher correlation with employment outcome, they should remain the priority in fidelity assessments within the Japanese IPS framework.

Enhancing individual task performance and productivity: an ethnographic observational study of supported employment among social services clients in Finland

BACKGROUND

The purpose of the study was to investigate the various aspects of employees' work environment, including their job characteristics; the level of support provided by supervisors, job coaches and coworkers; and their perceptions of job performance and productivity from the perspectives of both employees and supervisors in the context of sustainable employability in supported employment interventions. This study was part of the Finnish Work Ability Programme Evaluation Study (2020-2024).

METHODS

This study is theoretically informed by the concepts of specific work ability and sustainable employability, as well as how health affects productivity at the task level-approach. The research is based on qualitative data obtained through ethnographic fieldwork, nonparticipating observing with interaction at work, which includes observing employed individuals in their workplaces. Additionally, we recorded discussions, took photos at work, and conducted interviews with supervisors and job coaches.

RESULTS

The main findings were that persons with disability or decreased work ability were employed in precarious low-productivity work, with limited opportunities for more sustainable employment. Several means from public employment services to decrease the employer's personnel costs were used. The supervisors appeared to have a strong grasp of each employee's task-specific productivity level. Supervisors had to adapt their usual tasks to provide extra support for employees, often focusing more on work performance. The role of coworkers and the work community as whole was also important. The personal support of job coaches during the employment phase was crucial, but their role in the workplace was unclear, especially to employers.

CONCLUSIONS

To strengthen sustainable careers, the matching of jobs and individuals should be promoted through closer and productivity-oriented cooperation with employers and work communities in vocational rehabilitation and re-employment. The chosen qualitative research strategy, ethnographic fieldwork at work and multi-perspective data collection provided new interpretations of the possibilities for sustainable employability using the Supported Employment method. From the perspectives of both enabling prolonged working careers for employees and providing a clear understanding of task-performance-based productivity to employers, there is a need for more microlevel data on what happens in work and workplaces, particularly the social mechanisms through which results are achieved.

"Without IPS I Think I Would Really Fall Apart": Individual Placement and Support as Experienced by People With Mental Illness-Phenomenological Peer Research Study

Having a job is an important component of recovery from mental illness and a source of economic, social, and health benefits. Most people experiencing severe mental illness (SMI) want to work but are excluded from employment opportunities. Employment specialists (ESs) working in individual placement and support (IPS) teams help persons struggling with SMI obtain competitive employment. This study is a qualitative phenomenological study of 10 IPS participants in the Norwegian context, serving to develop a deeper understanding of the IPS phenomenon as it is experienced in the everyday life of IPS participants. The study was designed as a peer research project including four members of a competence group with experience in IPS and SMI. The results, analyzed using the reflective lifeworld research approach, revealed four constituents: "Having a safety net along the way toward employment," "Feeling more like a person, not just a patient," "Brighter future," and "Going above and beyond employment support." IPS functions as an anchor in participants' journey toward employment. Strong and meaningful relationships with an ES seem crucial for IPS participants to gain the strength and confidence essential to engage in the job search. IPS participants experience various challenges in everyday life, resulting in ESs exceeding their vocational role to cover the unmet needs that health services seem unable to fully address. Closer coordination between vocational and health services, as well as a deeper focus on everyday life issues, will positively affect IPS participants' vocational outcomes and quality of life.

Assessing the fidelity of supported education programs for first-episode psychosis to the supported employment guidelines adapted for education

INTRODUCTION

Psychotic disorders are associated with academic difficulties. Supported Employment Program (SEP) guidelines have become the gold standard to improve occupational functioning in psychotic disorders. More recently, these guidelines have been adapted to education. In Canada, several community organizations and hospital programs offer supported education to young people with psychotic disorders. However, SEP guidelines are not systematically used. The objective of this study was to assess the fidelity of 6 Canadian (Quebec) organizations offering supported education services to young people with psychotic disorders to the SEP guidelines adapted to education.

METHODS

Six sites offering educational services to young people with psychotic disorders were recruited. Semi-structured interviews were conducted with one supported education professional and one manager of each site, using the Quality of Supported Education Implementation Scale (QSEDIS). This new scale has been developed from the Quality of Supported Employment Implementation Scale. The QSEDIS assesses the fidelity of the quality of the implementation of supported education programs, using three subscales (Employees, Organization and Services).

RESULTS

Acceptable fidelity scores were observed in the three QSEDIS subscales for all six sites combined. The Services subscale received the highest score of fidelity (4.4/5), followed by the Supported Education Employee (4.1/5) and the Organization (3.7/5).

CONCLUSION

The results suggest that supported education services offered to young people with psychotic disorders in the six sites are generally consistent with SEP guidelines adapted to education. Further research is warranted to validate whether acceptable SEP guidelines fidelity according to the QSEDIS translates into educational outcomes.

Individual Placement and Support and Participatory Workplace Intervention on the Work Participation of People with Disabilities: A Randomised Controlled Trial

PURPOSE

This study assessed the effectiveness of Individual Placement and Support (IPS), Participatory Workplace Intervention (PWI), and IPS + PWI on work participation and health of people with work disabilities.

METHODS

A randomised controlled 2 × 2 factorial trial with 120 clients and an 18-month follow-up was performed. Differences between IPS and no-IPS and between PWI and no-PWI were assessed using log-rank tests and Cox proportional hazards models.

RESULTS

In the IPS group, restricted mean survival time (RMST) for sustainable paid employment was 352 days, compared to 394 in the no-IPS group (HR = 1.47, 95% CI = 0.81-2.63). In the PWI group the RMST was 378 days, compared to 367 in the no-PWI group (HR = 0.89, 95% CI = 0.48-1.64). For the secondary outcome 'starting any paid employment, a trial placement, or education' RMST was significantly lower for the IPS group (222 days) than for the no-IPS group (335 days; HR = 1.85, 95% CI = 1.01-3.42). Mental health was significantly lower (worse) in the PWI group (difference -4.07, 95% CI = -7.93 to -0.22) than in the no-PWI group. For all other secondary outcomes, no statistically significant differences were found.

CONCLUSION

No statistically significant differences were observed in the duration until starting sustainable employment between IPS and no-IPS, and between PWI and no-PWI. The duration until starting any paid employment, a trial placement, or education was shorter in the IPS group than in the no-IPS group, but further research should explore whether this also increases sustainable employment in the longer term.

Individual Placement and Support (IPS) beyond severe mental health: An overview review and meta-analysis of evidence around vocational outcomes

Objective

To provide an overview review of international evidence of vocational outcomes in Individual Placement and Support (IPS) interventions for populations other than severe mental health.

Methods

An overview of reviews published in English since 2000 reporting vocational outcomes (job entry, work sustainment, earnings, work hours, time to job entry) against counterfactuals of IPS interventions for population groups other than severe mental health. The overview review maximises data from individual studies and includes additional recent primary studies. DerSimonian-Laird random effects meta-analysis was performed.

Results

Thirteen eligible studies were identified from five reviews and five more recent individual studies were also identified. IPS studies covered a range of groups with a concentration towards mental health. For the primary vocational outcome of job entry all IPS studies showed superior job entry rates compared to control groups with an overall weighted odds ratio of 1.78 [1.42,2.22]. Substantial heterogeneity was identified by study size and the overall weighted odds ratio of 1.32 [1.2,1.46] estimated from the large and medium sized studies seems a more plausible estimate of the likely effects of scaled-up IPS interventions in groups beyond severe mental health. Secondary vocational outcomes including job sustainment, total earnings, average weekly hours worked and time to job entry were typically superior in IPS services than control groups.

Conclusions

IPS services are consistently more effective in supporting diverse population groups into sustained employment compared to business-as-usual employment services. The evidence is limited by unclear terminology, small sample sizes, incomplete intervention fidelity, intervention contamination and inconsistent measurement.

Process Evaluation of Individual Placement and Support and Participatory Workplace Intervention to Increase the Sustainable Work Participation of People with Work Disabilities

PURPOSE

This study is a process evaluation of the use of Individual Placement and Support (IPS) and Participatory Workplace Intervention (PWI) to increase the work participation of people with work disabilities. We ran the evaluation alongside a randomized controlled trial (RCT), to investigate whether and to what extent IPS and PWI were executed according to protocol.

METHODS

The study population consisted of clients with work disabilities, and their job coaches who were employed by the municipality of a large city in the Netherlands. Data were collected between September 2019 and November 2022 using registration forms, accompanied by researchers' notes and logbooks.

RESULTS

For IPS the dose delivered was reasonable and the IPS fidelity measurement score was fair. The job search focused on paid work for almost all clients and was based on their wishes as indicated in the protocol, but integration of employment services with (health) care was often lacking. A minority of the clients who were assigned to PWI received the intervention, often because the client did not start work within the follow-up period and a workplace was a requirement to apply the intervention.

CONCLUSION

The results of this study show that IPS was executed reasonably and with a fair fidelity, which indicated implementation was sufficient to find an effect on work participation in the RCT. PWI was barely realized in practice and no conclusions regarding the fidelity could be drawn. We therefore conclude that we cannot expect PWI to have any effect on work participation in the RCT.

Supported employment interventions with people who have severe mental illness: Systematic mixed-methods umbrella review

BACKGROUND/AIMS

Primary and review studies show that supported employment interventions showed promise in assisting people with severe mental illness (SMI) in achieving successful employment and health-related outcomes. This umbrella review synthesises evidence from across review studies on supported employment interventions for individuals with SMI, to identify key findings and implementation challenges in relation to five key outcomes: (1) employment, (2) quality of life, (3) social functioning, (4) clinical/service utilisation, and (5) economic outcomes.

METHODS

A systematic search of eleven databases and registers (CINAHL, Cochrane, EmCare, JBI EBP, ProQuest, PsycINFO, PubMed, Scopus, and Web of Science, and Prospero and Campbell) was conducted to identify meta-analyses and systematic reviews on supported employment interventions for individuals with SMI, peer reviewed and published in English. Quality assessment and data extraction were performed using standardised Joanna Briggs Institute (JBI) tools. A mixed-methods synthesis approach was employed to integrate both quantitative and qualitative evidence.

RESULTS

The synthesis of 26 review studies primarily focused on the Individual Placement and Support (IPS) model among various supported employment interventions. Overall, combining supported employment with targeted interventions such as neurocognitive therapy and job-related social skill training showed a positive effect on employment (including job retention) and non-employment outcomes (e.g., health, quality of life, social functioning) relative to standard forms of supported employment for people with SMI. Contextual factors (intervention fidelity, settings, systemic barriers) were important considerations for intervention implementation and effectiveness.

DISCUSSION

Significant overlap of primary studies across 26 review studies exposed considerable variations in interpretation and conclusions drawn by authors, raising questions about their reliability. High volume of overlap reporting from the USA on IPS interventions in review studies is likely to have biased perceptions of effectiveness. There is no one-size-fits-all solution for supporting individuals with SMI in obtaining and maintaining employment. Tailoring strategies based on individual needs and circumstances appears crucial to address the complexity of mental health recovery. We propose creating centralised registries or databases to monitor primary studies included in reviews, thus avoiding redundancy.

OTHER

This umbrella study was registered with PROSPERO (No. CRD42023431191).

Effectiveness, cost-effectiveness and return on investment of individual placement and support compared with traditional vocational rehabilitation for individuals with severe mental illness in the Netherlands: a nationwide implementation study

Objectives

To assess the effectiveness, cost-effectiveness and return on investment of individual placement and support (IPS) implemented through a reimbursement strategy on a nationwide scale compared with traditional vocational rehabilitation (TVR) regarding sustainable participation in competitive employment in individuals with severe mental illness receiving sickness or disability benefits.

Methods

An observational study was conducted using administrative data regarding all Dutch individuals receiving sickness or disability benefits in the period 2012-2019. Exact matching and difference-in-difference fixed-effect estimations were performed to handle the non-randomised nature of the data. The matched sample consisted of 863 IPS and 16 466 TVR participants. The primary effect measure was the proportion of individuals having worked for at least 48 hours per month in competitive employment (ie, for 12 hours or more per week); the proportion of individuals having worked in competitive employment for at least 1 hour per month was also evaluated. Cost-effectiveness and return on investment were assessed from the societal perspective (intervention, sickness/disability benefit and healthcare costs) and payer perspective (sickness/disability benefit costs).

Results

IPS led to a statistically significant higher probability of being competitively employed for at least 12 hours per week of 3.7% points (95% CI 0.8% to 6.7%) to 7.5% points (95% CI 3.8% to 11.3%) and of being competitively employed for at least 1 hour per month of 4.7% points (95% CI 1.6% to 7.7%) to 8.9% points (95% CI 5.2 to 12.6%) from 6 to 36 months after starting the intervention. From the societal and payer perspective, IPS was-on average-less costly and more effective than TVR and return-on-investment estimates showed that IPS was-on average-cost saving (eg, societal perspective: ∆C: -364 (95% CI -3977 to 3249); ∆E: 0.104 (95% CI 0.046 to 0.164); benefit-cost ratio: 2.1 (95% CI -14.8 to 19.1)), but the uncertainty surrounding these estimates was large.

Conclusions

IPS implemented through a reimbursement strategy on a nationwide scale is more effective and potentially cost-effective than TVR in people with severe mental illness receiving sickness or disability benefits. Based on these results, the implementation of IPS by a wide scale reimbursement strategy could be promoted to enhance sustainable participation in competitive employment in these individuals. Future economic evaluations should strive for a more robust sample size and a long follow-up period.

Understanding interventions and outcomes in supported employment and individual placement support: A qualitative evidence synthesis

BACKGROUND

Economically developed economies continue to display large and long-standing disability employment gaps. Train-then-place activation models have traditionally dominated efforts to support non-working disabled people to gain employment but recently there has been increasing interest in place-then-train Supported Employment (SE) activation models.

OBJECTIVE

Evidence regarding the effectiveness of SE approaches is growing. However, authors have called for greater understanding of the mechanisms underpinning these interventions. We therefore carried out a systematic review of qualitative research to understand the processes operating.

METHODS

We carried out a systematic review of qualitative research around SE interventions carried out in developed countries since 2000 in any population excepting those with severe mental illness. We used thematic synthesis and logic modelling methods and assessed the quality of the body of literature.

RESULTS

We identified and included 13 relevant source studies containing qualitative data. Key aspects of the programmes reported were the nature of the support, the employment advisor, and the type of employment. Influencing factors were client-related, employer and employment-related, programme-related, and system-related. Effects beyond the gaining of employment included a changed attitude to work, different outlook, increased skills and/or confidence. Suggested longer-term impacts were on health and wellbeing, financial security, independence, contribution to society and sense of belonging.

CONCLUSIONS

This review adds to the growing evidence regarding the value of SE interventions for disabled people. It adds insights regarding the key elements of the programmes, and suggests outcomes beyond the measures typically considered within quantitative studies.

Fidelity and Clinical Competence in Providing Illness Management and Recovery: An Explorative Study

Illness Management and Recovery (IMR) is a psychosocial intervention supporting people with serious mental illnesses. In this study, 15 IMR groups were assessed for fidelity and clinician competency to establish the implementation level of all IMR elements and explore complementarity of the IMR Treatment Integrity Scale (IT-IS) to the standard IMR Fidelity Scale. Use of the IT-IS was adapted, similar to the IMR Fidelity Scale. Descriptive statistics were applied. Implementation success of IMR elements varied widely on the IMR Fidelity Scale and IT-IS (M = 3.94, SD = 1.13, and M = 3.29, SD = 1.05, respectively). Twelve IMR elements (60%) were well-implemented, whereas eight (40%) were implemented insufficiently, including some critical cognitive-behavioral techniques (e.g., role-playing). The scales appeared largely complementary, though strongly correlated (r (13) = 0.74, p = 0.002). Providing all IMR elements adequately requires a variety of clinical skills. Specific additional training and supervision may be necessary.

Individual placement and support: History, current status, and future directions

Over the past three decades, Individual Placement and Support (IPS) has emerged as a robust evidence-based approach to helping people with severe mental illnesses, such as schizophrenia, bipolar disorder, and major depression, to obtain and succeed in competitive employment. This review addresses the history, principles, research, and future directions of IPS. It covers current evidence on employment outcomes, cost-effectiveness, and nonvocational outcomes. It also describes current attempts to extend IPS to new populations. The authors provide an overview of numerous systematic reviews and meta-analyses of randomized controlled trials involving people with serious mental illness. For studies addressing nonvocational outcomes and new populations, the review uses best available evidence. Published reviews agree that IPS enables patients with serious mental illness in high-income countries to succeed in competitive employment at a higher rate than patients who receive other vocational interventions. Within IPS programs, quality of implementation, measured by standardized fidelity scales, correlates with better outcomes. Employment itself leads to enhanced income, psychosocial outcomes, clinical improvements, and decreased mental health service use. As IPS steadily spreads to new populations and new settings, research is active across high-income countries and spreading slowly to middle-income countries. IPS is an evidence-based practice for people with serious mental illness in high-income countries. It shows promise to help other disability groups also, and emerging research aims to clarify adaptations and outcomes.

Implementing a combined individual placement and support and vocational peer work program in integrated youth mental health settings

AIM

To describe the implementation and outcomes of a combined individual placement and support (IPS) and vocational peer work program for young people with mental ill-health.

METHODS

This uncontrolled pilot study co-located IPS workers and vocational peer workers within two integrated youth mental health services (provided to clients aged 15-25 years old). Employment outcomes included job placements (working 15 hours or more per week in a paid competitive job in the open employment market) and sustained employment (employed for at least 26 weeks). Participants who required additional assistance also received peer work.

RESULTS

Of the 326 young people enrolled, 195 (59.8%) achieved competitive employment, including 157 (48.2%) in funder-approved placements. Among those in approved placements, 87 (55.4%) achieved sustained employment. For the 116 participants additionally receiving vocational peer work, 54 (46.6%) worked in funder-approved placements, of whom 27 (50.0%) achieved sustained employment. Among 210 participants who did not receive peer work, 103 (49.0%) worked in funder-approved placements, of whom 60 (58.3%) achieved sustained employment.

CONCLUSIONS

The program achieved positive vocational outcomes and good fidelity to the IPS model. Approximately half of young people had employment placements, with a relatively high proportion maintained over time. The similar proportion of placements for those who did and did not receive peer work was encouraging given the IPS team determined that the former group needed additional support. Recommendations include upskilling the workforce, a data linkage system to obtain placement evidence, and using implementation science methodologies to understand how IPS programs are successfully embedded. This demands a coordinated effort between governments and funders, policymakers, services, and professional bodies.

Development and validation of a fidelity instrument for Cognitive Adaptation Training

Purpose

Cognitive Adaptation Training (CAT) is a psychosocial intervention with demonstrated effectiveness. However, no validated fidelity instrument is available. In this study, a CAT Fidelity Scale was developed and its psychometric properties, including interrater reliability and internal consistency, were evaluated.

Methods

The fidelity scale was developed in a multidisciplinary collaboration between international research groups using the Delphi method. Four Delphi rounds were organized to reach consensus for the items included in the scale. To examine the psychometric properties of the scale, data from a large cluster randomized controlled trial evaluating the implementation of CAT in clinical practice was used. Fidelity assessors conducted 73 fidelity reviews at four mental health institutions in the Netherlands.

Results

After three Delphi rounds, consensus was reached on a 44-item CAT Fidelity Scale. After administration of the scale, 24 items were removed in round four resulting in a 20-item fidelity scale. Psychometric properties of the 20-item CAT Fidelity Scale shows a fair interrater reliability and an excellent internal consistency.

Conclusions

The CAT fidelity scale in its current form is useful for both research purposes as well as for individual health professionals to monitor their own adherence to the protocol. Future research needs to focus on improvement of items and formulating qualitative anchor point to the items to increase generalizability and psychometric properties of the scale. The described suggestions for improvement provide a good starting point for further development.

Outcomes of Peer-Provided Individual Placement and Support Services in a Mental Health Peer-Run Vocational Program

OBJECTIVE

The authors sought to determine whether staff at a peer-run agency could deliver supported employment services with high fidelity to the individual placement and support (IPS) model and whether employment outcomes of peer-delivered IPS plus work-specific health promotion were superior to usual supported employment services.

METHODS

Two teams from a vocational program of a large peer-run agency were studied from July 2015 to July 2017. One team received training and supervision in delivering IPS plus employment-focused physical wellness support and mentoring. The other team continued providing usual supported employment services. Study data included vocational outcomes from 348 clients served by the two teams (IPS, N=184; comparison condition, N=164) and the results of IPS fidelity reviews of the IPS team at study baseline, midpoint, and end. The authors modeled the primary outcome of competitive employment with random-effects logistic regression and adjusted propensity scores for age, gender, race, ethnicity, education, and months of service receipt.

RESULTS

Following training, the IPS team demonstrated acceptable and increasing fidelity to the IPS model, achieving "good fidelity" by the end of the 25-month observation period. Among IPS recipients, 43% achieved competitive employment versus 21% of comparison recipients (p<0.001). Multivariable analysis indicated that IPS recipients were significantly more likely to achieve competitive employment than individuals in the comparison group (OR=4.06, p<0.001).

CONCLUSIONS

Providing training in IPS along with health promotion to the behavioral health peer workforce may help address the severe shortage of IPS services and enhance the competitive employment outcomes of people served by peer-run programs.

Evaluation of an implementation strategy for Individual Placement and Support in the Netherlands: a 30-month observational study

BACKGROUND

Individual Placement and Support (IPS) is an evidence-based, effective approach to help people with severe mental illness (SMI) obtain and maintain competitive employment. The aim of the present study was to examine employment outcomes and associations with an organizational and a financial factor in people with SMI who participated in Individual Placement and Support using a multifaceted implementation strategy (IPS + MIS). The goal of this strategy was to improve IPS implementation by enhancing collaboration among mental health care and vocational rehabilitation stakeholders, and realizing secured IPS funding.

METHODS

An observational cohort study including 103 participants was conducted, with a 30-month follow-up. Descriptive analyses were used to examine employment outcomes. Multivariable logistic and linear regression analyses were performed to study associations with an organizational and a financial factor: the level of experience of mental health agencies with providing IPS + MIS and the type of IPS funding (i.e. municipality funding (reference group) and the Dutch Social Security Institute: the Institute for Employee Benefits Schemes (UWV) funding).

RESULTS

Forty-six percent of the participants were competitively employed at any time during the 30-month follow-up; the median number of days until competitive job obtainment and in competitive jobs was 201 and 265, respectively. The majority of all jobs obtained (81%) were categorized as 'elementary occupations', 'clerical support workers', and 'service and sales workers'. A higher level of experience of the mental health agencies with providing IPS + MIS was found to be positively associated with job obtainment (OR = 3.83, 95% CI 1.42-10.30, p = 0.01) and the number of days worked in competitive jobs (B = 1.21, 95% CI 0.36-2.07, p = 0.01). UWV funding was found to be negatively associated with job obtainment (OR = 0.30, 95% CI 0.11-0.77, p = 0.01). No association was found for the type of IPS funding and the number of days worked in competitive jobs (B = -0.73, 95% CI -1.48-0.02, p = 0.06).

CONCLUSIONS

This study shows that almost half of the people who participate in IPS + MIS obtain a competitive job within 30 months. The results further suggest that both the level of experience of mental health agencies with providing IPS + MIS, and funding may play a role in employment outcomes.

Who benefits from individual placement and support? A meta-analysis

AIMS

Individual placement and support (IPS) is an evidence-based service model to support people with mental disorders in obtaining and sustaining competitive employment. IPS is increasingly offered to a broad variety of service users. In this meta-analysis we analysed the relative effectiveness of IPS for different subgroups of service users both based on the diagnosis and defined by a range of clinical, functional and personal characteristics.

METHODS

We included randomised controlled trials that evaluated IPS for service users diagnosed with any mental disorder. We examined effect sizes for the between-group differences at follow-up for three outcome measures (employment rate, job duration and wages), controlling for methodological confounders (type of control group, follow-up duration and geographic region). Using sensitivity analyses of subgroup differences, we analysed moderating effects of the following diagnostic, clinical, functional and personal characteristics: severe mental illness (SMI), common mental disorders (CMD), schizophrenia spectrum disorders, mood disorders, duration of illness, the severity of symptoms, level of functioning, age, comorbid alcohol and substance use, education level and employment history.

RESULTS

IPS is effective in improving employment outcomes compared to the control group in all subgroups, regardless of any methodological confounder. However, IPS was relatively more effective for service users with SMIs, schizophrenia spectrum disorders and a low symptom severity. Although IPS was still effective for people with CMD and with major depressive disorder, it was relatively less effective for these subgroups. IPS was equally effective after both a short and a long follow-up period. However, we found small, but clinically not meaningful, differences in effectiveness of IPS between active and passive control groups. Finally, IPS was relatively less effective in European studies compared to non-European studies, which could be explained by a potential benefits trap in high welfare countries.

CONCLUSIONS

IPS is effective for all different subgroups, regardless of diagnostic, clinical, functional and personal characteristics. However, there might be a risk of false-positive subgroup outcomes and results should be handled with caution. Future research should focus on whether, and if so, how the IPS model should be adapted to better meet the vocational needs of people with CMD and higher symptom severity.

Sustainable employability in Supported Employment and IPS interventions in the context of the characteristics of work and perspectives of the employers: a scoping review protocol

INTRODUCTION

The sustainable employment outcomes and cost-effectiveness of Supported Employment (SE) and Individual Placement and Support (IPS) have been well reported. Research has also focused on various target groups, compliance with the quality criteria for the implementation of the SE/IPS method in diverse work life and social security contexts. However, the impact of employers' interests and the quality and opportunities of jobs or the work itself for sustainable working careers have not been studied extensively. The objective of the proposed scoping review is to systematically explore what is known about sustainable employability in SE and IPS interventions in the context of the characteristics of work and perspectives of the employers.

METHODS AND ANALYSES

The scoping review methodological framework by Arksey and O'Malley and its recently enhanced versions are used as guidelines in this study. The literature search, which was conducted in Medline, Scopus, PsycINFO, the Cumulative Index to Nursing and Allied Health Literature, and Social Science Premium Collection (ProQuest), identified a total of 2706 articles after the removal of duplicates. Key findings of selected studies will be charted, analysed and reported.

ETHICS AND DISSEMINATION

The study does not require ethics approval, as the data are collected from secondary sources. The final version of the scoping review will be published in a peer-reviewed academic journal. Findings of the review will be used in the upcoming ethnographic observation at work study, which is part of the Finnish Work Ability Programme Evaluation Study (2020-2023).

Community-based social interventions for people with severe mental illness: a systematic review and narrative synthesis of recent evidence

People living with severe mental illness (SMI) are one of the most marginalized groups in society. Interventions which aim to improve their social and economic participation are of crucial importance to clinicians, policy-makers and people with SMI themselves. We conducted a systematic review of the literature on social interventions for people with SMI published since 2016 and collated our findings through narrative synthesis. We found an encouragingly large amount of research in this field, and 72 papers met our inclusion criteria. Over half reported on the effectiveness of interventions delivered at the service level (supported accommodation, education or employment), while the remainder targeted individuals directly (community participation, family interventions, peer-led/supported interventions, social skills training). We identified good evidence for the Housing First model of supported accommodation, for the Individual Placement and Support model of supported employment, and for family psychoeducation, with the caveat that a range of models are nonetheless required to meet the varied housing, employment and family-related needs of individuals. Our findings also highlighted the importance of contextual factors and the need to make local adaptations when "importing" interventions from elsewhere. We found that augmentation strategies to enhance the effectiveness of social interventions (particularly supported employment and social skills training) by addressing cognitive impairments did not lead to transferable "real life" skills despite improvements in cognitive function. We also identified an emerging evidence base for peer-led/supported interventions, recovery colleges and other interventions to support community participation. We concluded that social interventions have considerable benefits but are arguably the most complex in the mental health field, and require multi-level stakeholder commitment and investment for successful implementation.

Predictive Association of Low- and High-Fidelity Supported Employment Programs with Multiple Outcomes in a Real-World Setting: A Prospective Longitudinal Multi-site Study

PURPOSE

The individual placement and support (IPS) model of supported employment is a leading evidence-based practice in community mental health services. In Japan, individualized supported employment that is highly informed by the philosophy of the IPS model has been implemented. While there is a body of evidence demonstrating the association between program fidelity and the proportion of participants gaining competitive employment, the association between fidelity and a wider set of vocational and individual outcomes has received limited investigation. This study aimed to assess whether high-fidelity individualized supported employment programs were superior to low-fidelity programs in terms of vocational outcomes, preferred job acquisition, and patient-reported outcome measures (PROMs).

METHODS

A prospective longitudinal study with 24-month follow-up analyzed 16 individualized supported employment programs. The Japanese version of the individualized Supported Employment Fidelity scale (JiSEF) was used to assess the structural quality of supported employment programs (scores: low-fidelity program, ≤ 90; high-fidelity program, ≥ 91). Job acquisition, work tenure, work earnings, job preference matching (e.g., occupation type, salary, and illness disclosure), and PROMs such as the INSPIRE and WHO-Five Well-being index were compared between groups.

RESULTS

There were 75 and 127 participants in the low-fidelity group (k = 6) and high-fidelity group (k = 10), respectively. The high-fidelity group demonstrated better vocational outcomes than the low-fidelity group, i.e., higher competitive job acquisition (71.7% versus 38.7%, respectively, adjusted odds ratio (aOR) = 3.6, p = 0.002), longer work tenure (adjusted mean difference = 140.8, p < 0.001), and better match for illness disclosure preference (92.6% versus 68.0%, respectively, aOR = 5.9, p = 0.003). However, we found no differences between groups in other preference matches or PROM outcomes.

CONCLUSION

High-fidelity individualized supported employment programs resulted in good vocational outcomes in a real-world setting. However, enhancing service quality to increase desired job acquisition and improve PROMs will be important in the future.

CLINICAL TRIAL REGISTRATION

UMIN000025648.

Assessing stable validity and reliability of the Japanese version of the individualized supported employment fidelity scale: A replication

Background

The Japanese version of the individualized Supported Employment Fidelity scale (JiSEF) was developed by modifying the 25‐item Individual Placement and Support Fidelity Scale (IPS‐25). While a preliminary study partly confirmed the concurrent validity with vocational outcomes, this replication study aimed to examine the stability of the concurrent validity and the inter‐rater reliability of the JiSEF and to test its convergent validity with IPS‐25.

Methods

Fidelity assessments were conducted in 2016 (n = 17), 2017 (n = 13), and 2018 (n = 18) to examine the employment rate and the fidelity scores at the agency level. We also evaluated the fidelity scores for the IPS‐25 in 2018. We examined the associations between the fidelity scale scores and vocational outcomes for the concurrent validity and between the fidelity scales for convergent validity. The inter‐rater reliability was examined in the 2016 and 2017 assessments.

Results

High intraclass correlation coefficients (0.93 in 2016 and 0.92 in 2017) were obtained for the inter‐rater reliability. The JiSEF score in each year was associated with the agency employment rate (r = 0.710, P = 0.001 in 2016; r = 0.722, P = 0.005 in 2017; and r = 0.665, P = 0.003 in 2018). A supplementary longitudinal data analysis also confirmed the association between the JiSEF score and the employment outcomes. Additionally, the JiSEF was significantly correlated with the IPS‐25 (r = 0.760, P < 0.001).

Conclusions

This study stably replicated good inter‐rater reliability and concurrent validity of the JiSEF. Additionally, the convergent validity was confirmed. Further studies with large samples are needed to confirm these findings.

This study stably replicated a good inter‐rater reliability and concurrent validity of the Japanese version of the individualized Supported Employment Fidelity scale (JiSEF).

Effects of Illness Management and Recovery: A Multicenter Randomized Controlled Trial

There have been inconsistent findings in the literature with respect to the efficacy of Illness Management and Recovery (IMR) in the psychosocial treatment of people with schizophrenia or other severe mental illnesses. This study aimed to comprehensively investigate the effectiveness of IMR, including the impact of completion and fidelity. In this randomized controlled trial (RCT), 187 outpatients received either IMR plus care as usual (CAU) or only CAU. Multilevel modeling was implemented to investigate group differences over an 18-month period, comprising 12 months of treatment and six months of follow-up. The primary outcome was overall illness management, which was assessed using the client version of the IMR scale. Secondary outcomes included measures regarding illness management, clinical, personal, and functional recovery, and hospitalizations. The interviewers were blinded to group allocation. This clinical trial was registered with the Netherlands Trial Register (NL4931, NTR5033). Patients who received IMR showed statistically significant improvement in self-reported overall illness management (the primary outcome). Moreover, they showed an improvement in self-esteem, which is a component of personal recovery. There were no effects within the other questionnaires. There were also no statistically significant between-group differences in terms of hospitalizations. Patients in both groups showed statistically significant improvement in clinician-rated overall illness management, social support, clinical and functional recovery, and self-stigma over time. IMR completion was associated with stronger effects. High IMR fidelity was associated with self-esteem. This study confirms the efficacy of IMR in overall illness self-management. To our knowledge, this is the first RCT on IMR to explore the impact of fidelity on treatment efficacy. Future studies should further establish efficacy in personal recovery. To improve efficacy, it appears important to promote IMR completion and fidelity.

Long-Term Effects of the Individual Placement and Support Intervention on Employment Status: 6-Year Follow-Up of a Randomized Controlled Trial

People with mental illness often experience difficulties with reintegration into the workplace, although employment is known to assist these individuals in their recovery process. Traditional approaches of "first train, then place" have been recently replaced by supported employment (SE) methods that carry strategy of "first place, then train." Individual placement and support (IPS) is one of the best-studied methods of SE, which core principles are individualized assistance in rapid job search with consequent placement in a paid employment position. A considerable amount of high-quality evidence supported the superiority of IPS over conventional methods in providing improved employment rates, longer job tenure, as well as higher salaries in competitive job markets. Nonetheless, our knowledge about the IPS-mediated long-term effects is limited. This non-interventional follow-up study of a previously published randomized controlled trial (RCT) called ZhEPP aimed to understand the long-term impact of IPS after 6 years since the initial intervention. Participants from the ZhEPP trial, where 250 disability pensioners with mental illnesses were randomized into either IPS intervention group or treatment as usual group (TAU), were invited to face-to-face interviews, during which employment status, job tenure, workload, and salaries were assessed. One hundred and fourteen individuals agreed to participate in this follow-up study. Although during the first 2 years post-intervention, the IPS group had higher employment rates (40% (IPS) vs. 28% (TAU), p < 0.05 at 24 months), these differences disappeared by the time of follow-up assessments (72 months). The results indicated no substantial differences in primary outcome measures between IPS and TAU groups: employment rate (36 vs. 33%), workload (10.57 vs. 10.07 h per week), job tenure (29 vs. 28 months), and salary (20.21CHF vs. 25.02 CHF). These findings provide important insights regarding the long-term effects of IPS among individuals with mental health illnesses. Further research is required to advance the current knowledge about IPS intervention and its years-long impact.

A structured mixed method process evaluation of a randomized controlled trial of Individual Placement and Support (IPS)

Background

Individual Placement and Support (IPS) is an evidence-based work rehabilitation program helping people with moderate to severe mental illness to obtain ordinary employment. Although IPS has proven superior to other work rehabilitation programs, in many studies, the majority of the participants remain unemployed. Structured process evaluations of IPS that use mixed methods are scarce, although they could identify implementation aspects that may enhance its effect. The aim of the current study is to assess reach, fidelity, and identify barriers and facilitators to implement IPS.

Methods

The process evaluation was conducted alongside a randomized controlled trial including six IPS centers, comparing IPS with treatment as usual in a population of patients in treatment for moderate to severe mental illness. Mixed methods were used in the process evaluation, including focus group interviews with service providers, individual interviews and survey data from participants, and fidelity reviews using the validated IPS Fidelity Scale.

Results

The intervention reached the intended target group. All centers reached fair to good fidelity according to the IPS Fidelity Scale within the project period (range 97–109, SD 8.1) (see Table 5). Certain fidelity items indicated implementation issues related to employer contact, community-based services, and integration with health services. Survey data showed that less than half of the participants regarded their illness as a barrier for participating in IPS and that freedom of disclosure was important. Participant interviews gave further insight into the role of the IPS specialist, emphasizing their availability and consistent job focus.

Conclusions

Indications of implementation challenges across centers during the first year suggest special attention should be given to these aspects in an early phase to ensure higher fidelity from the start and thus enhance the effectiveness of IPS. The IPS specialist played an important role for participants and was described as positive, pushing in a positive way, and encouraging. More knowledge on the characteristics of successful IPS specialists could further enhance the effectiveness of the intervention.

Trial registration

The study was registered on clinicaltrials.gov prior to the inclusion period (reg.no: NCT01964092, registered 17/07/2013).

Supplementary information

Supplementary information accompanies this paper at 10.1186/s43058-020-00083-9.

IPS in Supported Housing: Fidelity and Employment Outcomes Over a 4 Year Period

Background: People with severe mental illness have difficulties finding and maintaining competitive employment. This is particularly so for those living in supported housing who, by definition, have significant day-to-day support needs: in the Netherlands only 3 to 5% of people with serious mental health problems who live in supported housing are competitively employed. To support these people in finding and maintaining competitive employment, Individual Placement, and Support (IPS) was introduced within supported housing services in the Netherlands in 2015. As this is the first country that broadly implemented IPS in supported housing settings, this paper will focus on the first results regarding feasibility and effects on employment in clients of IPS in this sector. Methods: We investigated the feasibility and employment outcomes of delivering IPS in supported housing services using fidelity assessments and quarterly employment outcomes on IPS program level within eight supported housing organizations, and compared these with 21 mental health treatment organizations in the Netherlands over a 4 year period. We investigated possible reasons for our findings and their implications through qualitative evaluations of the IPS fidelity assessors' notes and additional focus groups with IPS specialists and coordinators from supported housing services and fidelity assessors. Results: The overall fidelity scores indicated reasonable implementation of the IPS model within both supported housing services and mental health services. However, there were differences between services with regard to specific fidelity items; mental health treatment organizations scored higher for team integration, whereas supported housing services scored higher for rapid job search and caseload size, diversity of jobs, and employers. Our qualitative data suggested that the difference in team integration between the two sectors was due to differences in their organizational and financial structures, as well as in the specific needs of their clients. Conversely, supported housing services had better connections with employers which facilitated more rapid job searching and greater diversity in employment opportunities. The average total client employment rate did not significantly differ; and was 25.8% per quarter in supported housing services and 29.6% in mental health treatment services. Conclusion: Implementing IPS in supported housing settings is both feasible and effective.