Justice involvement among homeless individuals with mental illnesses: Are self-report and administrative measures comparable?

Leveraging integrated data for program evaluation: Recommendations from the field

Use of administrative data to inform decision making is now commonplace throughout the public sector, including program and policy evaluation. While reuse of these data can reduce costs, improve methodologies, and shorten timelines, challenges remain. This article informs evaluators about the growing field of Integrated Data Systems (IDS), and how to leverage cross-sector administrative data in evaluation work. This article is informed by three sources: a survey of current data integration efforts in the United States (U.S.) (N=63), informational interviews with experts, and internal knowledge cultivated through Actionable Intelligence for Social Policy's (AISP) 12+ years of work in the field. A brief discussion of the U.S. data integration context and history is provided, followed by discussion of tangible recommendations for evaluators, examples of evaluations relying on integrated data, and a list of U.S. IDS sites with publicly available processes for external data requests. Despite the challenges associated with reusing administrative data for program evaluation, IDS offer evaluators a new set of tools for leveraging data across institutional silos.

Multivariable modelling of factors associated with criminal convictions among people experiencing homelessness and serious mental illness: a multi-year study

People experiencing homelessness and serious mental illness exhibit high rates of criminal justice system involvement. Researchers have debated the causes of such involvement among people experiencing serious mental illness, including what services to prioritize. Some, for example, have emphasized mental illness while others have emphasized poverty. We examined factors associated with criminal convictions among people experiencing homelessness and serious mental illness recruited to the Vancouver At Home study. Participants were recruited between October 2009 and June 2011. Comprehensive administrative data were examined over the five-year period preceding study baseline to identify risk and protective factors associated with criminal convictions among participants (n = 425). Eight variables were independently associated with criminal convictions, some of which included drug dependence (RR = 1.53; P = 0.009), psychiatric hospitalization (RR = 1.44; P = 0.030), an irregular frequency of social assistance payments (compared to regular payments; 1.75; P < 0.001), and prior conviction (RR = 3.56; P < 0.001). Collectively, findings of the present study implicate poverty, social marginalization, crises involving mental illness, and the need for long-term recovery-oriented services that address these conditions to reduce criminal convictions among people experiencing homelessness and serious mental illness.

Cost-Effectiveness of Housing First With Assertive Community Treatment: Results From the Canadian At Home/Chez Soi Trial

OBJECTIVE

The At Home/Chez Soi trial for homeless individuals with mental illness showed scattered-site Housing First with Assertive Community Treatment (ACT) to be more effective than treatment as usual. This study evaluated the cost-effectiveness of Housing First with ACT and treatment as usual.

METHODS

Between October 2009 and June 2011, a total of 950 homeless individuals with serious mental illness were recruited in five Canadian cities: Vancouver, Winnipeg, Toronto, Montreal, and Moncton. Participants were randomly assigned to Housing First (N=469) or treatment as usual (N=481) and followed up for up to 24 months. The intervention consisted of scattered-site Housing First, using rent supplements, with ACT. The treatment-as-usual group had access to all other services. The perspective of society was adopted for the cost-effectiveness analysis. Days of stable housing served as the outcome measure. Retrospective questionnaires captured service use data.

RESULTS

Most (69%) of the costs of the intervention were offset by savings in other costs, such as emergency shelters, reducing the net annual cost of the intervention to about Can$6,311 per person. The incremental cost-effectiveness ratio was Can$41.73 per day of stable housing (95% confidence interval=Can$1.96-$83.70). At up to Can$60 per day, Housing First had more than an 80% chance of being cost-effective, compared with treatment as usual. Cost-effectiveness did not vary by participant characteristics.

CONCLUSIONS

Housing First with ACT appeared about as cost-effective as Housing First with intensive case management for people with moderate needs. The optimal mix between the two remains to be determined.

Trajectories of Homeless Shelter Utilization in the At Home/Chez Soi Trial of Housing First

OBJECTIVE

Studies have shown that Housing First, a recovery-oriented housing intervention, is effective in reducing service utilization among homeless individuals with mental illness, but less is known about how Housing First affects patterns of service use over time and about characteristics associated with various utilization trajectories. This analysis aimed to explore latent class trajectories of shelter utilization in a randomized controlled trial of Housing First conducted across five Canadian cities.

METHODS

Data from the At Home/Chez Soi trial were analyzed (N=2,058). Latent class growth analysis was performed using days of shelter utilization to identify trajectories over 24 months. Multinomial logistic regression was used to determine which baseline variables, including treatment group, could predict class membership.

RESULTS

Four shelter use trajectories were identified: consistently low (N=1,631, 79%); mostly low (N=120, 6%); early temporary increase (N=179, 9%); and higher use, late temporary increase (N=128, 6%). Treatment group was a significant predictor of class membership. Those enrolled in Housing First had lower odds of experiencing higher shelter use trajectories (mostly low: odds ratio [OR]=0.50, 95% confidence interval [CI]=0.34-0.72; early temporary increase: OR=0.21, 95% CI=0.15-0.31; higher use, late temporary increase: OR=0.14, 95% CI=0.09-0.22). Other variables associated with trajectory classes included older age and longer time homeless, both of which were associated with higher shelter use.

CONCLUSIONS

Several participant characteristics were associated with different shelter use patterns. Knowledge of variables associated with more favorable trajectories may help to inform service planning and contribute to modeling efforts for homelessness.

DOES THE TIMING OF INCARCERATION IMPACT THE TIMING AND DURATION OF HOMELESSNESS? EVIDENCE FROM "THE TRANSITIONS TO HOUSING" STUDY

Compared to their non-homeless peers, chronically homeless adults are much more likely to have a history of incarceration. In turn, homelessness is associated with increased morbidity, lack of access to adequate healthcare services, and decreased life expectancy. This study investigates whether age at first incarceration is associated with age at first homeless experience and with lifetime duration of literal homelessness. Study participants are homeless adults entering permanent supportive housing (PSH) in Los Angeles County, California, that have experienced incarceration prior to their first experience of homelessness (n=230). Multivariate linear regressions were conducted to determine association between age at first incarceration with: 1) age at first literal homelessness and 2) lifetime duration of literal homelessness. Results indicate that incarceration as a juvenile and young adult is significantly associated with earlier literal homelessness experiences and may be associated with longer durations of literal homelessness, for adults entering PSH. Moreover, women incarcerated as juveniles and entering PSH first experienced literal homelessness earlier than comparable men. Our findings suggest the need for long-term supportive services for persons incarcerated before 25 years old, especially for women. Moreover, these findings refine the working knowledge that prior incarceration increases risk for prolonged homelessness and can help agencies complete more accurate risk assessments.

Cost-effectiveness of Housing First Intervention With Intensive Case Management Compared With Treatment as Usual for Homeless Adults With Mental Illness: Secondary Analysis of a Randomized Clinical Trial

IMPORTANCE

In the At Home/Chez Soi trial for homeless individuals with mental illness, the scattered-site Housing First (HF) with Intensive Case Management (ICM) intervention proved more effective than treatment as usual (TAU).

OBJECTIVE

To evaluate the cost-effectiveness of the HF plus ICM intervention compared with TAU.

DESIGN, SETTING, AND PARTICIPANTS

This is an economic evaluation study of data from the At Home/Chez Soi randomized clinical trial. From October 2009 through July 2011, 1198 individuals were randomized to the intervention (n = 689) or TAU (n = 509) and followed up for as long as 24 months. Participants were recruited in the Canadian cities of Vancouver, Winnipeg, Toronto, and Montreal. Participants with a current mental disorder who were homeless and had a moderate level of need were included. Data were analyzed from 2013 through 2019, per protocol.

INTERVENTIONS

Scattered-site HF (using rent supplements) with off-site ICM services was compared with usual housing and support services in each city.

MAIN OUTCOMES AND MEASURES

The analysis was performed from the perspective of society, with days of stable housing as the outcome. Service use was ascertained using questionnaires. Unit costs were estimated in 2016 Canadian dollars.

RESULTS

Of 1198 randomized individuals, 795 (66.4%) were men and 696 (58.1%) were aged 30 to 49 years. Almost all (1160 participants, including 677 in the HF group and 483 in the TAU group) contributed data to the economic analysis. Days of stable housing were higher by 140.34 days (95% CI, 128.14-153.31 days) in the HF group. The intervention cost $14 496 per person per year; reductions in costs of other services brought the net cost down by 46% to $7868 (95% CI, $4409-$11 405). The incremental cost-effectiveness ratio was $56.08 (95% CI, $29.55-$84.78) per additional day of stable housing. In sensitivity analyses, adjusting for baseline differences using a regression-based method, without altering the discount rate, caused the largest change in the incremental cost-effectiveness ratio with an increase to $60.18 (95% CI, $35.27-$86.95). At $67 per day of stable housing, there was an 80% chance that HF was cost-effective compared with TAU. The cost-effectiveness of HF appeared to be similar for all participants, although possibly less for those with a higher number of previous psychiatric hospitalizations.

CONCLUSIONS AND RELEVANCE

In this study, the cost per additional day of stable housing was similar to that of many interventions for homeless individuals. Based on these results, expanding access to HF with ICM appears to be warranted from an economic standpoint.

TRIAL REGISTRATION

isrctn.org Identifier: ISRCTN42520374.

The Impact of Housing First on Criminal Justice Outcomes among Homeless People with Mental Illness: A Systematic Review

OBJECTIVE

Housing First is increasingly put forward as an important component of a pragmatic plan to end homelessness. The literature evaluating the impact of Housing First on criminal justice involvement has not yet been systematically examined. The objective of this systematic review is to examine the impact of Housing First on criminal justice outcomes among homeless people with mental illness.

METHOD

Five electronic databases (PsycINFO, MEDLINE, Embase, CINAHL, Web of Science) were searched up until July 2018 for randomised and nonrandomised studies of Housing First among homeless people with a serious mental disorder.

RESULTS

Five studies were included for a total of 7128 participants. Two studies from a randomised controlled trial found no effect of Housing First on arrests compared to treatment as usual. Other studies compared Housing First to other programs or compared configurations of HF and found reductions in criminal justice involvement among Housing First participants.

CONCLUSIONS

This systematic review suggests that Housing First, on average, has little impact on criminal justice involvement. Community services such as Housing First are potentially an important setting to put in place strategies to reduce criminal justice involvement. However, forensic mental health approaches such as risk assessment and management strategies and interventions may need to be integrated into existing services to better address potential underlying individual criminogenic risk factors. Further outcome assessment studies would be necessary.