Health of the Nation Outcome Scales. Results of the Victorian field trial

Outcomes of Victorian Prevention and Recovery Care Services: A matched pairs comparison

OBJECTIVE

In Victoria, Prevention and Recovery Care Services have been established to provide a partial alternative to inpatient admissions through short-term residential mental health care in the community. This study set out to determine whether Prevention and Recovery Care Services are achieving their objectives in relation to reducing service use and costs, fostering least restrictive care and leading to positive clinical outcomes.

METHODS

We matched 621 consumers whose index admission in 2014 was to a Prevention and Recovery Care ('PARCS consumers') with 621 similar consumers whose index admission in the same year was to an acute inpatient unit and who had no Prevention and Recovery Care stays for the study period ('inpatient-only consumers'). We used routinely collected data to compare them on a range of outcomes.

RESULTS

Prevention and Recovery Care Services consumers made less subsequent use of acute inpatient services and, on balance, incurred costs that were similar to or lower than inpatient-only consumers. They were also less likely to spend time on an involuntary treatment order following their index admission. Prevention and Recovery Care Services consumers also experienced positive clinical outcomes over the course of their index admission, but the magnitude of this improvement was not as great as for inpatient-only consumers. This type of clinical improvement is important for Prevention and Recovery Care Services, but they may place greater emphasis on personal recovery as an outcome.

CONCLUSION

Prevention and Recovery Care Services can provide an alternative, less restrictive care option for eligible consumers who might otherwise be admitted to an acute inpatient unit and do so at no greater cost.

Translation and psychometric properties of the Persian version of the Health of the Nation Outcome Scales for Elderly People (HoNOS65+)

OBJECTIVES

This study aimed to evaluate the validity and reliability of the Persian version of Health of the Nation Outcome Scales for Elderly People (HoNOS65+) in Iran's elderly population.

METHODS

The scale English version translated to Persian using a forward and backward translation method. The scale was filled for two elderly population groups (inpatient and outpatients) (N = 300). Simultaneously with HoNOS+65, the Clinical Global Impressions Scale (CGI) was completed. Two separate therapists were filled HoNOS+65 for thirty-one patients (inter-rater reliability test). In general, content validity, consistency, confirmatory factor analyses (CFA), convergent validity, and criterion validity were examined.

RESULTS

Using exploratory factor analysis, three factors were extracted. Inter-rater reliability in some items has a slight agreement. Content validity ratio (0.75) and index (0.90) were calculated for each item. Cronbach's alpha total score was 0.82. According to the largest modification indices, CFA showed satisfactory fit indices. The convergent validity between HoNOS +65 and CGI was (r = 0/71, sig = 0.000). Finally, the optimal cut-off point was achieved 13. Sensitivity and specificity for the HoNOS +65 were 88.89% and 81.16%, respectively, with the Youden index of 0.7005.

CONCLUSION

The Persian version of HoNOS65+ has high reliability, validity, specificity, and sensitivity in multidimensional assessment of Iranian geriatric mental health.

The meagre outcomes of HoNOS

OBJECTIVE

To ask the Leginski question of an outcome measurement process.

METHOD

Articles elicited by a literature search of 'HoNOS' are analysed for evidence of its value or cost effectiveness to consumers, clinicians or administrators.

RESULTS

None of the 260 studies elicited by the search attempted to assess the cost of the use of Health of the Nation Outcome Scale (HoNOS). One study investigated the effect of routine outcome measurement, finding that it failed to result in the provision of evidence-based care. One study reported positive outcomes.

CONCLUSIONS

The ability of HoNOS to improve the health and social functioning of mentally ill people has not been demonstrated. The widespread use of HoNOS as a routine outcome measure is not justified by the evidence.

Symptomatic and Functional Remission in Young Adults with a Psychotic Disorder in a Rehabilitation Focused Team

The aim of this study is to assess symptomatic remission (SR) and functional remission (FR) in a rehabilitation focused program for young adults with a psychotic disorder in the Netherlands, and to investigate which individual and mental health care factors are associated with SR and/or FR, by using Routine Outcome Monitoring data and data on met needs and unmet needs for care. Data of 287 young adults were collected. Almost 40% achieved or maintained SR, 34% FR, and 26% achieved or maintained both. In addition to sociodemographic factors, living independently, paid employment, higher levels of compliance with treatment, and better fulfillment of unmet needs for care in relation to psychological distress, company and daytime activities were associated with better outcomes on SR and/or FR. Our findings underscore that to successfully improve and sustain remission in young adults with a psychotic disorder, it is needed to conduct specific research into the relationship between SR and FR.

Reliable and clinically significant change based on the Health of the Nation Outcome Scales

To evaluate treatment outcomes of individual patients based on clinician-rated instruments, the assessment of reliable and clinically significant change (RCSC) is essential. In heterogeneous samples, RCSC underestimates treatment outcome. Therefore, the Reliable Change Index (RCI) was adjusted by a stratification into subsamples. This method was tested on the Health of the Nation Outcome Scales for Children and Adolescents (HoNOSCA) ratings (n = 12,547) at admission and discharge of youths (age 6-18 years) treated in ten psychiatric institutions. Based on the test-retest reliability of a subsample (n = 397), the RCI was calculated for three severity groups ("very severe," "moderately severe," and "subclinical/mild"). Individuals who accomplished reliable change during treatment and moved to a subclinical score were classified as recovered. Using the traditional RCSC calculation, the large majority (75.1%) of the sample would be considered as unchanged, 2.9% as deteriorated, 18.9% as improved, and 3.1% as recovered. Using RCI cutoff points based on the severity ratings at admission results in a more representative distribution of outcome groups, where 54.6% of the sample was stable, 7.5% worsened, 21.6% improved, and 16.3% recovered. This methodological framework for calculating RCSC for heterogeneous populations is applicable for all HoNOS instruments, making it very useful for mental health professionals.

Implementation of outcome measurement (HoNOS) in an outpatient psychiatric clinic in Sligo/Leitrim mental health service

BACKGROUND

Routine clinical outcome monitoring (RCOM) is the standardised gathering of measures of clinical outcomes in everyday practice. HoNOS (Health of the Nation Outcome Scales) is a tool used in RCOM.

AIMS

To examine (a) agreement between HoNOS and Global Assessment of Functioning (GAF), (b) HoNOS changes over time/attendance and (c) clinical parameters affecting HoNOS scores.

METHODS

Data from outpatient clinics were collected at each contact over 2 years until June 2016 including: gender, age, diagnosis (ICD-10) and HoNOS scores. In a subsample, the GAF also were completed by community psychiatric nurses blind to HoNOS scores.

RESULTS

A number of 470 outpatients have undergone 1125 HoNOS assessments during the study period. Mean age of the attendants was 43.12; SD 14.6. Male = 220 (46.8%). Longitudinal analysis demonstrated that lower HoNOS scores are independently significantly associated to number of assessments and diagnosis in ICD-10 categories of F20-F29 (Schizophrenia, schizotypal and delusional disorders) F30-F39 (mood disorders) F40-F48 (neurotic, stress-related and somatoform disorders) and F50-F59 (behavioural disorders associated with physiological disturbances). Gender and age were not significantly associated with decline of HoNOS scores. Neither were other diagnostic categories. Agreement between HoNOS and GAF was excellent (N = 261, rho = - 0.919, p < 0.001).

CONCLUSIONS

This study shows that HoNOS is a feasible instrument which can be potentially used in ROCM in mental health services in Ireland and supports further the need for implementation of routine measurements in Mental Health Services. It adds longitudinal data which is lacking in similar previous studies.

Routine measurement of mental health service outcomes: Health of the Nation Outcome Scales in Nova Scotia

Aims and Method

Although the Health of the Nation Outcome Scales (HoNOS) were designed for routine clinical use, completion rates in clinical settings rarely exceed 60%. We evaluated two initiatives to increase completion rates: timely feedback to clinicians, useful at individual, team and service levels, and improved supporting materials (tabulated glossaries for all versions covering the life-span).

Results

Clinicians in South Shore Health district provided ratings on all outpatient referrals over 12 months as part of routine care. Data were captured using the Nova Scotia routine administrative data system. Completion rates rose from 61% to 86% (n=1190). Clinicians' ratings of the instrument's ease of use were significantly improved.

Clinical Implications

Use of a tabulated glossary and enhanced feedback of clinically useful information improved clinician support for the routine measurement of health outcomes with HoNOS.

An evaluation of Health of the Nation Outcome Scales data to inform psychiatric morbidity following the Canterbury earthquakes

OBJECTIVE

Following the onset of the Canterbury, New Zealand earthquakes, there were widespread concerns that mental health services were under severe strain as a result of adverse consequences on mental health. We therefore examined Health of the Nation Outcome Scales data to see whether this could inform our understanding of the impact of the Canterbury earthquakes on patients attending local specialist mental health services.

METHOD

Health of the Nation Outcome Scales admission data were analysed for Canterbury mental health services prior to and following the Canterbury earthquakes. These findings were compared to Health of the Nation Outcome Scales admission data from seven other large District Health Boards to delineate local from national trends. Percentage changes in admission numbers were also calculated before and after the earthquakes for Canterbury and the seven other large district health boards.

RESULTS

Admission Health of the Nation Outcome Scales scores in Canterbury increased after the earthquakes for adult inpatient and community services, old age inpatient and community services, and Child and Adolescent inpatient services compared to the seven other large district health boards. Admission Health of the Nation Outcome Scales scores for Child and Adolescent community services did not change significantly, while admission Health of the Nation Outcome Scales scores for Alcohol and Drug services in Canterbury fell compared to other large district health boards. Subscale analysis showed that the majority of Health of the Nation Outcome Scales subscales contributed to the overall increases found. Percentage changes in admission numbers for the Canterbury District Health Board and the seven other large district health boards before and after the earthquakes were largely comparable with the exception of admissions to inpatient services for the group aged 4-17 years which showed a large increase.

CONCLUSION

The Canterbury earthquakes were followed by an increase in Health of the Nation Outcome Scales scores for attendees of local mental health services compared to other large district health boards. This suggests that patients presented with greater degrees of psychiatric distress, social disruption, behavioural change and impairment as a result of the earthquakes.

A systematic review of clinician-rated instruments to assess adults' levels of functioning in specialised public sector mental health services

BACKGROUND

Functioning is one of the key domains emphasised in the routine assessment of outcomes that has been occurring in specialised public sector mental health services across Australia since 2002, via the National Outcomes and Casemix Collection. For adult consumers (aged 18-64), the 16-item Life Skills Profile (LSP-16) has been the instrument of choice to measure functioning. However, review of the National Outcomes and Casemix Collection protocol has highlighted some limitations to the current approach to measuring functioning. A systematic review was conducted to identify, against a set of pre-determined criteria, the most suitable existing clinician-rated instruments for the routine measurement of functioning for adult consumers.

METHOD

We used two existing reviews of functioning measures as our starting point and conducted a search of MEDLINE and PsycINFO to identify articles relating to additional clinician-rated instruments. We evaluated identified instruments using a hierarchical, criterion-based approach. The criteria were as follows: (1) is brief (<50 items) and simple to score, (2) is not made redundant by more recent instruments, (3) relevant version has been scientifically scrutinised, (4) considers functioning in a contemporary way and (5) demonstrates sound psychometric properties.

RESULTS

We identified 20 relevant instruments, 5 of which met our criteria: the LSP-16, the Health of the Nation Outcome Scales, the Illness Management and Recovery Scale-Clinician Version, the Multnomah Community Ability Scale and the Personal and Social Performance Scale.

CONCLUSION

Further work is required to determine which, if any, of these instruments satisfy further criteria relating to their appropriateness for assessing functioning within relevant service contexts, acceptability to clinicians and consumers, and feasibility in routine practice. This should involve seeking stakeholders' opinions (e.g. about the specific domains of functioning covered by each instrument and the language used in individual items) and testing completion rates in busy service settings.

Routine outcome measurement in Australia

Australia has been implementing routine outcome measurement in its specialized public sector mental health services for over a decade. It uses a range of clinician-rated and consumer-rated measures that are administered at set times during episodes of inpatient, ambulatory and community residential episodes of care. Routine outcome measurement is now embedded in service delivery, and data are made available in a variety of ways to different audiences. These data are used by policy-makers and planners to inform decisions about system-wide reforms, by service managers to monitor quality and effectiveness, and by clinicians to guide clinical decision-making and to promote dialogue with consumers. Consumers, carers and the general community can use these data to ensure that services are accountable for the care they deliver. This paper describes the status quo in Australia with respect to routine outcome measurement, discusses the factors that led to its successful implementation, and considers the steps that are necessary for its continued development.

The performance of the Health of the Nation Outcome Scales as measures of clinical severity

The aim of this study was to examine the performance of the Health of the Nation Outcome Scales (HoNOS) against other measures of functioning and mental health in a full three-year cohort of admissions to a psychiatric hospital. A sample of N=1719 patients (35.3% females, aged 17-78 years) was assessed using observer-rated measures and self-reports of psychopathology at admission. Self-reports were available from 51.7% of the sample (34.4% females, aged 17-76 years). Functioning and psychopathology were compared across five ICD-10 diagnostic groups: substance use disorders, schizophrenia and psychotic disorders, affective disorders, anxiety/somatoform disorders and personality disorders. Associations between the measures were examined, stratifying by diagnostic subgroup. The HoNOS were strongly linked to other measures primarily in psychotic disorders (except for the behavioral subscale), while those with substance use disorders showed rather poor links. Those with anxiety/somatoform disorders showed null or only small associations. This study raises questions about the overall validity of the HoNOS. It seems to entail different levels of validity when applied to different diagnostic groups. In clinical practice the HoNOS should not be used as a stand-alone instrument to assess outcome but rather as part of a more comprehensive battery including diagnosis-specific measures.

Consistency of the Health of the Nation Outcome Scales (HoNOS) at inpatient-to-community transition

OBJECTIVES

The Health of the Nation Outcome Scales (HoNOS) are mandated outcome-measures in many mental-health jurisdictions. When HoNOS are used in different care settings, it is important to assess if setting specific bias exists. This article examines the consistency of HoNOS in a sample of psychiatric patients transitioned from acute inpatient care and community centres.

SETTING

A regional mental health service with both acute and community facilities.

PARTICIPANTS

111 psychiatric patients were transferred from inpatient care to community care from 2012 to 2014. Their HoNOS scores were extracted from a clinical database; Each inpatient-discharge assessment was followed by a community-intake assessment, with the median period between assessments being 4 days (range 0-14). Assessor experience and professional background were recorded.

PRIMARY AND SECONDARY OUTCOME MEASURES

The difference of HoNOS at inpatient-discharge and community-intake were assessed with Pearson correlation, Cohen's κ and effect size.

RESULTS

Inpatient-discharge HoNOS was on average lower than community-intake HoNOS. The average HoNOS was 8.05 at discharge (median 7, range 1-22), and 12.16 at intake (median 12, range 1-25), an average increase of 4.11 (SD 6.97). Pearson correlation between two total scores was 0.073 (95% CI -0.095 to 0.238) and Cohen's κ was 0.02 (95% CI -0.02 to 0.06). Differences did not appear to depend on assessor experience or professional background.

CONCLUSIONS

Systematic change in the HoNOS occurs at inpatient-to-community transition. Some caution should be exercised in making direct comparisons between inpatient HoNOS and community HoNOS scores.

Health of the Nation Outcome Scales (HoNOS): use in an Irish psychiatric outpatient population

Objectives: To evaluate the clinical utility and validity of the Health of the Nation Outcome Scales (HoNOS) in an Irish catchment area psychiatric service.

Method: One hundred consecutive outpatients were assessed using the HoNO S and Global Assessment of Functioning (GAF) scales.

Results: It was feasible to administer HoNOS in day-to-day clinical practice. There was a statistically significant correlation between the HoNO S and GAF scores. Attenders at the outpatient department had significantly lower HoNOS scores compared to individuals assessed on domiciliary visits or at the day hospital. Individuals with schizophrenia had significantly higher HoNO S scores compared to affective disordered patients. However, this difference was confined to the Social subscale of HoNOS.

Conclusions: Although these findings indicate that HoNOS has significant convergent and criterion validity as a measure of psychiatric morbidity, its widespread use in day-to-day clinical practice may be premature.

The effect of community treatment orders on outcome as assessed by the Health of the Nation Outcome Scales

Many studies of outpatient commitment have assessed effects on health service use rather than psychiatric symptomatology. We examined whether patients on one form of outpatient commitment, community treatment orders (CTOs), had better outcomes on the Health of the Nation Outcome Scales (HoNOS). Cases and controls from three linked Western Australian databases were matched on age, sex, diagnosis and time of hospital discharge. These databases cover the entire state (population=2.3 million). We compared HoNOS scores of CTO cases and controls at baseline, six-, and twelve-month follow-up, using multivariate analyses to further control for confounders. We identified 1296 CTO cases between 2004 and 2009 along with the same number of controls matched on age, sex, discharge date and mental health diagnosis (total n=2592). HoNOS scores were available for 1433 (55%) of the patients who could have had these recorded at baseline (748 CTO cases and 685 controls). There was no significant difference in HoNOS scores at six- and twelve-month follow-up between CTO cases and controls after adjusting for potential confounders at each time-point. Although the study was limited by missing data, outpatient commitment in the form of CTOs may not result in better psychiatric outcomes as measured by the HoNOS.

Measuring the impacts of seclusion on psychiatry inpatients and the effectiveness of a pilot single-session post-seclusion counselling intervention

Despite the accumulation of evidence demonstrating patients' accounts of trauma associated with seclusion, the use of evidence-based post-seclusion debriefing is not apparent in the published work. This study aimed to identify the impacts seclusion has on an individual using the Impact of Events - Revised (IES-R), a standardized and widely used measure of trauma symptoms, and measure the effectiveness of a post-seclusion counselling intervention in mitigating the experience of seclusion-related trauma and reducing time spent in seclusion. The study design involved a comparison of the seclusion-related trauma and time in seclusion that was experienced by consenting patients managed on the two inpatient wards of Alfred Psychiatry. To investigate the efficacy of post-seclusion counselling to reduce event-related trauma as well as the use of seclusion, a brief single-session intervention was piloted comparing outcomes for patients treated on a ward implementing semistructured post-seclusion counselling and patients treated on a ward continuing with post-seclusion support as usual. A total of 31 patients consented to participate, with approximately 47% reporting trauma symptoms consistent with 'probable post-traumatic stress disorder' (IES-R total score, >33), although there was no difference in trauma experience between groups. Significantly fewer hours were spent in seclusion for patients treated on the ward piloting the post-seclusion counselling intervention. Findings, therefore, highlight not only the potential for significant trauma stemming from a seclusion event, but also the capacity for the implementation of such interventions as post-seclusion counselling to raise awareness of the need to minimize time spent in seclusion for patients.

Demonstrating the effectiveness of less restrictive care pathways for the management of patients treated with clozapine

OBJECTIVE

The purpose of this study was to measure the effectiveness of two alternative care pathways for managing patients treated with clozapine.

METHOD

Medical records for 90 clozapine patients managed via three care pathways were audited for a 24 month period (30 per group). The three care pathways established to manage patients prescribed clozapine include: (1) remaining in public mental health service case management; (2) transitioning to general practitioner-mental health service shared care; or (3) transitioning to private psychiatry sole care. Demographic, illness, medication compliance, service utilisation and performance on clinical outcome measures were collected in the 12 months prior to and following transition.

RESULTS

Across both the private psychiatry and general practitioner (GP) shared care transitioned groups, only one patient had a psychiatric hospital admission in the 12 months following transition, and transitioned patients also had fewer mental health service clinician contacts. Good medication compliance, better skills of daily living, lower levels of illicit substance abuse and a lower intensity of case management history were seen in transitioned patients.

CONCLUSIONS

Transitioning appropriate patients taking clozapine to less intensive care pathways like private psychiatrists and GP shared care can be effectively achieved if appropriate supports are in place for both the clinicians and their patients.

Does an educational intervention improve the usefulness of the Health of the Nation Outcome Scales in an acute mental health setting?

The purpose of the current study was to measure the effect of an educational intervention on the Health of the Nation Outcome Scales (HoNOS) completion rates. Additionally, interrater reliability and accuracy amongst nurses completing the instrument was assessed. We used a pre- and post-intervention design with videoed vignettes providing the basis for the educational intervention. Mental health nurses were assessed four times: at baseline, immediately after the intervention, 1 week later and again, 2 months after the intervention. There was a non-statistical increase in the number of patients assessed on admission using the HoNOS from 12.5% to 22.6%. Interrater reliability was low and did not improve through the course of the study. Intraclass correlation coefficients ranged 0.41-0.48. Accuracy was poor when discrete scoring between 0-4 was analyzed but improved when scores were dichotomised to reflect a clinically significant cut-off of 2 or more. The intervention improved completion rates marginally but interrater reliability and accuracy were low and did not improve over the study period. Opportunities for improvement were identified.

The validity of the severity-psychosis hypothesis in depression

BACKGROUND

Psychotic depression (PD) is classified as a subtype of severe depression in the current diagnostic manuals. Accordingly, it is a common conception among psychiatrists that psychotic features in depression arise as a consequence of depressive severity. The aim of this study was to determine whether the severity of depressive and psychotic symptoms correlate in accordance with this "severity-psychosis" hypothesis and to detect potential differences in the clinical features of PD and non-psychotic depression (non-PD).

METHODS

Quantitative analysis of Health of the Nation Outcome Scales (HoNOS) scores from all patients admitted to a Danish general psychiatric hospital due to a severe depressive episode in the period between 2000 and 2010 was performed.

RESULTS

A total of 357 patients with severe depression, of which 125 (35%) were of the psychotic subtype, formed the study sample. Mean HoNOS scores at admission differed significantly between patients with non-PD and PD on the items hallucinations and delusions (non-PD=0.33 vs. PD=1.37, p<0.001), aggression (non-PD=0.20 vs. PD=0.36, p=0.044) and on the total score (non-PD=10.55 vs. PD=11.87, p=0.024). The HoNOS scores on the two items "depression" and "hallucinations and delusions" were very weakly correlated.

LIMITATIONS

Diagnoses were based on normal clinical practice and not formalized research criteria.

CONCLUSIONS

The symptomatology of PD and non-PD differs beyond the mere psychosis. Furthermore, severity ratings of depressive and psychotic symptoms are very weakly correlated. These findings offer further support to the hypothesis stating that the psychotic- and non-psychotic subtypes of depression may in fact be distinct clinical syndromes.

Organisational obsessive-compulsive disorder: has clinical governance become pathological?

OBJECTIVE

The aim of the study was to compare the use of various monitoring tools in the public psychiatry sector to the development of obsessive-compulsive rituals in individuals.

CONCLUSION

The step from useful data collection to meaningless and incapacitating ritual may be prevented by the use of ongoing dialogue, assumption testing, realistic appraisal of clinician responsibility and tolerance of uncertainty.

Timing, prevalence, determinants and outcomes of homelessness among patients admitted to acute psychiatric wards

PURPOSE

To document the prevalence, timing, associations and short-term housing outcomes of homelessness among acute psychiatric inpatients.

METHODS

Cross-sectional study of 4,386 acute psychiatric admissions discharged from a single NHS Trust in 2008-2009.

RESULTS

Homelessness occurred in 16%. Most homelessness (70%) was either recorded as present at admission or started within 1 week. It was associated with younger age; male gender; ethnicity other than White British or Black African/Caribbean; being single, divorced, separated or widowed; diagnosis of drug and alcohol disorder; detention under a forensic section of the Mental Health Act; having no previous admission or alternatively having a longer previous admission; having a low score on the depressed mood or hallucinations and delusions items of the Health of the Nation Outcome Scales (HoNOS); and having a high score on the HoNOS relationship difficulties and occupation and activities items. Of those who were followed-up for 28 days after discharge, 53% had a new address recorded; of those who were not, only 22% did.

CONCLUSIONS

Homelessness affects a substantial minority of psychiatric admissions in the UK. Housing outcomes are uncertain, and it is possible that more than half continue to be homeless or living in very transient situations. Demographic and diagnostic associations with homelessness were consistent with US studies; associations with HoNOS item scores and having had no admission in the preceding 2 years suggest that, in many cases, social adversity predominates over active psychopathology at the time of admission.

Achievements in mental health outcome measurement in Australia: Reflections on progress made by the Australian Mental Health Outcomes and Classification Network (AMHOCN)

Background

Australia’s National Mental Health Strategy has emphasised the quality, effectiveness and efficiency of services, and has promoted the collection of outcomes and casemix data as a means of monitoring these. All public sector mental health services across Australia now routinely report outcomes and casemix data. Since late-2003, the Australian Mental Health Outcomes and Classification Network (AMHOCN) has received, processed, analysed and reported on outcome data at a national level, and played a training and service development role. This paper documents the history of AMHOCN’s activities and achievements, with a view to providing lessons for others embarking on similar exercises.

Method

We conducted a desktop review of relevant documents to summarise the history of AMHOCN.

Results

AMHOCN has operated within a framework that has provided an overarching structure to guide its activities but has been flexible enough to allow it to respond to changing priorities. With no precedents to draw upon, it has undertaken activities in an iterative fashion with an element of ‘trial and error’. It has taken a multi-pronged approach to ensuring that data are of high quality: developing innovative technical solutions; fostering ‘information literacy’; maximising the clinical utility of data at a local level; and producing reports that are meaningful to a range of audiences.

Conclusion

AMHOCN’s efforts have contributed to routine outcome measurement gaining a firm foothold in Australia’s public sector mental health services.

Care coordinators: a controlled evaluation of an inpatient mental health service innovation

The study aimed to evaluate the impact of introducing designated care coordinators into an acute mental health inpatient unit in terms of service delivery, clinical outcomes, and service user and significant other perceptions. A pre-post-controlled design was implemented with a consecutive sample of 292 service users admitted and staying more than 5 days in two wards, with care coordinators introduced in one ward. Data were obtained from clinical records, standard measures, and service user and significant other surveys. Care coordinator input was associated with significant improvements in service delivery and stronger involvement of significant others and community resources. Care-coordinated clients showed significantly better clinical outcomes, including the Health of Nations Outcome Scales behaviour subscale, less time in the intensive care subunit, less community crisis team input in the week following discharge, and lower rates of readmission in the month following discharge. Care-coordinated service users and their significant others gave higher ratings of service delivery, outcome, and satisfaction. The results indicate that designated care coordinators significantly improve care processes, outcomes, and service user experience in acute inpatient mental health settings.

Measuring clinical change in routine mental health care: differences between first time and longer term service users

OBJECTIVE

The aims were to assess the feasibility of routinely collecting outcome data in everyday mental health services across Italy and to evaluate clinical change in a cohort of patients stratified by illness duration.

METHOD

A prevalence sample of patients attending nine Italian community mental health services (CMHS) was assessed over one year with the Health of the Nation Outcome Scales (HoNOS). The patients were classified on the basis of the duration of their contact with services. Clinical outcome was evaluated taking into account parameters of reliable and clinically significant change (RCSC). Predictors of change included clinical and socio-demographic characteristics at first assessment and six month reliable improvement.

RESULTS

2059 patients were evaluated with only 3% attrition at follow up; 22% of first time and about 7% of longer term users achieved reliable improvement at one year. First contacts had a better outcome than longer term users and significant differences were seen at both group and individual level. Reliable improvement at six months was the best predictor of clinical improvement at one year for the whole cohort.

CONCLUSION

The study demonstrated the feasibility of routine outcome assessment and gave an expected and realistic picture of the one-year outcome of a representative sample of patients attending a group of Italian CMHS. RCSC showed potential utility as a means of communicating with clinicians and decision makers.

Does a more specified version of the HoNOS (Health of the Nation Outcome Scales) increase psychometric properties of the inventory?

BACKGROUND

The Health of the Nation Outcome Scales (HoNOS) is a clinician-rated instrument for the differentiated measurement of severity in patients with mental disorder. Item 8 of the instrument, assessing 'Other mental and behavioral problems', is particularly relevant for patients with affective disorders, anxiety disorders, and eating and personality disorders. However, some studies have shown that the scale possesses unsatisfactory psychometric properties. The objective of the present study was therefore to validate the psychometric properties of a more specified version of the HoNOS-D item 8.

METHODS

The instrument's reliability and validity were tested using a large, representative, clinical sample of patients with mental disorders (study 1: n = 1,918 and n = 1,357). Additional tests of reliability and criterion validity were performed using a further clinical sample of patients with mental disorders (study 2: N = 55).

RESULTS

The extended version of the HoNOS provides a differentiated picture of additional problem areas for the patient. Although inter-rater reliability indicates a need for more detailed instructions, the problem areas of item 8 proved on the whole to be suitable for measuring the extent and severity of mental problems that are present in addition to the primary problem.

CONCLUSION

In order to make the extended assessment of the HoNOS useful for clinical routine practice, a supplemental glossary is needed.

Clinical indicators for routine use in the evaluation of early psychosis intervention: development, training support and inter-rater reliability

AIM

Clinical practice improvement carried out in a quality assurance framework relies on routinely collected data using clinical indicators. Herein we describe the development, minimum training requirements, and inter-rater agreement of indicators that were used in an Australian multi-site evaluation of the effectiveness of early psychosis (EP) teams.

METHODS

Surveys of clinician opinion and face-to-face consensus-building meetings were used to select and conceptually define indicators. Operationalization of definitions was achieved by iterative refinement until clinicians could be quickly trained to code indicators reliably. Calculation of percentage agreement with expert consensus coding was based on ratings of paper-based clinical vignettes embedded in a 2-h clinician training package.

RESULTS

Consensually agreed upon conceptual definitions for seven clinical indicators judged most relevant to evaluating EP teams were operationalized for ease-of-training. Brief training enabled typical clinicians to code indicators with acceptable percentage agreement (60% to 86%). For indicators of suicide risk, psychosocial function, and family functioning this level of agreement was only possible with less precise 'broad range' expert consensus scores. Estimated kappa values indicated fair to good inter-rater reliability (kappa > 0.65). Inspection of contingency tables (coding category by health service) and modal scores across services suggested consistent, unbiased coding across services.

CONCLUSIONS

Clinicians are able to agree upon what information is essential to routinely evaluate clinical practice. Simple indicators of this information can be designed and coding rules can be reliably applied to written vignettes after brief training. The real world feasibility of the indicators remains to be tested in field trials.

HoNOS in the consultation liaison psychiatry setting: is it valid?

OBJECTIVE

The aim of this paper was to assess whether the Health of the Nation Outcome Scales (HoNOS) is a valid outcome measure in the consultation liaison psychiatry (CL) setting.

METHODS

Statistical analysis was performed on 6 months of HoNOS data from a busy metropolitan CL service.

RESULTS

There were statistical differences between the HoNOS scores of groups referred for different types of mental health follow up, but also wide ranges within, and substantial overlap between, each of these groups. HoNOS item analysis demonstrated significant contributions to changes in HoNOS scores across multiple items.

CONCLUSIONS

Although the HoNOS appears to have validity as a measure of severity of mental illness in the CL setting at a population level, concerns can be raised about its usefulness as a measure of change in the severity of mental illness in this setting.

Outcome measurement in chronic mental illness

This review begins with an outline of outcome measurement in the country where it has been most thoroughly implemented, namely Australia. There follows a consideration of what constitutes an outcome in mental illness generally, and chronic mental illness in particular. Some instruments, such as the Health of the Nation Outcome Scales (HoNOS), focus primarily on illness severity, and examples of their use in the area of chronic mental illness are presented. Other instruments, such as the Life Skills Profile (LSP), assess personal functioning or disability, and that literature is reviewed. One major area of attention in the chronically mentally ill is quality of life. Another fruitful approach to assessing outcome is to look at needs, especially unmet needs, for which the leading instrument is the Camberwell Assessment of Need; relevant findings are reviewed. The most recent area of interest is recovery. While several scales have been developed, there are as yet relatively few reports of their application with patients with chronic mental illness. The concluding section considers the benefits and weaknesses of using the same standard instruments with all consumers within a service, and shows the utility of outcome results in groups and individuals with generally small overall changes.

Needs and risks of patients in a state-wide inpatient forensic mental health population

Routine needs assessments have become mandated requirements for public mental health services. However, the appropriateness of these generic health needs assessments to specialist populations remains questionable. This study sought to assess individual needs assessed using a widely used clinician rated assessment (Health of the Nation Outcome Scales-Secure; HoNOS-Secure), a subjective needs assessment that considers both staff and patient perspectives (Camberwell Assessment of Need-Forensic version; CANFOR), and a measure of risk for general criminal recidivism (Level of Service Inventory: Screening Version; LSI:SV) in a secure forensic mental health service. Results revealed significant positive correlations between staff ratings on HoNOS-Secure, CANFOR total needs, and CANFOR met needs scores, but no significant association between CANFOR ratings or HoNOS-Secure ratings and LSI:SV scores. Although patients and staff reported the same number of needs overall according to CANFOR (7.2 vs. 7.5, P > 0.05), patients reported that more of these needs were unmet (3.1 vs. 2.3, P < 0.05). Differences between staff and patient ratings of need suggest that needs assessments should include patient perspectives to facilitate more collaborative and comprehensive care planning. Divergent perspectives between patients and staff may impair patient engagement in treatment and therefore negatively impact on outcome. Service planning issues and opportunities for future research are discussed.

Do the Health of the Nation Outcome Scales measure outcome?

OBJECTIVE

Among mental health outcome measures that have been developed for routine use, most of the information concerns the Health of the Nation Outcome Scales (HoNOS). This instrument is widely used in Europe, Australia, and New Zealand, but not in Canada. We tested its sensitivity and predictive validity under conditions that would resemble, as closely as possible, routine use.

METHOD

Treating clinicians were asked to assess patients of all ages referred to outpatient mental health facilities of 2 district health authorities in Nova Scotia using either the HoNOS for adults or the HoNOS for Children and Adolescents (HoNOSCA). Data were entered using the existing routine administrative data system.

RESULTS

We obtained at least 1 rating on 4620 patients, giving a completion rate of 82%. On follow-up, ratings for the global score and most of the individual items were sensitive to change (n = 808). After adjusting for confounders, a baseline HoNOS score was significantly associated with subsequent in and outpatient service use including admissions, bed days, and psychiatric contacts (n = 1359).

CONCLUSIONS

HoNOS has satisfactory sensitivity and predictive validity for routine use. We could introduce the adult version and HoNOSCA simultaneously and collect data using routine databases. Given the widespread routine use of HoNOS internationally, using the same outcome measure in Canada would enable comparisons of illness severity and outcomes between jurisdictions.

The validity of the German version of the Health of the Nation Outcome Scales (HoNOS-D): a clinician-rating for the differential assessment of the severity of mental disorders

The Health of the Nation Outcome Scales (HoNOS) is an internationally-established clinician-rating instrument for the differential assessment of the severity of patients with mental disorders. The aim of this study was to examine the validity of the German version of the HoNOS (HoNOS-D). Evaluation of validity, including factor validity, convergent and discriminant validity and sensitivity to change, was conducted on a large, virtually representative, clinical sample of patients with mental disorders in inpatient psychotherapy (Study 1, N = 3169). Additional assessment of criterion-based validity was completed using another clinical sample of patients with mental disorders (Study 2, N = 55). Although factor validity of the HoNOS-D and its total score could not be confirmed as expected, the majority of single items of the HoNOS-D proved to be valid in terms of convergent validity, criterion-based validity and sensitivity to change. Hence, single items, rather than the total score of the HoNOS-D, can be recommended for obtaining a picture of the impairment of patients with mental disorders in the clinical setting.

Are the Health of the Nation Outcome Scales a valid and practical instrument to measure outcomes in North America? A three-site evaluation across Nova Scotia

We tested the usability, sensitivity and validity of the Health of the Nation Outcome Scales (HoNOS) in routine clinical practice in North America. Three pilot sites provided ratings on all inpatient and outpatient referrals over 4 months using versions covering children and adolescents (HoNOSCA), working-age adults and the over-65s. Data were entered using the routine administrative data system. Sixty-one percent of eligible patients had at least one HoNOS rating (n = 485). Following the initial rating, subsequent completion rates reached 80%. Ratings were sensitive to time and setting, with significantly higher scores in inpatients than outpatients. Individual diagnoses had different patterns of scores, further supporting validity.

Structured assessment of mental health status in psychogeriatrics: validity of the French HoNOS65+

OBJECTIVE

To assess the reliability, validity, and feasibility of a French version of the Health of the Nation Outcome Scales for Elderly People (HoNOS65+).

METHOD

Twenty mental health professionals completed the scale for 126 elderly patients. We assessed interrater reliability in inpatient and outpatient settings, together with construct and discriminant validity, as well as concurrent validity compared with several widely used clinical instruments.

RESULTS

Excellent agreement among raters was observed in the outpatient subgroup (kappa range 0.77 to 1.00), whereas interrater reliability was modest in the inpatient subgroup (kappa values < 0.55). In cases where the patient-caregiver relationship lasted more than 1 month, the reliability of the scale improved. Construct validity analysis revealed no subscale structure. All items except "self-injury" displayed high concurrent validity (significant Spearman correlations with 8 other questionnaires). In terms of discriminant validity, the "cognitive impairment" (area under the curve [AUC] 0.91) and "depressive symptoms" (AUC 0.79) items showed high sensitivity and specificity values.

CONCLUSION

Our results indicate that the French version of HoNOS65+ is a promising clinical assessment tool to evaluate mental disorders in the elderly in outpatient settings. We support its use in routine clinical practice, with the condition that a relatively long and individualized patient-caregiver relationship has been established.

Discriminant ability and criterion validity of the HoNOS in Italian psychiatric residential facilities

BACKGROUND

The Health of the Nation Outcomes Scales (HoNOS) was developed as an inclusive and comprehensive instrument to assess patient outcomes in 4 main domains: behaviour, cognitive and physical impairment, symptoms and social functioning/context. Concerns about the reliability and validity of the HoNOS have been raised. The aim of this study was to further investigate the discriminatory ability of the HoNOS; criterion validity was also examined.

SAMPLING AND METHODS

A broad sample of patients with psychotic disorders, admitted to 265 Italian residential facilities, were rated by trained research assistants and local staff on the HoNOS, Global Assessment of Functioning, Life Skills Profile, and Physical Health Index. Discriminant function analysis was used to examine the ability of the HoNOS items to correctly classify patients with positive symptoms, substantial psychosocial impairment or physical disability. The HoNOS criterion validity was also examined.

RESULTS

On the whole, the pattern of correlations between the HoNOS and the other corresponding measures was consistent. However, the majority of the correlations were only moderate. In discriminant function analysis, the classification procedure correctly classified 55.7% of the patients.

CONCLUSIONS

Although the HoNOS has many advantages in its brevity, it may lack sufficient discriminatory ability for certain patient groups. Further, it correlates only moderately with measures of disability and physical health status. These findings suggest that the HoNOS alone might be insufficient for routine evaluation and should probably be supplemented by additional measures.

A Psychometric evaluation of the German version of the 'Health of the Nation Outcome Scales, HoNOS-D': on the feasibility and reliability of clinician-performed measurements of severity in patients with mental disorders

BACKGROUND

The assessment of the severity of a mental illness is a central component in the treatment of patients with mental disorders in both the in- and outpatient settings. In Great Britain, the 'Health of the Nation Outcome Scales, HoNOS' were developed to assess the health and social functioning of patients with mental disorders.

AIMS

To examine the psychometric properties, especially the feasibility and reliability, of a German version of the HoNOS (HoNOS-D) and to thus provide international data for the comparison of different mental health services.

SAMPLING AND METHODS

The HoNOS was translated into German (HoNOS-D) in an extensive and multilayered consensus procedure. The HoNOS-D was then reviewed within the framework of a pilot study on quality assurance measures implemented by the German statutory health insurance institutes in 11 hospitals. Assessments were made of the psychometric qualities of feasibility and reliability using a representative sample of patients with mental and behavioral disorders.

RESULTS

An analysis of the feasibility of the HoNOS-D showed a range of missing values between 1.3 and 4.5% for 11 of the 12 items. An item analysis showed that three items of the HoNOS-D are particularly positively skewed. In most instances, the individual items of the rating scale exhibited only slight correlations to each other. With regard to retest reliability, satisfactory intraclass correlations between 0.80 and 0.91 were seen for 9 of the 12 items.

CONCLUSIONS

The authors of the original version of the HoNOS [Wing et al.:Br J Psychiatry 1998;172:11-18] primarily emphasized the feasibility of the instrument and the independence of the individual items and dimensions. The analysis of the missing values showed satisfactory results for feasibility. The intercorrelation matrix of the individual items also exhibited only few correlations >0.30. The retest reliability also proves to be satisfactory for the majority of the items. The narrow distribution of some of the items must be critically discussed in comparison to analyses of results in other countries (e.g. Great Britain) and other settings (e.g. inpatient psychiatric hospitals or outpatient psychotherapy).

Pattern and correlates of inpatient admission during the initial acute phase of first-episode psychosis

OBJECTIVES

The first aim of this study was to examine the rate, pattern and correlates of inpatient admission during the first 3 months of treatment for first-episode psychosis (FEP). The second aim was to determine whether the pattern of inpatient admission during this period was associated with remission of psychotic symptoms or inpatient service use at 15-month follow-up.

METHOD

One hundred and four consecutive patients with FEP at a specialist treatment service were approached to participate in a follow-up study. Patients were grouped on the basis of the pattern of inpatient admission (none, one, or multiple) during the first 3 months of treatment. Clinical ratings at baseline and 3-month follow-up, and ratings of remission of psychotic symptoms at 3 and 15-month follow-up, were available for two-thirds of the patients. Inpatient data for the 15-month follow-up period were derived from an electronic database for most patients (n = 98).

RESULTS

Eighty (76.9%) of the 104 patients were admitted to an inpatient unit during the first 3 months of treatment. Fifty-nine (56.7%) patients had a single admission and 21 (20.2%) had multiple admissions. At baseline, inpatient admission was associated with a diagnosis of affective psychosis and more severe behavioural and functional disturbance but not positive psychotic symptoms. Multiple admissions were associated with risks to self or others at baseline and 3-month follow-up, and lack of remission of positive symptoms at 3 and 15-month follow-up. There was no association between the pattern of inpatient admission during the initial 3-month period and inpatient service use during the following 12-month period.

CONCLUSIONS

The substantial proportion of young patients with FEP admitted to hospital emphasizes the need for youth-friendly treatment environments and practices. Although patients with multiple admissions during the initial treatment period are less likely to achieve remission, these patients are no more likely to establish a pattern of revolving-door hospitalizations compared with other patients.

Pathways to the first contact with specialist mental health care

OBJECTIVE

To examine the pathways to mental health care followed by patients presenting for the first time to community- and hospital-based services and the degree to which individual characteristics, cultural background, illness type, severity and service-related variables influence the time and pathways taken to reach care.

METHOD

One hundred and forty-six consecutive Australian-born, Asian and Arabic-speaking patients making their first lifetime contact with mental health services in two area health regions were included. Symptom severity was assessed using the Health of the Nations Outcome Scales. Illness explanatory models, social support, English-language proficiency and acculturation were also assessed.

RESULTS

An average of three professional consultations were made prior to first contact with public mental health services. Family physicians occupied a pivotal role in the help-seeking pathway with 53% of patients consulting a general practitioner. The median time taken to reach specialist mental health services was 6 months, with significantly shorter time for patients with psychotic disorders. Individual variables such as gender, social support, ethnicity and English fluency were not associated with delays in receiving public mental health care. Ethnicity was associated with lower utilization of allied health professionals.

CONCLUSIONS

The data suggest that social and cultural factors influence the range of professionals consulted by those with a mental illness but do not delay their presentation to public mental health services.

A review of the psychometric properties of the Health of the Nation Outcome Scales (HoNOS) family of measures

Background

The Health of the Nation Outcome Scales was developed to routinely measure outcomes for adults with mental illness. Comparable instruments were also developed for children and adolescents (the Health of the Nation Outcome Scales for Children and Adolescents) and older people (the Health of the Nation Outcome Scales 65+). All three are being widely used as outcome measures in the United Kingdom, Australia and New Zealand. There is, however, no comprehensive review of these instruments. This paper fills this gap by reviewing the psychometric properties of each.

Method

Articles and reports relating to the instruments were retrieved, and their findings synthesised to assess the instruments' validity (content, construct, concurrent, predictive), reliability (test-retest, inter-rater), sensitivity to change, and feasibility/utility.

Results

Mostly, the instruments perform adequately or better on most dimensions, although some of their psychometric properties warrant closer examination.

Conclusion

Collectively, the Health of the Nation Outcome Scales family of measures can assess outcomes for different groups on a range of mental health-related constructs, and can be regarded as appropriate for routinely monitoring outcomes.

A review of the psychometric properties of the Health of the Nation Outcome Scales (HoNOS) family of measures

BACKGROUND

The Health of the Nation Outcome Scales was developed to routinely measure outcomes for adults with mental illness. Comparable instruments were also developed for children and adolescents (the Health of the Nation Outcome Scales for Children and Adolescents) and older people (the Health of the Nation Outcome Scales 65+). All three are being widely used as outcome measures in the United Kingdom, Australia and New Zealand. There is, however, no comprehensive review of these instruments. This paper fills this gap by reviewing the psychometric properties of each.

METHOD

Articles and reports relating to the instruments were retrieved, and their findings synthesised to assess the instruments' validity (content, construct, concurrent, predictive), reliability (test-retest, inter-rater), sensitivity to change, and feasibility/utility.

RESULTS

Mostly, the instruments perform adequately or better on most dimensions, although some of their psychometric properties warrant closer examination.

CONCLUSION

Collectively, the Health of the Nation Outcome Scales family of measures can assess outcomes for different groups on a range of mental health-related constructs, and can be regarded as appropriate for routinely monitoring outcomes.

Assessing reliable and clinically significant change on Health of the Nation Outcome Scales: method for displaying longitudinal data

OBJECTIVE

Many authors recommended that reliable and clinically significant change (RCSC) should be calculated when reporting results of interventions. To test the reliability of the Health of the Nation Outcome Scales (HoNOS) in identifying RCSC, we applied the Jacobson and Truax model to two HoNOS assessments in a large group of people evaluated in 10 community mental health services in Lombardy, Italy, in 2000.

METHOD

The HoNOS was administered to 9817 patients; of these, 4759 (48%) were re-assessed. Reliable change (RC) was calculated using Cronbach's alpha (alpha), as a parameter of the reliability of the measure. Clinical significance cut-offs were calculated using a classification of severity based on HoNOS items.

RESULTS

In the whole sample, the clinical improvement cut-off was 11 and the remission cut-off was 5. Considering the severe patients, the clinical improvement cut-off was 12. The RC index calculated on the whole group and on the subgroup of severe patients indicated that eight-point and seven-point changes, respectively, were needed to be confident that a real change had occurred. Longitudinal changes were depicted on two-dimensional graphs as examples of reporting RCSC on HoNOS total scores in a routine data collection: 91.6% of the whole sample (4361) was stable, 5.6% (269) improved and 1.8% (129) worsened.

CONCLUSION

Our study proposes a methodological framework for computing RCSC normative data on a widely used outcome scale and for identifying different degrees of clinical change.

Performance of routine outcome measures in adult mental health care

OBJECTIVE

To examine the performance of two widely used outcome measures in public adult mental health services.

METHOD

As part of a larger study, clinical staff in eight New Zealand District Health Board areas collected consumer outcomes data for a period of 6 months. Among other measures, the Health of the Nation Outcome Scales (HoNOS) and Life Skills Profile (LSP-16) were completed at the start and end of episodes of care, as well as at 90-day reviews.

RESULTS

The performance of these two measures was examined in relation to compliance with the data collection protocol, item completion rates, certain psychometric properties, the relationship between them and the relationship of each instrument to the age, sex, principal psychiatric diagnosis and legal status of the consumer. Compliance with the HoNOS was superior to the LSP-16, but the reverse was true for completion. The two instruments were strongly correlated, but not enough to suggest that one may substitute for the other. A five-subscale structure for the HoNOS was supported. Certain HoNOS subscales were associated with age, but the total score was not, and differences between the sexes were small. Some large diagnostic differences were observed on both instruments. All LSP-16 summary scores and all HoNOS summary scores apart from Depression were higher (worse) in involuntary episodes. Only one LSP-16 item, relating to work potential, was related to age and men generally scored higher (worse) than women.

CONCLUSION

From a technical perspective, the HoNOS and LSP-16 appear suitable for routine collection. New Zealand has adopted the HoNOS for routine use but not the LSP-16 because of local concerns about its appropriateness and acceptability. The clinician-rated measures reported here need to be complemented by both consumer-rated and family/carer measures.

Posttraumatic stress disorder: an exploratory study examining rates of trauma and PTSD and its effect on client outcomes in community mental health

BACKGROUND

Rates of trauma and Posttraumatic Stress Disorder (PTSD) were examined in order to compare the profile in clients of an Australian Public Mental Health Service with that reported in the international literature for clients with major mental illness and to explore the effect of this on client health outcomes. Potential factors contributing to increased levels of trauma/PTSD in this group of clients and the issue of causality between PTSD and subsequent mental illness was also explored.

METHODS

A convenience sample of 29 clients was screened for trauma and PTSD using the Posttraumatic Stress Diagnostic Scale (PDS) and selected outcome measures. Paired and independent samples t-test and ANOVA were applied to the data.

RESULTS

High levels of undocumented trauma and PTSD were found. Twenty clients, (74%) reported exposure to multiple traumatic events; 33.3% (9) met DSM IV diagnostic criteria for PTSD. Significant difference was found for PTSD symptomatology, severity and impairment and for client and clinician-rated scores of Quality of Life (QOL) outcomes in the PTSD group. No effect for PTSD symptomatology on the Working Alliance (WA) was found. Factors that may influence higher rates of PTSD in this group were identified and included issues associated with the population studied, the predominance of assaultive violence found, and vulnerability and risks factors associated with re-traumatisation within the social and treating environments.

CONCLUSION

A similar trauma and PTSD profile to that reported in the international literature, including greater levels of trauma and PTSD and a poorer QOL, was found in this small sample of clients. It is postulated that the increased levels of trauma/PTSD as reported for persons with major mental illness, including those found in the current study, are primarily related to the characteristics of the population that access public mainstream psychiatric services and that these factors have specific implications for service delivery, and raise issues of efficiency and effectiveness of resource use in achieving successful outcomes in public mental health services for clients with co-morbid PTSD. Further research with a more rigorous design is needed to test these preliminary findings within Australian Community Mental Health Services.

Use of a routine outcome measure in a consultation-liaison mental health service

OBJECTIVE

The problem severity of patients seen by a psychiatric consultation- liaison service was studied through the use of a routine outcome measure.

METHODS

Ratings on the Health of the Nation Outcome Scales (HoNOS) over nearly 3 years in the emergency department, general hospital, and on admission to the acute psychiatric unit were compared.

RESULTS

Mean HoNOS total scores in the emergency department were not significantly different from those at admission to the acute psychiatric unit, but were significantly higher than those in the general hospital. Mean scores in all three settings were higher than those obtained at case review of psychiatric patients in the community. Despite differences in age, sex, and psychiatric diagnosis between the three hospital settings, differences in mean HoNOS total scores remained substantially unchanged after adjustment for these factors. Most HoNOS assessments were performed by medical staff.

CONCLUSIONS

The suspected high levels of problem severity and comorbidity of patients seen by a psychiatric consultation-liaison service were confirmed through the use of a routine outcome measure.

Multilevel investigation of variation in HoNOS ratings by mental health professionals: a naturalistic study of consecutive referrals

Episodes of mental healthcare in specialist psychiatric services often begin with the assessment of clinical and psychosocial needs of patients by healthcare professionals. Particularly for patients with complex needs or severe problems, ratings of clinical and social functioning at the start of each episode of care may serve as a baseline against which subsequent measures can be compared. Currently, little is known about service variations in such assessments on referrals from primary care. We set out to quantify variability in initial assessments performed by healthcare professionals in three CMHTs in Bristol (UK) using the Health of the Nation Outcome Scales (HoNOS). We tested the hypothesis that variations in HoNOS total and sub-scale scores are related to referral source (general practices), healthcare assessor (in CMHTs) and the assessor's professional group. Statistical analysis was performed using multilevel variance components models with cross-classified random effects. We found that variation due to assessor substantially exceeded that due to referral source (general practices). Furthermore, patient variance differed by assessor profession for the HoNOS--Impairment scores. Assessor variance differed by assessor profession for the HoNOS--Social scores. As HoNOS total and subscale scores show much larger variation by assessor than by referral source, investigations of HoNOS scores must take assessors into account. Services should implement and evaluate interdisciplinary training to improve consistency in use of rating thresholds; such initiatives could be evaluated using these extensions of multilevel models. Future research should aim to integrate routine diagnostic data with continuous outcomes to address selection effects (of patients to assessors) better.

[HoNOS-Rome: an extended, customized, and longitudinal oriented version of the HoNOS]

AIMS

To clarify the acceptability, reliability and factorial validity of a new Italian version of the HoNOS called HoNOS-Rome. Its main innovations are both in design and in contents.

METHODS

Face validity was assessed by surveying 3 focus groups. Reliability was assessed in 8 different pairs of raters on a sample of 24 patients; construct validity was analysed by factor analysis using a sample of 187 patients at 6 day centres. Acceptability was investigated by means an anonymous questionnaire filled by professionals that were using the instrument.

RESULTS

Time of completion was low (range 4-12 minutes), the tool proved very acceptable and the reliability was good (weighted kappa > or = 0.71 for all items). Factor analysis was consistent with the division of HoNOS-Rome into four sensible factors accounting for 52% of the total variance.

CONCLUSIONS

The findings indicate that HoNOS-Rome has a satisfactory degree of acceptability, construct validity and reliability, and may promote the routine evaluation of outcomes in mental health services.

Outcome measurement in rural mental health care: a field trial of rooming-in models

The main objectives of this project, in rural Western Australia, were to collect information, compare and evaluate the functioning of novel types of psychiatric services, including rooming-in facilities, using outcome measurement tools, and to assess the attitude of mental health professionals towards routine outcome measurement. For the first time in rural health services, two outcome measurement tools were used for this purpose: the Health of the Nation Outcome Scales and the World Health Organization Short Disability Assessment Schedule. While staff at 11 rural sites were trained in the use of outcome measurements, only staff from three sites were able to participate in the data collection that spanned for a year and shed information on 39 patients. Two of these sites were rooming-in facilities with different models of care and patient characteristics. Shortage of staff, lack of adequate local information technology support on sites and technical difficulties limited participation. The assessment of staff attitudes towards routine outcome measurement revealed a need to provide staff with reasons and incentives for incorporating outcome measurement into routine practice, in addition to provision of a thorough and on-going training and support in time and resources from management.