Routine administration of Health Related Quality of Life (HRQoL) and needs assessment instruments to improve psychological outcome--a systematic review

Lifestyle habits, health indicators and sociodemographic factors associated with health-related quality of life and self-esteem in adolescents

BACKGROUND

Mental health is defined as a state of emotional, psychological, and social well-being, and has been shown to be positively associated with self-esteem and quality of life. It is important to note that mental health is dynamic and influenced by a wide range of social, biological, and behavioral factors. Therefore, the aim this study was to describe the health-related quality of life and self-esteem in adolescents, examining their relationship with various health indicators, lifestyle habits, and sociodemographic variables.

METHOD

A cross-sectional study was conducted with a representative sample of 761 students (14.51 ± 1.63 years). Health-related quality of life, self-esteem, satisfaction with body image, adherence to the Mediterranean diet, physical activity practice, hours of nightly sleep, maximum oxygen consumption, body mass index, academic performance, and various sociodemographic factors of all participants were analyzed.

RESULTS

Regression analysis showed that body satisfaction and academic performance were associated of both health-related quality of life and self-esteem. Additionally, physical activity, age, and favourable settings for physical activity engagement were also found to be related to health-related quality of life, whilst adherence to the Mediterranean diet, hours of nightly sleep, maximum oxygen consumption and socioeconomic status were associated with self-esteem.

CONCLUSIONS

Given the associations found between health-related quality of life and self-esteem with lifestyle habits and sociodemographic indicators, there is an urgent need to develop interdisciplinary and cross-cutting promotion strategies to improve the mental health of adolescents.

Psychometric properties of a patient-reported outcome set in acute stroke patients

OBJECTIVES

Impairments after stroke may affect multiple domains of health-related quality of life (HRQoL). Patient-reported outcome measures (PROMs) have proven valuable in measuring patients' well-being. We examine the psychometric properties of a standard set of PROMs assessing global health, anxiety, and depression, and functioning in a German health care setting.

METHOD

We included inpatients at the Department of Neurology at the University Medical Center Hamburg-Eppendorf, diagnosed with stroke. Following the stroke-specific standard set of the International Consortium for Health Outcome Measurement, we collected demographic and clinical information at baseline, and PROMs for global health (PROMIS-10), three items for self-reported functioning, anxiety, and depression (PHQ-4) at 90 days follow-up. We calculated confirmatory factor analyses to test factorial validity and correlation analyses to test construct validity. We further conducted item and reliability analyses.

RESULTS

In a sample of 487 patients (mean age, SD: 71.1, 12.6; 47% female) with mild and moderate symptoms, model fit for the PROMIS-10 was acceptable for the two-factor and single-factor models. Factor loadings ranged from 0.52 to 0.94. The postulated single-factor model for functioning was saturated with zero degrees of freedom. Factor loadings ranged from 0.90 to 0.96. For the PHQ-4, the two-factor model showed excellent model fit. Factor loadings ranged from 0.78 to 0.87. Internal consistency was acceptable to good. Construct validity was generally confirmed.

CONCLUSIONS

The PROMIS-10 is a valid and reliable instrument to measure HRQoL among German stroke patients. While the PHQ-4 was confirmed as a screening measure for mental disorders, further research is needed on items assessing self-reported functioning. Results are limited to patients showing minimal functional deficits.

Sexual Orientation Identity and Its Implication in the Disparities in Psychological Health-Related Quality of Life

PURPOSE

To examine disparities in psychological health-related quality of life (HRQoL) among sexual minority women within racial/ethnic subgroups.

DESIGN

A secondary analysis of the 2018 Behavioral Risk Factor Surveillance Survey (BRFSS).

SETTING

United States.

SUBJECTS

Noninstitutionalized, cisgender, adult women in the U.S (unweighted n = 81,947).

MEASURES

Socioeconomics, health behaviors, and healthcare access as risk factors, whereas 1 item measures psychological HRQoL as an outcome.

ANALYSIS

Weighted multivariable logistic regressions to estimate the odds of having adversely psychological HRQoL in relation to sexual orientation and other correlates within a racial/ethnic subgroup independently.

RESULTS

The prevalence of adverse psychological HRQoL was greater in bisexual and "other" sexual orientation women. Both bisexual (adjusted odds ratio [aOR] = 1.58; 95% confidence interval [CI] = 1.26-2.00) and "other" sexual orientation (Aor = 1.93; 95%CI = 1.26-2.96) had greater adjusted odds of adversely psychological HRQoLcompared to their heterosexual peers in non-Hispanic White women. Bisexual women (aOR = 3.42; 95%CI = 1.98-5.88) had greater adjusted odds of adversely psychological HRQoLcompared to their heterosexual peers in Latinas. No similar pattern was observed in non-Hispanic Black women.

CONCLUSION

Disparities in psychological HRQoL varied by sexual orientation identities within different racial/ethnic subgroups. The magnitude of the association for Latina bisexual women was strong. Implications for bisexual health among people with intersecting identities are discussed.

A cluster randomized controlled trial for the Evaluation of routinely Measured PATient reported outcomes in HemodialYsis care (EMPATHY): a study protocol

Background

Kidney failure requiring dialysis is associated with poor health outcomes and health-related quality of life (HRQL). Patient-reported outcome measures (PROMs) capture symptom burden, level of functioning and other outcomes from a patient perspective, and can support clinicians to monitor disease progression, address symptoms, and facilitate patient-centered care. While evidence suggests the use of PROMs in clinical practice can lead to improved patient experience in some settings, the impact on patients’ health outcomes and experiences is not fully understood, and their cost-effectiveness in clinical settings is unknown. This study aims to fill these gaps by evaluating the effectiveness and cost-effectiveness of routinely measuring PROMs on patient-reported experience, clinical outcomes, HRQL, and healthcare utilization.

Methods

The EMPATHY trial is a pragmatic multi-centre cluster randomized controlled trial that will implement and evaluate the use of disease-specific and generic PROMs in three kidney care programs in Canada. In-centre hemodialysis units will be randomized into four groups, whereby patients: 1) complete a disease-specific PROM; 2) complete a generic PROM; 3) complete both types of PROMs; 4) receive usual care and do not complete any PROMs. While clinical care pathways are available to all hemodialysis units in the study, for the three active intervention groups, the results of the PROMs will be linked to treatment aids for clinicians and patients. The primary outcome of this study is patient-provider communication, assessed by the Communication Assessment Tool (CAT). Secondary outcomes include patient management and symptoms, use of healthcare services, and the costs of implementing this intervention will also be estimated. The present protocol fulfilled the Standard Protocol Items: Recommendations for Intervention Trials (SPIRIT) checklist.

Discussion

While using PROMs in clinical practice is supported by theory and rationale, and may engage patients and enhance their role in decisions regarding their care and outcomes, the best approach of their use is still uncertain. It is important to rigorously evaluate such interventions and investments to ensure they provide value for patients and health systems.

Trial registration

Protocol version (1.0) and trial registration data are available on www.clinicaltrials.gov, identifier: NCT03535922, registered May 24, 2018.

Effectiveness of a Self-Monitoring Quality of Life Intervention For Patients with Cancer Receiving Palliative Care: A Randomized Controlled Clinical Trial

Background: Use of patient-reported outcome measures in routine clinical practice has important benefits for patients with cancer. To examine the effect of a self-monitoring quality of life (QOL) intervention on global QOL and physical and emotional function in patients with cancer receiving palliative care. Methods: Prospective randomized study had been undertaken at Toshima Hospital, Japan. This study compared an intervention group that completed the shortened Care Notebook booklet versus a control group that received usual care. The primary outcome was global QOL and secondary outcomes were physical and emotional function. Participants completed the European Organization for Research and Treatment of Cancer Quality of Life Questionnaire Core 15 Palliative at baseline, and at 1 and 3 weeks. The effects of the intervention were evaluated with a linear mixed-effects model. Results: Forty-three patients were randomized. One patient in each group could not receive the allocated intervention, leaving 41 patients for inclusion in the modified intention-to-treat (ITT) analysis for the primary outcome. Twenty-seven patients were analyzed for the secondary outcomes using per protocol set (PPS). The ITT analysis showed no significant overall effect on global QOL (P=0.285), but the PPS analysis showed a significant overall effect on global QOL (P=0.034) and physical function (P=0.047) for group difference over time in the linear mixed-effects model. Conclusions: Use of the Care Notebook might have beneficial effects. The results could be interpreted as the effectiveness of the intervention of the Care Notebook for with cancer receiving palliative care.

Chiropractors' views on the use of patient-reported outcome measures in clinical practice: a qualitative study

Background

Patient-reported outcome measures (PROMs) are widely available for use in musculoskeletal care. However, there is little research exploring the implementation of PROMs in clinical practice. This qualitative study explored chiropractors' views on PROMs to identify any barriers and facilitators to implementing PROMs in chiropractic care and the training needs of chiropractors regarding the use of PROMs.

Methods

A qualitative study of chiropractors' views on PROMs was undertaken as part of a larger project to address the feasibility of conducting a randomised controlled trial of PROM use in chiropractic clinics for patients with low back pain. Contact was made with chiropractors working in chiropractic companies with multiple clinic sites. Semi-structured interviews were conducted with eight chiropractors, either face-to-face at their place of work or over the telephone. The interviews were transcribed verbatim and analysed using thematic analysis. The data were coded inductively by two authors.

Results

Chiropractors discussed their knowledge and engagement with PROMs in clinical practice, identifying reasons for their use, such as understanding clinic performance, clinical practice, and research. They also discussed how they used PROMs within their clinical practice and the benefits of using them with individual patients, for example during the consultation, identifying yellow flags, and tracking patient progress. Chiropractors voiced concerns about patient engagement with PROMs, questioning if patients find them burdensome, and the appropriate PROMs to use with patients with pain. Finally, chiropractors acknowledged the organisational barriers and facilitators to using PROMs within their practice, such as busy practices, electronic systems, and use of reception staff.

Conclusions

Using participating chiropractors' views of PROMs, the study identified barriers and facilitators to implementing PROMs in chiropractic care, such as clinician knowledge, engagement, and organisational concerns and identified the potential training needs of chiropractors regarding PROMs. The results from the study suggested chiropractors use PROMs with their individual patients, but PROMs should be meaningful to patients and chiropractors to improve engagement.

Effects of a Self-Monitoring Quality of Life Intervention for Patients with Cancer Receiving Palliative Care in Japan: Study Protocol for a Randomized Controlled Trial

Background:

Previous studies suggest the use of patient-reported outcome measures in routine clinical practice has important benefits for patients with cancer, particularly as feedback regarding patients’ quality of life (QOL) improves doctor-patient communication and clinical decision making. This study aimed to examine the effect of using the Care Notebook as a routine self-monitoring QOL intervention in clinical practice for patients with cancer receiving palliative care. The results are expected to clarify the practical use of the Care Notebook in this population.

Methods:

This prospective randomized study is being undertaken at Toshima Hospital, Japan. Participating patients who are randomly assigned to the intervention group will be asked to complete the shortened Care Notebook booklet for patients with cancer in palliative care once each day. A control group will receive usual care. The primary outcome is global health status/QOL (Global QOL), as assessed by the European Organization for Research and Treatment of Cancer Quality of Life Questionnaire Core 15 Palliative. Data will be collected at baseline (after allocation), and at 1 week and 3 weeks in both the control and intervention groups. The effects of the intervention will be evaluated with a mixed random effects model. The required sample size is 200 patients. We obtained approval from Toshima Hospital (No 26-11) and the Tokyo Medical and Dental University Ethics Committee (No 1756). The findings will be disseminated through publications in peer-reviewed journals and attendance at domestic and international conferences. The trial was registered with the UMIN clinical trials registry (Trial registration number: UMIN000025322).

Conclusions:

This study will provide evidence on whether medical staff can use the Care Notebook as a routine self-monitoring QOL intervention in clinical practice for patients with cancer receiving palliative care. We expect that a routine Care Notebook intervention for patients with cancer will be recommended in healthcare facilities.

A systematic review of randomised controlled trials evaluating the use of patient-reported outcome measures (PROMs)

BACKGROUND

Patient-reported outcome measures (PROMs) could play an important role in identifying patients' needs and goals in clinical encounters, improving communication and decision-making with clinicians, while making care more patient-centred. Comprehensive evidence that PROMS are an effective intervention is lacking in single randomised controlled trials (RCTs).

METHODS

A systematic search was performed using controlled vocabulary related to the terms: clinical care setting and patient-reported outcome. English language studies were included if they were a RCT with a PROM as an intervention in a patient population. Included studies were analysed and their methodologic quality was appraised using the Cochrane Risk of Bias tool. The protocol was registered with PROSPERO (CRD42016034182).

RESULTS

Of 4302 articles initially identified, 115 underwent full-text review resulting in 22 studies reporting on 25 comparisons. The majority of included studies were conducted in USA (11), among cancer patients (11), with adult participants only (20). Statistically significant and robust improvements were reported in the pre-specified outcomes of the process of care (2) and health care (3). Additionally, five, eight and three statistically significant but possibly non-robust findings were reported in the process of care, health and patient satisfaction outcomes, respectively.

CONCLUSIONS

Overall, studies that compared PROM to standard care either reported a positive effect or were not powered to find pre-specified differences. There is justification for the use of a PROM as part of standard care, but further adequately powered studies on their use in different contexts are necessary for a more comprehensive evidence base.

Patient-reported outcome measurements in clinical routine of trauma, spine and craniomaxillofacial surgeons: between expectations and reality: a survey among 1212 surgeons

OBJECTIVE

To gain information about the advantages/disadvantages of an implementation of patient-reported outcome measures (PROM) into the clinical routine of trauma/orthopaedic surgeons, and to identify the technical constraints confronting a successful implementation of PROMs.

DESIGN

Online survey.

PARTICIPANTS

Surgeons who are members of the AO Foundation.

MEASURES

Participants answered questions regarding demographics, their familiarity with specific and generic PROMs and the use of PROMs in clinical routine. Furthermore, reasons for/against using PROMs, why not used more often, prerequisites to implement PROMs into clinical routine and whether PROMs would be implemented if adequate tools/technologies were available, were solicited. Χ² tests and multivariable logistic regressions were conducted to evaluate the effect of the AO Region, surgeon specialisation, current position, clinical experience, and workplace on the familiarity with disease-specific PROMs, the familiarity with generic PROMs and the current use of PROMs. Exploratory factor analysis was used to identify issues underlying the extent of PROM usage.

RESULTS

1212 surgeons completed the survey (response rate: 6.8%; margin of error: ±2.72%): 54.2% were trauma/orthopaedic surgeons, 16.6% were spine surgeons, 27.9% were craniomaxillofacial surgeons and 16 had no defined specialty. Working in a certain AO Region, surgical specialisation and current workplace were associated with a higher familiarity of disease-specific PROMs and the use of PROMs in daily clinical routine (p≤0.05). Exploratory factor analysis identified four categories important for the use of PROMs and two categories preventing the use of PROMs. In case of the availability of an adequate tool, 66.2% of surgeons would implement PROMs in clinical routine.

CONCLUSIONS

Our survey results provide an understanding of the use of PROMs in clinical routine. There is consensus on the usefulness of PROMs. User-friendly and efficient tools/technologies would be a prerequisite for the daily use of PROMs. Additionally, educational efforts and/or policies might help.

Provider-Associated Measurement Error in Routine Outcome Monitoring in Community Mental Health

Despite the strengths of routine outcome monitoring (ROM) in community mental health settings, there are a number of barriers to effective implementation of ROM, including measurement error due to provider factors (e.g., training level) and non-target client factors (i.e., client characteristics which have no meaningful relationship to the outcome of interest). In this study, ROM data from 80 client-provider dyads were examined for sources of variance due to provider factors and non-target client factors. Results indicated that provider factors and non-target client factors accounted for between 9.6 and 54% of the variance in the ROM measures. Our findings supported past research that provider characteristics impact ROM, and added the novel finding that client gender, age, diagnosis, and cognition also impact ROM. Methods to increase accuracy and utility of ROM in community mental health are discussed.

Implementation of an electronic routine outcome monitoring at an inpatient unit for psychosomatic medicine

BACKGROUND

Patient-reported outcomes (PROs) can be part of an electronic routine outcome monitoring (eROM). eROM can improve patient involvement, treatment outcomes and simplify scientific data assessment. Available studies on eROM focus on its evaluation only and lack a detailed description of the prior implementation procedure.

OBJECTIVE

The aim was to implement an eROM assessment at a division of Psychosomatic Medicine and provide a detailed description of the implementation procedure.

METHODS

According to the Replicating Effective Program concept the project consisted of 4 phases: pre-condition (1), pre-implementation (2), implementation (3) and maintenance and evolution (4) mainly focusing the description of the implementation procedure and a short evaluation.

RESULTS

We describe the actions taken during the implementation procedure and steps which were taken to overcome identified barriers. All decisions were carried out based on the Participatory Action Research process. A core set consisting of sociodemographic and clinical data and a comprehensive questionnaire battery covering symptoms, functioning parameters and psychological constructs was implemented. In total 164 patients, took part in the eROM assessment from June 2015 to December 2016. The evaluation showed that eROM was appreciated by health-care professionals (85.2%) and patients (70.2%) alike. The majority of patients (89.4%) and health-care professionals (85.7%) experienced no delays in daily clinical routine due to eROM.

CONCLUSION

The detailed description of the implementation process can guide institutions planning to implement eROM into their daily clinical routine. Focusing scientific efforts on the implementation process is essential since this influences all further steps such as evaluation and acceptance.

Uptake of mandatory outcome measures in mental health services

Aims and method

The collection of results of a specific outcome measure, the Health of the Nation Outcome Scales (HoNOS), is mandatory for mental healthcare providers in the National Health Service in England. Not all providers collect HoNOS data and coverage varies widely. This paper explores, by means of interviews with clinicians and policy makers and econometric analysis of HoNOS data, the barriers and incentives to the uptake of HoNOS and outcomes more generally, and the key characteristics associated with providers who do undertake HoNOS.

Results

The main barriers to the collection of outcomes involve a lack of adequate feedback mechanisms, a lack of perceived clinical relevance and poor information technology infrastructure. Econometric results show HoNOS collection is associated with providers who produce high-quality data.

Clinical implications

Initiatives should focus on putting systems in place to encourage feedback mechanisms for clinicians.

A qualitative exploration of attitudes towards the use of outcome measures in child and adolescent mental health services

The aim of the present research was to explore clinician attitudes to outcome measures and, in particular, the facilitators and barriers to implementing outcome measures. An up-to-date exploration of clinician attitudes is especially needed in the context of recent policies on the implementation of outcome measures in child and adolescent mental health services (CAMHS), and because evidence suggests that there is a disparity between policy recommendations and the use of outcome measures in clinical practice. Semi-structured interviews were conducted with nine CAMHS clinicians from a Mental Health Trust in South London. Two levels of implementation emerged from the analysis: (1) the service level, regarding the implementation of outcome measures across a service to inform service improvement and (2) the session level, regarding the implementation of outcome measures within individual clinical sessions. The present research described training and ongoing support as a crucial facilitator of use at both service and session levels. This included help overcoming local contextual barriers, such as resources, information systems and administrative processes. The research showed that a balance is needed between a mandatory and uniform approach across a service and providing clinicians with support to use outcome measures with all service users for whom they are appropriate.

Functionality and feedback: a realist synthesis of the collation, interpretation and utilisation of patient-reported outcome measures data to improve patient care

Background

The feedback of patient-reported outcome measures (PROMs) data is intended to support the care of individual patients and to act as a quality improvement (QI) strategy.

Objectives

To (1) identify the ideas and assumptions underlying how individual and aggregated PROMs data are intended to improve patient care, and (2) review the evidence to examine the circumstances in which and processes through which PROMs feedback improves patient care.

Design

Two separate but related realist syntheses: (1) feedback of aggregate PROMs and performance data to improve patient care, and (2) feedback of individual PROMs data to improve patient care.

Interventions

Aggregate – feedback and public reporting of PROMs, patient experience data and performance data to hospital providers and primary care organisations. Individual – feedback of PROMs in oncology, palliative care and the care of people with mental health problems in primary and secondary care settings.

Main outcome measures

Aggregate – providers’ responses, attitudes and experiences of using PROMs and performance data to improve patient care. Individual – providers’ and patients’ experiences of using PROMs data to raise issues with clinicians, change clinicians’ communication practices, change patient management and improve patient well-being.

Data sources

Searches of electronic databases and forwards and backwards citation tracking.

Review methods

Realist synthesis to identify, test and refine programme theories about when, how and why PROMs feedback leads to improvements in patient care.

Results

Providers were more likely to take steps to improve patient care in response to the feedback and public reporting of aggregate PROMs and performance data if they perceived that these data were credible, were aimed at improving patient care, and were timely and provided a clear indication of the source of the problem. However, implementing substantial and sustainable improvement to patient care required system-wide approaches. In the care of individual patients, PROMs function more as a tool to support patients in raising issues with clinicians than they do in substantially changing clinicians’ communication practices with patients. Patients valued both standardised and individualised PROMs as a tool to raise issues, but thought is required as to which patients may benefit and which may not. In settings such as palliative care and psychotherapy, clinicians viewed individualised PROMs as useful to build rapport and support the therapeutic process. PROMs feedback did not substantially shift clinicians’ communication practices or focus discussion on psychosocial issues; this required a shift in clinicians’ perceptions of their remit.

Strengths and limitations

There was a paucity of research examining the feedback of aggregate PROMs data to providers, and we drew on evidence from interventions with similar programme theories (other forms of performance data) to test our theories.

Conclusions

PROMs data act as ‘tin openers’ rather than ‘dials’. Providers need more support and guidance on how to collect their own internal data, how to rule out alternative explanations for their outlier status and how to explore the possible causes of their outlier status. There is also tension between PROMs as a QI strategy versus their use in the care of individual patients; PROMs that clinicians find useful in assessing patients, such as individualised measures, are not useful as indicators of service quality.

Future work

Future research should (1) explore how differently performing providers have responded to aggregate PROMs feedback, and how organisations have collected PROMs data both for individual patient care and to improve service quality; and (2) explore whether or not and how incorporating PROMs into patients’ electronic records allows multiple different clinicians to receive PROMs feedback, discuss it with patients and act on the data to improve patient care.

Study registration

This study is registered as PROSPERO CRD42013005938.

Funding

The National Institute for Health Research Health Services and Delivery Research programme.

Routine use of patient reported outcome measures (PROMs) for improving treatment of common mental health disorders in adults

BACKGROUND

Routine outcome monitoring of common mental health disorders (CMHDs), using patient reported outcome measures (PROMs), has been promoted across primary care, psychological therapy and multidisciplinary mental health care settings, but is likely to be costly, given the high prevalence of CMHDs. There has been no systematic review of the use of PROMs in routine outcome monitoring of CMHDs across these three settings.

OBJECTIVES

To assess the effects of routine measurement and feedback of the results of PROMs during the management of CMHDs in 1) improving the outcome of CMHDs; and 2) in changing the management of CMHDs.

SEARCH METHODS

We searched the Cochrane Depression Anxiety and Neurosis group specialised controlled trials register (CCDANCTR-Studies and CCDANCTR-References), the Oxford University PROMS Bibliography (2002-5), Ovid PsycINFO, Web of Science, The Cochrane Library, and International trial registries, initially to 30 May 2014, and updated to 18 May 2015.

SELECTION CRITERIA

We selected cluster and individually randomised controlled trials (RCTs) including participants with CMHDs aged 18 years and over, in which the results of PROMs were fed back to treating clinicians, or both clinicians and patients. We excluded RCTs in child and adolescent treatment settings, and those in which more than 10% of participants had diagnoses of eating disorders, psychoses, substance use disorders, learning disorders or dementia.

DATA COLLECTION AND ANALYSIS

At least two authors independently identified eligible trials, assessed trial quality, and extracted data. We conducted meta-analysis across studies, pooling outcome measures which were sufficiently similar to each other to justify pooling.

MAIN RESULTS

We included 17 studies involving 8787 participants: nine in multidisciplinary mental health care, six in psychological therapy settings, and two in primary care. Pooling of outcome data to provide a summary estimate of effect across studies was possible only for those studies using the compound Outcome Questionnaire (OQ-45) or Outcome Rating System (ORS) PROMs, which were all conducted in multidisciplinary mental health care or psychological therapy settings, because both primary care studies identified used single symptom outcome measures, which were not directly comparable to the OQ-45 or ORS.Meta-analysis of 12 studies including 3696 participants using these PROMs found no evidence of a difference in outcome in terms of symptoms, between feedback and no-feedback groups (standardised mean difference (SMD) -0.07, 95% confidence interval (CI) -0.16 to 0.01; P value = 0.10). The evidence for this comparison was graded as low quality however, as all included studies were considered at high risk of bias, in most cases due to inadequate blinding of assessors and significant attrition at follow-up.Quality of life was reported in only two studies, social functioning in one, and costs in none. Information on adverse events (thoughts of self-harm or suicide) was collected in one study, but differences between arms were not reported.It was not possible to pool data on changes in drug treatment or referrals as only two studies reported these. Meta-analysis of seven studies including 2608 participants found no evidence of a difference in management of CMHDs between feedback and no-feedback groups, in terms of the number of treatment sessions received (mean difference (MD) -0.02 sessions, 95% CI -0.42 to 0.39; P value = 0.93). However, the evidence for this comparison was also graded as low quality.

AUTHORS' CONCLUSIONS

We found insufficient evidence to support the use of routine outcome monitoring using PROMs in the treatment of CMHDs, in terms of improving patient outcomes or in improving management. The findings are subject to considerable uncertainty however, due to the high risk of bias in the large majority of trials meeting the inclusion criteria, which means further research is very likely to have an important impact on the estimate of effect and is likely to change the estimate. More research of better quality is therefore required, particularly in primary care where most CMHDs are treated.Future research should address issues of blinding of assessors and attrition, and measure a range of relevant symptom outcomes, as well as possible harmful effects of monitoring, health-related quality of life, social functioning, and costs. Studies should include people treated with drugs as well as psychological therapies, and should follow them up for longer than six months.

Validation of clinical symptom IRT scores for diagnosis and severity assessment of common mental disorders

PURPOSE

We studied the validity and responsiveness of an item response theory (IRT) scoring method for assessing major depressive episode (MDE) and generalized anxiety disorder (GAD) severity based on direct assessment of DSM-IV-TR symptoms.

METHODS

Prospective cohort study (baseline, 1-month, 3-months assessments) of patients seeking help for incident or aggravated mood or anxiety symptoms from primary, outpatient and inpatient mental health centers (N = 244; 67.81 % active cases - 100 % under psychiatric treatment). The drop-out rate at 3 months was 24.89 %. Patients were assessed at each follow-up for presence/absence of DSM-IV symptoms of MDE (nine symptoms) and GAD (eight symptoms). IRT scores for depression (INS-D) and anxiety (INS-G), based on response patterns, were obtained by means of a 2-parameter model. Diagnostic accuracy was assessed with receiver operating characteristic analysis, using a blinded MINI interview as gold standard. Scores' construct validity was compared with external clinician-administered (Hamilton Depression Rating Scale, HRSD; Hamilton Anxiety Rating Scale, HAM-A) and self-reported severity measures (PHQ-9; Beck Anxiety Inventory-Subjective Aspects, BAI-Sub). Responsiveness was analyzed based on the evolution of HRSD and HAM-A scores.

RESULTS

Both severity scores showed excellent reliability (INS-D: 0.92; INS-G: 0.93) and yielded high diagnostic accuracy (INS-D: AUC = 0.96; INS-G: AUC = 0.91) with respect to MINI diagnoses. INS-D and INS-G had higher correlations with clinician-administered measures of the same disorder (INS-D-HRSD: 0.73; INS-G-HAM-A: 0.53) than with self-reported measures (INS-D-PHQ-9: 0.69; INS-G-BAI-Sub: 0.49). Patients who recovered during follow-up showed important decreases in severity (Cohen's d INS-D:-1.38; INS-G: -1.75). About 90 % variance of INS-D and INS-G score changes over time was associated with changes in clinical status.

CONCLUSIONS

INS-D and INS-G are short reliable, valid, and responsive measures that can be used for diagnostic and severity assessment of mood and anxiety disorders in outpatient care.

Surgeon's experiences of receiving peer benchmarked feedback using patient-reported outcome measures: a qualitative study

Background

The use of patient-reported outcome measures (PROMs) to provide healthcare professionals with peer benchmarked feedback is growing. However, there is little evidence on the opinions of professionals on the value of this information in practice. The purpose of this research is to explore surgeon’s experiences of receiving peer benchmarked PROMs feedback and to examine whether this information led to changes in their practice.

Methods

This qualitative research employed a Framework approach. Semi-structured interviews were undertaken with surgeons who received peer benchmarked PROMs feedback. The participants included eleven consultant orthopaedic surgeons in the Republic of Ireland.

Results

Five themes were identified: conceptual, methodological, practical, attitudinal, and impact. A typology was developed based on the attitudinal and impact themes from which three distinct groups emerged. ‘Advocates’ had positive attitudes towards PROMs and confirmed that the information promoted a self-reflective process. ‘Converts’ were uncertain about the value of PROMs, which reduced their inclination to use the data. ‘Sceptics’ had negative attitudes towards PROMs and claimed that the information had no impact on their behaviour. The conceptual, methodological and practical factors were linked to the typology.

Conclusion

Surgeons had mixed opinions on the value of peer benchmarked PROMs data. Many appreciated the feedback as it reassured them that their practice was similar to their peers. However, PROMs information alone was considered insufficient to help identify opportunities for quality improvements. The reasons for the observed reluctance of participants to embrace PROMs can be categorised into conceptual, methodological, and practical factors. Policy makers and researchers need to increase professionals’ awareness of the numerous purposes and benefits of using PROMs, challenge the current methods to measure performance using PROMs, and reduce the burden of data collection and information dissemination on routine practice.

What is the value of the routine use of patient-reported outcome measures toward improvement of patient outcomes, processes of care, and health service outcomes in cancer care? A systematic review of controlled trials

PURPOSE

The systematic use of patient-reported outcome measures (PROMs) has been advocated as an effective way to standardize cancer practice. Yet, the question of whether PROMs can lead to actual improvements in the quality of patient care remains under debate. This review examined whether inclusion of PROM in routine clinical practice is associated with improvements in patient outcomes, processes of care, and health service outcomes during active anticancer treatment.

METHODS

A systematic review of five electronic databases (Medline, EMBASE, CINAHL [Cumulative Index to Nursing and Allied Health Literature], PsycINFO, and Psychology and Behavioral Sciences Collection [PBSC]) was conducted from database inception to May 2012 to locate randomized and nonrandomized controlled trials of patients receiving active anticancer treatment or supportive care irrespective of type of cancer.

RESULTS

Based on prespecified eligibility criteria, we included 26 articles that reported on 24 unique controlled trials. Wide variability in the design and use of interventions delivered, outcomes evaluated, and cancer- and modality-specific context was apparent. Health service outcomes were only scarcely included as end points. Overall, the number of statistically significant findings were limited and PROMs' intervention effect sizes were predominantly small-to-moderate.

CONCLUSION

The routine use of PROMs increases the frequency of discussion of patient outcomes during consultations. In some studies, PROMs are associated with improved symptom control, increased supportive care measures, and patient satisfaction. Additional effort is required to ensure patient adherence, as well as additional support to clinicians who will respond to patient concerns and issues, with clear system guidelines in place to guide their responses. More research is required to support PROM cost-benefit in terms of patient safety, clinician burden, and health services usage.

Implementing an aim-based outcome measure in a psychoanalytic child psychotherapy service: insights, experiences and evidence

In this paper, we describe the use of an aim-based outcome measure used in routine outcome monitoring of child and adolescent psychotherapy within a child and adolescent mental health service. We aim to explore the clinical feasibility and implications of the routine use of this measure. We argue that use of the measure provides a simple and useful way of clarifying the focus of the clinical work and reflecting its progress, while also having the potential to illuminate the clinical picture by contributing an additional source of clinical information from a collaborative process with the patient, parents or both. We argue that while there are some cases where use of the measure may be impossible, or even perverse, in general it enhances rather than detracts from clinical work.

Improving the care of children with advanced cancer by using an electronic patient-reported feedback intervention: results from the PediQUEST randomized controlled trial

PURPOSE

This study aimed to determine whether feeding back patient-reported outcomes (PROs) to providers and families of children with advanced cancer improves symptom distress and health-related quality of life (HRQoL).

PATIENTS AND METHODS

This study was a parallel, multicentered pilot randomized controlled trial. At most once per week, children age ≥ 2 years old with advanced cancer or their parent completed the computer-based Pediatric Quality of Life and Evaluation of Symptoms Technology (PediQUEST) survey consisting of age- and respondent-adapted versions of the Memorial Symptom Assessment Scale (MSAS), Pediatric Quality of Life Inventory 4.0 Generic Core Scales (PedsQL4.0), and an overall Sickness question. In the intervention group (n = 51), oncologists and families received printed reports summarizing PROs; e-mails were sent to oncologists and subspecialists when predetermined scores were exceeded. No feedback was provided in the control group (n = 53). Primary outcomes included linear trends of MSAS, PedsQL4.0 total and subscale scores, and Sickness scores during 20 weeks of follow-up, along with child, parent, and provider satisfaction with PediQUEST feedback.

RESULTS

Feedback did not significantly affect average MSAS, PedsQL4.0, or Sickness score trends. Post hoc subgroup analyses among children age ≥ 8 years who survived 20 weeks showed that feedback improved PedsQL4.0 emotional (+8.1; 95% CI, 1.8 to 14.4) and Sickness (-8.2; 95% CI, -14.2 to -2.2) scores. PediQUEST reports were valued by children, parents, and providers and contributed at least sometimes to physician initiation of a psychosocial consult (56%).

CONCLUSION

Although routine feedback of PROs did not significantly affect the child's symptoms or HRQoL, changes were in expected directions and improvements observed in emotional HRQoL through exploratory analyses were encouraging. Importantly, children, parents, and providers value PRO feedback.

Evaluating the impact of a quality of life assessment with feedback to clinicians in patients with schizophrenia: randomised controlled trial

BACKGROUND

Quality of life (QoL) measurements are increasingly considered to be an important evaluation of the treatment and care provided to patients with schizophrenia. However, there is little evidence that assessing QoL improves patient outcomes in clinical practice.

AIMS

To investigate the impact of a QoL assessment with feedback for clinicians regarding satisfaction and other health outcomes in patients with schizophrenia.

METHOD

We conducted a 6-month, prospective, randomised and controlled open-label study. Patients with schizophrenia were assigned to one of three groups: standard psychiatric assessment; QoL assessment with standard psychiatric assessment; and QoL feedback with standard psychiatric assessment. The primary outcome was patient satisfaction at 6 months. The local ethics committee (Comité de Protection des Personnes Sud-Méditerranéee V, France, trial number 07 067) and the French drug and device regulation agency (Agence Française de Sécurité Sanitaire des Produits de Santé, France, trial number A01033-50) approved this study.

RESULTS

We randomly assigned 124 patients into groups. Quality of life feedback significantly affected patient satisfaction. Global satisfaction was significantly higher in the QoL feedback group (72.5% of patients had a high level of satisfaction) compared with the standard psychiatric assessment (67.5%) and QoL assessment groups (45.2%). Despite trends towards decreased severity for all clinical outcomes and increased changes to medication in the QoL feedback group at 6-month follow-up, these effects were not significant.

CONCLUSIONS

Quality of life feedback positively influences patient satisfaction, which confirms the relevance of measuring QoL in clinical practice. The absence of a significant effect of QoL feedback on clinical outcomes also suggests that clinicians did not use these data optimally. Our findings suggest a nocebo effect of QoL assessment without feedback that should be considered by researchers and clinicians.

Quality of life of people with mental health problems: a synthesis of qualitative research

PURPOSE

To identify the domains of quality of life important to people with mental health problems.

METHOD

A systematic review of qualitative research undertaken with people with mental health problems using a framework synthesis.

RESULTS

We identified six domains: well-being and ill-being; control, autonomy and choice; self-perception; belonging; activity; and hope and hopelessness. Firstly, symptoms or 'ill-being' were an intrinsic aspect of quality of life for people with severe mental health problems. Additionally, a good quality of life was characterised by the feeling of being in control (particularly of distressing symptoms), autonomy and choice; a positive self-image; a sense of belonging; engagement in meaningful and enjoyable activities; and feelings of hope and optimism. Conversely, a poor quality life, often experienced by those with severe mental health difficulties, was characterized by feelings of distress; lack of control, choice and autonomy; low self-esteem and confidence; a sense of not being part of society; diminished activity; and a sense of hopelessness and demoralization.

CONCLUSIONS

Generic measures fail to address the complexity of quality of life measurement and the broad range of domains important to people with mental health problems.

The clinical utility of health-related quality of life assessment in pediatric cardiology outpatient practice

OBJECTIVES

Children with congenital heart disease may experience significant psychosocial morbidity related to impaired quality of life (QOL). The aim of this study was to evaluate the clinical utility of health-related QOL assessment in a pediatric cardiology outpatient clinic.

DESIGN

The Pediatric Quality of Life Inventory (PedsQL) 4.0 Generic Core Scales were completed by a convenience sample of 176 patients, aged 8-18 years, being seen in a pediatric cardiology clinic. Three cardiologists enrolled in this study reviewed the completed PedsQL during the clinic visit and recorded their responses to items reported to be a problem "Often" or "Almost Always." This utilization of the instrument was compared to standardized scoring and the practicality and perceived usefulness of the practice was evaluated by physician interview.

RESULTS

PedsQL responses showed 38% of patients reporting significant (Often or Almost Always) problems on at least one domain (19% Physical Functioning, 18.2% Emotional Functioning, 11.4% Social Functioning, and 22.3% School Functioning problems). Using standardized scoring, the prevalence of scores below the cutoff score for clinically significant impaired QOL in each domain ranged from 10% to 20%, with agreement between scoring methods ranging from 89% to 93%, sensitivity 68% to 86%, and specificity 89% to 97%. Cardiologists reported interventions in 30.1% of patients. They found that the PedsQL was easy to use, did not interfere with clinic operations, required minimal time (1-5 minutes), and provided information that had an important impact on their practice in some patients.

CONCLUSIONS

This study demonstrates the clinical utility of health-related QOL assessment using the PedsQL in a pediatric cardiology outpatient setting. Identification of significant impairments in QOL can impact clinical decision making and may change psychosocial outcomes in children with congenital heart disease.

Clinical vs. structured interview on anxiety and affective disorders by primary care physicians. Understanding diagnostic discordance

Aims— To assess in a national sample the ability of GPs to detect psychiatric disorders using a clinical vs. a standardized interview and to characterize the patients that were falsely diagnosed with an anxiety or affective disorder.Methods— This is a national, cross—sectional, epidemiological survey, carried out by GPs on a random sample of their patients. The GPs were randomly divided into two groups. Apart from the routine clinical interview, the experimental group (group A) had to administer the Mini—International Neuropsychiatric Interview (MINI).Results— Data was collected by 143 GPs. 17.2% of all patients had a clinical diagnosis of an affective disorder, and 25.4% a clinical diagnosis of an anxiety disorder. In group A, the number of clinical diagnoses was about twice that of MINI diagnoses for affective disorders and one and a half times that for anxiety disorders. The majority of clinical diagnoses were represented by MINI subsyndromal cases (52.3%). Females showed a higher OR of being over—detected by GPs with anxiety disorders or of not being diagnosed with an affective disorder. Being divorced/separated/widowed increased the OR of over—detection of affective and anxiety disorders. The OR of over—detection of an affective or an anxiety disorder was higher for individuals with a moderate to poor quality of life.Conclusions— In the primary care a gap exists between clinical and standardized interviews in the detection of affective and anxiety disorders. Some experiential and social factors can increase this tendency. The use of a psycho.

Declaration of Interest: GlaxoSmithKline provided unrestricted economic and organizational support to the study. No further declarations on other form of financing or any other involvement that might be considered a conflict of interest in connection with the submitted article.

The incremental value of self-reported mental health measures in predicting functional outcomes of veterans

Research on patient-centered care supports use of patient/consumer self-report measures in monitoring health outcomes. This study examined the incremental value of self-report mental health measures relative to a clinician-rated measure in predicting functional outcomes among mental health service recipients. Participants (n = 446) completed the Behavior and Symptom Identification Scale, the Brief Symptom Inventory, and the Veterans/Rand Short Form-36 at enrollment in the study (T1) and 3 months later (T2). Global Assessment of Functioning (GAF) ratings, mental health service utilization, and psychiatric diagnoses were obtained from administrative data files. Controlling for demographic and clinical variables, results indicated that improvement based on the self-report measures significantly predicted one or more functional outcomes (i.e., decreased likelihood of post-enrollment psychiatric hospitalization and increased likelihood of paid employment), above and beyond the predictive value of the GAF. Inclusion of self-report measures may be a useful addition to performance measurement efforts.

The relationship among Mental Health Status (GHQ-12), Health Related Quality of Life (EQ-5D) and Health-State Utilities in a general population

Aim – To assess the relationship between mental health and health-related quality of life (HRQL) in the general population, and to map GHQ-12 as a screening test for population psychological distress to a generic health state measure (EQ-5D) in order to estimate health state values and allow deriving quality-adjusted life years. Methods – Relationship between mental health and HRQL was examined from the 2004 Canary Islands’ Health Survey. Participants were classified as probable psychiatric cases according to GHQ-12. HRQL was measured by the EQ-5D index. Multivariate lineal regression analysis was used to examine the association between mental health and HRQL adjusting by socio-demographic variables and comorbidities. A multivariate regression model was built from EQ-5D to estimate health states values using GHQ-12 as exposure. Results – EQ-5D index scores decreased as the GHQ-12 scores increased. Clinical and socio-demographic factors influenced HRQL without changing the overall trend for this negative relationship. The regression equation explained 43% of the variance. For estimation of utility scores, the model showed a high predictive capacity, with a mean forecast errors of 16%. Conclusions – HRQL progressively decreased when the probability of being a psychiatric case increased. Findings enable health state values to be derived from GHQ-12 scores for populations where utilities has not or cannot be measured directly.

Declaration of Interest: Authors declare no conflicts of interest. This work was supported by the Quality Plan for the National Health Service (Spanish Ministry of Health and Social Policy).

Measuring patients' views: a bifactor model of distinct patient-reported outcomes in psychosis

BACKGROUND

Patient-reported outcomes (PROs) are widely used for evaluating the care of patients with psychosis. Previous studies have reported a considerable overlap in the information captured by measures designed to assess different outcomes. This may impair the validity of PROs and makes an a priori choice of the most appropriate measure difficult when assessing treatment benefits for patients. We aimed to investigate the extent to which four widely established PROs [subjective quality of life (SQOL), needs for care, treatment satisfaction and the therapeutic relationship] provide distinct information independent from this overlap.

METHOD

Analyses, based on item response modelling, were conducted on measures of SQOL, needs for care, treatment satisfaction and the therapeutic relationship in two large samples of patients with psychosis.

RESULTS

In both samples, a bifactor model matched the data best, suggesting sufficiently strong concept factors to allow for four distinct PRO scales. These were independent from overlap across measures due to a general appraisal tendency of patients for positive or negative ratings and shared domain content. The overlap partially impaired the ability of items to discriminate precisely between patients from lower and higher PRO levels. We found that widely used sum scores were strongly affected by the general appraisal tendency.

CONCLUSIONS

Four widely established PROs can provide distinct information independent from overlap across measures. The findings may inform the use and further development of PROs in the evaluation of treatments for psychosis.

Is the EQ-5D fit for purpose in mental health?

The EQ-5D is a widely used questionnaire for calculating quality-adjusted life-years (QALYs) for assessing cost-effectiveness in healthcare. It reflects the impact of common mental health conditions such as mild to moderate depression but seems to be more problematic for use in people with psychotic and severe and complex non-psychotic disorders.

Logistic feasibility of health related quality of life measurement in clinical practice: results of a prospective study in a large population of chronic liver patients

BACKGROUND

The objective of the present study was to provide a complete and detailed report of technical and logistical feasibility problems with the implementation of routine computerized HRQoL measurement at a busy outpatient department of Hepatology that can serve as a tool for future researchers interested in the procedure.

METHODS

Practical feasibility was assessed by observing problems encountered during the development of the computer program, observing patients' ability to complete the HRQoL questionnaires, monitoring the number of times that patients completed the HRQoL questionnaires and observing logistics at the outpatient department. Patients' reasons for not completing the HRQoL questionnaires were assessed retrospectively by means of a mailed questionnaire. Physicians' attitudes towards the availability of computerized HRQoL information about their patients were assessed by means semi-structured interviews and by means of checklists administered after each consultation with s study participant.

RESULTS

All physicians (n = 11) and 587 patients agreed to participate in the study. Practical feasibility problems concerned complicated technical aspects of developing a user-friendly computer program and safe data transmission over the Internet, patients' lack of basic computer skills and patients' lack of compliance (completion of questionnaires on only 43% of the occasions). The main reason given for non-compliance was simply forgetting, which seemed to be related to reception employees' passive attitude towards sending patients to the computer. Physicians were generally positive about the instant computerized availability of HRQoL information. They requested the information in 92% of the consultations and found the information useful in 45% of the consultations, especially when it provided them with new information.

CONCLUSION

This study was among the first to implement the complete procedure of routine computerized HRQoL measurements in clinical practice and to subsequently describe the feasibility issues encountered. It was shown that the attitudes of physicians were generally positive. Several barriers towards successful implementation of such a procedure were encountered, and subsequently solutions were provided. Most importantly, when implementing routine computerized HRQoL measurements in clinical practice, assistance of an IT professional for the development of a tailor-made computer program, availability of questionnaires in multiple languages and the use of touch-screen computers to optimise patient participation are essential. Also, all staff of the department concerned should approve of the intervention and consider it as part of standard clinical routine if successful implementation is to be obtained.

Deconstructing the 'black box' of the Camberwell assessment of need score in mental health services evaluation

OBJECTIVE

The aim of the study was to examine an alternative way of scoring the Camberwell Assessment of Need (CAN) for the purpose of service evaluation, using the by us defined Social Services (SI) and Psychiatric Services (PI) subindices.

METHODS

CAN assessments in 1997 and 1999 of 262 outpatients (mean age 45 years, 77.1% psychotic disorders) were reanalysed to fit the SI and the PI, which were compared to the full CAN.

RESULTS

The mean total needs on the full CAN decreased from 6.65 to 6.22 (P = 0.007), as did the mean unmet needs (1.55-1.81, P = 0.049). The mean total needs on the PI decreased from 2.42 to 2.22 (P = 0.006), as did the mean unmet needs (1.66-0.57, P < 0.001). No changes in mean needs occurred on the SI.

CONCLUSIONS

All significant changes occurred on the PI, indicating a more beneficial outcome of the psychiatric care than the social care in terms of meeting needs, a result impossible to discern from the total scores of the CAN. Thus, output scores on subindices of the CAN might be useful as outcome measures in service evaluation.

Effectiveness of health-related quality-of-life measurement in clinical practice: a prospective, randomized controlled trial in patients with chronic liver disease and their physicians

BACKGROUND

This study assessed the effectiveness of computerized measurement and feedback of health-related quality of life (HRQoL) in daily clinical practice in patients with chronic liver disease.

METHODS

One hundred and sixty-two patients (61% men; mean age 47.5 years) regularly completed computerized HRQoL questionnaires before each consultation for the duration of 1 year. Six physicians were randomly assigned to the experimental group and received an instant online graphical output of data. Five other physicians were randomly assigned to the control group and conducted their consultations as usual. Differences between groups on generic- and disease-specific HRQoL, patient management, and patient satisfaction with the consultation were assessed, as were physicians' experiences with HRQoL data and effects on their consultations.

RESULTS

No direct effect of the experimental condition on patients' HRQoL was found. However, an interaction effect of the experimental condition and age was found: older patients in the experimental group had significantly better disease-specific HRQoL (F = 4.16; P = 0.04) and generic mental HRQoL (F = 4.62; P = 0.03) than patients in the control group. Also, male patients in the experimental group had better generic mental HRQoL than patients in the control group (F = 6.10; P = 0.02). Physicians in the experimental group altered their treatment policy significantly more often than did physicians in the control group (z = -3.73, P = 0.00), and their experiences with the availability of HRQoL information were generally positive. The scores on patient satisfaction with the consultation did not differ significantly between the experimental and control groups (z = -1.20, P = 0.23).

CONCLUSIONS

Computerized measurement and feedback of HRQoL in a daily clinical practice of an outpatient department of hepatology did not improve HRQoL for the entire group of chronic liver patients but, rather, improved disease-specific HRQoL of older patients with chronic liver disease and mental HRQoL of older patients and male patients with chronic liver disease. It also had an effect on patient management.

The impact of measuring patient-reported outcomes in clinical practice: a systematic review of the literature

OBJECTIVE

The purpose of this paper is to summarize the best evidence regarding the impact of providing patient-reported outcomes (PRO) information to health care professionals in daily clinical practice.

METHODS

Systematic review of randomized clinical trials (Medline, Cochrane Library; reference lists of previous systematic reviews; and requests to authors and experts in the field).

RESULTS

Out of 1,861 identified references published between 1978 and 2007, 34 articles corresponding to 28 original studies proved eligible. Most trials (19) were conducted in primary care settings performed in the USA (21) and assessed adult patients (25). Information provided to professionals included generic health status (10), mental health (14), and other (6). Most studies suffered from methodologic limitations, including analysis that did not correspond with the unit of allocation. In most trials, the impact of PRO was limited. Fifteen of 23 studies (65%) measuring process of care observed at least one significant result favoring the intervention, as did eight of 17 (47%) that measured outcomes of care.

CONCLUSIONS

Methodological concerns limit the strength of inference regarding the impact of providing PRO information to clinicians. Results suggest great heterogeneity of impact; contexts and interventions that will yield important benefits remain to be clearly defined.

Assessing the outcome of community-based psychiatric care: building a feedback loop from 'real world' health services research into clinical practice

OBJECTIVE

To describe the main characteristics of the South-Verona Outcome Project (SVOP) and to focus on its overall conceptual framework, with specific reference to the following perspectives: i) integrating evidence-based and practice-based approaches; ii) involving service professionals in routine outcome assessment; and iii) involving service users in mental health outcome assessment.

METHOD

A selective literature review of methodological and empirical papers addressing the relevance and usefulness of outcome research to routine clinical practice was performed.

RESULTS

Reviewed literature shows the need to integrate evidence-based and practice-based approaches and to involve service professionals in routine outcome assessment, by adopting a multiple perspective paradigm. Studies conducted in 'real world' health services indicate that the outcome of care is multifaceted and it can be perceived differently when different perspectives are taken into account. Such a complex picture can provide more comprehensive information on the effectiveness of care provided, to feed back positively into clinical practice.

CONCLUSION

The SVOP design and its methodological background were demonstrated to be appropriate for a detailed and routine assessment of outcome in the 'real world' of mental health services.

Exploration of the value of health-related quality-of-life information from clinical research and into clinical practice

Quality-of-life (QOL) instruments used in clinical research can provide important evidence to inform decisions about alternative treatments. This is particularly true when patients, such as those with cancer who are contemplating toxic chemotherapy, face tradeoffs between quantity of life and QOL or when the primary goal of therapy is to improve how patients feel. Surrogate measures (cardiac function, exercise capacity, bone density, tumor size) are inadequate substitutes for direct measurement of QOL. Quality-of-life measures will be most valuable when they comprehensively measure aspects of QOL that are both important to patients and likely to be influenced by therapy, when the QOL measurement instruments are valid (measuring what is intended) and responsive (able to detect all important changes, even if small), and when the results are readily interpretable (determining whether treatment-related changes are trivial, small but important, or large). Researchers are finding new, imaginative ways to help clinicians understand the magnitude of treatment impact on QOL. Additionally, QOL measures may be useful in clinical practice. Recent results from well-designed randomized controlled trials suggest that information on patient QOL provided to clinicians might, in some circumstances, result in benefits for these patients. Further investigation is warranted to confirm these observations and to define the particular combination of methods and settings most likely to yield important benefits.

Measuring clinically meaningful change following mental health treatment

Assessment of clinically meaningful change is useful for treatment planning, monitoring progress, and evaluating treatment response. Outcome studies often assess statistically significant change, which may not be clinically meaningful. Study objectives are to: (1) evaluate responsiveness of the BASIS-24 using three methods for determining clinically meaningful change: reliable change index (RCI), effect size (ES), and standard error of measurement (SEM); and (2) determine which method provides an estimate of clinically meaningful change most concordant with other change measures. BASIS-24 assessments were obtained at two time points for 1,397 inpatients and 850 outpatients. The proportion showing clinically meaningful change using each method was compared to the proportion showing change in global mental health, retrospectively reported change, and clinician-assessed change. BASIS-24 demonstrated responsiveness at both aggregate and individual levels. Regarding clinically meaningful improvement and decline, SEM was most concordant with all three outcome measures; regarding no change, RCI was most concordant with all three measures.

The Feasibility of Computerized Patient Self-assessment at Mental Health Clinics

OBJECTIVES

Improving the quality of care for severe mental illness (SMI) has been difficult because patients' clinical information is not readily available. Audio computer-assisted self-interviewing (ACASI) supports data collection by asking patients waiting for appointments clinical questions visually and aurally. It has improved outcomes for many disorders. While reliable and accurate for SMI in research settings, this study assesses questions about ACASI's feasibility in usual care.

DESIGN

Patient and provider surveys and provider focus groups after 12 months of ACASI implementation.

SETTING

Two outpatient mental health clinics in Los Angeles, one run by the Department of Veterans Affairs and the other by Los Angeles County Department of Mental Health.

PARTICIPANTS

266 patients with SMI and 14 psychiatrists.

INTERVENTION

Patients completed an ACASI survey on symptoms, drug use, medication adherence and side-effects by internet using a touch-screen monitor. A 1-page report summarizing each patient's results was printed and given to providers by patients during appointments.

MAIN OUTCOME MEASURE

Feedback surveys (patients and psychiatrists) and focus groups and interviews (psychiatrists) assessed usability, usefulness, effects on treatment, and barriers to sustaining ACASI.

RESULTS

Patients believed the PAS was enjoyable, easy to learn and use, and that it improved communication with their psychiatrists. Providers believed the PAS was easy to use, had a small impact on care, could be improved by being more detailed and comprehensive, and requires outside support to continue its use.

CONCLUSIONS

ACASI was easy to use and enhanced communication. Systems like this can be a valuable part of quality improvement projects.

Measuring patient quality of life: is the health utility index useful?

The purpose of this paper is to report Health Utility Index Mark 3 (HUI3) scores, at baseline and at one year, for patients with psychotic disorders. Eighty two randomly selected outpatients from a Montreal teaching hospital completed the HUI3 and other measures of symptoms and side-effects. At baseline, the average Global Utility score was 0.64, which is rated in the "dysfunctional" health status range. Improvements were seen at one year follow-up in the Global, Dexterity, Cognition, and Pain Utility scores. The proportion of individuals rated in the "healthy" health status range improved by 32% from baseline to one year. HUI3 scores were negatively related to measures of psychotic symptoms and side-effects. We propose that the HUI3 should be used to assess health-related quality of life (HRQOL) in patients with psychotic disorders. Scores could be compared with other populations affected with chronic conditions (e.g., Alzheimer dementia, cancer, arthritis, etc.).

Assessing and achieving readiness to initiate HIV medication

OBJECTIVE

To summarise published HIV-specific research on readiness theories, factors influencing readiness, instruments to measure readiness and interventions to increase readiness for treatment.

METHODS

Medline and PsychInfo were searched until August 2004.

RESULTS

Two HIV-specific readiness theories were identified. Fear of side effects, emotions emerging from the diagnosis and lack of trust in the physician were some barriers to overcome in order to reach readiness. Of the three measurement instruments found, the index of readiness showed the most promise. Multi-step intervention programs to increase readiness for HIV treatment had been investigated.

CONCLUSION

Readiness instruments may be useful tools in clinical practice but the predictive validity of the instruments needs to be further established in the HIV-infected population.

PRACTICE IMPLICATIONS

Readiness instruments and practice placebo trials may serve as complements to routine care, since health care providers currently have no better than chance probability in identifying those patients who are ready to adhere.

Path analytical study of the short version of the WHO Quality of Life Instrument

BACKGROUND

Using confirmatory factor analysis, we have shown that the 8 factors we derived from the responses of 118 Nigerian psychiatric patients to the short version of the WHO Quality of Life Instrument had greater structural integrity than the 4- and 6-domain models of the WHO.

OBJECTIVES

Using path analysis to assess the structural integrity of the model we generated from the relationships among the 8 factors, we proposed a model of QOL from which targets for subjective QOL interventions could be delineated.

METHOD

The model was generated by multiple regression analysis with the item on overall QOL (OQOL) as dependent variable and the 8 domains as predictors. Path analysis was done by Analysis of Moment Structures, with a maximum likelihood ratio as method of estimation.

RESULTS

Our model had high Cronbach's alphas and met the criteria for the following fit indices: relative chi2 (1.9), goodness of fit (0.92) and comparative fit index (0.91). Hence, we propose that subjective QOL is primarily mediated by satisfaction with life, informational need, opportunity for experience, and instrumental need.

CONCLUSION

Subjective QOL encompasses satisfaction with life circumstances, fulfillment of needs, and opportunity for experience, which should be targets for QOL interventions.

Screening and case finding instruments for depression

BACKGROUND

Screening or case finding instruments have been advocated as a simple, quick and inexpensive method to improve detection and management of depression in non-specialist settings, such as primary care and the general hospital. However, screening/case finding is just one of a number of strategies that have been advocated to improve the quality of care for depression. The adoption of this seemingly simple and effective strategy should be underpinned by evidence of clinical and cost effectiveness.

OBJECTIVES

To determine the clinical and cost effectiveness of screening and case finding instruments in: (1) improving the recognition of depression; (2) improving the management of depression, and (3) improving the outcome of depression.

SEARCH STRATEGY

The researchers undertook electronic searches of The Cochrane Library (Issue 4, 2004); The Cochrane Depression, Anxiety and Neurosis Group's Register [2004); EMBASE (1980-2004); MEDLINE (1966-2004); CINAHL (to 2004) and PsycLIT (1974-2004). References of all identified studies were searched for further trials, and the researchers contacted authors of trials.

SELECTION CRITERIA

Randomised controlled trials of the administration of case finding/screening instruments for depression and the feedback of the results of these instruments to clinicians, compared with no clinician feedback. Trials had to be conducted in non-mental health settings, such as primary care or the general hospital. Studies that used screening strategies in addition to enhanced care, such as case management and structured follow up, were specifically excluded.

DATA COLLECTION AND ANALYSIS

Citations and, where possible, abstracts were independently inspected by researchers, papers ordered, re-inspected and quality assessed. Data were also independently extracted. Data relating to: (1) the recognition of depression; (2) the management of depression and (3) the outcome of depression over time were sought. For dichotomous data the Relative Risk (RR), 95% confidence interval (CI) were calculated on an intention-to-treat basis. For continuous data, weighted and standardised mean difference were calculated. A series of a priori sensitivity analyses relating to the method of administration of questionnaires and population under study were used to examine plausible causes of heterogeneity.

MAIN RESULTS

Twelve studies (including 5693 patients) met our inclusion criteria. Synthesis of these data gave the following results:(1) the recognition of depression: according to case note entries of depression, screening/case finding instruments had borderline impact on the overall recognition of depression by clinicians (relative risk 1.38; 95% confidence interval 1.04 to 1.83). However, substantial heterogeneity was found for this outcome. Screening and feedback, irrespective of baseline score of depression has no impact on the detection of depression (relative risk 1.00; 95% confidence interval 0.89 to 1.13). In contrast, three small positive studies using a two stage selective procedure, whereby patients were screened and only patients scoring above a certain threshold were entered into the trial, did suggest that this approach might be effective (relative risk 2.66; 95% confidence interval 1.78 to 3.96). Separate pooling according to this variable reduced the overall level of heterogeneity. Publication bias was also found for this outcome.(2) the management of depression: according to case note entries for active interventions and prescription data, a selected subsample of all studies reported this outcome and found that there was there was an overall trend to showing a borderline higher intervention rate amongst those who received feedback of screening/case finding instruments (relative risk 1.35; 95% confidence interval 0.98 to 1.85), although substantial heterogeneity between studies existed for this outcome. This result was dependant upon the presence of one highly positive study.(3) the outcome of depression: few studies reported the impact of case finding/screening instruments on the actual outcome of depression, and no statistical pooling was possible. However, three out of four studies reported no clinical effect (p<0.05) at either six months or twelve months. No studies examined the cost effectiveness of screening/case finding as a strategy.

AUTHORS' CONCLUSIONS

There is substantial evidence that routinely administered case finding/screening questionnaires for depression have minimal impact on the detection, management or outcome of depression by clinicians. Practice guidelines and recommendations to adopt this strategy, in isolation, in order to improve the quality of healthcare should be resisted. The longer term benefits and costs of routine screening/case finding for depression have not been evaluated. A two stage procedure for screening/case finding may be effective, but this needs to be evaluated in a large scale cluster randomised trial, with a prospective economic evaluation.

The impact of the VF-14 index, a perceived visual function measure, in the routine management of cataract patients

BACKGROUND

Evidence about the impact of routine feedback of patient-reported outcomes is contradictory, and there is limited information regarding its use in the routine management of cataract patients.

METHODS

The VF-14 Index was used to assess the visual function of 833 consecutive cataract patients, attending 19 ophthalmologists from public and private hospitals and primary care practices in Spain, in 1999-2000. In this before/after trial, the intervention included (1) an educational session, and (2) the provision of the VF-14 scores of all subsequent patients to the ophthalmologist. Mixed effects linear and logistic models were constructed to assess the effect on the process (correlation between patients' and physicians' assessments of visual function, appropriateness of surgery recommendation) and the outcome of care (satisfaction).

RESULTS

The adjusted regression coefficient for the VF-14 score significantly increased after the intervention as a predictor of the ophthalmologist's assessment of visual function (beta coefficient: control 0.10 vs. intervention 0.35, p < 0.05). The intervention did not increase the probability of an appropriate medical decision (OR = 0.90; 95% CI: 0.42; 2,69) and it did not change patient satisfaction with care.

CONCLUSIONS

Routine provision of education and feedback on the patient's VF-14 Index score significantly increases agreement between patients' and physicians' assessments of functional capacity. The lack of a beneficial effect on management or outcome suggests the need for a more intense intervention to change medical practice.

Health needs assessment tools: Progress and potential

Objectives:Health needs has attracted the interest of policy-makers, health economists, and health professionals as modern health services try to satisfy individual and population health needs to optimize resource utilization. Health needs can be assessed by administering various types of survey or interview-based instruments. If health needs are to be satisfied in changing health agendas in developed and developing countries, it is essential to employ valid and reliable tools. Despite the importance of needs assessment, no comprehensive review of tools is currently available. We carried out a literature search to define and categorize existing health needs assessment tools.

Methods:We reviewed medical and social search engines for items containing specific health needs–related words to identify needs tools across a range of specialties. Papers were reviewed in terms of design, subject matter, psychometric features, and method of administration method.

Results:Thirty-one employed in 52 studies including cancer, mental health, palliative care, multiple sclerosis, and cardiovascular disease tools were identified.

Conclusions:This report summarizes available health needs instruments in a range of diseases to assist researchers in accessing health needs resources more easily and to encourage further research in this field.

The use of patient reported outcome measures in routine clinical practice: lack of impact or lack of theory?

This paper applies a theory-driven approach to explore why the use of patient-reported outcome (PRO) measures in clinical practice, in particular, health-related quality of life (HRQoL) instruments, has little or no apparent influence on clinical decision making. A theory-driven approach involves combining knowledge of whether and how an intervention works. It is argued that such an approach is currently lacking within the literature evaluating the effectiveness of feeding back HRQoL information to clinicians. The paper identifies a number of mechanisms that might give rise to the expected outcomes that are currently implicit within the design of the intervention and hypotheses specified within the trials evaluating the use of HRQoL measures in clinical practice. It then examines how far current clinical practice matches these mechanisms and in doing so, a number of possible explanations for the lack of impact of HRQoL on clinical decision making are reviewed. The influence of HRQoL information on clinical decision making depends on a large number of factors related to the design of the intervention, patients' and clinicians' desire to discuss HRQoL issues within the consultation and the legitimacy that clinicians give to HRQoL instruments. To date, knowledge of how the feedback of HRQoL information to clinicians might improve doctor-patient communication or clinical decision making has yet to sufficiently inform an assessment of whether these aspects of patient care are improved. The paper concludes by specifying how the feedback of HRQoL information to clinicians might be modified to maximise its impact on clinical decision making.