Developing a user-generated measure of continuity of care: brief report

Relational continuity may give better clinical outcomes in patients with serious mental illness - a systematic review

BACKGROUND

Continuity of care is considered important for results of treatment of serious mental illness (SMI). Yet, evidence of associations between relational continuity and different medical and social outcomes is sparse. Research approaches differ considerably regarding how to best assess continuity as well as which outcome to study. It has hitherto been difficult to evaluate the importance of relational continuity of care. The aim of this systematic review was to investigate treatment outcomes, including effects on resource use and costs associated with receiving higher relational continuity of care for patients with SMI.

METHODS

Eleven databases were searched between January 2000 and February 2021 for studies investigating associations between some measure of relational continuity and health outcomes and costs. All eligible studies were assessed for study relevance and risk of bias by at least two independent reviewers. Only studies with acceptable risk of bias were included. Due to study heterogeneity the synthesis was made narratively, without meta-analysis. The certainty of the summarized result was assessed using GRADE. Study registration number in PROSPERO: CRD42020196518.

RESULTS

We identified 8 916 unique references and included 17 studies comprising around 300 000 patients in the review. The results were described with regard to seven outcomes. The results indicated that higher relational continuity of care for patients with serious mental illness may prevent premature deaths and suicide, may lower the number of emergency department (ED) visits and may contribute to a better quality of life compared to patients receiving lower levels of relational continuity of care. The certainty of the evidence was assessed as low or very low for all outcomes. The certainty of results for the outcomes hospitalization, costs, symptoms and functioning, and adherence to drug treatment was very low with the result that no reliable conclusions could be drawn in these areas.

CONCLUSIONS

The results of this systematic review indicate that having higher relational continuity of care may have beneficial effects for patients with severe mental illness, and no results have indicated the opposite relationship. There is a need for better studies using clear and distinctive measures of exposure for relational continuity of care.

Predicting Continuity of Asthma Care Using a Machine Learning Model: Retrospective Cohort Study

Continuity of care (COC) has been shown to possess numerous health benefits for chronic diseases. Specifically, the establishment of its level can facilitate clinical decision-making and enhanced allocation of healthcare resources. However, the use of a generalizable predictive methodology to determine the COC in patients has been underinvestigated. To fill this research gap, this study aimed to develop a machine learning model to predict the future COC of asthma patients and explore the associated factors. We included 31,724 adult outpatients with asthma who received care from the University of Washington Medicine between 2011 and 2018, and examined 138 features to build the machine learning model. Following the 10-fold cross-validations, the proposed model yielded an accuracy of 88.20%, an average area under the receiver operating characteristic curve of 0.96, and an average F1 score of 0.86. Further analysis revealed that the severity of asthma, comorbidities, insurance, and age were highly correlated with the COC of patients with asthma. This study used predictive methods to obtain the COC of patients, and our excellent modeling strategy achieved high performance. After further optimization, the model could facilitate future clinical decisions, hospital management, and improve outcomes.

Needs and Experiences in Psychiatric Treatment (NEPT)- Piloting a Collaboratively Generated, Initial Research Tool to Evaluate Cross-Sectoral Mental Health Services

BACKGROUND

Research tools to evaluate institutions or interventions in the field of mental health have rarely been constructed by researchers with personal experience of using the mental health system ("experiential expertise"). This paper presents a preliminary tool that has been developed within a participatory-collaborative process evaluation as part of a controlled, multi-center, prospective cohort study (PsychCare) to evaluate psychiatric flexible and integrative treatment, FIT for short, models in Germany.

METHOD

The collaborative research team consisting of researchers with and without experiential expertise developed 12 experiential program components of FIT models by an iterative research process based on the Grounded Theory Methodology. These components were transformed into a preliminary research tool that was evaluated by a participatory expert panel, and during a pilot and validation study, the latter using a random sample of 327 users from 14 mental health departments. Internal consistency of the tool was tested using Cronbach's alpha. Construct validity was evaluated using a Principal Components Analysis (PCA) and a Jonckheere Terpstra test in relation to different implementation levels of the FIT model. Concurrent validity was tested against a German version of the Client Satisfaction Questionnaire (ZUF-8) using correlation analysis and a linear regression model.

RESULTS

The evaluation of the expert panel reduced 29 initial items to 16 that were further reduced to 11 items during the pilot study, resulting into a research tool (Needs and Experiences in Psychiatric Treatment-NEPT) that demonstrated good internal consistency (Cronbach's alpha of 0.89). PCA yielded a 1-component structure, which accounted for 49% of the total variance supporting the unidimensional structure of the tool. The total NEPT score increased alongside the increasing implementation of the FIT model (p < 0.05). There was evidence (p < 0.001) for convergent validity assessed against the ZUF-8 as criterion measure.

CONCLUSIONS

The NEPT tool seems to be promising for further development to assess the experiences with and fulfillment of needs of psychiatric care models from the perspective of users. This paper demonstrates that it is possible to use a participatory-collaborative approach within the methodologically rigorous confines of a prospective, controlled research design.

Designed to Clash? Reflecting on the Practical, Personal, and Structural Challenges of Collaborative Research in Psychiatry

Background: In the field of mental health research, collaborative and participatory approaches in which mental health service users actively contribute to academic knowledge production are gaining momentum. However, concrete examples in scientific literature that would detail how collaborative research projects are actually organized, and how they deal with the inherent challenges are rare. This paper provides an in-depth description of a three-year collaborative project that took place in the wider context of a mixed-method process evaluation of innovative models of psychiatric care in Germany. Methods: The in-depth description we provide here draws on a vast body of notes and records that originated from numerous meetings and sessions. The research group continuously and systematically reflected on their collaboration itself using the interpretative method of "interactive interviewing," which included that also the personal memories of the researchers were collectively re-discussed before and during the process of writing. Our concrete experiences as a group were then contextualized with and analyzed in the light of more general challenges that are central to collaborative research in general. Results: Performing collaborative research requires unconventional thinking and improvisation in order to find creative solutions for practical problems and to overcome the structural obstacles inherent to the process of academic knowledge production. An atmosphere of mutual trust and respect within the group is crucial, and continuous self-reflection or supervision can be largely beneficial. Challenges mainly originate from the vast heterogeneity that characterizes the researchers, usually including large differences in economic, cultural, and social capital. Conclusion: Collaborative research in the field of psychiatry is designed to bring together researchers with widely diverse backgrounds. Emerging conflicts are important parts of knowledge production but also exceptional opportunities to negotiate research ethics, and potential vehicles for personal growth and transformation. Success or failure of collaborative research largely depends on how divergences and conflicts are articulated, mediated, and reflected. This also holds true in the light of the power asymmetries within the research team and the structural power inherent to the engines of academic knowledge production.

Measuring the Patient Experience of Mental Health Care: A Systematic and Critical Review of Patient-Reported Experience Measures

BACKGROUND

There is growing concern about measuring patient experience with mental health care. There are currently numerous patient-reported experience measures (PREMs) available for mental health care, but there is little guidance for selecting the most suitable instruments. The objective of this systematic review was to provide an overview of the psychometric properties and the content of available PREMs.

METHODS

A comprehensive review following the preferred reporting items for systematic reviews and meta-analysis (PRISMA) guidelines was conducted using the MEDLINE database with no date restrictions. The content of PREMs was analyzed using an inductive qualitative approach, and the methodological quality was assessed according to Pesudovs quality criteria.

RESULTS

A total of 86 articles examining 75 PREMs and totaling 1932 items were included. Only four PREMs used statistical methods from item response theory (IRT). The 1932 items covered seven key mental health care domains: interpersonal relationships (22.6%), followed by respect and dignity (19.3%), access and care coordination (14.9%), drug therapy (14.1%), information (9.6%), psychological care (6.8%) and care environment (6.1%). Additionally, a few items focused on patient satisfaction (6.7%) rather than patient experience. No instrument covered the latent trait continuum of patient experience, as defined by the inductive qualitative approach, and the psychometric properties of the instruments were heterogeneous.

CONCLUSION

This work is a critical step in the creation of an item library to measure mental health care patient-reported experience that will be used in France to develop, validate, and standardize item banks and computerized adaptive testing (CAT) based on IRT. It will also provide internationally replicable measures that will allow direct comparisons of mental health care systems.

TRIAL REGISTRATION

NCT02491866.

The CORE service improvement programme for mental health crisis resolution teams: results from a cluster-randomised trial

BACKGROUND

Crisis resolution teams (CRTs) offer brief, intensive home treatment for people experiencing mental health crisis. CRT implementation is highly variable; positive trial outcomes have not been reproduced in scaled-up CRT care.

AIMS

To evaluate a 1-year programme to improve CRTs' model fidelity in a non-masked, cluster-randomised trial (part of the Crisis team Optimisation and RElapse prevention (CORE) research programme, trial registration number: ISRCTN47185233).

METHOD

Fifteen CRTs in England received an intervention, informed by the US Implementing Evidence-Based Practice project, involving support from a CRT facilitator, online implementation resources and regular team fidelity reviews. Ten control CRTs received no additional support. The primary outcome was patient satisfaction, measured by the Client Satisfaction Questionnaire (CSQ-8), completed by 15 patients per team at CRT discharge (n = 375). Secondary outcomes: CRT model fidelity, continuity of care, staff well-being, in-patient admissions and bed use and CRT readmissions were also evaluated.

RESULTS

All CRTs were retained in the trial. Median follow-up CSQ-8 score was 28 in each group: the adjusted average in the intervention group was higher than in the control group by 0.97 (95% CI -1.02 to 2.97) but this was not significant (P = 0.34). There were fewer in-patient admissions, lower in-patient bed use and better staff psychological health in intervention teams. Model fidelity rose in most intervention teams and was significantly higher than in control teams at follow-up. There were no significant effects for other outcomes.

CONCLUSIONS

The CRT service improvement programme did not achieve its primary aim of improving patient satisfaction. It showed some promise in improving CRT model fidelity and reducing acute in-patient admissions.

The impact of ward climate on staff perceptions of barriers to research-driven service changes on mental health wards: A cross-sectional study

WHAT IS KNOWN ON THE SUBJECT?: To date, improvements on U.K. acute mental health wards have been difficult to sustain. The barriers to change may be context dependent. Mental health wards are volatile workplaces with service user violence/aggression, frequent staff and patient changes, and ongoing service improvements. The evidence suggests that burnout affects staff perceptions of barriers to change, and ward climate affects burnout. As two potentially important, independent predictors of staff perceptions of barriers to change, the impact of ward climate and burnout on how staff regard changes should be considered. WHAT THE PAPER ADDS TO EXISTING KNOWLEDGE?: Elements of ward climate such as high numbers of incidents and temporary staff independently worsened mental health staff perceptions of barriers to change, in addition to negative impacts from burnout and occupational status. How staff perceived ward climate was also linked their perceptions of barriers to change; however, burnout was no longer a significant consideration with these variables. Staff with low job satisfaction and high interaction anxiety also had low confidence regarding changes. Staff with low job satisfaction were also demotivated towards changes. WHAT ARE THE IMPLICATIONS FOR PRACTICE?: Ward climate is clearly an important factor in how nurses view organizational changes. In this study, nurses' perceptions of barriers to change were worse if they viewed ward climate negatively, or if temporary staff and incident numbers were high. Staff perceptions of ward climate and barriers to change should be assessed, ahead of service changes. Developing change strategies based on such information is likely to produce better implementation outcomes. Specifically, targeting staff confidence and motivation (which are barriers to change) may improve how staff regard their ward climate. Abstract Introduction To create successful change programmes for mental health wards, it is necessary to understand which aspects of ward climate prevent change. Question Does ward climate influence mental health nurse's perceptions of barriers to change? Method Random-effects models were used to test whether the following ward climate variables influenced the outcome measure "staff perceptions of barriers to change" (VOCALISE) and its subscales (powerlessness/confidence/demotivation): (a) Perceptions of ward climate (VOTE: subscales included work intensity/job satisfaction/interaction anxiety). (b) Ward climate indicators (incidents/detention under the Mental Health Act (2007)/staffing/bed pressure). As known predictors of VOCALISE, burnout (Maslach Burnout Inventory) and occupational status were included in the models. Results Perceptions of ward climate (VOTE), incidents, temporary staff, occupational status and burnout significantly and negatively affected perceptions of barriers to change (VOCALISE). Staff with low job satisfaction (VOTE) and high interaction anxiety (VOTE) also had low confidence (VOCALISE). Staff with low job satisfaction (VOTE) were also demotivated (VOCALISE). Discussion Ward climate is an important predictor of how staff regard service changes in mental health wards. Implications for practice Staff perceptions of ward climate and barriers to change should be assessed ahead of service changes to identify pressures that impede progress and lower morale.

Factors Associated with Perceived Continuity of Care Among Patients Suffering from Mental Disorders

This cross-sectional study identified variables associated with continuity of care among 327 patients with mental disorders receiving services from a variety of professionals in different Quebec settings. Based on the Andersen's Behavioral Model, a linear regression analysis was performed. Attention deficit and mood disorders were negatively associated with continuity of care, while substance use disorders and quality of life revealed positive associations. Consulting a psychologist was linked to weaker continuity of care whereas visiting a drug rehabilitation center, social support, and satisfaction with services were positively related. Fostering social support, comprehensive and integrated care, and facilitating access to psychologists could lead to improved continuity of care.

Crisis resolution teams for people experiencing mental health crises: the CORE mixed-methods research programme including two RCTs

Background

Crisis resolution teams (CRTs) seek to avert hospital admissions by providing intensive home treatment for people experiencing a mental health crisis. The CRT model has not been highly specified. CRT care is often experienced as ending abruptly and relapse rates following CRT discharge are high.

Aims

The aims of CORE (Crisis resolution team Optimisation and RElapse prevention) workstream 1 were to specify a model of best practice for CRTs, develop a measure to assess adherence to this model and evaluate service improvement resources to help CRTs implement the model with high fidelity. The aim of CORE workstream 2 was to evaluate a peer-provided self-management programme aimed at reducing relapse following CRT support.

Methods

Workstream 1 was based on a systematic review, national CRT manager survey and stakeholder qualitative interviews to develop a CRT fidelity scale through a concept mapping process with stakeholders (n = 68). This was piloted in CRTs nationwide (n = 75). A CRT service improvement programme (SIP) was then developed and evaluated in a cluster randomised trial: 15 CRTs received the SIP over 1 year; 10 teams acted as controls. The primary outcome was service user satisfaction. Secondary outcomes included CRT model fidelity, catchment area inpatient admission rates and staff well-being. Workstream 2 was a peer-provided self-management programme that was developed through an iterative process of systematic literature reviewing, stakeholder consultation and preliminary testing. This intervention was evaluated in a randomised controlled trial: 221 participants recruited from CRTs received the intervention and 220 did not. The primary outcome was re-admission to acute care at 1 year of follow-up. Secondary outcomes included time to re-admission and number of days in acute care over 1 year of follow-up and symptoms and personal recovery measured at 4 and 18 months’ follow-up.

Results

Workstream 1 – a 39-item CRT fidelity scale demonstrated acceptability, face validity and promising inter-rater reliability. CRT implementation in England was highly variable. The SIP trial did not produce a positive result for patient satisfaction [median Client Satisfaction Questionnaire score of 28 in both groups at follow-up; coefficient 0.97, 95% confidence interval (CI) –1.02 to 2.97]. The programme achieved modest increases in model fidelity. Intervention teams achieved lower inpatient admission rates and less inpatient bed use. Qualitative evaluation suggested that the programme was generally well received. Workstream 2 – the trial yielded a statistically significant result for the primary outcome, in which rates of re-admission to acute care over 1 year of follow-up were lower in the intervention group than in the control group (odds ratio 0.66, 95% CI 0.43 to 0.99; p = 0.044). Time to re-admission was lower and satisfaction with care was greater in the intervention group at 4 months’ follow-up. There were no other significant differences between groups in the secondary outcomes.

Limitations

Limitations in workstream 1 included uncertainty regarding the representativeness of the sample for the primary outcome and lack of blinding for assessment. In workstream 2, the limitations included the complexity of the intervention, preventing clarity about which were effective elements.

Conclusions

The CRT SIP did not achieve all its aims but showed potential promise as a means to increase CRT model fidelity and reduce inpatient service use. The peer-provided self-management intervention is an effective means to reduce relapse rates for people leaving CRT care.

Study registration

The randomised controlled trials were registered as Current Controlled Trials ISRCTN47185233 and ISRCTN01027104. The systematic reviews were registered as PROSPERO CRD42013006415 and CRD42017043048.

Funding

The National Institute for Health Research Programme Grants for Applied Research programme.

Addressing organizational barriers to continuity of care in the Danish mental health system - a comparative analysis of 14 national intervention projects

BACKGROUND

Continuity of mental health care is central to improve the conditions of people with enduring mental disorders. In Denmark, several government-funded projects on the improvement of continuity of mental health care have been initiated since 2009.

AIM

The aim of this study was to investigate how national intervention projects on continuity of mental health care have addressed major barriers for continuity of care and extract general learning points from the projects on the improvement of continuity of care.

METHOD

The study was designed as a thematic document analysis of external evaluations of 14 major national projects on the improvement of continuity of routine mental health care from 2009 to 2017. The data material was processed through thematic coding and comparative analysis.

RESULTS

The analysis was organized around four main barriers for continuity: Lack of models for collaboration, different professional cultures and methods, lack of channels of communication, and intersectoral differences in management, economy, and legislation. The first three barriers were addressed in a predominant part of the projects through development of collaborative models, common tools and communication systems. The latter structural barrier was not addressed in any of the projects.

CONCLUSION

There is an ongoing need to address barriers for continuity of mental health care. So far, there has been a much larger focus on organizational, cultural and communicational aspects of continuity than on structural aspects. The study calls for an increased focus on how changes in existing managerial, economic and legislative structures can improve continuity of care.

Patient involvement in improving the evidence base on mental health inpatient care: the PERCEIVE programme

Background

Despite the movement towards care in the community, 40% of the NHS budget on mental health care is still attributed to inpatient services. However, long before the Francis Report highlighted grave shortcomings in inpatient care, there were reports by service user groups on the poor quality of these services in mental health. The programme provides a particular focus on the inclusion of the patient’s perspective in the development and evaluation of evidence.

Objectives

To understand how changes to inpatient care affect the perceptions of the ward by service users and staff by using stakeholder participatory methods.

Design

The programme consisted of four work packages (WPs). (1) Lasting Improvements for Acute Inpatient SEttings (LIAISE): using participatory methods we developed two new scales [Views On Therapeutic Environment (VOTE) for staff and Views On Inpatient CarE (VOICE) for service users]. (2) Client Services Receipt Inventory – Inpatient (CITRINE): working with nurses and service users we developed a health economic measure of the amount of contact service users have with staff. The self-report measure records interactions with staff as well as the number of therapeutic activities attended. (3) Delivering Opportunities for Recovery (DOORWAYS): a stepped-wedge randomised controlled trial to test if training ward nurses to deliver therapeutic group activities would improve the perception of the ward by service users and staff. A total of 16 wards were progressively randomised and we compared the VOICE, VOTE and CITRINE measures before and after the intervention. A total of 1108 service users and 539 staff participated in this trial. (4) Bringing Emergency TreatmenT to Early Resolution (BETTER PATHWAYS) was an observational study comparing two service systems. The first was a ‘triage’ system in which service users were admitted to the triage ward and then either transferred to their locality wards or discharged back into the community within 7 days. The second system was routine care. We collected data from 454 service users and 284 nurses on their perceptions of the wards.

Main outcome measures

The main outcomes for the DOORWAYS and BETTER project were service user and staff perceptions of the ward (VOICE and VOTE, respectively) and the health economic measure was CITRINE. All were developed in WPs 1 and 2.

Results

We developed reliable and valid measures of (1) the perceptions of inpatient care from the perspectives of service users and nurses (VOICE and VOTE) and (2) costs of interactions that were valued by service users (CITRINE). In the DOORWAYS project, after adjusting for legal status, we found weak evidence for benefit (standardised effect of –0.18, 95% CI 0.38 improvement to 0.01 deterioration;p = 0.062). There was only a significant benefit for involuntary patients following the staff training (N582, standardised effect of –0.35, 95% CI –0.57 to –0.12;p = 0.002; interactionp-value 0.006). VOTE scores did not change over time (standardised effect size of 0.04, 95% CI –0.09 to 0.18;p = 0.54). We found no evidence of an improvement in cost-effectiveness (estimated effect of £33, 95% CI –£91 to £146;p = 0.602), but resource allocation did change towards patient-perceived meaningful contacts by an average of £12 (95% CI –£76 to £98;p = 0·774). There were no significant differences between the triage and routine models of admission in terms of better perceptions by service users (estimated effect 0.77-point improvement in VOICE score on the triage ward;p = 0.68) or nurses (estimated effect of 1.68-point deterioration in VOTE on the triage ward;p = 0.38) or in terms of the cost of the length of care provided (£391 higher on triage;p = 0.77).

Strengths and limitations

We have developed measures using methods involving both service users and staff from mental health services. The measures were developed specifically for acute inpatient services and, therefore, cannot be assumed to be useful for other services. For instance, extensions of the measures are under construction for use in mother and baby units. The strength of the BETTER PATHWAYS and DOORWAYS projects is the large-scale data collection. However, we were testing specific services based in inner city areas and stretching to inner urban areas. It may be that different effects would be found in more rural communities or in different types of inpatient care.

Future work

Our database will be used to develop an understanding of the mediating and moderating factors for improving care quality.

Trial registration

Current Controlled Trials ISRCTN06545047.

Funding

This project was funded by the NIHR Programme Grants for Applied Research programme and will be published in full inProgramme Grants for Applied Research; Vol. 6, No. 7. See the NIHR Journals Library website for further project information.

Quality of life and service satisfaction in outpatients with severe or non-severe mental illness diagnoses

Purpose

Our study investigated quality of life (QoL) in patients with severe or non-severe mental illness diagnoses (SMI and non-SMI) and the association between QoL and service satisfaction measured as patients’ perception of continuity of care (CoC), therapeutic relationship, and unmet service needs.

Methods

We conducted a national cross-sectional survey among 3836 mental health outpatients, of whom 1327 (34.6%) responded. We assessed QoL with the Manchester Short Assessment of Quality of Life (MANSA), CoC with the CONTINUUM, the therapeutic relationship with the Therapeutic Relationship in Community Mental Health Care (STAR-P) and developed a simple scale to measure unmet service needs.

Results

Outpatients with SMI (n = 155) reported significantly better QoL than those with non-SMI (n = 835) (p = 0.003). In both groups, QoL was positively associated with cohabitation (p = 0.007 for non-SMI and p = 0.022 for SMI), good contact with family and friends (p < 0.001 for both) and positive ratings of CoC (p < 0.001 for non-SMI and p = 0.008 for SMI). A positive association between QoL and therapeutic relationship (p = 0.001) and a negative association between QoL and unmet needs for treatment (p = 0.009) and activity (p = 0.005) was only found in the non-SMI group.

Conclusion

Our study highlights the important differences between those with SMI and those with non-SMI in their reported QoL and in the relationship between QoL and service satisfaction, with only non-SMI patients’ QoL influenced by the therapeutic relationship and unmet needs for treatment and activity. It also shows the importance of continuity of care and social factors for good QoL for both groups.

Participatory research: real or imagined

BACKGROUND

Participatory research has as a central tenet that power relations between researcher and researched be reduced. In the last 20 years, a substantial literature has demonstrated the difficulties inherent in this as well as the troublesome nature of certain central concepts.

AIMS

(1) To describe and illustrate a new form of participatory research where the researchers share at least something with the participants in the research. That is, all are users of mental health services. (2) To reflect on the novel form of participatory research in terms of whether it shares, mitigates or avoids some of the difficulties of more traditional forms and to pose the question: what is a mental health community?

RESULTS

The model described is new in that the researchers have a different status than in conventional participatory research. But it is illuminated by and itself illuminates issues of power relations in research and difficulties in reducing that; gatekeepers and the exclusion of crucial groups of service users; the confusion of demographic representativeness with the silencing of marginalized perspectives; coming out of the academic space and the shifting issue of what counts as 'communities' in mental health.

CONCLUSION

The examples given are moderate in scale and relevant to social psychiatry. Yet they may change methods and the definition of participatory research and at the same time be vitiated by but also illuminate dilemmas already identified in the literature albeit in different formations.

Developing a patient-reported experience questionnaire with and for people who use drugs: A community engagement process in Vancouver's Downtown Eastside

People who use drugs (PWUD) frequently have complex health care needs, yet face multiple barriers to accessing services. Involving PWUD in health service design and evaluation can enhance the quality of data collected and ensure policy and practice improvements reflect the expressed needs of the population. However, PWUD remain largely excluded from the evaluation of health services that directly affect their lives, including development of patient-reported experience measures (PREMS) that have gained prominence in health services research and clinical practice. Detailed descriptions of PWUD participation in survey design are notably absent in the literature. In this commentary, we present a case that demonstrates how PWUD can contribute meaningfully to the development of questionnaires that assess patient-reported health care experiences. We describe the development, implementation and outcomes of a process to engage local drug user organizations in the evaluation of a redesign and reorientation of health service delivery in the Downtown Eastside (DTES) neighborhood of Vancouver, Canada. Through this process, participants contributed critical elements to the design of a patient-reported experience measure, including: (1) identifying unmet service needs in the neighborhood; (2) identifying local barriers and facilitators to care; (3) formulating questions on cultural safety; and (4) improving structure, language and clarity of the questionnaire. We highlight lessons learned from the process, reflecting on the strengths, challenges and ethical considerations associated with community-based approaches to questionnaire development. The workshop model presented here illustrates one flexible and promising approach to enabling meaningful participation of PWUD in questionnaire development.

Continuity of care as experienced by mental health service users - a qualitative study

Background

People who struggle with mental health problems can provide valuable insight into understanding and improving the coordination of mental health and welfare services. The aims of the study were to explore service users’ experiences and perceptions of continuity of care within and across services relevant to personal recovery, to elicit which dimensions of continuity of care are most essential to service users, and to generate ideas for improving service users’ experiences of continuity of care.

Methods

In the context of a hermeneutic-phenomenological approach, ten service users at a community mental health centre were interviewed about their experiences of continuity of care in and across services. Eight of these were re-interviewed two years later. A collaborative research approach was adopted. Data were analysed by means of a data-driven stepwise approach in line with thematic analysis.

Results

Following the analysis five themes representing experiences of continuity of care were developed. Each theme ranged from poor to good experiences of continuity of care: Relationship – from experiencing frequent setbacks and anxiety due to breaks in relationships, to feeling safe in an ongoing personal relationship; Timeliness – from experiencing frustrating waiting times with worsening of problems, to getting help when needed; Mutuality – from having a one-sided struggle, to a situation in which both professionals and service users take initiatives; Choice – from not having the opportunity to make practical arrangements within the context of one’s everyday life, to having an array of support options to choose from; Knowledge – from feeling confused and insecure because one does not know what is happening, to feeling safe because one is informed about what is going to happen. Participants provided a range of suggestions for improving experiences of continuity of care.

Conclusions

A discrepancy between aspects of continuity that are essential for service users and their experiences of actual practice was revealed. The valid evidence generated in the present collaborative study therefore offers knowledge to policy makers, professionals and service users that may be of help in their future efforts in orienting primary care, mental health, addiction and welfare services towards recovery.

Electronic supplementary material

The online version of this article (10.1186/s12913-017-2719-9) contains supplementary material, which is available to authorized users.

Concepts, models and measurement of continuity of care in mental health services: A systematic appraisal of the literature

WHAT IS KNOWN ON THE SUBJECT?: Care continuity is considered to be a cornerstone of modern mental health care. As community mental health services have become increasingly fragmented and complex, the crucial criterion for best quality care has become the degree to which treatment delivered by separate services and professionals is continuous and well coordinated. However, clarification of the key elements of continuity has proved challenging and a consensus has not been reached. Recent research has shown significant levels of variation in the quality of care coordination across England and Wales, with potentially detrimental consequences for individuals. WHAT THIS PAPER ADDS TO EXISTING KNOWLEDGE?: Studies on care continuity identified in this review are grouped into three categories: studies defining concepts of care continuity, studies providing models of continuity and studies describing development of questionnaires about care continuity. There are many similarities and parallels between concepts of continuity described in the studies under review. Therefore, there is potential for developing a consensus on the nature of care continuity as a multidimensional concept. The priority placed upon the patient's experience of care continuity is identified as a major focus in these studies. WHAT ARE THE IMPLICATIONS FOR PRACTICE?: A consensus on the nature of care continuity would benefit both theory and practice in mental health nursing. It would provide a firmer foundation for new research seeking to improve continuity for people using services, and enable mental health nurses working as care coordinators to have a better understanding of the elements of their role that are most effective.

ABSTRACT

Introduction The increased complexity of community mental health services, and associated fragmentation of traditional dividing lines between services, has underscored the centrality of care continuity and coordination in modern mental health care. However, clarification of the key features of the care continuity concept has proved difficult and a consensus has not been reached. Aim/Question This review draws together and critically examines latest evidence concerning concepts, models and scales based on a multidimensional understanding of care continuity. Method Databases ASSIA, PubMed, MEDLINE and Cochrane were searched for papers dating from January 2005 to July 2016, of which 21 articles met the inclusion criteria. These were subjected to quality appraisal based on CASP and COSMIN checklists. Studies were grouped into three thematic categories describing concepts, models and scales of care continuity. Results/Discussion Synthesis indicated correspondence between independent, multidimensional models of care continuity, providing greater clarity regarding the essential features of the concept. Association, although not causation, between care continuity factors and health outcomes is supported by current evidence. Implications for practice Clarification of care continuity in mental health services may enable nurses working as care coordinators to develop a better understanding of key elements of their role, and provide guidance for future service development.

Development and Preliminary Validation of the Scale for Evaluation of Psychiatric Integrative and Continuous Care-Patient's Version

This pilot study aimed to evaluate and examine an instrument that integrates relevant aspects of cross-sectoral (in- and outpatients) mental health care, is simply to use and shows satisfactory psychometric properties. The development of the scale comprised literature research, held 14 focus groups and 12 interviews with patients and health care providers, item-pool generation, content validation by a scientific expert panel, and face validation by 90 patients. The preliminary scale was tested on 385 patients across seven German hospitals with cross-sectoral mental health care (CSMHC) as part of their treatment program. Psychometric properties of the scale were evaluated using genuine and transformed data scoring. To check reliability and postdictive validity of the scale, Cronbach's α coefficient and multivariable linear regression were used. This development process led to the development of an 18-item scale called the "Scale for Evaluation of Psychiatric Integrative and Continuous Care (SEPICC)" with a two-point and five-point response options. The scale consists of two sections. The first section assesses the presence or absence of patients' experiences with various CSMHC' relevant components such as home treatment, flexibility of treatments' switching, case management, continuity of care, cross-sectoral therapeutic groups, and multidisciplinary teams. The second section evaluates the patients' opinions about these relevant components. Using raw and transformed scoring resulted into comparable results. However, data distribution using transformed scoring showed a smaller deviation from normality. For the overall scale, the Cronbach's α coefficient was 0.82. Self-reported experiences with relevant components of the CSMHC were positively associated with the patients approval of these components. In conclusion, the new scale provides a good starting point for further validation. It can be used as a tool to evaluate CSMHC. Methodologically, using transformed data scoring appeared to be preferable because of a smaller deviation from normality and a higher reliability measured by Cronbach's α.

The CORE Service Improvement Programme for mental health crisis resolution teams: study protocol for a cluster-randomised controlled trial

BACKGROUND

As an alternative to hospital admission, crisis resolution teams (CRTs) provide intensive home treatment to people experiencing mental health crises. Trial evidence supports the effectiveness of the CRT model, but research suggests that the anticipated reductions in inpatient admissions and increased user satisfaction with acute care have been less than hoped for following the scaling up of CRTs nationally in England, as mandated by the National Health Service (NHS) Plan in 2000. The organisation and service delivery of the CRTs vary substantially. This may reflect the lack of a fully specified CRT model and the resources to enhance team model fidelity and to improve service quality. We will evaluate the impact of a CRT service improvement programme over a 1-year period on the service users' experiences of care, service use, staff well-being, and team model fidelity.

METHODS/DESIGN

Twenty-five CRTs from eight NHS Trusts across England will be recruited to this cluster-randomised trial: 15 CRTs will be randomised to receive the service improvement programme over a 1-year period, and ten CRTs will not receive the programme. Data will be collected from 15 service users and all clinical staff from each participating CRT at baseline and at the end of the intervention. Service use data will be collected from the services' electronic records systems for two 6-month periods: the period preceding and the period during months 7-12 of the intervention. The study's primary outcome is service user satisfaction with CRT care, measured using a client satisfaction questionnaire. Secondary outcomes include the following: perceived continuity of care, hospital admission rates and bed use, rates of readmission to acute care following CRT support, staff morale, job satisfaction, and general health. The adherence of the services to a model of best practice will be assessed at baseline and follow-up. Outcomes will be compared between the intervention and control teams, adjusting for baseline differences and participant characteristics using linear random effects modelling. Qualitative investigations with participating CRT managers and staff and programme facilitators will explore the experiences of the service improvement programme.

DISCUSSION

Our trial will show whether a theoretically underpinned and clearly defined package of resources are effective in supporting service improvement and improving outcomes for mental health crisis resolution teams.

TRIAL REGISTRATION

Current Controlled Trials ISRCTN47185233.

Defining continuity of care from the perspectives of mental health service users and professionals: an exploratory, comparative study

Background

Continuity of care (COC) is central to the organization and delivery of mental health services. Traditional definitions have excluded service users, and this lack of involvement has been linked to poor conceptual clarity surrounding the term. Consequently, very little is known about the differences and similarities in the conceptualization of COC by mental health service users and professionals.

Objective

To explore and compare mental health service users’ and professionals’ definitions of COC.

Methods

Using an exploratory, qualitative design, five focus groups with 32 service users each met twice. Data were analysed thematically to generate a service user‐defined model of COC. In a cross‐sectional survey, health and social care professionals (n = 184) defined COC; responses were analysed thematically. Service user and professional definitions were conceptually mapped and compared to identify similarities and differences.

Results

There was crossover between the service user and professional derived models of COC. Both contained temporal, quality, systemic, staff, hospital and needs‐related elements of COC. Service users prioritized access, information, peer support and avoiding services; health professionals most frequently referred to staff, cross‐sectional and temporal COC. Service users alone identified service avoidance, peer support and day centres as COC elements; professionals alone identified cross‐sectional working.

Conclusions

Important similarities and differences exist in service user and professional conceptualizations of COC. Further research is necessary to explore these differences, prior to integrating service user and professional perspectives in a validated COC framework which could enable the development and evaluation of interventions to improve COC, informing policy and practice.

Expectations of new treatment in rheumatoid arthritis: developing a patient-generated questionnaire

BACKGROUND

Service-user partnerships in research exist in mental health, but there have been few advances in other disciplines, apart from cancer.

OBJECTIVES

To develop a patient-generated expectancy measure for new treatments in rheumatoid arthritis (RA), using a participatory method.

METHOD

Stage 1: three repeated focus groups and two expert panels with patients with RA conducted by a patient researcher to generate items for the draft questionnaire. Stage 2: feasibility study of draft scale with consecutive outpatient attendees.

RESULTS

Patients identified 21 dimensions of new treatment expectations, grouped into (i) physical, (ii) psycho-social and (iii) expectations relating to the impact of treatment. This resulted in a draft instrument assessed in a feasibility study.

DISCUSSION AND CONCLUSION

The participatory research method was useful in involving patients actively in research and to produce collaboratively a feasible, valid and acceptable measure in RA. The scale will be included in a longitudinal observational study, with newly diagnosed patients, to assess (i) whether the new scale demonstrates sensitivity to change for expectations when receiving new treatment and (ii) participants' completion rate of the new scale compared with five instruments included in the future study.

The role of fear in mental health service users' experiences: a qualitative exploration

PURPOSE

Although studies suggest that fear plays an important role in shaping mental health service users' experiences, evidence is patchy and the contexts, conditions and consequences of fear have rarely been researched. This paper explores the role of fear in adult mental health service users' lives and describes its implications for mental health services.

METHODS

Four community health service user focus groups (N32) were held. Each group was reconvened after 7-14 days. An initial thematic analysis generated a service user definition of continuity of care (reported elsewhere). A Straussian 'secondary grounded theory analysis' was conducted to gain a deeper understanding of participants' experiences.

RESULTS

'Being afraid' was identified as a core process, with power and control, and stigma and discrimination found to have explanatory power in determining how and why fear manifests. Consequences included distrusting staff, cooperating reluctantly, learning reticence, delaying help-seeking, avoiding services, feeling unsafe in the community and avoiding exposure as a service user.

CONCLUSIONS

Our model suggests that fear plays a substantial role in the lives of adult mental health service users. This has particular consequences for therapeutic relationships, engagement with services and engagement with the wider community. This lack of engagement is associated with adverse outcomes. Further research into the role of fear and the factors that mediate against it is warranted.

The challenge of change in acute mental health services: measuring staff perceptions of barriers to change and their relationship to job status and satisfaction using a new measure (VOCALISE)

Background

Health services are subject to frequent changes, yet there has been insufficient research to address how staff working within these services perceive the climate for implementation. Staff perceptions, particularly of barriers to change, may affect successful implementation and the resultant quality of care. This study measures staff perceptions of barriers to change in acute mental healthcare. We identify whether occupational status and job satisfaction are related to these perceptions, as this might indicate a target for intervention that could aid successful implementation. As there were no available instruments capturing staff perceptions of barriers to change, we created a new measure (VOCALISE) to assess this construct.

Methods

All nursing staff from acute in-patient settings in one large London mental health trust were eligible. Using a participatory method, a nurse researcher interviewed 32 staff to explore perceptions of barriers to change. This generated a measure through thematic analyses and staff feedback (N = 6). Psychometric testing was undertaken according to standard guidelines for measure development (N = 40, 42, 275). Random effects models were used to explore the associations between VOCALISE, occupational status, and job satisfaction (N = 125).

Results

VOCALISE was easy to understand and complete, and showed acceptable reliability and validity. The factor analysis revealed three underlying constructs: ‘confidence,’ ‘de-motivation’ and ‘powerlessness.’ Staff with negative perceptions of barriers to change held more junior positions, and had poorer job satisfaction. Qualitatively, nursing assistants expressed a greater sense of organisational unfairness in response to change.

Conclusions

VOCALISE can be used to explore staff perceptions of implementation climate and to assess how staff attitudes shape the successful outcomes of planned changes. Negative perceptions were linked with poor job satisfaction and to those occupying more junior roles, indicating a negative climate for implementation in those groups. Staff from these groups may therefore need special attention prior to implementing changes in mental health settings.

Impact of patient involvement in mental health research: longitudinal study

BACKGROUND

It is deemed good practice to involve patients routinely in research but no study has investigated the practical benefits, particularly to successful recruitment.

AIMS

To identify whether patient involvement is associated with study success.

METHOD

All studies listed on the Mental Health Research Network (MHRN) portfolio database (n = 374) were interrogated using logistic regression, ANOVA and Pearson's correlation to identify associations with study characteristics, funding bodies and recruitment success.

RESULTS

Patient involvement increased over time although in some areas of research it was limited. Some funders, especially the National Institute for Health Research (NIHR), had more associated patient involvement than others. Studies that involved patients to a greater extent were more likely to have achieved recruitment targets (χ(2) = 4.58, P<0.05), defined as reaching at least 90% of the target.

CONCLUSIONS

This is the first time associations with study success have been identified for patient involvement. Researchers might now consider ways to involve patients more comprehensively as this is associated with study success. Further research is needed to explore this finding.

Continuity of care for carers of people with severe mental illness: results of a longitudinal study

INTRODUCTION

Continuity of care has been demonstrated to be important for service users and carer groups have voiced major concerns over disruptions of care. We aimed to assess the experienced continuity of care in carers of patients with both psychotic and non-psychotic disorders and explore its association with carer characteristics and psychological well-being.

METHODS

Friends and relatives caring for two groups of service users in the care of community mental health teams (CMHTs), 69 with psychotic and 38 with non-psychotic disorders, were assessed annually at three and two time points, respectively. CONTINUES, a measure specifically designed to assess continuity of care for carers themselves, was utilized along with assessments of psychological well-being and caregiving.

RESULTS

One hundred and seven carers participated. They reported moderately low continuity of care. Only 22 had had a carer's assessment and just under a third recorded psychological distress on the GHQ. For those caring for people with psychotic disorders, reported continuity was higher if the carer was male, employed, lived with the user and had had a carer's assessment; for those caring for people with non-psychotic disorders, it was higher if the carer was from the service user's immediate family, lived with them and had had a carer's assessment.

CONCLUSION

The vast majority of the carers had not had a carer's assessment provided by the CMHT despite this being a clear national priority and being an intervention with obvious potential to increase carers' reported low levels of continuity of care. Improving continuity of contact with carers may have an important part to play in the overall improvement of care in this patient group and deserves greater attention.

Patient and public involvement in health research: ethical imperative and/or radical challenge?

Patient and public involvement in health research, including mental health research, is promoted by research funders in England. However, it is poorly conceptualised. One argument is that patient and public involvement in research is an ethical imperative because those who research is for should have a stake in how it is done. This could be developed through concepts of citizenship and democratic science. More strongly, it can be argued that changing the knowledge producers will change knowledge itself. Starting with feminist standpoint epistemology, it is argued that a political conceptualisation best captures the new knowledge that marginalised health groups can produce.

Continuity of care for people with psychotic illness: its relationship to clinical and social functioning

BACKGROUND

The relationship between continuity of care and user characteristics or outcomes has rarely been explored. The ECHO study operationalized and tested a multi-axial definition of continuity of care, producing a seven-factor model used here.

AIMS

To assess the relationship between user characteristics and established components of continuity of care, and the impact of continuity on clinical and social functioning.

METHODS

The sample comprised 180 community mental health team users with psychotic disorders who were interviewed at three annual time-points, to assess their experiences of continuity of care and clinical and social functioning. Scores on seven continuity factors were tested for association with user-level variables.

RESULTS

Improvement in quality of life was associated with better Experience & Relationship continuity scores (better user-rated continuity and therapeutic relationship) and with lower Meeting Needs continuity factor scores. Higher Meeting Needs scores were associated with a decrease in symptoms.

CONCLUSION

Continuity is a dynamic process, influenced significantly by care structures and organizational change.

Continuity of care for people with non-psychotic disorders

BACKGROUND

Service users with non-psychotic disorders are rarely studied. How continuity of care functions for this group is unknown.

AIMS

To compare users of community mental health teams with non-psychotic disorders to those with psychotic disorders in terms of demographic and illness characteristics, continuity of care and clinical and social functioning.

METHODS

Service users with non-psychotic disorders (N = 98) were followed up for one year and compared to 180 service users with psychotic disorders. Continuity of care factors were tested for association with user, illness and service variables.

RESULTS

Service users with non-psychotic disorders experienced more care transitions, but there were no differences in team practices in relation to these two different groups.

CONCLUSION

The underlying concepts of continuity of care derived from users with psychotic disorders appear to be meaningful for users with non-psychotic disorders. Their greater likelihood of experiencing disruptive and distressing care transitions needs to be addressed.

Patient-reported outcome measures: are they patient-generated, patient-centred or patient-valued?

BACKGROUND

In the past two decades, there has been a growing interest in the development of a more patient-centred approach to assessing treatment outcomes. This interest has resulted in the increasing use of patient-reported outcome measures (PROMs) in both clinical trials and usual clinical practice.

AIMS

To briefly discuss the paucity of efficacy and effectiveness studies in the field of mental health (exemplified by schizophrenia, depression and opioid dependence) that significantly incorporate the patient's perspective. The limited concordance between the perspectives of patients and clinicians in outcome assessment is also addressed. Finally, we propose a new PROM classification system based on the degree to which these instruments incorporate the patient's perspective.

CONCLUSIONS

PROMs may differ little from traditional instruments unless they truly incorporate the patient's perspective and not just the perspectives of clinicians and researchers. Efforts to develop new PROMs that provide a more patient-centred outcome assessment should use qualitative and participatory methods to capture and incorporate patient perspectives and values.

We are bitter, but we are better off: case study of the implementation of an electronic health record system into a mental health hospital in England

BACKGROUND

In contrast to the acute hospital sector, there have been relatively few implementations of integrated electronic health record (EHR) systems into specialist mental health settings. The National Programme for Information Technology (NPfIT) in England was the most expensive IT-based transformation of public services ever undertaken, which aimed amongst other things, to implement integrated EHR systems into mental health hospitals. This paper describes the arrival, the process of implementation, stakeholders' experiences and the local consequences of the implementation of an EHR system into a mental health hospital.

METHODS

Longitudinal, real-time, case study-based evaluation of the implementation and adoption of an EHR software (RiO) into an English mental health hospital known here as Beta. We conducted 48 in-depth interviews with a wide range of internal and external stakeholders, undertook 26 hours of on-site observations, and obtained 65 sets of relevant documents from various types relating to Beta. Analysis was both inductive and deductive, the latter being informed by the 'sociotechnical changing' theoretical framework.

RESULTS

Many interviewees perceived the implementation of the EHR system as challenging and cumbersome. During the early stages of the implementation, some clinicians felt that using the software was time-consuming leading to the conclusion that the EHR was not fit for purpose. Most interviewees considered the chain of deployment of the EHR-which was imposed by NPfIT-as bureaucratic and obstructive, which restricted customization and as a result limited adoption and use. The low IT literacy among users at Beta was a further barrier to the implementation of the EHR. This along with inadequate training in using the EHR software led to resistance to the significant cultural and work environment changes initiated by EHR. Despite the many challenges, Beta achieved some early positive results. These included: the ability to check progress notes and monitor staff activities; improving quality of care as a result of real-time, more accurate and shared patient records across the hospital; and potentially improving the safety of care through increasing the legibility of the clinical record.

CONCLUSIONS

Notwithstanding what was seen as a turbulent, painful and troublesome implementation of the EHR system, Beta achieved some early clinical and managerial benefits from implementing EHRs. The 'sociotechnical changing' framework helped us go beyond the dichotomy of success versus failure, when conducting the evaluation and interpreting findings. Given the scope for continued development, there are good reasons, we argue, to scale up the intake of EHR systems by mental health care settings. Software customization and appropriate support are essential to work EHR out in such organizations.

Trust, choice and power in mental health care: experiences of patients with psychosis

BACKGROUND

Trust, choice and power are critical issues in clinical practice, public policies and a post-modern understanding of mental health care. We aimed to investigate the experiences and attitudes of patients with psychosis in relation to trust, choice and power.

METHOD

We conducted 20 in-depth interviews with patients with psychotic disorders in care of NHS services. The interviews were subjected to thematic analysis.

DISCUSSION

Patients discussed aspects of their care in terms of dimensions that enhance or undermine trust, choice and power. Two interpretive themes emerged from this data. First, patients perceive the need for a shifting balance of power, according to the severity of their illness and their own experience of care, but feel that threats of coercion and neglect disable them. Second, they appreciate the expertise of clinicians, but particularly value 'the personal touch' that goes beyond this expertise, including personal disclosure about their own lives, common acts of kindness and conversation outside clinical matters. Patients view trust as a two-way process with responsibility shared between patient and clinician.

CONCLUSIONS

The active involvement of patients with psychosis in their individual care may be strengthened, particularly when they are not acutely ill and have more experience of their illness. While patients value expertise and respect in interactions with clinicians, they also appreciate a 'personal touch', which may go beyond current notions of professionalism.

Measurement properties of questionnaires measuring continuity of care: a systematic review

BACKGROUND

Continuity of care is widely acknowledged as a core value in family medicine. In this systematic review, we aimed to identify the instruments measuring continuity of care and to assess the quality of their measurement properties.

METHODS

We did a systematic review using the PubMed, Embase and PsycINFO databases, with an extensive search strategy including 'continuity of care', 'coordination of care', 'integration of care', 'patient centered care', 'case management' and its linguistic variations. We searched from 1995 to October 2011 and included articles describing the development and/or evaluation of the measurement properties of instruments measuring one or more dimensions of continuity of care (1) care from the same provider who knows and follows the patient (personal continuity), (2) communication and cooperation between care providers in one care setting (team continuity), and (3) communication and cooperation between care providers in different care settings (cross-boundary continuity). We assessed the methodological quality of the measurement properties of each instrument using the COSMIN checklist.

RESULTS

We included 24 articles describing the development and/or evaluation of 21 instruments. Ten instruments measured all three dimensions of continuity of care. Instruments were developed for different groups of patients or providers. For most instruments, three or four of the six measurement properties were assessed (mostly internal consistency, content validity, structural validity and construct validity). Six instruments scored positive on the quality of at least three of six measurement properties.

CONCLUSIONS

Most included instruments have problems with either the number or quality of its assessed measurement properties or the ability to measure all three dimensions of continuity of care. Based on the results of this review, we recommend the use of one of the four most promising instruments, depending on the target population Diabetes Continuity of Care Questionnaire, Alberta Continuity of Services Scale-Mental Health, Heart Continuity of Care Questionnaire, and Nijmegen Continuity Questionnaire.

Views of the Therapeutic Environment (VOTE): stakeholder involvement in measuring staff perceptions of acute in-patient care

BACKGROUND

The impact of staff perceptions of daily work pressures on burnout requires further exploration because both issues may be adversely affecting the quality of staff interactions with service users.

OBJECTIVES

To use a model of 'stakeholder involvement' to develop and test a self-report instrument capturing nursing staff perceptions of the daily pressures of working in acute in-patient mental health wards.

DESIGN

Measure development followed a participatory methodology, followed by psychometric testing of the new measure of the daily pressures of working on an acute ward (VOTE).

SETTINGS

Acute in-patient wards in an inner London mental health trust.

PARTICIPANTS

All nursing staff from acute in-patient settings are eligible for this study. In total 376 staff (qualified nurses and healthcare assistants) were involved at the various stages of measure development and testing.

METHODS

Focus groups of nursing staff met to discuss their perceptions of acute wards. A twenty item measure was generated through thematic analysis of these data and staff feedback. Reliability and validity were tested and the effects of demographic characteristics on VOTE, and VOTE on burnout were examined.

RESULTS

Staff found VOTE easy to understand and complete. Test-retest reliability and the internal consistency of the measure and subscales were good. A test of criterion validity showed that staff with negative perceptions of the daily pressures of the working on an acute ward also had negative perceptions of job satisfaction and high levels of burnout. Regression modelling showed that VOTE had a significant effect on burnout.

CONCLUSIONS

VOTE is a concise measure which combines aspects of care provision as well as the organisational and professional stressors of acute ward working. VOTE can be used to further explore how staff perceptions of the daily pressures of acute ward working affect the quality of care delivered.

Understanding service user-defined continuity of care and its relationship to health and social measures: a cross-sectional study

BACKGROUND

Despite the importance of continuity of care [COC] in contemporary mental health service provision, COC lacks a clearly agreed definition. Furthermore, whilst there is broad agreement that definitions should include service users' experiences, little is known about this. This paper aims to explore a new construct of service user-defined COC and its relationship to a range of health and social outcomes.

METHODS

In a cross sectional study design, 167 people who experience psychosis participated in structured interviews, including a service user-generated COC measure (CONTINU-UM) and health and social assessments. Constructs underlying CONTINU-UM were explored using factor analysis in order to understand service user-defined COC. The relationships between the total/factor CONTINU-UM scores and the health and social measures were then explored through linear regression and an examination of quartile results in order to assess whether service user-defined COC is related to outcome.

RESULTS

Service user-defined COC is underpinned by three sub-constructs: preconditions, staff-related continuity and care contacts, although internal consistency of some sub-scales was low. High COC as assessed via CONTINU-UM, including preconditions and staff-related COC, was related to having needs met and better therapeutic alliances. Preconditions for COC were additionally related to symptoms and quality of life. COC was unrelated to empowerment and care contacts unrelated to outcomes. Service users who had experienced a hospital admission experienced higher levels of COC. A minority of service users with the poorest continuity of care also had high BPRS scores and poor quality of life.

CONCLUSIONS

Service-user defined continuity of care is a measurable construct underpinned by three sub-constructs (preconditions, staff-related and care contacts). COC and its sub-constructs demonstrate a range of relationships with health and social measures. Clinicians have an important role to play in supporting service users to navigate the complexities of the mental health system. Having experienced a hospital admission does not necessarily disrupt the flow of care. Further research is needed to test whether increasing service user-defined COC can improve clinical outcomes. Using CONTINU-UM will allow researchers to assess service users' experiences of COC based on the elements that are important from their perspective.

The association between continuity of care in the community and health outcomes: a population-based study

BACKGROUND

The study goal was to assess indices of continuity of care in the primary care setting and their association with health outcomes and healthcare services utilization, given the reported importance of continuity regarding quality of care and healthcare utilization.

METHODS

The study included a random sample of enrollees from Clalit Health Services 19 years-of-age or older who visited their primary care clinic at least three times in 2009. Indices of continuity of care were computed, including the Usual Provider Index (UPC), Modified Modified Continuity Index (MMCI), Continuity of Care Index (COC), and Sequential Continuity (SECON). Quality measures of preventive medicine and healthcare services utilization and their costs were assessed as outcomes.

RESULTS

1,713 randomly sampled patients were included in the study (mean age: 48.9 ± 19.2, 42% males). Continuity of care indices were: UPC: 0.75; MMCI: 0.81; COC: 0.67; SECON: 0.70. After controlling for patient characteristics in a multivariate analysis, a statistically significant association was found between higher values of UPC, COC, and SECON and a decrease in the number and cost of ED visits. Higher MMCI values were associated with a greater number and higher costs of medical consultation visits. Continuity of care indices were associated with BMI measurements, and inversely associated with blood pressure measurements. No association was found with other quality indicators, e.g., screening tests for cancer.

CONCLUSIONS

Several continuity of care indices were associated with decreased number and costs of ED visits. There were both positive and negative associations of continuity of care indices with different aspects of healthcare utilization. The relatively small effects of continuity might be due to the consistently high levels of continuity in Clalit Health Services.

VOICE: developing a new measure of service users' perceptions of inpatient care, using a participatory methodology

BACKGROUND

Service users express dissatisfaction with inpatient care and their concerns revolve around staff interactions, involvement in treatment decisions, the availability of activities and safety. Traditionally, satisfaction with acute care has been assessed using measures designed by clinicians or academics.

AIMS

To develop a patient-reported outcome measure of perceptions of acute care. An innovative participatory methodology was used to involve services users throughout the research process.

METHOD

A total of 397 participants were recruited for the study. Focus groups of service users were convened to discuss their experiences and views of acute care. Service user researchers constructed a measure from the qualitative data, which was validated by expert panels of service users and tested for its psychometric properties.

RESULTS

Views on Inpatient Care (VOICE) is easy to understand and complete and therefore is suitable for use by service users while in hospital. The 19-item measure has good validity and internal and test-retest reliability. Service users who have been compulsorily admitted have significantly worse perceptions of the inpatient environment.

CONCLUSIONS

A participatory methodology has been used to generate a self-report questionnaire measuring service users' perceptions of acute care. VOICE encompasses the issues that service users consider most important and has strong psychometric properties.

Rapid progress or lengthy process? Electronic personal health records in mental health

A major objective of many healthcare providers is to increase patients' participation in their own care. The introduction of electronic personal health records (ePHRs) may help to achieve this. An ePHR is an electronic database of an individual's health information, accessible to and maintained by the patient. ePHRs are very much in vogue, with an increasing number of studies reporting their potential utility as well as cost. However, the vast majority of these studies focus on general healthcare. Little attempt has been made to document the specific problems which might occur throughout the implementation of ePHRs in mental health. This review identifies such concerns through an electronic search of the literature. Several potential difficulties are highlighted and addressed, including access to information technology, identifying relevant populations and the handling of sensitive information. Special attention is paid to the concept of 'empowerment' and what this means in relation to ePHRs.

A model for developing outcome measures from the perspectives of mental health service users

It is becoming increasingly recognized that conventionally derived outcome measures in mental health research are problematic. This is both because of the methodology used and because a 'good' outcome is framed from the perspective of clinicians and researchers. This paper describes a methodology for developing outcome measures for use in large studies entirely from the perspective of mental health service users. It is a mixed methods model starting with a participatory and qualitative methodology and proceeding to psychometric testing. At all stages, the researchers are themselves mental health service users. In the first phase of the model, focus groups are convened comprising people who have received the treatment or service being measured. The focus groups meet twice resulting in a draft mixed-methods questionnaire devised from thematic analysis of the focus group data. This is then taken to expert panels, again comprising individuals who have received the treatment or service being evaluated for refinement. Following this, a feasibility study is conducted with N ∼ 50 participants and changes made iteratively to the questionnaire in light of feedback. The final measure is subject to psychometric testing both to ensure it is robust and to explore similarities and differences with conventionally derived measures.

Reported stigma and discrimination by people with a diagnosis of schizophrenia

AIMS

This article examines the extent of stigma and discrimination as reported by people with a diagnosis of schizophrenia. The hypothesis is that when people express in their own words the discrimination they experience such discrimination will be found to be widespread.

METHODS

Seventy-five people with a diagnosis of schizophrenia from 15 different countries were interviewed with a mixed methods instrument to assess reported discrimination. The data were analysed for frequency counts and then a thematic analysis was performed. A conceptual map is provided.

RESULTS

The study was a cross-cultural one but, contrary to expectations, few transnational differences were found. The main hypothesis was supported. Conversely, we found that when participants reported 'positive discrimination', this could as easily be conceptualised as being treated similarly to how others in society would expect to be treated.

CONCLUSION

Negative discrimination is ubiquitous and sometimes connotatively very strong, with reports of humiliation and abuse. 'Positive discrimination' conversely indicates that people with a mental illness diagnosis expect discrimination and are grateful when it does not occur. The literature on self-stigma is discussed and found wanting. Similarly, the theory that contact with mentally ill people reduces stigma and discrimination is not fully supported by our results.

The development of a tool to measure service user satisfaction with in-patient forensic services: The Forensic Satisfaction Scale

BACKGROUND

Service-user satisfaction helps determine the quality of services. No valid measure of service-user satisfaction in forensic mental health settings has been developed.

AIMS

To develop and validate a scale designed to measure satisfaction with forensic mental health services.

METHOD

Participants were from three forensic mental health units. Items generated from focus groups were developed into a self-report scale and factor analysed. This was administered with a non-forensic satisfaction self-report scale, the Verona Service Satisfaction Scale (VSSS) and assessed for internal consistency and validity.

RESULTS

A 60-item scale was produced comprising seven subscales recording moderate to high levels of internal consistency and concurrent validity with the VSSS.

CONCLUSIONS

The scale is a promising instrument for assessing service-user satisfaction with forensic mental health in-patient services.