Measuring patient-reported outcomes in psychosis: conceptual and methodological review

Psychometric Assessment of an Item Bank for Adaptive Testing on Patient-Reported Experience of Care Environment for Severe Mental Illness: Validation Study

BACKGROUND

The care environment significantly influences the experiences of patients with severe mental illness and the quality of their care. While a welcoming and stimulating environment enhances patient satisfaction and health outcomes, psychiatric facilities often prioritize staff workflow over patient needs. Addressing these challenges is crucial to improving patient experiences and outcomes in mental health care.

OBJECTIVE

This study is part of the Patient-Reported Experience Measure for Improving Quality of Care in Mental Health (PREMIUM) project and aims to establish an item bank (PREMIUM-CE) and to develop computerized adaptive tests (CATs) to measure the experience of the care environment of adult patients with schizophrenia, bipolar disorder, or major depressive disorder.

METHODS

We performed psychometric analyses including assessments of item response theory (IRT) model assumptions, IRT model fit, differential item functioning (DIF), item bank validity, and CAT simulations.

RESULTS

In this multicenter cross-sectional study, 498 patients were recruited from outpatient and inpatient settings. The final PREMIUM-CE 13-item bank was sufficiently unidimensional (root mean square error of approximation=0.082, 95% CI 0.067-0.097; comparative fit index=0.974; Tucker-Lewis index=0.968) and showed an adequate fit to the IRT model (infit mean square statistic ranging between 0.7 and 1.0). DIF analysis revealed no item biases according to gender, health care settings, diagnosis, or mode of study participation. PREMIUM-CE scores correlated strongly with satisfaction measures (r=0.69-0.78; P<.001) and weakly with quality-of-life measures (r=0.11-0.21; P<.001). CAT simulations showed a strong correlation (r=0.98) between CAT scores and those of the full item bank, and around 79.5% (396/498) of the participants obtained a reliable score with the administration of an average of 7 items.

CONCLUSIONS

The PREMIUM-CE item bank and its CAT version have shown excellent psychometric properties, making them reliable measures for evaluating the patient experience of the care environment among adults with severe mental illness in both outpatient and inpatient settings. These measures are a valuable addition to the existing landscape of patient experience assessment, capturing what truly matters to patients and enhancing the understanding of their care experiences.

TRIAL REGISTRATION

ClinicalTrials.gov NCT02491866; https://clinicaltrials.gov/study/NCT02491866.

Patient-reported outcome measures in early psychosis: A cross-cultural, longitudinal examination of the self-reported health and self-reported mental health measures in Chennai, India and Montreal, Canada

OBJECTIVE

Despite their acknowledged value, patient-reported outcome measures (PROMs) are infrequently used in psychosis, particularly in low-and middle-income countries. We compared ratings on two single-item PROMs, Self-Rated Health (SRH) and Self-Rated Mental Health (SRMH), of persons receiving similar early psychosis services in Chennai, India and Montreal, Canada. We hypothesized greater improvements in SRH and SRMH in the Chennai (compared to the Montreal) sample.

METHODS

Participants (Chennai N = 159/168 who participated in the larger study; Montreal N = 74/165 who participated in the larger study) completed the SRH and SRMH during at least two out of three timepoints (entry, months 12 and 24). Repeated measures proportional odds logistic regressions examined the effects of time (baseline to month 24), site, and relevant baseline (e.g., gender) and time-varying covariates (i.e., symptoms) on SRH and SRMH scores.

RESULTS

SRH (but not SRMH) scores significantly differed between the sites at baseline, with Chennai patients reporting poorer health (OR: 0.33; CI: 0.18, 0.63). While Chennai patients reported similar significant improvements in their SRH (OR: 7.03; CI: 3.13; 15.78) and SRMH (OR: 2.29, CI: 1.03, 5.11) over time, Montreal patients only reported significant improvements in their SRMH. Women in Chennai (but not Montreal) reported lower mental health than men. Higher anxiety and longer durations of untreated psychosis were associated with poorer SRH and SRMH, while negative symptoms were associated with SRH.

CONCLUSIONS

As hypothesized, Chennai patients reported greater improvements in health and mental health. The marked differences between health and mental health in Montreal, in contrast to the overlap between the two in Chennai, aligns with previous findings of clearer distinctions between mind and body in Western societies. Cross-context (e.g., anxiety) and context-specific (e.g., gender) factors influence patients' health perceptions. Our results highlight the value of integrating simple PROMs in early psychosis.

The Discrepancy between Subjective and Objective Evaluations of Cognitive and Functional Ability among People with Schizophrenia: A Systematic Review

BACKGROUND

An important aspect of recovery in schizophrenia relates to one's subjective, lived experience. Self-report is a subjective measurement method with yet-uncertain utility in the assessment of functioning among individuals diagnosed with schizophrenia-spectrum disorder. No review to date has comprehensively synthesized existing research to evaluate the degree of correspondence, or lack thereof, between subjective and objective assessments of cognitive and everyday functioning, nor how extant data can inform the use of self-reported information in treatment and research.

METHODS

A systematic review was completed to provide a broad perspective of the literature on this topic. Relevant manuscripts were identified via a search strategy using key terms in PubMed and PsycINFO and a review of manuscript bibliographies. Twenty-six studies met the inclusion criteria.

RESULTS

These studies show minimal to modest associations between subjective assessments of cognition and everyday functioning and objective assessments of these domains, including informant reports and neuropsychological and behavioral measures. Individuals with schizophrenia appear to overestimate their functioning when compared to objective measures. Depression and greater cognitive ability tend to predict greater correspondence between subjective and objective assessments of cognition and everyday functioning.

DISCUSSION

This review discusses how we might understand the low correspondence between subjective and objective measures of functioning and provides recommendations for using and eliciting self-reported information in the pursuit of recovery-centered practices.

Inspire self report scale (ISRS): A feasibility study of a Novel self report scale for people with schizophrenia spectrum disorders

Clinician-rated symptom scales are the current standard for outcome measures in Schizophrenia Spectrum Disorders (SSD) research. There has been growing interest in the development of self-report measures for people with SSD to support measurement-based care and inclusive research. We developed the Inspire Self Report Scale (ISRS), which measures the current magnitude of well-being, mood symptoms, psychosis, negative symptoms and cognition using 10 questions on a Likert or Visual analogue scale (VAS). The main aim of this report was to investigate the correlation and concordance between patient self-report and clinician ratings on the ISRS during a clinical encounter. When ratings were discordant, we sought to identify whether the participant's or psychiatrist's rating was more accurate. The results indicated a moderately strong statistically significant correlation between participant and clinician ratings. There was a moderate concordance between participant and clinician ratings on the ISRS. When the results were discordant, the participant ratings were assessed to be more accurate than the clinician rating over 70% of the time. The ISRS has distinct utility compared to existing scales due to the measurement of present symptom severity, capturing multiple clinical domains, and time efficiency and ease of use. Thus, it may be useful in clinical and research settings.

Novel digital methods for gathering intensive time series data in mental health research: scoping review of a rapidly evolving field

Recent technological advances enable the collection of intensive longitudinal data. This scoping review aimed to provide an overview of methods for collecting intensive time series data in mental health research as well as basic principles, current applications, target constructs, and statistical methods for this type of data.In January 2021, the database MEDLINE was searched. Original articles were identified that (1) used active or passive data collection methods to gather intensive longitudinal data in daily life, (2) had a minimum sample size of N ⩾ 100 participants, and (3) included individuals with subclinical or clinical mental health problems.In total, 3799 original articles were identified, of which 174 met inclusion criteria. The most widely used methods were diary techniques (e.g. Experience Sampling Methodology), various types of sensors (e.g. accelerometer), and app usage data. Target constructs included affect, various symptom domains, cognitive processes, sleep, dysfunctional behaviour, physical activity, and social media use. There was strong evidence on feasibility of, and high compliance with, active and passive data collection methods in diverse clinical settings and groups. Study designs, sampling schedules, and measures varied considerably across studies, limiting the generalisability of findings.Gathering intensive longitudinal data has significant potential to advance mental health research. However, more methodological research is required to establish and meet critical quality standards in this rapidly evolving field. Advanced approaches such as digital phenotyping, ecological momentary interventions, and machine-learning methods will be required to efficiently use intensive longitudinal data and deliver personalised digital interventions and services for improving public mental health.

Patient-reported outcome measures for life engagement in mental health: a systematic review

Background

Life engagement in the context of mental health is a broad term that describes positive health aspects relating to cognition, vitality, motivation and reward, and the ability to feel pleasure—concepts that are meaningful to patients. The aim of this systematic literature review was to identify validated patient-reported outcomes (PROs) that can assess any aspect of life engagement in adults, in the field of general mental health.

Methods

This was a systematic literature review of articles in English from the MEDLINE database (date of search: September 9, 2020). The search strategy had three components: (1) terms to capture PROs; (2) terms to capture mental health; and (3) terms to capture aspects of life engagement. Articles were eligible if they included a PRO that: (1) is named; (2) can be used across mental health disorders; (3) is used to assess any aspect of life engagement; and (4) has undergone psychometric validation and/or qualitative content validation. A list of PROs was extracted.

Results

A total of 1585 records were screened and 233 articles were eligible for inclusion. Within these 233 articles, 49 distinct PROs were identified, two of which specifically captured their authors’ interpretation of life engagement: the Engaged Living Scale (ELS) and the Life Engagement Test (LET). However, while the ELS and LET covered motivation and reward, life fulfillment, and value-based living, neither scale captured the cognitive or vitality aspects of life engagement. The remaining identified PROs generally captured single aspects of life engagement, most commonly motivation/reward/energy–apathy, pleasure–anhedonia, and mental/psychological well-being.

Conclusion

Numerous PROs are available that may capture aspects of life engagement. However, a need remains for a new PRO that can be used in clinical trials to provide a more comprehensive description of the improvements in life engagement that patients with mental health disorders may experience with successful treatment.

A Scoping Review of Measures Used in Early Intervention Services for Psychosis

OBJECTIVE

The early intervention service (EIS) model for psychosis has been implemented with increasing frequency; yet, improving outcomes across domains for all patients remains challenging. Measurement-based care can strengthen outcomes by optimizing interventions and promoting alignment with standards, but it is still not widely deployed in EIS. The authors conducted a scoping review by systematically identifying and synthesizing measures used in EIS related to purpose (i.e., to assess patients, families, and programs), domains (e.g., symptoms, quality of life), and reporting perspectives (of patients, families, and clinicians).

METHODS

EMBASE, MEDLINE, PsycINFO, CINAHL, and Cochrane Library databases were searched for pertinent literature published between 2000 and 2020. Two reviewers independently screened titles, abstracts, and full texts and extracted data. Measures were classified as clinician-reported outcome measures (CROMs), patient-reported outcome or experience measures (PROMs/PREMs), or family-reported outcome or experience measures (FROMs/FREMs).

RESULTS

In total, 172 measures of 27 domains were identified from 115 articles. Nineteen measures had been used to assess programs on fidelity, service engagement, and satisfaction; 136 to assess patients on duration of untreated psychosis, symptoms, functioning, quality of life, and others; and 17 to assess families on coping and burden, background, and others. Sixty percent were CROMs, 30% were PROMs/PREMs, and 10% were FROMs/FREMs.

CONCLUSIONS

Greater inclusion of PROMs and FROMs is needed because they align with the EIS philosophy of patient and family engagement and may improve shared decision making and outcomes. A comprehensive, meaningfully synthesized archive of measures can advance measurement-based care, services research, and data harmonization in early psychosis.

Psychosocial Profiles of Patients Admitted to Psychiatric Emergency Services: Results from the Signature Biobank Project

OBJECTIVES

Patients admitted to psychiatric emergency services (PES) are highly heterogenous. New tools based on a transdiagnosis approach could help attending psychiatrists in their evaluation process and treatment planning. The goals of this study were to: (1) identify profiles of symptoms based on self-reported, dimensional outcomes in psychiatric patients upon their admission to PES, (2) link these profiles to developmental variables, that is, history of childhood abuse (CA) and trajectories of externalizing behaviours (EB), and (3) test whether this link between developmental variables and profiles was moderated by sex.

METHODS

In total, 402 patients were randomly selected from the Signature Biobank, a database of measures collected from patients admitted to the emergency of a psychiatric hospital. A comparison group of 92 healthy participants was also recruited from the community. Symptoms of anxiety, depression, alcohol and drug abuse, impulsivity, and psychosis as well as CA and EB were assessed using self-reported questionnaires. Symptom profiles were identified using cluster analysis. Prediction of profile membership by sex, CA, and EB was tested using structural equation modelling.

RESULTS

Among patients, four profiles were identified: (1) low level of symptoms on all outcomes, (2) high psychotic symptoms, (3) high anxio-depressive symptoms, and (4) elevated substance abuse and high levels of symptoms on all scales. An indirect effect of CA was found through EB trajectories: patients who experienced the most severe form of CA were more likely to develop chronic EB from childhood to adulthood, which in turn predicted membership to the most severe psychopathology profile. This indirect effect was not moderated by sex.

CONCLUSION

Our results suggest that a transdiagnostic approach allows to highlight distinct clinical portraits of patients admitted to PES. Importantly, developmental factors were predictive of specific profiles. Such transdiagnostic approach is a first step towards precision medicine, which could lead to develop targeted interventions.

A systematic search and critical review of studies evaluating psychometric properties of patient-reported outcome measures for schizophrenia

Measurement-based care (MBC) involves the regular administration of outcome assessments to track and evaluate treatment progress and requires psychometrically sound instruments. While there are widely used patient-reported outcome measures (PROMs) for several psychiatric disorders and symptom categories (e.g., depression, anxiety), there is less consensus about self-report assessments for measurement-based care of schizophrenia. The present review provides an initial guide to this area by reporting on psychometric studies that introduce or evaluate PROMs designed for the ongoing treatment of schizophrenia. Out of an initial database of 6,153 articles, and review of 141 full-text articles, an analysis of 21 articles examining 12 measures is presented in this review. Findings suggest robust options exist for clinical and research institutions aiming to assess symptom outcomes in schizophrenia, with most measures showing strengths in internal consistency, test-retest reliability, and a number of measures with evidence of convergent or criterion validity. While there exist heterogeneous options, multiple measures demonstrated promising psychometric strengths. Future work validating consistent psychometric validity could involve measures which could be valuable in context of MBC for schizophrenia.

Relationship between satisfaction with mental health services, personal recovery and quality of life among service users with psychosis: a cross-sectional study

Background

Mental health policy internationally emphasizes patient centredness and personal recovery. This study investigated the relationship between satisfaction with mental health services among service users with psychosis in Norway, and personal recovery, perceived support for personal recovery, and quality of life.

Methods

Cross-sectional data were collected from 292 service users diagnosed with psychosis from 39 clinical sites across Norway. Satisfaction with services was assessed using the Client Satisfaction Questionnaire-8. A linear mixed model was estimated to explore the relationship between satisfaction with services and preselected covariates, and to control for confounding factors.

Results

A large majority of participants (89%) reported moderate-to-high levels of satisfaction. Satisfaction with services was positively associated with perceived support for personal recovery, but not with personal recovery or quality of life. In addition, service users under a Community Treatment Order (CTO) were significantly less satisfied than those who were not.

Conclusions

Satisfaction levels among service users were higher compared with similar, international studies. Those who feel supported in their personal recovery were more satisfied with the care they receive, which support the need for implementation of recovery-oriented practices for service users with psychosis. However, satisfaction with services was not related to service user-rated quality of life or level of personal recovery; thus, more follow-up studies are needed. The lower satisfaction of service users placed under CTOs shows the importance of targeted interventions to improve satisfaction with services among this group.

Trial registration

NCT03271242, date of registration: 5 sept. 2017.

Differences of mentally ill patients' satisfaction degree during their involuntary or voluntary stay in a psychiatric clinic

BACKGROUND

Mental health illness is not considered as a private matter, as it affects not only the mental patient's life and those who are considered his/her immediate family, but also the society as a whole. The involuntary examination and/or hospitalization in the field of mental health as the basic first-line therapeutic solution in Greece, calls for an immediate intervention, which is supposed to counterbalance the need for therapy and patient's rights of personal freedom and safety.

DESIGN AND METHODS

A research using questionnaire was realized, consisting of 100 hospitalized patients in psychiatric clinics (50 voluntarily and 50 involuntarily hospitalized) at the Psychiatric Hospital of Attica. The sampling scheme was the stratified sampling and the level of statistical significance was set to α=0.05.

RESULTS

The results have shown that involuntarily and voluntarily hospitalized mental patients did not differ significantly with almost the entirety of the questionnaire; however, the involuntary patients were significantly more satisfied with the conditions of hospitalization as well as assessing the overall quality of the services provided during their hospitalization.

CONCLUSIONS

For mentally ill patients, greater importance and stronger correlation with gratification, does not constitute the admission procedure to the psychiatric clinic but the development of effective communication and therapeutic relationship with the staff, full knowledge and update about patient's health condition, medication, participation in therapeutic planning and hospitalization in a regime of autonomy and respect for their rights.

The assessment of factors associated with patient satisfaction in evaluation of mental health care center

AIMS

The study was conducted to explore patient satisfaction and to identify factors associated with patient satisfaction with the care in psychiatric wards using Psychiatric Inpatient Patient Experience Questionnaire On-Site (PIPEQ-OS) self-assessment tool. Such studies to detect factors associated with patient satisfaction in mental health care have not yet been conducted in Latvia.

METHODS

Cross-sectional study was conducted over 6-month period in 2018. Total amount of 773 mental health care patients were offered to fill in the questionnaire in subacute and acute wards. From them, 419 (54.2%) filled and returned the questionnaire and 354 (45.8%) refused to fill it. Descriptive statistical analysis and factor correlation was done.

RESULTS

Response rate was found to be 54.2%. Patients generally showed high satisfaction with received care. However, lower satisfaction rates were found in items related to engagement of relatives and patients in the treatment process, as well as patients were less satisfied with information provided. Statistically significant higher satisfaction was associated with organic mental disorders compared to schizophrenia spectrum disorders, as well as with female gender, older age, being employed or pensioner, being married or divorced. Patient education level did not show significant association with self-assessment scores.

CONCLUSION

The study revealed possible directions for improvement in the future in terms of providing information to patients, involvement of relatives and patients in the process of treatment. Further studies with more patients and involvement of other hospitals are required to assess factors associated with the satisfaction to organize care and to plan treatment according to the needs of the patients.

Routine measurement of satisfaction with life and treatment aspects in mental health patients - the DIALOG scale in East London

AIMS

The DIALOG scale has been implemented as a routine patient outcome and experience measure (PROM/PREM) in a mental health trust in East London since 2017. The resulting healthcare dataset was used to estimate satisfaction with life and treatment aspects over time and factors associated with it.

METHODS

Variables available from the Trust were DIALOG items, service level, clinical and basic demographic data. Data was extracted in February 2019. Data is described using a range of descriptive statistics and looking at the subgroups: treatment stage, diagnosis, service type. Predictors for average DIALOG scores across patients was explored with clustered linear regression models. A fixed effect model was chosen to estimate the impact of clinical and service related variables on patient's average DIALOG scores over time. Sensitivity analyses with the whole data set and complete cases were carried out.

RESULTS

Of the original 18,481 DIALOG records 12, 592 were kept after data cleaning (5646 patients). The average DIALOG score was 4.8 (SD 1.0) on the 7-point scale. Average satisfaction with life aspects (PROM) was 4.65 (SD 1.1) and with treatment aspects (PREM) was 5.25 (SD 1.17). Across all 11 items, "job situation" scored lowest (mean 4.05) and "meetings with professionals" highest (mean 5.5). Satisfaction for all items increased over time (average increase 0.47). The largest increase was in "mental health" (0.94) and the smallest in "family relationships" (0.34).

CONCLUSIONS

Patients in mental healthcare services were "fairly satisfied" in both life and treatment aspects with improvements seen over time. These results will act as a benchmark for clinical services currently implementing DIALOG across the UK and inform local service developments.

Depressive symptoms and quality of life in people with a diagnosis of schizophrenia: An exploratory study of the potential mediating role of health-promoting lifestyles

PURPOSE

To examine health-promoting lifestyles mediates the relationship between depressive symptoms and quality of life (QOL) in people with schizophrenia.

DESIGN AND METHODS

A cross-sectional exploratory study design was conducted. Two-hundred and seventy-three participants were administered demographic data, health-promoting lifestyle profile, Beck Depression Inventory II, and World Health Organization Quality of Life-BREF. The Hayes PROCESS macro was employed to analyze data.

FINDINGS

The results showed self-actualization fully mediated the environmental domain of QOL, physical health, psychological health, and social relationships domains were partial mediation.

PRACTICE IMPLICATIONS

This study recommends that professionals reinforce persons' self-actualization when the QOL is affected by depressive symptoms in people with schizophrenia.

The Conceptualization of Mental Health Service Quality Assessment: Consumer Perspective

This review synthesises theoretical approaches and methodological considerations in mental health service quality assessment from consumers-perspective. We searched published articles from databases: EMBASE, MEDLINE, CIHNAL, Scopus, Web of Science, and PsycINFO. Of the 30 included papers, 16 contained instruments used to mental health quality assessment and 14 focused on theoretical constructs. The review finds that mental health quality assessment is explained and measured using constructs that focus on structure, process and outcome. The methodological issues that need critical consideration are the context and cultural norms of services, outcome perspectives, evaluator, sources of information as well as the selection of consumers and instruments. The review recommends that researchers and clinicians should consider the theoretical constructs and methodological issues in mental health quality assessment.

Development and psychometric properties of a new brief scale for subjective personal agency (SPA-5) in people with schizophrenia

AIMS

Personal agency is a variable which potentially facilitates personal recovery in people with serious mental illness. This study aimed to develop a new brief measure for subjective personal agency that can be completed by people with serious mental illness.

METHODS

Two focus group interviews were first conducted with 11 people with schizophrenia to understand the fundamental components of subjective personal agency for people with serious mental illness living in the community. One group comprised six people with schizophrenia living in the community, while the other consisted of five people with schizophrenia working as peer-support workers. We then developed scale items through collaboration with people with schizophrenia and qualitative analysis (stage 1). A cross-sectional survey was then conducted to test the psychometric properties of the new scale among service users with schizophrenia in 18 assertive community treatment teams (stage 2). Factor validity was tested via exploratory factor analysis (EFA) and confirmatory factor analysis (CFA). We evaluated convergent validity with the Boston University Empowerment Scale (BUES), divergent validity with the global assessment of functioning (GAF), internal consistency, and test-retest reliability.

RESULTS

Seven items were included in the scale at stage 1. In stage 2, 195 participants completed this scale. EFA revealed a one-factor model with five items. CFA indicated good model fit (χ2 statistics [CMIN] = 8.445, df = 5 (CMIN/df = 1.689), p = 0.133, comparative fit index = 0.974, Tucker-Lewis fit index = 0.949, root mean square error of approximation = 0.077 and standardised root mean squared residual = 0.042). The new scale was significantly correlated with total BUES score (r = 0.526, p < 0.001), but not with GAF score. Cronbach's α for internal consistency was 0.79, and intra-class correlation coefficient for test-retest reliability was 0.70.

CONCLUSION

We developed a new, five-item Subjective Personal Agency scale (SPA-5) that can be completed by people with serious mental illness. Further studies are needed to confirm the results outside Japan.

Comorbidity rates of depression and anxiety in first episode psychosis: A systematic review and meta-analysis

Anxiety and depression symptoms are frequently experienced by individuals with psychosis, although prevalence rates have not been reviewed in first-episode psychosis (FEP). The aim of this systematic review was to focus on the prevalence rates for both anxiety and depression, comparing the rates within the same study population. A systematic review and meta-analysis was completed for all studies measuring both anxiety and depression in FEP at baseline. The search identified 6040 citations, of which n = 10 met inclusion criteria. These reported 1265 patients (age 28.3 ± 9.1, females: 39.9%) with diagnosed FEP. Studies which used diagnosis to define comorbidity count were included in separate meta-analyses for anxiety and depression, although the heterogeneity was high limiting interpretation of separate prevalence rates. A random-effects meta-analysis also compared the mean difference between anxiety and depression within the same studies. We show that anxiety and depression co-occur at a similar rate within FEP, although the exact rates are not reliable due to the heterogeneity between the small number of studies. Future research in FEP should consider routinely measuring anxiety and depression using continuous self-report measures of symptoms. Clinically we recommend that both anxiety and depression are equally targeted during psychological intervention in FEP, together with the psychotic symptoms.

Factors associated with satisfaction of inpatient psychiatric care: a cross country comparison

BACKGROUND

Patient satisfaction is a key indicator of inpatient care quality and is associated with clinical outcomes following admission. Different patient characteristics have been inconsistently linked with satisfaction. This study aims to overcome previous limitations by assessing which patient characteristics are associated with satisfaction within a large study of psychiatric inpatients conducted across five European countries.

METHODS

All patients with a diagnosis of psychotic (F2), affective (F3) or anxiety/somataform (F4) disorder admitted to 57 psychiatric inpatient units in Belgium, Germany, Italy, Poland and the UK were included. Data were collected from medical records and face-to-face interviews, with patients approached within 2 days of admission. Satisfaction with inpatient care was measured on the Client Assessment of Treatment Scale.

RESULTS

Higher satisfaction scores were associated with being older, employed, living with others, having a close friend, less severe illness and a first admission. In contrast, higher education levels, comorbid personality disorder and involuntary admission were associated with lower levels of satisfaction. Although the same patient characteristics predicted satisfaction within the five countries, there were significant differences in overall satisfaction scores across countries. Compared to other countries, patients in the UK were significantly less satisfied with their inpatient care.

CONCLUSIONS

Having a better understanding of patient satisfaction may enable services to improve the quality of care provided as well as clinical outcomes for all patients. Across countries, the same patient characteristics predict satisfaction, suggesting that similar analytical frameworks can and should be used when assessing satisfaction both nationally and internationally.

Distress related to psychotic symptoms in individuals at high risk of psychosis

This study assessed the relationship between distress, severity and frequency of attenuated psychotic symptoms in individuals meeting Ultra High Risk (UHR) criteria, both at baseline and over time. It also assessed distress in relation to attenuated symptoms and whether cognitive behavioural therapy (CBT) reduced distress over time by symptom type. At baseline a combined total of 592 UHR participants (mean age 19.9; males, 53.9%) from two studies were assessed using a confirmatory factor analysis (CFA). Change over time from this baseline point was assessed using latent growth curve (LGC) models, based on participants from one of the studies. Distress associated with psychotic symptom was shown to be a separate psychological construct from severity and frequency. Distress was also significantly associated with severity but not frequency. Longitudinal LGC models with 244 participants showed that distress, severity and frequency all reduced over six months, although the rate of distress reduction varied across symptom type. Non-bizarre ideas (NBI) were more distressing and had the fastest rate of distress reduction over time. The baseline distress for some symptoms also strongly predicted the symptom severity change over time, suggesting that distress may cause change in the UHR criteria for unusual thought content (UTC) and NBI symptoms. CBT was not shown to be significantly different from treatment as usual (TAU) in its effect on distress. However, distress reduces over time, particularly in the first 3 months after presentation. We recommend that distress should be used as an outcome in future research and as a clinical indicator. (250 words).

Divergence of subjective and performance-based cognitive gains following cognitive training in schizophrenia

BACKGROUND

Cognitive training is effective for improving cognitive performance among people with schizophrenia. An individual's perception of their own cognition is dissociable from performance on objective cognitive tests. Since subjective cognitive benefit may impact engagement, motivation, and satisfaction with time-intensive cognitive interventions, this study aimed to determine whether subjective cognitive difficulties improve in conjunction with cognitive gains following 30 h of cognitive training.

METHODS

Patients with schizophrenia or schizoaffective disorder (N = 46) were randomized to treatment as usual (TAU) or TAU augmented with auditory-targeted cognitive training (TCT). All participants completed assessment batteries at baseline and follow-up. As previously reported, the TCT group showed significant improvements in verbal learning and memory and reductions in auditory hallucinations relative to the TAU group.

RESULTS

Subjective cognitive difficulties did not significantly improve following TCT, even among TCT participants who showed improvements in cognitive performance (all ps > 0.05). Subjective cognitive difficulties were significantly associated with severity of depressive symptoms and hallucinations (r = 0.48 and r = 0.28, p < 0.001), but not global or specific domains of cognition (all rs < 0.1) at baseline. There were no significant relationships between change in subjective cognitive difficulties and change in cognitive or clinical variables (all ps > 0.05).

DISCUSSION

Patients with schizophrenia do not detect change in their cognition following cognitive training, even among those who showed robust gains in cognitive performance. Failure to detect improvement may undermine treatment engagement, motivation, and satisfaction. Translating score improvements on the cognitive exercises into tangible metrics, and providing ongoing, clinician-delivered feedback on performance may facilitate patient ability to detect improvements and improve motivation to engage with cognitive training interventions.

Cost-Effectiveness Evaluations of Psychological Therapies for Schizophrenia and Bipolar Disorder: A Systematic Review

OBJECTIVES

This review aims to assess the cost-effectiveness of psychological interventions for schizophrenia/bipolar disorder (BD), to determine the robustness of current evidence and identify gaps in the available evidence.

METHODS

Electronic searches (PsycINFO, MEDLINE, Embase) identified economic evaluations relating incremental cost to outcomes in the form of an incremental cost-effectiveness ratio published in English since 2000. Searches were concluded in November 2018. Inclusion criteria were: adults with schizophrenia/BD; any psychological/psychosocial intervention (e.g., psychological therapy and integrated/collaborative care); probability of cost-effectiveness at explicitly defined thresholds reported. Comparators could be routine practice, no intervention, or alternative psychological therapies. Screening, data extraction, and critical appraisal were performed using pre-specified criteria and forms. Results were summarized qualitatively. The protocol was registered on the PROSPERO database (CRD42017056579).

RESULTS

Of 3,864 studies identified, 12 met the criteria for data extraction. All were integrated clinical and economic randomized controlled trials. The most common intervention was cognitive behavioral therapy (CBT, 6/12 studies). The most common measure of health benefit was the quality-adjusted life-year (6/12). Follow-up ranged from 6 months to 5 years. Interventions were found to be cost-effective in most studies (9/12): the probability of cost-effectiveness ranged from 35-99.5 percent. All studies had limitations and demonstrated uncertainty (particularly related to incremental costs).

CONCLUSIONS

Most studies concluded psychological interventions for schizophrenia/BD are cost-effective, including CBT, although there was notable uncertainty. Heterogeneity across studies makes it difficult to reach strong conclusions. There is a particular need for more evidence in the population with BD and for longer-term evidence across both populations.

Associations between readmission and patient-reported measures in acute psychiatric inpatients: a study protocol for a multicenter prospective longitudinal study (the ePOP-J study)

Background

Several previous observational studies have reported the risk factors associated with readmission in people with mental illness. While patient-reported experiences and outcomes have become increasingly important in healthcare, only a few studies have examined these parameters in terms of their direct association with readmission in an acute psychiatric setting. This project will investigate multiple factors associated with readmission and community living in acute psychiatric patients in Japan. This study will primarily investigate whether patient-reported experiences at discharge, particularly quality of life (QoL), are associated with future readmission and whether readmission after the index hospitalization is associated with changes in patient-reported outcomes during the study period. Here, we describe the rationale and methods of this study.

Methods

This multicenter prospective cohort study is being conducted in 21 participating Japanese hospitals, with a target sample of approximately 600 participants admitted to the acute psychiatric ward. The study has four planned assessment points: time of index admission (T1), time of discharge (from the index admission) (T2), 6 months after discharge from the index admission (T3), and 12 months after discharge from the index admission (T4). Participants will complete self-reported measures including a QoL scale, a subjective disability scale, and an empowerment- and self-agency-related scale at each assessment point; additionally, service satisfaction, subjective view of need for services, and subjective relationships with family members will be assessed at T2 and T3. We will assess the participants’ hospitalization during the study period and evaluate several potential individual- and service-level factors associated with readmission and patient-reported experiences and outcomes. Multivariate analyses will be conducted to identify potential associations between readmission and patient-reported experiences and outcomes.

Discussion

The present study may produce evidence on how patient-reported experiences at discharge influence readmission and on the influence of readmission on the course of patient-reported outcomes from admission to community living after discharge. The study may contribute to improving care for both patients’ subjective views of their own health conditions and their community lives in an acute psychiatric setting.

Trial registration University Hospital Medical Information Network—Clinical Trials Registry (UMIN-CTR) UMIN000034220. Registered on September 20, 2018.

Electronic supplementary material

The online version of this article (10.1186/s13033-019-0298-3) contains supplementary material, which is available to authorized users.

The impact of waiting time on patient outcomes: Evidence from early intervention in psychosis services in England

Recently, new emphasis was put on reducing waiting times in mental health services as there is an ongoing concern that longer waiting time for treatment leads to poorer health outcomes. However, little is known about delays within the mental health service system and its impact on patients. We explore the impact of waiting times on patient outcomes in the context of early intervention in psychosis (EIP) services in England from April 2012 to March 2015. We use the Mental Health Services Data Set and the routine outcome measure the Health of the Nation Outcome Scale. In a generalised linear regression model, we control for baseline outcomes, previous service use, and treatment intensity to account for possible endogeneity in waiting time. We find that longer waiting time is significantly associated with a deterioration in patient outcomes 12 months after acceptance for treatment for patients that are still in EIP care. Effects are strongest for waiting times longer than 3 months, and effect sizes are small to moderate. Patients with shorter treatment periods are not affected. The results suggest that policies should aim to reduce excessively long waits in order to improve outcomes for patients waiting for treatment for psychosis.

Spanish translation and analysis of the metric properties of inpatient satisfaction scale in psychiatry: The Satispsy-22-E

The Satispsy-22 scale is an instrument created for the specific evaluation of psychiatric inpatient satisfaction. Therefore, the study aims to carry out the Satispsy-22 scientific translation to Spanish and to learn its psychometric properties. The Satipsy-22-E was administered to discharged patients from four units of acute psychiatric admission, a unit of dual pathology and two units of subacute psychiatric admission (N = 268). Cronbach's alpha was 0.886, which can be interpreted as good internal reliability. All the dimensions showed a good internal consistency with scores from 0.722 to 0.919. Test-retest offered scores of 0.752-0.951 showing good stability. Confirmatory factor analysis showed that all elements load in the estimated dimensions of the original scale and these were significant and the adjustment measures showed, in general, a rather good adjustment, Root Mean Square Error (RMSE) showed that the error between observations and actual data is small and acceptable. Satispsy-22-E is a specific scale in Spanish language for the assessment of psychiatric inpatient satisfaction. It is an easy to use tool that offers good psychometric properties. The availability of a validated survey in Spanish may help to improve the care provided by psychiatric wards in Spanish-speaking countries.

Subjective quality of life in psychosis: Evidence for an association with real world functioning?

Subjective quality of life (SQOL) is an established patient-reported outcome in psychosis. However, current self-report measures of SQOL may be affected by recall bias and may not fully capture dynamic changes in SQOL over time. This study aimed to examine the ecological validity of self-reported and momentary assessment measures of SQOL, and their association with emotional experience, social interaction and activity in real life, in both patients with psychotic disorder (n = 56) and controls (n = 71). Self-reported QOL was assessed with the WHO-QOL, momentary QOL and real life experiences were assessed with the Experience Sampling Method (ESM). Results show that both measures were significantly associated in patients and controls, and associations with emotional experience were most relevant, momentary QOL being a stronger predictor than self-reported QOL. The association between momentary QOL and negative affect was stronger in patients than in controls. Overall, momentary QOL was more consistently associated with affect, social interaction and activity, while self-reported QOL displayed a more narrow association with mostly affect. Concluding, concurrent assessment of self-reported QOL and momentary QOL showed that momentary QOL may enhance the ecological validity of SQOL measurement. Experience sampling research may broaden our perspective on SQOL and its associations with real life functioning.

Ginkgo biloba induced mood dysregulation: a case report

Background

Impairment of cognitive function as well as negative symptom is the major factor causing the decline of a patient’s functioning in chronic stages of schizophrenia. However, until now, there were no definite treatment options that could effectively reduce the impairment.

Case presentation

We report a case of mood dysregulation associated with use of Ginkgo biloba in a patient with schizophrenia. After Ginkgo biloba was given, the patient experienced cluster symptoms of mood dysregulation including irritability, difficulty in controlling anger, agitation and restlessness. We estimated the possibility as “probable” according to Naranjo scale considering circumstantial evidence.

Conclusions

This case suggests that Ginkgo biloba may have caused mood dysregulation in this patient. Although it is generally accepted as safe, more attention should be given to the adverse effect when treating with Ginkgo biloba.

Satisfaction of psychotic patients with care and its value to predict outcomes

BACKGROUND

A key indicator of quality of treatment from the patient's perspective is expressed by satisfaction with care. Our aim was to (i) explore satisfaction and its relation to clinical outcome measures; and (ii) explore the predictive value of satisfaction for the course of outcomes over three years.

METHODS

Data of 654 patients with a non-affective psychosis included in a naturalistic longitudinal cohort study were analyzed. We included 506 males and 148 females with a mean age of 30.47 (SD 7.24) from The Netherlands. Satisfaction was measured with the self-rating Client Satisfaction Questionnaire-8. A wide range of interviewer-rated (e.g., Positive and Negative Symptom Scale) and self-rated (e.g., World Health Organization Quality of Life); outcomes of low, intermediate and high satisfied patients were compared using ANOVA, Chi² or Kruskal-Wallis tests. The predictive value of satisfaction level on clinical outcomes after three years was tested using regression models.

RESULTS

Satisfaction levels were low (19.4%), intermediate (48.9%) or high (31.7%). High satisfied patients showed significantly better interviewer-rated outcomes, e.g., less severe psychotic symptoms, and self-rated outcomes, e.g., better quality of life, compared to patients with intermediate or low satisfaction. Higher levels of satisfaction with care at baseline predicted a reduction of positive symptoms three years later (B=-.09, P-value=.013).

CONCLUSIONS

Satisfaction of patients with psychosis is a valuable monitoring measure since high satisfied patients show more favorable outcomes ranging from psychopathological symptoms to quality of life. Further research into explanations of lower levels of satisfaction is commendable in order to improve outcomes.

Satisfaction with psychiatric in-patient care as rated by patients at discharge from hospitals in 11 countries

PURPOSE

There is disregard in the scientific literature for the evaluation of psychiatric in-patient care as rated directly by patients. In this context, we aimed to explore satisfaction of people treated in mental health in-patient facilities. The project was a part of the Young Psychiatrist Program by the Association for the Improvement of Mental Health Programmes.

METHODS

This is an international multicentre cross-sectional study conducted in 25 hospitals across 11 countries. The research team at each study site approached a consecutive target sample of 30 discharged patients to measure their satisfaction using the five-item study-specific questionnaire. Individual and institution level correlates of 'low satisfaction' were examined by comparisons of binary and multivariate associations in multilevel regression models.

RESULTS

A final study sample consisted of 673 participants. Total satisfaction scores were highly skewed towards the upper end of the scale, with a median total score of 44 (interquartile range 38-48) out of 50. After taking clustering into account, the only independent correlates of low satisfaction were schizophrenia diagnosis and low psychiatrist to patient ratio.

CONCLUSION

Further studies on patients' satisfaction should additionally pay attention to treatment expectations formed by the previous experience of treatment, service-related knowledge, stigma and patients' disempowerment, and power imbalance.

Treatment outcomes in schizophrenia: qualitative study of the views of family carers

BACKGROUND

Schizophrenia is a complex, heterogeneous disorder, with highly variable treatment outcomes, and relatively little is known about what is important to patients. The aim of the study was to understand treatment outcomes informal carers perceive to be important to people with schizophrenia.

METHOD

Qualitative interview study with 34 individuals and 8 couples who care for a person with schizophrenia/schizoaffective disorder. Interviews were transcribed verbatim and analysed by a thematic framework based approach.

RESULTS

Carers described well-recognised outcomes of importance, alongside more novel outcomes relating to: Safety (of the patient/others); insight (e.g. into non-reality of psychotic phenomena); respite from fear, distress or pain; socially acceptable behaviour; getting out of the house; attainment of life milestones; changes in personality and/or temperament; reduction of vulnerability to stress; and several aspects of physical health.

CONCLUSIONS

These findings have the potential to inform the development of patient- or carer- focused outcome measures that take into account the full range of domains that carers feel are important for patients.

Examining the reliability and validity of the Clinical Assessment Interview for Negative Symptoms within the Management of Schizophrenia in Clinical Practice (MOSAIC) multisite national study

The current study sought to expand on prior reports of the validity and reliability of the CAINS (CAINS) by examining its performance across diverse non-academic clinical settings as employed by raters not affiliated with the scale's developers and across a longer test-retest follow-up period. The properties of the CAINS were examined within the Management of Schizophrenia in Clinical Practice (MOSAIC) schizophrenia registry. A total of 501 participants with a schizophrenia spectrum diagnosis who were receiving usual care were recruited across 15 national Patient Assessment Centers and evaluated with the CAINS, other negative symptom measures, and assessments of functioning, quality of life and cognition. Temporal stability of negative symptoms was assessed across a 3-month follow-up. Results replicated the two-factor structure of the CAINS reflecting Motivation and Pleasure and expression symptoms. The CAINS scales exhibited high internal consistency and temporal stability. Convergent validity was supported by significant correlations between the CAINS subscales with other negative symptom measures. Additionally, the CAINS was significantly correlated with functioning and quality of life. Discriminant validity was demonstrated by small to moderate associations between the CAINS and positive symptoms, depression, and cognition (and these associations were comparable to those found with other negative symptom scales). Findings suggest that the CAINS is a reliable and valid tool for measuring negative symptoms in schizophrenia across diverse clinical samples and settings.

A core outcome set for evaluating self-management interventions in people with comorbid diabetes and severe mental illness: study protocol for a modified Delphi study and systematic review

Background

People with diabetes and comorbid severe mental illness (SMI) form a growing population at risk of increased mortality and morbidity compared to those with diabetes or SMI alone. There is increasing interest in interventions that target diabetes in SMI in order to help to improve physical health and reduce the associated health inequalities. However, there is a lack of consensus about which outcomes are important for this comorbid population, with trials differing in their focus on physical and mental health. A core outcome set, which includes outcomes across both conditions that are relevant to patients and other key stakeholders, is needed.

Methods

This study protocol describes methods to develop a core outcome set for use in effectiveness trials of self-management interventions for adults with comorbid type-2 diabetes and SMI. We will use a modified Delphi method to identify, rank, and agree core outcomes. This will comprise a two-round online survey and multistakeholder workshops involving patients and carers, health and social care professionals, health care commissioners, and other experts (e.g. academic researchers and third sector organisations). We will also select appropriate measurement tools for each outcome in the proposed core set and identify gaps in measures, where these exist.

Discussion

The proposed core outcome set will provide clear guidance about what outcomes should be measured, as a minimum, in trials of interventions for people with coexisting type-2 diabetes and SMI, and improve future synthesis of trial evidence in this area. We will also explore the challenges of using online Delphi methods for this hard-to-reach population, and examine differences in opinion about which outcomes matter to diverse stakeholder groups.

Trial registration

COMET registration: http://www.comet-initiative.org/studies/details/911. Registered on 1 July 2016

Validation of the Warwick-Edinburgh Mental Well-Being Scale (WEMWBS) in French psychiatric and general populations

The Warwick-Edinburgh Mental Well-Being Scale (WEMWBS) has been validated in general population samples in many countries. Interest in using this measure in clinical populations is growing, particularly for tertiary prevention and mental health promotion. This paper reports validation of the French WEMWBS in healthy and chronic remitted schizophrenia populations. The French WEMWBS was administered to 319 workers, 75 students and 121 patients. For non-patients, self-reported Trait- and State-Anxiety, Mindfulness, Positive and Negative Affect and the General Health Questionnaire were completed. For patients, the Positive and Negative Syndrome Scale, Clinical Global Impression Severity Scale, Birchwood Insight Scale, Social Adjustment Scale, and Global Assessment of Functioning scale were completed. Test-retest reliability and responsiveness to intervention was assessed at 6 months. Whatever the sample, response frequencies showed normal distributions, and internal consistency was good (Cronbach's α). Scree plots of eigenvalues suggested a single factor in the samples. The one-dimensional solution yielded suboptimal fit indices. Construct validity was confirmed. Significant improvement in scores was observed before and after intervention. Test-retest variation was non-significant. Impairment of insight and cognition in the assessed patients implies that attention must be paid before applying WEMWBS to all patients. Nevertheless, WEMWBS proved valid and reliable in a further European population, suggesting transcultural validity for both monitoring and evaluation of interventions in healthy as well as chronic remitted schizophrenia populations.

Reliability of a patient-reported outcome measure in schizophrenia: Results from back-to-back self-ratings

This study aimed to assess patient's capacity to perform a patient-reported outcome (PRO) measure (i.e., a self-rating scale) and examine its relationship with clinical characteristics including cognition. Fifty patients with schizophrenia were asked to rate the Subjective Well-being under Neuroleptics scale - Short form (SWNS) twice; the second rating was started immediately after they completed the first to minimize the gap between ratings. At the same time, the Positive and Negative Symptoms Scale (PANSS) and Brief Neurocognitive Assessment (BNA) were administered. The correlations between the two ratings for the SWNS total and each item scores were high (rs=0.94 and rs=0.60-0.84, respectively); however, for 16 (80%) of 20 items, 5 or more patients (i.e., ≥10%) demonstrated a>1 point score difference. There was no significant correlation between the SWNS total score difference and any clinical characteristics including age, education duration, illness duration, antipsychotic dose, psychopathology, and cognition. In contrast, the number of items with a>1 point score difference was significantly correlated with disorganized symptoms and overall severity (rs=0.29 for both), as well as working memory and global cognition (rs=-0.41 and rs=-0.40, respectively). These findings suggest that PROs should be interpreted with caution in patients with schizophrenia with prominent disorganization and cognitive impairment.

Calibrating well-being, quality of life and common mental disorder items: psychometric epidemiology in public mental health research

BACKGROUND

The assessment of 'general health and well-being' in public mental health research stimulates debates around relative merits of questionnaire instruments and their items. Little evidence regarding alignment or differential advantages of instruments or items has appeared to date.

AIMS

Population-based psychometric study of items employed in public mental health narratives.

METHOD

Multidimensional item response theory was applied to General Health Questionnaire (GHQ-12), Warwick-Edinburgh Mental Well-being Scale (WEMWBS) and EQ-5D items (Health Survey for England, 2010-2012; n = 19 290).

RESULTS

A bifactor model provided the best account of the data and showed that the GHQ-12 and WEMWBS items assess mainly the same construct. Only one item of the EQ-5D showed relevant overlap with this dimension (anxiety/depression). Findings were corroborated by comparisons with alternative models and cross-validation analyses.

CONCLUSIONS

The consequences of this lack of differentiation (GHQ-12 v. WEMWBS) for mental health and well-being narratives deserves discussion to enrich debates on priorities in public mental health and its assessment.

Psychometric properties of the Seville quality of life questionnaire in Mexican patients with psychosis

BACKGROUND

The Seville Quality of Life Questionnaire (CSCV) was designed to assess quality of life in patients with schizophrenia taking into account those facets particularly important in this disorder. The study aimed at applying the CSCV to a sample of Mexican patients with psychosis in an effort further substantiates the psychometric properties of the CSCV.

METHODS

This cross-sectional study included 61 patients (56 % female) with psychosis. Item-scale and item-factor correlations were analyzed, as well as scale-factor correlations. Cronbach's Alpha and principal component analysis with varimax rotation were used to assess internal consistency and construct validity, respectively.

RESULTS

Analyses of both, disfavorable and favorable dimensions, showed a stronger item-scale than item-factor correlation, in most cases significant, though. Internal consistency was significant and adequate; higher for scales than for factors. For the disfavorable and the favorable scales 11 and 2 factors were obtained, respectively; explained variance was low.

CONCLUSIONS

In this sample of Mexican patients it was replicated that the CSCV is a valid and reliable instrument to assess quality of life in people with psychosis; the use of scale scores is recommended.

Ecological Interventionist Causal Models in Psychosis: Targeting Psychological Mechanisms in Daily Life

Integrated models of psychotic disorders have posited a number of putative psychological mechanisms that may contribute to the development of psychotic symptoms, but it is only recently that a modest amount of experience sampling research has provided evidence on their role in daily life, outside the research laboratory. A number of methodological challenges remain in evaluating specificity of potential causal links between a given psychological mechanism and psychosis outcomes in a systematic fashion, capitalizing on longitudinal data to investigate temporal ordering. In this article, we argue for testing ecological interventionist causal models that draw on real world and real-time delivered, ecological momentary interventions for generating evidence on several causal criteria (association, time order, and direction/sole plausibility) under real-world conditions, while maximizing generalizability to social contexts and experiences in heterogeneous populations. Specifically, this approach tests whether ecological momentary interventions can (1) modify a putative mechanism and (2) produce changes in the mechanism that lead to sustainable changes in intended psychosis outcomes in individuals' daily lives. Future research using this approach will provide translational evidence on the active ingredients of mobile health and in-person interventions that promote sustained effectiveness of ecological momentary interventions and, thereby, contribute to ongoing efforts that seek to enhance effectiveness of psychological interventions under real-world conditions.

Development and psychometric properties of the client's assessment of treatment scale for supported accommodation (CAT-SA)

BACKGROUND

Patient-Reported Outcome Measures (PROMs) are important for evaluating mental health services. Yet, no specific PROM exists for the large and diverse mental health supported accommodation sector. We aimed to produce and validate a PROM specifically for supported accommodation services, by adapting the Client's Assessment of Treatment Scale (CAT) and assessing its psychometric properties in a large sample.

METHODS

Focus groups with service users in the three main types of mental health supported accommodation services in the United Kingdom (residential care, supported housing and floating outreach) were conducted to adapt the contents of the original CAT items and assess the acceptability of the modified scale (CAT-SA). The CAT-SA was then administered in a survey to service users across England. Internal consistency was assessed using Cronbach's alpha. Convergent validity was tested through correlations with subjective quality of life and satisfaction with accommodation, as measured by the Manchester Short Assessment of Quality of Life (MANSA).

RESULTS

All seven original items of the CAT were regarded as relevant to appraisals of mental health supported accommodation services, with only slight modifications to the wording required. In the survey, data were obtained from 618 clients. The internal consistency of the CAT-SA items was 0.89. Mean CAT-SA scores were correlated with the specific accommodation item on the MANSA (r s  = 0.37, p ˂ .001).

CONCLUSIONS

The content of the CAT-SA has relevance to service users living in mental health supported accommodation. The findings from our large survey show that the CAT-SA is acceptable across different types of supported accommodation and suggest good psychometric properties. The CAT-SA appears a valid and easy to use PROM for service users in mental health supported accommodation services.

Psychometric evaluation of the Questionnaire about the Process of Recovery (QPR)

BACKGROUND

Supporting recovery is the aim of national mental health policy in many countries. However, only one measure of recovery has been developed in England: the Questionnaire about the Process of Recovery (QPR), which measures recovery from the perspective of adult mental health service users with a psychosis diagnosis.

AIMS

To independently evaluate the psychometric properties of the 15- and 22-item versions of the QPR.

METHOD

Two samples were used: data-set 1 (n = 88) involved assessment of the QPR at baseline, 2 weeks and 3 months. Data-set 2 (n = 399; trial registration: ISRCTN02507940) involved assessment of the QPR at baseline and 1 year.

RESULTS

For the 15-item version, internal consistency was 0.89, convergent validity was 0.73, test-retest reliability was 0.74 and sensitivity to change was 0.40. Confirmatory factor analysis showed the 15-item version offered a good fit. For the 22-item version, the interpersonal subscale was found to underperform and the intrapersonal subscale overlaps substantially with the 15-item version.

CONCLUSIONS

Both the 15-item and the intrapersonal subscale of the 22-item versions of the QPR demonstrated satisfactory psychometric properties. The 15-item version is slightly more robust and also less burdensome, so it can be recommended for use in research and clinical practice.

Can we have routine measurement of patient satisfaction in acute psychiatric settings? A cross sectional study

Patient satisfaction is considered an important indicator of the quality of care in psychiatric services. Its importance has been widely studied, but the literature identifies methodological problems deriving from samples with low response rates and exclusion criteria which would seem to imply a kind of exclusion in the evaluations of less compliant patients. The aim of this study is to test a methodology to assess patient satisfaction with the quality of care received at an acute psychiatric ward in terms of its application in daily routine. In this cross sectional survey inpatients were given the Rome Opinion Questionnaire (ROQ). Our patients, involuntary patients included, with a 92.3% participation rate (47 patients out of 51), returned a mean general satisfaction score of 7.7/9. This response rate is higher than that reported in most previously published studies, which shows that a good level of both voluntary and involuntary patient participation may be achieved when an appropriate methodological approach is adopted. Not acknowledging patient satisfaction reduces the possibility of more effective caring actions. Measuring patient satisfaction, through use of short questionnaires, should become a routine in daily practice.

A history of health-related quality of life outcomes in psychiatry

Health-related quality of life (HRQoL) is a multidimensional concept that includes subjective reports of symptoms, side effects, functioning in multiple life domains, and general perceptions of life satisfaction and quality. Rather than estimating it from external observations, interview, or clinical assessment, it is best measured by direct query. Due to a perception that respondents may not be reliable or credible, there has been some reluctance to use self-report outcomes in psychiatry. More recently, and increasingly, HRQoL assessment through direct patient query has become common when evaluating a range of psychiatric, psychological, and social therapies. With few exceptions, psychiatric patients are credible and reliable reporters of this information. This article summarizes studies that highlight the development, validation, and application of HRQoL measures in psychiatry. Thoughtful application of these tools in psychiatric research can provide a much-needed patient perspective in the future of comparative effectiveness research, patient-centered outcomes research, and clinical care.

Factors of psychological distress: clinical value, measurement substance, and methodological artefacts

PURPOSE

Psychometric models and statistical techniques are cornerstones of research into latent structures of specific psychopathology and general mental health. We discuss "pivot points" for future research efforts from a psychometric epidemiology perspective, emphasising sampling and selection processes of both indicators that guide data collection as well as samples that are confronted with them.

METHOD

First, we discuss how a theoretical model of psychopathology determines which empirical indicators (questions, diagnoses, etc.) and modelling methods are appropriate to test its implications. Second, we deal with how different research designs introduce different (co-)variances between indicators, potentially leading to a different understanding of latent structures. Third, we discuss widening the range of statistical models available within the "psychometrics class": the inclusion of categorical approaches can help to enlighten the debate on the structure of psychopathology and agreement on a minimal set of models might lead to greater convergence between studies. Fourth, we deal with aspects of methodology that introduce spurious (co-)variance in latent structure analysis (response styles, clustered data) and differential item functioning to gather more detailed information and to guard against over-generalisation of results, which renders assessments unfair.

CONCLUSIONS

Building on established insights, future research efforts should be more explicit about their theoretical understanding of psychopathology and how the analysis of a given indicator-respondent set informs this theoretical model. A coherent treatment of theoretical assumptions, indicators, and samples holds the key to building a comprehensive account of the latent structures of different types of psychopathology and mental health in general.

The Brief Obsessive-Compulsive Scale (BOCS): a self-report scale for OCD and obsessive-compulsive related disorders

BACKGROUND

The Brief Obsessive Compulsive Scale (BOCS), derived from the Yale-Brown Obsessive-Compulsive Scale (Y-BOCS) and the children's version (CY-BOCS), is a short self-report tool used to aid in the assessment of obsessive-compulsive symptoms and diagnosis of obsessive-compulsive disorder (OCD). It is widely used throughout child, adolescent and adult psychiatry settings in Sweden but has not been validated up to date.

AIM

The aim of the current study was to examine the psychometric properties of the BOCS amongst a psychiatric outpatient population.

METHOD

The BOCS consists of a 15-item Symptom Checklist including three items (hoarding, dysmorphophobia and self-harm) related to the DSM-5 category "Obsessive-compulsive related disorders", accompanied by a single six-item Severity Scale for obsessions and compulsions combined. It encompasses the revisions made in the Y-BOCS-II severity scale by including obsessive-compulsive free intervals, extent of avoidance and excluding the resistance item. 402 adult psychiatric outpatients with OCD, attention-deficit/hyperactivity disorder, autism spectrum disorder and other psychiatric disorders completed the BOCS.

RESULTS

Principal component factor analysis produced five subscales titled "Symmetry", "Forbidden thoughts", "Contamination", "Magical thoughts" and "Dysmorphic thoughts". The OCD group scored higher than the other diagnostic groups in all subscales (P < 0.001). Sensitivities, specificities and internal consistency for both the Symptom Checklist and the Severity Scale emerged high (Symptom Checklist: sensitivity = 85%, specificities = 62-70% Cronbach's α = 0.81; Severity Scale: sensitivity = 72%, specificities = 75-84%, Cronbach's α = 0.94).

CONCLUSIONS

The BOCS has the ability to discriminate OCD from other non-OCD related psychiatric disorders. The current study provides strong support for the utility of the BOCS in the assessment of obsessive-compulsive symptoms in clinical psychiatry.

Negative affectivity as a transdiagnostic factor in patients with common mental disorders

BACKGROUND

Screening and monitoring systems are increasingly used in psychotherapy, but it has been questioned whether outcome measurement using multiple questionnaires is warranted. Arguably, type and number of assessment instruments should be determined by empirical research. This study investigated the latent factor structure of a multi-dimensional outcome measurement strategy used in English services aligned to the Improving Access to Psychological Therapies (IAPT) programme.

METHODS

Factor analyses and structural equation models were performed on 11,939 intake assessments of outpatients accessing an IAPT service between 2008 and 2010. We examined whether three routinely employed instruments (PHQ-9 for depression, GAD-7 for anxiety, WSAS for functional impairment) assess empirically different dimensions.

RESULTS

The instruments were found to assess mainly one general dimension and only some items of the GAD-7 and WSAS assess unique variance beyond this general dimension. In a structural equation model the disorder-specific factor scores were predicted by patients׳ diagnostic categories.

LIMITATIONS

Since a large naturalistic data base was used, missing data for diagnoses and scale items were encountered. Diagnoses were obtained with brief case-finding measures rather than structured diagnostic interviews.

CONCLUSION

Although the items seem to address mostly one dimension, some variance is due to differences between individuals in anxiety and impairment. While this generally supports multi-dimensional assessment in a primary care population, the clinical upshot of the study is to concentrate attention on transdiagnostic factors as a target for treatment.

Association of stigma resistance with emotion regulation - functional magnetic resonance imaging and neuropsychological findings

BACKGROUND

[corrected] Personal characteristics contribute to whether negative attitudes in society are internalized as deteriorating self-stigma. Studies in healthy subjects suggest that resilience is associated with the regulation of amygdala activation by the medial prefrontal cortex (mPFC), but little is known about the factors that contribute to individual stigma resistance in psychiatric patients.

METHODS

We assessed stigma (by measuring association strengths between social inferiority and schizophrenia by an implicit association test) in 20 patients with schizophrenia and in 16 age- and sex-matched healthy control subjects. The brain activation strengths were measured by functional magnetic resonance imaging during evaluation of schizophrenia-related statements and of control statements.

RESULTS

Association strengths between social inferiority and schizophrenia were inversely related to the strength of the activation of the rostro-ventral mPFC. This inverse correlation survived adjustment for global functioning, depression symptom scores, and insight. Activation of the rostro-ventral mPFC was negatively correlated with activation of the amygdala. The association strengths between social inferiority and schizophrenia correlated with the compromised performance in a Stroop task, which is a measure of cognitive regulation.

DISCUSSION

Our findings suggest that individual stigma resistance is associated with emotion regulation. These findings may help to understand better stigma resistance and thereby aid the development of patient interventions that add to the public anti-stigma work in reducing devastating effects of stigma.

Urbanicity, social adversity and psychosis

In recent years, there has been increasing interest in research on geographical variation in the incidence of schizophrenia and other psychoses. In this paper, we review the evidence on variation in incidence of schizophrenia and other psychoses in terms of place, as well as the individual- and area-level factors that account for this variation. We further review findings on potential mechanisms that link adverse urban environment and psychosis. There is evidence from earlier and more recent studies that urbanicity is associated with an increased incidence of schizophrenia and non-affective psychosis. In addition, considerable variation in incidence across neighbourhoods has been observed for these disorders. Findings suggest it is unlikely that social drift alone can fully account for geographical variation in incidence. Evidence further suggests that the impact of adverse social contexts - indexed by area-level exposures such as population density, social fragmentation and deprivation - on risk of psychosis is explained (confounding) or modified (interaction) by environmental exposures at the individual level (i.e., cannabis use, social adversity, exclusion and discrimination). On a neurobiological level, several studies suggest a close link between social adversity, isolation and stress on the one hand, and monoamine dysfunction on the other, which resembles findings in schizophrenia patients. However, studies directly assessing correlations between urban stress or discrimination and neurobiological alterations in schizophrenia are lacking to date.

Subjective quality of life in war-affected populations

Background

Exposure to traumatic war events may lead to a reduction in quality of life for many years. Research suggests that these impairments may be associated with posttraumatic stress symptoms; however, wars also have a profound impact on social conditions. Systematic studies utilising subjective quality of life (SQOL) measures are particularly rare and research in post-conflict settings is scarce. Whether social factors independently affect SQOL after war in addition to symptoms has not been explored in large scale studies.

Method

War-affected community samples were recruited through a random-walk technique in five Balkan countries and through registers and networking in three Western European countries. The interviews were carried out on average 8 years after the war in the Balkans. SQOL was assessed on Manchester Short Assessment of Quality of Life - MANSA. We explored the impact of war events, posttraumatic stress symptoms and post-war environment on SQOL.

Results

We interviewed 3313 Balkan residents and 854 refugees in Western Europe. The MANSA mean score was 4.8 (SD = 0.9) for the Balkan sample and 4.7 (SD = 0.9) for refugees. In both samples participants were explicitly dissatisfied with their employment and financial situation. Posttraumatic stress symptoms had a strong negative impact on SQOL. Traumatic war events were directly linked with lower SQOL in Balkan residents. The post-war environment influenced SQOL in both groups: unemployment was associated with lower SQOL and recent contacts with friends with higher SQOL. Experiencing more migration-related stressors was linked to poorer SQOL in refugees.

Conclusion

Both posttraumatic stress symptoms and aspects of the post-war environment independently influence SQOL in war-affected populations. Aid programmes to improve wellbeing following the traumatic war events should include both treatment of posttraumatic symptoms and social interventions.