The Cognitive Assessment Interview (CAI): reliability and validity of a brief interview-based measure of cognition

Introducing an interview-based cognitive assessment tool for people with Schizophrenia in Ethiopia

Assessment of cognitive impairment in people with schizophrenia (PWS) is limited in low and middle-income countries due to lack of context-appropriate measures. This study aimed to select, adapt, and evaluate an interview-based cognitive tool for PWS in Ethiopia. The study was carried out in three phases. In the first phase, we followed a rigorous instrument selection procedure to select a tool for adaptation. We then applied a rigorous instrument adaption procedure, including interviews with 24 participants. Finally, we evaluated the psychometric properties of the adapted tool with 208 PWS and 208 matched controls. The Cognitive Assessment Interview was selected as the appropriate tool for adaptation. This tool is practical and tolerable, with short time of administration. We reported high inter-rater reliability and test-retest reliability for the adapted scale. One-factor structure better represented the data with excellent internal consistency. Weak but significant correlation with a performance-based battery was reported. At a cut-off value of > 13, the tool significantly differentiated PWS from controls (62 % sensitivity and 82 % specificity). Item Response Theory-based analysis showed that the tool gives much information among severely impaired participants. The findings show that the tool is reliable, valid, and practical in resource-scarce settings.

Assessment of cognitive impairment in psychosis spectrum disorders through self-reported and interview-based measures

Self-reported and interview-based measures can be considered coprimary measures of cognitive performance. We aimed to ascertain to what extent cognitive impairment in psychotic disorders, as assessed with a neuropsychological battery, is associated with subjective cognitive complaints compared to difficulties in daily activities caused by cognitive impairment. We assessed 114 patients who had a psychotic disorder with a set of neuropsychological tests and two additional measures: the Cognitive Assessment Interview-Spanish version (CAI-Sp) and the Frankfurt Complaint Questionnaire (FCQ). Patients also underwent a clinical assessment. The CAI-Sp correlated significantly with all the clinical dimensions, while the FCQ correlated only with positive and depressive symptoms. The CAI-Sp correlated significantly with all cognitive domains, except for verbal memory and social cognition. The FCQ was associated with attention, processing speed and working memory. The combination of manic and depressive symptoms and attention, processing speed, working memory and explained 38-46% of the variance in the patients' CAI-Sp. Education and negative symptoms, in combination with attention, processing speed, and executive functions, explained 54-59% of the CAI-Sp rater's variance. Only negative symptoms explained the variance in the CAI-Sp informant scores (37-42%). Depressive symptoms with attention and working memory explained 15% of the FCQ variance. The ability to detect cognitive impairment with the CAI-Sp and the FCQ opens the possibility to consider these instruments to approximate cognitive impairment in clinical settings due to their ease of application and because they are less time-consuming for clinicians.

The Cognitive Assessment Interview (CAI): Association with neuropsychological scores and real-life functioning in a large sample of Italian subjects with schizophrenia

INTRODUCTION

The Cognitive Assessment Interview (CAI) is an interview-based scale developed to measure cognitive impairment and its impact on functioning in subjects with schizophrenia (SCZ). Previous studies demonstrated good psychometric properties of the CAI. However, only relatively small samples of SCZ were investigated. This study aimed to determine in a large sample of SCZ (N = 580) the relationships of the Italian Version of the CAI with measures of cognitive performance and functional capacity and real-life functioning, using state-of-the-art instruments.

METHODS

Intraclass correlation coefficients (ICCs) and Cronbach's alpha were calculated to examine the CAI's inter-rater reliability and internal consistency. Pearson's correlation coefficients were used to evaluate relationships between CAI global and domain composite scores with neurocognition, social cognition, functional capacity, and functioning.

RESULTS

The inter-rater reliability and internal consistency were good to excellent. The CAI global composite score showed a strong correlation with the MATRICS Consensus Cognitive Battery (MCCB) composite score (r = -0.50) and moderate/strong associations with measures of functional capacity (-0.46 < r < -0.52) and real-life functioning (-0.30 < r < -0.51). Finally, CAI composite social cognition score correlated moderately with the Facial Emotion Identification Test (r = -0.31) and two subscales of the Awareness of Social Inference Test (-0.32 < r < -0.34).

CONCLUSIONS

The study suggests that CAI is a valid co-primary measure for clinical trials and a suitable instrument to screen impairment in neurocognitive and social cognitive domains and its impact on functioning in SCZ in everyday clinical practice.

European Psychiatric Association guidance on assessment of cognitive impairment in schizophrenia

Background

Impairment in a wide range of cognitive abilities has been consistently reported in individuals with schizophrenia. Both neurocognitive and social cognitive deficits are thought to underlie severe functional disabilities associated with schizophrenia. Despite the key role in schizophrenia outcome, cognition is still poorly assessed in both research and clinical settings.

Methods

In this guidance paper, we provide a systematic review of the scientific literature and elaborate several recommendations for the assessment of cognitive functions in schizophrenia both in research settings and in real-world clinical practice.

Results

Expert consensus and systematic reviews provided guidance for the optimal assessment of cognitive functions in schizophrenia. Based on the reviewed evidence, we recommend a comprehensive and systematic assessment of neurocognitive and social cognitive domains in schizophrenia, in all phases of the disorder, as well as in subjects at risk to develop psychosis. This European Psychiatric Association guidance recommends not only the use of observer reports but also self-reports and interview-based cognitive assessment tools. The guidance also provides a systematic review of the state of the art of assessment in the first episode of psychosis patients and in individuals at risk for psychosis.

Conclusion

The comprehensive review of the evidence and the recommendations might contribute to advance the field, allowing a better cognitive assessment, and avoiding overlaps with other psychopathological dimensions. The dissemination of this guidance paper may promote the development of shared guidelines concerning the assessment of cognitive functions in schizophrenia, with the purpose to improve the quality of care and to obtain recovery.

We Should Improve Personalization of Management in Patients with a Diagnosis of Schizophrenia

The current management of patients with schizophrenia is marked by a lack of personalization. After the diagnosis is made, a second-generation antipsychotic is usually prescribed based on the current clinician’s preferences, sometimes accompanied by a psychosocial intervention which is typically not evidence-based and not targeted to the specific needs of the individual patient. In this opinion paper, some steps are outlined that could be taken in order to address this lack of personalization. A special emphasis is laid on the clinical characterization of the patient who has received a diagnosis of schizophrenia. Considerations are put forward concerning the assessment of the negative dimension in ordinary clinical practice, which is often neglected; the evaluation of cognitive functioning using a simple test battery which requires limited professional training and takes no more than 15 min to administer; the evaluation of social functioning using a validated instrument focusing on personal care skills, interpersonal relationships, social acceptability, activities, and work skills; and the assessment of the unmet needs of the person (including practical, social, and emotional needs, and existential or personal recovery). The implications of the assessment of these domains for the formulation of the management plan are discussed.

Daily Ecological Momentary Assessments of happy and sad moods in people with schizophrenia and bipolar disorders: What do participants who are never sad think about their activities and abilities?

OBJECTIVES

People with schizophrenia have challenges in their self-assessments of everyday functioning and those who report no sadness also tend to overestimate their everyday functional abilities. While previous studies were cross-sectional, this study related longitudinal assessments of sadness to self-reports of abilities in domains of everyday functioning and cognitive abilities.

METHODS

71 people with bipolar illness (BPI) were compared to 102 people with schizophrenia (SCZ). Participants were sampled 3 times per day for 30 days with a smartphone-based Ecological Momentary Assessment (EMA) survey. Each survey asked where they were, with whom they were, what they were doing, and if they were sad. Performance based assessments of executive functioning, social competence, and everyday activities were collected after the EMA period, at which time the participants and observers were asked to provide ratings of three different domains of everyday functioning and neurocognitive ability.

RESULTS

18% of participants with SCZ reported that they were never sad on any one of the 90 EMA surveys. Reports of never being sad were associated with overestimated functioning compared to observers and SCZ participants who reported that they were never sad were more commonly home and alone than both SCZ participants who reported occasional sadness and participants with BPI. These participants reported being significantly happier than all people in the study.

IMPLICATIONS

Reporting that you were never sad was associated with overestimation of everyday functioning and cognitive abilities. Although participants who were never sad did not perform more poorly on objective measures than those were occasionally sad, their self-assessed functioning was significantly elevated. These data suggest that negative symptoms constructs such as reduced emotional experience need to consider reduced ability to subjectively evaluate emotional experience as a feature of negative symptoms.

Self-assessment of social cognition in a sample of Lebanese in-patients with schizophrenia

Objective

The primary objective was to evaluate social cognitive complaints in a sample of chronic in-patients with schizophrenia and compare it to healthy controls. The secondary objective was to explore factors related to social cognitive complaints in these patients, such as neurocognition, clinical symptoms, depression, and insight.

Methods

A cross-sectional study conducted between July 2019 and March 2020 at the Psychiatric Hospital of the Cross (HPC)-Lebanon enrolled 120 chronic in-patients diagnosed with schizophrenia and schizoaffective disorders and 60 healthy controls. The Self-Assessment of Social Cognition Impairments (ACSo) scale was used to assess social cognitive complaints.

Results

A significant difference was found between schizophrenia patients and healthy controls in all social cognitive complaints: theory of mind complaint, attributional biases complaint, emotional processes complaint, and social perception and knowledge complaint (p < 0.001 for all). All objective cognitive disorders were significantly associated with social cognitive complaints except for attention and speed of information processing. Higher verbal memory and verbal fluency were significantly associated with lower emotional processes complaint scores. The results of the multivariate analysis showed that a higher cognition (Beta = −0.08, p = 0.001) was significantly associated with a lower social cognitive complaint, contrary a higher depression (Beta = 0.38, p = 0.04) was significantly associated with a higher social cognitive complaint, in particular attributional biases complaints.

Conclusion

This study showed that patients with schizophrenia have complaints about their social cognition. It could also demonstrate that subjective social cognitive complaints are correlated with depressive symptoms and objective cognitive deficits among these patients.

•

Individuals with schizophrenia often have impairments in social cognition

•

Despite low insight, patients report difficulties in their social cognitive skills.

•

A correlation exists between neurocognition and subjective social cognition in schizophrenia

•

Clinical symptoms (positive and negative symptoms) were not associated with social cognitive complaints

•

Social cognitive complaints might help in cognitive remediation and therapy

An Interview-Based Assessment of the Experience of Cognitive Impairment in Multiple Sclerosis: The Cognitive Assessment Interview (CAI)

Background: Cognitive impairment is a common feature of multiple sclerosis (MS). A semi-structured interview, including informant input, can characterize the experience of individuals living with MS and cognitive involvement.

Objective: We administered the Cognitive Assessment Interview (CAI), a patient- and informant-based semi-structured interview, to characterize the experience of cognitive impairments in those living with MS.

Methods: Trained raters administered the CAI to a sample of MS participants and their informants enrolled for a trial of cognitive remediation. Cognitive impairments on the CAI were characterized and compared to those captured by neuropsychological and self-report measures.

Results: A total of n = 109 MS participants (mean age = 50.3 ± 12.2) and their available informants (n = 71) were interviewed. Participants reported experiencing processing speed (90/106, 85%), working memory (87/109, 80%), and learning and memory (79/109, 72%) problems most commonly. CAI-based ratings were moderately correlated with a self-report measure (Multiple Sclerosis Neuropsychological Screening Questionnaire, r_s = 0.52, p < 0.001) and only mildly correlated with objective neuropsychological measures specific to executive functions (r_s = 0.21, p = 0.029). For those with informant interviews, ratings were overall consistent, suggesting that the CAI is valid even in cases in which an informant is unavailable and the interview is conducted with the patient alone (as is often the case in clinical and research settings).

Conclusions: The CAI provides a semi-structured interview to characterize the experience of cognitive impairment in MS, with findings representing real-world functioning, adding valuable information to both self-report measures and neuropsychological assessment.

Long-Term Benzodiazepine Prescription During Maintenance Therapy of Individuals With Psychosis Spectrum Disorders-Associations With Cognition and Global Functioning

BACKGROUND

Cognitive difficulties have a significant impact on life functioning and overall well-being in patients with psychosis spectrum disorders (PSDs). There are indications that continuous use of benzodiazepines (BZDs) in various patient groups has a detrimental effect on cognition. Our aim was to explore the association between long-term BZD prescription, global functioning, and cognitive functioning in persons with PSD.

METHODS

This exploratory study included 55 PSD patients, recruited from 2 outpatient services in Serbia. Patients were grouped into BZD long-term prescription group and BZD-other group. Brief Psychiatric Rating Scale was used for symptom assessment, functioning was measured by Global Assessment and Functioning Scale, and cognition was assessed by the Global Assessment of Functioning-Cognition in Schizophrenia Scale.

RESULTS

The sample comprised 52.7% patients who were prescribed with BZD for 6 months or more continually (29/55), with a mean daily dose of 3.16 ± 0.66 mg lorazepam equivalents. There were no differences between study groups in any of the sociodemographic characteristics, duration of illness, or antipsychotic daily dosages. The BZD long-term prescription group had lower global (P < 0.01) and cognitive functioning (P < 0.01), higher Brief Psychiatric Rating Scale scores (1.86 vs 1.58, respectively, P < 0.01), and more psychotropic drugs prescribed on a daily basis than the other group (median: 4 vs 2, respectively, P < 0.01).

CONCLUSIONS

The study explored a topic that continues to be underresearched, especially in the Balkans. Prospective studies and comprehensive cognitive batteries are needed to further elucidate the associations between polypharmacy, long-term BZD use, cognitive functioning, and global functioning during maintenance therapy of individuals with PSD.

Video games for people with schizophrenia

BACKGROUND

Commercial video games are a vastly popular form of recreational activity. Whilst concerns persist regarding possible negative effects of video games, they have been suggested to provide cognitive benefits to users. They are also frequently employed as control interventions in comparisons of more complex cognitive or psychological interventions. If independently effective, video games - being both engaging and relatively inexpensive - could provide a much more cost-effective add-on intervention to standard treatment when compared to costly, cognitive interventions.

OBJECTIVES

To review the effects of video games (alone or as an additional intervention) compared to standard care alone or other interventions including, but not limited to, cognitive remediation or cognitive behavioural therapy for people with schizophrenia or schizophrenia-like illnesses.

SEARCH METHODS

We searched the Cochrane Schizophrenia Group's Study-Based Register of Trials (March 2017, August 2018, August 2019).

SELECTION CRITERIA

Randomised controlled trials focusing on video games for people with schizophrenia or schizophrenia-like illnesses.

DATA COLLECTION AND ANALYSIS

Review authors extracted data independently. For binary outcomes we calculated risk ratio (RR) with its 95% confidence interval (CI) on an intention-to-treat basis. For continuous data we calculated the mean difference (MD) between groups and its CI. We employed a fixed-effect model for analyses. We assessed risk of bias for the included studies and created a 'Summary of findings' table using GRADE.

MAIN RESULTS

This review includes seven trials conducted between 2009 and 2018 (total = 468 participants, range 32 to 121). Study duration varied from six weeks to twelve weeks. All interventions in the included trials were given in addition to standard care, including prescribed medication. In trials video games tend to be the control for testing efficacy of complex, cognitive therapies; only two small trials evaluated commercial video games as the intervention. We categorised video game interventions into 'non-exergame' (played statically) and 'exergame' (the players use bodily movements to control the game). Our main outcomes of interest were clinically important changes in: general functioning, cognitive functioning, social functioning, mental state, quality of life, and physical fitness as well as clinically important adverse effects. We found no clear difference between non-exergames and cognitive remediation in general functioning scores (Strauss Carpenter Outcome Scale) (MD 0.42, 95% CI -0.62 to 1.46; participants = 86; studies = 1, very low-quality evidence) or social functioning scores (Specific Levels of Functioning Scale) (MD -3.13, 95% CI -40.17 to 33.91; participants = 53; studies = 1, very low-quality evidence). There was a clear difference favouring cognitive remediation for cognitive functioning (improved on at least one domain of MATRICS Consensus Cognitive Battery Test) (RR 0.58, 95% CI 0.34 to 0.99; participants = 42; studies = 1, low-quality evidence). For mental state, Positive and Negative Syndrome Scale (PANSS) overall scores showed no clear difference between treatment groups (MD 0.20, 95% CI -3.89 to 4.28; participants = 269; studies = 4, low-quality evidence). Quality of life ratings (Quality of Life Scale) similarly showed no clear intergroup difference (MD 0.01, 95% CI -0.40 to 0.42; participants = 87; studies = 1, very low-quality evidence). Adverse effects were not reported; we chose leaving the study early as a proxy measure. The attrition rate by end of treatment was similar between treatment groups (RR 0.96, 95% CI 0.87 to 1.06; participants = 395; studies = 5, low-quality evidence). One small trial compared exergames with standard care, but few outcomes were reported. No clear difference between interventions was seen for cognitive functioning (measured by MATRICS Consensus Cognitive Battery Test) (MD 2.90, 95% CI -1.27 to 7.07; participants = 33; studies = 1, low-quality evidence), however a benefit in favour of exergames was found for average change in physical fitness (aerobic fitness) (MD 3.82, 95% CI 1.75 to 5.89; participants = 33; studies = 1, low-quality evidence). Adverse effects were not reported; we chose leaving the study early as a proxy measure. The attrition rate by end of treatment was similar between treatment groups (RR 1.06, 95% CI 0.75 to 1.51; participants = 33; studies = 1). Another small trial compared exergames with non-exergames. Only one of our main outcomes was reported - physical fitness, which was measured by average time taken to walk 3 metres. No clear intergroup difference was identified at six-week follow-up (MD -0.50, 95% CI -1.17 to 0.17; participants = 28; studies = 1, very low-quality evidence). No trials reported adverse effects. We chose leaving the study early as a proxy outcome.

AUTHORS' CONCLUSIONS

Our results suggest that non-exergames may have a less beneficial effect on cognitive functioning than cognitive remediation, but have comparable effects for all other outcomes. These data are from a small number of trials, and the evidence is graded as of low or very low quality and is very likely to change with more data. It is difficult to currently establish if the more sophisticated cognitive approaches do any more good - or harm - than 'static' video games for people with schizophrenia. Where players use bodily movements to control the game (exergames), there is very limited evidence suggesting a possible benefit of exergames compared to standard care in terms of cognitive functioning and aerobic fitness. However, this finding must be replicated in trials with a larger sample size and that are conducted over a longer time frame. We cannot draw any firm conclusions regarding the effects of video games until more high-quality evidence is available. There are ongoing studies that may provide helpful data in the near future.

The clinical characterization of the patient with primary psychosis aimed at personalization of management

The current management of patients with primary psychosis worldwide is often remarkably stereotyped. In almost all cases an antipsychotic medica-tion is prescribed, with second-generation antipsychotics usually preferred to first-generation ones. Cognitive behavioral therapy is rarely used in the vast majority of countries, although there is evidence to support its efficacy. Psychosocial interventions are often provided, especially in chronic cases, but those applied are frequently not validated by research. Evidence-based family interventions and supported employment programs are seldom implemented in ordinary practice. Although the notion that patients with primary psychosis are at increased risk for cardiovascular diseases and diabetes mellitus is widely shared, it is not frequent that appropriate measures be implemented to address this problem. The view that the management of the patient with primary psychosis should be personalized is endorsed by the vast majority of clinicians, but this personalization is lacking or inadequate in most clinical contexts. Although many mental health services would declare themselves "recovery-oriented", it is not common that a focus on empowerment, identity, meaning and resilience is ensured in ordinary practice. The present paper aims to address this situation. It describes systematically the salient domains that should be considered in the characterization of the individual patient with primary psychosis aimed at personalization of management. These include positive and negative symptom dimensions, other psychopathological components, onset and course, neurocognition and social cognition, neurodevelopmental indicators; social functioning, quality of life and unmet needs; clinical staging, antecedent and concomitant psychiatric conditions, physical comorbidities, family history, history of obstetric complications, early and recent environmental exposures, protective factors and resilience, and internalized stigma. For each domain, simple assessment instruments are identified that could be considered for use in clinical practice and included in standardized decision tools. A management of primary psychosis is encouraged which takes into account all the available treatment modalities whose efficacy is supported by research evidence, selects and modulates them in the individual patient on the basis of the clinical characterization, addresses the patient's needs in terms of employment, housing, self-care, social relationships and education, and offers a focus on identity, meaning and resilience.

Identifying fear of childbirth in a UK population: qualitative examination of the clarity and acceptability of existing measurement tools in a small UK sample

Background

Fear of childbirth is related to but not synonymous with general anxiety, and represents a superior predictor for maternal and infant outcomes. There is a need to improve the identification and provision of support for women experiencing high fear of childbirth. However it is uncertain as to whether existing measurement tools have appropriate content validity (i.e. cover the relevant domains within the construct), practical utility, and whether they are acceptable for use with a UK population. This study aimed to (1) identify the utility and acceptability of existing measures of fear of childbirth (FOC) with a small UK sample and (2) map the content of existing measures to the key concepts of fear of childbirth established by previous research.

Methods

Ten pregnant women; five with high and five with low fear of childbirth participated in a cognitive interview covering four most commonly used measures of fear of childbirth: 1. The Wijma Delivery Expectancy Questionnaire (WDEQ A), 2. The Oxford Worries about Labour Scale (OWLS), 3. The Slade-Pais Expectations of Childbirth Scale – fear subscale (SPECS) and 4. The Fear of Birth scale (FOBS). Each measure was also reviewed by participants for ease and clarity of understanding and acceptability. The measures were then reviewed against the key domains identified in the fear of childbirth literature to ascertain the adequacy of content validity of each measure. Interviews were analysed using thematic analysis for each scale item.

Results

All measures except the FOBS, included items that either women did not understand or, if where there was understanding the meanings were inconsistent across women. All measures demonstrated limited acceptability and content validity for the specific construct of FOC. Therefore, none of the measurement tools currently used within the UK met criteria for understanding, acceptability and content validity for measurement of FOC.

Conclusions

Findings emphasise a need to develop a specific fear of childbirth tool with good clarity which demonstrates appropriate content validity, and that is acceptable in presentation and length for pregnant women in a UK population.

Nicotine effects on cognitive remediation training outcome in people with schizophrenia: A pilot study

Cognitive remediation training can alleviate cognitive impairment associated with schizophrenia, but the impact is limited by small effect sizes. The present study aimed at augmenting training effects by administering nicotine prior to training sessions. Twenty-five people with schizophrenia were enrolled in a 10-week, 5 days/week, computerized cognitive training regimen. Participants were randomized to two treatment groups: nicotine or placebo. Every Monday and Thursday, the nicotine group received a nicotine lozenge before the training, and the placebo group a placebo lozenge. Outcome measurements were conducted on a no-lozenge day in weeks 0, 4, 7, and 10, and at 4-week follow-up. The MATRICS Consensus Cognitive Battery composite score improved over time, but there was no group difference in this effect. A significant group difference emerged over time in the reasoning/problem solving sub-domain: the placebo group improved but not the nicotine group, suggesting that nicotine exposure negatively impacted training benefits on executive control processes. There were no effects on psychiatric symptoms. However, significant improvements were seen across groups on the Quality of Life Scale and the Cognitive Assessment Interview, measuring real-life functional outcome. In conclusion, the present study failed to find evidence that nicotine exposure during cognitive remediation training may potentiate training benefits.

Depressive Temperament in Relatives of Patients with Schizophrenia Is Associated with Suicidality in Patients with Schizophrenia

Objective

Suicide is a major cause of death in patients with schizophrenia; thus, predicting and preventing suicide in patients with schizophrenia is examined in various studies. Affective temperaments which are accepted as precursors of mood disorders may be an important factor in predicting suicidality. This study investigated the relationship between affective temperaments of relatives of schizophrenia patients and suicidal thoughts and other clinical correlates of patients with schizophrenia.

Methods

Patients with schizophrenia and their first degree relatives are included to the study. All of the participants were evaluated with Structured Clinical Interview for DSM-IV axis I disorders and relatives with active psychiatric diagnosis were excluded. Positive and Negative Symptom Scale, Clinical Global Impression Scale, Turkish version of cognitive assessment interview were administered congruently to the patients. Relatives of the patients were evaluated with Temperament Evaluation of Memphis, Pisa, Paris and San Diego-Auto-questionnaire.

Results

Depressive temperament scores of relatives of schizophrenic patients who had suicidal thoughts were higher than the scores of the relatives of the patients who did not have suicidal thoughts. Depressive temperament also predicted number of suicide attempts in regression analysis. Number of suicide attempts was also related with number of hospitalization and functionality of the patient.

Conclusion

Suicidality in schizophrenia is related with relatives’ affective temperaments and patients’ own positive symptom scores. The relationship between suicidal thoughts and depressive temperament is high lightened in this study

A 10-minute measure of global cognition: Validation of the Brief Cognitive Assessment Tool for Schizophrenia (B-CATS)

INTRODUCTION

Schizophrenia is marked by a global cognitive impairment that contributes significantly to chronic disability and unemployment. As new treatments are developed for cognition in schizophrenia, clinicians require easily administered instruments to assess cognition. We previously developed a very brief cognitive battery (Bell et al., 2005). The Brief Cognitive Assessment Tool for Schizophrenia (B-CATS) was developed specifically to provide clinicians with a way to assess cognition in their patients with schizophrenia. Here, we report the results of a validity study comparing B-CATS to a larger neurocognitive battery, the Measurement and Treatment Research to Improve Cognition in Schizophrenia (MATRICS) battery.

METHODS

Outpatients with schizophrenia (N=91) were administered the B-CATS and the non-overlapping tests of the MATRICS battery at two time points separated by 1month. They were also administered the UCSD Performance-based Skills Assessment-Brief (UPSA-B), a measure of functional capacity.

RESULT

The B-CATS has an administration time of approximately 10min. It demonstrates good test-retest reliability and internal consistency. It correlates 0.76 (p<0.01) with the MATRICS battery. The shorter B-CATS and the MATRICS battery correlate with the UPSA-B at 0.50 and 0.58 respectively.

CONCLUSION

A 10-minute version of the B-CATS correlates highly with the "gold standard" neurocognitive battery that has an administration time of over 60min. Both measures correlate moderately with a measure of functional capacity. This brief battery was designed to allow clinicians to monitor cognitive change and better inform treatment decisions.

Issues and developments related to assessing function in serious mental illness

Serious mental illness (SMI) results in functional disability that imposes a significant burden on individuals, caregivers, and society. Development of novel treatments is under way in an effort to improve the illness domains of cognitive impairment and negative symptoms and subsequently to improve functional outcomes. The assessment of functional outcomes in SMI faces a number of challenges, including the proliferation of assessment instruments and the differential prioritization of functional goals among stakeholder groups. Functional assessments relying on self- and informant report present a number of limitations. Identifying alternative strategies to assess functioning that are reliable, valid, and sensitive to change is necessary for use in clinical trials. Measures of functional capacity have been proposed for clinical trials investigating compounds to treat cognitive impairment in schizophrenia. Alternative approaches employing effort-based decision making or daily activity recording using instruments such as the Daily Activity Report may be more appropriate for studies focused on improving negative symptoms.

The Cognitive Assessment Interview: A comparative study in first episode and chronic patients with psychosis

The Cognitive Assessment Interview (CAI) is an interview-based instrument to assess cognition considering the impact of cognitive impairment on daily activities. We aimed to explore the associations of the Spanish version of the CAI (CAI-Sp) with a neuropsychological battery and a measure of psychosocial functioning in psychosis. The sample consisted of fifty-six first episode psychosis (FEP) patients and 66 non-FEP patients, who were assessed with a neuropsychological battery, the CAI-Sp and the Short Disability Schedule (DAS-S). Patients also underwent clinical assessment. Additionally, 37 controls were assessed with the neuropsychological battery and CAI-Sp, for normalization purposes. The results showed that CAI-Sp scores were overall correlated with the neuropsychological battery in non-FEP patients. In FEP patients, we found fewer significant correlations. Most associations were maintained after controlling for clinical symptoms. CAI-Sp rater scores contributed to the variance in the DAS-S scores in both groups, as did negative and disorganized symptoms. The CAI-Sp may be a good instrument to assess cognition in non-FEP patients. In FEP patients, it was less effective in capturing cognitive impairments and their functional consequences, probably because cognitive deficits have yet to become evident, due to the recency of illness onset, and no functional disturbances were observed due to these cognitive impairments.

Using the cognitive assessment interview to screen cognitive impairment in psychosis

Cognitive impairment in psychosis is closely related to functional outcome, so research into psychotic disorders is focusing most effort on treatments for improving cognition. New treatments must show not only an improvement on neuropsychological tests but also in co-primary measures of cognition. The cognitive assessment interview (CAI) is an interview-based measure of cognition which assesses the impact of cognitive deficits in patients' daily lives. Information obtained from patients and their relatives is integrated into a rater composite score. This study examines the validity of the CAI (adapted to Spanish, CAI-Sp) as a screening instrument for cognitive impairment, compared to an objective test of cognitive functioning. The psychometric properties of the CAI-Sp and its association with clinical dimensions are also explored. Eighty-one patients with a psychotic disorder and 38 healthy controls were assessed using the CAI-Sp and the screen for cognitive impairment in psychiatry (SCIP-S). Patients also underwent a clinical assessment. Poorer cognitive functioning as assessed with the CAI-Sp was associated to illness severity, specifically positive, negative and disorganised syndromes. Binary logistic regression showed that the CAI-Sp was able to detect cognitive impairment in patients, when considering CAI-Sp patient and informant information and CAI-Sp rater scores. The CAI-Sp was found to be a valid and reliable scale to assess cognitive functioning in the context of its impact on daily living. Given its ease and speed of application, the CAI-Sp could prove useful in clinical practice, though not a substitute of objective cognitive testing.

Validation of a Computerized test of Functional Capacity

Regulatory guidance for schizophrenia cognition clinical trials requires that the assessment of cognitive change is accompanied by a functionally meaningful endpoint. However, currently available measures are challenged by resistance to change, psychometric weaknesses, and for interview-based assessments, dependence upon the presence of an informant. The aims of the current study were to: 1) assess the validity, sensitivity, and reliability of the Virtual Reality Functional Capacity Assessment Tool (VRFCAT) as a measure of functional capacity; 2) determine the association between performance on the VRFCAT and performance on the MATRICS Consensus Cognitive Battery (MCCB); and 3) compare the metrics of the VRFCAT with the UCSD Performance-based Skills Assessment (UPSA). 167 patients with schizophrenia and 166 healthy controls completed the VRFCAT, UPSA, and the MCCB at baseline. The VRFCAT and UPSA were completed again at follow-up. The VRFCAT, MCCB, and UPSA were very sensitive to impairment in schizophrenia (d=1.16 to 1.22). High test-retest reliability was demonstrated for VRFCAT total completion time and the UPSA total score in patients (ICC=0.81 and 0.78, respectively). The UPSA demonstrated significant practice effects in patients (d=0.35), while the VRFCAT did not (d=-0.04). VRFCAT total completion time was correlated with both UPSA (r=-0.56, p<0.0001 for patients and -0.58, p<0.0001 for controls) and MCCB Composite (r=-0.57, p<0.0001 for patients and -0.68, p<0.0001 for controls). The VRFCAT is a highly reliable and sensitive measure of functional capacity with associations to the UPSA and MCCB. These results provide encouraging support for a computerized functional capacity assessment for use in schizophrenia.

Cognitive Assessment Interview (CAI): Validity as a co-primary measure of cognition across phases of schizophrenia

BACKGROUND

Progress has been made in developing interview-based measures for the assessment of cognitive functioning, such as the Cognitive Assessment Interview (CAI), as co-primary measures that compliment objective neurocognitive assessments and daily functioning. However, a few questions remain, including whether the relationships with objective cognitive measures and daily functioning are high enough to justify the CAI as an co-primary measure and whether patient-only assessments are valid.

METHODS

Participants were first-episode schizophrenia patients (n=60) and demographically-similar healthy controls (n=35), chronic schizophrenia patients (n=38) and demographically similar healthy controls (n=19). Participants were assessed at baseline with an interview-based measure of cognitive functioning (CAI), a test of objective cognitive functioning, functional capacity, and role functioning at baseline, and in the first episode patients again 6 months later (n=28).

RESULTS

CAI ratings were correlated with objective cognitive functioning, functional capacity, and functional outcomes in first-episode schizophrenia patients at similar magnitudes as in chronic patients. Comparisons of first-episode and chronic patients with healthy controls indicated that the CAI sensitively detected deficits in schizophrenia. The relationship of CAI Patient-Only ratings with objective cognitive functioning, functional capacity, and daily functioning were comparable to CAI Rater scores that included informant information.

CONCLUSIONS

These results confirm in an independent sample the relationship of the CAI ratings with objectively measured cognition, functional capacity, and role functioning. Comparison of schizophrenia patients with healthy controls further validates the CAI as an co-primary measure of cognitive deficits. Also, CAI change scores were strongly related to objective cognitive change indicating sensitivity to change.

Report on ISCTM Consensus Meeting on Clinical Assessment of Response to Treatment of Cognitive Impairment in Schizophrenia

If treatments for cognitive impairment are to be utilized successfully, clinicians must be able to determine whether they are effective and which patients should receive them. In order to develop consensus on these issues, the International Society for CNS Clinical Trials and Methodology (ISCTM) held a meeting of experts on March 20, 2014, in Washington, DC. Consensus was reached on several important issues. Cognitive impairment and functional disability were viewed as equally important treatment targets. The group supported the notion that sufficient data are not available to exclude patients from available treatments on the basis of age, severity of cognitive impairment, severity of positive symptoms, or the potential to benefit functionally from treatment. The group reached consensus that cognitive remediation is likely to provide substantial benefits in combination with procognitive medications, although a substantial minority believed that medications can be administered without nonpharmacological therapy. There was little consensus on the best methods for assessing cognitive change in clinical practice. Some participants supported the view that performance-based measures are essential for measurement of cognitive change; others pointed to their cost and time requirements as evidence of impracticality. Interview-based measures of cognitive and functional change were viewed as more practical, but lacking validity without informant involvement or frequent contact from clinicians. The lack of consensus on assessment methods was viewed as attributable to differences in experience and education among key stakeholders and significant gaps in available empirical data. Research on the reliability, validity, sensitivity, and practicality of competing methods will facilitate consensus.

Factors influencing self-assessment of cognition and functioning in bipolar disorder: a preliminary study

INTRODUCTION

Self-assessment deficits are common in schizophrenia and span multiple aspects of functioning, including awareness of symptoms, and the ability to assess objective levels of cognitive deficits and everyday functioning. Whereas impaired awareness of illness in bipolar disorder during symptomatic periods is well understood, awareness of disability and cognitive deficits has been less well studied.

METHODS

In this pilot study, 30 patients with a lifetime history of bipolar I disorder and current bipolar depression completed performance-based tests of cognition and functional capacity and self-reported their opinions of their cognitive abilities, everyday functioning and symptoms. High contact clinicians also provided impressions of the patients' cognitive performance and everyday functioning.

RESULTS

Clinician impressions of cognition and everyday functioning were correlated with the results of the performance-based assessments, whereas the patient self-reports of cognition and functioning were uncorrelated both with their own performance and with the clinician impressions. However, severity of depressive symptoms was correlated with self-reports of functioning in cognitive and functional domains, but not with either performance-based data or clinician impressions of cognition or functioning.

CONCLUSIONS

Depression appears to be a factor affecting self-assessment in bipolar disorder and reports of cognition and functioning were minimally related to objective information and clinician impressions. Symptoms of mania were minimal and not correlated with performance-based assessments or clinician impressions.

Self-assessment in schizophrenia: Accuracy of evaluation of cognition and everyday functioning

OBJECTIVE

Self-assessment deficits, often referred to as impaired insight or unawareness of illness, are well established in people with schizophrenia. There are multiple levels of awareness, including awareness of symptoms, functional deficits, cognitive impairments, and the ability to monitor cognitive and functional performance in an ongoing manner. The present study aimed to evaluate the comparative predictive value of each aspect of awareness on the levels of everyday functioning in people with schizophrenia.

METHOD

We examined multiple aspects of self-assessment of functioning in 214 people with schizophrenia. We also collected information on everyday functioning rated by high contact clinicians and examined the importance of self-assessment for the prediction of real-world functional outcomes. The relative impact of performance-based measures of cognition, functional capacity, and metacognitive performance on everyday functioning was also examined.

RESULTS

Misestimation of ability emerged as the strongest predictor of real-world functioning and exceeded the influences of cognitive performance, functional capacity performance, and performance-based assessment of metacognitive monitoring. The relative contribution of the factors other than self-assessment varied according to which domain of everyday functioning was being examined, but, in all cases, accounted for less predictive variance.

CONCLUSION

These results underscore the functional impact of misestimating one's current functioning and relative level of ability. These findings are consistent with the use of insight-focused treatments and compensatory strategies designed to increase self-awareness in multiple functional domains.

Reliability, validity and treatment sensitivity of the Schizophrenia Cognition Rating Scale

Cognitive functioning can be assessed with performance-based assessments such as neuropsychological tests and with interview-based assessments. Both assessment methods have the potential to assess whether treatments for schizophrenia improve clinically relevant aspects of cognitive impairment. However, little is known about the reliability, validity and treatment responsiveness of interview-based measures, especially in the context of clinical trials. Data from two studies were utilized to assess these features of the Schizophrenia Cognition Rating Scale (SCoRS). One of the studies was a validation study involving 79 patients with schizophrenia assessed at 3 academic research centers in the US. The other study was a 32-site clinical trial conducted in the US and Europe comparing the effects of encenicline, an alpha-7 nicotine agonist, to placebo in 319 patients with schizophrenia. The SCoRS interviewer ratings demonstrated excellent test-retest reliability in several different circumstances, including those that did not involve treatment (ICC> 0.90), and during treatment (ICC>0.80). SCoRS interviewer ratings were related to cognitive performance as measured by the MCCB (r=-0.35), and demonstrated significant sensitivity to treatment with encenicline compared to placebo (P<.001). These data suggest that the SCoRS has potential as a clinically relevant measure in clinical trials aiming to improve cognition in schizophrenia, and may be useful for clinical practice. The weaknesses of the SCoRS include its reliance on informant information, which is not available for some patients, and reduced validity when patient's self-report is the sole information source.

Factors influencing self-assessment of cognition and functioning in schizophrenia: implications for treatment studies

Awareness of illness is a major factor in schizophrenia and extends into unawareness of cognitive and functional deficits. This unawareness of functional limitations has been shown to be influenced by several different predictive factors, including greater impairment and less severe depression. As treatment efforts are aimed at reducing cognitive deficits, discovery of the most efficient assessment strategies for detection of cognitive and functional changes is critical. In this study, we collected systematic assessments from high contact clinicians focusing on their impressions of the cognitive deficits and everyday functioning in a sample of 169 community dwelling patients with schizophrenia. The patients provided self-report on those same rating scales, as well as self-reporting their depression and performing an assessment of cognitive performance and functional skills. There was essentially no correlation between patients' self-reports of their cognitive performance and functional skills and either clinician ratings of these skills or the results of the performance-based assessments. In contrast, clinician reports of cognitive impairments and everyday functioning were correlated with objective performance data. Depression on the part of patients was associated with ratings of functioning that were both more impaired and more congruent with clinician impressions, while overall patients reported less impairment than clinicians. These results underscore the limitations of self-reported cognitive functioning even with structured rating scales. Concurrently, clinicians provided ratings of cognitive performance that were related to scores on objective tests, even though they were unaware of the results of those assessments.

Cognitive deficit awareness in schizophrenia: absent, intact, or somewhere in-between?

INTRODUCTION

Cognitive impairment is a pervasive feature of schizophrenia, and is a major determinant of the functional disability that is characteristic of the disorder. However, research investigating whether patients with schizophrenia show a deficit awareness remains unclear. The present study aimed to replicate and extend previous research comparing subjective and objective measures of cognition.

METHODS

. Thirty patients with a diagnosis of schizophrenia or schizoaffective disorder were administered the subjectively assessed Schizophrenia Cognitive Rating Scale (SCoRS) and the objective Brief Assessment of Cognition in Schizophrenia (BACS), which each assess overall global functioning and four specific neurocognitive domains (i.e., Verbal Memory, Working Memory, Processing Speed, and Reasoning and Problem Solving). Because deficit awareness may influence the likelihood of patients engaging in treatments designed to improve cognitive functioning, patients' attitudes towards such therapies were also contrasted with these subjective and objective measures of cognitive functioning.

RESULTS

Patients' subjective appraisals did not significantly correlate with the objective neuropsychological assessments for global functioning or any specific neurocognitive domains. However, patients accurately deduced that their memory domains were more impaired than the other domains, and there was a trend for patients to exaggerate their Reasoning and Problem Solving deficits. This suggests that patients show some level of deficit awareness, when overestimating "deficits" for domains that are not impaired. Finally subjective, but not objective, measures of cognitive functioning correlated significantly with willingness to participate in cognitive-enhancing therapies.

CONCLUSIONS

These results suggest that although patients' perceptions of their cognitive function are no substitute for objective neuropsychological test data, patients do possess a level of deficit awareness which may, in turn, influence willingness to participate in interventions such as cognitive rehabilitation.