A qualitative investigation of the Montgomery-Åsberg depression rating scale: discrepancies in rater perceptions and data trends in remote assessments of rapid-acting antidepressants in treatment resistant depression

Introduction

Despite the development of many successful pharmaceutical interventions, a significant subset of patients experience treatment-resistant depression (TRD). Ketamine and its derivatives constitute a novel therapeutic approach to treat TRD; however, standard tools, such as the Montgomery-Åsberg Depression Rating Scale (MADRS) are still being used to measure symptoms and track changes.

Methods

The aim of this study was to review item-level differences between rate of data change (MADRS score) and rater-weighted perception of the most useful items for assessing change in symptoms while remotely conducting the 10-item version of the MADRS in TRD in a clinical trial of rapid-acting antidepressants. Two studies of rapid-acting antidepressants in the treatment of TRD were used to identify item-scoring trends when MADRS is administered remotely and repeatedly (733 subjects across 10 visits). Scoring trends were evaluated in tandem to a rater survey completed by 75 raters. This was completed to gain insight on MADRS items' perceived level of helpfulness when assessing change of symptoms in rapid-acting antidepressant trials.

Results

MADRS items 'Reduced sleep', 'Apparent sadness', and 'Pessimistic thoughts' were found to have the greatest average data change by visit, while raters ranked 'Reported sadness', 'Lassitude' and 'Apparent sadness' as the most helpful items when assessing symptom change.

Discussion

The diversion between rate of data-change ranking and rater perception of helpfulness could be related to difficulty in assessing specific items, to the novel treatment itself, and/or to the sensitivity to symptom change to which raters are accustomed in traditional antidepressant treatments.

Are informants required to obtain valid ratings on the Positive and Negative Syndrome Scale (PANSS)?

Ratings on the Positive and Negative Syndrome Scale (PANSS) are ideally based on both a patient interview and an informant questionnaire. In research and clinical settings, however, the informant questionnaire is often omitted. This study investigated the consequences of omitting informant information by comparing PANSS ratings of patients with schizophrenia (n = 49 patients, 77 ratings) conducted with and without informant information, respectively. Additionally, changes in symptom severity over time based on ratings with and without informant information were also compared for the full PANSS and the six-item version of the PANSS (PANSS-6). PANSS ratings including informant information were higher than those without, both at the total score and individual item level. Additionally, the full PANSS appeared less "responsive" to baseline-to-endpoint changes for ratings without informant information compared to ratings including informant information, while no differences were found for the PANSS-6.

Recommendations for selection and adaptation of rating scales for clinical studies of rapid-acting antidepressants

The novel mechanisms of action (MOA) derived from some recently introduced molecular targets have led to regulatory approvals for rapid acting antidepressants (RAADs) that can generate responses within hours or days, rather than weeks or months. These novel targets include the N-methyl-D-glutamate receptor antagonist ketamine, along with its enantiomers and various derivatives, and the allosteric modulators of gamma-aminobutyric acid (GABA) receptors. There has also been a strong resurgence in interest in psychedelic compounds that impact a range of receptor sites including D1, 5-HT7, KOR, 5-HT5A, Sigma-1, NMDA, and BDNF. The RAADs developed from these novel targets have enabled successful treatment for difficult to treat depressed individuals and has generated a new wave of innovation in research and treatment. Despite the advances in the neurobiology and clinical treatment of mood disorders, we are still using rating instruments that were created decades ago for drugs from a different era (e.g., The Hamilton and Montgomery-Åsberg depression rating scales, HDRS, and MADRS) continue to be used. These rating instruments were designed to assess mood symptoms over a 7-day time frame. Consequently, the use of these rating instruments often requires modifications to address items that cannot be assessed in short time frames, such as the sleep and appetite items. This review describes the adaptative approaches that have been made with the existing scales to meet this need and examines additional domains such as daily activities, side effects, suicidal ideation and behavior, and role functioning. Recommendations for future studies are described, including the challenges related to implementation of these adapted measures and approaches to mitigation.

Clinical Outcome Assessment Instruments in Schizophrenia: A Scoping Literature Review with a Focus on the Potential of Patient-reported Outcomes

Objective

The complexity inherent in the treatment of schizophrenia results in a multitude of outcome assessments being employed when conducting clinical trials. Subjective outcome assessments and minimal clinically important differences (MCIDs) to evaluate clinical meaningfulness have gained traction; however, the extent of application in evaluation of treatments for schizophrenia is unknown. A scoping review was conducted to assess the availability of published psychometric evaluations, including MCIDs, for clinical outcome assessments used to evaluate treatments for schizophrenia.

Method of Research

Key databases (PubMed®, Embase®, APA PsycINFO®, International Society for Pharmacoeconomics and Outcomes Research) were searched for studies on schizophrenia published from 2010 to 2020. Secondary sources (ClinicalTrials.gov, PROLABELS™, FDA.gov) were also reviewed. Clinical outcome assessments were organized by type (patient-reported outcomes [PROs], clinician-reported outcomes [ClinROs], observer-reported outcomes [ObsROs]) and further classified by intended use (generic, mental health, schizophrenia). Reliability and internal consistency were evaluated using Cronbach's α. External validity was evaluated by intraclass correlation coefficient (ICC).

Results

Across 140 studies, 66 clinical outcome assessments were identified. MCIDs were reported for eight of the 66 studies. Of these, two were PROs (generic) and six were ClinROs/ObsROs (three mental health-specific, three schizophrenia-specific). Reliability was good across generic, mental health-specific, and schizophrenia-specific categories, whereas external validity was strong mainly for schizophrenia-specific PROs. Overall, ClinROs/ObsROs that focused on mental health had good reliability and strong external validity.

Conclusion

This review provides a comprehensive overview of the clinical outcome assessments used in schizophrenia research during the past ten years. Results highlight the heterogeneity of existing outcomes and a growing interest in PROs for schizophrenia.

Validation of ratings on the six-item Positive and Negative Syndrome Scale obtained via the Simplified Negative and Positive Symptoms Interview among outpatients with schizophrenia

BACKGROUND

The six-item Positive and Negative Syndrome Scale (PANSS-6) is a measure of the severity of core symptoms of schizophrenia, which can be administered via the brief Simplified Negative and Positive Symptoms Interview (SNAPSI). A recent study has confirmed the validity of PANSS-6 ratings as derived by SNAPSI (PANSS-6_SNAPSI) among inpatients with schizophrenia.

AIMS

We aimed to test the validity of PANSS-6_SNAPSI among outpatients with schizophrenia using PANSS-6 ratings extracted from the 30-item PANSS-30 as derived by the Structured Clinical Interview for the Positive and Negative Syndrome Scale (PANSS-6_SCI-PANSS) as a gold standard reference.

METHODS

PANSS-6_SNAPSI and PANSS-6_SCI-PANSS ratings were obtained at two time points by independent raters with established inter-rater reliability. Agreement between PANSS-6_SNAPSI and PANSS-6_SCI-PANSS ratings was estimated via intra-class coefficients (ICCs) and responsiveness over time was quantified using Spearman's rank correlation coefficients. Post hoc "leave-one-out" analyses were carried out, in which each rater in turn was excluded from the ICC calculations.

RESULTS

Seventy-three outpatients with schizophrenia participated in the study (mean age: 38.3 years; 56% males). The ICC for PANSS-6_SNAPSI versus PANSS-6_SCI-PANSS was 0.67 [95%CI = 0.56-0.76] and the Spearman's rank correlation coefficient for responsiveness was 0.40 (p = 0.004). When data from a specific outlying rater were excluded, the ICC for PANSS-6_SNAPSI versus PANSS-6_SCI-PANSS was 0.75 [95% CI = 0.63-0.83] and the Spearman's rank correlation coefficient for responsiveness was 0.55 (p = 0.018).

CONCLUSIONS

We found PANSS-6_SNAPSI ratings to have acceptable clinical validity, suggesting that PANSS-6_SNAPSI can be used for both inpatients and outpatients with schizophrenia.

Clinical validation of ratings on the six-item Positive and Negative Syndrome Scale obtained via the Simplified Negative and Positive Symptoms Interview

BACKGROUND

The six-item version of the Positive and Negative Syndrome Scale (PANSS-6) has shown promise as a brief measure of the severity of core symptoms of schizophrenia. However, since all prior analyses of the PANSS-6 were based on data extracted from studies using the full 30-item PANSS (PANSS-30), it remains unknown whether it is possible to obtain valid information for the PANSS-6 ratings via a brief interview, such as the Simplified Negative and Positive Symptoms Interview (SNAPSI).

AIMS

We aimed to validate the PANSS-6 ratings obtained via the SNAPSI using the PANSS-6 scores extracted from the PANSS-30 ratings obtained via the comprehensive Structured Clinical Interview for PANSS (SCI-PANSS) as the gold-standard reference.

METHODS

The PANSS-6 ratings based on the SNAPSI and the PANSS-30 ratings based on the SCI-PANSS were conducted by independent raters with established inter-rater reliability.

RESULTS

Seventy-seven inpatients with schizophrenia (M_age = 35.1 ± 11.7 years; males = 57%; paranoid schizophrenia = 75%) participated in the study. The intraclass correlation coefficient (ICC) of the PANSS-6 total scores obtained using the SNAPSI and the PANSS-30-derived PANSS-6 total scores via the SCI-PANSS was 0.77 (p < 0.001). The ICC for the PANSS-6 total score and the PANSS-30-derived PANSS-8 (Andreasen's remission criteria) was 0.75 (p < 0.001). Spearman's rank correlation coefficient for changes in PANSS-6 total scores via the SNAPSI and changes in PANSS-30-derived PANSS-6 total scores was 0.70 (p < 0.001).

CONCLUSIONS

Using the SNAPSI to rate the PANSS-6 enables a focused and brief assessment of the severity of core symptoms of schizophrenia, which facilitates measurement-based care and clinical decision making in the treatment of schizophrenia.

Clinical validation of the Symptom Self-rating Scale for Schizophrenia (4S) among inpatients

PURPOSE

Self-reports of psychosis-related symptoms may be a valuable supplement to clinician-ratings, but more validation studies are required. The aim of this study was to conduct clinical validation for the Symptom Self-rating Scale for Schizophrenia (4S) in an inpatient setting.

MATERIALS AND METHODS

Inpatients diagnosed with schizophrenia were invited to participate in the study. The participants completed the 4S, the 5-item World Health Organization Wellbeing Index (WHO-5) and the Sheehan Disability Scale (SDS) at two time points. Trained raters assessed participants using the 6-item Positive And Negative Syndrome Scale (PANSS-6). The relationship between the 4S and PANSS-6, self-reported side effects, functioning and wellbeing was assessed using Spearman's correlation coefficient (rho).

RESULTS

Sixty-one participants completed the 4S at least once (yielding a total of 91 completed 4S questionnaires). The 4S total score was weakly correlated with the PANSS-6 total score (rho = 0.37, p < 0.001). The rho's for individual 4S and PANSS-6 subscales and item comparisons ranged from -0.24 (thought disorder) to 0.69 (hallucinations). Finally, the 4S hallucination subscale was also sensitive to change. The 4S was strongly inversely correlated with wellbeing (WHO-5) and moderately inversely correlated with functioning (SDS total score).

CONCLUSION

The 4S holds promise as a valid self-report of core schizophrenia symptoms among inpatients. While the hallucination subscale seems superior to existing scales, the thought disorder subscale needs to be re-developed.

Standardized training in the rating of the six-item positive and negative syndrome scale (PANSS-6)

Introduction

The six-item Positive And Negative Syndrome Scale (PANSS-6) is short psychometric valid scale quantifying the severity of core schizophrenia symptoms. Using PANSS-6 to guide treatment decision-making requires that staff members’ ratings are valid and reliable.

Objectives

The objective of the study was to evaluate whether such valid and reliable PANSS-6 ratings can be obtained through a video-based training program.

Methods

One-hundred-and-four staff members from Aarhus University Hospital - Psychiatry, Denmark participated in the training. Participants conducted baseline PANSS-6 ratings based on a video of a patient being interviewed using the Simplified Positive And Negative Symptoms interview (SNAPSI). Subsequently, a theoretical introduction video was displayed followed by five SNAPSI patient interviews. After each SNAPSI video, individual ratings were performed before a video providing the gold standard scores was displayed. The validity of ratings was estimated by calculating the proportion of participants not deviating from the gold standard scores with >2 points on individual items or >6 points on the PANSS-6 total score. Reliability was evaluated after each step in the training by means of Gwet’s Agreement Coefficient (Gwet).

Results

By the end of the training, 72% of the participants rated within the acceptable deviations of the gold standard, ranging from 60% (nurses) to 91% (medical doctors/psychologists). The reliability improved (Gwet baseline vs. endpoint) for all PANSS-6 items, except for Blunted affect.

Conclusions

The majority of the staff members conducted valid PANSS-6 ratings after a brief standardized training program, supporting the implementation of PANSS-6 in clinical settings to facilitate measurement-based care.

Conflict of interest

Dr. Opler is a full-time employee of MedAvante-ProPhase Inc. Dr. Correll has been a consultant and/or advisor to or have received honoraria from: Acadia, Alkermes, Allergan, Angelini, Axsome, Gedeon Richter, Gerson Lehrman Group, Indivior, IntraCellular T

Standardized training in the rating of the six-item Positive And Negative Syndrome Scale (PANSS-6)

The six-item Positive And Negative Syndrome Scale (PANSS-6) allows for a brief assessment of the severity of core symptoms of schizophrenia. However, implementing the PANSS-6 in clinical practice requires that staff members' ratings are accurate and reliable. We aimed to investigate whether such accuracy and reliability can be obtained via a brief video-based training program. One-hundred-and-four staff members from a psychiatric hospital in Denmark participated in the training. Participants performed a baseline PANSS-6 rating based on a video of a patient being interviewed using the Simplified positive And Negative Symptoms interview (SNAPSI). Subsequently, a theoretical introduction video was displayed followed by five successive videotaped SNAPSI patient interviews. After each SNAPSI video, individual ratings were conducted before a video providing the gold standard rating was displayed. The accuracy of ratings was estimated by calculating the proportion of participants not deviating from the gold standard rating with >2 points on individual items or >6 points on the PANSS-6 total score. Reliability was tested after each step in the training by means of Gwet's Agreement Coefficient (Gwet). By the end of the training, 72% of the participants rated within the acceptable deviations of the gold standard, ranging from 60% (nurses) to 91% (medical doctors & psychologists). The reliability improved (Gwet baseline vs. endpoint) for all PANSS-6 items, except for Blunted affect. In conclusion, the majority of the staff members conducted accurate PANSS-6 ratings after a brief standardized training program, supporting the implementation of PANSS-6 in clinical settings to facilitate measurement-based care.

M35. CLINICAL VALIDATION OF THE SIX-ITEM POSITIVE AND NEGATIVE SYNDROME SCALE (PANSS-6)

Background

The development of the brief and psychometrically valid, six-item Positive and Negative Syndrome Scale (PANSS-6) holds promise to improve the treatment of schizophrenia by paving the way for implementation of measurement-based care. However, an important limitation to the existing studies of PANSS-6 is that PANSS-6 was extracted from studies in which the 30-item PANSS ratings were obtained through the Structured Clinical Interview (SCI-PANSS). Therefore, it remains unknown whether it is possible to extract sufficient and equally valid information for PANSS-6 rating via a brief and focused interview, which is a prerequisite for the utility of PANSS-6 in clinical practise. The Simplified Negative And Positive Symptoms Interview (SNAPSI) is a brief semi-structured interview, which focuses specifically on extracting information on the PANSS-6. The aim of the present study was to perform a clinical validation study of PANSS-6 ratings obtained via the SNAPSI using PANSS-30 ratings obtained via SCI-PANSS as a gold standard reference.

Methods

Participants were ≥18 years old, had a diagnosis of schizophrenia (ICD-10: F20.x) and were undergoing inpatient treatment at the Department for Psychosis, Aarhus University Hospital - Psychiatry, Denmark. The SNAPSI and the SCI-PANSS were conducted by trained and reliable independent interviewers, which was followed by independent PANSS-6 and PANSS-30 ratings at two time-points: as soon as possible after admission and as close to discharge as possible. The degree to which the PANSS-6 (rated independently using the SNAPSI) corresponds to PANSS-6 extracted from PANSS-30 (rated using the SCI-PANSS) was tested by means of intra-class correlation coefficient (ICC) analysis. The sensitivity to change was tested by comparing the endpoint-baseline change in the PANSS-6 total scores to the endpoint-baseline change in the PANSS-6 total scores extracted from the PANSS-30 ratings via Spearman correlation analysis.

Results

A total of 77 inpatients with schizophrenia (age=35.3, SD=11.8 years; males=56%, paranoid schizophrenia=79%) were included. Of these 65% (n=50) were rated at two time-points. Time to complete the SNAPSI was 18.1, SD=6.9 minutes. The mean score of PANSS-30 at baseline and at follow-up was 81.0, SD=15.9 and 71.8, SD=12.5, respectively. The mean score of PANSS-6 at baseline and follow-up was 18.8, SD=4.6 and 18.1, SD=4.0, respectively. The ICC between the PANSS-6 total scores obtained by the SNAPSI and the PANSS-6 total scores extracted from the PANSS-30 ratings was 0.77 [95% CI 0.62–0.85]. The absolute mean deviation between PANSS-6 ratings and PANSS-6 derived from PANSS-30 ratings was 0.7, SD=0.9. Three percent (n=4) of the PANSS-6 ratings deviated by more than a mean of 1 point i.e. >6 points on the PANSS-6 total score compared to the PANSS-6 derived from PANSS-30 ratings. The Spearman correlation coefficient for changes in endpoint-baseline PANSS-6 and PANSS-30 derived PANSS-6 total scores was 0.67, p<0.001. The full results of the study will be presented at the SIRS 2020 conference.

Discussion

We found an excellent level of correlation between the PANSS-6 total scores obtained via SNAPSI and the PANSS-6 total scores extracted from the PANSS-30 ratings obtained via SCI-PANSS. Also, the sensitivity to change reached a good level of agreement. In conclusion, the combination of SNAPSI and PANSS-6 allows for a brief and valid assessment of the severity of core symptoms of schizophrenia. These results hold promise for the implementation of measurement-based care in the treatment of schizophrenia.

Cross-cultural adaptation of the Arabic Positive and Negative Syndrome Scale in schizophrenia: Qualitative analysis of a focus group

As part of a project to translate and validate scales used in the diagnosis and treatment of Arab patients with schizophrenia, this study aimed to explore the experience of clinical research coordinators (CRCs) while administering the Arabic version of the Positive and Negative Syndrome Scale (PANSS) on Arab schizophrenia patients. We previously reported that the Arabic version of PANSS is a valid and reliable tool to assess Arab patients with schizophrenia. Five CRCs and the principal investigator attended focus group discussions on cultural issues in administering the PANSS. A thematic analysis approach was utilized for data coding and analysis. The results identified issues related to the translation of the instrument, the structure of the interview, the cultural sensitivity of some questions, and the procedures for rating items of the PANSS. Qualitative analysis also identified four main themes relevant to clinical assessment of patients from Middle Eastern cultures: religion, beliefs and values, gender, and semantic expressions. In conclusion, researchers or clinicians administering the PANSS scale interview in Arabic should be trained to consider the roles of local dialects, familiarity with abstract thinking, religion, and social constructs when assessing psychosis.

Adapting the Goal Attainment Approach for Major Depressive Disorder

The need for patient-centered care has become a focal point of healthcare improvement initiatives. Shared decision making-in which patients and clinicians communicate about various treatment options and goals and patient input is considered when making treatment decisions-has been associated with improved health and quality of life. A method of treatment evaluation allowing incorporation of patient-specific goals and perspectives is of increasing interest to healthcare providers, payers, and patients. An approach that allows incorporation of shared goal setting is possible via use of an instrument called the Goal Attainment Scale (GAS). This scale provides the structure for measuring progress toward treatment goals set through patient-clinician collaboration. The goal attainment approach has been used as a primary outcomes measure in numerous studies but not in major depressive disorder (MDD). As MDD is a complex, multidimensional disorder affecting each patient differently, the use of GAS methodology is a relevant framework for setting personalized meaningful treatment goals. Initial research into the feasibility of using the GAS in MDD (GAS-D) to measure patient-centric outcomes that may be neglected when more traditional scales are used has been encouraging. The objective of this Commentary is to provide background and rationale for implementation of the GAS-D in clinical practice.Funding Takeda Pharmaceutical Company, Ltd., and Lundbeck LLC.

Clinical Validation of the Autism Behavior Inventory: Caregiver-Rated Assessment of Core and Associated Symptoms of Autism Spectrum Disorder

There is a need for measures to track symptom change in autism spectrum disorder (ASD). We conducted a validation study on a revised version of the Autism Behavior Inventory (ABI), and a short form (ABI-S). Caregivers of individuals (6–54 years) with confirmed diagnoses of ASD (N = 144) completed the ABI and other rating scales at 4 time points. Scale consistency for each domain, 3–5 day test–retest reliability, and construct validity, determined by comparison to pre-specified scales, were all good. Change in the ABI was congruent with changes in other instruments. Collectively, results suggest incipient suitability of the ABI as a measure of changes in core and associated symptoms of ASD.

Trial Registration NCT02299700.

A new brief opioid stigma scale to assess perceived public attitudes and internalized stigma: Evidence for construct validity

One key strategy to improve treatment access for persons with opioid use disorder (OUD) is overcoming stigma that is internalized by such individuals. Because few theoretically-derived, multidimensional measures of substance abuse stigma exist, we contribute a brief, theoretically-based measure of opioid-related stigma (adapted from Corrigan's Self-Stigma of Mental Illness Scale) to assess perceived stigma and internalized stigma among individuals with OUD. This study presents initial validation of the newly-developed Brief Opioid Stigma Scale among 387 adults who entered an inpatient opioid managed-withdrawal program. The scale assesses: (1) Stereotype awareness ("Aware"), or the extent to which individuals who use opioids perceive community members to believe OUD-related stereotypes; (2) Stereotype agreement ("Agree"), or the endorsement of stigmatizing beliefs by individuals who use opioids; (3) Self-esteem decrement ("Harm"), or the diminution of self-esteem due to these negative stereotypes' impacts on self-worth. Psychosocial measures including self-esteem, depressive symptoms, mental and physical functioning, and desire for aftercare OUD medication treatment, were administered to assess construct validity. Results showed that greater endorsement of the "harm" stigma subscale was associated with greater depressive symptoms, lower self-esteem, and poorer mental and physical functioning. The "aware" stigma subscale displayed similar overall patterns of associations with self-esteem and depression but to a lesser magnitude. The "aware" stigma subscale was positively associated with desire for aftercare methadone and naltrexone treatment, and the "harm" subscale was positively associated with desire for aftercare buprenorphine treatment. Results indicated good initial construct validity. Tailored stigma interventions are recommended for specific aftercare OUD medication treatments.

Patient attitudes toward and goals for MDD treatment: a survey study

Background/Objectives: Major depressive disorder (MDD) is a highly prevalent disorder, frequently diagnosed and treated in a primary care setting; however, little information is available about the treatment decision-making process between MDD patients and their providers. A shared decision-making and goal attainment approach to establishing and tracking progress toward treatment goals that are meaningful to individual patients is explored in this survey study. In addition, information about patient perspectives on setting treatment goals, medication selection/switching, and engaging patients with their health care professionals was also collected and evaluated. Methods: A 50-question online survey was administered to members of the PatientsLikeMe community who indicated an MDD diagnosis and a switch in antidepressant medications within the past 2 years. Follow-up interviews were also conducted with a small subset of these participants. Results: Of the 200 participants who completed the survey, 42% reported currently having goals for MDD treatment. These goals were typically in the areas of physical health (62.7%), cognitive functioning (60.2%), and social aspects of life (57.8%). A majority of survey participants (61%) believed the goal attainment approach would be helpful to set and evaluate treatment goals. Conclusions: The data provide important insights into patient perspectives on the development of formal treatment plans and goals for MDD. In addition, the data also support the use of a patient-centric approach to shared decision-making by using a goal attainment scale to establish and track progress toward treatment goals that are meaningful to MDD patients in real-world clinical practice. The results of this study can be used to inform best practices in patient-clinician communication when developing an MDD treatment plan and goals.

Inter-rater reliability of ratings on the six-item Positive and Negative Syndrome Scale (PANSS-6) obtained using the Simplified Negative and Positive Symptoms Interview (SNAPSI)

PURPOSE

The six-item version of the Positive And Negative Syndrome Scale (PANSS-6) is a brief rating scale focusing on core symptoms of schizophrenia. In order to facilitate rating of PANSS-6 and selected items from other common psychiatric rating scales, we recently developed the Simplified Negative and Positive Symptoms Interview (SNAPSI). The objective of the present study was to test the inter-rater reliability of PANSS-6 ratings obtained using the SNAPSI.

MATERIALS AND METHODS

Using the SNAPSI, seven raters (psychiatrists, first-year psychiatry residents and psychologists) performed a total of 56 PANSS-6 ratings of 12 in- or outpatients with schizophrenia. As a measure of inter-rater reliability, we calculated the intra-class correlation coefficient (ICC, ≥0.75 = excellent, 0.40-0.74 = fair to good, <0.40 = poor) for the PANSS-6 total score and individual item scores. Furthermore, for the PANSS-6 total scores obtained by the six noncertified PANSS raters, we calculated the median deviation from the PANSS-6 total scores obtained by the only certified PANSS rater.

RESULTS

The ICC for the PANSS-6 total score was 0.74 (F = 2.84, p = .03). The ICCs for the six individual PANSS-6 items ranged from 0.45 (N6 - Lack of spontaneity & flow of conversation) to 0.76 (P3 - Hallucinatory behavior). The PANSS-6 total scores obtained by the six noncertified PANSS raters deviated by a median of 12.7% (interquartile range: 6.2-20.0) from the PANSS-6 total scores obtained by the certified PANSS rater.

CONCLUSIONS

We found a good level of inter-rater reliability of PANSS-6 ratings obtained using the SNAPSI for seven raters with varying levels of clinical and research experience.

The brief negative symptom scale (BNSS): Sensitivity to treatment effects

The Brief Negative Symptom Scale (BNSS) grew out of a recommendation by the NIMH-sponsored Consensus Development Conference on Negative Symptoms that a scale based on contemporary concepts be developed. We assessed sensitivity to change of the BNSS in a trial of MIN-101, which showed efficacy for negative symptoms (PANSS pentagonal model) at daily doses of 32 and 64mg/day. Using mixed-effects model for repeated measures, we examined change in BNSS total score and in the BNSS factors of anhedonia/avolition/asociality (AAA), and expressivity (EXP). Compared to placebo, the 64mg group (N=83) showed a significant decrease in BNSS total score (effect size d [ES] 0.56, p<0.01) and both factor scores (AAA ES=0.48, EXP ES=0.46, p<0.02 for both). Patients in the trial had minimal depression and positive symptom scores; covarying for disorganization, positive symptoms, or anxiety/depression did not cause a meaningful change in the significance of the BNSS total or factor scores in this group. The 32mg group (N=78) did not differ significantly from placebo (N=83) on BNSS total score (ES=0.33, p<0.09), AAA (ES=0.25, p<0.20) or EXP (ES=0.30, p<0.12) scores. These results demonstrate the BNSS is sensitive to change.

A Developmental History of the Positive and Negative Syndrome Scale (PANSS)

Psychometric instruments are products of their time-Their designs and initial purposes are influenced and shaped by the contemporary treatment regimens, context, and cultural and conceptual biases of their developers. In this review article, the authors explore the history of the most influential schizophrenia research tools that have been created over the past several decades. The authors describe the scientific concepts, cultural influences, and challenges of past and present researchers as they strive to develop better assessment tools for schizophrenia. Starting with Moore's Scheme for the Quantitative Measurement of Abnormal Emotional Condition, developed in the early 1900s, and concluding with Kay, Fiszbein, and Opler's Positive and Negative Syndrome Scale, developed in the 80s, the authors describe several scales and illustrate how each scale led to and influenced the development of a later scale. The authors hope that a better understanding of schizophrenia assessment tool evolution and limitations will assist in the development of new instruments that better address the global needs for the evaluation, research, and treatment of psychosis.

Consistency checks to improve measurement with the Positive and Negative Syndrome Scale (PANSS)

International Society for CNS Clinical Trials and Methodology convened an expert working-group that assembled consistency/inconsistency flags for the Positive and Negative Syndrome Scale (PANSS). Twenty-four flags were identified and divided based on extent to which they represent error (Possibly, Probably, Very probably or definitely). The flags were applied to assessments derived from the NEWMEDS data repository and the CATIE clinical trial data. Almost 40% of ratings had at least one inconsistency flag raised and 10% had two. Application of flags to clinical rating can improve reliability and validity of trials.

Autism Behavior Inventory: A Novel Tool for Assessing Core and Associated Symptoms of Autism Spectrum Disorder

OBJECTIVE

Autism Behavior Inventory (ABI) is a new measure for assessing changes in core and associated symptoms of autism spectrum disorder (ASD) in participants (ages: 3 years-adulthood) diagnosed with ASD. It is a web-based tool with five domains (two ASD core domains: social communication, restrictive and repetitive behaviors; three associated domains: mental health, self-regulation, and challenging behavior). This study describes design, development, and initial psychometric properties of the ABI.

METHODS

ABI items were generated following review of existing measures and inputs from expert clinicians. Initial ABI scale contained 161 items that were reduced to fit a factor analytic model, retaining items of adequate reliability. Two versions of the scale, ABI-full (ABI-F; 93 items) and ABI-short version (ABI-S; 36 items), were developed and evaluated for psychometric properties, including validity comparisons with commonly used measures. Both scales were administered to parents and healthcare professionals (HCPs) involved with study participants.

RESULTS

Test-retest reliability (intraclass correlation coefficient [ICC] = 0.79) for parent ratings on ABI was robust and compared favorably to existing scales. Test-retest correlations for HCP ratings were generally lower versus parent ratings. ABI core domains and comparison measures strongly correlated (r ≥ 0.70), demonstrating good concurrent validity.

CONCLUSIONS

Overall, ABI demonstrates promise as a tool for measuring change in core symptoms of autism in ASD clinical studies, with further validation required.

Live birth sex ratios and father's geographic origins in Jerusalem, 1964-1976

OBJECTIVE

To examine whether ancestry influenced sex ratios of offspring in a birth cohort before parental antenatal sex selection influenced offspring sex.

METHODS

We measured the sex ratio as the percent of males according to countries of birth of paternal and maternal grandfathers in 91,459 live births from 1964 to 1976 in the Jerusalem Perinatal Study. Confidence limits (CI) were computed based on an expected sex ratio of 1.05, which is 51.4% male.

RESULTS

Of all live births recorded, 51.4% were male. Relative to Jewish ancestry (51.4% males), significantly more males (1,761) were born to Muslim ancestry (54.5, 95% CI = 52.1-56.8, P = 0.01). Among the former, sex ratios were not significantly associated with paternal or maternal age, education, or offspring's birth order. Consistent with a preference for male offspring, the sex ratio decreased despite increasing numbers of births over the 13-year period. Sex ratios were not affected by maternal or paternal origins in North Africa or Europe. However, the offspring whose paternal grandfathers were born in Western Asia included fewer males than expected (50.7, 50.1-51.3, P = 0.02), whether the father was born abroad (50.7) or in Israel (50.8). This was observed for descendents of paternal grandfathers born in Lebanon (47.6), Turkey (49.9), Yemen & Aden (50.2), Iraq (50.5), Afghanistan (50.5), Syria (50.6), and Cyprus (50.7); but not for those from India (51.5) or Iran (51.9). The West Asian group showed the strongest decline in sex ratios with increasing paternal family size.

CONCLUSIONS

A decreased sex ratio associated with ancestry in Western Asia is consistent with reduced ability to bear sons by a subset of Jewish men in the Jerusalem cohort. Lower sex ratios may be because of pregnancy stress, which may be higher in this subgroup. Alternatively, a degrading Y chromosome haplogroup or other genetic or epigenetic differences on male germ lines could affect birth ratios, such as differential exposure to an environmental agent, dietary differences, or stress. Differential stopping behaviors that favor additional pregnancies following the birth of a daughter might exacerbate these lower sex ratios.

Validation of the Five-Factor Model of the Arabic Version of the Positive and Negative Syndrome Scale in Schizophrenia

BACKGROUND

The Positive and Negative Syndrome Scale (PANSS) is a widely used assessment for patients with schizophrenia across clinical and research settings. This scale allows the classification of the psychotic symptoms to better understand the psychopathology in patients with schizophrenia. There are no available data on the different components of psychopathology in Arab patients with schizophrenia.

OBJECTIVES

This study examined the factor structure of the validated Arabic version of the PANSS in a sample of Arab patients with schizophrenia.

METHODS

The Arabic version of the PANSS was administered to 101 patients with schizophrenia, and principal component analysis (PCA) was carried out after the cross-cultural adaptation and validation of this version.

RESULTS

This sample had more males (66.3%) than females (33.7%) with a mean age of 35.03 years (SD = 9.99). PCA showed that 28 items loaded on 5 components: cognitive, negative, excited, depressed and positive. These factors explained 63.19% of variance. The 2 remaining items, grandiosity and somatic concerns, did not load well on any of these components.

CONCLUSION

Our results support the common 5-dimension PANSS model shown in other cultures with different languages. Nevertheless, there were minor differences, which could reflect cultural or semantic differences.

Reliability, validity and factorial structure of the Arabic version of the international suicide prevention trial (InterSePT) scale for suicidal thinking in schizophrenia patients in Doha, Qatar

BACKGROUND

Patients with schizophrenia are known to have higher rates of mortality and morbidity when compared to the general population. Suicidality is a major contributor to increased mortality. The International Suicide Prevention Trial (InterSePT) Scale for Suicidal Thinking (ISST) is a validated tool to assess current suicidal ideation in patients with schizophrenia. The aims of the study were to culturally adapt the Arabic translation of ISST and to examine the psychometric characteristics of the Arabic version of the ISST among patients with schizophrenia in Qatar.

METHODS

ISST was translated and adapted into formal Arabic using the back translation method. Patients diagnosed with schizophrenia were randomly recruited from the department of Psychiatry, Rumailah Hospital, Doha, Qatar. Healthy controls were randomly recruited from two primary health care centers in Doha, Qatar. The Arabic version of Module B for suicidality in Mini International Neuropsychiatric Interview was used as the gold standard to which the Arabic ISST was compared.

RESULTS

The study sample (n = 199) was composed of 100 patients diagnosed with schizophrenia (age 35.30 ± 10.04 years; M/F is 2/1) and 99 controls (age 33.98 ± 8.33 years; M/F is 2/3). The mean score on the ISST was 3.03 ± 4.75 vs. 0.47 ± 1.44 for the schizophrenia and control groups, respectively. Inter-rater reliability coefficient was 0.95, p > 0.001. The overall Cronbach's alpha was 0.92. Principal Component Analysis produced 3 factors explaining a total of 73.8% of variance.

CONCLUSIONS

This is the first study in the Arab countries to validate the Arabic version of the ISST. The psychometric properties indicate that the Arabic ISST is a valid tool to assess the severity of suicidal ideation in Arabic patients with schizophrenia.

Validation of the Arabic Version of Calgary Depression Scale for Schizophrenia

BACKGROUND

Patients with schizophrenia commonly show both depressive and negative symptoms that can differentially affect the prognosis and course of treatment. The Calgary Depression Scale for Schizophrenia (CDSS) was designed to distinguish between depression and negative symptoms in patients with schizophrenia. The purpose of this study is to validate an Arabic version of the CDSS among patients with schizophrenia.

METHODS

The diagnosis of schizophrenia was confirmed using the Arabic Mini International Neuropsychiatric Interview 6 (MINI 6). A standardized translation back-translation process was adopted. One rater administered the Arabic CDSS to subjects with schizophrenia as well as to a control group who should not have any psychiatric disorder except for depression. Another rater, blinded to the results administered the already validated Arabic version of Beck Depression Inventory-II (BDI-II).

RESULTS

We recruited 102 patients and 102 controls subjects. The CDSS showed good internal consistency in the active group (Cronbach's alpha = 0.82). The Intraclass Coefficient correlations (ICC) for the inter-rater reliability (n = 21) was 0.90, p<0.05 and test-retest reliability (n = 19) was 0.85, p<0.001. When compared to the BDI-II, the cutoff score of 5 on the Arabic CDSS showed reasonable sensitivity and specificity of 72.75% and 67.95% respectively.

CONCLUSIONS

The psychometric properties of the Arabic version of CDSS demonstrate that it is a valid tool to assess the depressive symptoms in the Arab patients with schizophrenia.

Data Quality Monitoring in Clinical Trials: Has It Been Worth It? An Evaluation and Prediction of the Future by All Stakeholders

This paper summarizes the results of the CNS Summit Data Quality Monitoring Workgroup analysis of current data quality monitoring techniques used in central nervous system (CNS) clinical trials. Based on audience polls conducted at the CNS Summit 2014, the panel determined that current techniques used to monitor data and quality in clinical trials are broad, uncontrolled, and lack independent verification. The majority of those polled endorse the value of monitoring data. Case examples of current data quality methodology are presented and discussed. Perspectives of pharmaceutical companies and trial sites regarding data quality monitoring are presented. Potential future developments in CNS data quality monitoring are described. Increased utilization of biomarkers as objective outcomes and for patient selection is considered to be the most impactful development in data quality monitoring over the next 10 years. Additional future outcome measures and patient selection approaches are discussed.

Validity and Reliability of the Arabic Version of the Positive and Negative Syndrome Scale

BACKGROUND

The Positive and Negative Syndrome Scale (PANSS) is widely used for patients with schizophrenia. This scale is reliable and valid. The PANSS was translated and validated in several languages.

OBJECTIVE

The aim of this study was to translate and validate the PANSS in the Arab population.

SUBJECTS AND METHODS

The PANSS was translated into formal Arabic language using the back-translation method. 101 Arab patients with schizophrenia and 98 Arabs with no diagnosis of any mental disorder were recruited. The Arabic version of the Mini International Neuropsychiatric Interview (MINI-6) was used as a diagnostic tool to confirm the diagnosis of schizophrenia or rule out any diagnosis for the healthy control group. Reliability of the scale was assessed by calculating internal consistency, interrater reliability and test-retest reliability. Construct validity was assessed using the Arabic version of the MINI-6. PANSS total scores were correlated with the Clinical Global Impression-Severity scale.

RESULTS

Our findings showed that the internal consistency was good (0.92). Scores on the PANSS of the patients were much higher than those of the healthy controls. The PANSS showed good interrater reliability and test-retest reliability (0.92 and 0.75, respectively). In comparison with the MINI-6, the PANSS showed good sensitivity and specificity, which implies good construct validity of this version.

CONCLUSION

In conclusion, the Arabic version of the PANSS is a reliable and valid instrument for the assessment of patients with schizophrenia in the Arab population.

Consensus recommendations on rater training and certification

There is currently no accepted standard for the clinical research industry to follow when selecting and training raters to administer rating scales in clinical neuroscience trials. This article offers guidelines, based on expert recommendations of the CNS Summit Rater Training and Certification Committee, for selecting, training, and evaluating raters. The article also defines terminology and offers recommendations for considering raters with prior training and certification. These guidelines are intended for investigators, pharmaceutical companies, contract research organizations, and other entities involved in clinical neuroscience trials.

Risk of schizophrenia and minority status: a comparison of the Swedish-speaking minority and the Finnish-speaking majority in Finland

Approximately five percent of the Finnish population are Swedish-speaking and have higher socioeconomic position and longer life expectancy than the Finnish-speaking majority. Previous studies have not investigated whether Swedish-speaking Finns have lower risk of schizophrenia spectrum disorders (SSD) than Finnish-speaking Finns. We investigated this in a representative sample of 47 445 Finns born in 1972-1984. Hazard ratios of SSD between language groups were assessed with conditional proportional hazards regression. Sex, parental ages at birth, paternal employment around conception, parental psychosis and place and residence in the capital area were used as other explanatory variables. The prevalence of SSD was 0.7% in the Swedish-speaking minority and 1.5% in the Finnish-speaking majority. In the adjusted regression model, belonging to the Swedish-speaking minority was associated with lower risk of SSD (hazard ratio (HR) 0.41, 95% confidence interval (CI) 0.24-0.69). In a subset analysis by gender, the protective effect was evident among Swedish-speaking males (HR 0.32, 95% CI 0.15-0.68) but marginal in females (HR 0.75, 95% CI 0.41-1.37). Parental psychosis and place of birth in the capital area were associated with higher risk of SSD, whereas paternal employment at the time of conception was associated with lower risk of SSD. Our results support the role of social factors in the etiology of schizophrenia. Belonging to a minority with high socioeconomic status and social capital may be protective against schizophrenia, especially for males.

A new Integrated Negative Symptom structure of the Positive and Negative Syndrome Scale (PANSS) in schizophrenia using item response analysis

BACKGROUND

Debate persists with regard to how best to categorize the syndromal dimension of negative symptoms in schizophrenia. The aim was to first review published Principle Components Analysis (PCA) of the PANSS, and extract items most frequently included in the negative domain, and secondly, to examine the quality of items using Item Response Theory (IRT) to select items that best represent a measurable dimension (or dimensions) of negative symptoms.

METHODS

First, 22 factor analyses and PCA met were included. Second, using a large dataset (n=7187) of participants in clinical trials with chronic schizophrenia, we extracted items loading on one or more PCA. Third, items not loading with a value of ≥ 0.5, or loading on more than one component with values of ≥ 0.5 were discarded. Fourth, resulting items were included in a non-parametric IRT and retained based on Option Characteristic Curves (OCCs) and Item Characteristic Curves (ICCs).

RESULTS

15 items loaded on a negative domain in at least one study, with Emotional Withdrawal loading on all studies. Non-parametric IRT retained nine items as an Integrated Negative Factor: Emotional Withdrawal, Blunted Affect, Passive/Apathetic Social Withdrawal, Poor Rapport, Lack of Spontaneity/Conversation Flow, Active Social Avoidance, Disturbance of Volition, Stereotyped Thinking and Difficulty in Abstract Thinking.

CONCLUSIONS

This is the first study to use a psychometric IRT process to arrive at a set of negative symptom items. Future steps will include further examination of these nine items in terms of their stability, sensitivity to change, and correlations with functional and cognitive outcomes.

A rasch model to test the cross-cultural validity in the positive and negative syndrome scale (PANSS) across six geo-cultural groups

Background

The objective of this study was to examine the cross-cultural differences of the PANSS across six geo-cultural regions. The specific aims are (1) to examine measurement properties of the PANSS; and (2) to examine how each of the 30 items function across geo-cultural regions.

Methods

Data was obtained for 1,169 raters from 6 different regions: Eastern Asia (n = 202), India (n = 185), Northern Europe (n = 126), Russia & Ukraine (n = 197), Southern Europe (n = 162), United States (n = 297). A principle components analysis assessed unidimensionality of the subscales. Rasch rating scale analysis examined cross-cultural differences among each item of the PANSS.

Results

Lower item values reflects items in which raters often showed less variation in the scores; higher item values reflects items with more variation in the scores. Positive Subscale: Most regions found item P5 (Excitement) to be the most difficult item to score. Items varied in severity from −0.93 [item P6. Suspiciousness/persecution (USA) to 0.69 item P4. Excitement (Eastern Asia)]. Item P3 (Hallucinatory Behavior) was the easiest item to score for all geographical regions. Negative Subscale: The most difficult item to score for all regions is N7 (Stereotyped Thinking) with India showing the most difficulty Δ = 0.69, and Northern Europe and the United States showing the least difficulty Δ = 0.21, each. The second most difficult item for raters to score was N1 (Blunted Affect) for most countries including Southern Europe (Δ = 0.30), Eastern Asia (Δ = 0.28), Russia & Ukraine (Δ = 0.22) and India (Δ = 0.10). General Psychopathology: The most difficult item for raters to score for all regions is G4 (Tension) with difficulty levels ranging from Δ = 1.38 (India) to Δ = 0.72.

Conclusions

There were significant differences in response to a number of items on the PANSS, possibly caused by a lack of equivalence between the original and translated versions, cultural differences among interpretation of items or scoring parameters. Knowing which items are problematic for various cultures can help guide PANSS training and make training specialized for specific geographical regions.

Prenatal stress and affective disorders in a population birth cohort

OBJECTIVES

Pregnant women exposed to an acute traumatic event are thought to produce offspring with an increased incidence of affective disorders. It is not known whether there are specific times in pregnancy which confer increased vulnerability, or if psychosocial stress alone can increase the incidence of affective disorders in offspring. We examined the relationship of the timing of an acute psychosocial threat during pregnancy to the incidence of affective disorders in offspring using data from a large birth cohort.

METHODS

Using data on 90079 offspring born in Jerusalem in 1964-1976 and linked to Israel's psychiatric registry, we constructed proportional hazards models to evaluate the link between gestational age during the Arab-Israeli war of June 1967 and incidence of mood disorders.

RESULTS

Those in their first trimester of fetal development during the war were more likely to be admitted to hospitals for any mood disorders [relative risk (RR) = 3.01, 95% confidence interval (CI): 1.68-5.39, p = 0.0002]; for bipolar disorder the risk was doubled (RR = 2.44, 95% CI: 0.996-5.99, p = 0.054) and for all 'other' mood disorders the risk was tripled (RR = 3.61, 95% CI: 1.68-7.80, p = 0.001). Mood disorders were also increased in offspring whose mothers had been in the third month of pregnancy in June of 1967 (RR = 5.54, 95% CI: 2.73-11.24, p < 0.0001).

CONCLUSIONS

A time-limited exposure to a severe threat during early gestation may be associated with an increased incidence of affective disorders in offspring. The third month of fetal development was a moment of special vulnerability.

Is lead exposure in early life an environmental risk factor for Schizophrenia? Neurobiological connections and testable hypotheses

Schizophrenia is a devastating neuropsychiatric disorder of unknown etiology. There is general agreement in the scientific community that schizophrenia is a disorder of neurodevelopmental origin in which both genes and environmental factors come together to produce a schizophrenia phenotype later in life. The challenging questions have been which genes and what environmental factors? Although there is evidence that different chromosome loci and several genes impart susceptibility for schizophrenia; and epidemiological studies point to broad aspects of the environment, only recently there has been an interest in studying gene × environment interactions. Recent evidence of a potential association between prenatal lead (Pb(2+)) exposure and schizophrenia precipitated the search for plausible neurobiological connections. The most promising connection is that in schizophrenia and in developmental Pb(2+) exposure there is strong evidence for hypoactivity of the N-methyl-d-aspartate (NMDA) subtype of excitatory amino acid receptors as an underlying neurobiological mechanism in both conditions. A hypofunction of the NMDA receptor (NMDAR) complex during critical periods of development may alter neurobiological processes that are essential for brain growth and wiring, synaptic plasticity and cognitive and behavioral outcomes associated with schizophrenia. We also describe on-going proof of concept gene-environment interaction studies of early life Pb(2+) exposure in mice expressing the human mutant form of the disrupted in schizophrenia 1 (DISC-1) gene, a gene that is strongly associated with schizophrenia and allied mental disorders.

Olfactory processing, sex effects and heterogeneity in schizophrenia

INTRODUCTION

Smell identification deficits are associated with negative symptoms in schizophrenia, particularly in males. Far less information is known about the relationship of odor detection sensitivity (acuity) and negative symptoms in schizophrenia, and currently there is a dearth in sex-stratified research specifically examining odor sensitivity and smell identification.

METHODS

Fifty-eight individuals with schizophrenia and 42 healthy comparison subjects were assessed on tests of odor sensitivity, smell identification and cognition. Negative symptoms were assessed with the Positive and Negative Syndrome Scale and the Schedule for the Deficit Syndrome.

RESULTS

In healthy males, increased odor detection sensitivity predicted better smell identification scores. In contrast, male schizophrenia patients showed a significant inverse relationship, in which increased odor sensitivity predicted lower smell identification scores. Odor sensitivity and smell identification were unrelated in both schizophrenia and healthy females. Olfactory processing was strongly linked to negative symptoms, but the relationships differed by sex. Emotional expression deficits were related to odor detection hypersensitivity in female patients, whereas smell identification deficits predicted these emotional deficits in male cases.

CONCLUSION

Sex differences in olfactory functioning were identified in healthy subjects and in schizophrenia patients. Smell identification was related to negative symptoms in males with schizophrenia, whereas odor detection sensitivity predicted these features in females. Sex differences should be considered in future analyses that employ odor stimuli for neuropsychiatric research.

Global inter-rater reliability, scale validity, and local perception: Panss ratings and reactions from 4 Countries

Introduction/objectives/aims

We compared cohorts of raters from different countries who received training on the PANSS. We attempted to determine if there was any consistent by-country impact on specific items, factors, or subscales. We also queried raters about their perceptions of the instrument they were asked to use vis-à-vis their local patient population.

Methods

The data set comes from standardized rater training events involving raters from four countries: India (n = 83), Russia (n = 59), the US (n = 63), and Romania (n = 76). Raters scored interviews of schizophrenic patients using the PANSS. Scores were compared and intra-class correlation coefficients (ICCs) and rater agreement with “gold standard” scores were evaluated. The results were viewed against raters’ responses to questions about how well the PANSS items correlated to the presentation of symptoms.

Results

Raters from the US and Russia demonstrated a higher level of inter-rater consistency with ICCs of 0.883 and 0.835, respectively. For eight PANSS items, all raters demonstrated at least 80% agreement with the gold standard scores. For ten PANSS items, there was at least one country whose raters scored below 60% agreement. The PANSS items with the lower inter-rater reliability were the same items raters indicated as problematic in local settings.

Conclusion

The differences in rater performance indicate that standardized rater training is broadly effective but that there are some important differences in the way in which different groups conceptualize symptomatology and corresponding PANSS items. This suggests a need to tailor training to ensure reliability and validity in the use of this instrument.

Quantifying rater drift on the HAM-D in a sample of standardized rater training events: Implications for reliability and sample size calculations

Introduction/objectives/aims

Though rater drift in clinical trials has long been understood to negatively impact trial results, few studies have systematically quantified this. We examined training data for the HAM-D (Hamilton Depression Scale, 17-item version) at two time points to measure the impact.

Methods

Raters participating in a standardized training scored the HAM-D based on two videotaped interviews of depressed patients. To assess drift, data from an initial, post-online training session was compared to data obtained 12 months later. Intra-class correlation coefficients (Shrout & Fliess, 1979) and concordance with expert ratings were compared.

Results

Intra-class correlation coefficients (ICC) for raters (n = 167) following initial training were good to excellent for individual raters (.695–.976, p < .0001) and good for the overall cohort (.752, p < .0001). Concordance with expert ratings was excellent at 99.3%. The overall ICC fell to .730 at the second assessment and although the upper bound of individual performance remained in the good to excellent range, the frequency of scores in the poor to fair range (< .65) increased. Concordance also fell slightly to 87%.

Conclusions

Rater drift occurred over 12 months, as gauged by the metrics of reliability and concordance. Drift was apparent in a limited portion of the cohort but resulted in a lower overall ICC at the second time point. Because studies are generally powered assuming that the ICC remains stable, there are implications for both this power calculation and the required sample size.

Later paternal age and sex differences in schizophrenia symptoms

OBJECTIVE

Advanced paternal age is consistently associated with an increased risk for schizophrenia, accounting for up to a quarter of cases in some populations. If paternal age-related schizophrenia (PARS) involves a distinct etiopathology, then PARS cases may show specific characteristics, vis-à-vis other schizophrenia cases. This study examined if PARS exhibits the symptom profile and sex differences that are consistently observed for schizophrenia in general, wherein males have an earlier onset age and more severe negative symptoms than females.

METHOD

Symptoms were assessed at baseline (admission) and during medication-free and treatment phases for 153 inpatients on a schizophrenia research unit, 38 of whom fulfilled operationally defined criteria for PARS (sporadic cases with paternal age > or = 35).

RESULTS

Males and females with PARS had the same age at onset and a similar preponderance of negative symptoms, whereas the other (non-PARS) cases showed the typical earlier onset age and more severe negative symptoms in males. When medications were withdrawn, PARS cases showed significantly worse symptoms than non-PARS cases (higher total PANSS scores and positive, activation, and autistic preoccupation scores). However these symptoms globally improved with antipsychotic treatment, such that the differences between the PARS and other schizophrenia cases receded.

CONCLUSION

The lack of sex differences in the age at onset and the greater severity of medication-free symptoms bolster the hypothesis that PARS has a distinct etiopathology. It also suggests that female sex does not exert a protective effect on the course of PARS, as it may in other forms of schizophrenia.