On the invalidity of validity scales: evidence from self-reports and observer ratings in volunteer samples

Disorder-specific versus transdiagnostic cognitive mechanisms in anxiety and depression: Machine-learning-based prediction of symptom severity

INTRODUCTION

Psychiatric evaluation of anxiety and depression is currently based on self-reported symptoms and their classification into discrete disorders. Yet the substantial overlap between these disorders as well as their within-disorder heterogeneity may contribute to the mediocre success rates of treatments. The proposed research examines a new framework for diagnosis that is based on alterations in underlying cognitive mechanisms. In line with the Research Domain Criteria (RDoC) approach, the current study directly compares disorder-specific and transdiagnostic cognitive patterns in predicting the severity of anxiety and depression symptoms.

METHODS

The sample included 237 individuals exhibiting differing levels of anxiety and depression symptoms, as measured by the STAI-T and BDI-II. Random Forest regressors were used to analyze their performance on a battery of six computerized cognitive-behavioral tests targeting selective and spatial attention, expectancy, interpretation, memory, and cognitive control biases.

RESULTS

Unique anxiety-specific biases were found, as well as shared anxious-depressed bias patterns. These cognitive biases exhibited relatively high fitting rates when predicting symptom severity (questionnaire scores common range 0-60, MAE = 6.03, RMSE = 7.53). Interpretation and expectancy biases exhibited the highest association with symptoms, above all other individual biases.

LIMITATIONS

Although internal validation methods were applied, models may suffer from potential overfitting due to sample size limitations.

CONCLUSION

In the context of the ongoing dispute regarding symptom-centered versus transdiagnostic approaches, the current study provides a unique comparison of these two views, yielding a novel intermediate approach. The results support the use of mechanism-based dimensional diagnosis for adding precision and objectivity to future psychiatric evaluations.

Machine Learning-Based Behavioral Diagnostic Tools for Depression: Advances, Challenges, and Future Directions

The psychiatric diagnostic procedure is currently based on self-reports that are subject to personal biases. Therefore, the diagnostic process would benefit greatly from data-driven tools that can enhance accuracy and specificity. In recent years, many studies have achieved promising results in detecting and diagnosing depression based on machine learning (ML) analysis. Despite these favorable results in depression diagnosis, which are primarily based on ML analysis of neuroimaging data, most patients do not have access to neuroimaging tools. Hence, objective assessment tools are needed that can be easily integrated into the routine psychiatric diagnostic process. One solution is to use behavioral data, which can be easily collected while still maintaining objectivity. The current paper summarizes the main ML-based approaches that use behavioral data in diagnosing depression and other psychiatric disorders. We classified these studies into two main categories: (a) laboratory-based assessments and (b) data mining, the latter of which we further divided into two sub-groups: (i) social media usage and movement sensors data and (ii) demographic and clinical information. The paper discusses the advantages and challenges in this field and suggests future research directions and implementations. The paper's overarching aim is to serve as a first step in synthetizing existing knowledge about ML-based behavioral diagnosis studies in order to develop interventions and individually tailored treatments in the future.

Correlated personality change across time and age

The goal of this study was to examine differential and correlated change in personality across the adult lifespan. Studying differential and correlated change can help understand whether intraindividual trait change trajectories deviate from the norm and how these trajectories are coupled with each other. We used data from two large longitudinal panel studies from the United States that covered a total age range of 20 to 95 years on the first measurement occasion. We used correlated factor models and bivariate latent change score models to examine the rank-order stability and correlations between change across three measurement waves covering 18 years ( N = 3250) and four measurement waves covering 12 years ( N = 4145). We examined the moderation effects of continuous age on these model parameters using local structural equation modeling. The results suggest that the test–retest correlations decrease with increasing time between measurements but are unaffected by participants’ age. We found that change processes in Extraversion, Openness, Agreeableness, and Conscientiousness were strongly related, particularly in late adulthood. Correlated change patterns were highly stable across time intervals and similar to the initial cross-sectional Big Five correlations. We discuss potential mechanisms and implications for personality development research.

The Lazy or Dishonest Respondent: Detection and Prevention

Self-report measures are characterized as being susceptible to threats associated with deliberate dissimulation or response distortion (i.e., social desirability responding) and careless responding. Careless responding typically arises in low-stakes settings (e.g., participating in a study for course credit) where some respondents are not motivated to respond in a conscientious manner to the items. In contrast, in high-stakes assessments (e.g., prehire assessments), because of the outcomes associated with their responses, respondents are motivated to present themselves in as favorable a light as possible and, thus, may respond dishonestly in an effort to accomplish this objective. In this article, we draw a distinction between the lazy respondent, which we associate with careless responding, and the dishonest respondent, which we associate with response distortion. We then seek to answer the following questions for both careless responding and response distortion: ( a) What is it? ( b) Why is it a problem or concern? ( c) Why do people engage in it? ( d) How pervasive is it? ( e) Can and how is it prevented or mitigated? ( f) How is it detected? ( g) What does one do when one detects it? We conclude with a discussion of suggested future research directions and some practical guidelines for practitioners and researchers.

Effects of self‐enhancement on agreement on personality profiles

Effects of self‐enhancement and socially desirable responding (SDR) on rater agreement for personality profiles were studied in 304 students. Dyads of participants described themselves and their peer on the Revised NEO Personality Inventory (NEO‐PI‐R) that measures 30 facets of personality. In addition, participants filled in six scales measuring self‐enhancement or SDR. Data analyses focussed on moderator and suppressor effects of SDR on the similarity between self‐reported and other reported NEO‐PI‐R profiles. Three kinds of profile agreement were distinguished: (a) normative agreement; (b) distinctive agreement and (c) profile normativeness, that is, how strongly a self‐reported personality profile resembled the average profile of all participants. There were no moderator or suppressor effects on distinctive agreement, but SDR predicted profile normativeness quite strongly. Copyright © 2009 John Wiley & Sons, Ltd.

Social desirability and consensual validity of personality traits

The effect of socially desirable responding (SDR) on the consensual validity of personality traits was studied. SDR was operationalized as the sum of items weighted by their respective social desirability values (Social Desirability Index, SDI), which could be computed for both self‐ and peer‐reports. In addition, the Balanced Inventory of Desirable Responding (BIDR) was used as a measure of SDR. It was shown that both self‐peer and peer‐peer agreement rose significantly for most studied traits when SDI was controlled in both self‐ and peer‐reports. BIDR was a significant suppressor variable in only one of the analyses involving Neuroticism. The SDI detected faking on personality scales somewhat better than the BIDR scales. It is argued that the SDI is a measure of evaluativeness of a person description, and that people agree more on descriptive than on evaluative aspects of a target's personality traits. Copyright © 2006 John Wiley & Sons, Ltd.

The Properties and Utility of Less Evaluative Personality Scales: Reduction of Social Desirability; Increase of Construct and Discriminant Validity

Evaluative neutralization implies rephrasing items such that it is less clear to the respondent what would be a desirable response in the given population. The current research compares evaluatively neutralized scales measuring the FFM model with standard counterparts. Study 1 reveals that evaluatively neutralized scales are less influenced by social desirability. Study 2 estimates higher-order factor models for neutralized vs. standard five-factor scales. In contrast to standard inventories, there was little support for higher-order factors for neutralized scales. Study 3 demonstrates the convergent and discriminant validity for the neutralized scales, e.g., by less inflated correlations to external measures. It is argued that evaluatively neutralized inventories help researchers come to grips with social desirability in personality measurement, and are particularly useful when the factor structure is central to the research question and there is a focus on discriminant validity.

The Role of Distinct Facets of Perfectionism and Sociocultural Idealization of Thinness on Disordered Eating Symptoms

Introduction: Perfectionism is a multidimensional personality style implicated in risk for disordered eating (DE), yet the types of perfectionism most predictive of DE and how perfectionistic tendencies lead to the development of DE remains less clear. This study aimed to determine the types of perfectionism most strongly associated with DE and whether perceived pressures for thinness and thin-ideal internalization serve as intervening variables that explain associations between perfectionism and DE.

Methods: An ethnically diverse sample of female college students (n = 154–292) completed well-validated self-report questionnaires assessing overall DE symptoms, perfectionism, and two sociocultural factors: pressures for thinness and thin-ideal internalization.

Results: Only perfectionism constructs encompassed under the “maladaptive evaluative concerns” domain were significantly associated with DE. Double mediation models indicated that heightened pressures for thinness and thin-ideal internalization fully mediate perfectionism-DE associations.

Discussion: Results suggest that disorder-specific risk factors related to idealization of thinness may be important for understanding how a transdiagnostic factor, like perfectionism, results in DE.

Source method biases as implicit personality theory at the domain and facet levels

OBJECTIVE

We tested predictions about the structure and magnitude of method biases in single-source personality trait assessments. We expected a large number of distinct biases that would parallel the observed structure of traits, at both facet and item levels.

METHOD

We analyzed multimethod ratings on the Estonian NEO Personality Inventory-3 in a sample of 3,214 adults. By subtracting informant ratings from self-reports, we eliminated true score variance and analyzed the size and structure of the residual method biases. We replicated analyses using data (N = 709) from the Czech Revised NEO Personality Inventory.

RESULTS

The magnitude of method biases was consistent with predictions by McCrae (2018, Psychological Assessment). Factor analyses at the facet level showed a clear replication of the normative Five-Factor Model structure in both samples. Item factor analyses within domains showed that facet-level method biases mimicked the facet structure of the instrument.

CONCLUSIONS

Method biases apparently reflect implicit personality theory (IPT)-beliefs about how traits and trait indicators covary. We discuss the (collective) accuracy and possible origins of IPT. Because method biases limit the accuracy of single-source assessments, we recommend assessments that combine information from two or more informants.

Do impression management and self-deception distort self-report measures with content of dynamic risk factors in offender samples? A meta-analytic review

Self-report measures provide an important source of information in correctional/forensic settings, yet at the same time the validity of that information is often questioned because self-reports are thought to be highly vulnerable to self-presentation biases. Primary studies in offender samples have provided mixed results with regard to the impact of socially desirable responding on self-reports. The main aim of the current study was therefore to investigate-via a meta-analytic review of published studies-the association between the two dimensions of socially desirable responding, impression management and self-deceptive enhancement, and self-report measures with content of dynamic risk factors using the Balanced Inventory of Desirable Responding (BIDR) in offender samples. These self-report measures were significantly and negatively related with self-deception (r = -0.120, p < 0.001; k = 170 effect sizes) and impression management (r = -0.158, p < 0.001; k = 157 effect sizes), yet there was evidence of publication bias for the impression management effect with the trim and fill method indicating that the relation is probably even smaller (r = -0.07). The magnitude of the effect sizes was small. Moderation analyses suggested that type of dynamic risk factor (e.g., antisocial cognition versus antisocial personality), incentives, and publication year affected the relationship between impression management and self-report measures with content of dynamic risk factors, whereas sample size, setting (e.g., incarcerated, community), and publication year influenced the relation between self-deception and these self-report measures. The results indicate that the use of self-report measures to assess dynamic risk factors in correctional/forensic settings is not inevitably compromised by socially desirable responding, yet caution is warranted for some risk factors (antisocial personality traits), particularly when incentives are at play.

Controlling for Response Bias in Self-Ratings of Personality: A Comparison of Impression Management Scales and the Overclaiming Technique

Self-serving response distortions pose a threat to the validity of personality scales. A common approach to deal with this issue is to rely on impression management (IM) scales. More recently, the overclaiming technique (OCT) has been proposed as an alternative and arguably superior measure of such biases. In this study (N = 162), we tested these approaches in the context of self- and other-ratings using the HEXACO personality inventory. To the extent that the OCT and IM scales can be considered valid measures of response distortions, they are expected to account for inflated self-ratings in particular for those personality dimensions that are prone to socially desirable responding. However, the results show that neither the OCT nor IM account for overly favorable self-ratings. The validity of IM as a measure of response biases was further scrutinized by a substantial correlation with other-rated honesty-humility. As such, this study questions the use of both the OCT and IM to assess self-serving response distortions.

Social Desirability in Spouse Ratings

Whether or not socially desirable responding is a cause for concern in personality assessment has long been debated. For many researchers, McCrae and Costa laid the issue to rest when they showed that correcting for socially desirable responding in self-reports did not improve the agreement with spouse ratings on the Neuroticism, Extraversion, and Openness to Experience Personality Inventory. However, their findings rest on the assumption that observer ratings in general, and spouse ratings in particular, are an unbiased external criterion. If spouse ratings are also susceptible to socially desirable responding, correcting for the bias in self-rated measures cannot be assumed to increase agreement between self-reports and spouse ratings, and thus failure to do so should not be taken as evidence for the ineffectiveness of measuring and correcting for socially desirable responding. In the present study, McCrae and Costa's influential study was replicated with the exception of measuring socially desirable responding with the Marlowe-Crowne Social Desirability Scale, in both self-reports and spouse ratings. Analyses were based on responses from 70 couples who had lived together for at least one year. The results showed that both self-reports and spouse ratings are susceptible to socially desirable responding and thus McCrae and Costa's conclusion is drawn into question.

Careless responding in internet-based quality of life assessments

PURPOSE

Quality of life (QoL) measurement relies upon participants providing meaningful responses, but not all respondents may pay sufficient attention when completing self-reported QoL measures. This study examined the impact of careless responding on the reliability and validity of Internet-based QoL assessments.

METHODS

Internet panelists (n = 2000) completed Patient-Reported Outcomes Measurement Information System (PROMIS®) short-forms (depression, fatigue, pain impact, applied cognitive abilities) and single-item QoL measures (global health, pain intensity) as part of a larger survey that included multiple checks of whether participants paid attention to the items. Latent class analysis was used to identify groups of non-careless and careless responders from the attentiveness checks. Analyses compared psychometric properties of the QoL measures (reliability of PROMIS short-forms, correlations among QoL scores, "known-groups" validity) between non-careless and careless responder groups. Whether person-fit statistics derived from PROMIS measures accurately discriminated careless and non-careless responders was also examined.

RESULTS

About 7.4% of participants were classified as careless responders. No substantial differences in the reliability of PROMIS measures between non-careless and careless responder groups were observed. However, careless responding meaningfully and significantly affected the correlations among QoL domains, as well as the magnitude of differences in QoL between medical and disability groups (presence or absence of disability, depression diagnosis, chronic pain diagnosis). Person-fit statistics significantly and moderately distinguished between non-careless and careless responders.

CONCLUSIONS

The results support the importance of identifying and screening out careless responders to ensure high-quality self-report data in Internet-based QoL research.

Detecting Inconsistent Responding on the Youth Psychopathic Traits Inventory-Short Form

The Youth Psychopathic Traits Inventory-Short Form (YPI-S) is a convenient measure for assessing psychopathy in settings with constraints on resources. However, the YPI-S does not contain a means of detecting careless or random response styles. The present study describes the development and evaluation of an inconsistent responding scale for the YPI-S using five archival samples that vary in language (English, German, Italian, Dutch) and other participant characteristics (juvenile offenders, adolescent students). Inconsistency scores resulting from the new scale effectively distinguished genuine participant responses from randomly generated cases (area under the ROC curve [AUC] = .85-.90) and from cases in which 50% of original responses were replaced with random data (AUC = .75-.82). The associations between the YPI-S and theoretically relevant correlates were reduced among participants exceeding proposed cutoff scores for profile validity compared with associations among more consistent respondents.

Five Factor Biodata Inventory: Resistance to Faking

Faking on a biographical inventory compared to a traditional personality inventory was assessed in measuring the Five Factor Model of Personality. 705 subjects were randomly assigned to either an Answer Honestly or Faking condition. All subjects were recruited from psychology classes at two New Jersey State colleges. Women comprised 68.6% of the participants. The average age of the subjects was 24 yr. 383 subjects took part in the Answer Honestly condition. 322 participated in the Faking condition. In the Faking condition, subjects responded as if applying for the position of librarian. All subjects completed a biodata inventory, the NEO-Five Factor Inventory, a social desirability scale, a letter-cancellation task, and self-reported their grade point average. Criterion-related validity was assessed for both test scores across samples. Comparisons between samples indicated that subjects inflated scores on both inventories in socially desirable directions. Biodata Inventory scores were less elevated under the Faking conditions than the NEO-Five Factor Inventory scores.

Response Style Versus Crime-Specific Cognition

Four samples were used to evaluate the incremental validity of the Psychological Inventory of Criminal Thinking Styles (PICTS) General Criminal Thinking (GCT) score and Proactive (P) and Reactive (R) composite scales vis-á-vis response style in predicting disciplinary adjustment and recidivism. Purified Confusion (Cfp) and Defensiveness (Dfp) validity scales were constructed by eliminating items from the PICTS Confusion and Defensiveness scales that overlapped with GCT, P, and R. The four-item Cfp and Dfp scales were employed as measures of response style and entered into binomial probit regression analyses alongside GCT, P, and R. The GCT score consistently predicted disciplinary adjustment and recidivism in male and female offenders when included in regression equations with Cfp and Dfp. The P scale only displayed incremental validity relative to Cfp and Dfp in large groups of participants, whereas the R scale was incapable of predicting recidivism in female offenders when paired with Cfp and Dfp.

Fertility Cycle Patterns in Motives for Sexual Behavior

Three studies examined the relationship between fertility, as indexed by day in cycle or salivary estradiol levels, and reported motives for sexual intercourse. Data from university and community samples in both cross-sectional and repeated-measures designs showed that sex-for-intimacy motives are endorsed significantly less by women who are relatively more fertile or show higher salivary estrogen levels. Sex for enhancement, self-affirmation, and partner approval also declined, although the data were less consistent. The remaining motives (coping and power) showed no consistent patterns across fertility status. Results suggest that sexual motives are rooted partly in woman's biology and are discussed in terms of plausible evolutionary mechanisms that might promote female “choosiness” at midcycle.

As Others See Us

Discrepancies are often found between self-reports and reports by others regarding psychopathology. Both the person being assessed and various informants may contribute crucial data concerning a person's functioning. Comprehensive assessment requires data from multiple informants. Such data can be easily obtained with parallel self-report and collateral-report forms. The multi-informant data can be compared, aggregated, and used in many ways. Optimal use of multi-source data is essential for clinical assessment and for discovering causes and cures of psychopathology.

Agreement Between Self- and Informant-Reported Ratings of Personality Traits: The Moderating Effects of Major Depressive and/or Panic Disorder

Several personality traits are risk factors for psychopathology. As symptoms of psychopathology may influence self-rated personality, informant reports of personality are also sometimes collected. However, little is known about self-informant agreement in individuals with anxiety and/or depression. We investigated whether self-informant agreement on positive and negative affectivity (PA and NA) and anxiety sensitivity differs for individuals with major depressive disorder (MDD) and/or panic disorder (PD; total n = 117). Informant- and self-reported PA was correlated among those with MDD, but not among those without MDD. Informant- and self-reported anxiety sensitivity was correlated among those with PD, but not among those without PD. Informant- and self-reported NA was correlated irrespective of diagnosis. Results indicate that the agreement of self- and informant-reported personality may vary as a function of depression and/or anxiety disorders.

Rethinking Social Desirability Scales: From Impression Management to Interpersonally Oriented Self-Control

Social desirability (specifically, impression management) scales are widely used by researchers and practitioners to screen individuals who bias self-reports in a self-favoring manner. These scales also serve to identify individuals at risk for psychological and health problems. The present review explores the evidence with regard to the ability of these scales to achieve these objectives. In the first part of the review, I present six criteria to evaluate impression management scales and conclude that they are unsatisfactory as measures of response style. Next, I explore what individual differences in impression management scores actually do measure. I compare two approaches: a defensiveness approach, which argues that these scales measure defensiveness that stems from vulnerable self-esteem, and an adjustment approach, which suggests that impression management is associated with personal well-being and interpersonal adjustment. Data from a wide variety of fields including social behavior, affect and well-being, health, and job performance tend to favor the adjustment approach. Finally, I argue that scales measuring impression management should be redefined as measures of interpersonally oriented self-control that identify individuals who demonstrate high levels of self-control, especially in social contexts.

Substance and Artifact in Interest Self-Reports

Abstract. Although self-reports are often distorted by response biases, nearly all knowledge about interests rely on self-reports. This multiple-rater twin study investigated the degree to which interest self-reports reflect substance. Specifically, we examined whether genetic variance in interest self-reports reflect substance in terms of genetically based motivational attributes or artifact in terms of genetically influenced self-rater biases. We compared normative and ipsatized self- and peer reports on interests from 844 individuals (incl. 225 monozygotic and 113 dizygotic twin pairs) regarding psychometric qualities and further regarding the estimates of genetic and environmental components in self-other agreement and self-rater specificity. Ipsatized interest scores showed lower internal consistency but higher consensus and self-other agreement. Self-other agreement showed a large genetic component, whereas variance specific to self-reports was not significantly attributable to genetic influences. The results provide strong support that genetic variance in interest self-reports reflect substance rather than artifact.

How Careless Responding and Acquiescence Response Bias Can Influence Construct Dimensionality

We investigated the effects that careless responding and acquiescence response bias have on analyses conducted to assess construct dimensionality. Using job satisfaction/dissatisfaction as the focal construct, we measured and controlled for careless responding and acquiescence bias in data obtained from an online survey of employees ( N = 666) from different organizations and occupational groups. We found that the negative correlation between factors defined by job satisfaction and dissatisfaction items, respectively, was attenuated by careless responding and acquiescence bias, and was not significantly different from –1.0 when both were controlled. Moreover, the correlations between the two factors and measures of other constructs were similar when careless responding and acquiescence were controlled. These findings challenge recent research purporting to demonstrate that job satisfaction and dissatisfaction are distinct constructs. Recommendations for future investigations of construct dimensionality are provided.

Syndromes of collateral-reported psychopathology for ages 18-59 in 18 Societies

The purpose was to advance research and clinical methodology for assessing psychopathology by testing the international generalizability of an 8-syndrome model derived from collateral ratings of adult behavioral, emotional, social, and thought problems. Collateral informants rated 8,582 18-59-year-old residents of 18 societies on the Adult Behavior Checklist (ABCL). Confirmatory factor analyses tested the fit of the 8-syndrome model to ratings from each society. The primary model fit index (Root Mean Square Error of Approximation) showed good model fit for all societies, while secondary indices (Tucker Lewis Index, Comparative Fit Index) showed acceptable to good fit for 17 societies. Factor loadings were robust across societies and items. Of the 5,007 estimated parameters, 4 (0.08%) were outside the admissible parameter space, but 95% confidence intervals included the admissible space, indicating that the 4 deviant parameters could be due to sampling fluctuations. The findings are consistent with previous evidence for the generalizability of the 8-syndrome model in self-ratings from 29 societies, and support the 8-syndrome model for operationalizing phenotypes of adult psychopathology from multi-informant ratings in diverse societies.

Detecting and Explaining Aberrant Responding to the Outcome Questionnaire-45

We applied item response theory based person-fit analysis (PFA) to data of the Outcome Questionnaire-45 (OQ-45) to investigate the prevalence and causes of aberrant responding in a sample of Dutch clinical outpatients. The [Formula: see text] person-fit statistic was used to detect misfitting item-score patterns and the standardized residual statistic for identifying the source of the misfit in the item-score patterns identified as misfitting. Logistic regression analysis was used to predict person misfit from clinical diagnosis, OQ-45 total score, and Global Assessment of Functioning code. The [Formula: see text] statistic classified 12.6% of the item-score patterns as misfitting. Person misfit was positively related to the severity of psychological distress. Furthermore, patients with psychotic disorders, somatoform disorders, or substance-related disorders more likely showed misfit than the baseline group of patients with mood and anxiety disorders. The results suggest that general outcome measures such as the OQ-45 are not equally appropriate for patients with different disorders. Our study emphasizes the importance of person-misfit detection in clinical practice.

Identifying personality subtypes based on the five-factor model dimensions in male prisoners: implications for psychopathy and criminal offending

The current study was designed to identify personality subtypes on the basis of the five-factor model dimensions in male prisoners. Participants included 110 Flemish male prisoners assessed by means of the Neuroticism, Extraversion, Openness Five Factor Inventory and different symptom, personality, and coping measures. We found two clusters: an emotionally stable/resilient cluster and an aggressive/undercontrolled cluster. Prisoners within the aggressive/undercontrolled cluster scored significantly higher on almost all Minnesota Multiphasic Personality Inventory-2 basic scales, (in)direct aggression measures, and depressive coping scales compared with resilients. They also scored higher on drug abuse and committed more sexual offenses than resilient prisoners. These two personality subtypes bear theoretically and practically important implications for psychopathy subtypes and different pathways to criminal offenses.

Exploring trait assessment of samples, persons, and cultures

I present a very broad overview of what I have learned about personality trait assessment at different levels and offer some views on future directions for research and clinical practice. I review some basic principles of scale development and argue that internal consistency has been overemphasized; more attention to retest reliability is needed. Because protocol validity is crucial for individual assessment and because validity scales have limited utility, I urge combining assessments from multiple informants, and I present some statistical tools for that purpose. As culture-level traits, I discuss ethos, national character stereotypes, and aggregated personality traits, and summarize evidence for the validity of the latter. Our understanding of trait profiles of cultures is limited, but it can guide future exploration.

The value of suppressor effects in explicating the construct validity of symptom measures

Suppressor effects are operating when the addition of a predictor increases the predictive power of another variable. We argue that suppressor effects can play a valuable role in explicating the construct validity of symptom measures by bringing into clearer focus opposing elements that are inherent--but largely hidden--in the measure's overall score. We illustrate this point using theoretically grounded, replicated suppressor effects that have emerged in analyses of the original Inventory of Depression and Anxiety Symptoms (IDAS; Watson et al., 2007) and its expanded 2nd version (IDAS-II; Watson et al., 2012). In Study 1, we demonstrate that the IDAS-II Appetite Gain and Appetite Loss scales contain both (a) a shared distress component that creates a positive correlation between them and (b) a specific symptom component that produces a natural negative association between them (i.e., people who recently have experienced decreased interest in food/loss of appetite are less likely to report a concomitant increase in appetite/weight). In Study 2, we establish that mania scales also contain 2 distinct elements-namely, high energy/positive emotionality and general distress/dysfunction-that oppose each another in many instances. In both studies, we obtained evidence of suppression effects that were highly robust across different types of respondents (e.g., clinical outpatients, community adults, college students) and using both self-report and interview-based measures. These replicable suppressor effects establish that many homogeneous, unidimensional symptom scales actually contain distinguishable components with distinct--at times, even antagonistic--properties.

The Development and Psychometric Properties of an Informant-Report Form of the Personality Inventory for DSM-5 (PID-5)

The current article reports on the development, psychometric properties, and external validity of an informant-report form of the Personality Inventory for DSM-5 (the PID-5-IRF). Using data from two nationally representative samples, as well as an elevated-risk community sample, we report on the PID-5-IRF item characteristics, scale properties, superordinate factor structure, and correlations with other measures. The PID-5-IRF replicates the factor structure of the self-report form and has relationships with other measures (including the PID-5 self-report form and a widely used Big Five measure) that are consistent with previous research and theory. We believe that the PID-5-IRF is a useful measure for a number of scenarios, such as when additional sources of information are desired, where informant measures are expected to provide incremental validity over self-report, where relationships or social perception is a focal interest, or when response bias is a salient concern. Areas for future research are also discussed.

Measuring Faking on Five-Factor Personality Questionnaires

The aim of the study was to test whether the Agentic Management (AM) and Communal Management (CM) scales ( Paulhus, 2006 ) represent valid indicators of faking on a Five-Factor personality questionnaire. These scales represent recent advances in measurement of desirable responding. In a within-subject design study, 210 participants completed a Big Five personality questionnaire and social desirability inventory, both in honest and simulated selection conditions. Although the AM and CM scales were sensitive to situational demands and substantially correlated with the level of faking on some personality traits, our analyses revealed that they cannot be used to correct personality scales nor to eliminate participants from selection procedures.

The inconsistency of inconsistency scales: a comparison of two widely used measures

This study compared the inconsistent responding validity scales of the Personality Assessment Inventory (PAI) and the Psychopathic Personality Inventory (PPI)/PPI-Revised (PPI-R) in two correctional samples to determine the extent to which they overlap in identifying invalid profiles. Results revealed substantial differences in the way the inconsistent responding validity scales of these measures performed. In particular, the PAI identified far fewer participants as having responded inconsistently compared with the PPI/PPI-R. We discuss the implications of our findings for clinical practice, and potential concerns with the use of a single measure to identify inconsistent responding in clinical practice and research.

Applicant reactions and faking in real-life personnel selection

Faking may affect hiring decisions in personnel selection. All the antecedents of faking are still not known. The present study investigates the association between applicants' reactions about the selection procedure and their tendency to fake. The subjects (N = 180) were real-life applicants for a fire and rescue personnel school. After completing the selection process, the applicants filled out a questionnaire about their test reactions (Chan, Schmitt, Sacco & DeSohon, 1998b) and a faking scale, the Balanced Inventory of Desirable Responding (Paulhus, 1991). The results based on Structural Equation Modelling (SEM) indicated that the more positive reactions applicant had about the selection procedure the more impression management they had. The applicant reactions were not associated with self-deception.

Longitudinal intergroup contact effects on prejudice using self- and observer-reports

Longitudinal effects of intergroup contact on prejudice were investigated in a sample of 65 young adults (Sample 1) and a sample of their close friends (Sample 2, N= 172), adopting a full cross-lagged panel design. We first validated the self-report measure of intergroup contact from Sample 1 with observer ratings from Sample 2 by demonstrating that self-reports and observer ratings of contact were highly correlated. Moreover, we obtained significant cross-lagged effects of intergroup contact on prejudice with both contact measures, thereby providing a second validation for the use of self-reports of intergroup contact. Finally, by the use of latent change modelling, we demonstrated that, although no overall significant change in contact and prejudice over time was found, there was meaningful variation in absolute change in the individual levels of intergroup contact and prejudice. In particular, some individuals showed increases while others showed decreases in contact or prejudice across time. Moreover, higher levels of intergroup contact at Time 1 were followed by larger subsequent decreases in prejudice between Time 1 and Time 2, and changes in contact were significantly and negatively related to changes in prejudice. Methodological implications of the findings are discussed.