Implications relevant to CFA model misfit, reliability, and the five-factor model as measured by the NEO-FFI

An exploration of Italian laypeople's belief in how human memory works

We present the first study to measure the beliefs held by Italian laypeople about how human memory works, using a newly developed tool: the Italian Memory Belief Questionnaire (IMBQ). Research conducted in other countries has demonstrated that beliefs about memory vary widely between different professional and non-professional groups, indicating that limitations exist regarding the dissemination of empirically researched scientific knowledge. To ascertain what Italian people understand about memory-related topics, including eyewitness testimony, repression of traumatic memories and factors influencing memory recall, 301 native Italian participants completed the IMBQ in Study 1. In Study 2, 346 additional participants completed the IMBQ, alongside various additional measures, to examine the construct validity of our new instrument and investigate socio-demographic predictors of memory beliefs. Exploratory factor analysis in Study 1 identified three distinct belief factors that were present in the dataset: eyewitness and memory reliability, trauma and remembering and aspects that improve remembering. Study 2 partially confirmed this factor structure and found IMBQ scores to correlate with existing memory belief questionnaires. Correlations were also found between the IMBQ subscales and measures of fantasy proneness, but not dissociation. In both studies, many Italian laypeople strongly endorsed the notion that controversial topics (i.e., repression) are possible. Contrastingly, Italian laypeople do appear to understand the conceivable inaccuracies of memory in eyewitness settings. Sex, age and education were shown to predict beliefs about memory. Findings are discussed in relation to the importance of addressing misinformation about memory, especially in clinical and forensic settings.

Is it time to replace the Big Five personality model? Factorial structure of the NEO PI-R in a community sample of Spanish adults

Recent studies have revived the issue of whether the five-factor personality model or Big Five is the most valid to summarize the most relevant personality traits or whether, on the contrary, the basic structure of personality traits would better fit a six-factor model such as the HEXACO model: Honesty-Humility (H), Emotionality (E), Extraversion (X), Agreeableness (A), Conscientiousness (C), and Openness to Experience (O). In a Spanish community sample of 682 adults, the factorial structure of the 30 facets of the NEO-Revised Personality Inventory (NEO PI-R) and its 16 facets common to the HEXACO model was analyzed. In two subsamples of participants, the internal structure of the NEO PI-R, of 30 and 16 facets, fit the five-factor Big Five model better than the six-factor HEXACO model. In addition, the internal 30-facet structure of the NEO-PI-R replicated that obtained in the original US validation and those previously obtained in Spain, although the latter used different participant samples (people evaluated in personnel selection processes, university students). These results suggest that, at least in Spain, the five-factor personality model or Big Five is still the most valid taxonomy of personality traits.

Trajectory of first-year students’ depressive mood after the transition to high school: The role of personality dimensions

This short-term longitudinal study investigated the developmental trajectory of first-year students’ depressive mood and the role of personality dimensions after the transition to high school. Chinese first-year high school students (251 males, 295 females) completed surveys to determine depressive mood and personality dimensions. The latent growth modeling results were as follows: participants’ depressive mood increased linearly after the transition to high school, and the intercept and slope of depressive mood were insignificantly correlated; neuroticism significantly and positively predicted the intercept and slope of depressive mood; extraversion, openness, and conscientiousness negatively and significantly predicted the intercept of depressive mood, but insignificantly predicted the slope; and agreeableness did not predict the intercept or slope of depressive mood. Overall, first-year students’ depressive mood increased linearly and personality dimensions differently predict depressive mood during this period.

Hidden framings and hidden asymmetries in the measurement of personality--A combined lens-model and frame-of-reference perspective

OBJECTIVE

The symmetry principle and the frame-of-reference perspective have each made contributions to improving the measurement of personality. Although each perspective is valuable in its own right, we argue that even greater improvement can be achieved through the combination of both. Therefore, the goal of the current article was to show the value of a combined lens-model and frame-of-reference perspective.

METHOD

We conducted a literature review to summarize relevant research findings that shed light on the interplay of both perspectives and developed an integrative model.

RESULTS

Based on the literature review and on theoretical grounds, we argue that a basic premise of the frame-of-reference literature--that personality items are open to interpretation and allow individuals to impose their own contextual framings--should be considered from a symmetry perspective. Unintended context-specificity in items may "spread" to personality facets and domains, and thus, impact the symmetry of personality measures with other criteria. As the individuals´ frames-of-reference and (a)symmetric relationships are not always apparent, we term them as "hidden."

CONCLUSIONS

The proposed combination of lens-model and frame-of-reference perspectives provides further insights into current issues in personality research and uncovers important avenues for future research.

Psychometric Properties and Construct Validity of the Short Version of the Self-Report Psychopathy Scale in a Southern European Sample

The Self-Report Psychopathy Scale-Short Form (SRP-SF) is a brief measure of psychopathy, developed via model-based test theory. The SRP-SF has a 4-factor structure with items reflecting affective, interpersonal, lifestyle, and antisocial domains, in line with the Psychopathy Checklist-Revised (PCL-R), which can be aggregated to form the traditional F1 and F2 dimensions of psychopathy. Previous research indicates the SRP is a viable tool for examining the prevalence of psychopathic propensities and their correlates in nonoffender populations. Currently, a substantial amount of nonoffender research on psychopathy is conducted in North America. Here, we inspect the psychometric properties of the SRP-SF and probe its association with general personality and empathy in a large southern European (Portuguese) community sample. Consistent with previous studies, results indicated good fit for the 4-factor model, including for separate female and male subsamples, good internal consistency across its scales and subscales, and the predicted pattern of associations with the correlates of psychopathy. The results of this cross-cultural study provide further evidence of the validity of the SRP-SF in the assessment of psychopathy in community samples, and help to extend the nomological net on the larger construct to a southern European sample.

Applying bifactor modelling to improve the clinical interpretive values of Functional Independence Measure in adults with acquired brain injury

Purpose: To apply a modern robust approach, bifactor modeling, to critically examine psychometric properties of Functional Independence Measure (FIM) in adults with acquired brain injury and to propose a solution to improve the clinical interpretive values of the FIM to inform policy and clinical practice.Methods: The data came from a state-wide specialist in-patient brain injury rehabilitation service in Queensland, Australia for adults with acquired brain injury and discharged between 2012 and 2017. The sample included 457 people. Three measurement models (unidimensional, correlated first-order and bifactor) for FIM were tested using confirmatory factor analysis with structural equation modeling. Then, model-based reliability and incremental validity were assessed.Results: The bifactor model best fit the data. When operationalized as latent factors under structural equation modeling framework, general care burden had a large predictive effect, while Motor and Cognitive showed medium and small predictive effects respectively on rehabilitation length of stay.Conclusions: The total score of FIM was a reliable measure of general care burden, while the subscale scores were not. A solution is to apply a bifactor modeling approach based on structural equation modeling to disentangle the unique variance attributable to Motor and Cognitive factors. In the structural equation modeling framework, the FIM demonstrated good incremental validity to inform policy and clinical practice.Implications for rehabilitationClinicians and researchers can confidently use FIM total score in adults with acquired brain injury.The current study proposed an alternative solution to the poor reliability of Motor and Cognitive scores, that is, by applying a bifactor modeling approach, the unique contributions of the Motor and Cognitive factors can be examined.The current study has demonstrated the strengths of bifactor modeling in the robust validation and interpretation of FIM to better inform clinical practice and policy decision-making.The current study has the potential to make an important contribution to enhance more equitable decision-making in the areas of national benchmarking of rehabilitation outcomes and other program eligibility criteria and funding allocation.

Modeling General, Specific, and Method Variance in Personality Measures: Results for ZKA-PQ and NEO-PI-R

Contemporary models of personality assume a hierarchical structure in which broader traits contain narrower traits. Individual differences in response styles also constitute a source of score variance. In this study, the bifactor model is applied to separate these sources of variance for personality subscores. The procedure is illustrated using data for two personality inventories-NEO Personality Inventory-Revised and Zuckerman-Kuhlman-Aluja Personality Questionnaire. The inclusion of the acquiescence method factor generally improved the fit to acceptable levels for the Zuckerman-Kuhlman-Aluja Personality Questionnaire, but not for the NEO Personality Inventory-Revised. This effect was higher in subscales where the number of direct and reverse items is not balanced. Loadings on the specific factors were usually smaller than the loadings on the general factor. In some cases, part of the variance was due to domains being different from the main one. This information is of particular interest to researchers as they can identify which subscale scores have more potential to increase predictive validity.

Within-trait heterogeneity in age group differences in personality domains and facets: implications for the development and coherence of personality traits

The study investigated differences in the Five-Factor Model (FFM) domains and facets across adulthood. The main questions were whether personality scales reflected coherent units of trait development and thereby coherent personality traits more generally. These questions were addressed by testing if the components of the trait scales (items for facet scales and facets for domain scales) showed consistent age group differences. For this, measurement invariance (MI) framework was used. In a sample of 2,711 Estonians who had completed the NEO Personality Inventory 3 (NEO PI-3), more than half of the facet scales and one domain scale did not meet the criterion for weak MI (factor loading equality) across 12 age groups spanning ages from 18 to 91 years. Furthermore, none of the facet and domain scales met the criterion for strong MI (intercept equality), suggesting that items of the same facets and facets of the same domains varied in age group differences. When items were residualized for their respective facets, 46% of them had significant (p < 0.0002) residual age-correlations. When facets were residualized for their domain scores, a majority had significant (p < 0.002) residual age-correlations. For each domain, a series of latent factors were specified using random quarters of their items: scores of such latent factors varied notably (within domains) in correlations with age. We argue that manifestations of aetiologically coherent traits should show similar age group differences. Given this, the FFM domains and facets as embodied in the NEO PI-3 do not reflect aetiologically coherent traits.

Spirituality as a scientific construct: testing its universality across cultures and languages

Using data obtained from 4004 participants across eight countries (Canada, India, Japan, Korea, Poland, Slovakia, Uganda, and the U.S.), the factorial reliability, validity and structural/measurement invariance of a 30-item version of Expressions of Spirituality Inventory (ESI-R) was evaluated. The ESI-R measures a five factor model of spirituality developed through the conjoint factor analysis of several extant measures of spiritual constructs. Exploratory factor analyses of pooled data provided evidence that the five ESI-R factors are reliable. Confirmatory analyses comparing four and five factor models revealed that the five dimensional model demonstrates superior goodness-of-fit with all cultural samples and suggest that the ESI-R may be viewed as structurally invariant. Measurement invariance, however, was not supported as manifested in significant differences in item and dimension scores and in significantly poorer fit when factor loadings were constrained to equality across all samples. Exploratory analyses with a second adjective measure of spirituality using American, Indian, and Ugandan samples identified three replicable factors which correlated with ESI-R dimensions in a manner supportive of convergent validity. The paper concludes with a discussion of the meaning of the findings and directions needed for future research.

On the Inappropriateness of Using Items to Calculate Total Scale Score Reliability via Coefficient Alpha for Multidimensional Scales

Researchers have the implicit option of calculating internal consistency reliability (coefficient α) for total scale scores derived from multidimensional inventories based on either the inter-item correlation matrix (item unit-level) or the inter-subscale correlation matrix (subscale unit-level). It is demonstrated that item unit-level and subscale unit-level reliability estimates often diverge substantially in practice. Specifically, the item unit-level reliability estimation is often larger than the corresponding subscale unit-level estimate. It is recommended that if researchers calculate total scale score reliability at the item unit-level, then a model-based approach to the estimation of internal consistency reliability (i.e., omega hierarchical) should be applied, when the underlying model is multidimensional. If omega hierarchical cannot be applied for any particular reason, it is recommended that total scale score reliabilities be calculated at the subscale unit-level of analysis, not the item unit-level.

Bifactor Modeling and the Estimation of Model-Based Reliability in the WAIS-IV

Previous confirmatory factor analytic research that has examined the factor structure of the Wechsler Adult Intelligence Scale-Fourth Edition (WAIS-IV) has endorsed either higher order models or oblique factor models that tend to amalgamate both general factor and index factor sources of systematic variance. An alternative model that has not yet been examined for the WAIS-IV is the bifactor model. Bifactor models allow all subtests to load onto both the general factor and their respective index factor directly. Bifactor models are also particularly amenable to the estimation of model-based reliabilities for both global composite scores (ω h ) and subscale/index scores (ω s ). Based on the WAIS-IV normative sample correlation matrices, a bifactor model that did not include any index factor cross loadings or correlated residuals was found to be better fitting than the conventional higher order and oblique factor models. Although the ω h estimate associated with the full scale intelligence quotient (FSIQ) scores was respectably high (.86), the ω s estimates associated with the WAIS-IV index scores were very low (.13 to .47). The results are interpreted in the context of the benefits of a bifactor modeling approach. Additionally, in light of the very low levels of unique internal consistency reliabilities associated with the index scores, it is contended that clinical index score interpretations are probably not justifiable.

The psychometric properties of the personality inventory for DSM-5 in an APA DSM-5 field trial sample

Section 3 of the fifth edition of the Diagnostic and Statistical Manual of Mental Disorders (DSM-5) includes a hybrid model of personality pathology, in which dimensional personality traits are used to derive one of seven categorical personality disorder diagnoses. The Personality Inventory for DSM-5 (PID-5) was developed by the DSM-5 Personality and Personality Disorders workgroup and their consultants to produce a freely available instrument to assess the personality traits within this new system. To date, the psychometric properties of the PID-5 have been evaluated primarily in undergraduate student and community adult samples. In the current investigation, we extend this line of research to a psychiatric patient sample who participated in the APA DSM-5 Field Trial (Centre for Addiction and Mental Health site). A total of 201 psychiatric patients (102 men, 99 women) completed the PID-5 and the Revised NEO Personality Inventory (NEO PI-R). The internal consistencies of the PID-5 domain and facet trait scales were acceptable. Results supported the unidimensional structure of all trait scales but one, and the convergence between the PID-5 and analogous NEO PI-R scales. Evidence for discriminant validity was mixed. Overall, the current investigation provides support for the psychometric properties of this diagnostic instrument in psychiatric samples.

Phenomenological dimensions of sensory gating

Contemporary sensory gating definitions are generally tied to the perceptual and attentional phenomenology described by McGhie and Chapman, including abnormalities in the quality of sensory input, heightened awareness of background noises, and poor selective attention reported by individuals with schizophrenia. Despite these explicit phenomenological origins, little is known about the experiential phenomena underlying contemporary operationalizations of the sensory gating construct, such as whether the construct is restricted to experiences associated with the modulation of sensory percepts includes selective attention and distractibility or even whether the construct is accessible via self-report. Because clarification of these issues has important implications for the development and testing of psychological theories and the study of psychopathology, a series of studies was conducted to (a) empirically identify the major dimensions of sensory gating-like perceptual and attentional phenomenology in healthy young adults and (b) develop a psychometrically sound self-report rating scale to capture these dimensions, the Sensory Gating Inventory (SGI). Factor analyses of Likert items measuring a broad range of sensory gating-like subjective experiences revealed 1 primary factor that encompassed anomalies of perceptual modulation (eg, perceptions of heightened stimulus sensitivity and sensory inundation) and 3 other factors measuring disturbances in the processes of focal and radial attention as well as exacerbation of sensory gating-like anomalies by fatigue and stress. Psychometrically, the SGI demonstrated strong reliability and validity. An empirically based conceptual demarcation of the sensory gating construct is offered, and directions for future research are described.

How Should the Internal Structure of Personality Inventories Be Evaluated?

Personality trait inventories often perform poorly when their structure is evaluated with confirmatory factor analysis (CFA). The authors demonstrate poor CFA fit for several widely used personality measures with documented evidence of criterion-related validity but also show that some measures perform well from an exploratory factor analytic perspective. In light of these results, the authors suggest that the failure of these measures to fit CFA models is because of the inherent complexity of personality, issues related to its measurement, and issues related to the application and interpretation of CFA models. This leads to three recommendations for researchers interested in the structure and assessment of personality traits: (a) utilize and report on a range of factor analytic methods, (b) avoid global evaluations regarding the internal validity of multiscale personality measures based on model fit according to conventional CFA cutoffs, and (c) consider the substantive and practical implications of model modifications designed to improve fit.

Same or different? Clarifying the relationship of need for cognition to personality and intelligence

Need for cognition (NFC) refers to an individual's tendency to engage in and enjoy effortful cognitive processing. So far, little attention has been paid to a systematic evaluation of the distinctiveness of NFC from traits with similar conceptualization and from intelligence. The present research contributes to filling this gap by examining the relation of NFC to well-established personality concepts (Study 1) and to a comprehensive measure of intelligence in a sample with broad educational backgrounds (Study 2). We observed NFC to be positively correlated with openness, emotional stability, and traits indicating goal orientation. Using confirmatory factor analysis and event-related potentials, incremental validity of NFC and openness to ideas was demonstrated, showing that NFC is more predictive of drive-related and goal-oriented behavior and attentional resource allocation. Regarding intelligence, NFC was more associated with fluid than with crystallized aspects of intelligence. Altogether, the results provide strong support for the conceptual autonomy of NFC.

Psychometric characteristics of a measure of emotional dispositions developed to test a developmental propensity model of conduct disorder

Lahey and Waldman proposed a developmental propensity model in which three dimensions of children's emotional dispositions are hypothesized to transact with the environment to influence risk for conduct disorder, heterogeneity in conduct disorder, and comorbidity with other disorders. To prepare for future tests of this model, a new measure of these dispositions was tested. Exploratory factor analysis of potential items was conducted in a sample of 1,358 participants 4 to 17 years of age. Confirmatory factor analyses then confirmed the three dispositional dimensions in a second sample of 2,063 pairs of 6- to 17-year-old twins. Caretaker ratings of the dispositional dimensions were associated as predicted with symptoms of conduct disorder and other psychopathology. In a third sample, caretaker ratings of each disposition correlated uniquely with relevant observational measures of child behavior and unintentional injuries. These findings provide initial support for the new dispositional measure.