On the sins of short-form development

Validation of an abbreviated Big Five personality inventory at large population scale: Psychometric structure and associations with common psychiatric and neurological disorders

BACKGROUND

The five-factor model of personality, as quantified using instruments such as the Big Five Inventory, consists of broad personality domains including Extraversion, Agreeableness, Conscientiousness, Neuroticism (emotional instability), and Openness. Such instruments typically include >40 items. However, instruments with many items can be unwieldly and a cause of measurement error in clinical and cohort studies where multiple scales are sequenced. Conversely, established 5- and 10-item versions of the Big Five Inventory have poor reliability. Here, we developed and validated an abbreviated 18-item Big Five Inventory that balances efficiency, reliability and sensitivity.

METHOD

We analysed three datasets (N = 59,797, N = 21,177, and N = 87,983) from individuals who participated in the online Great British Intelligence Test (GBIT) study, a collaborative citizen science project with BBC2 Horizon. We applied factor analyses (FA), predictive normative modelling, and one-sample t-tests to validate the 18-item version of the Big Five and to investigate its associations with psychiatric and neurological conditions.

RESULTS

The 18-item version of the Big Five Inventory had higher validity and retest reliability compared to the other previously shortened versions in the literature, with comparable demographic associations to the full Big Five Inventory. It exhibited strong (i.e. large effect size) associations with psychiatric conditions, and moderate (small-medium) associations with neurological conditions. Neuroticism (emotional instability) was substantially higher in all psychiatric conditions, whereas Conscientiousness, Openness and Extraversion showed differential associations across conditions.

CONCLUSION

The newly validated 18-item version of the Big Five provides a convenient means of measuring personality traits that is suitable for deployment in a range of studies. It retains psychometric structure, retest reliability and clinical-group sensitivity, as compared to the full original scale.

Measuring Global Character Dimensions: An Ant Colony Optimization Approach toward Three Core Strength Scales

The Values in Action (VIA) framework encompasses 24 universally valued character strengths. Recent factor-analytic work has identified three global core strengths (metatraits) that proved to be well-interpretable and cross-culturally replicable: positivity, dependability, and mastery. However, there are no short scales to economically measure these core strengths that would encourage (large-scale) survey-based research on the global level of the VIA trait space. In the present study, we selected 18 items to measure the three metatraits from the 96-item IPIP-VIA-R inventory. To optimize the item selection while considering multiple psychometric criteria simultaneously, we made use of Ant Colony Optimization. Thereby, we obtained balanced-keyed scales that cover the heterogeneous constructs well, showed good model fit and reliability across six samples from Germany and the U.K. (total N = 2,754), and achieved scalar measurement invariance across countries. Furthermore, we demonstrated each scale's validity by locating the three core strengths in a nomological net with personality and value metatraits, life satisfaction, and behavioral criteria. Available in the public domain in English and German, these both valid and economical core strength scales may further stimulate integrative research on personality and values.

A brief young adult alcohol problems screening test: Short form development using combinatorics

Objective: To develop a shortened form of the Young Adult Alcohol Problems Screening Test1 (YAAPST; original length = 27 items) using a novel combinatorial approach. Participants: 489 college freshmen, half of whom were above average risk for alcohol use disorder based upon family history, attending a large, Midwestern University followed prospectively for 16-17 years across 7 measurement occasions (waves). Methods: Using an exhaustive combinatorial approach, we evaluated all possible combinations of questions and questionnaire length. Each candidate short-form was evaluated using part-whole correlations, alpha coefficients, and polyserial correlations with DSM-III criteria. Results: The 12-item scale, the Brief-YAAPST, was chosen as the best candidate short-form as this scale had the fewest items while maintaining strong reliability and validity. Conclusions: Complete enumeration optimization effectively produced a 12-item short form with minimal loss of reliability and validity making the Brief-YAAPST a desirable assessment alternative when there are concerns about participant or client burden.

Evaluating the factor structure and measurement invariance of the 20-item short version of the UPPS-P Impulsive Behavior Scale across multiple countries, languages, and gender identities

The UPPS-P Impulsive Behavior Model and the various psychometric instruments developed and validated based on this model are well established in clinical and research settings. However, evidence regarding the psychometric validity, reliability, and equivalence across multiple countries of residence, languages, or gender identities, including gender-diverse individuals, is lacking to date. Using data from the International Sex Survey (N = 82,243), confirmatory factor analyses and measurement invariance analyses were performed on the preestablished five-factor structure of the 20-item short version of the UPPS-P Impulsive Behavior Scale to examine whether (a) psychometric validity and reliability and (b) psychometric equivalence hold across 34 country-of-residence-related, 22 language-related, and three gender-identity-related groups. The results of the present study extend the latter psychometric instrument's well-established relevance to 26 countries, 13 languages, and three gender identities. Most notably, psychometric validity and reliability were evidenced across nine novel translations included in the present study (i.e., Croatian, English, German, Hebrew, Korean, Macedonian, Polish, Portuguese-Portugal, and Spanish-Latin American) and psychometric equivalence was evidenced across all three gender identities included in the present study (i.e., women, men, and gender-diverse individuals).

Brief memory assessment in children: can the ChAMP Screening Index detect memory impairment?

Abbreviated memory batteries play a role in some clinical and research assessments, but their validity and accuracy need to be well supported. The purpose of this study was to examine the accuracy of the ChAMP Screening Index for detecting memory impairment. The sample included N = 804 youths (ages 5-21 years) with medical and neurological diagnoses who were presented for a clinical neuropsychological assessment. All completed the full Child and Adolescent Memory Profile and had valid data. The ChAMP Screening Index contains the first two subtests of the battery (Lists and Objects) and takes about 10 min to administer (full ChAMP is about 35 min). Analyses to examine the accuracy of the ChAMP Screening Index with both the Total Memory Index and Delayed Memory Index included Intraclass correlations, Cohen's Kappa coefficients, receiver operating characteristics, and classification metrics (e.g., sensitivity, specificity, positive predictive values [PPV], and negative predictive values [NPV]). Very strong correlations, minimal mean difference scores, substantial agreement on kappa coefficients, and outstanding receiver operating characteristics all support the Screening Index accuracy. A cutoff score on the Screening Index of 70 provides a good balance between a high PPV (.91) and a high NPV (.96) for the Total Memory Index. When detecting impairment on the Delayed Memory Index, a Screening Index cutoff score of 65 provides a balance between a high PPV (.92) and a high NPV (.94). This study supports the accuracy, validity, and utility of the 10-min ChAMP Screening Index in those clinical and research situations where a brief evaluation of memory is desired.

Why Do People Watch Pornography? Cross-Cultural Validation of the Pornography Use Motivations Scale (PUMS) and Its Short Form (PUMS-8)

Motivations for pornography use may vary across gender identities, sexual orientations, and geographical regions, warranting examination to promote individual and public health. The aims of this study were to validate the Pornography Use Motivations Scale (PUMS) in a diverse, multicultural sample, and develop a short form (PUMS-8) that can assess a wide range of pornography use motivations. Using data from 42 countries (N = 75,117; Mage = 32.07; SDage = 12.37), enabled us to thoroughly evaluate the dimensionality, validity, and reliability of the Pornography Use Motivations Scale (PUMS), leading to the development of the more concise PUMS-8 short scale. Additionally, language-, nationality-, gender-, and sexual-orientation-based measurement invariance tests were conducted to test the comparability across groups. Both the PUMS and the PUMS-8 assess eight pornography use motivations, and both demonstrated excellent psychometric properties. Sexual Pleasure emerged as the most frequent motivation for pornography use across countries, genders, and sexual orientations, while differences were observed concerning other motivations (e.g. self-exploration was more prevalent among gender-diverse individuals than men or women). The motivational background of pornography use showed high similarity in the examined countries. Both the PUMS and the PUMS-8 are reliable and valid measurement tools to assess different types of motivations for pornography use across countries, genders, and sexual orientations. Both scales are recommended for use in research and clinical settings.

The Sport Experience Measure for Children and Youth (SEM:CY): A Rasch Validation Study

This study employed Rasch analyses to validate a novel measure of sport experience: the Sport Experience Measure: Children and Youth (SEM:CY). Analyses were applied to self-reported data of n = 503 young people (age 9-18 years, M = 12.91, 50% female) in Canada who were engaging in sport during the previous 12 months. The revised measure, consisting of 24 items on a 3-point response scale, demonstrated good fit statistics (e.g., item fit residual: M = -0.50, SD = 0.94 and person fit residual: M = -0.62, SD = 2.33), an ability to reliably discriminate between levels of sport experience, and an absence of differential item functioning for various groups (males and females, older and younger individuals, solo and team sports, and those playing at various competitive levels, including recreation). The SEM:CY is a succinct tool that can serve as a valuable means to gauge the quality of an individual's sport experience, which can facilitate positive youth development and sustain participation across the life span.

Not all mindfulness is equal: certain facets of mindfulness have important implications for well-being and mental health across the lifespan

The connections between the five facets of mindfulness, well-being, and mental health across the lifespan have traditionally been investigated using variable-centered approaches. Less research has investigated these relationships from a person-centered, profile-based approach. In this work, we aimed to identify the profiles of mindfulness in a Canadian lifespan sample (14 to 90 years of age) and investigate how these profiles compared on age, well-being, and mental health. An age- and gender-balanced sample of 1,600 participants completed a questionnaire that measured the five facets of mindfulness; life satisfaction; existential well-being; and anxiety, depression, and stress symptoms. A latent profile analysis was conducted. Five profiles based on the five-facet model of mindfulness were identified: high mindfulness, moderate mindfulness, low mindfulness, nonjudgmentally aware, and judgmentally observing. The 3-step approach to profile comparisons was used to assess age, mental health, and well-being differences across the profiles. Those in the high mindfulness and nonjudgmentally aware profiles were generally older, while the judgmentally observing profile contained younger individuals. Those in the high mindfulness and nonjudgmentally aware profiles reported the greatest mental health and well-being. Conversely, those in the low mindfulness and judgmentally observing profiles had worse mental health than the other profiles. The moderate mindfulness profile was situated between these profile groups on age, mental health, and well-being outcomes. This pattern of results has implications for mindfulness-based intervention research and practice to better account for heterogeneity in mindfulness and better support well-being across the lifespan.

The Brief Version of the Mentalization Scale (MentS-12): Evidence-Based Assessment of Mentalizing Capacity

Recognizing the need for a concise self-report measure of mentalizing capacity, we developed a 12-item iteration of the well-established Mentalization Scale (MentS). Using college student and community samples of Serbian adults (N = 566), we performed a precise selection of items and then examined the psychometric attributes of the shortened scale (MentS-12). The new scale maintains the original three-dimensional structure: self-related mentalization, other-related mentalization, and motivation to mentalize. MentS-12 proves to be both reliable and structurally consistent. To improve its utility in therapeutic contexts, we determined clinical change thresholds for both the complete and abbreviated forms. We hope that its feasibility stimulates the integration of the MentS-12 in longitudinal research projects and real-world clinical settings.

Development and validation of an 8-item version of the Real Relationship Inventory-Client form

OBJECTIVE

To develop and validate a very brief version of the 24-item Real Relationship Inventory-Client (RRI-C) form.

METHOD

Two independent samples of individual psychotherapy patients (Nsample1 = 700, Nsample2 = 434) completed the RRI-C along with other measures. Psychometric scale shortening involved exploratory factor analysis, item response theory analysis, confirmatory factor analysis (CFA), and multigroup CFA. Reliability and convergent and discriminant validity of the scale and subscales were also assessed.

RESULTS

The 8-item RRI-C (RRI-C-SF) preserves the two-factor structure: Genuineness (k = 4, α = .86) and Realism (k = 4, α = .87), which were correlated at r = .74. CFA provided the following fit indices for the bifactor model: X2/df = 2.16, CFI = .99, TLI = .96, RMSEA = .07, and SRMR = .03. Multigroup CFA showed that the RRI-C-SF was invariant across in-person and remote session formats. The RRI-C-SF demonstrated high reliability (α = .91); high correlation with the full-length scale (r = .96); and excellent convergent and discriminant validity with measures of other elements of the therapeutic relationship, personality characteristics, current mental health state, and demographic-clinical variables. Clinical change benchmarks were calculated to serve as valuable tools for both research and clinical practice.

CONCLUSION

The RRI-C-SF is a reliable measure that can be used for both research and clinical purposes. It enables a nuanced assessment of the genuineness and the realism dimensions of the real relationship.

Outcome metrics utilized in evaluations of programs and interventions for combat and operational stress: A review of psychometric properties

The Department of Defense has mandated combat and operational stress control (COSC) efforts for the Services since 1999. Although several COSC-related programs have been implemented, few have undergone evaluation, and no standardized metrics have been established to assess their effectiveness and utility. The purpose of this review was to characterize the content and psychometrics of measures that have been utilized as outcome metrics in evaluations of COSC-related programs and interventions. Systematic literature searches were conducted for publications that: a) evaluated at least one measure from U.S. service members who participated in a program or intervention to prevent or reduce the adverse effects of combat and operational stress; and b) reported U.S. data on the internal consistency, test-retest reliability, convergent validity, and sensitivity/specificity of the identified measures. This process identified 15 measures for which psychometric properties were reviewed for acceptability based on recommended criteria. Identified measures varied from well-validated measures to newer instruments for which more data is needed on one or more of the target psychometric properties. Aside from internal consistency, psychometric data from U.S. military samples were sparse. Results further suggested that some measures might have reduced sensitivity in service members under certain conditions, such as large-scale screening. Additional studies are needed to validate COSC-relevant measures in service members. Future evaluations of programs and interventions for combat and operational stress should select measures that will increase the consistency of the literature, allow comparisons across studies, and ensure alignment with the objectives of identified programs.

Online assessment of musical ability in 10 minutes: Development and validation of the Micro-PROMS

We describe the development and validation of a test battery to assess musical ability that taps into a broad range of music perception skills and can be administered in 10 minutes or less. In Study 1, we derived four very brief versions from the Profile of Music Perception Skills (PROMS) and examined their properties in a sample of 280 participants. In Study 2 (N = 109), we administered the version retained from Study 1-termed Micro-PROMS-with the full-length PROMS, finding a short-to-long-form correlation of r = .72. In Study 3 (N = 198), we removed redundant trials and examined test-retest reliability as well as convergent, discriminant, and criterion validity. Results showed adequate internal consistency ( ω ¯ = .73) and test-retest reliability (ICC = .83). Findings supported convergent validity of the Micro-PROMS (r = .59 with the MET, p < .01) as well as discriminant validity with short-term and working memory (r ≲ .20). Criterion-related validity was evidenced by significant correlations of the Micro-PROMS with external indicators of musical proficiency ( r ¯ = .37, ps < .01), and with Gold-MSI General Musical Sophistication (r = .51, p<.01). In virtue of its brevity, psychometric qualities, and suitability for online administration, the battery fills a gap in the tools available to objectively assess musical ability.

Artificial Neural Networks for Short-Form Development of Psychometric Tests: A Study on Synthetic Populations Using Autoencoders

Short-form development is an important topic in psychometric research, which requires researchers to face methodological choices at different steps. The statistical techniques traditionally used for shortening tests, which belong to the so-called exploratory model, make assumptions not always verified in psychological data. This article proposes a machine learning-based autonomous procedure for short-form development that combines explanatory and predictive techniques in an integrative approach. The study investigates the item-selection performance of two autoencoders: a particular type of artificial neural network that is comparable to principal component analysis. The procedure is tested on artificial data simulated from a factor-based population and is compared with existent computational approaches to develop short forms. Autoencoders require mild assumptions on data characteristics and provide a method to predict long-form items' responses from the short form. Indeed, results show that they can help the researcher to develop a short form by automatically selecting a subset of items that better reconstruct the original item's responses and that preserve the internal structure of the long-form.

Development and Psychometric Properties of the Chronic Uveitis-Specific Quality of Life Instrument for Patients with Chronic Uveitis

PURPOSE

To develop and assess psychometric properties of a disease-specific quality of life (QOL) assessment tool for patients with chronic uveitis.

METHODS

The initial 42-item chronic uveitis-related QOL questionnaire (CUQOL) was developed by literature review, semi-structured interviews, and expert consultation. Further development and assessment of the CUQOL were performed using Classic Test Theory and Rasch analysis.

RESULTS

The CUQOL version 1.0 was constructed with 28 items in five dimensions. The five subscales satisfied the requirements of unidimensionality, local independence, and threshold ordering. Cronbach's α coefficient for overall and each scale of the CUQOL 1.0 ranged from 0.75 to 0.94, with test-retest intraclass correlation ranging from 0.95 to 0.99. The CUQOL 1.0 has satisfactory convergent validity (r = 0.41-0.82), reasonable known group validity (p < .05), and good responsiveness (p < .05).

CONCLUSIONS

The CUQOL 1.0 is reliable and vaild for evaluating the QOL of patients with chronic uveitis.

Comparing Brief Measures of Narcissism-Internal Consistency, Validity, and Coverage

Many measures, varying in breadth and length, have been constructed to measure narcissism. In recent years, super-short forms have become popular in research settings. Although brief measures hold some advantages, their brevity can come at psychometric costs. Participants recruited from Amazon's Mechanical Turk (N = 473) completed long and brief narcissism measures and criterion measures in a randomized order. Short forms were examined and compared to long forms in terms of their completion times and psychometric properties. Generally, the short forms demonstrated adequate internal consistency, variable convergence with each other, mostly moderate to strong convergence with long forms, and appropriate convergence with external criteria. These findings suggest that some short forms may be used when efficiency of survey administration is particularly important without significant psychometric cost. We discuss the advantages and disadvantages of the brief measures and make recommendations for which to use depending on the priorities of a given study.

Development and validation of a scale assessing parental varied responses to Chinese adolescents' negative emotions

OBJECTIVES

Parental responses to children's negative emotions (PRCNE) constitute a critical construct in the study of emotion socialization in children and adolescents. The objective of this research was to develop and validate a concise scale for assessing how adolescents perceive PRCNE in a Chinese context, resulting in the creation of the parental varied responses to Chinese adolescents' negative emotions (PVRCANE) scale. The PVRCANE aims to evaluate seven forms of PRCNE, including the six types encompassed by the commonly used Coping with Children's Negative Emotions Scale-Adolescent Version (CCNES-AV), as well as an additional, culturally specific category frequently seen in Chinese families: didactic talk and teaching.

METHODS

In Study 1, a group of participants (N = 901, Mage  = 13.39 years, SD = 0.92) completed the initial PVRCANE and the CCNES-Adolescent Version. In Study 2: A separate group of participants (N = 320, Mage  = 13.54 years, SD = 0.57) filled in PVRCANE and scales evaluating parental socialization goals and adolescents' depressive symptoms.

RESULTS

In Study 1, factor analyses showed that a four-factor structure best fit the data, leading to the final version of the PVRCANE, which includes 35 items. PVRCANE scores exhibited good internal consistency (Omega > 0.79) and convergent validity, demonstrated by their close correlation with traditional CCNES scores. Study 2 confirmed the PVRCANE's measurement invariance for both male and female parents and demonstrated criterion validity by showing significant relationships between PVRCANE scores, parental socialization goals, and adolescents' symptoms of depression.

CONCLUSION

The PVRCANE is a brief, valid, and reliable scale for assessing PRCNE in Chinese adolescents. The study concludes with a discussion on future directions and how this research enhances the existing literature on emotion socialization, with a particular emphasis on the scale's potential application in other cultural settings.

A Psychometric Study of a Trait and State Assessment of Sexual Pleasure - The Amsterdam Sexual Pleasure Inventory

We studied the Amsterdam Sexual Pleasure Inventory's (1.0) psychometric properties. The ASPI, a revised self-report battery designed to measure domains of state and trait sexual pleasure in diverse gender, sex, and relationship populations, is based on a recently proposed conceptual framework of sexual pleasure. We collected quantitative (n = 1371) and qualitative data (n = 637) using a cross-sectional multi-method design targeting the general (German-speaking) population. After pre-processing, we conducted analyses on a sample of n = 706 participants. The theory-based 5-factor exploratory structural equation model and the principal component analyses of the two general exploratory index-scales showed good and acceptable structural validity evidence respectively. Measurement invariance was confirmed separately for male and female participants and for those with sexually functional-scoring and dysfunctional-scoring levels. Coefficient omega indicated that all scales, except those of one facet, showed acceptable to very good internal consistency. The ASPI's convergent and discriminant associations with sexological and psychological constructs demonstrated good overall construct validity. Participants understood the items as intended and felt that the ASPI covered relevant facets of sexual pleasure. The ASPI might help understand how individuals differ in experiencing sexual pleasure and how different contexts enable some people to experience pleasure while disadvantaging others.

A Short Measure of the Big Five Aspects: Development and Validation of the BFAS-40

We present psychometric evidence for the BFAS-40, an abbreviated measure of the Big Five Aspects Scale (DeYoung et al., 2007). In Study 1, we developed the BFAS-40 using metaheuristic algorithms and cross-validated the factor structure of the shortened measure. In Study 2, we demonstrated that the BFAS and BFAS-40 correlate with external criteria in similar ways. In Studies 3 and 4, we provide convergent validity evidence by examining correlations between the BFAS-40 and other measures of typical and clinically relevant personality. Finally, in Study 5, we provide evidence of test-retest reliability as well as additional construct validity evidence. Across these five studies, we demonstrate that the BFAS-40 is a short, reliable, and valid measure of the Big Five Aspects.

Development and validation of a Manic Thought Inventory

OBJECTIVE

This article describes the development and psychometric evaluation of the Manic Thought Inventory (MTI), a patient-driven self-report inventory to assess the presence of typical (hypo)manic cognitions.

METHODS

The initial item pool was generated by patients with bipolar disorder (BD) type I and assessed for suitability by five psychiatrists specialized in treating BD. Study 1 describes the item analysis and exploratory factor structure of the MTI in a sample of 251 patients with BD type I. In study 2, the factor structure was validated with confirmatory factor analysis, and convergent and divergent validity were assessed in an independent sample of 201 patients with BD type I.

RESULTS

Study 1 resulted in a 50-item version of the MTI measuring one underlying factor. Study 2 confirmed the essentially unidimensional underlying construct in a 47-item version of the MTI. Internal consistency of the 47-item version of the MTI was excellent (α = 0.97). The MTI showed moderate to large positive correlations with other measures related to mania. It was not correlated with measures of depression.

CONCLUSION

The MTI showed good psychometric properties and can be useful in research and clinical practice. Patients could use the MTI to select items that they recognize as being characteristic of their (hypo)manic episodes. By monitoring and challenging these items, the MTI could augment current psychological interventions for BD.

The Emotion Regulation Questionnaire-Short Form (ERQ-S): A 6-item measure of cognitive reappraisal and expressive suppression

BACKGROUND

Emotion regulation plays a crucial role in affective functioning. One of the most commonly used measures of emotion regulation is the Emotion Regulation Questionnaire (ERQ), a 10-item self-report measure assessing frequency of use of two common emotion regulation strategies: cognitive reappraisal and expressive suppression. In this study, we aimed to optimize the utility of the ERQ for time-pressured settings by introducing and validating a 6-item short form called the Emotion Regulation Questionnaire-Short Form (ERQ-S).

METHOD

General community (N = 508) and college student (N = 245) samples from the United States completed online surveys containing a range of psychometric self-report measures. For each sample, we examined the factor structure, internal consistency, and concurrent validity of the ERQ-S.

RESULTS

Our confirmatory factor analyses supported the intended 2-factor structure of the ERQ-S (cognitive reappraisal and expressive suppression factors), with all items loading well on their intended factor in both samples. As expected, the ERQ-S correlated highly with the ERQ. A profile of low cognitive reappraisal use and high expressive suppression use on the ERQ-S was significantly associated with higher levels of emotion regulation difficulties, alexithymia, and affective symptoms.

LIMITATIONS

We did not examine psychometric performance in a clinical sample, or other cultural groups outside the US. All concurrent validity markers were self-report questionnaires.

CONCLUSIONS

Our data suggest that the ERQ-S successfully retains the psychometric strengths of the ERQ. The shorter format of the ERQ-S should therefore help to optimize the measurement of emotion regulation in time-pressured settings.

Assessment of Obsessive Thoughts About COVID-19 in 7 Latin American Countries: Structure and Measurement Invariance of the Obsession With COVID-19 Scale

The present study aimed to evaluate the measurement invariance of the Obsession with COVID-19 Scale (OCS) among seven Latin American countries: Bolivia, Brazil, Cuba, El Salvador, Guatemala, Paraguay, and Uruguay. Although the OCS has been used in several countries and languages, there is a need for approaches that better integrate the cross-cultural equivalence of the scale. A total of 3185 people participated in the study. The results indicated the presence of a unidimensional structure and good reliability indices for the OCS in each country. The alignment method indicated that the OCS is an invariant measure of COVID-19 obsession among the populations of seven Latin American countries. The findings based on IRT analysis indicated that all OCS items had adequate discrimination and difficulty parameters. The findings contribute to the understanding of the internal structure of the scale in different countries at the same time, something that has been pending evaluation.

Gender-Based Differential Item Function for the Positive and Negative Semantic Dimensions of the Relationship Satisfaction Scale with Item Response Theory

Relationship satisfaction is at the core of a robust social life and is essential to mental health. The positive and negative semantic dimensions of the relationship satisfaction (PN-SMD) scale is considered in the field of relationship studies to be a reliable tool for assessing the quality of a person's interpersonal relationships. This study evaluated the psychometric properties of the PN-SMD scale by conducting multidimensional item response theory (MIRT) and differential item functioning (DIF) analyses, both of which are emerging assessment methods that focus on individual items. We recruited 511 Chinese undergraduate students for this study. Construct validity, internal consistency, and concurrent validity were assessed, and MIRT and DIF analyses were conducted. Five of the 14 items were found to have gender-based DIF traits, affecting the scale's construct validity. A revised nine-item scale (DIF items excluded) had a significantly better model fit and demonstrated comparable concurrent validity to the original scale. The implications of our results and future research directions are discussed.

Machine learning item selection for short scale construction: A proof-of-concept using the SIMS

ObjectiveThis proof-of-concept paper provides evidence to support machine learning (ML) as a valid alternative to traditional psychometric techniques in the development of short forms of longer parent psychological tests. ML comprises a variety of feature selection techniques that can be efficiently applied to identify the set of items that best replicates the characteristics of the original test. MethodsIn the present study, we integrated a dataset of 329 participants from published and unpublished datasets used in previous research on the Structured Inventory of Malingered Symptomatology (SIMS) to develop a short version of the scale. The SIMS is a multi-axial self-report questionnaire and a highly efficient psychometric measure of symptom validity, which is frequently applied in forensic settings. Results State-of-the-art ML item selection techniques achieved a 72% reduction in length while capturing 92% of the variance of the original SIMS. The new SIMS short form now consists of 21 items. ConclusionsThe results suggest that the proposed ML-based item selection technique represents a promising alternative to standard psychometric correlation-based methods (i.e. item selection, item response theory), especially when selection techniques (e.g. wrapper) are employed that evaluate global, rather than local, item value.

Development of a Brief Version of the Dissociative Symptoms Scale and the Reliability and Validity of DSS-B Scores in Diverse Clinical and Community Samples

The Dissociative Symptoms Scale (DSS) was developed to assess moderately severe types of dissociation (depersonalization, derealization, gaps in awareness and memory, and dissociative reexperiencing) that would be relevant to a range of clinical populations, including those experiencing trauma-related dissociation. The current study used data from 10 ethnically and racially diverse clinical and community samples (N = 3,879) to develop a brief version of the DSS (DSS-B). Item information curves were examined to identify items with the most precision in measuring above average levels of the latent trait within each subscale. Analyses revealed that the DSS-B preserved the factor structure and content domains of the full scale, and its scores had strong reliability and validity that were comparable to those of scores on the full measure. DSS-B scores showed high levels of measurement invariance across ethnoracial groups. Results indicate that DSS-B scores are reliable and valid in the populations studied.

Attachment, Competitiveness, and Workplace Aggression: A Model of Aggressive Intent and Examination of the Competitive Orientation Scale

Workplace aggression consists of harmful actions between co-workers, supervisors, and subordinates. In this series of studies, we draw from attachment theory and competitive personality to develop and test a mediated model of workplace aggression that incorporates relational working models (i.e., attachment style) with competitive orientation to predict aggressive intentions. Our results find that an avoidant attachment style caused by dissociative relational models promotes a preference for aggression through hypercompetitiveness, while other relational models fail to predict aggressive intentions. In addition, we test and incorporate a shortened scale of competitive orientation for greater accessibility in competitiveness studies.

Tried and True? A Psychometric Evaluation of the Psychological Inventory of Criminal Thinking Styles-Short Form

The Psychological Inventory of Criminal Thinking Styles-Short Form (PICTS-SF) is an abbreviated 35-item version of the PICTS, a measure of cognitions that support a criminal lifestyle. Despite use in research and clinical work, the PICTS-SF's psychometric properties have not been tested. Using two archival datasets, we analyzed the PICTS-SF's reliability and structural validity in multiply imputed data from adult males and females on probation in a residential treatment facility (n = 514). We also tested the PICTS-SF's reliability and discriminant and postdictive validities among adult males in administrative segregation in prison (n = 95). We found evidence for the PICTS-SF's internal consistency (α and ω ≥ .89), structural validity (CFI = .90, RMSEA = .05), discriminant validity (.22 ≤ r ≤ .39), and postdictive validity for receiving disciplinary infractions (incident rate ratio = 1.04). These results support the PICTS-SF's use in research, and qualified use in clinical applications.

The Development of a Short Form of the Indonesian Version of the Wechsler Adult Intelligence Scale-Fourth Edition

(1) Background: The Wechsler intelligence scales are very popular in clinical practice and for research purposes. However, they are time consuming to administer. Therefore, researchers and psychologists have explored the possibility of shorter test battery compositions. (2) Methods: In this study, we investigated 13 potential short forms of the Indonesian version of the Wechsler Adult Intelligence Scale-Fourth Edition (WAIS-IV-ID). An existing standardization data set of 1745 Indonesian participants collected for the validation of the WAIS-IV-ID was used to examine the short forms' validity. These ranged from 2-subtest versions to 7-subtest versions. Regression analyses with goodness-of-fit measures were performed, and regression equations were determined for each short form to estimate the Full Scale IQ (FSIQ) score. Discrepancies between the FSIQ and the estimated FSIQ (FSIQEst) scores were examined and classification accuracies were calculated for each short form (% agreement of intelligence classification between the FSIQEst and FSIQ). (3) Results: None of the 13 short form FSIQEst values significantly differed from the FSIQ scores based on the full WAIS-IV-ID, and strong correlations were observed between each of these values. The classification accuracies of the short forms were between 56.8% and 81.0%. The 4-subtest short form of the WAIS-IV-ID consisting of the subtests Matrix Reasoning, Information, Arithmetic, and Coding had the optimal balance between best classification values and a short administration duration. The validity of this short form was demonstrated in a second study in an independent sample (N = 20). (4) Conclusions: Based on the results presented here, the WAIS-IV-ID short forms are able to reliably estimate the FSIQ, with a significant shorter administration duration. The WAIS-IV-ID short form consisting of four subtests, Matrix Reasoning, Information, Arithmetic, and Coding, was the best version according to our criteria.

Development and Psychometric Evaluation of the IPV Internalized Stigma Scale

Self-stigma is the internalization of widespread and negative attitudes around a devalued attribute. Being a victim of intimate partner violence (IPV) is a stigmatized identity, with IPV self-stigma is a potential barrier to help seeking. The lack of an IPV self-stigma scale limits current measurement of this latent trait; this study sought to fill this gap. We developed the IPV Internalized Self-stigma Scale (IPVIS) by revising existing self-stigma and devaluation/discrimination measures and adding new items to fill perceived gaps. Using an online survey, a diverse sample (N = 455, M = 39.51, SD = 12.03) with various relationship types (e.g., heterosexual, same-sex), IPV circumstances (e.g., male or female perpetrators/victims) and different gender and sexual identities was recruited. Participants first completed the item pool (44-items), followed by measures of IPV, anxiety, depression, social health, and self-efficacy with data analyzed using a multi-model approach (e.g., factor analysis, item response theory [IRT]). Factor analyses revealed one dominant factor; IRT analyses further refined the unidimensional item set. The final 11 items had high internal consistency, ω = .90, 95% CI [0.89, 0.91], and were highly informative with moderate to high discrimination levels. The IPVIS demonstrated measurement invariance by demographics, showing no differential item functioning by age groups, sex, residence (urban/suburban/rural), ethnicity (European/Caucasian vs. others), or relationship status (partnered/unpartnered). Initial validity examination revealed significant correlations between the IPVIS and related measures (e.g., depression, anxiety, social health). The IPVIS is suitable for research and has widespread clinical applicability. To the best of our knowledge, the IPVIS is the first scale developed that assesses IPV self-stigma inclusive of a diverse range of clients/participants, relationship types, and IPV circumstances.

The Ten-Item Personality Inventory (TIPI): a scoping review of versions, translations and psychometric properties

Background

The Ten-Item Personality Inventory (TIPI) is a brief instrument designed to assess the five-factor model (FFM) personality dimensions. It was specifically developed to provide a brief assessment option in situations where using more comprehensive FFM instruments would be unfeasible. The TIPI enjoys widespread use and has been translated into several different languages.

Objective

The aim of this scoping review was to generate an overview of different versions of the TIPI, and their psychometric properties in terms of two aspects of validity (convergent and structural) and two aspects of reliability (internal consistency and test-retest reliability).

Methods

Four databases (PsycINFO, PubPsych, Medline, and Web of Science) were searched for studies exploring psychometric properties of the TIPI (original and/or translated or revised versions), published in English as full-text original research articles. Additionally, manual searches were conducted on the official TIPI website and in reference lists. Studies who utilized the TIPI simply as a measure, without an aim of testing its psychometric properties, were excluded. A descriptive-analytical approach was utilized to generate overviews of available TIPI versions and their psychometric properties.

Results

In a total of 29 studies, 27 versions of the TIPI were identified, covering 18 different languages. Across versions, and evaluated against conventions of acceptable psychometric properties, the TIPI demonstrated acceptable test-retest reliability, somewhat mixed results for convergent and structural validity, and inappropriate internal consistency.

Conclusion

Being a brief instrument, the TIPI is unsurprisingly characterized by certain psychometric shortcomings. However, the TIPI may represent a feasible compromise in instances where it is necessary to strike a balance between maximizing psychometric properties and minimizing survey length.

Sexual Fantasies and Harmful Sexual Interests: Exploring Differences in Sexual Memory Intensity and Sexual Fantasy Characteristics

The perpetration of harmful sexual behavior is a global concern, with deviant sexual fantasies identified as a prominent etiological risk factor. However, the concepts of state sexual fantasy characteristics (e.g., vividness and emotionality) and associated trait sexual memory intensity have received minimal investigation concerning harmful sexual interests, formulating the impetus for this research. Two online surveys were conducted in community populations. Study 1 (N = 414) aimed to validate the psychometric properties of a trait sexual memory intensity scale (SMIS) through principal components analysis, confirmatory factor analysis, and evaluation of concurrent validity. Study 2 (N = 820) endeavored to explore associations between state sexual fantasy characteristics and cognitive-behavior variables (e.g., frequency of masturbation to a reported fantasy), and evaluate differences in fantasy characteristics and SMIS scores between participants with and without harmful sexual interests. Collectively, results supported the factor structure, concurrent validity, and internal consistency of the SMIS, while revealing significant associations between the SMIS, sexual fantasy characteristics, and several variables. Significant differences in sexual fantasy characteristics and SMIS scores were evident but variable among harmful sexual interests. Findings encourage the consideration and research of interventions focused on impairing mental imagery and memory in the management of harmful sexual interests.

The Sexual Orientation Microaggression Inventory Short Form (SOMI-SF): Validation in Three Samples of Racially/Ethnically Diverse Sexual Minority Youth

Introduction

The Sexual Orientation Microaggression Inventory (SOMI) has been used to measure sexual orientation-based microaggression experiences. However, at 19 items, the SOMI may be difficult to fit into survey batteries where microaggressions are not the primary predictor or the time researchers have with each participant is very limited.

Methods

We sought to identify an eight-item short form of the SOMI (SOMI-SF) in a sample of sexual minority (SM) youth (N = 879) and confirm the validity and reliability of the SOMI-SF by administering both versions to separate cohorts of male-assigned (N = 533) and female-assigned (N = 430) at birth SM youth. Data was collected from April 2018 to May 2020.

Results

We found high reliability (α > 0.80) and validity (significant association with SM victimization, depression symptoms, anxiety symptoms, and internalized stigma) in all three samples for the SOMI-SF.

Conclusions

For researchers looking to conserve time and limit burden, the SOMI-SF is a high quality option for measuring sexual orientation microaggressions.

Policy Implications

The greater ease of administering the SOMI-SF means that sexual orientation microaggressions can be measured in a greater number of contexts. With a growing literature linking these experiences to poorer health outcomes for SM populations, measuring these experiences quickly and accurately can improve our understanding of the mechanisms creating those links and impact policy necessary to alleviate them.

Reliability and validity of the brief version of the difficulties in emotion regulation scale in a sample of Turkish adolescents

BACKGROUND

Difficulty in regulating emotions increases during adolescence and can be associated with psychopathology. It is thus crucial to develop tools to identify adolescents at risk of having emotional difficulties. This study aimed to investigate the reliability and validity of a brief questionnaire in a sample of Turkish adolescents.

METHODS

A total of 256 participants (mean age = 15.51 ± 0.85) were recruited. They completed the original form of the Difficulties in Emotion Regulation Scale (DERS-36), a brief version of DERS (DERS-16), the Barrett Impulsivity Scale (BIS-11), and the Toronto Alexithymia Scale (TAS). Psychometric properties of DERS-16 were investigated by confirmatory factor analysis, Cronbach's alpha, and Pearson correlational analysis.

RESULTS

A five-factor model and second-order bifactor model of DERS-16 were confirmed. Cronbach's alpha values for the subscales varied between 0.69 and 0.88, while the reliability of the factors Difficulties in Emotional Processing and Difficulties in Emotion Regulation were 0.75 and 0.90, respectively. DERS-16 subscales were positively correlated with the BIS-11 and TAS. In addition, there were only minimal differences between the DERS-16 and DERS-36.

CONCLUSION

The DERS-16 is a valid and reliable scale for Turkish adolescents. The fact that it has fewer items than DERS-36, but has similar reliability and validity and can be used as two factors, provides significant advantages in terms of applicability.

Modeling urgency in the lab: Exploring the associations between self-reported urgency and behavioral responses to negative outcomes in laboratory gambling

Impulsivity is a multifaceted construct that relates to different behaviors in everyday life and has been associated with many psychopathological disorders and behavioral problems, such as problematic gambling behavior. One questionnaire to measure these several facets on a trait level is the UPPS-P Impulsive Behavior Scale. Specifically, the UPPS-P investigates five distinct facets: (a) negative urgency, (b) lack of premeditation, (c) lack of perseverance, (d) sensation seeking, and (e) positive urgency. Negative urgency at a trait level in particular seems to be associated with the development of psychopathological disorders. To date, there are no established state measures of negative urgency. However, it was recently proposed that speeding after losses might be a suitable measure. Thus, in this study, we explored the possible relationship between a state measure of negative urgency modeled through a behavioral gambling task and a trait measure of negative urgency through the UPPS-P questionnaire. We used correlational and network analyses in an aggregated database of eight samples (total N = 1216) to explore the potential relationships between post-loss speeding on the behavioral gambling task and UPPS-P scores (by combining trait vs. item-based analyses). We found that the degree of speeding after losses (post-loss speeding) did not correlate with the trait measure of impulsivity in general and negative urgency specifically, either at the latent trait level or on an item-based level. This null finding indicates that our state measure of post-loss speeding and negative urgency on a trait level does not seem to capture the same underlying constructs. Implications for personality research are discussed.

An Optimized Version of the Positive and Negative Symptoms Scale (PANSS) for Pediatric Trials

OBJECTIVE

The accepted primary outcome measure for evaluating psychotic symptoms is decades old, long, and initially designed for adults. Surprisingly, the psychometric properties of primary outcome measures have never been reported for a pediatric sample using modern methods. The present study's aim is to use a pediatric sample to evaluate the psychometrics of the most used primary outcome measure in pediatric schizophrenia trials, the Positive and Negative Syndrome Scale (PANSS).

METHOD

To evaluate the factor structure, item characteristics, and treatment sensitivity of the PANSS in a pediatric sample, secondary analyses of PANSS data at baseline and weekly throughout an 8-week randomized double-blind study of 3 antipsychotic agents (registered and previously published) were conducted. Subjects were 118 youths receiving outpatient psychiatric treatment for schizophrenia spectrum disorders (mean age = 14.26 years, SD = 2.41 years).

RESULTS

A 10-item short form, keeping 2 strongest items for each factor, had r = 0.89 with the full-length scale. Each of the five 2-item subscales has alphas ranging from 0.66 to 0.84. Item Response Theory (IRT) found that the 10-item scale and 2-item subscores had high reliability across the severity range typical of those for clinical trials. Criterion validity was high, with equal sensitivity to clinical changes over time.

CONCLUSION

A 10-item PANSS version eliminates weaker items in the pediatric population while preserving coverage of 5 factors and similar sensitivity to clinical changes over time. It thus may be more appropriate for subsequent pediatric trials, and for clinical use when time and efficiency are paramount.

Dark Triad and COVID-19 vaccine hesitancy: the role of conspiracy beliefs and risk perception

With the spread of the Coronavirus Disease-2019 (COVID-19) pandemic, the mass vaccination plan represents the primary weapon to control the infection curve. Unfortunately, vaccine hesitancy also spread out worldwide. This led to exploring the critical factors that prevent vaccination from improving the efficacy of vaccine campaigns. In the present study, the role of the Dark Triad (psychopathy, Machiavellianism, and narcissism) in vaccine hesitancy was investigated, considering the sequential mediating effects of conspiracy beliefs and risk perception. Via a cross-sectional design, the study was conducted with 210 participants surveyed using an online questionnaire to assess the Dark Triad, vaccine hesitancy, conspiracy beliefs, risk perception, and a set of demographic and socio-cultural control variables. Results showed that conspiracy beliefs and risk perception fully mediated the association between the Dark Triad and vaccine hesitancy. This finding suggested that albeit personality accounts for individual differences in human behaviour, vaccine hesitancy is also affected by irrational and false beliefs that, in turn, weaken the risk perception associated with COVID-19. Implications and future research directions were discussed.

The Perth Alexithymia Questionnaire-Short Form (PAQ-S): A 6-item measure of alexithymia

BACKGROUND

Alexithymia is a trait characterized by difficulties identifying feelings, difficulties describing feelings, and externally orientated thinking. It is widely regarded as an important transdiagnostic risk factor for a range of psychopathologies, including depressive and anxiety disorders. Whilst several well-validated psychometric measures of alexithymia exist, these are relatively lengthy, thus limiting their utility in time-pressured settings. In this paper, we address this gap by introducing and validating a brief 6-item version of the Perth Alexithymia Questionnaire, called the Perth Alexithymia Questionnaire-Short Form (PAQ-S).

METHOD

Across two studies with adult samples (Study 1 N = 508 United States community; Study 2 = 378 Australian college students), we examined the psychometric properties of the PAQ-S in terms of its factor structure, reliability, and concurrent/criterion validity.

RESULTS

In exploratory and confirmatory factor analyses, all PAQ-S items loaded well on a single general alexithymia factor. The PAQ-S total score had high reliability, and correlated as expected with the long-form of the PAQ, as well as other established markers of alexithymia, emotion regulation, and affective disorder symptoms.

LIMITATIONS

Our samples were general community or college student samples from two Western countries; future validation work in clinical samples and more diverse cultural groups is thus needed.

CONCLUSIONS

The PAQ-S retains the psychometric strengths of the PAQ. As such, the PAQ-S can be used as a quick, robust measure of overall alexithymia levels. The introduction of the PAQ-S hence enables valid assessments of alexithymia in a more diverse range of settings and research designs.

Spirituality in the Context of Well-being. Evaluation of the Psychometric Properties and Added Value of the Spiritual Attitude and Involvement List Short Form (SAIL-SF)

There is growing evidence that spiritual well-being is positively associated with adaptive coping and health. The Spiritual Attitude and Involvement List (SAIL) was developed to measure a sense of connectedness to oneself, the environment and the transcendent as a universal experience. The aim of the current study was to develop a short form of the SAIL (SAIL-SF). A factor analytic approach was adopted to select the items for the SAIL-SF based on earlier studies among nurses (n = 458) and cancer patients (n = 445). The dimensionality, factor-loadings, internal consistency, construct validity and incremental validity of the final SAIL-SF were then evaluated in a new sample of adults (n = 225) participating in a trial assessing a positive psychology intervention. The first study yielded seven items, each representing one of the dimensions of the original SAIL: meaningfulness, trust, acceptance, caring for others, connectedness with nature, transcendent experiences, and spiritual activities. The seven items represented a single meaningful factor in both samples and the factor loadings of the items were adequately high. In the second study, a good fit across the various model indices was found and all items had adequately high factor loadings in a strict unidimensional confirmatory factor model and demonstrated good internal consistency. The SAIL-SF explained 7% of variance in ability to adapt above and beyond emotional, psychological, and social well-being. The current study shows that the SAIL-SF has good psychometric properties, and that spiritual well-being has a unique contribution to the ability to adapt in comparison with other types of well-being.

Construction of a computerized adaptive test (CAT-CCNB) for efficient neurocognitive and clinical psychopathology assessment

BACKGROUND

Traditional paper-and-pencil neurocognitive evaluations and semi-structured mental health interviews can take hours to administer and score. Computerized assessment has decreased that burden substantially, and contemporary psychometric tools such as item response theory and computerized adaptive testing (CAT) allow even further abbreviation.

NEW METHOD

The goal of this paper was to describe the application of CAT and related methods to the Penn Computerized Neurocognitive Battery (CNB) and a well-validated clinical assessment in order to increase efficiency in assessment and relevant domain coverage. To calibrate item banks for CAT, N = 5053 participants (63% female; mean age 45 years, range 18-80) were collected from across the United States via crowdsourcing, providing item parameters that were then linked to larger item banks and used in individual test construction. Tests not amenable to CAT were abbreviated using complementary short-form methods.

RESULTS

The final "CAT-CCNB" battery comprised 21 cognitive tests (compared to 14 in the original) and five adaptive clinical scales (compared to 16 in the original).

COMPARISON WITH EXISTING METHODS

This new battery, derived with contemporary psychometric approaches, provides further improvements over existing assessments that use collections of fixed-length tests developed for stand-alone administration. The CAT-CCNB provides an improved version of the CNB that shows promise as a maximally efficient tool for neuropsychiatric assessment.

CONCLUSIONS

We anticipate CAT-CCNB will help satisfy the clear need for broad yet efficient measurement of cognitive and clinical domains, facilitating implementation of large-scale, "big science" approaches to data collection, and potential widespread clinical implementation.

A new tool for the assessment of speech understanding and spatial hearing difficulties in children: the Kid-SSQ questionnaire

PURPOSE

To develop and validate a new questionnaire, the Kid-SSQ, for the rapid screening of hearing abilities in children with hearing impairment, aged 7-17 years.

METHODS

The questionnaire was constructed from two existing, validated versions of the 'Speech, Spatial and Qualities of Hearing' - (SSQ) questionnaire (pediatric form and adult short-form). The 12 selected items included auditory aspects from three subscales: speech perception, spatial hearing, and qualities of hearing. This new short form was then validated in 154 children with cochlear implants (100 bilaterally, and 54 unilaterally implanted children). Construct validity was assessed by testing relationships between Kid-SSQ scores and objective clinical parameters (e.g., age at test, pure-tone audiometry-PTA threshold, speech reception threshold-SRT, duration of binaural experience).

RESULTS

Completion time was acceptable for use with children (less than 10 min) and the non-response rate was less than 1%. Good internal consistency was obtained (Cronbach's α = 0.78), with a stable internal structure corresponding to the 3 intended subscales. External validity showed the specificity of each subscale: speech subscale scores were significantly predicted (r = 0.32, p < 0.001) by both 2 kHz PTA threshold (β = 0.33, p < 0.001) and SRT (β = - 0.23, p < 0.001). Children with more binaural experience showed significantly higher scores on the spatial subscale than children with less binaural experience (F(1,98) = 5.1, p < 0.03) and the qualities of hearing subscale scores significantly depended on both age and SRT (r = 0.32, p < 0.001).

CONCLUSIONS

The Kid-SSQ questionnaire is a robust and clinically useful questionnaire for self-assessment of difficulties in various auditory domains.

Validation of the Arabic version of the 35-item TEMPS-M in a community sample of adults

BACKGROUND

To our knowledge, no brief version of the Temperament Evaluation in Memphis Pisa and San Diego (TEMPS-M) is available so far in the Arabic language, which might have resulted in limited research in this field from Arab countries. We aimed through this study to validate the 35-item TEMPS-M into the Arabic language in a sample of non-clinical Lebanese adults.

METHODS

We used an online cross-sectional survey targeting non-clinical Lebanese adults from the general population. A confirmatory factor analysis was conducted to test the factorial structure of the TEMPS-M.

RESULTS

All five temperament subscales achieved good/very good internal consistencies in the present study (depressive: α = 0.78, cyclothymic: α = 0.86, hyperthymic: α = 0.83, irritable: α = 0.87, and anxious: α = 0.87). The five-factor solution of the TEMPS-M displayed a good CFI of 0.94, TLI of .94 and a GFI of .95, but a poor RMSEA of .10 [90% CI .10, .11]. The five affective temperaments showed positive correlations with personality dysfunction domains, thus attesting for convergent validity. In addition, positive correlations between all affective temperament dimensions and anxiety/depression scores were found. We also tested for gender invariance, and found that configural, metric, and scalar invariance were supported across gender.

CONCLUSION

Our data suggest that the psychometric properties of the Arabic TEMPS-M are good. Making this scale available in Arabic will hopefully encourage Arab researchers to investigate this under-explored topic in their countries, and advance knowledge on how culture impacts the prevalence, development and course of temperament.

Development of empirically derived brief program evaluation measures in Pennsylvania first-episode psychosis coordinated specialty care programs

AIM

The Pennsylvania first episode psychosis program evaluation (PA-FEP-PE) core assessment battery was developed as a standard and comprehensive clinical assessment and data collection tool in Pennsylvania coordinated specialty care programs (CSC). To reduce administrative time and maximize clinical utility by maintaining acceptable levels of precision, we aimed to generate a short form using item response theory (IRT)-based computer-adaptive test (CAT) simulation and analyse the implementation and acceptability of the short form among providers from PA-CSC.

METHODS

FEP participants (n = 759; age 14-36) from nine coordinated specialty care programs completed 156 items drawn from the PA-FEP-PE battery. Multidimensional IRT-based CAT simulations were used to select the best PA-FEP-PE items for abbreviated forms.

RESULTS

A 67-item PA-FEP-PE short form was developed to capture six factors: (1) positive affect and surgency (with negative loadings on Anxious-Misery items); (2) psychiatric services satisfaction; (3) antipsychotic side effect severity; (4) family turmoil and associated traumas; (5) trauma load; and (6) psychosis. The total number of items was reduced more than 50% in the PA-FEP-PE shortened forms. The short form demonstrated good psychometric properties, and it was well accepted by our providers in the implementation.

CONCLUSIONS

The empirical derivation and implementation of abbreviated measures of key domains and constructs in FEP care have streamlined and facilitated PA-FEP program evaluation. Our work supports potential application of IRT based methods to empirically reduce core assessment battery measures in large-scale data collection efforts such as in the Early Psychosis Intervention Network.

Validity and reliability of Spanish version of the EQ-i: YV[S] in Colombian children and youth

Introduction

Validity and reliability evaluations of the Emotional Quotient Inventory: Youth Version (EQ-i: YV[S]) with children and adolescents from different countries have shown variations in the structural model proposed by Bar-On.

Objective

To examine the psychometric properties of EQ-i: YV[S] with a Colombian' sample.

Method

We randomly selected a sample of 1355 children and adolescents between 8 and 14 years old (Mage = 10.80; SD = 1.41). We conducted exploratory (n1 = 416) and confirmatory (n2 = 939) factor analyses (EFA, CFA), reliability, internal consistency, and predictive validity.

Results

The EFA explained 27.6% of the variance. The AFC indicated a multidimensional structure with four factors and 21 items obtained the best fit (χ2 = 334.358; df = 183; RMSEA=0.030; CFI=.951; TLI=944; NFI=.899) with acceptable internal consistency (ω = .57,.75). EQ-i: YV[S] factors explain 18.5% of the observed variance in problem-centered coping scores.

Conclusions

The psychometric fit of the inventory supports evidence of its usefulness for screening processes in clinical or educational assessment.

Employee human resource management values: validation of a new concept and scale

Purpose

Although human resource management (HRM) practices all seek to support and improve organizational functioning, the value ascribed to various HRM practices differs greatly among employees. Drawing on an exhaustive measure of HRM practices, this study proposed a new conceptualization and measure of HRM values, the HRM Values Scale (HRM-VS).

Design/methodology/approach

To examine the psychometric properties of scores obtained on this new measure, we rely on a sample of 979 employees occupying a variety of jobs within various private and public organizations.

Findings

Through the comparison of confirmatory factor analysis (CFA) and exploratory structural equation modeling (ESEM) solutions, our results supported a nine-factor structure of participants' responses to the HRM-VS and the measurement invariance of this solution across male and female employees. Specifically, they support that the HRM-VS items adequately capture core HRM values underlying independent HRM practices. Criterion-related validity was evidenced with respect to employees' ratings of intrinsic and extrinsic job satisfaction.

Research implications

The HRM-VS appears to represent a promising tool for research and intervention seeking to account for individual differences in the relative importance of various HRM practices, in order to devise more effective HRM systems.

Practical implications

This new concise but complete measure could help better guide organizations in tailoring their strategic HRM.

Originality/value

This study introduces HRM values as a valid concept that characterizes what employees desire or consider to be important in relation to HRM practices.

Development and Validation of Two Abbreviated Intraminority Gay Community Stress Scales

Social stressors stemming from within the gay community might render gay and bisexual men vulnerable to mental health problems. The 20-item intraminority Gay Community Stress Scale (GCSS) is a reliable measure of gay community stress, but the scale's length limits its widespread use in sexual minority mental health research. Using three independent samples of gay and bisexual men, the present research developed two abbreviated versions of the GCSS using nonparametric item response modeling and validated them. Results indicated that eight items provided maximal information about the gay community stress construct; these items were selected to form the eight-item GCSS. The eight-item GCSS reproduced the factor structure of the parent scale, and gay community stress scores obtained from it correlated with other identity-specific social stress constructs and mental health symptoms. Associations between gay community stress and mental health symptoms remained significant even after controlling for related identity-specific stressors, general life stress, and relevant demographics. A four-item version was also developed and assessed, showing good structural, convergent, criterion, and incremental validity and adequate reliability. The eight- and four-item versions of the GCSS offer efficient measures of gay community stress, an increasingly recognized source of stress for gay and bisexual men.

A 2-item version of the Japanese Consultation and Relational Empathy measure: a pilot study using secondary analysis of a cross-sectional survey in primary care

BACKGROUND

The Consultation and Relational Empathy (CARE) measure is a patient-reported measure of physician empathy which is widely used internationally. The Japanese version of the CARE measure has very high internal reliability, suggesting that a shorter version may have adequate validity and reliability.

OBJECTIVE

To investigate a valid shorter version of the Japanese CARE measure.

METHODS

We conducted a pilot study using secondary analysis of previous data obtained from 9 general practitioners and 252 patients and used to develop the Japanese CARE measure. All 1,023 possible combinations of the Japanese CARE items (n = 1-10) were candidates for the short measure. The internal consistency (Cronbach's alpha) and the correlations between candidate short questionnaires and the original questionnaire were calculated. After selecting the most valid short questionnaire, inter-rater reliability was determined using generalizability theory, and construct validity (Spearman's rho) was determined using patient satisfaction.

RESULTS

Two items were selected for a pilot shorter version: item 6 "Showing care and compassion" and item 9 "Helping you to take control." These showed high internal consistency and correlations with the 10-item measure (Cronbach's alpha = 0.920, correlation = 0.979). Forty-five questionnaires per doctor allowed us to reliably differentiate between practitioners. The construct validity for the pilot short measure was high (Spearman's rho 0.706, P < 0.001).

CONCLUSION

We generated a pilot 2-item version of the Japanese CARE measure. This pilot 2-item version provides a basis for future validation studies of short CARE measures in other languages.

Development of a brief therapist presence inventory in China using multilevel factor analysis and item response theory

Objectives The aims of this study were to investigate the multilevel factor structure of the Therapist Presence Inventory-Therapist version (TPI-T) in a sample of Chinese beginning trainees, and to develop a 6-item brief version (TPI-T-Brief) using multilevel item response theory (M-IRT). Methods: Participants included 131 therapists from a master's level counseling training program in China. After every session, therapists were sent the TPI-T and measures assessing their ratings of working alliance and session quality. Results: Multilevel factor analysis indicated that though conceptually TPI-T was hypothesized as having a unidimensional structure, the positively and negative worded items emerged as two statistical artifact factors. Using M-IRT, we shortened the 21-item TPI-T into the 6-item TPI-T-Brief, with three positive and three negative items. Conclusions: Evidence was found for the multilevel reliability, convergent validity, and concurrent validity of TPI-T-Brief given its significant associations with therapist- and client-rated working alliance and session quality. Further, TPI-T-Brief had significant predictive effect of session quality above and beyond working alliance at the session level. We discussed limitations (including using only one dataset) and recommended that the TPI-T-Brief be used in routine clinical practice to track therapy process.

An Investigation of the Relationship between Personality, Cognitive Ability, and Work Engagement in Intellectually Gifted Individuals

Do personality traits in highly intelligent individuals relate to their work engagement? Seemingly little is known about the relationship between personality and work engagement for gifted individuals. In what may be the first study to do so, a Swedish Mensa sample (n = 353) was explored with a two-part aim: to assess psychometric personality properties and to investigate the relationship between personality traits (Mini-IPIP6) and work engagement (UWES-9). The results of the Mensa members and the Mturk sample (1.4 SD lower in cognitive ability based on ICAR-16) were compared using a confirmatory factor analysis (CFA) and a regression. The findings indicated that the Mensa sample had higher openness (d = .50) and honesty-humility (d = .65) and that personality traits were similarly related to work engagement in both groups, with the exception that neither openness nor honesty-humility were related to work engagement in the Mensa sample. The characteristics of intellectually gifted individuals are further discussed.