Reversed item bias: an integrative model

Change Score and Subscore Precision and Reliability of the Children's Depression Inventory

The Child Depression Inventory (CDI) is often used to assess change in depression over time, but no studies estimate the reliability of CDI change scores nor its five subscores. Our study investigated the reliability of change scores for both the total score on the CDI as well as its five subscores. We examined CDI responses from 186 maltreated children and estimated change score reliability for relative (e.g., comparison) and absolute (e.g., diagnosis) purposes. We also conducted subscore utility analysis, which determines if subscores have adequate reliability and provide information beyond the total score. We found that the total change score had acceptable reliability of .70 for our sample for both relative and absolute interpretations. In addition, the total score was a better predictor of true subscore values than the observed subscores-suggesting subscores did not add value over the total score, and that the reliability of changes in subscores was too low to be useful for any purpose. In summary, we found that the total CDI change scores were useful for assessing change in studies that examine relative or absolute change, and we advise caution when interpreting CDI subscores based on our analysis.

Detecting non-content-based response styles in survey data: An application of mixture factor analysis

It is common for some participants in self-report surveys to be careless, inattentive, or lacking in effort. Data quality can be severely compromised by responses that are not based on item content (non-content-based [nCB] responses), leading to strong biases in the results of data analysis and misinterpretation of individual scores. In this study, we propose a specification of factor mixture analysis (FMA) to detect nCB responses. We investigated the usefulness and effectiveness of the FMA model in detecting nCB responses using both simulated data (Study 1) and real data (Study 2). In the first study, FMA showed reasonably robust sensitivity (.60 to .86) and excellent specificity (.96 to .99) on mixed-worded scales, suggesting that FMA had superior properties as a screening tool under different sample conditions. However, FMA performance was poor on scales composed of only positive items because of the difficulty in distinguishing acquiescent patterns from valid responses representing high levels of the trait. In Study 2 (real data), FMA detected a minority of cases (6.5%) with highly anomalous response patterns. Removing these cases resulted in a large increase in the fit of the unidimensional model and a substantial reduction in spurious multidimensionality.

Dimensionality assessment in the presence of wording effects: A network psychometric and factorial approach

This study proposes a procedure for substantive dimensionality estimation in the presence of wording effects, the inconsistent response to regular and reversed self-report items. The procedure developed consists of subtracting an approximate estimate of the wording effects variance from the sample correlation matrix and then estimating the substantive dimensionality on the residual correlation matrix. This is achieved by estimating a random intercept factor with unit loadings for all the regular and unrecoded reversed items. The accuracy of the procedure was evaluated through an extensive simulation study that manipulated nine relevant variables and employed the exploratory graph analysis (EGA) and parallel analysis (PA) retention methods. The results indicated that combining the proposed procedure with EGA or PA achieved high accuracy in estimating the substantive latent dimensionality, but that EGA was superior. Additionally, the present findings shed light on the complex ways that wording effects impact the dimensionality estimates when the response bias in the data is ignored. A tutorial on substantive dimensionality estimation with the R package EGAnet is offered, as well as practical guidelines for applied researchers.

The visual analogue scale as a child-friendly measure of the unhealthy = tasty intuition

Worldwide, obesity is a growing concern. The implicit belief that healthiness and tastiness in food are inversely related (the Unhealthy = Tasty Intuition or UTI) decreases healthy food consumption and increases the risk of obesity. Since also childhood obesity has increased at an alarming rate and a large component of adult obesity is established during childhood, questions about children's own food beliefs and preferences are important. However, methods currently used to assess the UTI are either unvalidated Likert scales or implicit measures that are time intensive and too complex to be used for children. Two studies presented here offer an alternative measurement - the simple visual analogue scale. The findings show that this measure is more effective in predicting dietary quality in adults and the frequency of healthy food consumption in children compared to more traditional measures. This simple and effective tool could be used by academics and health practitioners alike to better understand children's food beliefs at an early age, which is a critical step when addressing the increasing obesity problem.

The Development and Validation of a Measure of Mental Health, Help-Seeking Beliefs in Arabic-Speaking Refugees

Despite reporting elevated rates of posttraumatic stress disorder (PTSD), refugees are less likely than other groups to seek psychological treatment. Relatively little attention has been paid to the role of negative help-seeking beliefs in influencing treatment uptake. The current study sought to develop and psychometrically validate a novel measure indexing negative help-seeking beliefs for refugees (Help-Seeking Beliefs Scale [HSBS]). In this study, 262 Arabic-speaking refugee participants completed an online survey consisting of the HSBS along with measures indexing similar constructs (self-stigma of PTSD and help-seeking, perceived stigma, negative help-seeking attitudes, and help-seeking intentions). Factor analysis revealed a three-factor structure aligning with key themes identified in the literature: (a) Fear of Negative Consequences, (b) Inappropriateness, and (c) Perceived Necessity. The scale demonstrated excellent internal consistency, convergent validity, and predicted reduced help-seeking intentions. Results support the utility of a novel measure capturing a prominent help-seeking barrier in a population with high psychopathology and low treatment uptake.

Intuitive Eating Scale-2-EA: Psychometric properties and factor structure of the adapted IES-2 for early adolescents

PURPOSE

Intuitive Eating (IE) is an approach to eating characterised by attunement to intrinsic cues, and using those cues to guide behaviours related to food and eating. Tylka and Kroon Van Diest's (2008) Intuitive Eating Scale (IES-2) is well-validated in adults, but not yet among early adolescents. The current study was designed to adapt and validate a version suited for use in early adolescence (IES-2-EA).

METHODS

Data collected from two independent samples of adolescents aged 11 to 13 (N = 471) were structurally examined using exploratory factor analysis (EFA), with a subsequent confirmatory factor analysis (CFA) to confirm hypothesised model fit. Relationships between scores on the IES-2-EA and validated measures of actual-ideal body size discrepancy, body appreciation, interoceptive awareness, and psychological distress were also examined.

RESULTS

The adapted 17-item IES-2-EA had a three-factor structure with several key differences from the original version developed for adults. Moderate-to-strong correlations were found between scores on the IES-2-EA, body appreciation, interoceptive awareness, actual-ideal body size discrepancy, and psychological distress in the first sample of adolescents (n = 245). Secondary CFA showed good model fit in the second sample of adolescents (n = 226).

CONCLUSION

The IES-2-EA is well-suited to measure intuitive eating behaviour among early adolescents. The 17 items reflect a three-component structure similar to that seen in adults completing the IES-2. These early data suggest the adapted IES-2-EA has evidence of reliability and validity; it may be an effective measure for research and clinical use.

Why Do Regular and Reversed Items Load on Separate Factors? Response Difficulty vs. Item Extremity

When constructing measurement scales, regular and reversed items are often used (e.g., "I am satisfied with my job"/"I am not satisfied with my job"). Some methodologists recommend excluding reversed items because they are more difficult to understand and therefore engender a second, artificial factor distinct from the regular-item factor. The current study compares two explanations for why a construct's dimensionality may become distorted: response difficulty and item extremity. Two types of reversed items were created: negation items ("The conditions of my life are not good") and polar opposites ("The conditions of my life are bad"), with the former type having higher response difficulty. When extreme wording was used (e.g., "excellent/terrible" instead of "good/bad"), negation items did not load on a factor distinct from regular items, but polar opposites did. Results thus support item extremity over response difficulty as an explanation for dimensionality distortion. Given that scale developers seldom check for extremity, it is unsurprising that regular and polar opposite items often load on distinct factors.

An English-Language adaptation and validation of the Justice Sensitivity Short Scales-8 (JSS-8)

The construct of justice sensitivity has four perspectives that capture individual differences in the strength of reactions to injustice when becoming a victim of injustice (victim sensitivity), when witnessing injustice as an outsider (observer sensitivity), when passively benefitting from an injustice done to others (beneficiary sensitivity), or when committing an injustice (perpetrator sensitivity). Individual differences in these four justice sensitivity perspectives are highly relevant in moral research. With just eight items in total, the Justice Sensitivity Short Scales-8 (JSS-8) are a very efficient way to measure the four perspectives. JSS-8 was initially constructed in German (Ungerechtigkeitssensibilität-Skalen-8, USS-8) and later translated into English. In the present study, we empirically validated this English-language adaptation in a heterogeneous quota sample from the UK. The results show that the psychometric properties (i.e., reliability, validity, standardization) of JSS-8 are good, and that they are comparable with those of the German-language source version. Because of the invariance of loadings, intercepts, and residual variances, researchers can compare manifest scale statistics (i.e., means, variances) of JSS-8 across the UK and Germany. JSS-8 is thus particularly suitable for measuring justice sensitivity in various research areas with constraints on assessment time and questionnaire space.

Development and Psychometric Evaluation of a Food Resource Acceptability Questionnaire

The stigma associated with food assistance is a significant barrier to resolution of food insecurity. Interventions and policies aimed at reducing food insecurity would benefit from the inclusion of strategies aimed at minimizing food assistance stigma. We developed the Food Resource Acceptability Questionnaire (FRAQ), a scale that measures the perceptions of stigma associated with food assistance. Qualitative interviews, modified Delphi technique, and exploratory factor analysis were used to develop and evaluate the 17-item scale. The FRAQ consists of two subscales (stigma and the belief that food is a basic right) to measure the likelihood of individuals perceiving food assistance as socially and culturally acceptable. Cronbach's alphas were 0.85, 0.80, and 0.89 for the Stigma subscale, Food as a Basic Right subscale, and the overall FRAQ, respectively. Additional research is needed to determine the applicability of the FRAQ in diverse populations.

Development and validation of the adaptive leadership behavior scale (ALBS)

Due to the rapid changes in today's business world, leaders need to, more than ever, adequately and flexibly react to new and changing demands in the workplace. An instrument that captures adaptive leadership behavior is still missing, however. This study describes the development and validation of a concise and timely new leadership instrument, the Adaptive Leadership Behavior Scale (ALBS). Based on a thorough literature review, we developed 27 items as an initial item pool. We tested this set of items with leaders and followers in a pilot study to assess its relevancy and comprehensibility. In Study 1, a field study with 201 employees, we explored the internal structure of the initial item pool with a Principal Component Analysis (PCA). Based on the factor loadings resulting from a second PCA, we reduced the item pool, resulting in a 15-item scale for which we then assessed convergent and divergent validity. In Study 2, a field study with 311 employees, we replicated the findings of Study 1 and assessed additional convergent and divergent validity as well as the model fit with a Confirmatory Factor Analysis (CFA). In Study 3, a multi-source field study with 155 leader-follower dyads we replicated the CFA and additionally assessed criterion-related validity. Results show that the ALBS is a concise and valid instrument for assessing adaptive leadership behavior, thereby building the grounds to extend our understanding of antecedents, mechanisms and consequences of leadership in dynamic environments.

Creation of a Short-Form and Brief Short-Form Version of the Coping With Children's Negative Emotions Scale

The Coping with Children's Negative Emotions Scale (CCNES) is a widely used measure of parent emotion socialization; however, it is a lengthy measure and it is unclear whether all items are appropriately aligned with, and fully capture, the underlying constructs. We aimed to examine content validity of the CCNES, evaluate the theoretical alignment between the CCNES and Gottman, Katz and Hooven's meta-emotion theory, and develop two short-forms. Participants were parents of children aged 4 to 10 years (N = 937) from the longitudinal study the Child and Parent Emotion Study (https://bmjopen.bmj.com/content/10/10/e038124). Content experts qualitatively evaluated parent-report items of the CCNES and additional items that measured empathy. Nineteen of the 84 items were found to not align with the meta-emotion theory. The latent structures of the CCNES and empathy subscales were quantitatively evaluated via confirmatory factor analysis. Items with poor psychometric properties were subsequently removed. An 18-item short-form (three emotion coaching subscales, three emotion dismissing subscales) and 6-item brief short-form (one emotion coaching subscale, one emotion dismissing subscale) with strong psychometric properties were created using a calibration sample (n = 468, that is, 50% of N = 937) and cross-validated with a validation sample. The short-form CCNES measures provide viable, theoretically consistent alternatives to the original CCNES measure.

Workers' Sensation Seeking Matters: Development and Validation of the Need for Sensations at Work Scale (NSWS)

Although sensation seeking (SS) may be a highly relevant trait in the occupational context, it is still understudied in the field of work and organizational psychology. Probably, one reason is the lack of an appropriate SS instrument for the work context. We therefore developed a scale that measures work-related SS. Results based on a sample of 304 workers provided evidence for the convergent and discriminant validity of the instrument. In an independent sample of 271 workers, confirmatory factor analyses supported a bifactor structure with a global SS factor and three specific domain factors (tension seeking, adrenaline seeking, and heartbeat increase seeking). Based on bifactor indices, essential unidimensionality of the instrument could be assumed. Work-related SS was positively associated with increasing challenging job demands, and a moderating effect of task variety on the relationship between work-related SS and job satisfaction was found. SS was not associated with the number of past job terminations. Overall, the findings indicate that SS may be relevant with regard to workers' proactive work behaviors and job attitudes. The Need for Sensations at Work Scale (NSWS) now provides a promising measurement instrument to further investigate SS in the work context.

Introduction and behavioral validation of the climate change distress and impairment scale

Governmental agencies and the medical and psychological professions are calling for a greater focus on the negative mental health effects of climate change (CC). As a first step, the field needs measures to distinguish affective/emotional distress due to CC from impairment that requires further scientific and diagnostic attention and that may require treatment in the future. To this end, we constructed the climate change distress and impairment scale, which distinguishes CC distress (spanning anger, anxiety, and sadness) from impairment. In four studies (N = 1699), we developed and validated English and German versions of the scale. Across samples, spanning 2021-2022, CC distress was at least moderate, while we observed general moderate to high levels of distress and low to moderate levels of impairment. In three English-speaking samples, younger individuals and women were most affected by CC distress, whereas this was not the case in a German-speaking sample, suggesting sociopolitical influencing factors. We demonstrate convergent validity with previous measures and discriminant validity for general negative affectivity and depressive and generalized anxiety disorder symptoms, which underlines that CC distress is not in itself pathological. Employing a fully incentivized social dilemma paradigm, we demonstrate that CC distress and (to a lesser degree) CC impairment predict pro-environmental behavior, underscoring them as possible drivers, and targets, of climate-change mitigation efforts.

Big five model personality traits and job burnout: a systematic literature review

BACKGROUND

Job burnout negatively contributes to individual well-being, enhancing public health costs due to turnover, absenteeism, and reduced job performance. Personality traits mainly explain why workers differ in experiencing burnout under the same stressful work conditions. The current systematic review was conducted with the PRISMA method and focused on the five-factor model to explain workers' burnout risk.

METHODS

The databases used were Scopus, PubMed, ScienceDirect, and PsycINFO. Keywords used were: "Burnout," "Job burnout," "Work burnout," "Personality," and "Personality traits".

RESULTS

The initial search identified 3320 papers, from which double and non-focused studies were excluded. From the 207 full texts reviewed, the studies included in this review were 83 papers. The findings show that higher levels of neuroticism (r from 0.10** to 0.642***; β from 0.16** to 0.587***) and lower agreeableness (r from - 0.12* to - 0.353***; β from - 0.08*** to - 0.523*), conscientiousness (r from -0.12* to -0.355***; β from - 0.09*** to - 0.300*), extraversion (r from - 0.034** to - 0.33***; β from - 0.06*** to - 0.31***), and openness (r from - 0.18*** to - 0.237**; β from - 0.092* to - 0.45*) are associated with higher levels of burnout.

CONCLUSIONS

The present review highlighted the relationship between personality traits and job burnout. Results showed that personality traits were closely related to workers' burnout risk. There is still much to explore and how future research on job burnout should account for the personality factors.

Psychometric properties of the Slovenian version of Internet Disorder Scale-IDS-15

BACKGROUND

Conceptualising internet addiction and assessing its symptoms has presented a significant challenge for researchers over the past 25 years. Recently, the Internet Disorder Scale (IDS-15), which is based on the criteria for Internet Gaming Disorder (IGD) from DSM-5, has emerged as a promising instrument to assess internet addiction. The main objective of the present study was to evaluate the psychometric properties of the Slovenian IDS-15.

METHODS

The sample was recruited from the National Survey on the Use of Tobacco, Alcohol and Other Drugs that was conducted in 2018 on a nationally representative sample (N  =  16,000; age range: 15-64 years; 62.4% response rate). The final sample comprised 9,161 participants, with 80.9% reporting having used the internet at least once a week (n  =  7,413). A structured questionnaire was designed and internet addiction was assessed using the IDS-15.

RESULTS

Confirmatory Factor Analysis showed acceptable fit to the proposed four-factor structure of the IDS-15. The reliability, and criterion, convergent and discriminant validity were also found to be adequate with a notable exception of the first item of the scale, as shown by its lower factor loading and higher variability. Additionally, latent profile analysis was used to distinguish between internet users with low (n = 3,818; 51.5%), medium (n = 3,111; 42.0%) and high (n = 484; 6.4%) addiction risk. Furthermore, the high-risk class was associated with higher IDS-15 factor scores, higher frequency of internet use in leisure time, and lower age of first internet use.

CONCLUSIONS

The present study provides new insights about the strengths and shortcomings of the IDS-15. Moreover, the results provide an insight into the prevalence of internet addiction in Slovenia, as well as associations with other potential factors. The results serve as the basis for further analyses on internet addiction epidemiology, policymaking activities, and design for targeted public health interventions in Slovenia.

Measuring clinician stuck points about trauma-focused cognitive behavior therapy: The TF-CBT Stuck Points Questionnaire

Although evidence-based treatments (EBTs) for youth trauma have been developed, trauma-informed EBTs are rarely used in community settings. Clinician concerns about evidence-based trauma treatment may be a barrier to adoption and delivery. However, few instruments to assess clinician beliefs about specific EBTs, such as trauma-focused cognitive behavior therapy (TF-CBT) are available. This study evaluated an instrument of clinician concerns about TF-CBT, the TF-CBT Therapist Stuck Points questionnaire, in a sample of community mental health clinicians training in a year-long TF-CBT community-based learning collaborative. The 26 items in the instruments, which aim to assess clinician views on child trauma treatment and TF-CBT, indicate preliminary psychometric support (i.e., item-total correlations, internal consistency, negative correlations with measures of attitudes towards evidence-based practice). Scores on the TF-CBT Therapist Stuck Points questionnaire revealed that, on average, clinicians expressed concerns about having children talk about their trauma in session, the effectiveness of certain TF-CBT components, and whether to involve caregivers in treatment. Clinician doubts could be targeted during a TF-CBT implementation effort and clinical supervision to facilitate treatment delivery. Implications for assessing TF-CBT specific beliefs during implementation are discussed.

How a Few Inconsistent Respondents Can Confound the Structure of Personality Survey Data

Abstract. In survey data, inconsistent responses due to careless/insufficient effort (C/IE) can lead to problems of replicability and validity. However, data cleaning prior to the main analyses is not yet a standard practice. We investigated the effect of C/IE responses on the structure of personality survey data. For this purpose, we analyzed the structure of the Core-Self Evaluations scale (CSE-S), including the detection of aberrant responses in the study design. While the original theoretical model of the CSE-S assumes that the construct is unidimensional ( Judge et al., 2003 ), recent studies have argued for a multidimensional solution (positive CSE and negative CSE). We hypothesized that this multidimensionality is not substantive but a result of the tendency of C/IE data to generate spurious dimensions. We estimated the confirmatory models before and after removing highly inconsistent response vectors in two independent samples (6% and 4.7%). The analysis of the raw samples clearly favored retaining the two-dimensional model. In contrast, the analysis of the clean datasets suggested the retention of a single factor. A mere 6% C/IE response rate showed enough power to confound the results of the factor analysis. This result suggests that the factor structure of positive and negative CSE factors is spurious, resulting from uncontrolled wording variance produced by a limited proportion of highly inconsistent response vectors. We encourage researchers to include screening for inconsistent responses in their research designs.

Factorial structure of Individual Work Performance Questionnaire (Version 1.0) revisited: Evaluation of acquiescence bias

The objective of this study is to evaluate the factorial structure of the Spanish version of the Individual Work Performance Questionnaire (Version 1.0) and to estimate the impact that acquiescence has on it as response bias. Exactly 500 workers from organizations from different industries, primarily located in Ecuador, participated in this study. The comparison of different models using Confirmatory Factor Analysis proved that when acquiescence is not controlled, evidence leads to the rejection of a one-dimensional—or essentially one-dimensional—structure (bifactor model), thus questioning the initial conceptualization of the construct. But when this response bias is controlled, both the one-dimensional model (χ2 = 429.608 [223], p < .001; CFI = .974; TLI = .982; RMSEA = .043; SRMR = .063) and the bifactor model (χ2 = 270.730 [205], p = .001; CFI = .992; TLI = .994; RMSEA = .026; SRMR = .047) show relevant improvement in terms of goodness of fit over the three-correlated-factors model (χ2 = 537.038 [132], p < .001; CFI = .950; TLI = .942; RMSEA = .079; SRMR = .070). However, the low reliability of the substantive factors of the bifactor model makes the one-dimensional model preferable in applied studies. Finally, the results show how mistakes could be made when concluding on the possible relationships between work performance and other relevant variables, in case acquiescence is not controlled.

Testing the Nonlinearity Assumption Underlying the Use of Reverse-Keyed Items: A Logical Response Perspective

Researchers often assume a strong, linear relationship between regular- and reverse-keyed items, with responses on regular-keyed items (e.g., agree) perfectly mirroring those on reverse-keyed items (e.g., disagree). The current research challenges this received view and propounds a possible nonlinear relationship, partly due to the logical tendency of midlevel respondents to disagree with both types of items. In four examples (reported human height, job satisfaction, positive-negative affect, and self-esteem; total N = 50,544), a nonlinear model consistently explained additional item variance beyond a linear model. We further demonstrate that this relationship is moderated by item characteristics such as item extremity (job satisfaction) and item softening (self-esteem). Suboptimal modeling of the relationship may result in the apparent bidmensionality of a construct that characterizes regular- and reverse-keyed items as separate factors. User-friendly syntax for the examination of nonlinearity is provided to enhance the accessibility of the procedure.

Normierung und testtheoretische Überprüfung der deutschen Adaptation der Kurzform der Self-Control Scale (SCS-K-D)

Zusammenfassung. Gegenstand dieses Artikels ist die deutsche Adaptation der Kurzform der Self-Control Scale (SCS-K-D; übersetzt von Bertrams und Dickhäuser). Es werden 3 Ziele verfolgt: (1) Die Dimensionalität der Skala formal zu prüfen, (2) die Skala auf Messinvarianz bezüglich Geschlecht, Bildung und Alter zu prüfen und (3) basierend auf einer Zufallsstichprobe der erwachsenen deutschen Bevölkerung ( N = 4 038) Normwerte abzuleiten. Die theoretisch erwartete eindimensionale Struktur konnte empirisch nicht bestätigt werden. Wird der Einfluss invertierter Items mit einem Methodenfaktor kontrolliert, verbessert sich die Modellgüte. Für eine angemessene Modellgüte musste die 13-Item Skala jedoch zusätzlich durch Itemausschluss auf eine 8-Item Skala reduziert werden. Diese 8-Item Variante erreichte auch in einer zweiten, unabhängigen Stichprobe ( N = 1 818) eine akzeptable Güte. Die Überprüfung der durch Messinvarianz erfolgte 8-Item Variante mit Methodenfaktor ergab skalare Messinvarianz für Geschlecht, konfigurale Messinvarianz für Bildung und deutliche Messinvarianzprobleme über Altersgruppen hinweg. Normwerte für die erwachsene, deutsche Bevölkerung werden sowohl für die 13-Item und die 8-Item Variante zur Verfügung gestellt und zudem differenziert nach Bildungsniveau und Alter dargeboten.

Reconsidering the digital divide: an analytical framework from access to appropriation

Purpose

This paper presents a framework to measure the digital divide by considering a more comprehensive index of information and communication technology (ICT) predictors. The authors also address the conceptual and methodological problems in the digital divide field, given that its focus has been shifted from technological access to higher-order divides over the years. The proposed framework is hypothesized and tested in the context of unemployed and underemployed residents in Singapore.

Design/methodology/approach

Through a quantitative survey, 302 unemployed and underemployed workers were asked what ICT “access”, “usage” and “appropriation” meant to them. Factor analyses were deployed to identify the underlying, granular dimensions of ICT access, usage and appropriation.

Findings

The factor analyses revealed an interesting breakdown of the main factors of ICT access, usage and appropriation. The authors found that one's purpose for which technology is accessed, used and appropriated determines how each of the levels of ICT assets is defined. Thus, the authors propose new operational definitions for ICT access, usage and appropriation based on the analyses.

Originality/value

This study aims to provide a more robust measure of the digital divide from access, capabilities to outcomes. The authors hope that this framework, besides complementing current digital divide models, can be applied to different types of participants.

What Is the Optimal Cut-Off Point of the 10-Item Center for Epidemiologic Studies Depression Scale for Screening Depression Among Chinese Individuals Aged 45 and Over? An Exploration Using Latent Profile Analysis

Background

The main objective of the current study was to gain insight into the heterogeneity and profiles of depressive symptoms in Chinese individuals aged 45 and over and to determine the optimal cut-off point for the 10-item Center for Epidemiologic Studies Depression Scale (CES-D-10) to provide a reference for future practical application.

Methods

The participants were 16,997 Chinese community-dwelling adults aged 45 years or older who completed survey interviews for the 2018 China Health and Retirement Longitudinal Study. The current study utilised latent profile analysis (LPA) to identify distinct profiles based on participants' responses to CES-D-10 items, and receiver operating characteristic (ROC) curve analyses were applied to determine the optimal cut-off point for the CES-D-10 scale.

Results

A three-profile solution was suggested as the optimum and included a "minimal depression" group (63.1%), "mild depression" group (23.4%) and "moderate-severe depression" group (13.5%); 36.9% (95% CI: 36.2 ∼ 37.6%) were considered at risk for probable depression. The "minimal depression" group was viewed as "non-cases," and the remaining were viewed as "cases" that served as the reference standard for the ROC analysis, which obtained an AUC value of 97.8% (95% CI: 97.7-98.0%) and identified an optimal cut-off point of 10 (sensitivity:91.93%, specificity: 92.76%, and accuracy: 92.45).

Conclusion

The identification of these distinct profiles underscores the heterogeneity in depressive symptoms among Chinese middle-aged and older adults. The CES-D-10 scale was demonstrated to have acceptable psychometric properties, with a cut-off point of 10 recommended for future research and practical application.

The Relationship of Insufficient Effort Responding and Response Styles: An Online Experiment

While self-report data is a staple of modern psychological studies, they rely on participants accurately self-reporting. Two constructs that impede accurate results are insufficient effort responding (IER) and response styles. These constructs share conceptual underpinnings and both utilized to reduce cognitive effort when responding to self-report scales. Little research has extensively explored the relationship of the two constructs. The current study explored the relationship of the two constructs across even-point and odd-point scales, as well as before and after data cleaning procedures. We utilized IRTrees, a statistical method for modeling response styles, to examine the relationship between IER and response styles. To capture the wide range of IER metrics available, we employed several forms of IER assessment in our analyses and generated IER factors based on the type of IER being detected. Our results indicated an overall modest relationship between IER and response styles, which varied depending on the type of IER metric being considered or type of scale being evaluated. As expected, data cleaning also changed the relationships of some of the variables. We posit the difference between the constructs may be the degree of cognitive effort participants are willing to expend. Future research and applications are discussed.

A structural equation model predicting adults' online learning self-efficacy

We aimed to model the direct effects of the theorized relationships of academic self-efficacy, computer use self-efficacy, learning management system self-efficacy, internet and information-seeking self-efficacy, and online learning self-efficacy using structural equation modeling. The study proves that academic self-efficacy has positive predictive relationships with computer use self-efficacy, learning management system self-efficacy and internet and information self-efficacy. Secondly, modeling revealed that computer use self-efficacy, learning management system self-efficacy and internet and information self-efficacy positively predicts online learning self-efficacy. This study provides empirical evidence on a previously theorized set of relationships and informs policy makers on significant relationships they can employ to inform program development aimed at improving online learning self-efficacy anchored on their particular use cases.

Measurement Invariance of the Questionnaire on the Internal Stigma of Internet Surfing Among Sino-Australian Undergraduates

BACKGROUND

The stigma of internet surfing is a relatively new area of study arising from the popularity of the internet. The Questionnaire on the Internal Stigma of Internet Surfing-9 (QISIS-9) was developed for the Chinese culture, so its suitability for use in other cultural contexts is uncertain. This paper examines the measurement invariance of the QISIS-9 among Sino-Australian undergraduates to verify the cross-cultural measurement invariance of QISIS-9 and promote cross-cultural (nationality) research regarding the internal stigma of internet surfing.

METHODS

The Internal Stigma of Internet Surfing-9 (QISIS-9) was used to assess 200 Chinese undergraduates (50% female, M_age = 19.78) and 204 Australian undergraduates (76% female, M_age = 21.10), respectively.

RESULTS

A confirmatory factor analysis (CFA) indicated that the single-factor model of QISIS-9 is acceptable with both Chinese and Australian undergraduates. However, the factor loading of Item 9, to which a reverse score is assigned, is not ideal for both samples. Thus, the item should be deleted. According to a multigroup confirmatory factor analysis (MCFA), QISIS-8, the revised version of QISIS-9, meets the strict measurement invariance among the Chinese and Australian participants. The QISIS-8 demonstrated appropriate internal consistency in the scores for both the Chinese and Australian undergraduates.

CONCLUSION

The new QISIS-8 can effectively assess the internal stigma of internet surfing among Chinese and Australian undergraduates, and it provides a frame of reference for further cross-cultural (border) comparisons.

Measuring Impaired Control over Cannabis Use: Initial Evaluation of the Impaired Control Scale-Cannabis (ICS-C)

Background: Impaired control is a central concept in addiction. Impaired control over alcohol has been associated with heavy drinking and alcohol-related problems in young adults, but there is less research on impaired control over cannabis. Currently, there is no validated self-report instrument that comprehensively assesses impaired control over cannabis use. This study examined the factor structure, reliability, and validity of a new measure, the Impaired Control Scale-Cannabis (ICS-C), which was adapted from the widely used Impaired Control Scale (ICS) for alcohol. Method: The sample consisted of students at two Canadian universities who reported past-month cannabis use (N = 362; 63% women; 66% White, mean age = 19.91). Participants completed an online survey including the ICS-C and ICS, along with measures of cannabis use, cannabis problems, alcohol use, impulsivity, and self-regulation. Results: After trimming problematic and redundant items, the final exploratory factor analysis of the ICS-C items yielded two factors: Attempted Control (attempts to control cannabis use) and Failed Control (unsuccessful attempts to limit cannabis use). High correlations between the ICS-C subscales and the Impaired Control subscale of the Marijuana Consequences Questionnaire provided evidence for convergent validity. Support for concurrent and discriminant validity was observed in the associations of the ICS-C subscales with cannabis use, cannabis problems, impulsivity, self-regulation, alcohol use, and the alcohol ICS. Conclusions: The ICS-C is a promising tool for assessing impaired control over cannabis in young adults. Future research should further validate the ICS-C and examine its potential clinical utility for identifying individuals at risk for cannabis use disorder.

A self-report measure of perfectionism: A confirmatory factor analysis of the Swedish version of the Clinical Perfectionism Questionnaire

Background

Perfectionism is often defined as the strive for achievement and high standards, but can also lead to negative consequences. In addition to affecting performance and interpersonal relationships, perfectionism can result in mental distress. A number of different self-report measures have been put forward to assess perfectionism. Specifically intended for clinical practice and research, the Clinical Perfectionism Questionnaire (CPQ) was developed and is presently available in English and Persian. To promote its use in additional contexts, the current study has translated and investigated the psychometric properties of the Swedish version of the CPQ.

Method

A Confirmatory Factor Analysis was performed to examine the best fit with data, using a priori-models and a sample of treatment-seeking participants screened for eligibility to receive Internet-based cognitive behavior therapy (n = 223).

Results

The results indicated a lack of fit with data. A two-factor structure without the two reversed items (2 and 8) exhibited the best fit, perfectionistic strivings and perfectionistic concerns, but still had poor structural validity. Correlations with self-report measures of perfectionism, depression, anxiety, dysfunctional beliefs, self-criticism, quality of life, and self-compassion were all in the expected directions. Eight-week test-retest correlation was Pearson r = .62, 95% Confidence Interval [.45, .74], using data from 72 participants in the wait-list control, and the internal consistency for the CPQ, once removing the reversely scored items, was Cronbach’s α = .72.

Conclusion

The CPQ can be used as a self-report measure in Swedish, but further research on its structural validity is needed.

Rigorous Translation and Cultural Adaptation of an Autism Screening Tool: First Years Inventory as a Case Study

Screening tools for autism spectrum disorders serve a vital role in early identification of all children who may need evaluation and support. Recent studies suggest that traditional methods used in this field to translate such tools may be insufficient for maintaining linguistic, construct, or technical equivalence, resulting in screening tools that do not meet high psychometric standards in the new population. This study implemented a rigorous translation and cultural adaptation process by translating the First Years Inventory v3.1 (Baranek et al. First year inventory (FYI) 3.1. University of North Carolina at Chapel Hill Chapel Hill, NC, 2003) for a US-based Spanish-speaking population. A description of this process is provided with results from data collected during each phase. The unique challenges that were identified and addressed are detailed for future translation teams.

Development and Validation of the Holistic Cognition Scale

This paper introduces a new scale to measure cognitive cultural differences, drawing on the theory of analytic versus holistic thought. Examining culture from a cognitive perspective is a challenge to traditional values-based approaches. Existing measures based on this framework are methodologically problematic and warrant renewal. This paper presents development and validation studies for a new instrument that measures analytic versus holistic cognitive tendencies at the individual level. The scale assesses four previously established dimensions: attention, causality, contradiction, and change. The present work follows well-established scale development protocols and the results show that the 16-item Holistic Cognition Scale (HCS) is a valid and reliable measure of analytic versus holistic thought. Three new studies with four unique samples (N = 41; 272; 454; and 454) provide evidence to support the content validity, reliability, and factor structure of the new instrument, as well as its convergent, discriminant, and concurrent validity against comparable constructs. Convergent validity is established against measures of compromise, intuition, complexity, and collectivism; predictive validity is established against Hofstede's (1980) five cultural value dimensions; and discriminant validity is established using the average variance extracted from a confirmatory factor analysis. The new HCS is an improvement over previous attempts with a balanced number of forward- and reverse-scored items, superior reliability, less redundancy, and stronger factor loadings.

How Servant Leadership Drives Project Team Performance Through Collaborative Culture and Knowledge Sharing

Drawing on social learning theory, this research compared and tested how two distinct mediating mechanisms—collaborative culture and knowledge sharing—influence the servant leadership–project team performance relationship. Survey data were collected from 275 employees representing 70 project teams, and multilevel structural equation modeling was adopted to test the hypotheses. The findings indicated that collaborative culture fully mediates, whereas knowledge sharing does not mediate, the servant leadership–project team performance relationship. These findings reveal collaborative culture as the intervening mechanism that translates servant leadership to project team performance. For project-based organizations, the research puts forth theoretical and practical implications.

Using Constrained Factor Mixture Analysis to Validate Mixed-Worded Psychological Scales: The Case of the Rosenberg Self-Esteem Scale in the Dominican Republic

A common method to collect information in the behavioral and health sciences is the self-report. However, the validity of self-reports is frequently threatened by response biases, particularly those associated with inconsistent responses to positively and negatively worded items of the same dimension, known as wording effects. Modeling strategies based on confirmatory factor analysis have traditionally been used to account for this response bias, but they have recently become under scrutiny due to their incorrect assumption of population homogeneity, inability to recover uncontaminated person scores or preserve structural validities, and their inherent ambiguity. Recently, two constrained factor mixture analysis (FMA) models have been proposed by Arias et al. (2020) and Steinmann et al. (2021) that can be used to identify and screen inconsistent response profiles. While these methods have shown promise, tests of their performance have been limited and they have not been directly compared. Thus the objective of the current study was to assess and compare their performance with data from the Dominican Republic of the Rosenberg Self-Esteem Scale (N = 632). Additionally, as this scale had not yet been studied for this population, another objective was to show how using constrained FMAs could help in the validation of mixed-worded scales. The results indicated that removing the inconsistent respondents identified by both FMAs (≈8%) reduced the amount of wording effects in the database. However, whereas the Steinmann et al. method only cleaned the data partially, the Arias et al. (2020) method was able to remove the great majority of the wording effects variance. Based on the screened data with the Arias et al. method, we evaluated the psychometric properties of the RSES for the Dominican population, and the results indicated that the scores had good validity and reliability properties. Given these findings, we recommend that researchers incorporate constrained FMAs into their toolbox and consider using them to screen out inconsistent respondents to mixed-worded scales.

An Exploratory Study of Consumers’ Knowledge and Attitudes about Lignin-Based Sunscreens and Bio-Based Skincare Products

Daily consumption of synthetic sunscreens is harmful to the environment and consumers’ health, so greener alternatives need to be produced. Lignin is a multifunctional and widely available biopolymer that can replace several ingredients, but its dark color and low sun protection limit its perceived usefulness. With a survey made for this study, we explored the knowledge and attitudes of 230 consumers towards lignin-based sunscreen, their motives and barriers to purchase it, and how it relates to their environmental and health consciousness. Participants were also asked about their sunscreen habits, their familiarity with the environmental and health impacts of skincare, their perceptions of bio-based ingredients in general, and their skincare product purchasing decisions. Those who are more familiar with environmental issues have a positive attitude towards bio-based ingredients, are accustomed to purchasing more environmentally friendly skincare, and are likelier to be interested in a lignin product. Consumers are welcoming towards a natural, healthy, and environmentally friendly sunscreen alternative but are worried about the lower SPF. Because organic is perceived as luxurious, they are concerned about its price, and some are apprehensive about its pigmentation. While a lignin-based sunscreen at this stage of development is unlikely to take on the role of primary sunscreen on warm, sunny days, it may be more useful as a general-purpose, everyday product that can offer some protection, moisture, and coverage.

An Italian adaptation of the Child-Adolescent Perfectionism Scale: Testing measurement invariance across grade levels and exploring associations with academic achievement

This study aims to examine the properties of an Italian version of the Child-Adolescent Perfectionism Scale (CAPS), one of the most widely used instrument for the assessment of self-oriented (SOP) and socially-prescribed (SPP) perfectionism in young people. The study was conducted on two large samples of middle (n = 379, M_age = 11.31) and high school (n = 451, M_age = 15.21) students. Confirmatory factor analysis supported the expected three-factor structure, comprising SOP-Striving, SOP-Critical, and SPP. Multigroup analyses provided evidence of configural, metric, and (partial) scalar measurement invariance across grade levels. Structural invariance (i.e., the invariance of factor variances and covariances) was also established. The scale scores exhibited a differentiated pattern of relations with personality traits and academic achievement, as measured by school grades: SOP-Critical and SPP were positively related to neuroticism and have adverse effects on grades of middle and high school students, respectively. SOP-Striving, by contrast, was positively related to conscientiousness and predicted higher grades. The SOP-Striving-achievement relation was consistent across grade levels and held even after controlling for individual differences in conscientiousness and neuroticism. In sum, results from this study establish sound psychometric properties for an Italian version of the CAPS, providing support for the dual nature of self-oriented perfectionism among adolescents of different ages.

Dimensionality and psychometric properties of an Italian translation of the Intuitive Eating Scale-2 (IES-2): An assessment using a bifactor exploratory structural equation modelling framework

The construct of intuitive eating is most often measured using the 23-item Intuitive Eating Scale-2 (IES-2), but previous studies have typically relied solely on confirmatory factor analysis (CFA) to understand IES-2 dimensionality. In contrast, a bifactor exploratory structural equation modelling (B-ESEM) framework offers a more realistic account of IES-2 multidimensionality. Here, we assessed the psychometric properties of a novel Italian translation using a combination of exploratory factor analysis and B-ESEM. A total of 950 adults completed the IES-2 alongside measures of positive body image, disordered eating, and psychological well-being. Results indicated that a 4-factor B-ESEM model had adequate fit to the data and that fit was improved when the correlated uniqueness of seven negatively worded IES-2 items was accounted for. This model of IES-2 scores showed adequate internal consistency and good test-retest reliability up to three weeks. Evidence of construct validity was good in terms of a global IES-2 factor, and broadly supported in terms of its specific-factors. These results highlight the utility of a B-ESEM framework for understanding the dimensionality of IES-2 scores and may help scholars better understand the extent to which the IES-2 adequately operationalises the construct of intuitive eating.

The Development and Validation of the Epistemic Vice Scale

This paper presents two studies on the development and validation of a ten-item scale of epistemic vice and the relationship between epistemic vice and misinformation and fake news. Epistemic vices have been defined as character traits that interfere with acquiring, maintaining, and transmitting knowledge. Examples of epistemic vice are gullibility and indifference to knowledge. It has been hypothesized that epistemically vicious people are especially susceptible to misinformation and conspiracy theories. We conducted one exploratory and one confirmatory observational survey study on Amazon Mechanical Turk among people living in the United States (total N = 1737). We show that two psychological traits underlie the range of epistemic vices that we investigated: indifference to truth and rigidity. Indifference manifests itself in a lack of motivation to find the truth. Rigidity manifests itself in being insensitive to evidence. We develop a scale to measure epistemic vice with the subscales indifference and rigidity. The Epistemic Vice Scale is internally consistent; has good convergent, divergent, and discriminant validity; and is strongly associated with the endorsement of misinformation and conspiracy theories. Epistemic vice explains additional variance in the endorsement of misinformation and conspiracy theories over and above demographic and related psychological concepts and shows medium to large effect sizes across outcome measures. We demonstrate that epistemic vice differs from existing psychological constructs, and show that the scale can explain individual differences in dealing with misinformation and conspiracy theories. We conclude that epistemic vice might contribute to "postfactive" ways of thinking.

SUPPLEMENTARY INFORMATION

The online version contains supplementary material available at 10.1007/s13164-021-00562-5.

Modeling Wording Effects Does Not Help in Recovering Uncontaminated Person Scores: A Systematic Evaluation With Random Intercept Item Factor Analysis

The item wording (or keying) effect consists of logically inconsistent answers to positively and negatively worded items that tap into similar (but polarly opposite) content. Previous research has shown that this effect can be successfully modeled through the random intercept item factor analysis (RIIFA) model, as evidenced by the improvements in the model fit in comparison to models that only contain substantive factors. However, little is known regarding the capability of this model in recovering the uncontaminated person scores. To address this issue, the study analyzes the performance of the RIIFA approach across three types of wording effects proposed in the literature: carelessness, item verification difficulty, and acquiescence. In the context of unidimensional substantive models, four independent variables were manipulated, using Monte Carlo methods: type of wording effect, amount of wording effect, sample size, and test length. The results corroborated previous findings by showing that the RIIFA models were consistently able to account for the variance in the data, attaining an excellent fit regardless of the amount of bias. Conversely, the models without the RIIFA factor produced increasingly a poorer fit with greater amounts of wording effects. Surprisingly, however, the RIIFA models were not able to better estimate the uncontaminated person scores for any type of wording effect in comparison to the substantive unidimensional models. The simulation results were then corroborated with an empirical dataset, examining the relationship between learning strategies and personality with grade point average in undergraduate studies. The apparently paradoxical findings regarding the model fit and the recovery of the person scores are explained, considering the properties of the factor models examined.

Psychometric Properties of the German Brief Experiential Avoidance Questionnaire (BEAQ)

The Brief Experiential Avoidance Questionnaire (BEAQ) is a 15-item short form of the Multidimensional Experiential Avoidance Questionnaire. This study aimed to investigate psychometric properties of a German translation of the BEAQ in a student and a clinical population. The BEAQ showed high internal reliability and overall acceptable convergent and discriminant validity. The BEAQ displayed adequate 7- to 13-day test-retest reliability and captured changes in experiential avoidance when experiential avoidance was targeted in treatment. Confirmatory factor analyses indicated that a bifactor structure where the BEAQ is modeled as one general and five specific factors that correspond to the Multidimensional Experiential Avoidance Questionnaire subscales fit the data adequately. All items (except Item 1 in the clinical population) loaded on the general factor and common variance was approximately equally spread across the general and specific factors. The Distress Endurance subscale was not included in this model, since it is represented by only one item, which showed poor performances and low associations to the BEAQ's total score in both samples. We recommend further research into the BEAQ's factor structure to substantiate our preliminary findings.

To Reverse Item Orientation or Not to Reverse Item Orientation, That Is the Question

To investigate the effect of using negatively oriented items, we wrote semantic reversals of the items in the Rosenberg Self Esteem Scale, UCLA Loneliness Scale, and the General Belongingness Scale and used them to create four experimental conditions. Participants (N = 2,019) were recruited through Amazon's Mechanical Turk. Data were assessed for dimensionality, item functioning, instrument properties, and associations with other variables. Regarding dimensionality, although a two-factor model (positively vs. negatively oriented factors) exhibits better fit than a unidimensional model across all conditions, bifactor indices were used to argue that a unidimensional interpretation of the data can be employed. With respect to item functioning, factor loadings were found to be nearly invariant across conditions, but thresholds were not. Concerning instrument properties, inclusion of negatively oriented items results in lower mean scores and higher score variances. Instruments with both positively and negatively oriented items demonstrated lower reliability estimates than those with only one orientation. For associations with other variables, path coefficients in a model where loneliness mediates the effects of belongingness on life satisfaction and self-esteem were found to vary across conditions. Findings suggest that negatively oriented items have minor impact on instrument quality, but influence measurement model and path coefficients.