From everyday life to measurable problematic smartphone use: The development and validation of the Smartphone Use Problems Identification Questionnaire (SUPIQ)

Background and aims

Problematic smartphone use (PSU) has gained attention, but its definition remains debated. This study aimed to develop and validate a new scale measuring PSU-the Smartphone Use Problems Identification Questionnaire (SUPIQ).

Methods

Using two separate samples, a university community sample (N = 292) and a general population sample (N = 397), we investigated: (1) the construct validity of the SUPIQ through exploratory and confirmatory factor analyses; (2) the convergent validity of the SUPIQ with correlation analyses and the visualized partial correlation network analyses; (3) the psychometric equivalence of the SUPIQ across two samples through multigroup confirmatory factor analyses; (4) the explanatory power of the SUPIQ over the Short Version of Smartphone Addiction Scale (SAS-SV) with hierarchical multiple regressions.

Results

The results showed that the SUPIQ included 26 items and 7 factors (i.e., Craving, Coping, Habitual Use, Social Conflicts, Risky Use, Withdrawal, and Tolerance), with good construct and convergent validity. The configural measurement invariance across samples was established. The SUPIQ also explained more variances in mental health problems than the SAS-SV.

Discussion and conclusions

The findings suggest that the SUPIQ shows promise as a tool for assessing PSU. Further research is needed to enhance and refine the SUPIQ as well as to investigate its clinical utility.

Investigating mid-block pedestrian crossing behaviour and safety at urban streets in Cairo

Pedestrians are the most vulnerable road users in the transportation system. Understanding pedestrian behaviour and road safety culture is critical for improving traffic safety in developing countries. The primary goal of this 2-fold study is to provide an investigation of pedestrian behaviour in Egypt, a developing country. The first part of this study validated the applying of Pedestrian Behaviour Scale (PBS) to investigate pedestrian behaviour in Egypt. Confirmatory Factor Analysis (CFA) was applied to 533 participants to assess the pedestrian's behavioural factors based on four validated categories: transgressions, lapses, aggressive and positive behaviours. The second part investigated pedestrian crossing behaviour at five different mid-block locations using video recordings. Then, logistic regression models were conducted to investigate pedestrian crossing safety. Males reported more aggressive behaviour than females. Pedestrians previously involved in a collision committed more transgressions and lapses. The presence of forced pedestrian crossing facilities, such as raised pedestrian crossings or traffic signals, significantly reduced the number of unsafe crossings when compared to uncontrolled pedestrian crossings. The aforementioned findings can be used by policymakers to improve road safety programs, create effective traffic safety campaigns, and enact appropriate laws, which could reduce the number of pedestrian-related crashes.

When and how to use set-exploratory structural equation modelling to test structural models: A tutorial using the R package lavaan

Exploratory structural equation modelling (ESEM) is an alternative to the well-known method of confirmatory factor analysis (CFA). ESEM is mainly used to assess the quality of measurement models of common factors but can be efficiently extended to test structural models. However, ESEM may not be the best option in some model specifications, especially when structural models are involved, because the full flexibility of ESEM could result in technical difficulties in model estimation. Thus, set-ESEM was developed to accommodate the balance between full-ESEM and CFA. In the present paper, we show examples where set-ESEM should be used rather than full-ESEM. Rather than relying on a simulation study, we provide two applied examples using real data that are included in the OSF repository. Additionally, we provide the code needed to run set-ESEM in the free R package lavaan to make the paper practical. Set-ESEM structural models outperform their CFA-based counterparts in terms of goodness of fit and realistic factor correlation, and hence path coefficients in the two empirical examples. In several instances, effects that were non-significant (i.e., attenuated) in the CFA-based structural model become larger and significant in the set-ESEM structural model, suggesting that set-ESEM models may generate more accurate model parameters and, hence, lower Type II error rate.

A confirmatory factor analysis of an electronic format painDETECT questionnaire for patients with low back pain

BACKGROUND

The substantial burden of low back pain on patients and healthcare systems is exacerbated by unclear pathology and ineffective diagnostic methods, hindering effective management. The painDETECT questionnaire (PD-Q) has been used to facilitate the evaluation and categorization of low back pain. While preliminary validation and translations of the paper-based format of PD-Q into languages such as Spanish and Dutch have been accomplished, the underlying factor model inherent to the electronic format of the PD-Q remains to be established.

OBJECTIVE

The objective of this study was to utilise confirmatory factor analysis (CFA) to investigate the factor structure of an electronic format PD-Q among patients with neuropathic low back pain.

METHODS

This cross-sectional study was conducted at a Spinal Clinic in Sydney between November 2020 and October 2022. Eligible participants were adults over 18 with low back pain and no history of lumbar surgery or systemic co-morbidities. Participants completed the electronic format of the PD-Q, and CFA was employed to assess the validity of the suggested two-factor, nine-item structure. Recommended cut-offs for goodness-of-fit indices were used to evaluate the model fit.

RESULTS

Of the 236 patients that visited the clinic during the data collection period, 142 (71, 50% female, mean age 51.26 ± 15.28 years) participated in the study. Median pain severity was 9/10 over 4 weeks. CFA indicated strong model fit, with goodness-of-fit and comparative fit indices over 0.9, and overall internal consistency was 0.77. Construct validity analysis demonstrated the PD-Q's effectiveness in distinguishing neuropathic, mixed, and nociceptive LBP, aiding neuropathic pain evaluation in low back pain patients.

CONCLUSION

This study confirms the reliability and two-factor structure of the electronic PD-Q for neuropathic pain assessment in low back pain patients. To enhance comprehension of the clinical applicability of the electronic format PD-Q, future research should conduct clinimetric evaluations.

Psychometric properties of the TACT framework-Determining rigor in qualitative research

Introduction

The credibility of qualitative research has long been debated, with critics emphasizing the lack of rigor and the challenges of demonstrating it. In qualitative research, rigor encompasses explicit, detailed descriptions of various research stages, including problem framing, study design, data collection, analysis, and reporting. The diversity inherent in qualitative research, originating from various beliefs and paradigms, challenges establishing universal guidelines for determining its rigor. Additionally, researchers' often unrecorded thought processes in qualitative studies further complicate the assessment of research quality.

Methods

To address these concerns, this article builds on the TACT framework, which was developed to teach postgraduate students and those new to qualitative research to identify and apply rigorous principles and indicators in qualitative research. The research reported in this article focuses on creating a scale designed to evaluate the psychometric properties of the TACT framework. This involves analyzing the stability of its dimensions and understanding its effectiveness as a tool for teaching and research.

Results

The study's findings indicate that the TACT framework, when assessed through the newly developed scale, exhibits stable dimensions consistent with rigorous qualitative research principles. The framework effectively guides postgraduate students and new researchers in assessing the rigor of qualitative research processes and outcomes.

Discussion

The application of the TACT framework and its evaluation scale reveals several insights. Firstly, it demonstrates the framework's utility in bridging the gap in pedagogical tools for teaching rigor in qualitative research methods. Secondly, it highlights the framework's potential in providing a structured approach to undertaking qualitative research, which is essential given this field's diverse methodologies and paradigms. However, the TACT framework remains a guide to enhancing rigor in qualitative research throughout all the various phases but by no means a measure of rigor.

Conclusion

In conclusion, the TACT framework and its accompanying evaluative scale represent significant steps toward standardizing and enhancing the rigor of qualitative research, particularly for postgraduate students and early career researchers. While it does not solve all challenges associated with obtaining and demonstrating rigor in qualitative research, it provides a valuable tool for assessing and ensuring research quality, thereby addressing some of the longstanding criticisms of the quality of research obtained through qualitative methods.

Development and Validation of the Father-Love Absence Scale for Adolescents

Although father love is vital for the positive growth of the child, there is currently no reliable tool to assess the psychological absence of fathers. Therefore, the current study aims to develop an instrument to measure adolescents' experiences of father-love absence from a psychological absence perspective. According to the fundamental psychological diathesis assumption, the father-love absence scale (FLAS) was developed based on expert panel discussions. A total of 2592 junior high school student participants were surveyed, and exploratory factor analysis (EFA) and confirmatory factor analysis (CFA) was conducted to determine the items for the formal scale. The results showed that the 18-item FLAS consisted of four factors, which were emotional absence (EA), cognitive absence (CA), behavioral absence (BA), and volitional absence (VA). In conclusion, the FLAS demonstrated satisfactory reliability and validity, and this scale is a valuable tool for assessing father-love absence.

Evaluation of a short instrument for measuring health-related quality of life in oncological patients in routine care (HELP-6): an observational study

Purpose

Patient-reported outcomes have not been sufficiently implemented into the routine care of cancer patients because the existing instruments are often too long and complex or not cancer-specific. The aim of this study is the determination of psychometric properties and item reduction of a newly developed health-related quality of life (HrQoL) questionnaire for use in oncological clinical routines.

Methods

This observational study with a repeated measurements design included oncological inpatients and outpatients. A total of 630 patients participated at the first point of measurement and 404 at the second point of measurement. To evaluate the instrument, we conducted hierarchical confirmative factor analyses and for further validation correlated the resulting factors with standardized and validated HrQoL measurements. Test-retest reliability and responsiveness to change were tested.

Results

The developed questionnaire "HELP-6" ("Hamburg Inventory for Measuring Quality of Life in Oncological Patients") has a six-factor structure and has moderate-to-good convergent validity (r= -0.25 --0.68). Test-retest reliability was moderate-to-good (r =0.56-0.81, p < 0.001). Indications for responsiveness to change were found for three dimensions. The final version of the questionnaire HELP-6 has six dimensions with one item each.

Conclusion

With the HELP-6 instrument for measuring HrQoL in cancer patients, we provide a short and practical patient-reported outcome instrument. Though responsiveness to change could not be confirmed for all dimensions in this study, the HELP-6 includes time-efficient completion and evaluation and is informative in relevant HrQoL dimensions of cancer patients. Therefore, the HELP-6 poses an important addition to inpatient and outpatient routine cancer care.

Trial registration

This study was registered at Open Science Framework (https://osf.io/y7xce/), on 9 June 2018.

Examining Perceived Coercion in Drug Treatment Courts

While perceptions of voluntary consent have been studied among participants in Mental Health Courts (MHC), little is known about coercion among participants in Drug Treatment Courts (DTC), the most common type of specialty court. The purpose of the present study was to examine perceptions of coercion at enrollment among participants (N = 85) in two Massachusetts DTCs. Results indicated that, on average, participants reported low levels of perceived coercion (M = 1.67, SD = 1.23), which suggests that most individuals did not perceive their decision to enroll in DTC to be coercive. However, further research is needed to delineate whether clinical or procedural variations exist within DTCs, if levels of perceived coercion predict DTC participant outcomes, and if subpopulations experience higher or lower levels of coercion.

How Accurate Is Your Correlation? Different Methods Derive Different Results and Different Interpretations

Assessing the association between conceptual constructs are at the heart of quantitative research in educational and psychological research. Researchers apply different methods to the data to obtain results about the correlation between a set of variables. However, the question remains, how accurate are the results of the correlation obtained from these methods? Although various considerations should be taken to ensure accurate results, we focus on the types of analysis researchers apply to the data and discuss three methods most researchers use to obtain results about correlation. Particularly, we show how correlation results in bivariate correlation, confirmatory factor analysis (CFA), and exploratory structural equation modeling (ESEM) differ substantially in size. We observe that methods that assume independence of the items often generate inflated factor correlations whereas methods that relax this assumption present uninflated, thus more accurate correlations. Because factor correlations are inflated in bivariate correlation and CFA, the discriminant validity of the constructs is often unattainable. In these methods, the size of the correlation can be very large and biased. We discuss the reasons for this variation and suggest the type of correlation that researchers should select and report.

Measuring Perceived Research Competence of Junior Researchers

Graduates of doctoral (Ph.D.) programs are expected to be competent at designing and conducting research independently. Given the level of research competence needed to successfully conduct research, it is important that assessors of doctoral programs (e.g., faculty and staff) have a reliable and validated tool for measuring and tracking perceived research competence among their students and graduates. A high level of research competence is expected for all Ph.D. graduates worldwide, in addition to in all disciplines/fields. Moreover, graduates of Ph.D. programs may complete their studies in one country but then obtain a research position in another country, emphasizing the need to ensure that all doctoral programs are fostering similar levels of research competence. Thus, the purpose of this study was to gather additional evidence for validity and reliability of the Research Competence (R-Comp) scale. Specifically, we sought to extend the findings of by adapting the scale, translating it to other languages, and applying the tool with a sample of early stage researchers. Our findings provide initial evidence that the adapted PR-Comp is appropriate for use in three languages and across a variety of disciplines/programs of study.

The MOHIP-14PW (Modified Oral Health Impact Profile 14-Item Version for Pregnant Women): A Real-World Study of Its Psychometric Properties and Relationship with Patient-Reported Oral Health

Background: The 14-item version of the Oral Health Impact Profile (OHIP-14) has been widely used as a measure for oral health-related quality of life (OHQoL) since its publication in 1997. However, few studies have examined its psychometric properties and relationship with patient-reported oral health in pregnant women. Aim: To offer empirical evidence for appropriate use of the OHIP-14 among pregnant women in research and clinical practice. Objectives: (1) to empirically investigate the psychometric properties of the OHIP-14, (2) to modify it into the MOHIP-14PW (modified OHIP-14 for pregnant women), and (3) to compare their relationships with patient-reported oral health in pregnant women. Methods: In this real-world study (RWS) from suburban New York clinics, we collected OHIP-14 data from 291 pregnant women and assessed its psychometric properties at the item-, dimension-, and measure-level, including confirmatory factor analysis (CFA) and exploratory factor analysis (EFA). Accordingly, we modified the OHIP-14 into the MOHIP-14PW. Finally, we compared their correlations with patient-reported oral health scores. Results: All OHIP-14 items had severely skewed distributions, and two had a correlation with the patient-reported oral health < 0.1. All seven pairs of items correlated well (0.47 to 0.62), but the Cronbach’s alphas indicated suboptimal reliability, with two below 0.70. CFA results offered suboptimal support to the original structure, and EFA found a three-dimensional structure best fitted the data. Therefore, we modified the OHIP-14 into the MOHIP-14PW. CFA on the MOHIP-14PW offered stronger supports, and the Cronbach’s alphas increased to 0.92, 0.72, and 0.71. The MOHIP-14PW’s dimensions were more meaningful to pregnant women and had stronger relationships with patient-reported oral health than the OHIP-14; the average correlation coefficients increased by 26% from 0.19 in OHIP-14 to 0.24 in the MOHIP-14PW. Conclusions: The original OHIP-14 required modifications at the item-, dimension-, and measure- level, and the MOHIP-14PW had better psychometric properties, easier interpretation, and stronger correlation with patient-reported oral health in low-income pregnant women. Through an interdisciplinary RWS on a large sample of pregnant women, this study offers concrete empirical evidence for the advantages of the MOHIP-14PW over the original OHIP-14.

Reliability and validity of the repetitive behavior scale-revised for young Chinese children with autism spectrum disorder in Jiangxi Province

Restricted and repetitive behaviors (RRBs) are one of the two main diagnostic features of autism spectrum disorder (ASD). To date, a growing body of research on RRB in children with ASD has recently attracted academic attention. The Repetitive Behavior Scale-Revised (RBS-R) was primarily intended for use in evaluating RRBs observed in ASD. This study recruited 381 Chinese children with ASD aged 2-4 years to measure the reliability and validity of the RBS-R. Confirmatory factor analysis (CFA) was applied to the structuring models of the four proposed structural models, indicating that a 6-factor model demonstrated good internal consistency and the best fit based on common overall fit indices. These findings suggest the utility of the Chinese version of RBS-R.

Examining the dimensionality, reliability, and invariance of the Chinese version of the Resilience Scale-14: A multicenter cross-sectional survey in Chinese junior nurses

BACKGROUND

This study aimed to present the psychometric properties (dimensionality, reliability, and invariance) of the Chinese 14-Item Resilience Scale (RS-14) within Chinese register nurses (RNs) with less than 3 years work experiences. And we aimed to compare the fit of a unidimensional model and a bifactor model.

MATERIALS AND METHODS

This multicenter cross-sectional survey was conducted from August to September in 2019. A total of 7,231 registered nurses from 90 hospitals were recruited. Data was anonymously obtained through online questionnaires. Both reliability and validity of Chinese RS-14 were assessed. The confirmatory factor analyses (CFA) were used to compare the fit of two different factor structures of the RS-14 (unidimensional model vs. a bifactor model). Moreover, multigroup CFA (MGCFA) were applied to evaluate the measurement invariance (MI) across sociodemographic parameters (gender, educational level, marital status, and et al.).

DESIGN

Cross-sectional quantitative analyses.

RESULTS

Our study confirmed that the bifactor model presented the best fit within Chinese nurses (CFI = 0.924, TLI = 0.909, RMSEA = 0.095, SRMR = 0.043), and found strong factorial invariance across gender, marital status, and status of receiving standardized training. The reliability of RS-14 was high with a Cronbach's alpha coefficient of 0.939. Moreover, RS-14 was positively correlated with the social support and was negatively correlated with workplace bullying.

CONCLUSION

This is the first study to explore the latent factor structure for the RS-14 among Chinese RNs and evaluated MI across a series of sociodemographic variables. Based on our findings, the Chinese version RS-14 is both valid and reliable.

Psychometric Analysis of a German-Language Version of the Work-Family Conflict and Family-Work Conflict Scale

The Work-Family Conflict and Family-Work Conflict Scale (WFC & FWC Scale) is a questionnaire commonly used to assess conflicts that arise when required time devotion and strain for work obligations interfere with family responsibilities (work-family conflict) and conflicts that arise when family responsibilities interfere with work responsiblities (family work conflict). Past reports on the psychometric properties and recommendations for application of the WFC & FWC Scale mostly rely on samples from the United States. The current study is the first to report psychometric properties of a German-language version of the WFC & FWC Scale, including invariance analyses across women and men, and test-retest reliabilities. The analysis of the latent structure that was based on responses from 274 employes (77.0% women, 23.0% men) of a medical university in Austria revealed that the bifactor model had a satisfactory fit with the data. Configural and metric invariance indicated a similar factor structure and similar meaning in women and men. However, scalar invariance cannot be assumed. Thus, differences in scale scores between women and men might not adequately reflect level differences in the underlying latent factor. High internal consistencies and high test-retest reliabilities offer evidence for adequate reliability. Additionally, evidence for convergent (links to work stress and relationship satisfaction) and divergent validity (no links to career ambition) were found. In summary, the current study offers adequate evidence for validity and reliability of a German-language version of the WFC & FWC Scale.

The Development and Validation of the Doctoral Student Identity Scale

Objective: Based on how the identity of doctoral students is recognized and understood in the context of Chinese culture, we developed a doctoral identity scale using both qualitative and quantitative analyses. Methods: The initial project of the Scale was formed through qualitative analyses and expert consultation. Nine hundred and ninety-one doctoral students were officially tested, and 982 valid questionnaires were obtained. They were randomly divided into two parts, and 491 of which were assessed for item Response Theory (IRT) and exploratory factor analysis (EFA) and 491 of which were assessed for confirmatory factor analysis (CFA). The Subjective Well-Being Scale (SWB), the Rosenberg Self-Esteem Scale (RSE), and the Psychological Sense of School Membership Scale (PSSM) were used to test its the criterion-related validity. One hundred and forty-one students were selected for retesting after 8 weeks. Results: The doctoral student identity questionnaire consisted of two factors identity exploration and identity commitment, explaining 57% of the total variance. The results of CFA showed that the two-factor model fitted the data well. The two dimensions of the Doctoral Student Identity Scale were significantly and positively correlated with the two dimensions of the SWB scale (0.32-0.66), the latent factor of the RSE scale (0.42-0.55), and the latent factor of the PSSM scale (0.52-0.62). Composite reliability values for exploration and commitment were 0.79 and 0.83 respectively, and the values of McDonald's omega for exploration and commitment were 0.81 and 0.85 respectively. The test-retest reliability of the total questionnaire was 0.842. Conclusion: The Doctoral Student Identity Scale was developed with good reliability and validity, and can be used as a reliable tool for measuring the doctoral student identity. In addition, the questionnaire will provide corresponding ideas and methods for studying the identity issues of specific groups.

Health-related quality of life in women with endometriosis: psychometric validation of the Endometriosis Health Profile 30 questionnaire using confirmatory factor analysis

STUDY QUESTION

Which of the competing models of the Endometriosis Health Profile 30 Questionnaire (EHP-30) factor structure is best supported by confirmatory factor analysis (CFA)?

SUMMARY ANSWER

Findings support a five-factor first-order model of the EHP-30, thereby lending support to the model originally suggested by the questionnaire developers.

WHAT IS KNOWN ALREADY

Endometriosis has a negative impact on quality of life, and measures specifically developed to address this impact, such as the EHP-30, are vital in research and disease management. Previous studies have found different models of the EHP-30 factor structure, and generated uncertainty regarding how to use the questionnaire. CFA can be applied to compare competing factor models and determine the underlying structure of a questionnaire.

STUDY DESIGN SIZE DURATION

This cross-sectional multicenter study included 304 women with endometriosis recruited from three different public health service endometriosis clinics (referral centers for treatment of severe endometriosis) and the Danish Endometriosis Patients Association from 2014 to 2015.

PARTICIPANTS/MATERIALS SETTING METHODS

Diagnosis of endometriosis was confirmed in medical records for 84.2% and by histology for 66.8% of participants. Questionnaires (the licensed Danish version of the EHP-30) were sent by post two times with a 6- to 12-week interval. CFA was used to examine construct validity and Bland-Altman plots to examine test-retest reliability and the convergent validity with the Short Form 36 version 2.

MAIN RESULTS AND THE ROLE OF CHANCE

Response rate was high (87.6%). CFA supported the original first-order five-factor structure of the EHP-30, and thereby, the use of five separate scale-scores in clinical and research practice. Visual inspection of Bland-Altman plots suggested excellent test-retest reliability of the EHP-30 and supported the use of a disease specific quality of life instrument for women with endometriosis.

LIMITATIONS REASONS FOR CAUTION

Diagnosis could not be confirmed through histology data in 33.2% of participants. However, subgroup analyses based on women with confirmed histology only, yielded similar results. Data related to menstrual cycle stage and the use of hormonal and pain medication during questionnaire completion were not collected. A larger study, including data from different countries on different continents, would be better designed to exclude potential population bias.

WIDER IMPLICATIONS OF THE FINDINGS

EHP-30, with its original five-factor structure, appears to be a valid, stable, and specific quality of life measure for women with endometriosis. It seems easy to understand, quick to administer, and importantly, scoring might be unaffected by cyclical/menstrual pain symptoms related to endometriosis. The finding of a five-factor model from different studies across several countries supports the crosscultural validity of the EHP-30.

STUDY FUNDING/COMPETING INTERESTS

This work was supported by the Danish Endometriosis Association, which is a nongovernmental organization run by women with endometriosis and by a scholarship from the Health Research Fund of Central Denmark Region. The authors have no conflicts of interest.

TRIAL REGISTRATION NUMBER

The Danish Data Protection Agency (J.nr: 2013-41-2264).

COVID-19 Peritraumatic Distress as a Function of Age and Gender in a Spanish Sample

The sudden outbreak of the COVID-19 pandemic has profoundly altered the daily lives of the population with dramatic effects caused not only by the health risks of the coronavirus, but also by its psychological and social impact in large sectors of the worldwide population. The present study adapted the COVID-19 Peritraumatic Distress Index (CPDI) to the Spanish population, and 1094 Spanish adults (mean age 52.55 years, 241 males) completed the Spanish version in a cross-sectional online survey. To analyze the factorial structure and reliability of the CPDI, we performed an exploratory factor analysis (EFA) followed by a confirmatory factor analysis (CFA) on the Spanish sample. The effects of gender and age on the degree of distress were analyzed using the factorial scores of the CPDI as the dependent variables. Results showed that, after rotation, the first factor (Stresssymptoms) accounted for 35% of the total variance and the second factor (COVID-19 information) for 15%. Around 25% (n = 279) of the participants experienced mild to moderate distress symptoms, 16% (n = 179) severe distress, and about 58% (n = 636) showed no distress symptoms. Women experienced more distress than men (p<0.01), and distress decreased with age (p<0.01). We conclude that the CPDI seems a promising screening tool for the rapid detection of potential peritraumatic stress caused by the COVID-19 pandemic.

The Place of the Bifactor Model in Confirmatory Factor Analysis Investigations Into Construct Dimensionality in Language Testing

For practical and theoretical purposes, tests of second language (L2) ability commonly aim to measure one overarching trait, general language ability, while simultaneously measuring multiple sub-traits (e.g., reading, grammar, etc.). This tension between measuring uni- and multi-dimensional constructs concurrently can generate vociferous debate about the precise nature of the construct(s) being measured. In L2 testing, this tension is often addressed through the use of a higher-order factor model wherein multidimensional traits representing subskills load on a general ability latent trait. However, an alternative modeling framework that is currently uncommon in language testing, but gaining traction in other disciplines, is the bifactor model. The bifactor model hypothesizes a general factor, onto which all items load, and a series of orthogonal (uncorrelated) skill-specific grouping factors. The model is particularly valuable for evaluating the empirical plausibility of subscales and the practical impact of dimensionality assumptions on test scores. This paper compares a range of CFA model structures with the bifactor model in terms of theoretical implications and practical considerations, framed for the language testing audience. The models are illustrated using primary data from the British Council’s Aptis English test. The paper is intended to spearhead the uptake of the bifactor model within the cadre of measurement models used in L2 language testing.

The Dimensionality of the 12-Item General Health Questionnaire (GHQ-12): Comparisons of Factor Structures and Invariance Across Samples and Time

Because of its brevity, the 12-item General Health Questionnaire (GHQ-12) has become one of the most popular and used measure for detecting psychological distress. Originally intended as a unidimensional measure, the majority of subsequent factor-analytic studies have failed to support GHQ-12 as a unitary construct and have instead proposed a plethora of multidimensional structures. In this study, we further examined the factor structure in two different military samples, one consisting of crewmembers from four different frigates deployed in anti-piracy operations and Standing NATO Maritime Group deployments (N = 591) and one consisting of crewmember from three different minehunters/sweepers serving in Standing NATO Mine Counter-Measures Group deployments (N = 196). Results from confirmatory factor analyses (CFA) performed in the first sample supported a bifactor model, consisting of a general factor representing communality among all items and two specific factors reflecting common variance due to wording effects (negatively and positively phrased items). A multi-group CFA further confirmed this structure to be invariant across our second sample. Structural equation modeling also showed that the general factor was strongly associated with symptoms of insomnia and mental health, whereas the specific factors were either non-significantly or considerably weaker associated with the criterion variables. Overall, our results are congruent with the notion that the multidimensionality demonstrated in many previous investigations is most likely an expression of method-specific variance caused by item wording. The explained unique variance associated with these specific factors was further relatively small. Ignoring the multidimensionality and treating GHQ-12 as a unitary construct will therefore most likely introduce minimal bias to most practical applications.

Factor structure and gender invariance of the Beck Depression Inventory - second edition (BDI-II) in a community-dwelling sample of adults

Objective: The main purpose of this study was to investigate the factor structure of the Beck Depression Inventory – Second Edition (BDI-II) in a sample of adults. Specifically, we evaluated the BDI-II based on confirmatory factor analysis of different measurement models, and compared the optimal factor structure of the BDI-II by gender using measurement invariance analysis.

Method: A cross-sectional survey with 717 community-dwelling adults was conducted. The Brazilian Portuguese version of the BDI-II was administered. Seven different models (one-, two-, three-factor models and their bifactor structures) were tested through CFA. CFA and multigroup analysis were executed with the software MPLUS (Weighted Least Squares Estimator – WLSMV).

Results: Four bifactor models reached acceptable fit indices. A bifactor model with two specific factors (Cognitive–Affective, and Somatic-Affective) provided the best fit to the data. The multigroup analysis of this model demonstrated invariance by gender.

Conclusions: Our findings support the use of the total BDI-II score to identify depressive symptoms, including gender comparisons. Since a bifactor structure fit the data better, the scores of the specific factors should not be used as the first choice, or at least should be used with caution. The analysis of the severity of depression, based on a total score, seems to be the most appropriate option.

Measuring Coping Among Family Members with Substance-Misusing Relatives: Testing Competing Factor Structures of the Coping Questionnaire (CQ) in England and Italy

Background: The Coping Questionnaire measures affected family members' responses to their relatives' substance misuse related problems. The Coping Questionnaire examines three main coping strategies: engaged, tolerant-inactive, and withdrawal coping. Objectives: The aim of the current study was to compare competing conceptual measurement models across two countries, including one-factor, three-factor, and higher order factor models. Methods: Secondary analysis of data from five previous studies was conducted. Samples of affected family members from England (N = 323) and Italy (N = 165) were aggregated into two country specific groups. Series of confirmatory factor analyses were performed to test the degree of model fit and the effects of socio-demographic variables on the coping factors. Results: A bifactor model fitted the data most closely relative to the one- and three-factor models. High rates of common variance (60-65%) were attributable to the general coping factor, while a high proportion of the variance related to the withdrawal coping subscale score was independent (66-89%) of the general coping factor. Family members' country, age, gender, the type of relationship and the main problematic substance had significant effects on the coping factors. Conclusions: A bifactor model related to coping behaviors is consistent with the theoretical assumptions of the general coping literature. The concept of a general coping factor also fits the theoretical assumptions of the stress-strain-coping-support model, with family members showing a general tendency to cope with the harmful circumstances which arise due to substance misuse.

Modeling Measurement as a Sequential Process: Autoregressive Confirmatory Factor Analysis (AR-CFA)

To model data from multi-item scales, many researchers default to a confirmatory factor analysis (CFA) approach that restricts cross-loadings and residual correlations to zero. This often leads to problems of measurement-model misfit while also ignoring theoretically relevant alternatives. Existing research mostly offers solutions by relaxing assumptions about cross-loadings and allowing residual correlations. However, such approaches are critiqued as being weak on theory and/or indicative of problematic measurement scales. We offer a theoretically-grounded alternative to modeling survey data called an autoregressive confirmatory factor analysis (AR-CFA), which is motivated by recognizing that responding to survey items is a sequential process that may create temporal dependencies among scale items. We compare an AR-CFA to other common approaches using a sample of 8,569 people measured along five common personality factors, showing how the AR-CFA can improve model fit and offer evidence of increased construct validity. We then introduce methods for testing AR-CFA hypotheses, including cross-level moderation effects using latent interactions among stable factors and time-varying residuals. We recommend considering the AR-CFA as a useful complement to other existing approaches and treat AR-CFA limitations.

Turkish Adaptation of the Positive-Negative Relationship Quality (PN-RQ) Scale: A Reliability and Validity Study

BACKGROUND

The present study investigates the reliability and validity of the Positive-Negative Relationship Quality (PN-RQ) scale in Turkey. This study aims to test different factorial models including orthogonal factors model, correlated factors model, one-factor model, and bifactor model.

METHODS

In order to determine the validity and reliability of the scale, two studies were performed. The first was carried out with emerging adults (university students) who were in a romantic relationship (148 females, 43 males, and 2 unknown) and had the main purpose to examine the structure validity of the measurement tool in the Turkish sample with an exploratory analysis. Study 2 was performed online with 513 married adults (359 females, 149 males, and 5 unknown); confirmatory findings and criterion validity studies were added.

RESULTS

Exploratory factor analyses revealed that relationship quality had a two-factor structure and that there was also a negative relationship between the factors. Confirmatory factor analyses on the married sample showed that the bi-factor model provided evidence for the multidimensional nature of the scale. Both studies demonstrated high internal consistency.

CONCLUSION

There is evidence for reliability and validity in the Turkish version of the PN-RQ scale to measure both positive and negative aspects of the relationship. The PN-RQ scale will be highly functional for social and clinical psychologists who work on close relationship issues in Turkey.

Confirmatory Factor Analysis of the Malay-Language Transtheoretical Model of Physical Activity among Malaysian Primary School Children

Introduction

The transtheoretical model (TTM) is an integrative model of intentional change consisting of stages of change, processes of change, decisional balance and self-efficacy. This study aimed at validating the TTM questionnaires on physical activity for Malaysian children using confirmatory factor analysis.

Methods

The participants were 381 Malay students (188 male; 193 female), aged 10–12 years old, with a mean age of 10.94 (SD = 0.81). The original version of the TTM was translated into the Malay language using forward and backward translation. Certain phrases were adapted based on the local culture and vocabulary suitable for primary school students.

Results

The final measurement models and their fit indices were: processes of change (CFI = 0.939, TLI = 0.925, SRMR = 0.040, RMSEA = 0.030); decisional balance (CFI = 0.897, TLI = 0.864, SRMR = 0.045, RMSEA = 0.038); and self-efficacy (CFI = 0.934, TLI = 0.915, SRMR = 0.042, RMSEA = 0.032).

Conclusion

Care must be taken when using the TTM with children, as it has been prevalently validated with adults. The final version of the TTM questionnaire for Malay primary school children had 24 items for process of changes, 13 items for self-efficacy and 10 items for decisional balance.

BaSIQS - basic scale on insomnia complaints and quality of sleep: reliability, norms, validity, and accuracy studies, based on clinical and community samples

This research focused on the Basic Scale on Insomnia Symptoms and Quality of Sleep (BaSIQS), formerly validated in undergraduates using the Pittsburgh Sleep Quality Index (PSQI), and aimed to expand internal consistency analysis, examine thoroughly its validity, and determine its clinical accuracy. Considering objective and subjective measures, recruiting non-clinical and clinical samples, this research implemented a comprehensive approach to examine convergent and discriminant validity, confirmatory factor analyses, and the BaSIQS sensitivity and specificity. The BaSIQS was filled out along with the Insomnia Severity Index (ISI), questions on sleep-wake schedules, Composite Scale of Morningness (CSM) and Brief Symptom Inventory-18 (BSI-18) by 1198 adults, 18-64 years old, plus another 30 who wore actimeters, recruited in community settings. A clinical group of 30 chronic insomnia disorder patients also participated. Cronbach alpha coefficient was 0.80. A two-factor structure was confirmed. The association between BaSIQS and ISI was large, whereas actigraphy correlations were medium or small. Medium to non-significant correlations were found concerning conceptually different self-report measures. Comparing the clinic and control groups, the former showed poorer sleep, with a large effect size. Receiver operating characteristic analysis revealed an area under curve = 0.9, and an optimal cut-off score >15. In conclusion, results on reliability, validity, and accuracy provide support to the utility of the BaSIQS both in community and clinical settings, for research and practical purposes.

A Framework of Industrialized Building Assessment in China Based on the Structural Equation Model

Compared with the conventional building, the industrialized building (IB) promotes the sustainable development of the construction industry, which will become a growth trend in the future. Nevertheless, the progress of industrialized building is intimately affected through the scientific evaluating mechanism, which still requires more research. Thus, this study establishes a conceptual framework of industrialized building assessment (IBA), which is validated through exploratory factor analysis (EFA) and confirmatory factor analysis (CFA). The impact between efficiency and the other five dimensions are studied by the structural equations model (SEM). The findings indicated that the conceptual framework is valid, and the efficiency has a positive impact on economic factors, livability, safety, environmental factors, and social benefits. Consequently, the improvement of efficiency has turned out to be the primary issue for improving the growth of the industrialized building. This research explores the basic framework of industrialized building assessment and provides a basis to establish a comprehensive and precise industrial building evaluation mechanism in the near future.

Social Risk Factors of Transportation PPP Projects in China: A Sustainable Development Perspective

Public-private partnerships (PPPs) have become increasingly important in improving the sustainability of society in China, with transportation being the largest investment area. However, the Social Risk Factors (SRFs) of transportation PPPs in China, which serve as a useful tool for distinguishing strengths and weaknesses for effective social risk management (SRM), have not been clearly identified. A conceptual model including 3 risk dimensions and 15 SRFs was proposed to mitigate social risks and improve the social sustainability of transportation PPP projects. A questionnaire survey conducted to investigate stakeholders’ opinions on the proposed SRFs demonstrated that all the SRFs were important. The SRFs can be used to evaluate social risks from economic, environmental, and social dimensions. Confirmatory factor analysis (CFA) verified the classification of the SRFs and indicated that all the risk dimensions contributed to social risks. The social and environmental impacts on social sustainability may contribute more to the generation of social risks. Furthermore, the concept of people-first PPPs was proposed to reduce social risks from the perspective of different stakeholders, with the interactions among different stakeholders being prioritized. The identified SRFs and their relationships can improve our understanding of SRM in the delivery of social sustainability and improve social resilience.

Validation and Reliability of the Korean Version of the Sport Anxiety Scale-2

The main purpose of the present study was to examine the validation and reliability of the Korean version of the Sport Anxiety Scale (SAS-2Kr) by evaluating its factorial invariance across gender. A total of 303 Korean collegiate athletes (198 males and 105 females) from 9 sports participated in the study, and they completed the demographic questionnaire and the SAS-2Kr containing 15 items to measure multidimensional trait anxiety and individual differences in the cognitive and somatic anxiety experienced by athletes. The results of this study indicated that the construct validity in the SAS-2Kr was well established in that the values of the standardized factor loadings, composite reliability, and average variance extracted values were above the recommended cutoff points. The multiple-sample confirmatory factor analyses showed the SAS-2Kr could be generalizable across gender in college samples. The results also indicated that the SAS-2Kr supported the original 3-factor model of SAS-2 in English consisting of somatic anxiety, worry, and concentration disruption, and thus this study provides useful information for researchers to understand the athletes’ tendency to experience anxiety reactions in sport situations. Suggestions for future research on competitive trait anxiety are provided in the discussion section.

Is adjustment disorder unidimensional or multidimensional? Implications for ICD-11

In preparation for ICD-11, the adjustment disorder (AjD) diagnosis has undergone considerable revisions; however, the latent structure of AjD remains uncertain. It is unclear whether AjD is best represented as a unidimensional or multidimensional construct. This study performed a comprehensive assessment of the latent structure of AjD symptomatology and assessed its concurrent and discriminant validity. Individuals who experienced involuntary job loss (N = 333) completed a self-report measure of AjD symptoms. Seven alternative models of AjD were tested using confirmatory factor analysis. General psychological distress, impairment in social functioning, occupational self-efficacy, and sense of coherence were used as criterion variables for construct validity. In the confirmatory factor analysis, a bifactor solution with one dominant general AjD factor and 5 correlated group factors (preoccupation, failure-to-adapt, avoidance, affective reaction, and impulsivity) provided optimal fit. As expected, the AjD factor showed strong positive associations with general psychological distress and impairments in social functioning and moderately negative associations with occupational self-efficacy and sense of coherence. With regard to unidimensionality or multidimensionality of AjD symptoms, the current results indicate the plausibility of a unidimensional conceptualization. Future research should focus on essential key characteristics and a reduction of symptoms for the AjD definition.

Psychometric properties and a latent class analysis of the 12-item World Health Organization Disability Assessment Schedule 2.0 (WHODAS 2.0) in a pooled dataset of community samples

The 12-item World Health Organization Disability Assessment Schedule 2.0 (WHODAS 2.0) is a brief measurement tool used cross-culturally to capture the multi-dimensional nature of disablement through six domains, including: understanding and interacting with the world; moving and getting around; self-care; getting on with people; life activities; and participation in society. Previous psychometric research supports that the WHODAS 2.0 functions as a general factor of disablement. In a pooled dataset from community samples of adults (N = 447) we used confirmatory factor analysis to confirm a one-factor structure. Latent class analysis was used to identify subgroups of individuals based on their patterns of responses. We identified four distinct classes, or patterns of disablement: (1) pervasive disability; (2) physical disability; (3) emotional, cognitive, or interpersonal disability; (4) no/low disability. Convergent validity of the latent class subgroups was found with respect to socio-demographic characteristics, number of days affected by disabilities, stress, mental health, and substance use. These classes offer a simple and meaningful way to classify people with disabilities based on the 12-item WHODAS 2.0. Focusing on individuals with a high probability of being in the first three classes may help guide interventions.

Psychometric Properties of the Lesbian, Gay, and Bisexual Identity Scale-Turkish (LGBIS-TR)

The aim of the current study was to examine the psychometric properties of the Lesbian, Gay, and Bisexual Identity Scale (LGBIS; Mohr & Kendra, 2011) in a Turkish sample. Three hundred and ten LGB individuals participated and completed the Turkish version of the LGBIS (LGBIS-TR) along with the Satisfaction with Life, Positive and Negative Affect, and Self-Compassion Scales. Confirmatory factor analysis results yielded a good-fit for eight subscales of the LGBIS-TR. We also obtained satisfactory criterion validity and internal consistency reliability. Based on this initial study, the LGBIS-TR appears to be a psychometrically sound instrument to gauge LGB individuals' identity experiences in Turkey. We discuss the results along with previous findings and limitations of the study, and we provide implications for further research and practice.

Exploration and confirmation of the latent variable structure of the Jefferson scale of empathy

OBJECTIVE

To reaffirm the underlying components of the JSE by using exploratory factor analysis (EFA), and to confirm its latent variable structure by using confirmatory factor analysis (CFA).

METHODS

Research participants included 2,612 medical students who entered Jefferson Medical College between 2002 and 2012. This sample was divided into two groups: Matriculants between 2002 and 2007 (n=1,380) and be-tween 2008 and 2012 (n=1,232). Data for 2002-2007 matriculants were subjected to EFA (principal component factor extraction), and data for matriculants of 2008-2012 were used for CFA (structural equation modeling, and root mean square error for approximation.

RESULTS

The EFA resulted in three factors: "perspective-taking," "compassionate care" and "walking in patient's shoes" replicating the 3-factor model reported in most of the previous studies. The CFA showed that the 3-factor model was an acceptable fit, thus confirming the latent variable structure emerged in the EFA. Corrected item-total score correlations for the total sample were all positive and statistically significant, ranging from 0.13 to 0.61 with a median of 0.44 (p=0.01). The item discrimination effect size indices (contrasting item mean scores for the top-third versus bottom-third JSE scorers) ranged from 0.50 to 1.4 indicating that the differences in item mean scores between top and bottom scorers on the JSE were of practical importance. Cronbach's alpha coefficient of the JSE for the total sample was 0.80, ranging from 0.75 to 0.84 for matriculatnts of different years.

CONCLUSIONS

Findings provided further support for under-lying constructs of the JSE, adding to its credibility.

Comparison of DSM-IV and DSM-5 factor structure models for toddlers with autism spectrum disorder

OBJECTIVE

The present study examined the factor structure of autism symptoms in toddlers, to aid understanding of the phenotype during the developmental period that represents the earliest manifestations of autism symptoms. This endeavor is particularly timely, given changes in symptom structure from the Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition (DSM-IV) to the recently released Fifth Edition (DSM-5).

METHOD

Factor structure was examined in a sample of toddlers between 12 and 30 months of age (mean = 20.37 months, SD = 3.32 months) diagnosed with autism spectrum disorder (ASD) and recruited from community settings or referred for evaluation (N = 237). Confirmatory factor analyses were conducted comparing the relative fit of 4 distinct, previously proposed and validated models: DSM-5, DSM-IV, 1-factor, and an alternative 3-factor model proposed by van Lang et al.

RESULTS

Findings revealed that the 1-factor model provided the poorest fit, followed by the DSM-IV model and the van Lang et al. model. The DSM-5 model provided the best fit to the data relative to other models and good absolute fit. Indicators for the confirmatory factor analyses, drawn from the Autism Diagnostic Observation Schedule-Toddler Module (ADOS-T), loaded strongly onto the DSM-5 Social Communication and Social Interaction factor and more variably onto the DSM-5 Restricted/Repetitive Language and Behavior factor.

CONCLUSIONS

Results indicate that autism symptoms in toddlers, as measured by the ADOS-T, are separable and best deconstructed into the 2-factor DSM-5 structure, supporting the reorganization of symptoms in the DSM-5. Consistency of the present results in toddlers with previous studies in older children and adults suggests that the structure of autism symptoms may be similar throughout development.