How Accurate Is Your Correlation? Different Methods Derive Different Results and Different Interpretations

When and how to use set-exploratory structural equation modelling to test structural models: A tutorial using the R package lavaan

Exploratory structural equation modelling (ESEM) is an alternative to the well-known method of confirmatory factor analysis (CFA). ESEM is mainly used to assess the quality of measurement models of common factors but can be efficiently extended to test structural models. However, ESEM may not be the best option in some model specifications, especially when structural models are involved, because the full flexibility of ESEM could result in technical difficulties in model estimation. Thus, set-ESEM was developed to accommodate the balance between full-ESEM and CFA. In the present paper, we show examples where set-ESEM should be used rather than full-ESEM. Rather than relying on a simulation study, we provide two applied examples using real data that are included in the OSF repository. Additionally, we provide the code needed to run set-ESEM in the free R package lavaan to make the paper practical. Set-ESEM structural models outperform their CFA-based counterparts in terms of goodness of fit and realistic factor correlation, and hence path coefficients in the two empirical examples. In several instances, effects that were non-significant (i.e., attenuated) in the CFA-based structural model become larger and significant in the set-ESEM structural model, suggesting that set-ESEM models may generate more accurate model parameters and, hence, lower Type II error rate.

Introducing the Basic Psychological Needs Frustration in Second Language Scale (BPNF-L2): Examining its factor structure and effect on L2 motivation and achievement

Research on the satisfaction of the basic psychological needs for autonomy, competence, and relatedness is well-established in second language (L2) research. However, little is known about the frustration of these basic psychological needs and how they can undermine intrinsic motivation and L2 achievement. Importantly, there is no valid scale of the frustration of the basic psychological needs in the L2 context. Accordingly, the present study introduces a new scale called the Basic Psychological Needs Frustration in Second Language (BPNF-L2) and assesses its factor structure and criterion-related validity through the application of bifactor exploratory structural equation modeling (bifactor ESEM). Our results showed that scores obtained on the BPNF-L2 scale are reliable and valid. Moreover, our results support the criterion-related validity of this factor structure by showing that the general factor of BPNF-L2 negatively explains intrinsic motivation and L2 achievement while the BPNF-L2 specific factors (i.e., autonomy, competence, and relatedness frustration) explain the outcomes differently. The results indicate that feeling frustrated because basic psychological needs are not met may hinder the enjoyment and acquisition of the L2. Educational implications, methodological advancements, and directions for future research are provided.

A cross-lagged panel analysis of second language achievement and enjoyment

Although self-perceived language proficiency has recently been found to influence foreign language enjoyment (FLE), rigorous assessment of the causal relationship between actual second language (L2) achievement and FLE has received relatively little attention. Based on control-value theory, this longitudinal study examined the causal antecedents of the relationship between the L2 achievement of 206 FL learners and their FLE from the perspective of dynamic systems theory and conducted a cross-lagged panel (CLP) analysis using Mplus 8.3 software. Both variables were measured two times over one academic year (10 months) in an English as a foreign language (EFL) course. The Wilcoxon signed-rank test showed significant changes in both variables over time. According to the CLP path model, L2 achievement at Time 1 (T1) appeared to affect subsequent FLE, while FLE at T1 failed to predict L2 achievement at Time 2 (T2). This study provides empirical evidence of the directional effect of L2 achievement on FLE regarding the hypothesized reciprocal effect of the two. Implications for stakeholders in the field of education are discussed.

Financial well-being: Capturing an elusive construct with an optimized measure

Several definitions and measures of financial well-being (FWB) have been proposed in the scientific literature. The Multidimensional Subjective Financial Well-being Scale (MSFWBS) stands out among these measures in its ability to account for the conceptual richness of FWB. However, the original validation study based on a confirmatory factor analytic model indicated that the factor structure of scores obtained on this instrument was acceptable at best, revealing factor correlations high enough to question the discriminant validity of the factors. To improve conceptual and operational clarity of FWB, this study assesses the psychometric properties of the MSFWBS among French-Canadian adults (n = 454), using statistical models better suited to the examination of multidimensional constructs (exploratory structural equation modeling—ESEM, and bifactor-ESEM). Our results supported a bifactor-ESEM representation of scores on the MSFWBS, and their measurement invariance across groups of participants defined on the basis of their age, sex, personal income and household income. Our results also supported the convergent (with other measures of FWB) and criterion-related (with measures of life satisfaction, perceived stress, and psychological distress) validity of scores obtained on the MSFWBS (particularly the global FWB factor). By providing an optimized measure of FWB, our study contributes to advancing research on FWB.