Differential Performance of Social Communication Questionnaire Items in African American/Black vs. White Children

Screening for autism spectrum disorder (ASD) is an essential early step in the identification process and inaccurate screening may lead to significant delays in the onset of treatment. Past research has highlighted discrepancies in the performance of ASD screening tools such as the Social Communication Questionnaire (SCQ) among certain racial and ethnic groups. The current study explored the functioning of the SCQ among African American/Black and White respondents based on item level performance on the measure. Differential Item Functioning (DIF) analyses showed that 16 (41%) items of the SCQ functioned differently for African American/Black respondents when compared to White respondents. Implications, such as the potential for delayed diagnosis and treatment, and the influence on downstream outcomes, are discussed.

Brief Report: An Evaluation of Item Bias on the Functional Activities Questionnaire

OBJECTIVE

To evaluate whether the Functional Activities Questionnaire (FAQ), a commonly used measure of functional status in neurodegenerative disease research, performs equivalently across demographically diverse subgroups of participants.

METHOD

The FAQs from 30,613 National Alzheimer's Coordinating Center participants were evaluated with a hybrid graded response model-logistic ordinal regression approach to determine the presence of differential item functioning (DIF) within five demographic groups: education, ethnicity, race, language, and sex.

RESULTS

Measurable DIF was observed for FAQ items in all groups; however, measures of effect size, latent trait distributions, and item characteristic curves suggested that the impact was minimal for research and practice.

CONCLUSIONS

The FAQ is able to provide minimally biased assessments of daily functioning across diverse participants, suggesting potential value for offsetting disparities in diagnosis and treatment.

Differential item functioning analysis on the Geriatric Depression Scale-15: An iterative hybrid ordinal logistic regression

The elderly population has extensively increased globally, so depression like a common problem in late life may convert to one of the economic, social, and health challenges of the 21st century. Due to the high cost of clinical diagnosis of depression, it is necessary to provide effective questionnaires like the 15-item Geriatric Depression Scale (GDS-15) for screening. But, the measurement invariance of GDS-15 is still unknown in the general population. In our study, 1473 participants of all Iran’s ethnic groups were asked to answer GDS-15 and demographic factors such as human settlements, employment, disease, marital status, age, gender, homebound, financial status, and ethnicity. Then, the lordif package in R 3.1.3 was used to assess differential item functioning (DIF) items that behave unevenly across demographic factors. Our findings reveal that women, homebound patients, poorer, and non-Persian mother tongue score classic psychological symptoms higher than peoples of the same depression score in other groups. Since, psychologists have to remove or replace these items before using this questionnaire for screening geriatric depression.

Explaining differential item functioning focusing on the crucial role of external information - an example from the measurement of adolescent mental health

Background

An overarching objective in research comparing different sample groups is to ensure that the reported differences in outcomes are not affected by differences between groups in the functioning of the measurement instruments, i.e. the items have to work in the same way for the different sample groups to be compared. Lack of invariance across sample groups are commonly called Differential Item Functioning (DIF).

There is a sense in which the DIF of an item can be taken account of by resolving (splitting) the item into group specific items, rather than deleting the item. Resolving improves fit, retains the reliability and content provided by the item, and compensates for the DIF in estimation of person parameters on the scale of the instrument. However, it destroys invariance of the item’s parameter value among the groups. Whether or not a DIF item should be resolved depends on whether the source of the DIF is relevant or irrelevant for the content of the variable. The present paper shows how external information can be used to investigate if the gender DIF found in the item “Stomach ache” in a psychosomatic symptoms scale used among adolescents may reflect abdominal pain because of a biological factor, the girls’ menstrual periods.

Methods

Swedish data from the international Health Behaviour in School-aged Children study (HBSC) collected in 2005/06, 2009/10 and 2013/14 were used, comprising a total of 18,983 students in grades 5, 7 and 9. A composite measure of eight items of psychosomatic problems was analysed for DIF with respect to gender and menstrual periods using the Rasch model.

Results

The results support the hypothesis that the source of the gender DIF for the item “Stomach ache” is a gender specific biological factor. In that case the DIF should be resolved if the psychosomatic measure is not intended to tap information about abdominal pain caused by a gender specific biological factor. In contrast, if the measure is intended to tap such information, the DIF should not be resolved.

Conclusions

The conceptualisation of the measure governs whether the item showing DIF should be resolved or not.

Age differences in DSM-IV borderline personality disorder symptom expression: Results from a national study using item response theory (IRT)

Limited literature suggests that there may be age-related differences in borderline personality disorder (BPD) symptom expression. The present study used item response theory (IRT) methods to examine whether there are age differences in the likelihood of endorsing DSM-IV symptoms of BPD, when equating for levels of BPD symptom severity. Data were drawn from a nationally representative survey of adults in the US (n = 34,653), the second wave of the National Epidemiologic Survey on Alcohol and Related Conditions (NESARC). We found that 7 out of the 9 DSM-IV symptoms of BPD were age invariant. However, there were statistically and clinically significant differences between the oldest and youngest age groups in two BPD symptoms: oldest adult women were less likely to report suicidal/self-harm behavior than the youngest adult women across levels of BPD severity and unstable/intense interpersonal relationships discriminated BPD severity better in the youngest age group compared to the oldest age group in both genders. Overall, our findings indicate substantial age-related differences in BPD symptom expression. Mental health care providers should be alert to these two age-related differences in BPD symptom expression when making assessment and treatment decisions across adult age groups.

Cross-cultural validation of the German and Turkish versions of the PHQ-9: an IRT approach

BACKGROUND

The Patient Health Questionnaire's depression module (PHQ-9) is a widely used screening tool to assess depressive disorders. However, cross-linguistic and cross-cultural validation of the PHQ-9 is mostly lacking. This study investigates whether scores on the German and Turkish versions of the PHQ-9 are comparable.

METHODS

Data from Germans without a migration background (German version, n = 1670) and Turkish immigrants in Germany (either German or Turkish version, n = 307) were used. Differential Item Functioning (DIF) was assessed using Item Response Theory (IRT) models.

RESULTS

Several items of the PHQ-9 were found to exhibit DIF related to language or ethnicity, e.g. 'sleep problems', 'appetite changes' and 'anhedonia'. However, PHQ-9 sum scores were found to be unbiased, i.e., DIF had no notable impact on scale levels.

CONCLUSIONS

PHQ-9 sum scores can be compared between Turkish immigrants and Germans without a migration background without any adjustments, regardless of whether they complete the German or the Turkish version.

Examining sex differences in DSM-IV-TR narcissistic personality disorder symptom expression using Item Response Theory (IRT)

The limited published literature on the subject suggests that there may be differences in how females and males experience narcissistic personality disorder (NPD) symptoms. The aim of this study was to use methods based on item response theory to examine whether, when equating for levels of NPD symptom severity, there are sex differences in the likelihood of reporting DSM-IV-TR NPD symptoms. We conducted these analyses using a large, nationally representative sample from the USA (n=34,653), the second wave of the National Epidemiologic Survey on Alcohol and Related Conditions (NESARC). There were statistically and clinically significant sex differences for 2 out of the 9 DSM-IV-TR NPD symptoms. We found that males were more likely to endorse the item 'lack of empathy' at lower levels of narcissistic personality disorder severity than females. The item 'being envious' was a better indicator of NPD severity in males than in females. There were no clinically significant sex differences on the remaining NPD symptoms. Overall, our findings indicate substantial sex differences in narcissistic personality disorder symptom expression. Although our results may reflect sex-bias in diagnostic criteria, they are consistent with recent views suggesting that narcissistic personality disorder may be underpinned by shared and sex-specific mechanisms.

Sex differences in DSM-IV posttraumatic stress disorder symptoms expression using item response theory: A population-based study

BACKGROUND

Whether there are systematic sex differences in posttraumatic stress disorder (PTSD) symptom expression remains debated. Using methods based on item response theory (IRT), we aimed at examining differences in the likelihood of reporting DSM-IV symptoms of PTSD between women and men, while stratifying for major trauma type and equating for PTSD severity.

METHOD

We compared data from women and men in a large nationally representative adult sample, the National Epidemiologic Survey on Alcohol and Related Conditions. Analyses were conducted in the full population sample of individuals who met the DSM-IV criterion A (n=23,860) and in subsamples according to trauma types.

RESULTS

The clinical presentation of the 17 DSM-IV PTSD symptoms in the general population did not substantially differ in women and men in the full population and by trauma type after equating for levels of PTSD severity. The only exception was the symptom "foreshortened future", which was more likely endorsed by men at equivalent levels of PTSD severity.

LIMITATIONS

The retrospective nature of the assessment of PTSD symptoms could have led to recall bias. Our sample size was too small to draw conclusions among individuals who experienced war-related traumas.

CONCLUSIONS

Our findings suggest that the clinical presentation of PTSD does not differ substantially between women and men. We also provide additional psychometric support to the exclusion of the symptom "foreshortened future" from the diagnostic criteria for PTSD in the DSM-5.

Positive Aspects of Family Caregiving for Dementia: Differential Item Functioning by Race

OBJECTIVES

Due to increasing interest in the positive experiences associated with family caregiving, potential demographic group differences were examined on the Positive Aspects of Caregiving (PAC) scale at both the item and scale levels.

METHOD

Family caregivers (N = 642) completed the PAC as part of their participation in the Resources for Enhancing Alzheimer's Caregiver Health (REACH II) clinical trial. Multiple indicators, multiple causes models were used to examine potential differential item functioning (DIF) across demographic subgroups.

RESULTS

Overall PAC scale scores indicated that both Hispanics and African Americans experienced more PAC than Whites. Two items with statistically significant (p < .004) and practically meaningful (odds ratio > 2.0) DIF were found for African American caregivers. After controlling for the underlying unidimensional construct, African Americans reported that caregiving gave them "a more positive attitude toward life" and enabled them to "appreciate life more" than either Whites or Hispanics. No instances of meaningful DIF were found between Hispanics and Whites, women and men, or spouses and nonspouses.

DISCUSSION

PAC scores differ significantly by race. In addition, 2 items with meaningful race DIF identify content areas that are particularly relevant to the cultural experiences of African American caregivers.

Urinary incontinence in spina bifida: Initial instrument validation

The purpose of this study was to perform a psychometric assessment of the Incontinence Symptom Index-Pediatric (ISI-P) in a cohort of adolescents with spina bifida (SB) and neuropathic urinary incontinence (UI) to test its validity and reliability. The ISI-P, an 11-item instrument with domains for symptom severity and impairment, was self-administered by subjects 11-17 years old with SB and UI. Controls were 11-17 years old, with nephrolithiasis and no history of UI. Formal psychometric assessment included an evaluation of internal consistency, test re-test reliability and factor analysis. Of 78 study-eligible subjects we attempted to contact, 33 (66.7% female) with a median age of 13.1 years completed the ISI-P (42.3% response rate). 21 control patients also completed the ISI-P. Cronbach's alpha was 0.936 and 0.792 for the severity and bother factors respectively. The delta Chi-square test for the two-factor (vs. one-factor) model was significantly [χ(2)(89) = 107.823, p < 0.05] in favor of the former model with descriptive fit indices being excellent (e.g., comparative fit index = 0.969). Furthermore, category information analysis showed that all categories were associated with different threshold values, namely that each category contributed unique information for the measurement of the latent trait. In conclusion, the ISI-P has desirable psychometric properties for the measurement of UI symptom severity and impairment in adolescents with SB.

A Multiple Indicators Multiple Causes (MIMIC) model of internal barriers to drug treatment in China

BACKGROUND

Although evidence exists for distinct barriers to drug abuse treatment (BDATs), investigations of their inter-relationships and the effect of individual characteristics on the barrier factors have been sparse, especially in China. A Multiple Indicators Multiple Causes (MIMIC) model is applied for this target.

METHODS

A sample of 262 drug users were recruited from three drug rehabilitation centers in Hunan Province, China. We applied a MIMIC approach to investigate the effect of gender, age, marital status, education, primary substance use, duration of primary drug use, and drug treatment experience on the internal barrier factors: absence of problem (AP), negative social support (NSS), fear of treatment (FT), and privacy concerns (PC).

RESULTS

Drug users of various characteristics were found to report different internal barrier factors. Younger participants were more likely to report NSS (-0.19, p=0.038) and PC (-0.31, p<0.001). Compared to other drug users, ice users were more likely to report AP (0.44, p<0.001) and NSS (0.25, p=0.010). Drug treatment experiences related to AP (0.20, p=0.012). In addition, differential item functioning (DIF) occurred in three items when participant from groups with different duration of drug use, ice use, or marital status.

CONCLUSIONS

Individual characteristics had significant effects on internal barriers to drug treatment. On this basis, BDAT perceived by different individuals could be assessed before tactics were utilized to successfully remove perceived barriers to drug treatment.

Examining sex differences in DSM-IV borderline personality disorder symptom expression using Item Response Theory (IRT)

Limited literature suggests that there may be differences in how women and men experience borderline personality disorder (BPD) symptoms. The aim of the current study was to use methods based on item response theory (IRT) to examine whether, when equating for levels of BPD symptom severity, there are sex differences in the likelihood of reporting DSM-IV BPD symptoms. We conducted these analyses using a large, nationally representative sample from the USA (n = 34,653), the second wave of the National Epidemiologic Survey on Alcohol and Related Conditions (NESARC). Data from women and men were compared. There were statistically and clinically significant sex differences for 3 out of the 9 DSM-IV BPD symptoms. We found that women were more likely to experience suicidal/self-mutilation behavior, affective instability and chronic feelings of emptiness and tended to be less likely to endorse impulsivity at lower levels of borderline personality disorder severity than men, while affective instability and chronic feelings of emptiness appeared to be significantly less discriminant in terms of severity in men than in women. There were no significant differences between women and men on the remaining DSM-IV symptoms. Overall, our findings indicate substantial sex differences in borderline personality disorder symptom expression. Although our results may reflect sex-bias in diagnostic criteria, they are in keeping with recent arguments suggesting that BPD could be understood as a clinical phenomenon that may partially differ in men and women.