Development and validation of an item response theory-based Social Responsiveness Scale short form

Psychometric exploration of the RAADS-R with autistic adults: Implications for research and clinical practice

LAY ABSTRACT

Surveys used to screen for autism are being used much more by adults. Adults and clinicians want to be confident that the results from their surveys are accurate. If scores are not accurate, it is not possible to compare the scores of different groups of individuals. There are also concerns that these surveys do not accurately identify autistic individuals. This study explored the accuracy of two commonly used autism screening surveys for adults: the RAADS-R and the RAADS-14. The accuracy of these two screening tools was measured using a sample of 839 adults. Adults in the study were in one of the following categories: (1) diagnosed with autism, (2) adults who considered themselves to be autistic but had not been diagnosed, (3) adults who were unsure whether they were autistic, and (4) adults who did not consider themselves to be autistic and had not been diagnosed. The study found that the RAADS-R and the RAADS-14 are accurate. The study also found that a person's age, gender, autism diagnosis, or whether an individual considered themselves to be autistic did not impact how they understood the survey. Survey accuracy could be improved by changing the number of question responses from four to two. Importantly, individuals with a clinical diagnosis of autism and those who considered themselves to be autistic responded to survey items in a very similar way. Individuals with autism diagnoses and those who were unsure whether they were autistic were more different in their responses. Four specific survey items related to sensory experiences and social interaction identified key differences between autistic and non-autistic adults.

Expanding the Neuropsychological Phenotype of KAT6B Disorders: Overlapping Features with KAT6A Syndrome

KAT6B and KAT6A belong to the MYST family of lysine acetyltransferases, and regulate gene expression via histone modification. Although both proteins share similar structure and epigenetic regulatory functions, it remains unclear if KAT6A/6B mutation disorders, both very rare conditions, yield the same neurocognitive presentation and thus benefit from similar treatment approaches. This study provides a preliminary overview of neuropsychological functioning of 13 individuals with KAT6B disorder (Mean age = 9.01 years, SD = 5.46), which was compared to that of a recently published sample of 15 individuals with KAT6A syndrome (Mean age = 10.32 years, SD = 4.12). Participants completed a neuropsychological test battery to assess non-verbal cognition, and caregivers completed a series of standardized rating inventories to assess daily behavioral functioning. Results reveal those with KAT6B disorders present with severe adaptive deficits (92.3%) and autism-related behaviors (83.3%), juxtaposed with relatively low concerns with externalizing behaviors (7.6%), a pattern shared by the KAT6A group. Those with KAT6B disorders present with high levels of autistic features, including reduced affiliative interest, whereas social motivation is less affected within the KAT6A group. Overall, the levels of impairment in nonverbal cognition and receptive language were comparable among those with KAT6B disorders, a trend also seen in the KAT6A group. In brief, KAT6B and KAT6A disorders yield analogous neuropsychological profiles. Findings implicate common molecular pathophysiological mechanisms for these epigenetic disorders, such that similar therapies may have shared effect across diseases.

Performance of the Social Responsiveness Scale-2 for the Assessment of Autistic Behaviors in a Sample of Canadian Preschool-Aged Children

Behavioral traits of autism spectrum disorder (ASD) typically present in early childhood, underscoring the importance of screening tools for the early identification of ASD. The current study compared scores on the Social Responsiveness Scale-Second Edition (SRS-2) Preschool Form between the US standardization sample (n = 247) and a Canadian cohort of preschool-aged children (n = 595) recruited from the Maternal-Infant Research on Environmental Chemicals (MIREC) study. In the MIREC sample, we examined whether ASD-like traits are correlated with sociodemographic characteristics and child intellectual abilities, and how maternal ratings of social skills assessed by the SRS-2 are associated with maternal ratings of general problem behaviors. Mean total SRS-2 raw score was significantly lower in the MIREC sample (mean = 29.7, SD = 15.8) compared to the US standardization sample (mean = 41.9, SD = 26.0). Total raw score in the US standardization sample did not significantly differ between males (mean = 40.6, SD = 23.1) and females (mean = 42.8, SD = 28.7), whereas in the MIREC sample the total raw score was significantly higher among males (mean = 33.0, SD = 17.1) than females (mean = 26.6, SD = 13.9). A significantly larger proportion of the MIREC sample was White, younger in age, and had more educated parents compared to the US standardization sample. ASD-like traits were correlated with lower intellectual abilities, a less enriched home environment, more behavioral problems, and poorer adaptive skills. SRS-2 Preschool Form scores were significantly lower in the Canadian sample compared to the US standardization sample, which may reflect demographic differences between the two groups. Girls may be under-identified when SRS-2 Preschool Form norms are used for screening ASD.

Are autistic traits associated with a social-emotional memory bias?

Autistic traits are associated with differential processing of emotional and social cues. By contrast little is known about the relationship of autistic traits to socio-emotional memory, though research suggests an integral relationship between episodic memory processes and psychosocial well-being. Using an experimental paradigm, we tested if autistic traits moderate the effects of negative emotion and social cues on episodic memory (i.e. memory for past events). Young adults (N = 706) with varied levels of self-reported autistic traits (24% in clinical range) encoded images stratified by emotion (negative, neutral) and social cues (social, non-social) alongside a neutral object. After 24 h, item memory for images and associative memory for objects was tested. For item memory, after controlling for anxiety, a small effect emerged whereby a memory-enhancing effect of social cues was reduced as autistic traits increased. For associative memory, memory for pairings between neutral, but not negative, images reduced as autistic traits increased. Results suggest autistic traits are associated with reduced ability to bind neutral items together in memory, potentially impeding nuanced appraisals of past experience. This bias toward more negative, less nuanced memories of past experience may represent a cognitive vulnerability to social and mental health challenges commonly associated with autistic traits and a potential intervention target.

Wald χ2 Test for Differential Item Functioning Detection with Polytomous Items in Multilevel Data

Identifying items with differential item functioning (DIF) in an assessment is a crucial step for achieving equitable measurement. One critical issue that has not been fully addressed with existing studies is how DIF items can be detected when data are multilevel. In the present study, we introduced a Lord's Wald χ 2 test-based procedure for detecting both uniform and non-uniform DIF with polytomous items in the presence of the ubiquitous multilevel data structure. The proposed approach is a multilevel extension of a two-stage procedure, which identifies anchor items in its first stage and formally evaluates candidate items in the second stage. We applied the Metropolis-Hastings Robbins-Monro (MH-RM) algorithm to estimate multilevel polytomous item response theory (IRT) models and to obtain accurate covariance matrices. To evaluate the performance of the proposed approach, we conducted a preliminary simulation study that considered various conditions to mimic real-world scenarios. The simulation results indicated that the proposed approach has great power for identifying DIF items and well controls the Type I error rate. Limitations and future research directions were also discussed.

Developmental characteristics and accuracy of autism screening among two-year-old toddlers in the ECHO program

BACKGROUND

The Modified Checklist for Autism in Toddlers (M-CHAT) is a common pediatric screening tool with mixed accuracy findings. Prior evidence supports M-CHAT screening for developmental concerns, especially in toddlers born preterm. This study examined M-CHAT accuracy in a large, nationwide sample.

METHODS

3393 participants from the Environmental influences on Child Health Outcomes (ECHO) program were included. Harmonized M-CHAT (M-CHAT-H) results were compared with parent-reported autism diagnosis and autism-related characteristics to assess accuracy for term and preterm children, together and separately. Generalized estimating equations, clustering for ECHO cohort and controlling for demographic covariates, were used to examine associations between developmental and behavioral characteristics with M-CHAT-H accuracy.

RESULTS

Sensitivity of the M-CHAT-H ranged from 36 to 60%; specificity ranged from 88 to 99%. Positive M-CHAT-H was associated with more developmental delays and behavior problems. Children with severe motor delays and more autism-related problems were more likely to have a false-negative M-CHAT-H. Children with fewer behavior problems and fewer autism-related concerns were more likely to have a false-positive screen.

CONCLUSION

The M-CHAT-H accurately detects children at low risk for autism and children at increased risk with moderate accuracy. These findings support use of the M-CHAT-H in assessing autism risk and developmental and behavioral concerns in children.

IMPACT

Previous literature regarding accuracy of the Modified Checklist for Autism in Toddlers (M-CHAT) is mixed but this study provides evidence that the M-CHAT performs well in detecting children at low risk for autism and consistently detects children with developmental delays and behavioral problems. The M-CHAT moderately detects children at increased risk for autism and remains a useful screening tool. This study examines M-CHAT accuracy in a large-scale, nationwide sample, examining associations between screening accuracy and developmental outcomes. These findings impact pediatric screening for autism, supporting continued use of the M-CHAT while further elucidating the factors associated with inaccurate screens.

Temporal progression of pupil dilation and gaze behavior to emotion expressions in preschoolers with autism spectrum disorder

Previous work has shown divergent pupil dilation (PD) and gaze behavior in individuals with autism spectrum disorder (ASD), which may relate to the development of social difficulties in early life. Here, we investigated temporal dynamics of both phenotypes during naturalistic videos of a person displaying facial emotion expressions in 61 autistic and 61 non-autistic preschoolers. PD was segmented into three serial time components derived from a principal component analysis. Growth curve analysis was applied to analyze changes in looking time on eye and mouth regions over time. Groups did not differ in PD time components. Growth curve analysis revealed initially shorter looking times on the eyes and longer looking times on the mouth in autistic versus non-autistic preschoolers. However, a reversion of this pattern was observed over time, suggesting a delayed compensatory increase in eye attention during prolonged viewing periods in autistic children. Positive and negative associations of PD components and gaze behavior over time indicated a dynamic temporal relationship during emotion viewing. Our findings emphasize the need to apply time-sensitive measures in ecologically valid research, which may index etiological mechanisms of social difficulties in ASD.

Measurement matters: A commentary on the state of the science on patient reported outcome measures (PROMs) in autism research

High quality science relies upon psychometrically valid and reliable measurement, yet very few Patient Reported Outcome Measures (PROMs) have been developed or thoroughly validated for use with autistic individuals. The present commentary summarizes the current state of autism PROM science, based on discussion at the Special Interest Group (SIG) at the 2022 International Society for Autism Research (INSAR) Annual Meeting and collective expertise of the authors. First, we identify current issues in autism PROM research including content and construct operationalization, informant-structure, measure accessibility, and measure validation and generalization. We then enumerate barriers to conducting and disseminating this research, such as a lack of guidance, concerns regarding funding and time, lack of accessible training and professionals with psychometric skills, difficulties collecting large representative samples, and challenges with dissemination. Lastly, we offer future priorities and resources to improve PROMs in autism research including a need to continue to evaluate and develop PROMs for autistic people using robust methods, to prioritize diverse and representative samples, to expand the breadth of psychometric properties and techniques, and to consider developing field specific guidelines. We remain extremely optimistic about the future directions of this area of autism research. This work is well positioned to have an immense, positive impact on our scientific understanding of autism and the everyday lives of autistic people and their families.

Intellectual disability and autism in propionic acidemia: a biomarker-behavioral investigation implicating dysregulated mitochondrial biology

Propionic acidemia (PA) is an autosomal recessive condition (OMIM #606054), wherein pathogenic variants in PCCA and PCCB impair the activity of propionyl-CoA carboxylase. PA is associated with neurodevelopmental disorders, including intellectual disability (ID) and autism spectrum disorder (ASD); however, the correlates and mechanisms of these outcomes remain unknown. Using data from a subset of participants with PA enrolled in a dedicated natural history study (n = 33), we explored associations between neurodevelopmental phenotypes and laboratory parameters. Twenty (61%) participants received an ID diagnosis, and 12 of the 31 (39%) who were fully evaluated received the diagnosis of ASD. A diagnosis of ID, lower full-scale IQ (sample mean = 65 ± 26), and lower adaptive behavior composite scores (sample mean = 67 ± 23) were associated with several biomarkers. Higher concentrations of plasma propionylcarnitine, plasma total 2-methylcitrate, serum erythropoietin, and mitochondrial biomarkers plasma FGF21 and GDF15 were associated with a more severe ID profile. Reduced 1-13C-propionate oxidative capacity and decreased levels of plasma and urinary glutamine were also associated with a more severe ID profile. Only two parameters, increased serum erythropoietin and decreased plasma glutamine, were associated with ASD. Plasma glycine, one of the defining features of PA, was not meaningfully associated with either ID or ASD. Thus, while both ID and ASD were commonly observed in our PA cohort, only ID was robustly associated with metabolic parameters. Our results suggest that disease severity and associated mitochondrial dysfunction may play a role in CNS complications of PA and identify potential biomarkers and candidate surrogate endpoints.

Evaluating the sensitivity to threat and affiliative reward (STAR) model in relation to the development of conduct problems and callous-unemotional traits across early adolescence

BACKGROUND

The Sensitivity to Threat and Affiliative Reward (STAR) model proposes low threat sensitivity and low affiliation as risk factors for callous-unemotional (CU) traits. Preliminary evidence for the STAR model comes from work in early childhood. However, studies are needed that explore the STAR dimensions in late childhood and adolescence when severe conduct problems (CP) emerge. Moreover, it is unclear how variability across the full spectrum of threat sensitivity and affiliation gives rise to different forms of psychopathology beyond CU traits.

METHODS

The current study addressed these gaps using parent- and child-reported data from three waves and a sub-study of the Adolescent Brain Cognitive Development Study® of 11,878 youth (48% female; ages 9-12).

RESULTS

Consistent with the STAR model, low threat sensitivity and low affiliation were independently related to CU traits across informants and time. Moreover, there was significant interaction between the STAR dimensions, such that children with lower sensitivity to threat and lower affiliation had higher parent-reported CU traits. Unlike CU traits, children with higher threat sensitivity had higher parent-reported CP and anxiety. Finally, children with lower affiliation had higher parent-reported CP, anxiety, and depression. Results largely replicated across informants and time, and sensitivity analysis revealed similar findings in children with and without DSM-5 defined CP.

CONCLUSIONS

Results support the STAR model hypotheses as they pertain to CU traits and delineate threat sensitivity and affiliation as independent transdiagnostic risk factors for different types of psychopathology. Future research is needed to develop fuller and more reliable and valid measures of affiliation and threat sensitivity across multiple assessment modalities.

Arterial Health Markers in Relation to Behavior and Cognitive Outcomes at School Age

BACKGROUND

Impaired arterial health is associated with a decline in cognitive function and psychopathology in adults. We hypothesized that these associations originate in early life. We examined the associations of blood pressure, common carotid artery intima media thickness, and carotid distensibility with behavior and cognitive outcomes during adolescence.

METHODS AND RESULTS

This study was embedded in the Dutch Generation R Study, a population-based prospective cohort study from early fetal life onwards. Blood pressure, carotid intima media thickness, and carotid distensibility were measured at the age of 10 years. At the age of 13 years, total, internalizing and externalizing problems and attention-deficit hyperactivity disorder symptoms were measured using the parent-reported Child Behavior Checklist (CBCL/6-18), autistic traits were assessed by the Social Responsiveness Scale, and IQ was assessed using the Wechsler Intelligence Scale for Children-Fifth Edition. A 1-SD score higher mean arterial pressure was associated with lower odds of internalizing problems (odds ratio [OR], 0.92 [95% CI, 0.85-0.99]). However, this association was nonsignificant after correction for multiple testing. Carotid intima media thickness and carotid distensibility were not associated with behavior and cognitive outcomes at 13 years old.

CONCLUSIONS

From our results, we cannot conclude that the associations of blood pressure, carotid intima media thickness, and carotid distensibility at age 10 years with behavior and cognitive outcomes are present in early adolescence. Further follow-up studies are needed to identify the critical ages for arterial health in relation to behavior and cognitive outcomes at older ages.

The Toronto Adolescent and Youth Cohort Study: Study Design and Early Data Related to Psychosis Spectrum Symptoms, Functioning, and Suicidality

BACKGROUND

Psychosis spectrum symptoms (PSSs) occur in a sizable percentage of youth and are associated with poorer cognitive performance, poorer functioning, and suicidality (i.e., suicidal thoughts and behaviors). PSSs may occur more frequently in youths already experiencing another mental illness, but the antecedents are not well known. The Toronto Adolescent and Youth (TAY) Cohort Study aims to characterize developmental trajectories in youths with mental illness and understand associations with PSSs, functioning, and suicidality.

METHODS

The TAY Cohort Study is a longitudinal cohort study that aims to assess 1500 youths (age 11-24 years) presenting to tertiary care. In this article, we describe the extensive diagnostic and clinical characterization of psychopathology, substance use, functioning, suicidality, and health service utilization in these youths, with follow-up every 6 months over 5 years, including early baseline data.

RESULTS

A total of 417 participants were enrolled between May 4, 2021, and February 2, 2023. Participants met diagnostic criteria for an average of 3.5 psychiatric diagnoses, most frequently anxiety and depressive disorders. Forty-nine percent of participants met a pre-established threshold for PSSs and exhibited higher rates of functional impairment, internalizing and externalizing symptoms, and suicidality than participants without PSSs.

CONCLUSIONS

Initial findings from the TAY Cohort Study demonstrate the feasibility of extensive clinical phenotyping in youths who are seeking help for mental health problems. PSS prevalence is much higher than in community-based studies. Our early data support the critical need to better understand longitudinal trajectories of clinical youth cohorts in relation to psychosis risk, functioning, and suicidality.

Divergent electroencephalogram resting-state functional network alterations in subgroups of autism spectrum disorder: a symptom-based clustering analysis

Autism spectrum disorder (ASD) is characterized by etiological and phenotypic heterogeneity. Despite efforts to categorize ASD into subtypes, research on specific functional connectivity changes within ASD subgroups based on clinical presentations is limited. This study proposed a symptom-based clustering approach to identify subgroups of ASD based on multiple clinical rating scales and investigate their distinct Electroencephalogram (EEG) functional connectivity patterns. Eyes-opened resting-state EEG data were collected from 72 children with ASD and 63 typically developing (TD) children. A data-driven clustering approach based on Social Responsiveness Scales-Second Edition and Vinland-3 scores was used to identify subgroups. EEG functional connectivity and topological characteristics in four frequency bands were assessed. Two subgroups were identified: mild ASD (mASD, n = 37) and severe ASD (sASD, n = 35). Compared to TD, mASD showed increased functional connectivity in the beta band, while sASD exhibited decreased connectivity in the alpha band. Significant between-group differences in global and regional topological abnormalities were found in both alpha and beta bands. The proposed symptom-based clustering approach revealed the divergent functional connectivity patterns in the ASD subgroups that was not observed in typical ASD studies. Our study thus provides a new perspective to address the heterogeneity in ASD research.

Infant massage as a stress management technique for parents of hospitalized extremely preterm infants

Mothers of infants born extremely preterm requiring prolonged medical intervention in the Neonatal Intensive Care Unit (NICU) are at high risk of developing stress. Parent-administered infant massage is a well-established, safe intervention for preterm infants with many developmental benefits, but the published literature has mostly examined its impact on infants and parents through self-reported or observational measures of stress. The aim of this study was to measure salivary cortisol, a biomarker for stress, in extremely preterm infants and their mothers immediately pre and post parent-administered infant massage in order to detect potential changes in physiologic stress. Twenty-two mother-infant dyads completed massage education with a physical or occupational therapist. All dyads provided salivary cortisol samples via buccal swab immediately pre- and post-massage at the second session. Of mothers determined to be "cortisol responders" (15/22), salivary cortisol levels were lower after massage (pre-minus post-level: -26.47 ng/dL, [CI = -4.40, -48.53], p = .016, paired t-test). Our primary findings include a clinically significant decrease (as measured by percent change) in maternal cortisol levels immediately post parent-administered massage, indicating decreased physiological stress. Integration of infant massage into NICU clinical practice may support maternal mental health, but further powered studies are necessary to confirm findings.

An Examination of Family Transmission of Traits Measured by the Social Responsiveness Scale-Short Form

PURPOSE

The Social Responsiveness Scale (SRS) is frequently used in research settings to measure characteristics associated with autism spectrum disorders (ASD). A short version has been developed but not yet tested for certain properties of the full SRS, such as familiality. The purpose of this study was to determine if prior familiality findings for the full SRS can be replicated using the short form by measuring the associations of the parental Social Responsiveness Scale-Short Form (SRS-SF) scores with child ASD diagnoses and child SRS-SF scores.

METHODS

We used a nested case-control study within a longitudinal cohort study design. Participants were selected from the Nurses' Health Study II (NHS II). Cases were children of study participants who had been diagnosed with ASD, while controls had not been diagnosed with ASD and were frequency matched by year of birth to cases. 2144 out of 3161 eligible participants returned SRS forms for a child and at least one parent. Participants in NHS II completed SRS forms for their spouses and spouses completed SRS forms for NHS II participants. Parental SRS-SF scores were based on a subset of 16 questions from the SRS. ASD diagnosis among children was reported by the mothers and validated in a subset using the Autism Diagnostic Interview-Revised, as well as child SRS-SF scores.

RESULTS

Children whose parents both had elevated SRS-SF scores (those in the top 20% of the study distribution) had a higher odds of ASD diagnosis than those who did not have elevated parental scores (OR 2.25; 95% CI 1.41, 3.58). Additionally, children whose fathers had elevated SRS-SF scores had a higher odds of ASD diagnosis (OR 2.18; 95% CI 1.60, 2.97) than those whose fathers scores were not elevated. In sex-stratified analyses, male children with elevated parental SRS-SF scores had a higher odds of ASD diagnosis than those who did not have elevated parental scores. These associations were not as evident among female children. Parental SRS-SF scores also predicted child SRS-SF scores among controls.

CONCLUSION

These findings are similar to prior findings for the full SRS and support the ability of the SRS-SF to capture familiality of ASD-related traits.

Examining the latent structure and correlates of sensory reactivity in autism: a multi-site integrative data analysis by the autism sensory research consortium

BACKGROUND

Differences in responding to sensory stimuli, including sensory hyperreactivity (HYPER), hyporeactivity (HYPO), and sensory seeking (SEEK) have been observed in autistic individuals across sensory modalities, but few studies have examined the structure of these "supra-modal" traits in the autistic population.

METHODS

Leveraging a combined sample of 3868 autistic youth drawn from 12 distinct data sources (ages 3-18 years and representing the full range of cognitive ability), the current study used modern psychometric and meta-analytic techniques to interrogate the latent structure and correlates of caregiver-reported HYPER, HYPO, and SEEK within and across sensory modalities. Bifactor statistical indices were used to both evaluate the strength of a "general response pattern" factor for each supra-modal construct and determine the added value of "modality-specific response pattern" scores (e.g., Visual HYPER). Bayesian random-effects integrative data analysis models were used to examine the clinical and demographic correlates of all interpretable HYPER, HYPO, and SEEK (sub)constructs.

RESULTS

All modality-specific HYPER subconstructs could be reliably and validly measured, whereas certain modality-specific HYPO and SEEK subconstructs were psychometrically inadequate when measured using existing items. Bifactor analyses supported the validity of a supra-modal HYPER construct (ωH = .800) but not a supra-modal HYPO construct (ωH = .653), and supra-modal SEEK models suggested a more limited version of the construct that excluded some sensory modalities (ωH = .800; 4/7 modalities). Modality-specific subscales demonstrated significant added value for all response patterns. Meta-analytic correlations varied by construct, although sensory features tended to correlate most with other domains of core autism features and co-occurring psychiatric symptoms (with general HYPER and speech HYPO demonstrating the largest numbers of practically significant correlations).

LIMITATIONS

Conclusions may not be generalizable beyond the specific pool of items used in the current study, which was limited to caregiver report of observable behaviors and excluded multisensory items that reflect many "real-world" sensory experiences.

CONCLUSION

Of the three sensory response patterns, only HYPER demonstrated sufficient evidence for valid interpretation at the supra-modal level, whereas supra-modal HYPO/SEEK constructs demonstrated substantial psychometric limitations. For clinicians and researchers seeking to characterize sensory reactivity in autism, modality-specific response pattern scores may represent viable alternatives that overcome many of these limitations.

Modifying the social responsiveness scale for adaptive administration

PURPOSE

The social responsiveness scale (SRS) is frequently used to quantify the autism-related phenotype and is gaining use in health outcomes research. However, it has a high respondent burden (65 items) for large-scale studies. Further, most evaluations of it have focused on the school-age form, not the preschool form. More validity evidence of shortened forms is necessary in the general population to support the broader health outcomes context of use.

METHODS

We evaluated the psychometrics of the SRS in 7030 individuals from multiple predominantly neurotypical samples in order to shorten it based on non-autistic sample metrics. Analyses included item factor analysis, differential item functioning (DIF), and multiple-group item response theory (IRT) to place the SRS items on a comparable scale, which was then simulated via computer adaptive testing (CAT) administration.

RESULTS

The SRS was broadly unidimensional with few methodological residual dependencies. On average, males had more autistic characteristics than females, and preschoolers had fewer characteristics than school-age children. The final IRT calibration included 45 items equated across forms, and each form had 11 with significant wording discrepancies and 9 items with near-identical wording that exhibited form-related DIF. The CAT simulation suggested a median of 14 items was sufficient to reach a reliable score, demonstrating its feasibility across the range of impairments.

CONCLUSION

IRT allows practitioners the ability to get highly reliable scores with fewer items than the full-length SRS. This supports the future application of the SRS in a computer adaptive testing mode in both neurotypical and ASD samples.

A Comparative Analysis of the Full and Short Versions of the Social Responsiveness Scale in Estimating an Established Autism Risk Factor Association in ECHO: Do we Get the Same Estimates?

PURPOSE

Prior work developed a shortened 16-item version of the Social Responsiveness Scale (SRS), a quantitative measure of social communication and autism spectrum disorder (ASD)-related traits. However, its properties for use in risk factor estimation have not been fully tested compared to the full SRS. We compared the associations between gestational age (previously established risk factor for ASD) and the 65-item "full" and 16-item "short" versions of the SRS to test the shortened version's ability to capture associations in epidemiologic analyses of ASD risk factors.

METHODS

We used data from participants in the Environmental influences on Child Health Outcomes (ECHO) Program (n = 2,760). SRS scores were collected via maternal/caregiver report when children were aged 2.5-18 years. We compared estimates of associations between gestational age and preterm birth between the full and short SRS using multivariable linear regression, quantile regression, and prediction methods.

RESULTS

Overall, associations based on full and short SRS scores were highly comparable. For example, we observed positive associations between preterm birth with both full ([Formula: see text]=2.8; 95% CI [1.7, 4.0]) and short ([Formula: see text]=2.9; 95% CI [1.6, 4.3]) SRS scores. Quantile regression analyses indicated similar direction and magnitude of associations across the distribution of SRS scores between gestational age with both short and full SRS scores.

CONCLUSION

The comparability in estimates obtained for full and short SRS scores with an "established" ASD risk factor suggests ability of the shortened SRS in assessing associations with potential ASD-related risk factors and has implications for large-scale research studies seeking to reduce participant burden.

Examining the Latent Structure and Correlates of Sensory Reactivity in Autism: A Multi-site Integrative Data Analysis by the Autism Sensory Research Consortium

Background Differences in responding to sensory stimuli, including sensory hyperreactivity (HYPER), hyporeactivity (HYPO), and sensory seeking (SEEK) have been observed in autistic individuals across sensory modalities, but few studies have examined the structure of these "supra-modal" traits in the autistic population. Methods Leveraging a combined sample of 3,868 autistic youth drawn from 12 distinct data sources (ages 3-18 years and representing the full range of cognitive ability), the current study used modern psychometric and meta-analytic techniques to interrogate the latent structure and correlates of caregiver-reported HYPER, HYPO, and SEEK within and across sensory modalities. Bifactor statistical indices were used to both evaluate the strength of a "general response pattern" factor for each supra-modal construct and determine the added value of "modality-specific response pattern" scores (e.g., Visual HYPER). Bayesian random-effects integrative data analysis models were used to examine the clinical and demographic correlates of all interpretable HYPER, HYPO and SEEK (sub)constructs. Results All modality-specific HYPER subconstructs could be reliably and validly measured, whereas certain modality-specific HYPO and SEEK subconstructs were psychometrically inadequate when measured using existing items. Bifactor analyses unambiguously supported the validity of a supra-modal HYPER construct (ω H  = .800), whereas a coherent supra-modal HYPO construct was not supported (ω H  = .611), and supra-modal SEEK models suggested a more limited version of the construct that excluded some sensory modalities (ω H  = .799; 4/7 modalities). Within each sensory construct, modality-specific subscales demonstrated substantial added value beyond the supra-modal score. Meta-analytic correlations varied by construct, although sensory features tended to correlate most strongly with other domains of core autism features and co-occurring psychiatric symptoms. Certain subconstructs within the HYPO and SEEK domains were also associated with lower adaptive behavior scores. Limitations: Conclusions may not be generalizable beyond the specific pool of items used in the current study, which was limited to parent-report of observable behaviors and excluded multisensory items that reflect many "real-world" sensory experiences. Conclusion Psychometric issues may limit the degree to which some measures of supra-modal HYPO/SEEK can be interpreted. Depending on the research question at hand, modality-specific response pattern scores may represent a valid alternative method of characterizing sensory reactivity in autism.

Investigating and comparing the psychometric properties of the Chinese Mandarin version of social responsiveness scale-2 and its shortened version in preschool-age children with autism spectrum disorder

We aimed to investigate and compare the psychometric properties of the Chinese Mandarin Social Responsiveness Scale-2 (SRS-2) and its shortened version. The study assessed 670 children with autism spectrum disorder (ASD) aged 30-54 months and 138 typical developmental (TD) children of the same age in mainland China. Our item reliability test revealed that only 36 items of the 65 items in the Chinese Mandarin SRS-2 (Preschool) met the reliability criteria. Moreover, the shortened version of SRS-2 (Preschool) with four subscales and 30 items maintained strong correlations (r = 0.961) with the Chinese Mandarin SRS-2 (Preschool), and demonstrated improved psychometric performance on the 4-week test-retest reliability (intraclass correlations was 0.70), internal consistency (Cronbach's alpha 0.71-0.91), construct validity, and convergent validity with the Autism Diagnostic Observation Schedule, Autism Diagnostic Interview-Revised, and Child Behavior Checklist. Receiver operating characteristics (ROC) analyses showed excellent and comparable discriminant validity of the shortened version with an area under the curve of 0.992. Our data suggested a cutoff ≥ 22.5 for the shortened version, with good accuracy in screening autism symptoms (sensitivity=96.9 %, specificity=94.2 %). Our findings demonstrated that the shortened version of SRS-2 (Preschool) was a reliable and valid instrument for identifying preschoolers with ASD in mainland China.

The effect of perceptual expectation on processing gain, attention and the perceptual decision bias in children and adolescents with Autism Spectrum Disorder (ASD)

Perceptual expectations influence perception, attention and the perceptual decision bias during visuospatial orienting, which is impaired in individuals with Autism Spectrum Disorder (ASD). In this study, we investigated whether during visuospatial orienting, perceptual expectations in ASD differentially influence perception, attention and the perceptual decision bias relative to neurotypical controls (NT). Twenty-three children and adolescents with ASD and 23 NT completed a visuospatial orienting task, which compared the effect of a valid relative to an invalid perceptual expectation on target detection (cue validity effect). Group differences were calculated regarding the cue validity effect on neural correlates of processing gain (N1a amplitude) and attention (N1pc amplitude), the perceptual decision bias and mean reaction time (RT). In ASD relative to NT, findings showed a reduced processing gain for validly relative to invalidly cued targets and increased attentional response following invalidly relative to validly cued targets. Increased attention correlated with faster performance across groups. Increased processing correlated with a higher perceptual decision bias and faster mean RT in NT, but not in ASD. Results suggest that during visuospatial orienting, perceptual expectations in ASD may drive changes in sensory processing and stimulus-driven attention, which may differentially guide behavioural responses.

Examining shortened versions of the Social Responsiveness Scale for use in autism spectrum disorder prediction and as a quantitative trait measure: Results from a validation study of 3-5 year old children

Background

The Social Responsiveness Scale (SRS) is a 65-item measure yielding a continuous score capturing autism-related traits. Scores based on SRS item subsets have been analytically examined but administration of shortened versions has not been evaluated prospectively.

Objective

The goal of this study was to compare psychometric properties of two shortened versions of the SRS to the full 65-item SRS, in young children from both a clinical and general population setting.

Methods

Study participants (aged 3-5 years) were drawn from the AJ Drexel Autism Institute clinic (n = 154) and Kaiser Permanente Northern California (n = 201) and block randomized to receive either the 16-item short SRS, a newly developed computer adaptive testing-SRS, or the published full-length SRS. Total scores across the three SRS administration methods were scaled to facilitate comparisons. Scores were plotted to assess distributional properties, while Receiver Operating Characteristic analysis was used to estimate Area Under the Curve (AUC) and address predictive ability.

Results

Overall, distributional properties of the three administration methods were highly comparable, with shortened measures demonstrating similar ability to capture the range of the distribution and case non-case separation as the full SRS. In addition, AUC values were high (0.91-0.97) and comparable across the administration methods, though there was evidence of difference in predictive ability across measures for females (AUC for full SRS = 0.99 vs. 0.84 for short). Within individual comparisons of short versus full scores (available only for participants at the general population site) suggested underestimation of actual full SRS scores with the CAT-SRS.

Conclusions

Our findings broadly support the construct validity and performance of shortened SRS versions examined here, though the full measure may be needed to more accurately assess traits consistent with ASD diagnosis in females. This work suggests opportunities for collection of ASD-related phenotype in settings where participant burden or feasibility considerations may have otherwise prohibited such measurement.

Pupillometric measures of altered stimulus-evoked locus coeruleus-norepinephrine activity explain attenuated social attention in preschoolers with autism spectrum disorder

Attenuated social attention has been described as a reduced preference for social compared to geometric motion in preschoolers with autism spectrum disorder (ASD). The locus coeruleus-norpinephrine (LC-NE) system modulates sensory reactivity and is a promising underlying mechanism. LC-NE activity is indexed by a stimulus-evoked pupillary response (SEPR) and partially by a luminance-adaptation pupillary response (LAPR), which were both shown to be aberrant in ASD. We examined whether SEPR and LAPR explain an attenuated social motion preference. We applied pupillometry via video-based eye tracking in young children (18-65 months) with ASD (n = 57) and typically developing (TD) children (n = 39) during a preferential looking paradigm of competing social and geometric motion and a changing light condition paradigm. We found an attenuated social motion preference in the ASD compared to the TD group. This was accompanied by atypical pupillometry showing a smaller SEPR to social motion, a larger SEPR to geometric motion and a reduced LAPR to a dark screen. SEPR but not LAPR explained the group difference in social motion preference. An ASD diagnosis was statistically predicted by the social motion preference, while this effect was mediated by the inclusion of SEPR to geometric and social motion. Our findings suggest a decreased sensory reactivity to social and increased reactivity to non-social motion in ASD, which may concurrently contribute to an attenuated social attention. The LC-NE system is supported as a promising underlying mechanism of altered social attention in young children with ASD, while the specificity of findings remains to be addressed.

Measuring autism in males and females with a differential item functioning approach: Results from a nation-wide population-based study

Existing screening instruments for Autism Spectrum Disorder (ASD) might be prone to detect a male manifestation of ASD. Here, we examined the 17 items from the ASD domain in the Autism-Tics, ADHD and other Comorbidities inventory (A-TAC) for Differential Item Functioning (DIF). Data were obtained from the Child and Adolescent Twin Study in Sweden (CATSS) in which parents have responded to the A-TAC. Information regarding a registered diagnosis of ASD were retrieved from the National Patient Register. The cohort was divided into a developmental sample for evaluation of DIF, and a validation sample for examination of the diagnostic accuracy of the total ASD domain, and a novel male and female short form. Our main finding included the identification of DIF for six items, three favouring males and three favouring females. The full, 17 item, ASD domain and the male and female short form showed excellent ability to capture ASD diagnoses in both males and females up to the age of nine years. The full ASD domain in A-TAC is psychometrically largely equivalent across sex and the limited differences between males and females diminish the need for a sex-specific scoring when utilizing the 17 item total score.

Bias in measurement of autism symptoms by spoken language level and non-verbal mental age in minimally verbal children with neurodevelopmental disorders

Increasing numbers of children with known genetic conditions and/or intellectual disability are referred for evaluation of autism spectrum disorder (ASD), highlighting the need to refine autism symptom measures to facilitate differential diagnoses in children with cognitive and language impairments. Previous studies have reported decreased specificity of ASD screening and diagnostic measures in children with intellectual disability. However, little is known about how cognitive and language abilities impact the measurement of specific ASD symptoms in this group. We aggregated a large sample of young children (N = 1196; aged 31-119 months) to examine measurement invariance of ASD symptoms among minimally verbal children within the context of the Autism Diagnostic Observation Schedule (ADOS) Module 1. Using confirmatory factor analysis (CFA) and moderated non-linear factor analysis (MNLFA), we examined how discrete behaviors were differentially associated with the latent symptom domains of social communication impairments (SCI) and restricted and repetitive behaviors (RRB) across spoken language levels and non-verbal mental age groupings. While the two-factor structure of SCI and RRB held consistently across language and cognitive levels, only partial invariance was observed for both ASD symptom domains of SCI and RRB. Specifically, four out of the 15 SCI items and one out of the three RRB items examined showed differential item functioning between children with "Few to No Words" and those with "Some Words"; and one SCI item and one RRB item showed differential item functioning across non-verbal mental age groups. Moreover, even after adjusting for the differential item functioning to reduce measurement bias across groups, there were still differences in ASD symptom domain scores across spoken language levels. These findings further underscore the influence of spoken language level on measurement of ASD symptoms and the importance of measuring ASD symptoms within refined spoken language levels, even among those with minimal verbal abilities.

Drug development for Autism Spectrum Disorder (ASD): Progress, challenges, and future directions

In 2017, facing lack of progress and failures encountered in targeted drug development for Autism Spectrum Disorder (ASD) and related neurodevelopmental disorders, the ISCTM with the ECNP created the ASD Working Group charged to identify barriers to progress and recommending research strategies for the field to gain traction. Working Group international academic, regulatory and industry representatives held multiple in-person meetings, teleconferences, and subgroup communications to gather a wide range of perspectives on lessons learned from extant studies, current challenges, and paths for fundamental advances in ASD therapeutics. This overview delineates the barriers identified, and outlines major goals for next generation biomedical intervention development in ASD. Current challenges for ASD research are many: heterogeneity, lack of validated biomarkers, need for improved endpoints, prioritizing molecular targets, comorbidities, and more. The Working Group emphasized cautious but unwavering optimism for therapeutic progress for ASD core features given advances in the basic neuroscience of ASD and related disorders. Leveraging genetic data, intermediate phenotypes, digital phenotyping, big database discovery, refined endpoints, and earlier intervention, the prospects for breakthrough treatments are substantial. Recommendations include new priorities for expanded research funding to overcome challenges in translational clinical ASD therapeutic research.

Distributional Properties and Criterion Validity of a Shortened Version of the Social Responsiveness Scale: Results from the ECHO Program and Implications for Social Communication Research

Prior work proposed a shortened version of the Social Responsiveness Scale (SRS), a commonly used quantitative measure of social communication traits. We used data from 3031 participants (including 190 ASD cases) from the Environmental Influences on Child Health Outcomes (ECHO) Program to compare distributional properties and criterion validity of 16-item "short" to 65-item "full" SRS scores. Results demonstrated highly overlapping distributions of short and full scores. Both scores separated case from non-case individuals by approximately two standard deviations. ASD prediction was nearly identical for short and full scores (area under the curve values of 0.87, 0.86 respectively). Findings support comparability of shortened and full scores, suggesting opportunities to increase efficiency. Future work should confirm additional psychometric properties of short scores.

Inclusion of individuals with low IQ in drug development for autism spectrum disorder

Although individuals with intellectual disability (ID) and/or limited language ability make up a significant proportion of those with autism spectrum disorder (ASD), they are routinely excluded from ASD research. As a result, this vulnerable population is prevented from participating in and deriving full benefit from research. In this commentary, we expand upon points made by McCracken and colleagues (this issue), who describe several opportunities for improvement in drug development for ASD related to the inclusion of individuals with ID and/or limited language ability.

Novel treatments for autism spectrum disorder based on genomics and systems biology

BACKGROUND

Autism spectrum disorder (ASD) is a highly heterogeneous neurodevelopmental disorder with a complex underlying genetic architecture. There are currently no known pharmacologic treatments for the core ASD symptoms of social deficits and restricted/ repetitive behavior. However, there are dozens of clinical trials currently underway that are testing the impact of novel and existing agents on core and associated symptoms in ASD.

METHODS

We present a narrative synthesis of the historical and contemporary challenges to drug discovery in ASD. We then provide an overview of novel treatments currently under investigation from a genomics and systems biology perspective.

RESULTS

Data driven network and cluster analyses suggest alterations in transcriptional regulation, chromatin remodelling, synaptic transmission, neuropeptide signalling, and/or immunological mechanisms may contribute to or underlie the development of ASD. Agents and upcoming trials targeting each of the above listed systems are reviewed.

CONCLUSION

Identifying effective pharmacologic treatments for the core and associated symptom domains in ASD will require further collaboration and innovation in the areas of outcome measurement, biomarker research, and genomics, as well as systematic efforts to identify and treat subgroups of individuals with ASD who may be differentially responsive to specific treatments.

Extracting Latent Subdimensions of Social Communication: A Cross-Measure Factor Analysis

OBJECTIVE

Social communication deficits associated with autism spectrum disorder (ASD) are commonly represented as a single behavioral domain. However, increased precision of measurement of social communication is needed to promote more nuanced phenotyping, both within the autism spectrum and across diagnostic boundaries.

METHOD

A large sample (N = 1,470) of 4- to 10-year-old children was aggregated from across 4 data sources, and then randomly split into testing and validation samples. A total of 57 selected social communication items from 3 widely used autism symptom measures (the Autism Diagnostic Observation Scale [ADOS], Autism Diagnostic Interview-Revised [ADI-R], and Social Responsiveness Scale [SRS]) were analyzed in the multi-trait/multi-method factor analysis framework. The selected model was then confirmed with the validation sample.

RESULTS

The 4-substantive factor model, with 3 orthogonal method factors, was selected using the testing sample based on fit indices and then confirmed with the validation sample. Two of the factors, "Basic Social Communication Skills" and "Interaction Quality," were similar to those identified in a previous analysis of the ADOS, Module 3. Two additional factors, "Peer Interaction and Modification of Behavior" and "Social Initiation and Affiliation," also emerged. Factor scores showed nominal correlations with age and verbal IQ.

CONCLUSION

Identification of subdimensions could inform the creation of better conceptual models of social communication impairments, including mapping of how the cascading effects of social communication deficits unfold in ASD versus other disorders. Especially if extended to include both older and younger age cohorts and individuals with more varying developmental levels, these efforts could inform phenotype-based exploration for biological and genetic mechanisms by pinpointing specific mechanisms that contribute to various types of social communication deficits.

Validation of the Social Responsiveness Scale (SRS) to screen for atypical social behaviors in juvenile macaques

Primates form strong social bonds and depend on social relationships and networks that provide shared resources and protection critical for survival. Social deficits such as those present in autism spectrum disorder (ASD) and other psychiatric disorders hinder the individual’s functioning in communities. Given that early diagnosis and intervention can improve outcomes and trajectories of ASD, there is a great need for tools to identify early markers for screening/diagnosis, and for translational animal models to uncover biological mechanisms and develop treatments. One of the most widely used screening tools for ASD in children is the Social Responsiveness Scale (SRS), a quantitative measure used to identify individuals with atypical social behaviors. The SRS has been adapted for use in adult rhesus monkeys (Macaca mulatta)–a species very close to humans in terms of social behavior, brain anatomy/connectivity and development–but has not yet been validated or adapted for a necessary downward extension to younger ages matching those for ASD diagnosis in children. The goal of the present study was to adapt and validate the adult macaque SRS (mSRS) in juvenile macaques with age equivalent to mid-childhood in humans. Expert primate coders modified the mSRS to adapt it to rate atypical social behaviors in juvenile macaques living in complex social groups at the Yerkes National Primate Research Center. Construct and face validity of this juvenile mSRS (jmSRS) was determined based on well-established and operationalized measures of social and non-social behaviors in this species using traditional behavioral observations. We found that the jmSRS identifies variability in social responsiveness of juvenile rhesus monkeys and shows strong construct/predictive validity, as well as sensitivity to detect atypical social behaviors in young male and female macaques across social status. Thus, the jmSRS provides a promising tool for translational research on macaque models of children social disorders.

Phase-IIa randomized, double-blind, sham-controlled, parallel group trial on anodal transcranial direct current stimulation (tDCS) over the left and right tempo-parietal junction in autism spectrum disorder-StimAT: study protocol for a clinical trial

Background

Autism spectrum disorder (ASD) is characterized by impaired social communication and interaction, and stereotyped, repetitive behaviour and sensory interests. To date, there is no effective medication that can improve social communication and interaction in ASD, and effect sizes of behaviour-based psychotherapy remain in the low to medium range. Consequently, there is a clear need for new treatment options. ASD is associated with altered activation and connectivity patterns in brain areas which process social information. Transcranial direct current stimulation (tDCS) is a technique that applies a weak electrical current to the brain in order to modulate neural excitability and alter connectivity. Combined with specific cognitive tasks, it allows to facilitate and consolidate the respective training effects. Therefore, application of tDCS in brain areas relevant to social cognition in combination with a specific cognitive training is a promising treatment approach for ASD.

Methods

A phase-IIa pilot randomized, double-blind, sham-controlled, parallel-group clinical study is presented, which aims at investigating if 10 days of 20-min multi-channel tDCS stimulation of the bilateral tempo-parietal junction (TPJ) at 2.0 mA in combination with a computer-based cognitive training on perspective taking, intention and emotion understanding, can improve social cognitive abilities in children and adolescents with ASD. The main objectives are to describe the change in parent-rated social responsiveness from baseline (within 1 week before first stimulation) to post-intervention (within 7 days after last stimulation) and to monitor safety and tolerability of the intervention. Secondary objectives include the evaluation of change in parent-rated social responsiveness at follow-up (4 weeks after end of intervention), change in other ASD core symptoms and psychopathology, social cognitive abilities and neural functioning post-intervention and at follow-up in order to explore underlying neural and cognitive mechanisms.

Discussion

If shown, positive results regarding change in parent-rated social cognition and favourable safety and tolerability of the intervention will confirm tDCS as a promising treatment for ASD core-symptoms. This may be a first step in establishing a new and cost-efficient intervention for individuals with ASD.

Trial registration

The trial is registered with the German Clinical Trials Register (DRKS), DRKS00014732. Registered on 15 August 2018.

Protocol version

This study protocol refers to protocol version 1.2 from 24 May 2019.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13063-021-05172-1.

Using item response theory (IRT) to improve the efficiency of the Simple Clinical Colitis Activity Index (SCCAI) for patients with ulcerative colitis

BACKGROUND

The SCCAI was designed to facilitate assessment of disease activity in ulcerative colitis (UC). We aimed to interrogate the metric properties of individual items of the SCCAI using item response theory (IRT) analysis, to simplify and improve its performance.

METHODS

The original 9-item SCCAI was collected through TrueColours, a real-time software platform which allows remote entry and monitoring of patients with UC. Data were securely uploaded onto Dementias Platform UK Data Portal, where they were analysed in Stata 16.1 SE. A 2-parameter (2-PL) logistic IRT model was estimated to evaluate each item of the SCCAI for its informativeness (discrimination). A revised scale was generated and re-assessed following systematic removal of items.

RESULTS

SCCAI data for 516 UC patients (41 years, SD = 15) treated in Oxford were examined. After initial item deletion (Erythema nodosum, Pyoderma gangrenosum), a 7-item scale was estimated. Discrimination values (information) ranged from 0.41 to 2.52 indicating selected item inefficiency with three items < 1.70 which is a suggested discriminatory value for optimal efficiency. Systematic item deletions found that a 4-item scale (bowel frequency day; bowel frequency nocturnal; urgency to defaecation; rectal bleeding) was more informative and discriminatory of trait severity (discrimination values of 1.50 to 2.78). The 4-item scale possesses higher scalability and unidimensionality, suggesting that the responses to items are either direct endorsement (patient selection by symptom) or non-endorsement of the trait (disease activity).

CONCLUSION

Reduction of the SCCAI from the original 9-item scale to a 4-item scale provides optimum trait information that will minimise response burden. This new 4-item scale needs validation against other measures of disease activity such as faecal calprotectin, endoscopy and histopathology.

Predictive sensorimotor control in autism

Autism spectrum disorder has been characterized by atypicalities in how predictions and sensory information are processed in the brain. To shed light on this relationship in the context of sensorimotor control, we assessed prediction-related measures of cognition, perception, gaze and motor functioning in a large general population (n = 92; Experiment 1) and in clinically diagnosed autistic participants (n = 29; Experiment 2). In both experiments perception and action were strongly driven by prior expectations of object weight, with large items typically predicted to weigh more than equally-weighted smaller ones. Interestingly, these predictive action models were used comparably at a sensorimotor level in both autistic and neurotypical individuals with varying levels of autistic-like traits. Specifically, initial fingertip force profiles and resulting action kinematics were both scaled according to participants' pre-lift heaviness estimates, and generic visual sampling behaviours were notably consistent across groups. These results suggest that the weighting of prior information is not chronically underweighted in autism, as proposed by simple Bayesian accounts of the disorder. Instead, our results cautiously implicate context-sensitive processing mechanisms, such as precision modulation and hierarchical volatility inference. Together, these findings present novel implications for both future scientific investigations and the autism community.

When CAT is not an option: complementary methods of test abbreviation for neurocognitive batteries

INTRODUCTION

There is an obvious need for efficient measurement of neuropsychiatric phenomena. A proven method-computerized adaptive testing (CAT)-is not feasible for all tests, necessitating alternatives for increasing test efficiency.

METHODS

We combined/compared two methods for abbreviating rapid tests using two tests unamenable to CAT (a Continuous Performance Test [CPT] and n-back test [NBACK]). N=9,498 (mean age 14.2 years; 52% female) were administered the tests, and abbreviation was accomplished using methods answering two questions: what happens to measurement error as items are removed, and what happens to correlations with validity criteria as items are removed. The first was investigated using quasi-CAT simulation, while the second was investigated using bootstrapped confidence intervals around full-form-short-form comparisons.

RESULTS

Results for the two methods overlapped, suggesting that the CPT could be abbreviated to 57% of original and NBACK could be abbreviated to 87% of original with the max-acceptable loss of precision and min-acceptable relationships with validity criteria.

CONCLUSIONS

This method combination shows promise for use in other test types, and the divergent results for the CPT/NBACK demonstrate the methods' abilities to detect when a test should not be shortened. The methods should be used in combination because they emphasize complementary measurement qualities: precision/validity..

Gene functional networks and autism spectrum characteristics in young people with intellectual disability: a dimensional phenotyping study

BACKGROUND

The relationships between specific genetic aetiology and phenotype in neurodevelopmental disorders are complex and hotly contested. Genes associated with intellectual disability (ID) can be grouped into networks according to gene function. This study explored whether individuals with ID show differences in autism spectrum characteristics (ASC), depending on the functional network membership of their rare, pathogenic de novo genetic variants.

METHODS

Children and young people with ID of known genetic origin were allocated to two broad functional network groups: synaptic physiology (n = 29) or chromatin regulation (n = 23). We applied principle components analysis to the Social Responsiveness Scale to map the structure of ASC in this population and identified three components-Inflexibility, Social Understanding and Social Motivation. We then used Akaike information criterion to test the best fitting models for predicting ASC components, including demographic factors (age, gender), non-ASC behavioural factors (global adaptive function, anxiety, hyperactivity, inattention), and gene functional networks.

RESULTS

We found that, when other factors are accounted for, the chromatin regulation group showed higher levels of Inflexibility. We also observed contrasting predictors of ASC within each network group. Within the chromatin regulation group, Social Understanding was associated with inattention, and Social Motivation was predicted by hyperactivity. Within the synaptic group, Social Understanding was associated with hyperactivity, and Social Motivation was linked to anxiety.

LIMITATIONS

Functional network definitions were manually curated based on multiple sources of evidence, but a data-driven approach to classification may be more robust. Sample sizes for rare genetic diagnoses remain small, mitigated by our network-based approach to group comparisons. This is a cross-sectional study across a wide age range, and longitudinal data within focused age groups will be informative of developmental trajectories across network groups.

CONCLUSION

We report that gene functional networks can predict Inflexibility, but not other ASC dimensions. Contrasting behavioural associations within each group suggest network-specific developmental pathways from genomic variation to autism. Simple classification of neurodevelopmental disorder genes as high risk or low risk for autism is unlikely to be valid or useful.

Comprehensive Assessment of Individuals With Significant Levels of Intellectual Disability: Challenges, Strategies, and Future Directions

The variety and extent of impairments in individuals with severe-profound levels of intellectual disability (ID) impact their ability to complete valid behavioral assessments. Although standardized assessment is crucial for objectively evaluating patients, many individuals with severe-profound levels of ID perform at the floor of most assessments designed for their chronological age. Additionally, the presence of language and motor impairments may influence the individual's ability to perform a task, even when that task is meant to measure an unrelated construct leading to an underestimation of their true ability. This article provides an overview of the assessment protocols used by multiple groups working with individuals with severe-profound levels of ID, discusses considerations for obtaining high-quality assessment results, and suggests guidelines for standardizing these protocols across the field.

Social impairments in alternating hemiplegia of childhood

AIM

To evaluate presence and severity of social impairments in alternating hemiplegia of childhood (AHC) and determine factors that are associated with social impairments.

METHOD

This was a retrospective analysis of 34 consecutive patients with AHC (19 females, 15 males; mean age: 9y 7mo, SD 8y 2mo, range 2y 7mo-40y), evaluated with the Social Responsiveness Scale, Second Edition (SRS-2).

RESULTS

SRS-2 scores, indicating level of social impairment, were higher than population means (75, SD 14 vs 50, SD 10, p<0.001). Of these, 27 out of 34 had high scores: 23 severe (>76), four moderate (66-76). All subscale domains, including social cognition, social communication, social awareness, social motivation, restricted interests, and repetitive behavior, had abnormal scores compared to population means (p<0.001). High SRS-2 scores were associated with the presence of autism spectrum disorder (ASD) and epilepsy (p=0.01, p=0.04), but not with other scales of AHC disease symptomatology. All nine patients who received formal evaluations for ASD, because they had high SRS-2 scores, were diagnosed with ASD.

INTERPRETATION

Most patients with AHC have impaired social skills involving multiple domains. ASD is not uncommon. High SRS-2 scores in patients with AHC support referral to ASD evaluation. Our findings are consistent with current understandings of the pathophysiology of AHC and ASD, both thought to involve GABAergic dysfunction.

WHAT THIS PAPER ADDS

Most patients with alternating hemiplegia of childhood (AHC) have impaired social skills involving multiple domains. These impairments are significant compared to population means. Most patients with AHC have high Social Responsiveness Scale, Second Edition (SRS-2) scores. Patients with AHC with high SRS-2 scores are likely to have autism spectrum disorder.

Psychometric Study of the Social Responsiveness Scale in Phelan-McDermid Syndrome

The Social Responsiveness Scale-2 (SRS-2) is a quantitative measure used to characterize symptoms of autism spectrum disorder (ASD). However, research suggests that SRS-2 scores are significantly influenced by language ability and intellectual disability (ID). Efforts to refine the SRS-2 by Sturm, Kuhfeld, Kasari, and Mccracken [Journal of Child Psychology and Psychiatry, 58(9), 1053-1061] yielded a shortened form, yet its psychometric properties in populations with severe ID remain unknown. This study aims to examine the psychometric properties of the SRS-2 in Phelan-McDermid syndrome (PMS), a genetic condition associated with ASD and ID, thereby guiding score interpretation in this population and future development of targeted scales. Analyses, including Item Response Theory (IRT), were conducted on a sample of individuals with PMS (n = 91) recruited at six sites nationally. Psychometric properties evaluated include measures of reliability (internal consistency, test-retest reliability) and validity (structural, construct, content). While both SRS-2 forms are reliable, the shortened SRS-2 shows superior validity to the full SRS-2 for measuring ASD symptoms in PMS. On IRT analysis, the shortened SRS-2 shows excellent discrimination and precisely evaluates respondents across a wide range of ASD symptomatology but interpretation is limited by uncertain content validity and small sample size. The shortened SRS-2 shows some promise for use in PMS, but future refinements and additions are needed to develop items that are tailored to identify ASD in children with severe ID and specifically PMS. LAY SUMMARY: This study determined that a shortened form of the Social Responsiveness Scale, Second Edition (SRS-2) shows both promise and limitations for the characterization of autism symptomatology in individuals with Phelan-McDermid syndrome (PMS), a population characterized by intellectual disability (ID). Caution should be used when interpreting SRS-2 scores in individuals with ID and future research should modify existing items and develop new items to improve the SRS-2's ability to accurately characterize autism symptomatology in PMS. Autism Res 2020, 13: 1383-1396. © 2020 International Society for Autism Research, Wiley Periodicals, Inc.

Study protocol of the multi-centre, randomised controlled trial of the Frankfurt Early Intervention Programme A-FFIP versus early intervention as usual for toddlers and preschool children with Autism Spectrum Disorder (A-FFIP study)

BACKGROUND

Naturalistic developmental behavioural interventions (NDBI) have been shown to improve autism-specific symptoms in young children with Autism Spectrum Disorder (ASD). NDBI approaches, such as the ASD-specific Frankfurt Early Intervention Programme for ASD (A-FFIP), are based on ASD-specific developmental and learning aspects. A-FFIP is a low-intensity intervention which can easily be implemented in the local health care/social welfare system. The aim of the present study is to establish 1-year efficacy of the manualised early intervention programme A-FFIP in toddlers and preschool children with ASD. It is hypothesised that A-FFIP will result in improved ASD-specific symptoms compared to early intervention as usual (EIAU). Child- and family-specific secondary outcomes, as well as moderators and mediators of outcome, will be explored.

METHODS/DESIGN

A prospective, multi-centre, parallel-group, randomised controlled, phase-III trial comparing A-FFIP versus EIAU. A total of 134 children (A-FFIP: 67, EIAU: 67) aged 24-66 months at baseline assessment meeting the criteria for ASD (DSM-5) will be included. The primary outcome is the absolute change of the total score of the Brief Observation of Social Communication Change (BOSCC-AT) between baseline (T2) and 1-year follow-up (T6). The treatment effect will be tested, adjusted for relevant covariates applying a mixed model for repeated measures. Secondary outcomes are BOSCC social communication and repetitive-behaviour scores, single ASD symptoms, language, cognition, psychopathology, parental well-being and family quality of life. Predictors, moderators and mediating mechanisms will be explored.

DISCUSSION

If efficacy of the manualised A-FFIP early intervention is established, the current study has the potential to change clinical practice strongly towards the implementation of a low-intensity, evidence-based, natural early intervention in ASD. Early intervention in ASD requires specialist training, which subsequently needs to be developed or included into current training curricula.

TRIAL REGISTRATION

German Registry for Clinical Trials (Deutscher Register Klinischer Studien, DRKS); ID: 00016330. Retrospectively registered on 4 January 2019. URL: https://www.drks.de/drks_web/navigate.do?navigationId=trial.HTML&TRIAL_ID=DRKS00016330.

Development of the Stanford Social Dimensions Scale: initial validation in autism spectrum disorder and in neurotypicals

Background

The aim of this paper was to provide an initial validation of a newly developed parent questionnaire-the Stanford Social Dimensions Scale (SSDS), designed to capture individual differences across several key social dimensions including social motivation in children and adolescents with and without psychiatric disorders.

Methods

The initial validation sample was comprised of parents of 175 individuals with autism spectrum disorder (ASD) (35 females, 140 males; Mage = 7.19 years, SDage = 3.96) and the replication sample consisted of 624 parents of children who were either typically developing or presented with a range of neurodevelopmental and neuropsychiatric disorders (302 females, 322 males; Mage = 11.49 years, SDage = 4.48). Parents from both samples completed the SSDS and the Social Responsiveness Scale (SRS-2).

Results

Exploratory Structural Equation Modeling indicated that a 5-factor model provided adequate to excellent fit to the data in the initial ASD sample (comparative fit index [CFI] = .940, Tucker-Lewis Index [TLI] = .919, root mean square error of approximation [RMSEA] = .048, standardized root mean square residual [SRMR] = .038). The identified factors were interpreted as Social Motivation, Social Affiliation, Expressive Social Communication, Social Recognition, and Unusual Approach. This factor structure was further confirmed in Sample 2 (CFI = 946, TLI = .930, RMSEA = .044, SRMR = .026). Internal consistency for all subscales was in the good to excellent range across both samples as indicated by Composite Reliability scores of ≥ .72. Convergent and divergent validity was strong as indexed by the pattern of correlations with relevant SRS-2 and Child Behavior Checklist domains and with verbal and non-verbal intellectual functioning scores in Sample 1 and with the Need to Belong Scale and Child Social Preference Scale scores in Sample 2. Across both samples, females had higher social motivation and expressive social communication scores. Discriminant validity was strong given that across all SSDS subscales, the ASD sample had significantly higher impairment than both the typically developing group and the group with other clinical conditions, which in turn, had significantly higher impairment than the typically developing group.

Conclusions

Our findings provide initial validation of a new scale designed to comprehensively capture individual differences in social motivation and other key social dimensions in ASD.

The development of a brief screener for autism using item response theory

BACKGROUND

Brief screening instruments focusing on autism spectrum disorder (ASD) that can be administered in primary care are scarce; there is a need for shorter and more precise instruments. The Autism-Tics, AD/HD and other Comorbidities inventory (A-TAC) has previously been validated for ASD reporting excellent validity. This study aims to determine the psychometric properties of each item in the ASD domain (17 items) in the A-TAC using item response theory (IRT), and thereby construct and validate a short form that could be used as a screening instrument in the general population.

METHODS

Since 2004, parents of all 9-year-old Swedish twins have been invited to participate in a telephone interview in the Child and Adolescent Twin Study in Sweden (CATSS). The CATSS is linked to the National Patient Register (NPR), which includes data from in- and outpatient care. Data on ASD (A-TAC) collected in CATSS were compared with diagnoses from the NPR. Diagnoses that had been made both before (previous validity) and after (predictive validity) the interviews were included. The sample was divided into a developmental sample and a validation sample. An IRT model was fitted to the developmental sample and item parameters were used to select a subset of items for the short form. The performance of the proposed short form was examined in the validation sample by the use of receiver operation characteristic curves.

RESULTS

Four items which were able to discriminate among individuals with more autism traits were deemed sufficient for use in the short form. The values of the area under the receiver operating characteristic curve for a clinical diagnosis of ASD was .95 (previous validity) and .72 (predictive validity).

CONCLUSIONS

The proposed short form with 4 out of the original 17 items from A-TAC, showed excellent previous validity while the predictive validity was fair. The validity of the short form was in agreement with previous validations of the full ASD domain. The short form can be a valuable screening instrument in primary care settings in order to identify individuals in need for further assessment and for use in epidemiological studies.

The reliability and validity of the social responsiveness scale to measure autism symptomology in Vietnamese children

The Social Responsiveness Scale (SRS) has been validated in high-income countries but not yet in low- and middle-income countries. We aimed to assess the reliability of the SRS in a community sample and its validity to discriminate between children with and without autism spectrum disorder (ASD) in Vietnam. We used a three-phase study: piloting the translated SRS, reliability testing, and validation of the SRS in 158 Vietnamese caretakers and their children (ages 4-9 years). We examined reliability, validity and sensitivity, and specificity to ASD diagnosis. We applied receiver operator characteristic (ROC) analysis to determine optimal cutoff scores discriminating the children with ASD from those without ASD. We also assessed the performance of the SRS short form. We found that reliability was good with high internal consistency (0.88-0.89), test-retest reliability (0.82-0.83), sensitivity (93%), and specificity (98%) for identification of children with ASD. The ROC curves were similar for total raw score and total T-score, with the area under the curve (AUC) values reaching 0.98 and the optimal cutoff of 62 for raw scores and 60 for T-scores. The SRS short form also performed well in distinguishing children with ASD from children without ASD, with high AUC (0.98), sensitivity (90%), and specificity (98%) when using a raw score of 15 as a cutoff. In conclusion, the translated and culturally adapted SRS shows good reliability, validity, and sensitivity for identification of children with ASD in Vietnam. Both SRS long and short forms performed adequately to discriminate between children with and without ASD. Autism Res 2019, 00: 1-13. © 2019 International Society for Autism Research, Wiley Periodicals, Inc. LAY SUMMARY: Middle-income countries often lack validated tools to evaluate autism symptoms. The Social Responsiveness Scale (SRS) translated to Vietnamese was reliable and performed well to distinguish between children with and without autism spectrum disorder in Vietnam. The Vietnamese SRS, and translations of the tool to other languages with this methodology, may be useful in pediatric practice, potentially allowing providers to make more appropriate referrals for diagnostic evaluations and identify children for intervention to help them fulfill their developmental potential.

Behavioral characterization of dup15q syndrome: Toward meaningful endpoints for clinical trials

Duplication of 15q11.2-q13.1 (dup15q syndrome) is one of the most common copy number variations associated with autism spectrum disorders (ASD) and intellectual disability (ID). As with many neurogenetic conditions, accurate behavioral assessment is challenging due to the level of impairment and heterogeneity across individuals. Large-scale phenotyping studies are necessary to inform future clinical trials in this and similar ID syndromes. This study assessed developmental and behavioral characteristics in a large cohort of children with dup15q syndrome, and examined differences based on genetic subtype and epilepsy status. Participants included 62 children (2.5-18 years). Across individuals, there was a wide range of abilities. Although adaptive behavior was strongly associated with cognitive ability, adaptive abilities were higher than cognitive scores. Measures of ASD symptoms were associated with cognitive ability, while parent report of challenging behavior was not. Both genetic subtype and epilepsy were related to degree of impairment across cognitive, language, motor, and adaptive domains. Children with isodicentric duplications and epilepsy showed the greatest impairment, while children with interstitial duplications showed the least. On average, participants with epilepsy experienced seizures over 53% of their lives, and half of children with epilepsy had infantile spasms. Parents of children with isodicentric duplications reported more concerns regarding challenging behaviors. Future trials in ID syndromes should employ a flexible set of assessments, allowing each participant to receive assessments that capture their skills. Multiple sources of information should be considered, and the impact of language and cognitive ability should be taken into consideration when interpreting results.

The distribution of autistic traits across the autism spectrum: evidence for discontinuous dimensional subpopulations underlying the autism continuum

Background

A considerable amount of research has discussed whether autism and psychiatric/neurodevelopmental conditions in general are best described categorically or dimensionally. In recent years, finite mixture models have been increasingly applied to mixed populations of autistic and non-autistic individuals to answer this question. However, the use of such methods with mixed populations may not be appropriate for two reasons: First, subgroups within mixed populations are often skewed and thus violate mixture models assumptions, which are based on weighted sum of Gaussian distributions. Second, these analyses have, to our knowledge, been solely applied to enriched samples, where the prevalence of the clinical condition within the study sample far exceeds epidemiological estimates.

Method

We employed a dual Weibull mixture model to examine the distribution of the Autism Spectrum Quotient scores of a mixed sample of autistic and non-autistic adults (N = 4717; autism = 811), as well as of a derived sample (from the enriched sample; N = 3973; autism = 67) that reflects the current prevalence of autism within the general population.

Results

In a mixed autistic and non-autistic population, our model provided a better description of the underlying structure of autistic traits than traditional finite Gaussian mixture models and performed well when applied to a sample that reflected the prevalence of autism in the general population. The model yielded results, which are consistent with predictions of current theories advocating for the co-existence of a mixed categorical and dimensional architecture within the autism spectrum.

Conclusion

The results provide insight into the continuum nature of the distribution of autistic traits, support the complementary role of both categorical and dimensional approaches to autism spectrum condition, and underscore the importance of analyzing samples that reflect the epidemiological prevalence of the condition. Owing to its flexibility to represent a wide variety of distributions, the Weibull distribution might be better suited for latent structure studies, within enriched and prevalence-true samples.

Clinical Validation of the Autism Behavior Inventory: Caregiver-Rated Assessment of Core and Associated Symptoms of Autism Spectrum Disorder

There is a need for measures to track symptom change in autism spectrum disorder (ASD). We conducted a validation study on a revised version of the Autism Behavior Inventory (ABI), and a short form (ABI-S). Caregivers of individuals (6–54 years) with confirmed diagnoses of ASD (N = 144) completed the ABI and other rating scales at 4 time points. Scale consistency for each domain, 3–5 day test–retest reliability, and construct validity, determined by comparison to pre-specified scales, were all good. Change in the ABI was congruent with changes in other instruments. Collectively, results suggest incipient suitability of the ABI as a measure of changes in core and associated symptoms of ASD.

Trial Registration NCT02299700.

A data mining and item response mixture modeling method to retrospectively measure Diagnostic and Statistical Manual of Mental Disorders-5 attention deficit hyperactivity disorder in the 1970 British Cohort Study

OBJECTIVE

To facilitate future outcome studies, we aimed to develop a robust and replicable method for estimating a categorical and dimensional measure of Diagnostic and Statistical Manual of Mental Disorders-5 (DSM-5) attention deficit hyperactivity disorder (ADHD) in the 1970 British Cohort Study (BCS70).

METHOD

Following a data mining framework, we mapped DSM-5 ADHD symptoms to age 10 BCS70 data (N = 11,426) and derived a 16-item scale (α = 0.85). Mapping was validated by an expert panel. A categorical subgroup was derived (n = 594, 5.2%), and a zero-inflated item response theory (IRT) mixture model fitted to estimate a dimensional measure.

RESULTS

Subgroup composition was comparable with other ADHD samples. Relative risk ratios (ADHD/not ADHD) included boys = 1.38, unemployed fathers = 2.07, below average reading = 2.58, and depressed parent = 3.73. Our estimated measures correlated with two derived reference scales: Strengths and Difficulties Questionnaire hyperactivity (r = 0.74) and a Rutter/Conners-based scale (r = 0.81), supporting construct validity. IRT model items (symptoms) had moderate to high discrimination (0.90-2.81) and provided maximum information at average to moderate theta levels of ADHD (0.5-1.75).

CONCLUSION

We extended previous work to identify ADHD in BCS70, derived scales from existing data, modeled ADHD items with IRT, and adjusted for a zero-inflated distribution. Psychometric properties were promising, and this work will enable future studies of causal mechanisms in ADHD.

Exome sequencing of 85 Williams-Beuren syndrome cases rules out coding variation as a major contributor to remaining variance in social behavior

BACKGROUND

Large, multigenic deletions at chromosome 7q11.23 result in a highly penetrant constellation of physical and behavioral symptoms known as Williams-Beuren syndrome (WS). Of particular interest is the unusual social-cognitive profile evidenced by deficits in social cognition and communication reminiscent of autism spectrum disorders (ASD) that are juxtaposed with normal or even relatively enhanced social motivation. Interestingly, duplications in the same region also result in ASD-like phenotypes as well as social phobias. Thus, the region clearly regulates human social motivation and behavior, yet the relevant gene(s) have not been definitively identified.

METHOD

Here, we deeply phenotyped 85 individuals with WS and used exome sequencing to analyze common and rare variation for association with the remaining variance in social behavior as assessed by the Social Responsiveness Scale.

RESULTS

We replicated the previously reported unusual juxtaposition of behavioral symptoms in this new patient collection, but we did not find any new alleles of large effect in the targeted analysis of the remaining copy of genes in the Williams syndrome critical region. However, we report on two nominally significant SNPs in two genes that have been implicated in the cognitive and social phenotypes of Williams syndrome, BAZ1B and GTF2IRD1. Secondary discovery driven explorations focusing on known ASD genes and an exome wide scan do not highlight any variants of a large effect.

CONCLUSIONS

Whole exome sequencing of 85 individuals with WS did not support the hypothesis that there are variants of large effect within the remaining Williams syndrome critical region that contribute to the social phenotype. This deeply phenotyped and genotyped patient cohort with a defined mutation provides the opportunity for similar analyses focusing on noncoding variation and/or other phenotypic domains.

Autism spectrum disorder symptoms from ages 2 to 19 years: Implications for diagnosing adolescents and young adults

This study explored change in social-communicative symptoms in 140 individuals with childhood autism spectrum disorder (ASD) diagnoses. Trajectories of caregiver-reported social-communicative symptoms were examined for three groups (verbal, delayed speech, minimally verbal) from ages 2 to 19 years. Groups showed comparable levels of social-communicative impairment at 2 years and significant decreases in overall symptom levels across the 17-year period (P < .001). Across three subdomains, main effects of time and language (P < .001) reflected patterns of overall improvement, although children with more impaired language tended to have more caregiver-reported symptoms relative to verbal peers. A significant time-by-language interaction (P < .001) reflected that trajectories of socioemotional reciprocity symptoms differed according to patterns of language development. In contrast, improvements in the nonverbal communication domain were seen across language groups, whereas deficits in the development and maintenance of relationships improved for only verbal children. Verbal adults showed significant reductions in the prevalence of kseveral symptoms exhibited during childhood. Improvements suggest that symptoms indicative of ASD in young children may no longer be diagnostic markers in adolescents and adults. Relative stability of several items suggests that impaired facial expression may be a core ASD symptom that warrants more systematic study across the lifespan. Research investigating the manifestation of ASD in older individuals is needed to foster development of appropriate assessment tools and interventions. Differential relationships to developmental factors within the broader social-communication domain underscores a need to focus on more narrowly defined symptom constructs when exploring links between pathophysiology and observable phenotypes. Autism Research 2019, 12: 89-99. © 2018 International Society for Autism Research, Wiley Periodicals, Inc. LAY SUMMARY: In a sample of 140 participants with autism spectrum disorder (ASD) followed from 2 to 19 years old, this study found that overall social-communicative symptoms improve across childhood and adolescence. However, timing and amount of change varied for different symptom categories and participants with different language abilities. Findings suggest that some older adolescents and adults with ASD may not exhibit the same difficulties observed in young children with ASD. More research is needed to better understand the strengths and needs of young adults with ASD.