Atypical Time Course of Object Recognition in Autism Spectrum Disorder

Computational reconstruction of mental representations using human behavior

Revealing how the mind represents information is a longstanding goal of cognitive science. However, there is currently no framework for reconstructing the broad range of mental representations that humans possess. Here, we ask participants to indicate what they perceive in images made of random visual features in a deep neural network. We then infer associations between the semantic features of their responses and the visual features of the images. This allows us to reconstruct the mental representations of multiple visual concepts, both those supplied by participants and other concepts extrapolated from the same semantic space. We validate these reconstructions in separate participants and further generalize our approach to predict behavior for new stimuli and in a new task. Finally, we reconstruct the mental representations of individual observers and of a neural network. This framework enables a large-scale investigation of conceptual representations.

The processing of spatial frequencies through time in visual word recognition

This study examined the temporal profile of spatial frequency processing in a word reading task in 16 normal adult readers. They had to report the word presented in a 200 ms display using a four-alternative forced-choice task (4AFC). The stimuli were made of an additive combination of the signal (i.e. the target word) and of a visual white noise patch wherein the signal-to-noise ratio varied randomly across stimulus duration. Four spatial frequency conditions were defined for the signal component of the stimulus (bandpass Butterworth filters with center frequencies of 1.2, 2.4, 4.8 and 9.6 cycles per degree). In contrast to the coarse-to-fine theory of visual recognition, the results show that the highest spatial frequency range dominates early processing, with a shift toward lower spatial frequencies at later points during stimulus exposure. This pattern interacted in a complex way with the temporal frequency content of signal-to-noise oscillations. The outcome of individual data patterns classification by a machine learning algorithm according to the corresponding spatial frequency band further shows that the most salient spatial frequency signature is obtained when the time dimension within data patterns is recoded into its Fourier transform.

Sex modulation of faces prediction error in the autistic brain

Recent research suggests that autistic females may have superior socio-cognitive abilities compared to autistic males, potentially contributing to underdiagnosis in females. However, it remains unclear whether these differences arise from distinct neurophysiological functioning in autistic males and females. This study addresses this question by presenting 41 autistic and 48 non-autistic adults with a spatially filtered faces oddball paradigm. Analysis of event-related potentials from scalp electroencephalography reveal a neurophysiological profile in autistic females that fell between those of autistic males and non-autistic females, highlighting sex differences in autism from the initial stages of face processing. This finding underscores the urgent need to explore neurophysiological sex differences in autism and encourages efforts toward a better comprehension of compensation mechanism and a clearer definition of what is meant by camouflaging.

Loving Objects: Can Autism Explain Objectophilia?

Objectophilia (also known as objectum-sexuality) involves romantic and sexual attraction to specific objects. Objectophiles often develop deep and enduring emotional, romantic, and sexual relations with specific inanimate (concrete or abstract) objects such as trains, bridges, cars, or words. The determinants of objectophilia are poorly understood. The aim of this paper is to examine the determining factors of objectophilia. We examine four hypotheses about the determinants of objectophilia (pertaining to fetishism, synesthesia, cross-modal mental imagery, and autism) and argue that the most likely determining factors of objectophilia are the social and non-social features of autism. Future studies on the determinants of objectophilia could enhance our understanding and potentially lessen the marginalization experienced by objectophiles.

High spatial frequency filtered primes hastens happy faces categorization in autistic adults

Coarse information of a visual stimulus is conveyed by Low Spatial Frequencies (LSF) and is thought to be rapidly extracted to generate predictions. This may guide fast recognition with the subsequent integration of fine information, conveyed by High Spatial Frequencies (HSF). In autism, emotional face recognition is challenging, and might be related to alterations in LSF predictive processes. We analyzed the data of 27 autistic and 34 non autistic (NA) adults on an emotional Stroop task (i.e., emotional face with congruent or incongruent emotional word) with spatially filtered primes (HSF vs.LSF). We hypothesized that LSF primes would generate predictions leading to faster categorization of the target face compared to HSF primes, in the NA group but not in autism. Surprisingly, HSF primes led to faster categorization than LSF primes in both groups. Moreover, the advantage of HSF vs.LSF primes was stronger for angry than happy faces in NA, but was stronger for happy than angry faces in autistic participants. Drift diffusion modelling confirmed HSF advantage and showed a longer non-decision time (e.g., encoding) in autism. Despite LSF predictive impairments in autism was not corroborated, our analyses suggest low level processing specificities in autism.

Early Inflammation Dysregulates Neuronal Circuit Formation In Vivo via Upregulation of IL-1β

Neuroimmune interaction during development is strongly implicated in the pathogenesis of neurodevelopmental disorders, but the mechanisms that cause neuronal circuit dysregulation are not well understood. We performed in vivo imaging of the developing retinotectal system in the larval zebrafish to characterize the effects of immune system activation on refinement of an archetypal sensory processing circuit. Acute inflammatory insult induced hyperdynamic remodeling of developing retinal axons in larval fish and increased axon arbor elaboration over days. Using calcium imaging in GCaMP6s transgenic fish, we showed that these morphologic changes were accompanied by a shift toward decreased visual acuity in tectal cells. This finding was supported by poorer performance in a visually guided behavioral task. We further found that the pro-inflammatory cytokine, interleukin-1β (IL-1β), is upregulated by the inflammatory insult, and that downregulation of IL-1β abrogated the effects of inflammation on axonal dynamics and growth. Moreover, baseline branching of the retinal ganglion cell arbors in IL-1β morphant animals was significantly different from that in control larvae, and their performance in a predation assay was impaired, indicating a role for this cytokine in normal neuronal development. This work establishes a simple and powerful non-mammalian model of developmental immune activation and demonstrates a role for IL-1β in mediating the pathologic effects of inflammation on neuronal circuit development.SIGNIFICANCE STATEMENT Maternal immune activation can increase the risk of neurodevelopmental disorders in offspring; however, the mechanisms involved are not fully understood. Using a non-mammalian vertebrate model of developmental immune activation, we show that even brief activation of inflammatory pathways has immediate and long-term effects on the arborization of axons, and that these morphologic changes have functional and behavioral consequences. Finally, we show that the pro-inflammatory cytokine IL-1β plays an essential role in both the effects of inflammation on circuit formation and normal axonal development. Our data add to a growing body of evidence supporting epidemiological studies linking immune activation to neurodevelopmental disorders, and help shed light on the molecular and cellular processes that contribute to the etiology of these disorders.

Flexible time course of spatial frequency use during scene categorization

Human observers can quickly and accurately categorize scenes. This remarkable ability is related to the usage of information at different spatial frequencies (SFs) following a coarse-to-fine pattern: Low SFs, conveying coarse layout information, are thought to be used earlier than high SFs, representing more fine-grained information. Alternatives to this pattern have rarely been considered. Here, we probed all possible SF usage strategies randomly with high resolution in both the SF and time dimensions at two categorization levels. We show that correct basic-level categorizations of indoor scenes are linked to the sampling of relatively high SFs, whereas correct outdoor scene categorizations are predicted by an early use of high SFs and a later use of low SFs (fine-to-coarse pattern of SF usage). Superordinate-level categorizations (indoor vs. outdoor scenes) rely on lower SFs early on, followed by a shift to higher SFs and a subsequent shift back to lower SFs in late stages. In summary, our results show no consistent pattern of SF usage across tasks and only partially replicate the diagnostic SFs found in previous studies. We therefore propose that SF sampling strategies of observers differ with varying stimulus and task characteristics, thus favouring the notion of flexible SF usage.

Object expectations alter information use during visual recognition

Prior expectations influence how we perceive and recognize objects. However, how they do so remains unclear, especially in the case of real-world complex objects. Expectations of objects may affect which features are used to recognize them subsequently. In this study, we used reverse correlation to reveal with high precision how the use of information across time is modulated by real-world object expectations in a visual recognition task. We show that coarse information leads to accurate responses earlier when an object is expected, indicating that observers use diagnostic features earlier in this situation. We also demonstrate an increased variability in the use of coarse information depending on the expected object, indicating that observers adopt a more specialized recognition strategy when they expect a specific object. In summary, our results reveal potential mechanisms underlying the effect of expectations on the recognition of complex objects.

Impaired Adaptation and Laminar Processing of the Oddball Paradigm in the Primary Visual Cortex of Fmr1 KO Mouse

Both adaptation and novelty detection are an integral part of sensory processing. Recent animal oddball studies have advanced our understanding of circuitry underlying contextual processing in early sensory areas. However, it is unclear how adaptation and mismatch (MM) responses depend on the tuning properties of neurons and their laminar position. Furthermore, given that reduced habituation and sensory overload are among the hallmarks of altered sensory perception in autism, we investigated how oddball processing might be altered in a mouse model of fragile X syndrome (FX). Using silicon probe recordings and a novel spatial frequency (SF) oddball paradigm, we discovered that FX mice show reduced adaptation and enhanced MM responses compared to control animals. Specifically, we found that adaptation is primarily restricted to neurons with preferred oddball SF in FX compared to WT mice. Mismatch responses, on the other hand, are enriched in the superficial layers of WT animals but are present throughout lamina in FX animals. Last, we observed altered neural dynamics in FX mice in response to stimulus omissions. Taken together, we demonstrated that reduced feature adaptation coexists with impaired laminar processing of oddball responses, which might contribute to altered sensory perception in FX syndrome and autism.

Convergent Validity of Behavioural and Subjective Sensitivity in Relation to Autistic Traits

Sensory issues are highly prevalent in autism and previous findings support a relationship between questionnaires of sensitivity and autistic symptoms and traits, whereas studies that examine this relationship through behavioural assessments of sensitivity are less consistent. The current study explores these differences and suggests that behavioural thresholds for sensitivity and subjective sensitivity are distinct constructs. One hundred and eighteen adults completed a visual and auditory detection task and questionnaires on sensory processing and autistic traits. Visual thresholds and subjective visual sensitivity were not correlated, but both were related to autistic traits. Auditory thresholds and subjective auditory sensitivity were also unrelated. Overall, sensitivity is highly associated with autistic traits, however, behavioural and questionnaire assessments lack convergent validity and therefore, likely assess distinct constructs.

Abnormal visual representations associated with confusion of perceived facial expression in schizophrenia with social anxiety disorder

Deficits in social functioning are especially severe amongst schizophrenia individuals with the prevalent comorbidity of social anxiety disorder (SZ&SAD). Yet, the mechanisms underlying the recognition of facial expression of emotions-a hallmark of social cognition-are practically unexplored in SZ&SAD. Here, we aim to reveal the visual representations SZ&SAD (n = 16) and controls (n = 14) rely on for facial expression recognition. We ran a total of 30,000 trials of a facial expression categorization task with Bubbles, a data-driven technique. Results showed that SZ&SAD's ability to categorize facial expression was impared compared to controls. More severe negative symptoms (flat affect, apathy, reduced social drive) was associated with more impaired emotion recognition ability, and with more biases in attributing neutral affect to faces. Higher social anxiety symptoms, on the other hand, was found to enhance the reaction speed to neutral and angry faces. Most importantly, Bubbles showed that these abnormalities could be explained by inefficient visual representations of emotions: compared to controls, SZ&SAD subjects relied less on fine facial cues (high spatial frequencies) and more on coarse facial cues (low spatial frequencies). SZ&SAD participants also never relied on the eye regions (only on the mouth) to categorize facial expressions. We discuss how possible interactions between early (low sensitivity to coarse information) and late stages of the visual system (overreliance on these coarse features) might disrupt SZ&SAD's recognition of facial expressions. Our findings offer perceptual mechanisms through which comorbid SZ&SAD impairs crucial aspects of social cognition, as well as functional psychopathology.

Disentangling presentation and processing times in the brain

Visual object recognition seems to occur almost instantaneously. However, not only does it require hundreds of milliseconds of processing, but our eyes also typically fixate the object for hundreds of milliseconds. Consequently, information reaching our eyes at different moments is processed in the brain together. Moreover, information received at different moments during fixation is likely to be processed differently, notably because different features might be selectively attended at different moments. Here, we introduce a novel reverse correlation paradigm that allows us to uncover with millisecond precision the processing time course of specific information received on the retina at specific moments. Using faces as stimuli, we observed that processing at several electrodes and latencies was different depending on the moment at which information was received. Some of these variations were caused by a disruption occurring 160-200 ​ms after the face onset, suggesting a role of the N170 ERP component in gating information processing; others hinted at temporal compression and integration mechanisms. Importantly, the observed differences were not explained by simple adaptation or repetition priming, they were modulated by the task, and they were correlated with differences in behavior. These results suggest that top-down routines of information sampling are applied to the continuous visual input, even within a single eye fixation.

Differentiating between sensory sensitivity and sensory reactivity in relation to restricted interests and repetitive behaviours

Recent studies have suggested that individuals who exhibit heightened sensitivity also exhibit higher rates and severity of restricted interests and repetitive behaviours. This line of research has been conducted almost exclusively through caregiver reports of sensitivity. Here, a more rigorous psychophysics paradigm was applied to assess sensory sensitivity and relate hypersensitivity to restricted interests and repetitive behaviours. In addition, commonly used questionnaire measures of sensory sensitivity were collected to determine if self-reported measures accurately reflect behavioural measures of sensory sensitivity. In all, 90 typically developing participants completed a visual detection task, a questionnaire measure of sensory processing and a measure of restricted interests and repetitive behaviours. Visual sensitivity, measured both behaviourally and with questionnaires, is positively related to restricted interests and repetitive behaviours. Surprisingly, visual sensitivity as measured behaviourally and through self-report are unrelated. Furthermore, a regression analysis suggests that while restricted interests and repetitive behaviours can be predicted based on both behavioural and self-reported sensitivity, these two predictors account for different portions of the variance in restricted interests and repetitive behaviours. Thus, while these results provide evidence supporting the contribution of sensory sensitivity to restricted interests and repetitive behaviours, these results also indicate that behavioural and questionnaire measures of sensory sensitivity are measuring two distinct constructs. We hypothesize that behavioural measures are measuring sensory sensitivity, while questionnaires measures are in fact measuring sensory reactivity.

Time Course of Cultural Differences in Spatial Frequency Use for Face Identification

Several previous studies of eye movements have put forward that, during face recognition, Easterners spread their attention across a greater part of their visual field than Westerners. Recently, we found that culture’s effect on the perception of faces reaches mechanisms deeper than eye movements, therefore affecting the very nature of information sampled by the visual system: that is, Westerners globally rely more than Easterners on fine-grained visual information (i.e. high spatial frequencies; SFs), whereas Easterners rely more on coarse-grained visual information (i.e. low SFs). These findings suggest that culture influences basic visual processes; however, the temporal onset and dynamics of these culture-specific perceptual differences are still unknown. Here, we investigate the time course of SF use in Western Caucasian (Canadian) and East Asian (Chinese) observers during a face identification task. Firstly, our results confirm that Easterners use relatively lower SFs than Westerners, while the latter use relatively higher SFs. More importantly, our results indicate that these differences arise as early as 34 ms after stimulus onset, and remain stable through time. Our research supports the hypothesis that Westerners and Easterners initially rely on different types of visual information during face processing.

Sensory perception in autism

Autism is a complex neurodevelopmental condition, and little is known about its neurobiology. Much of autism research has focused on the social, communication and cognitive difficulties associated with the condition. However, the recent revision of the diagnostic criteria for autism has brought another key domain of autistic experience into focus: sensory processing. Here, we review the properties of sensory processing in autism and discuss recent computational and neurobiological insights arising from attention to these behaviours. We argue that sensory traits have important implications for the development of animal and computational models of the condition. Finally, we consider how difficulties in sensory processing may relate to the other domains of behaviour that characterize autism.