A Randomized Controlled Trial for Audiovisual Multisensory Perception in Autistic Youth

Differences in audiovisual integration are commonly observed in autism. Temporal binding windows (TBWs) of audiovisual speech can be trained (i.e., narrowed) in non-autistic adults; this study evaluated a computer-based perceptual training in autistic youth and assessed whether treatment outcomes varied according to individual characteristics. Thirty autistic youth aged 8-21 were randomly assigned to a brief perceptual training (n = 15) or a control condition (n = 15). At post-test, the perceptual training group did not differ, on average, on TBWs for trained and untrained stimuli and perception of the McGurk illusion compared to the control group. The training benefited youth with higher language and nonverbal IQ scores; the training caused widened TBWs in youth with co-occurring cognitive and language impairments.

Sound Level Changes the Auditory Cortical Activation Detected with Functional Near-Infrared Spectroscopy

BACKGROUND

Functional near-infrared spectroscopy (fNIRS) is a viable non-invasive technique for functional neuroimaging in the cochlear implant (CI) population; however, the effects of acoustic stimulus features on the fNIRS signal have not been thoroughly examined. This study examined the effect of stimulus level on fNIRS responses in adults with normal hearing or bilateral CIs. We hypothesized that fNIRS responses would correlate with both stimulus level and subjective loudness ratings, but that the correlation would be weaker with CIs due to the compression of acoustic input to electric output.

METHODS

Thirteen adults with bilateral CIs and 16 with normal hearing (NH) completed the study. Signal-correlated noise, a speech-shaped noise modulated by the temporal envelope of speech stimuli, was used to determine the effect of stimulus level in an unintelligible speech-like stimulus between the range of soft to loud speech. Cortical activity in the left hemisphere was recorded.

RESULTS

Results indicated a positive correlation of cortical activation in the left superior temporal gyrus with stimulus level in both NH and CI listeners with an additional correlation between cortical activity and perceived loudness for the CI group. The results are consistent with the literature and our hypothesis.

CONCLUSIONS

These results support the potential of fNIRS to examine auditory stimulus level effects at a group level and the importance of controlling for stimulus level and loudness in speech recognition studies. Further research is needed to better understand cortical activation patterns for speech recognition as a function of both stimulus presentation level and perceived loudness.

Cholinergic modulation of sensory perception and plasticity

Sensory systems are highly plastic, but the mechanisms of sensory plasticity remain unclear. People with vision or hearing loss demonstrate significant neural network reorganization that promotes adaptive changes in other sensory modalities as well as in their ability to combine information across the different senses (i.e., multisensory integration. Furthermore, sensory network remodeling is necessary for sensory restoration after a period of sensory deprivation. Acetylcholine is a powerful regulator of sensory plasticity, and studies suggest that cholinergic medications may improve visual and auditory abilities by facilitating sensory network plasticity. There are currently no approved therapeutics for sensory loss that target neuroplasticity. This review explores the systems-level effects of cholinergic signaling on human visual and auditory perception, with a focus on functional performance, sensory disorders, and neural activity. Understanding the role of acetylcholine in sensory plasticity will be essential for developing targeted treatments for sensory restoration.

Examining the latent structure and correlates of sensory reactivity in autism: a multi-site integrative data analysis by the autism sensory research consortium

BACKGROUND

Differences in responding to sensory stimuli, including sensory hyperreactivity (HYPER), hyporeactivity (HYPO), and sensory seeking (SEEK) have been observed in autistic individuals across sensory modalities, but few studies have examined the structure of these "supra-modal" traits in the autistic population.

METHODS

Leveraging a combined sample of 3868 autistic youth drawn from 12 distinct data sources (ages 3-18 years and representing the full range of cognitive ability), the current study used modern psychometric and meta-analytic techniques to interrogate the latent structure and correlates of caregiver-reported HYPER, HYPO, and SEEK within and across sensory modalities. Bifactor statistical indices were used to both evaluate the strength of a "general response pattern" factor for each supra-modal construct and determine the added value of "modality-specific response pattern" scores (e.g., Visual HYPER). Bayesian random-effects integrative data analysis models were used to examine the clinical and demographic correlates of all interpretable HYPER, HYPO, and SEEK (sub)constructs.

RESULTS

All modality-specific HYPER subconstructs could be reliably and validly measured, whereas certain modality-specific HYPO and SEEK subconstructs were psychometrically inadequate when measured using existing items. Bifactor analyses supported the validity of a supra-modal HYPER construct (ωH = .800) but not a supra-modal HYPO construct (ωH = .653), and supra-modal SEEK models suggested a more limited version of the construct that excluded some sensory modalities (ωH = .800; 4/7 modalities). Modality-specific subscales demonstrated significant added value for all response patterns. Meta-analytic correlations varied by construct, although sensory features tended to correlate most with other domains of core autism features and co-occurring psychiatric symptoms (with general HYPER and speech HYPO demonstrating the largest numbers of practically significant correlations).

LIMITATIONS

Conclusions may not be generalizable beyond the specific pool of items used in the current study, which was limited to caregiver report of observable behaviors and excluded multisensory items that reflect many "real-world" sensory experiences.

CONCLUSION

Of the three sensory response patterns, only HYPER demonstrated sufficient evidence for valid interpretation at the supra-modal level, whereas supra-modal HYPO/SEEK constructs demonstrated substantial psychometric limitations. For clinicians and researchers seeking to characterize sensory reactivity in autism, modality-specific response pattern scores may represent viable alternatives that overcome many of these limitations.

The Processing of Audiovisual Speech Is Linked with Vocabulary in Autistic and Nonautistic Children: An ERP Study

Explaining individual differences in vocabulary in autism is critical, as understanding and using words to communicate are key predictors of long-term outcomes for autistic individuals. Differences in audiovisual speech processing may explain variability in vocabulary in autism. The efficiency of audiovisual speech processing can be indexed via amplitude suppression, wherein the amplitude of the event-related potential (ERP) is reduced at the P2 component in response to audiovisual speech compared to auditory-only speech. This study used electroencephalography (EEG) to measure P2 amplitudes in response to auditory-only and audiovisual speech and norm-referenced, standardized assessments to measure vocabulary in 25 autistic and 25 nonautistic children to determine whether amplitude suppression (a) differs or (b) explains variability in vocabulary in autistic and nonautistic children. A series of regression analyses evaluated associations between amplitude suppression and vocabulary scores. Both groups demonstrated P2 amplitude suppression, on average, in response to audiovisual speech relative to auditory-only speech. Between-group differences in mean amplitude suppression were nonsignificant. Individual differences in amplitude suppression were positively associated with expressive vocabulary through receptive vocabulary, as evidenced by a significant indirect effect observed across groups. The results suggest that efficiency of audiovisual speech processing may explain variance in vocabulary in autism.

The Interictal Suppression Hypothesis in focal epilepsy: network-level supporting evidence

Why are people with focal epilepsy not continuously having seizures? Previous neuronal signalling work has implicated gamma-aminobutyric acid balance as integral to seizure generation and termination, but is a high-level distributed brain network involved in suppressing seizures? Recent intracranial electrographic evidence has suggested that seizure-onset zones have increased inward connectivity that could be associated with interictal suppression of seizure activity. Accordingly, we hypothesize that seizure-onset zones are actively suppressed by the rest of the brain network during interictal states. Full testing of this hypothesis would require collaboration across multiple domains of neuroscience. We focused on partially testing this hypothesis at the electrographic network level within 81 individuals with drug-resistant focal epilepsy undergoing presurgical evaluation. We used intracranial electrographic resting-state and neurostimulation recordings to evaluate the network connectivity of seizure onset, early propagation and non-involved zones. We then used diffusion imaging to acquire estimates of white-matter connectivity to evaluate structure-function coupling effects on connectivity findings. Finally, we generated a resting-state classification model to assist clinicians in detecting seizure-onset and propagation zones without the need for multiple ictal recordings. Our findings indicate that seizure onset and early propagation zones demonstrate markedly increased inwards connectivity and decreased outwards connectivity using both resting-state (one-way ANOVA, P-value = 3.13 × 10-13) and neurostimulation analyses to evaluate evoked responses (one-way ANOVA, P-value = 2.5 × 10-3). When controlling for the distance between regions, the difference between inwards and outwards connectivity remained stable up to 80 mm between brain connections (two-way repeated measures ANOVA, group effect P-value of 2.6 × 10-12). Structure-function coupling analyses revealed that seizure-onset zones exhibit abnormally enhanced coupling (hypercoupling) of surrounding regions compared to presumably healthy tissue (two-way repeated measures ANOVA, interaction effect P-value of 9.76 × 10-21). Using these observations, our support vector classification models achieved a maximum held-out testing set accuracy of 92.0 ± 2.2% to classify early propagation and seizure-onset zones. These results suggest that seizure-onset zones are actively segregated and suppressed by a widespread brain network. Furthermore, this electrographically observed functional suppression is disproportionate to any observed structural connectivity alterations of the seizure-onset zones. These findings have implications for the identification of seizure-onset zones using only brief electrographic recordings to reduce patient morbidity and augment the presurgical evaluation of drug-resistant epilepsy. Further testing of the interictal suppression hypothesis can provide insight into potential new resective, ablative and neuromodulation approaches to improve surgical success rates in those suffering from drug-resistant focal epilepsy.

Near-field potentials index local neural computations more accurately than population spiking

Local field potentials (LFP) are low-frequency extracellular voltage fluctuations thought to primarily arise from synaptic activity. However, unlike highly localized neuronal spiking, LFP is spatially less specific. LFP measured at one location is not entirely generated there due to far-field contributions that are passively conducted across volumes of neural tissue. We sought to quantify how much information within the locally generated, near-field low-frequency activity (nfLFP) is masked by volume-conducted far-field signals. To do so, we measured laminar neural activity in primary visual cortex (V1) of monkeys viewing sequences of multifeatured stimuli. We compared information content of regular LFP and nfLFP that was mathematically stripped of volume-conducted far-field contributions. Information content was estimated by decoding stimulus properties from neural responses via spatiotemporal multivariate pattern analysis. Volume-conducted information differed from locally generated information in two important ways: (1) for stimulus features relevant to V1 processing (orientation and eye-of-origin), nfLFP contained more information. (2) in contrast, the volume-conducted signal was more informative regarding temporal context (relative stimulus position in a sequence), a signal likely to be coming from elsewhere. Moreover, LFP and nfLFP differed both spectrally as well as spatially, urging caution regarding the interpretations of individual frequency bands and/or laminar patterns of LFP. Most importantly, we found that population spiking of local neurons was less informative than either the LFP or nfLFP, with nfLFP containing most of the relevant information regarding local stimulus processing. These findings suggest that the optimal way to read out local computational processing from neural activity is to decode the local contributions to LFP, with significant information loss hampering both regular LFP and local spiking.

Author’s Contributions

Conceptualization, D.A.T., J.A.W, and A.M.; Data Collection, J.A.W., M.A.C., K.D.; Formal Analysis, D.A.T. and J.A.W.; Data Visualization, D.A.T. and J.A.W.; Original Draft, D.A.T., J.A.W., and A.M.; Revisions and Final Draft, D.A.T., J.A.W., M.A.C., K.D., M.T.W., A.M.B., and A.M.

Competing Interests

The authors declare no conflicts of interest.

Localizing seizure onset zones in surgical epilepsy with neurostimulation deep learning

OBJECTIVE

In drug-resistant temporal lobe epilepsy, automated tools for seizure onset zone (SOZ) localization that use brief interictal recordings could supplement presurgical evaluations and improve care. Thus, the authors sought to localize SOZs by training a multichannel convolutional neural network on stereoelectroencephalography (SEEG) cortico-cortical evoked potentials.

METHODS

The authors performed single-pulse electrical stimulation in 10 drug-resistant temporal lobe epilepsy patients implanted with SEEG. Using 500,000 unique poststimulation SEEG epochs, the authors trained a multichannel 1-dimensional convolutional neural network to determine whether an SOZ had been stimulated.

RESULTS

SOZs were classified with mean sensitivity of 78.1% and specificity of 74.6% according to leave-one-patient-out testing. To achieve maximum accuracy, the model required a 0- to 350-msec poststimulation time period. Post hoc analysis revealed that the model accurately classified unilateral versus bilateral mesial temporal lobe seizure onset, as well as neocortical SOZs.

CONCLUSIONS

This was the first demonstration, to the authors' knowledge, that a deep learning framework can be used to accurately classify SOZs with single-pulse electrical stimulation-evoked responses. These findings suggest that accurate classification of SOZs relies on a complex temporal evolution of evoked responses within 350 msec of stimulation. Validation in a larger data set could provide a practical clinical tool for the presurgical evaluation of drug-resistant epilepsy.

Neural Correlates of Audiovisual Speech Processing in Autistic and Non-Autistic Youth

Autistic youth demonstrate differences in processing multisensory information, particularly in temporal processing of multisensory speech. Extensive research has identified several key brain regions for multisensory speech processing in non-autistic adults, including the superior temporal sulcus (STS) and insula, but it is unclear to what extent these regions are involved in temporal processing of multisensory speech in autistic youth. As a first step in exploring the neural substrates of multisensory temporal processing in this clinical population, we employed functional magnetic resonance imaging (fMRI) with a simultaneity-judgment audiovisual speech task. Eighteen autistic youth and a comparison group of 20 non-autistic youth matched on chronological age, biological sex, and gender participated. Results extend prior findings from studies of non-autistic adults, with non-autistic youth demonstrating responses in several similar regions as previously implicated in adult temporal processing of multisensory speech. Autistic youth demonstrated responses in fewer of the multisensory regions identified in adult studies; responses were limited to visual and motor cortices. Group responses in the middle temporal gyrus significantly interacted with age; younger autistic individuals showed reduced MTG responses whereas older individuals showed comparable MTG responses relative to non-autistic controls. Across groups, responses in the precuneus covaried with task accuracy, and anterior temporal and insula responses covaried with nonverbal IQ. These preliminary findings suggest possible differences in neural mechanisms of audiovisual processing in autistic youth while highlighting the need to consider participant characteristics in future, larger-scale studies exploring the neural basis of multisensory function in autism.

Examining the Latent Structure and Correlates of Sensory Reactivity in Autism: A Multi-site Integrative Data Analysis by the Autism Sensory Research Consortium

Background Differences in responding to sensory stimuli, including sensory hyperreactivity (HYPER), hyporeactivity (HYPO), and sensory seeking (SEEK) have been observed in autistic individuals across sensory modalities, but few studies have examined the structure of these "supra-modal" traits in the autistic population. Methods Leveraging a combined sample of 3,868 autistic youth drawn from 12 distinct data sources (ages 3-18 years and representing the full range of cognitive ability), the current study used modern psychometric and meta-analytic techniques to interrogate the latent structure and correlates of caregiver-reported HYPER, HYPO, and SEEK within and across sensory modalities. Bifactor statistical indices were used to both evaluate the strength of a "general response pattern" factor for each supra-modal construct and determine the added value of "modality-specific response pattern" scores (e.g., Visual HYPER). Bayesian random-effects integrative data analysis models were used to examine the clinical and demographic correlates of all interpretable HYPER, HYPO and SEEK (sub)constructs. Results All modality-specific HYPER subconstructs could be reliably and validly measured, whereas certain modality-specific HYPO and SEEK subconstructs were psychometrically inadequate when measured using existing items. Bifactor analyses unambiguously supported the validity of a supra-modal HYPER construct (ω H  = .800), whereas a coherent supra-modal HYPO construct was not supported (ω H  = .611), and supra-modal SEEK models suggested a more limited version of the construct that excluded some sensory modalities (ω H  = .799; 4/7 modalities). Within each sensory construct, modality-specific subscales demonstrated substantial added value beyond the supra-modal score. Meta-analytic correlations varied by construct, although sensory features tended to correlate most strongly with other domains of core autism features and co-occurring psychiatric symptoms. Certain subconstructs within the HYPO and SEEK domains were also associated with lower adaptive behavior scores. Limitations: Conclusions may not be generalizable beyond the specific pool of items used in the current study, which was limited to parent-report of observable behaviors and excluded multisensory items that reflect many "real-world" sensory experiences. Conclusion Psychometric issues may limit the degree to which some measures of supra-modal HYPO/SEEK can be interpreted. Depending on the research question at hand, modality-specific response pattern scores may represent a valid alternative method of characterizing sensory reactivity in autism.

Visually biased Perception in Cochlear Implant Users: A Study of the McGurk and Sound-Induced Flash Illusions

The reduction in spectral resolution by cochlear implants oftentimes requires complementary visual speech cues to facilitate understanding. Despite substantial clinical characterization of auditory-only speech measures, relatively little is known about the audiovisual (AV) integrative abilities that most cochlear implant (CI) users rely on for daily speech comprehension. In this study, we tested AV integration in 63 CI users and 69 normal-hearing (NH) controls using the McGurk and sound-induced flash illusions. To our knowledge, this study is the largest to-date measuring the McGurk effect in this population and the first that tests the sound-induced flash illusion (SIFI). When presented with conflicting AV speech stimuli (i.e., the phoneme "ba" dubbed onto the viseme "ga"), we found that 55 CI users (87%) reported a fused percept of "da" or "tha" on at least one trial. After applying an error correction based on unisensory responses, we found that among those susceptible to the illusion, CI users experienced lower fusion than controls-a result that was concordant with results from the SIFI where the pairing of a single circle flashing on the screen with multiple beeps resulted in fewer illusory flashes for CI users. While illusion perception in these two tasks appears to be uncorrelated among CI users, we identified a negative correlation in the NH group. Because neither illusion appears to provide further explanation of variability in CI outcome measures, further research is needed to determine how these findings relate to CI users' speech understanding, particularly in ecological listening conditions that are naturally multisensory.

Modeling dopamine dysfunction in autism spectrum disorder: From invertebrates to vertebrates

Autism Spectrum Disorder (ASD) is a highly heterogeneous neurodevelopmental disorder characterized by deficits in social communication and by patterns of restricted interests and/or repetitive behaviors. The Simons Foundation Autism Research Initiative's Human Gene and CNV Modules now list over 1000 genes implicated in ASD and over 2000 copy number variant loci reported in individuals with ASD. Given this ever-growing list of genetic changes associated with ASD, it has become evident that there is likely not a single genetic cause of this disorder nor a single neurobiological basis of this disorder. Instead, it is likely that many different neurobiological perturbations (which may represent subtypes of ASD) can result in the set of behavioral symptoms that we called ASD. One such of possible subtype of ASD may be associated with dopamine dysfunction. Precise regulation of synaptic dopamine (DA) is required for reward processing and behavioral learning, behaviors which are disrupted in ASD. Here we review evidence for DA dysfunction in ASD and in animal models of ASD. Further, we propose that these studies provide a scaffold for scientists and clinicians to consider subcategorizing the ASD diagnosis based on the genetic changes, neurobiological difference, and behavioral features identified in individuals with ASD.

Cross-disorder comparison of sensory over-responsivity in chronic tic disorders and obsessive-compulsive disorder

BACKGROUND

Sensory over-responsivity (SOR) refers to excessively intense and/or prolonged behavioral responses to environmental stimuli typically perceived as non-aversive. SOR is prevalent in several neurodevelopmental disorders, including chronic tic disorders (CTDs) and obsessive-compulsive disorder (OCD). Few studies have examined the extent and clinical correlates of SOR across disorders, limiting insights into the phenomenon's transdiagnostic clinical and biological relevance. Such cross-disorder comparisons are of particular interest for CTDs and OCD given their frequent co-occurrence.

OBJECTIVE

We sought to compare the magnitude of SOR between adults with CTD and adults with OCD and to identify the clinical factors most strongly associated with SOR across these disorders.

METHODS

We enrolled 207 age- and sex-matched participants across four diagnostic categories: CTD without OCD (designated "CTD/OCD-"; n = 37), CTD with OCD ("CTD/OCD+"; n = 32), OCD without tic disorder ("OCD"; n = 69), and healthy controls (n = 69). Participants completed a self-report battery of rating scales assessing SOR (Sensory Gating Inventory, SGI), obsessive-compulsive symptoms (Dimensional Obsessive-Compulsive Scale, DOCS), inattention and hyperactivity (Adult ADHD Self-Report Screening Scale for DSM-5, ASRS-5), anxiety (Generalized Anxiety Disorder-7), and depression (Patient Health Questionnaire-9). CTD participants were also administered the Yale Global Tic Severity Scale (YGTSS). To examine between-group differences in SOR, we compared SGI score across all groups and between pairs of groups. To examine the relationship of SOR with other clinical factors, we performed multivariable linear regression.

RESULTS

CTD/OCD-, CTD/OCD+, and OCD participants were 86.7%, 87.6%, and 89.5%, respectively, more likely to have higher SGI total scores than healthy controls. SGI total score did not differ between CTD/OCD-, CTD/OCD+, and OCD groups. In the regression model of log-transformed SGI total score, OCD diagnosis, DOCS score, and ASRS-5 score each contributed significantly to model goodness-of-fit, whereas CTD diagnosis and YGTSS total tic score did not.

CONCLUSION

SOR is prevalent in adults with CTD and in adults with OCD but does not significantly differ in magnitude between these disorders. Across CTD, OCD, and healthy control adult populations, SOR is independently associated with both obsessive-compulsive and ADHD symptoms, suggesting a transdiagnostic relationship between these sensory and psychiatric manifestations. Future cross-disorder, longitudinal, and translational research is needed to clarify the role and prognostic import of SOR in CTDs, OCD, and other neurodevelopmental disorders.

Mechanisms by which Early Eye Gaze to the Mouth During Multisensory Speech Influences Expressive Communication Development in Infant Siblings of Children with and without Autism

Looking to the mouth of a talker early in life predicts expressive communication. We hypothesized that looking at a talker's mouth may signal that infants are ready for increased supported joint engagement and that it subsequently facilitates prelinguistic vocal development and translates to broader gains in expressive communication. We tested this hypothesis in 50 infants aged 6-18 months with heightened and general population-level likelihood of autism diagnosis (Sibs-autism and Sibs-NA; respectively). We measured infants' gaze to a speaker's face using an eye tracking task, supported joint engagement during parent-child free play sessions, vocal complexity during a communication sample, and broader expressive communication. Looking at the mouth was indirectly associated with expressive communication via increased higher-order supported joint engagement and vocal complexity. This indirect effect did not vary according to sibling status. This study provides preliminary insights into the mechanisms by which looking at the mouth may influence expressive communication development.

Functional localization of audiovisual speech using near infrared spectroscopy

Visual cues are especially vital for hearing impaired individuals such as cochlear implant (CI) users to understand speech in noise. Functional Near Infrared Spectroscopy (fNIRS) is a light-based imaging technology that is ideally suited for measuring the brain activity of CI users due to its compatibility with both the ferromagnetic and electrical components of these implants. In a preliminary step toward better elucidating the behavioral and neural correlates of audiovisual (AV) speech integration in CI users, we designed a speech-in-noise task and measured the extent to which 24 normal hearing individuals could integrate the audio of spoken monosyllabic words with the corresponding visual signals of a female speaker. In our behavioral task, we found that audiovisual pairings provided average improvements of 103% and 197% over auditory-alone listening conditions in -6 and -9 dB signal-to-noise ratios consisting of multi-talker background noise. In an fNIRS task using similar stimuli, we measured activity during auditory-only listening, visual-only lipreading, and AV listening conditions. We identified cortical activity in all three conditions over regions of middle and superior temporal cortex typically associated with speech processing and audiovisual integration. In addition, three channels active during the lipreading condition showed uncorrected correlations associated with behavioral measures of audiovisual gain as well as with the McGurk effect. Further work focusing primarily on the regions of interest identified in this study could test how AV speech integration may differ for CI users who rely on this mechanism for daily communication.

Cortical Morphology in Autism: Findings from a Cortical Shape-Adaptive Approach to Local Gyrification Indexing

It has been challenging to elucidate the differences in brain structure that underlie behavioral features of autism. Prior studies have begun to identify patterns of changes in autism across multiple structural indices, including cortical thickness, local gyrification, and sulcal depth. However, common approaches to local gyrification indexing used in prior studies have been limited by low spatial resolution relative to functional brain topography. In this study, we analyze the aforementioned structural indices, utilizing a new method of local gyrification indexing that quantifies this index adaptively in relation to specific sulci/gyri, improving interpretation with respect to functional organization. Our sample included n = 115 autistic and n = 254 neurotypical participants aged 5-54, and we investigated structural patterns by group, age, and autism-related behaviors. Differing structural patterns by group emerged in many regions, with age moderating group differences particularly in frontal and limbic regions. There were also several regions, particularly in sensory areas, in which one or more of the structural indices of interest either positively or negatively covaried with autism-related behaviors. Given the advantages of this approach, future studies may benefit from its application in hypothesis-driven examinations of specific brain regions and/or longitudinal studies to assess brain development in autism.

Relations Between the McGurk Effect, Social and Communication Skill, and Autistic Features in Children with and without Autism

Children with autism show alterations in multisensory integration that have been theoretically and empirically linked with the core and related features of autism. It is unclear, however, to what extent multisensory integration maps onto features of autism within children with and without autism. This study, thus, evaluates relations between audiovisual integration and core and related autism features across children with and without autism. Thirty-six children reported perceptions of the McGurk illusion during a psychophysical task. Parents reported on participants' autistic features. Increased report of illusory percepts tended to covary with reduced autistic features and greater communication skill. Some relations, though, were moderated by group. This work suggests that associations between multisensory integration and higher-order skills are present, but in some instances vary according to diagnostic group.

Psychometric validation and refinement of the Interoception Sensory Questionnaire (ISQ) in adolescents and adults on the autism spectrum

BACKGROUND

Individuals on the autism spectrum are reported to display alterations in interoception, the sense of the internal state of the body. The Interoception Sensory Questionnaire (ISQ) is a 20-item self-report measure of interoception specifically intended to measure this construct in autistic people. The psychometrics of the ISQ, however, have not previously been evaluated in a large sample of autistic individuals.

METHODS

Using confirmatory factor analysis, we evaluated the latent structure of the ISQ in a large online sample of adults on the autism spectrum and found that the unidimensional model fit the data poorly. Using misspecification analysis to identify areas of local misfit and item response theory to investigate the appropriateness of the seven-point response scale, we removed redundant items and collapsed the response options to put forth a novel eight-item, five-response choice ISQ.

RESULTS

The revised, five-response choice ISQ (ISQ-8) showed much improved fit while maintaining high internal reliability. Differential item functioning (DIF) analyses indicated that the items of the ISQ-8 were answered in comparable ways by autistic adolescents and adults and across multiple other sociodemographic groups.

LIMITATIONS

Our results were limited by the fact that we did not collect data for typically developing controls, preventing the analysis of DIF by diagnostic status. Additionally, while this study proposes a new 5-response scale for the ISQ-8, our data were not collected using this method; thus, the psychometric properties for the revised version of this instrument require further investigation.

CONCLUSION

The ISQ-8 shows promise as a reliable and valid measure of interoception in adolescents and adults on the autism spectrum, but additional work is needed to examine its psychometrics in this population. A free online score calculator has been created to facilitate the use of ISQ-8 latent trait scores for further studies of autistic adolescents and adults (available at https://asdmeasures.shinyapps.io/ISQ_score/ ).

Inflexible Updating of the Self-Other Divide During a Social Context in Autism: Psychophysical, Electrophysiological, and Neural Network Modeling Evidence

BACKGROUND

Autism spectrum disorder (ASD) affects many aspects of life, from social interactions to (multi)sensory processing. Similarly, the condition expresses at a variety of levels of description, from genetics to neural circuits and interpersonal behavior. We attempt to bridge between domains and levels of description by detailing the behavioral, electrophysiological, and putative neural network basis of peripersonal space (PPS) updating in ASD during a social context, given that the encoding of this space relies on appropriate multisensory integration, is malleable by social context, and is thought to delineate the boundary between the self and others.

METHODS

Fifty (20 male/30 female) young adults, either diagnosed with ASD or age- and sex-matched individuals, took part in a visuotactile reaction time task indexing PPS, while high-density electroencephalography was continuously recorded. Neural network modeling was performed in silico.

RESULTS

Multisensory psychophysics demonstrates that while PPS in neurotypical individuals shrinks in the presence of others-as to "give space"-this does not occur in ASD. Likewise, electroencephalography recordings suggest that multisensory integration is altered by social context in neurotypical individuals but not in individuals with ASD. Finally, a biologically plausible neural network model shows, as a proof of principle, that PPS updating may be inflexible in ASD owing to the altered excitatory/inhibitory balance that characterizes neural circuits in animal models of ASD.

CONCLUSIONS

Findings are conceptually in line with recent statistical inference accounts, suggesting diminished flexibility in ASD, and further these observations by suggesting within an example relevant for social cognition that such inflexibility may be due to excitatory/inhibitory imbalances.

Autism-Associated Variant in the SLC6A3 Gene Alters the Oral Microbiome and Metabolism in a Murine Model

Background: Altered dopamine (DA) signaling has been associated with autism spectrum disorder (ASD), a neurodevelopmental condition estimated to impact 1 in 54 children in the United States. There is growing evidence for alterations in both gastrointestinal function and oral microbiome composition in ASD. Recent work suggests that rare variants of the SLC6A3 gene encoding the DA transporter (DAT) identified in individuals with ASD result in structural and functional changes to the DAT. One such recently identified de novo mutation is a threonine to methionine substitution at position 356 of the DAT (DAT T356M). The DAT T356M variant is associated with ASD-like phenotypes in mice homozygous for the mutation (DAT T356M+/+), including social deficits, hyperactivity, and impaired DA signaling. Here, we determine the impact of this altered DA signaling as it relates to altered oral microbiota, and metabolic and gastrointestinal dysfunction. Methods: In the DAT T356M+/+ mouse, we determine the oral microbiota composition, metabolic function, and gastrointestinal (GI) function. We examined oral microbiota by 16S RNA sequencing. We measured metabolic function by examining glucose tolerance and we probed gastrointestinal parameters by measuring fecal dimensions and weight. Results: In the DAT T356M+/+ mouse, we evaluate how altered DA signaling relates to metabolic dysfunction and altered oral microbiota. We demonstrate that male DAT T356M+/+ mice weigh less (Wild type (WT) = 26.48 ± 0.6405 g, DAT T356M+/+ = 24.14 ± 0.4083 g) and have decreased body fat (WT = 14.89 ± 0.6206%, DAT T356M+/+ = 12.72 ± 0.4160%). These mice display improved glucose handling (WT = 32.60 ± 0.3298 kcal/g, DAT T356M+/+ = 36.97 ± 0.4910 kcal/g), and an altered oral microbiota. We found a significant decrease in Fusobacterium abundance. The abundance of Fusobacterium was associated with improved glucose handling and decreased body fat. Conclusions: Our findings provide new insights into how DAT dysfunction may alter gastrointestinal function, composition of the oral microbiota, and metabolism. Our data suggest that impaired DA signaling in ASD is associated with a number of metabolic and gastrointestinal changes which are common in individuals with ASD.

Binocular Enhancement of Multisensory Temporal Perception

Purpose

The goal of this study was to examine the behavioral effects and to suggest possible underlying mechanisms of binocularity on audiovisual temporal perception in normally-sighted individuals.

Methods

Participants performed two audiovisual simultaneity judgment tasks-one using simple flashes and beeps and the other using audiovisual speech stimuli-with the left eye, right eye, and both eyes. Two measures, the point of subjective simultaneity (PSS) and the temporal binding window (TBW), an index for audiovisual temporal acuity, were derived for each viewing condition, stimulus type, and participant. The data were then modeled using causal inference, allowing us to determine whether binocularity affected low-level unisensory mechanisms (i.e., sensory noise level) or high-level multisensory mechanisms (i.e., prior probability of interring a common cause, pC=1).

Results

Whereas for the PSS there was no significant effect of viewing condition, for the TBW, a significant interaction between stimulus type and viewing condition was found. Post hoc analyses revealed a significantly narrower TBW during binocular than monocular viewing (average of left and right eyes) for the flash-beep condition but no difference between the viewing conditions for the speech stimuli. Modeling results showed no significant difference in pC=1 but a significant reduction in sensory noise during binocular performance on flash-beep trials.

Conclusions

Binocular viewing was found to enhance audiovisual temporal acuity as indexed by the TBW for simple low-level audiovisual stimuli. Furthermore, modeling results suggest that this effect may stem from enhanced sensory representations evidenced as a reduction in sensory noise affecting the measurement of physical asynchrony during audiovisual temporal perception.

Brief period of monocular deprivation drives changes in audiovisual temporal perception

The human brain retains a striking degree of plasticity into adulthood. Recent studies have demonstrated that a short period of altered visual experience (via monocular deprivation) can change the dynamics of binocular rivalry in favor of the deprived eye, a compensatory action thought to be mediated by an upregulation of cortical gain control mechanisms. Here, we sought to better understand the impact of monocular deprivation on multisensory abilities, specifically examining audiovisual temporal perception. Using an audiovisual simultaneity judgment task, we discovered that 90 minutes of monocular deprivation produced opposing effects on the temporal binding window depending on the eye used in the task. Thus, in those who performed the task with their deprived eye there was a narrowing of the temporal binding window, whereas in those performing the task with their nondeprived eye there was a widening of the temporal binding window. The effect was short lived, being observed only in the first 10 minutes of postdeprivation testing. These findings indicate that changes in visual experience in the adult can rapidly impact multisensory perceptual processes, a finding that has important clinical implications for those patients with adult-onset visual deprivation and for therapies founded on monocular deprivation.

Stimulus Feature-Specific Information Flow Along the Columnar Cortical Microcircuit Revealed by Multivariate Laminar Spiking Analysis

Most of the mammalian neocortex is comprised of a highly similar anatomical structure, consisting of a granular cell layer between superficial and deep layers. Even so, different cortical areas process different information. Taken together, this suggests that cortex features a canonical functional microcircuit that supports region-specific information processing. For example, the primate primary visual cortex (V1) combines the two eyes' signals, extracts stimulus orientation, and integrates contextual information such as visual stimulation history. These processes co-occur during the same laminar stimulation sequence that is triggered by the onset of visual stimuli. Yet, we still know little regarding the laminar processing differences that are specific to each of these types of stimulus information. Univariate analysis techniques have provided great insight by examining one electrode at a time or by studying average responses across multiple electrodes. Here we focus on multivariate statistics to examine response patterns across electrodes instead. Specifically, we applied multivariate pattern analysis (MVPA) to linear multielectrode array recordings of laminar spiking responses to decode information regarding the eye-of-origin, stimulus orientation, and stimulus repetition. MVPA differs from conventional univariate approaches in that it examines patterns of neural activity across simultaneously recorded electrode sites. We were curious whether this added dimensionality could reveal neural processes on the population level that are challenging to detect when measuring brain activity without the context of neighboring recording sites. We found that eye-of-origin information was decodable for the entire duration of stimulus presentation, but diminished in the deepest layers of V1. Conversely, orientation information was transient and equally pronounced along all layers. More importantly, using time-resolved MVPA, we were able to evaluate laminar response properties beyond those yielded by univariate analyses. Specifically, we performed a time generalization analysis by training a classifier at one point of the neural response and testing its performance throughout the remaining period of stimulation. Using this technique, we demonstrate repeating (reverberating) patterns of neural activity that have not previously been observed using standard univariate approaches.

Evaluating Sensory Integration/Sensory Processing Treatment: Issues and Analysis

For more than 50 years, "Sensory Integration" has been a theoretical framework for diagnosing and treating disabilities in children under the umbrella of "sensory integration dysfunction" (SID). More recently, the approach has been reframed as "the dimensions of sensory processing" or SPD in place of SID, so the review herein describes this collective framework as sensory integration/sensory processing treatment (SI/SP-T) for ASD. This review is not focused on diagnosis of SI/SPD. Broadly, the SI/SPD intervention approach views a plethora of disabilities such as ADHD, ASD, and disruptive behavior as being exacerbated by difficulties in modulating and integrating sensory input with a primary focus on contributions from tactile, proprioceptive, and vestibular systems which are hypothesized to contribute to core symptoms of the conditions (e.g., ASD). SI/SP intervention procedures include sensory protocols designed to enhance tactile, proprioceptive, and vestibular experiences. SI/SP-T procedures utilize equipment (e.g., lycra swings, balance beams, climbing walls, and trampolines), specific devices (e.g., weighted vests, sensory brushes) and activities (e.g., placing hands in messy substances such as shaving cream, sequenced movements) hypothesized to enhance sensory integration and sensory processing. The approach is reviewed herein to provide a framework for testing SI/SP-T using widely accepted clinical trials and event coding methods used in applied behavior analysis (ABA) and other behavioral interventions. Also, a related but distinct neuroscientific paradigm, multisensory integration, is presented as an independent test of whether SI/SP-T differentially impacts sensory integration and/or multisensory integration. Finally, because SI/SP-T activities include many incidental behavioral events that are known as developmental facilitators (e.g., contingent verbal models/recasts during verbal interactions), there is a compelling need to control for confounds to study the unique impact of sensory-based interventions. Note that SI/SP-T includes very specific and identifiable procedures and materials, so it is reasonable to expect high treatment fidelity when testing the approach. A patient case is presented that illustrates this confound with a known facilitator (recast intervention) and a method for controlling potential confounds in order to conduct unbiased studies of the effects of SI/SP-T approaches that accurately represent SI/SP-T theories of change.

Relations between Sensory Responsiveness and Features of Autism in Children

Autism is a neurodevelopmental condition defined by differences in social communication and by the presence of restricted and repetitive patterns of behavior, interests, and activities (RRBs). Individuals with autism also commonly present with atypical patterns of sensory responsiveness (i.e., hyporesponsiveness, hyperresponsiveness, and sensory seeking), which are theorized to produce cascading effects across other domains of development. The purpose of this study was to examine differences in sensory responsiveness in children with and without autism (ages 8–18 years), as well as relations between patterns of sensory responsiveness and core and related features of autism. Participants were 50 children with autism and 50 non-autistic peers matched on age and sex. A comprehensive clinical battery included multiple measures of sensory responsiveness, core features of autism, adaptive behavior, internalizing behaviors, cognitive ability, and language ability. Groups significantly differed on all three patterns of sensory responsiveness. Some indices of core and related autism features were robustly associated with all three patterns of sensory responsiveness (e.g., RRBs), while others were more strongly associated with discrete patterns of sensory responsiveness (i.e., internalizing problem behaviors and hyperresponsiveness, language and sensory seeking). This study extends prior work to show that differences in sensory responsiveness that are linked with core and related features of autism persist in older children and adolescents on the spectrum.

Visual-Tactile Spatial Multisensory Interaction in Adults With Autism and Schizophrenia

Background: Individuals with autism spectrum disorder (ASD) and schizophrenia (SZ) exhibit multisensory processing difficulties and social impairments, with growing evidence that the former contributes to the latter. However, this work has largely reported on separate cohorts, introducing method variance as a barrier to drawing broad conclusions across studies. Further, very few studies have addressed touch, resulting in sparse knowledge about how these two clinical groups may integrate somatic information with other senses. Methods: In this study, we compared adults with ASD (n = 29), SZ (n = 24), and typical developmental histories (TD, n = 37) on two tasks requiring visual-tactile spatial multisensory processing. In the first task (crossmodal congruency), participants judged the location of a tactile stimulus in the presence or absence of simultaneous visual input that was either spatially congruent or incongruent, with poorer performance for incongruence an index of spatial multisensory interaction. In the second task, participants reacted to touch in the presence or absence of dynamic visual stimuli that appeared to approach or recede from the body. Within a certain radius around the body, defined as peripersonal space (PPS), an approaching visual or auditory stimulus reliably speeds reaction times (RT) to touch; outside of this radius, in extrapersonal space (EPS), there is no multisensory effect. PPS can be defined both by its size (radius) and slope (sharpness of the PPS-EPS boundary). Clinical measures were administered to explore relations with visual-tactile processing. Results: Neither clinical group differed from controls on the crossmodal congruency task. The ASD group had significantly smaller and more sharply-defined PPSs compared to the other two groups. Small PPS size was related to social symptom severity across groups, but was largely driven by the TD group, without significant effects in either clinical group. Conclusions: These results suggest that: (1) spatially static visual-tactile facilitation is intact in adults with ASD and SZ, (2) spatially dynamic visual-tactile facilitation impacting perception of the body boundary is affected in ASD but not SZ, and (3) body boundary perception is related to social-emotional function, but not in a way that maps on to clinical status.

A visual lamina in the medulla oblongata of the frog, Rana pipiens

We have discovered a lamina of visually responsive units in the medulla oblongata of the frog. It spans the entire medial aspect of the rostrocaudal length of the medulla and extends dorsoventrally from the cell-dense dorsal zone into the cell-sparse ventral zone. Most visual units within this lamina have large receptive fields, with the majority extending bilaterally in the frontal visual field. Most of these neurons are binocular, have no apparent directional preference, respond equally well to stimuli of a variety of shapes and sizes, and exhibit strong habituation. More medial locations in the visual lamina represent ipsilateral visual space while more lateral locations within the lamina represent contralateral visual space. Many units in the caudal aspect of the visual lamina are bimodal, responding to both visual and somatosensory stimuli. HRP tracing reveals inputs to the lamina from many primary and secondary visual areas in the midbrain and diencephalon. There is no area-by-area segregation of the projections to the visual lamina. For example, most parts of the tectum project across the visual lamina. The only spatial order in the visual lamina is that at more medial sites there tends to be more input from contralateral tectum; and at more lateral sites there tends to be more input from ipsilateral tectum. There is bilateral input to the visual lamina from tectum, tegmentum, posterior nucleus of the thalamus, posterior tuberculum, and ventromedial thalamic nucleus. There is ipsilateral input to the visual lamina from torus semicircularis, pretectum, nucleus of Bellonci, and ventrolateral thalamic nucleus. There is contralateral input to the visual lamina from basal optic complex. Collectively, these results show the presence of visual influences in regions of the medulla that likely represent an important step in sensorimotor transformation.

Neonatal Multisensory Processing in Preterm and Term Infants Predicts Sensory Reactivity and Internalizing Tendencies in Early Childhood

Multisensory processes include the capacity to combine information from the different senses, often improving stimulus representations and behavior. The extent to which multisensory processes are an innate capacity or instead require experience with environmental stimuli remains debated. We addressed this knowledge gap by studying multisensory processes in prematurely born and full-term infants. We recorded 128-channel event-related potentials (ERPs) from a cohort of 55 full-term and 61 preterm neonates (at an equivalent gestational age) in response to auditory, somatosensory, and combined auditory-somatosensory multisensory stimuli. Data were analyzed within an electrical neuroimaging framework, involving unsupervised topographic clustering of the ERP data. Multisensory processing in full-term infants was characterized by a simple linear summation of responses to auditory and somatosensory stimuli alone, which furthermore shared common ERP topographic features. We refer to the ERP topography observed in full-term infants as "typical infantile processing" (TIP). In stark contrast, preterm infants exhibited non-linear responses and topographies less-often characterized by TIP; there were distinct patterns of ERP topographies to multisensory and summed unisensory conditions. We further observed that the better TIP characterized an infant's ERPs, independently of prematurity, the more typical was the score on the Infant/Toddler Sensory Profile (ITSP) at 12 months of age and the less likely was the child to the show internalizing tendencies at 24 months of age. Collectively, these results highlight striking differences in the brain's responses to multisensory stimuli in children born prematurely; differences that relate to later sensory and internalizing functions.

Approaches to Understanding Multisensory Dysfunction in Autism Spectrum Disorder

Abnormal sensory responses are a DSM-5 symptom of autism spectrum disorder (ASD), and research findings demonstrate altered sensory processing in ASD. Beyond difficulties with processing information within single sensory domains, including both hypersensitivity and hyposensitivity, difficulties in multisensory processing are becoming a core issue of focus in ASD. These difficulties may be targeted by treatment approaches such as "sensory integration," which is frequently applied in autism treatment but not yet based on clear evidence. Recently, psychophysical data have emerged to demonstrate multisensory deficits in some children with ASD. Unlike deficits in social communication, which are best understood in humans, sensory and multisensory changes offer a tractable marker of circuit dysfunction that is more easily translated into animal model systems to probe the underlying neurobiological mechanisms. Paralleling experimental paradigms that were previously applied in humans and larger mammals, we and others have demonstrated that multisensory function can also be examined behaviorally in rodents. Here, we review the sensory and multisensory difficulties commonly found in ASD, examining laboratory findings that relate these findings across species. Next, we discuss the known neurobiology of multisensory integration, drawing largely on experimental work in larger mammals, and extensions of these paradigms into rodents. Finally, we describe emerging investigations into multisensory processing in genetic mouse models related to autism risk. By detailing findings from humans to mice, we highlight the advantage of multisensory paradigms that can be easily translated across species, as well as the potential for rodent experimental systems to reveal opportunities for novel treatments. LAY SUMMARY: Sensory and multisensory deficits are commonly found in ASD and may result in cascading effects that impact social communication. By using similar experiments to those in humans, we discuss how studies in animal models may allow an understanding of the brain mechanisms that underlie difficulties in multisensory integration, with the ultimate goal of developing new treatments. Autism Res 2020, 13: 1430-1449. © 2020 International Society for Autism Research, Wiley Periodicals, Inc.

Rapid Recalibration of Peri-Personal Space: Psychophysical, Electrophysiological, and Neural Network Modeling Evidence

Interactions between individuals and the environment occur within the peri-personal space (PPS). The encoding of this space plastically adapts to bodily constraints and stimuli features. However, these remapping effects have not been demonstrated on an adaptive time-scale, trial-to-trial. Here, we test this idea first via a visuo-tactile reaction time (RT) paradigm in augmented reality where participants are asked to respond as fast as possible to touch, as visual objects approach them. Results demonstrate that RTs to touch are facilitated as a function of visual proximity, and the sigmoidal function describing this facilitation shifts closer to the body if the immediately precedent trial had indexed a smaller visuo-tactile disparity. Next, we derive the electroencephalographic correlates of PPS and demonstrate that this multisensory measure is equally shaped by recent sensory history. Finally, we demonstrate that a validated neural network model of PPS is able to account for the present results via a simple Hebbian plasticity rule. The present findings suggest that PPS encoding remaps on a very rapid time-scale and, more generally, that it is sensitive to sensory history, a key feature for any process contextualizing subsequent incoming sensory information (e.g., a Bayesian prior).

Selective Enhancement of Object Representations through Multisensory Integration

Objects are the fundamental building blocks of how we create a representation of the external world. One major distinction among objects is between those that are animate versus those that are inanimate. In addition, many objects are specified by more than a single sense, yet the nature by which multisensory objects are represented by the brain remains poorly understood. Using representational similarity analysis of male and female human EEG signals, we show enhanced encoding of audiovisual objects when compared with their corresponding visual and auditory objects. Surprisingly, we discovered that the often-found processing advantages for animate objects were not evident under multisensory conditions. This was due to a greater neural enhancement of inanimate objects-which are more weakly encoded under unisensory conditions. Further analysis showed that the selective enhancement of inanimate audiovisual objects corresponded with an increase in shared representations across brain areas, suggesting that the enhancement was mediated by multisensory integration. Moreover, a distance-to-bound analysis provided critical links between neural findings and behavior. Improvements in neural decoding at the individual exemplar level for audiovisual inanimate objects predicted reaction time differences between multisensory and unisensory presentations during a Go/No-Go animate categorization task. Links between neural activity and behavioral measures were most evident at intervals of 100-200 ms and 350-500 ms after stimulus presentation, corresponding to time periods associated with sensory evidence accumulation and decision-making, respectively. Collectively, these findings provide key insights into a fundamental process the brain uses to maximize the information it captures across sensory systems to perform object recognition.SIGNIFICANCE STATEMENT Our world is filled with ever-changing sensory information that we are able to seamlessly transform into a coherent and meaningful perceptual experience. We accomplish this feat by combining different stimulus features into objects. However, despite the fact that these features span multiple senses, little is known about how the brain combines the various forms of sensory information into object representations. Here, we used EEG and machine learning to study how the brain processes auditory, visual, and audiovisual objects. Surprisingly, we found that nonliving (i.e., inanimate) objects, which are more difficult to process with one sense alone, benefited the most from engaging multiple senses.

Stability of Variables Derived From Measures of Multisensory Function in Children With Autism Spectrum Disorder

Children with autism spectrum disorder (ASD) display differences in multisensory function as quantified by several different measures. This study estimated the stability of variables derived from commonly used measures of multisensory function in school-aged children with ASD. Participants completed: a simultaneity judgment task for audiovisual speech, tasks designed to elicit the McGurk effect, listening-in-noise tasks, electroencephalographic recordings, and eye-tracking tasks. Results indicate the stability of indices derived from tasks tapping multisensory processing is variable. These findings have important implications for measurement in future research. Averaging scores across repeated observations will often be required to obtain acceptably stable estimates and, thus, to increase the likelihood of detecting effects of interest, as it relates to multisensory processing in children with ASD.

Plasticity of Temporal Binding in Children with Autism Spectrum Disorder:A Single Case Experimental Design Perceptual Training Study

BACKGROUND

Many children with autism spectrum disorder (ASD) demonstrate atypical responses to multisensory stimuli. These disruptions, which are frequently seen in response to audiovisual speech, may produce cascading effects on the broader development of children with ASD. Perceptual training has been shown to enhance multisensory speech perception in typically developed adults. This study was the first to examine the effects of perceptual training on audiovisual speech perception in children with ASD.

METHOD

A multiple baseline across participants design was utilized with four 7- to 13-year-old children with ASD. The dependent variable, which was probed outside the training task each day using a simultaneity judgment task in baseline, intervention, and maintenance conditions, was audiovisual temporal binding window (TBW), an index of multisensory temporal acuity. During perceptual training, participants completed the same simultaneity judgment task with feedback on their accuracy after each trial in easy-, medium-, and hard-difficulty blocks.

RESULTS

A functional relation between the multisensory perceptual training program and TBW size was not observed. Of the three participants who were entered into training, one participant demonstrated a strong effect, characterized by a fairly immediate change in TBW trend. The two remaining participants demonstrated a less clear response (i.e., longer latency to effect, lack of functional independence). The first participant to enter the training condition demonstrated some maintenance of a narrower TBW post-training.

CONCLUSIONS

Results indicate TBWs in children with ASD may be malleable, but additional research is needed and may entail further adaptation to the multisensory perceptual training paradigm.

Multisensory Integration as a Window into Orderly and Disrupted Cognition and Communication

During our everyday lives, we are confronted with a vast amount of information from several sensory modalities. This multisensory information needs to be appropriately integrated for us to effectively engage with and learn from our world. Research carried out over the last half century has provided new insights into the way such multisensory processing improves human performance and perception; the neurophysiological foundations of multisensory function; the time course for its development; how multisensory abilities differ in clinical populations; and, most recently, the links between multisensory processing and cognitive abilities. This review summarizes the extant literature on multisensory function in typical and atypical circumstances, discusses the implications of the work carried out to date for theory and research, and points toward next steps for advancing the field.

Sensory Hypersensitivity Severity and Association with Obsessive-Compulsive Symptoms in Adults with Tic Disorder

BACKGROUND

Sensory hypersensitivity, defined as heightened awareness of and reactivity to external stimuli, is a bothersome symptom that affects up to 80% of adults with Tourette syndrome (TS). Such widespread prevalence suggests sensory hypersensitivity is a core feature of the disorder, but its severity and association with other clinical features of TS remain largely unexplored. Complicating matters, sensory hypersensitivity has been observed in two neurodevelopmental disorders commonly comorbid with TS: obsessive-compulsive disorder (OCD) and attention deficit hyperactivity disorder (ADHD).

OBJECTIVE

We sought to measure sensory hypersensitivity in TS patients relative to healthy controls and to investigate the relationship of sensory hypersensitivity with OCD and ADHD symptoms in the context of TS.

METHODS

We recruited 34 adults with TS or chronic tic disorder to undergo evaluation with the Yale Global Tic Severity Scale (YGTSS) and a battery of validated self-report instruments assessing sensory hypersensitivity (Sensory Gating Inventory, SGI; Sensory Perception Quotient, SPQ), premonitory urge (Premonitory Urge to Tic Scale, PUTS), OCD (Dimensional Obsessive-Compulsive Scale, DOCS), and ADHD (Adult ADHD Self-Report Screening Scale for DSM-5, ASRS-V). Age- and sex-matched healthy controls were recruited to complete SGI and psychiatric measures.

RESULTS

SGI and SPQ scores strongly correlated (r _s = -0.73, p < 0.0001) within patients. SGI total score was significantly higher in patients versus controls (119.0 vs 67.6, U =-5.3, p < 0.0001), indicating greater sensory hypersensitivity in the tic disorder group. SGI score correlated modestly with PUTS, DOCS, and ASRS-V scores but not with YGTSS total tic score. Hierarchical linear regression analysis revealed that, of the tested variables, only DOCS score contributed significantly to mean SGI score, with β ranging from 1.03 (p = 0.044) to 1.41 (p = 0.001). A simple linear regression model with DOCS as the independent variable accounted for 31.9% of SGI score variance.

CONCLUSION

Sensory hypersensitivity is prominent in adults with tic disorder and is independently associated with obsessive-compulsive symptom severity.

Leveraging Nonhuman Primate Multisensory Neurons and Circuits in Assessing Consciousness Theory

Both the global neuronal workspace (GNW) and integrated information theory (IIT) posit that highly complex and interconnected networks engender perceptual awareness. GNW specifies that activity recruiting frontoparietal networks will elicit a subjective experience, whereas IIT is more concerned with the functional architecture of networks than with activity within it. Here, we argue that according to IIT mathematics, circuits converging on integrative versus convergent yet non-integrative neurons should support a greater degree of consciousness. We test this hypothesis by analyzing a dataset of neuronal responses collected simultaneously from primary somatosensory cortex (S1) and ventral premotor cortex (vPM) in nonhuman primates presented with auditory, tactile, and audio-tactile stimuli as they are progressively anesthetized with propofol. We first describe the multisensory (audio-tactile) characteristics of S1 and vPM neurons (mean and dispersion tendencies, as well as noise-correlations), and functionally label these neurons as convergent or integrative according to their spiking responses. Then, we characterize how these different pools of neurons behave as a function of consciousness. At odds with the IIT mathematics, results suggest that convergent neurons more readily exhibit properties of consciousness (neural complexity and noise correlation) and are more impacted during the loss of consciousness than integrative neurons. Last, we provide support for the GNW by showing that neural ignition (i.e., same trial coactivation of S1 and vPM) was more frequent in conscious than unconscious states. Overall, we contrast GNW and IIT within the same single-unit activity dataset, and support the GNW.SIGNIFICANCE STATEMENT A number of prominent theories of consciousness exist, and a number of these share strong commonalities, such as the central role they ascribe to integration. Despite the important and far reaching consequences developing a better understanding of consciousness promises to bring, for instance in diagnosing disorders of consciousness (e.g., coma, vegetative-state, locked-in syndrome), these theories are seldom tested via invasive techniques (with high signal-to-noise ratios), and never directly confronted within a single dataset. Here, we first derive concrete and testable predictions from the global neuronal workspace and integrated information theory of consciousness. Then, we put these to the test by functionally labeling specific neurons as either convergent or integrative nodes, and examining the response of these neurons during anesthetic-induced loss of consciousness.

Increased Neural Strength and Reliability to Audiovisual Stimuli at the Boundary of Peripersonal Space

The actionable space surrounding the body, referred to as peripersonal space (PPS), has been the subject of significant interest of late within the broader framework of embodied cognition. Neurophysiological and neuroimaging studies have shown the representation of PPS to be built from visuotactile and audiotactile neurons within a frontoparietal network and whose activity is modulated by the presence of stimuli in proximity to the body. In contrast to single-unit and fMRI studies, an area of inquiry that has received little attention is the EEG characterization associated with PPS processing. Furthermore, although PPS is encoded by multisensory neurons, to date there has been no EEG study systematically examining neural responses to unisensory and multisensory stimuli, as these are presented outside, near, and within the boundary of PPS. Similarly, it remains poorly understood whether multisensory integration is generally more likely at certain spatial locations (e.g., near the body) or whether the cross-modal tactile facilitation that occurs within PPS is simply due to a reduction in the distance between sensory stimuli when close to the body and in line with the spatial principle of multisensory integration. In the current study, to examine the neural dynamics of multisensory processing within and beyond the PPS boundary, we present auditory, visual, and audiovisual stimuli at various distances relative to participants' reaching limit—an approximation of PPS—while recording continuous high-density EEG. We question whether multisensory (vs. unisensory) processing varies as a function of stimulus–observer distance. Results demonstrate a significant increase of global field power (i.e., overall strength of response across the entire electrode montage) for stimuli presented at the PPS boundary—an increase that is largest under multisensory (i.e., audiovisual) conditions. Source localization of the major contributors to this global field power difference suggests neural generators in the intraparietal sulcus and insular cortex, hubs for visuotactile and audiotactile PPS processing. Furthermore, when neural dynamics are examined in more detail, changes in the reliability of evoked potentials in centroparietal electrodes are predictive on a subject-by-subject basis of the later changes in estimated current strength at the intraparietal sulcus linked to stimulus proximity to the PPS boundary. Together, these results provide a previously unrealized view into the neural dynamics and temporal code associated with the encoding of nontactile multisensory around the PPS boundary.

Autism-linked dopamine transporter mutation alters striatal dopamine neurotransmission and dopamine-dependent behaviors

The precise regulation of synaptic dopamine (DA) content by the dopamine transporter (DAT) ensures the phasic nature of the DA signal, which underlies the ability of DA to encode reward prediction error, thereby driving motivation, attention, and behavioral learning. Disruptions to the DA system are implicated in a number of neuropsychiatric disorders, including attention deficit hyperactivity disorder (ADHD) and, more recently, Autism Spectrum Disorder (ASD). An ASD-associated de novo mutation in the SLC6A3 gene resulting in a threonine to methionine substitution at site 356 (DAT T356M) was recently identified and has been shown to drive persistent reverse transport of DA (i.e. anomalous DA efflux) in transfected cells and to drive hyperlocomotion in Drosophila melanogaster. A corresponding mutation in the leucine transporter, a DAT-homologous transporter, promotes an outward-facing transporter conformation upon substrate binding, a conformation possibly underlying anomalous dopamine efflux. Here we investigated in vivo the impact of this ASD-associated mutation on DA signaling and ASD-associated behaviors. We found that mice homozygous for this mutation display impaired striatal DA neurotransmission and altered DA-dependent behaviors that correspond with some of the behavioral phenotypes observed in ASD.

Brief Report: Differences in Multisensory Integration Covary with Sensory Responsiveness in Children with and without Autism Spectrum Disorder

Research shows that children with autism spectrum disorder (ASD) differ in their behavioral patterns of responding to sensory stimuli (i.e., sensory responsiveness) and in various other aspects of sensory functioning relative to typical peers. This study explored relations between measures of sensory responsiveness and multisensory speech perception and integration in children with and without ASD. Participants were 8-17 year old children, 18 with ASD and 18 matched typically developing controls. Participants completed a psychophysical speech perception task, and parents reported on children's sensory responsiveness. Psychophysical measures (e.g., audiovisual accuracy, temporal binding window) were associated with patterns of sensory responsiveness (e.g., hyporesponsiveness, sensory seeking). Results indicate that differences in multisensory speech perception and integration covary with atypical patterns of sensory responsiveness.

Audiovisual multisensory integration in individuals with autism spectrum disorder: A systematic review and meta-analysis

An ever-growing literature has aimed to determine how individuals with autism spectrum disorder (ASD) differ from their typically developing (TD) peers on measures of multisensory integration (MSI) and to ascertain the degree to which differences in MSI are associated with the broad range of symptoms associated with ASD. Findings, however, have been highly variable across the studies carried out to date. The present work systematically reviews and quantitatively synthesizes the large literature on audiovisual MSI in individuals with ASD to evaluate the cumulative evidence for (a) group differences between individuals with ASD and TD peers, (b) correlations between MSI and autism symptoms in individuals with ASD and (c) study level factors that may moderate findings (i.e., explain differential effects) observed across studies. To identify eligible studies, a comprehensive search strategy was employed using the ProQuest search engine, PubMed database, forwards and backwards citation searches, direct author contact, and hand-searching of select conference proceedings. A significant between-group difference in MSI was evident in the literature, with individuals with ASD demonstrating worse audiovisual integration on average across studies compared to TD controls. This effect was moderated by mean participant age, such that between-group differences were more pronounced in younger samples. The mean correlation between MSI and autism and related symptomatology was also significant, indicating that increased audiovisual integration in individuals with ASD is associated with better language/communication abilities and/or reduced autism symptom severity in the extant literature. This effect was moderated by whether the stimuli were linguistic versus non-linguistic in nature, such that correlation magnitudes tended to be significantly greater when linguistic stimuli were utilized in the measure of MSI. Limitations and future directions for primary and meta-analytic research are discussed.

Multisensory perception reflects individual differences in processing temporal correlations

Sensory signals originating from a single event, such as audiovisual speech, are temporally correlated. Correlated signals are known to facilitate multisensory integration and binding. We sought to further elucidate the nature of this relationship, hypothesizing that multisensory perception will vary with the strength of audiovisual correlation. Human participants detected near-threshold amplitude modulations in auditory and/or visual stimuli. During audiovisual trials, the frequency and phase of auditory modulations were varied, producing signals with a range of correlations. After accounting for individual differences which likely reflect relative unisensory temporal characteristics in participants, we found that multisensory perception varied linearly with strength of correlation. Diffusion modelling confirmed this and revealed that stimulus correlation is supplied to the decisional system as sensory evidence. These data implicate correlation as an important cue in audiovisual feature integration and binding and suggest correlational strength as an important factor for flexibility in these processes.

Audiovisual Temporal Processing in Postlingually Deafened Adults with Cochlear Implants

For many cochlear implant (CI) users, visual cues are vitally important for interpreting the impoverished auditory speech information that an implant conveys. Although the temporal relationship between auditory and visual stimuli is crucial for how this information is integrated, audiovisual temporal processing in CI users is poorly understood. In this study, we tested unisensory (auditory alone, visual alone) and multisensory (audiovisual) temporal processing in postlingually deafened CI users (n = 48) and normal-hearing controls (n = 54) using simultaneity judgment (SJ) and temporal order judgment (TOJ) tasks. We varied the timing onsets between the auditory and visual components of either a syllable/viseme or a simple flash/beep pairing, and participants indicated either which stimulus appeared first (TOJ) or if the pair occurred simultaneously (SJ). Results indicate that temporal binding windows-the interval within which stimuli are likely to be perceptually 'bound'-are not significantly different between groups for either speech or non-speech stimuli. However, the point of subjective simultaneity for speech was less visually leading in CI users, who interestingly, also had improved visual-only TOJ thresholds. Further signal detection analysis suggests that this SJ shift may be due to greater visual bias within the CI group, perhaps reflecting heightened attentional allocation to visual cues.

Acoustic features of auditory medical alarms-An experimental study of alarm volume

Audible alarms are a ubiquitous feature of all high-paced, high-risk domains such as aviation and nuclear power where operators control complex systems. In such settings, a missed alarm can have disastrous consequences. It is conventional wisdom that for alarms to be heard, "louder is better," so that alarm levels in operational environments routinely exceed ambient noise levels. Through a robust experimental paradigm in an anechoic environment to study human response to audible alerting stimuli in a cognitively demanding setting, akin to high-tempo and high-risk domains, clinician participants responded to patient crises while concurrently completing an auditory speech intelligibility and visual vigilance distracting task as the level of alarms were varied as a signal-to-noise ratio above and below hospital background noise. There was little difference in performance on the primary task when the alarm sound was -11 dB below background noise as compared with +4 dB above background noise-a typical real-world situation. Concurrent presentation of the secondary auditory speech intelligibility task significantly degraded performance. Operator performance can be maintained with alarms that are softer than background noise. These findings have widespread implications for the design and implementation of alarms across all high-consequence settings.

Probing Electrophysiological Indices of Perceptual Awareness across Unisensory and Multisensory Modalities

The neural underpinnings of perceptual awareness have been extensively studied using unisensory (e.g., visual alone) stimuli. However, perception is generally multisensory, and it is unclear whether the neural architecture uncovered in these studies directly translates to the multisensory domain. Here, we use EEG to examine brain responses associated with the processing of visual, auditory, and audiovisual stimuli presented near threshold levels of detectability, with the aim of deciphering similarities and differences in the neural signals indexing the transition into perceptual awareness across vision, audition, and combined visual-auditory (multisensory) processing. More specifically, we examine (1) the presence of late evoked potentials (∼>300 msec), (2) the across-trial reproducibility, and (3) the evoked complexity associated with perceived versus nonperceived stimuli. Results reveal that, although perceived stimuli are associated with the presence of late evoked potentials across each of the examined sensory modalities, between-trial variability and EEG complexity differed for unisensory versus multisensory conditions. Whereas across-trial variability and complexity differed for perceived versus nonperceived stimuli in the visual and auditory conditions, this was not the case for the multisensory condition. Taken together, these results suggest that there are fundamental differences in the neural correlates of perceptual awareness for unisensory versus multisensory stimuli. Specifically, the work argues that the presence of late evoked potentials, as opposed to neural reproducibility or complexity, most closely tracks perceptual awareness regardless of the nature of the sensory stimulus. In addition, the current findings suggest a greater similarity between the neural correlates of perceptual awareness of unisensory (visual and auditory) stimuli when compared with multisensory stimuli.

Multisensory Integration in Cochlear Implant Recipients

Speech perception is inherently a multisensory process involving integration of auditory and visual cues. Multisensory integration in cochlear implant (CI) recipients is a unique circumstance in that the integration occurs after auditory deprivation and the provision of hearing via the CI. Despite the clear importance of multisensory cues for perception, in general, and for speech intelligibility, specifically, the topic of multisensory perceptual benefits in CI users has only recently begun to emerge as an area of inquiry. We review the research that has been conducted on multisensory integration in CI users to date and suggest a number of areas needing further research. The overall pattern of results indicates that many CI recipients show at least some perceptual gain that can be attributable to multisensory integration. The extent of this gain, however, varies based on a number of factors, including age of implantation and specific task being assessed (e.g., stimulus detection, phoneme perception, word recognition). Although both children and adults with CIs obtain audiovisual benefits for phoneme, word, and sentence stimuli, neither group shows demonstrable gain for suprasegmental feature perception. Additionally, only early-implanted children and the highest performing adults obtain audiovisual integration benefits similar to individuals with normal hearing. Increasing age of implantation in children is associated with poorer gains resultant from audiovisual integration, suggesting a sensitive period in development for the brain networks that subserve these integrative functions, as well as length of auditory experience. This finding highlights the need for early detection of and intervention for hearing loss, not only in terms of auditory perception, but also in terms of the behavioral and perceptual benefits of audiovisual processing. Importantly, patterns of auditory, visual, and audiovisual responses suggest that underlying integrative processes may be fundamentally different between CI users and typical-hearing listeners. Future research, particularly in low-level processing tasks such as signal detection will help to further assess mechanisms of multisensory integration for individuals with hearing loss, both with and without CIs.

Atypical audiovisual temporal function in autism and schizophrenia: similar phenotype, different cause

Binding across sensory modalities yields substantial perceptual benefits, including enhanced speech intelligibility. The coincidence of sensory inputs across time is a fundamental cue for this integration process. Recent work has suggested that individuals with diagnoses of schizophrenia (SZ) and autism spectrum disorder (ASD) will characterize auditory and visual events as synchronous over larger temporal disparities than their neurotypical counterparts. Namely, these clinical populations possess an enlarged temporal binding window (TBW). Although patients with SZ and ASD share aspects of their symptomatology, phenotypic similarities may result from distinct etiologies. To examine similarities and variances in audiovisual temporal function in these two populations, individuals diagnosed with ASD (n = 46; controls n = 40) and SZ (n = 16, controls = 16) completed an audiovisual simultaneity judgment task. In addition to standard psychometric analyses, synchrony judgments were assessed using Bayesian causal inference modeling. This approach permits distinguishing between distinct causes of an enlarged TBW: an a priori bias to bind sensory information and poor fidelity in the sensory representation. Findings indicate that both ASD and SZ populations show deficits in multisensory temporal acuity. Importantly, results suggest that while the wider TBWs in ASD most prominently results from atypical priors, the wider TBWs in SZ results from a trend toward changes in prior and weaknesses in the sensory representations. Results are discussed in light of current ASD and SZ theories and highlight that different perceptual training paradigms focused on improving multisensory integration may be most effective in these two clinical populations and emphasize that similar phenotypes may emanate from distinct mechanistic causes.

Integration and Temporal Processing of Asynchronous Audiovisual Speech

Multisensory integration of visual mouth movements with auditory speech is known to offer substantial perceptual benefits, particularly under challenging (i.e., noisy) acoustic conditions. Previous work characterizing this process has found that ERPs to auditory speech are of shorter latency and smaller magnitude in the presence of visual speech. We sought to determine the dependency of these effects on the temporal relationship between the auditory and visual speech streams using EEG. We found that reductions in ERP latency and suppression of ERP amplitude are maximal when the visual signal precedes the auditory signal by a small interval and that increasing amounts of asynchrony reduce these effects in a continuous manner. Time–frequency analysis revealed that these effects are found primarily in the theta (4–8 Hz) and alpha (8–12 Hz) bands, with a central topography consistent with auditory generators. Theta effects also persisted in the lower portion of the band (3.5–5 Hz), and this late activity was more frontally distributed. Importantly, the magnitude of these late theta oscillations not only differed with the temporal characteristics of the stimuli but also served to predict participants' task performance. Our analysis thus reveals that suppression of single-trial brain responses by visual speech depends strongly on the temporal concordance of the auditory and visual inputs. It further illustrates that processes in the lower theta band, which we suggest as an index of incongruity processing, might serve to reflect the neural correlates of individual differences in multisensory temporal perception.

Contributions of Intraindividual and Interindividual Differences to Multisensory Processes

Most evidence on the neural and perceptual correlates of sensory processing derives from studies that have focused on only a single sensory modality and averaged the data from groups of participants. Although valuable, such studies ignore the substantial interindividual and intraindividual differences that are undoubtedly at play. Such variability plays an integral role in both the behavioral/perceptual realms and in the neural correlates of these processes, but substantially less is known when compared with group-averaged data. Recently, it has been shown that the presentation of stimuli from two or more sensory modalities (i.e., multisensory stimulation) not only results in the well-established performance gains but also gives rise to reductions in behavioral and neural response variability. To better understand the relationship between neural and behavioral response variability under multisensory conditions, this study investigated both behavior and brain activity in a task requiring participants to discriminate moving versus static stimuli presented in either a unisensory or multisensory context. EEG data were analyzed with respect to intraindividual and interindividual differences in RTs. The results showed that trial-by-trial variability of RTs was significantly reduced under audiovisual presentation conditions as compared with visual-only presentations across all participants. Intraindividual variability of RTs was linked to changes in correlated activity between clusters within an occipital to frontal network. In addition, interindividual variability of RTs was linked to differential recruitment of medial frontal cortices. The present findings highlight differences in the brain networks that support behavioral benefits during unisensory versus multisensory motion detection and provide an important view into the functional dynamics within neuronal networks underpinning intraindividual performance differences.