Body-environment integration: Temporal processing of tactile and auditory inputs along the schizophrenia continuum

According to the dimensional approach to psychosis, there is a continuum from low schizotypy to schizophrenia patients. The temporal aspect of sensory processing seems to be compromised across such continuum, as suggested by different studies separately investigating unisensory or multisensory domains. Most of these studies have so far focused primarily on the temporal processing of visual and auditory stimuli, either in schizotypy or schizophrenia, while leaving the tactile domain and the integration of touch with other senses mostly unexplored. Given the relevance of body-related perceptual abnormalities for psychosis proneness, we aimed at filling this gap in the literature across two studies. We asked participants with increasing levels of schizotypy (study 1) and schizophrenia patients (study 2) to perform three simultaneity judgement tasks: a unimodal tactile task, a unimodal auditory task and a bimodal audio-tactile task. Each task allowed estimating a simultaneity range (SR), as a proxy of the individual tolerance to asynchronies in the tactile, auditory and audio-tactile domains, respectively. Results showed larger SRs as the level of schizotypy increases. Specifically, the linear effect of schizotypy levels on the audio-tactile task was stronger than on the auditory task, which in turn was greater than the effect on the tactile task (study 1). Differently, schizophrenia patients showed larger SRs than controls in all the three tasks (study 2). The current study is the first empirical investigation across the continuum from low schizotypy to schizophrenia of the tolerance to asynchronies in the processing of external (auditory) and body-related (tactile) inputs.

Long-term music training modulates the recalibration of audiovisual simultaneity

To overcome differences in physical transmission time and neural processing, the brain adaptively recalibrates the point of simultaneity between auditory and visual signals by adapting to audiovisual asynchronies. Here, we examine whether the prolonged recalibration process of passively sensed visual and auditory signals is affected by naturally occurring multisensory training known to enhance audiovisual perceptual accuracy. Hence, we asked a group of drummers, of non-drummer musicians and of non-musicians to judge the audiovisual simultaneity of musical and non-musical audiovisual events, before and after adaptation with two fixed audiovisual asynchronies. We found that the recalibration for the musicians and drummers was in the opposite direction (sound leading vision) to that of non-musicians (vision leading sound), and change together with both increased music training and increased perceptual accuracy (i.e. ability to detect asynchrony). Our findings demonstrate that long-term musical training reshapes the way humans adaptively recalibrate simultaneity between auditory and visual signals.

Multisensory integration and ADHD-like traits: Evidence for an abnormal temporal integration window in ADHD

Abnormalities in multimodal processing have been found in many developmental disorders such as autism and dyslexia. However, surprisingly little empirical work has been conducted to test the integrity of multisensory integration in Attention Deficit Hyperactivity Disorder (ADHD). The main aim of the present study was to examine links between symptoms of ADHD (as measured using a self-report scale in a healthy adult population) and the temporal aspects of multisensory processing. More specifically, a Simultaneity Judgement (SJ) and a Temporal Order Judgement (TOJ) task were used in participants with low and high levels of ADHD-like traits to measure the temporal integration window and Just-Noticeable Difference (JND) (respectively) between the timing of an auditory beep and a visual pattern presented over a broad range of stimulus onset asynchronies. The Point of Subjective Similarity (PSS) was also measured in both cases. In the SJ task, participants with high levels of ADHD-like traits considered significantly fewer stimuli to be simultaneous than participants with high levels of ADHD-like traits, and the former were found to have significantly smaller temporal windows of integration (although no difference was found in the PSS in the SJ or TOJ tasks, or the JND in the latter). This is the first study to identify an abnormal temporal integration window in individuals with ADHD-like traits. Perceived temporal misalignment of two or more modalities can lead to distractibility (e.g., when the stimulus components from different modalities occur separated by too large of a temporal gap). Hence, an abnormality in the perception of simultaneity could lead to the increased distractibility seen in ADHD.

A model-based comparison of three theories of audiovisual temporal recalibration

Observers change their audio-visual timing judgements after exposure to asynchronous audiovisual signals. The mechanism underlying this temporal recalibration is currently debated. Three broad explanations have been suggested. According to the first, the time it takes for sensory signals to propagate through the brain has changed. The second explanation suggests that decisional criteria used to interpret signal timing have changed, but not time perception itself. A final possibility is that a population of neurones collectively encode relative times, and that exposure to a repeated timing relationship alters the balance of responses in this population. Here, we simplified each of these explanations to its core features in order to produce three corresponding six-parameter models, which generate contrasting patterns of predictions about how simultaneity judgements should vary across four adaptation conditions: No adaptation, synchronous adaptation, and auditory leading/lagging adaptation. We tested model predictions by fitting data from all four conditions simultaneously, in order to assess which model/explanation best described the complete pattern of results. The latency-shift and criterion-change models were better able to explain results for our sample as a whole. The population-code model did, however, account for improved performance following adaptation to a synchronous adapter, and best described the results of a subset of observers who reported least instances of synchrony.