Developmental changes in the perception of audiotactile simultaneity

Multisensory temporal processing in schizophrenia and bipolar disorder: implications for psychosis

Structuring sensory events in time is essential for interacting with the environment and producing adaptive behaviors. Over the past years, the microstructure of temporality received increasing attention, recognized as a fundamental factor influencing cognitive, affective, and social abilities, whose alteration can underlie the etiopathogeneses of some clinical symptoms in psychiatric disorders. The present research investigated multisensory temporal processing in individuals with schizophrenia (N = 21), bipolar disorder (N = 20) and healthy controls (N = 21) in order to explore a plausible link between multisensory alterations in the temporal order of events and the psychopathological dimensions underlying psychosis. We asked participants to temporally order audio-tactile, visual-tactile, and audio-visual stimuli, and we administered different psychopathological scales to explore depressive, manic and psychotic symptoms. Results demonstrated that both subjects with schizophrenia and bipolar disorder are less precise in temporal order judgment independently of the sensory modalities involved. Interestingly, reduced precision in temporal processing of patients is positively associated with the presence and severity of positive symptoms. Our findings support the hypothesis that low-level sensory alterations in temporal structure may contribute to the emergence of clinical symptoms such as delusions, hallucinations, and disorganized behaviors.

A new test for evaluation of marginal cognitive function deficits in idiopathic normal pressure hydrocephalus through expressing texture recognition by sound symbolic words

Introduction

The number of dementia patients is increasing with population aging. Preclinical detection of dementia in patients is essential for access to adequate treatment. In previous studies, dementia patients showed texture recognition difficulties. Onomatopoeia or sound symbolic words (SSW) are intuitively associated with texture impressions and are less likely to be affected by aphasia and description of material perception can be easily obtained. In this study, we aimed to create a test of texture recognition ability expressed by SSW to detect the presence of mild cognitive disorders.

Methods

The sound symbolic words texture recognition test (SSWTRT) is constructed from 12 close-up photos of various materials and participants were to choose the best SSW out of 8 choices to describe surface texture in the images in Japanese. All 102 participants seen in Juntendo University Hospital from January to August 2023 had a diagnosis of possible iNPH (age mean 77.9, SD 6.7). The answers were scored on a comprehensive scale of 0 to 1. Neuropsychological assessments included MMSE, FAB, and the Rey Auditory Verbal Learning Test (RAVLT), Pegboard Test, and Stroop Test from the EU-iNPH Grading Scale (GS). In study 1 the correlation between SSWTRT and the neuropsychological tests were analyzed. In study 2, participants were divided into two groups: the Normal Cognition group (Group A, n = 37) with MMSE scores of 28 points or above, and the Mild Cognitive Impairment group (Group B, n = 50) with scores ranging from 22 to 27 points, and its predictability were analyzed.

Results

In study 1, the total SSWTRT score had a moderate correlation with the neuropsychological test results. In study 2, there were significant differences in the SSWTRT scores between groups A and B. ROC analysis results showed that the SSWTR test was able to predict the difference between the normal and mildly impaired cognition groups.

Conclusion

The developed SSWTRT reflects the assessment results of neuropsychological tests in cognitive deterioration and was able to detect early cognitive deficits. This test not only relates to visual perception but is likely to have an association with verbal fluency and memory ability, which are frontal lobe functions.

Synchrony perception across senses: A systematic review of temporal binding window changes from infancy to adolescence in typical and atypical development

Sensory integration is increasingly acknowledged as being crucial for the development of cognitive and social abilities. However, its developmental trajectory is still little understood. This systematic review delves into the topic by investigating the literature about the developmental changes from infancy through adolescence of the Temporal Binding Window (TBW) - the epoch of time within which sensory inputs are perceived as simultaneous and therefore integrated. Following comprehensive searches across PubMed, Elsevier, and PsycInfo databases, only experimental, behavioral, English-language, peer-reviewed studies on multisensory temporal processing in 0-17-year-olds have been included. Non-behavioral, non-multisensory, and non-human studies have been excluded as those that did not directly focus on the TBW. The selection process was independently performed by two Authors. The 39 selected studies involved 2859 participants in total. Findings indicate a predisposition towards cross-modal asynchrony sensitivity and a composite, still unclear, developmental trajectory, with atypical development associated to increased asynchrony tolerance. These results highlight the need for consistent and thorough research into TBW development to inform potential interventions.

Developmental changes in audiotactile event perception

The fission and fusion illusions provide measures of multisensory integration. The sound-induced tap fission illusion occurs when a tap is paired with two distractor sounds, resulting in the perception of two taps; the sound-induced tap fusion illusion occurs when two taps are paired with a single sound, resulting in the perception of a single tap. Using these illusions, we measured integration in three groups of children (9-, 11-, and 13-year-olds) and compared them with a group of adults. Based on accuracy, we derived a measure of magnitude of illusion and used a signal detection analysis to estimate perceptual discriminability and decisional criterion. All age groups showed a significant fission illusion, whereas only the three groups of children showed a significant fusion illusion. When compared with adults, the 9-year-olds showed larger fission and fusion illusions (i.e., reduced discriminability and greater bias), whereas the 11-year-olds were adult-like for fission but showed some differences for fusion: significantly worse discriminability and marginally greater magnitude and criterion. The 13-year-olds were adult-like on all measures. Based on the pattern of data, we speculate that the developmental trajectories for fission and fusion differ. We discuss these developmental results in the context of three non-mutually exclusive theoretical frameworks: sensory dominance, maximum likelihood estimation, and causal inference.

Olfactory-gustatory simultaneity judgments: A preliminary study on the congruency-dependent temporal window of multisensory binding

BACKGROUND

A greater congruency of audio and video expands the temporal binding window (TBW). A similar phenomenon may occur with a combination of odor and taste, which are the main components of flavor.

OBJECTIVE

TBW is defined as the temporal resolution of synchrony perception. The larger the TBW, the lower the resolution. We hypothesized that the more congruent the odor and taste, the lower the temporal resolution of synchrony perception.

METHODS

To examine this hypothesis, 10 female participants performed simultaneity judgment (SJ) tasks under congruent (soy sauce odor with saline) and incongruent (cherry tree leaf odor with saline) conditions and evaluated the congruency with saltiness for the two odors. In the SJ tasks, participants reported whether odor and taste were presented simultaneously or successively. We assumed a Gaussian distribution for the temporal distributions of the simultaneous response rates and calculated the approximations. In addition, we computed the half width at half height (HWHH) as an index of TBW based on the coefficient of approximation for the temporal distribution of the simultaneous response rates.

RESULTS

HWHH was significantly larger under congruent condition than under incongruent condition. In addition, congruency with saltiness had a significant moderate positive correlation with HWHH.

CONCLUSION

The larger the HWHH, the lower the temporal resolution of synchrony perception, supporting the hypothesis. This study suggests that the width of TBW depends on the cross-modal congruency similar to the case for audio-visual SJs. However, methodological improvements, including a larger sample size and gender-independent recruitment of participants, are essential to enhance the reliability of the findings because some of the results did not provide sufficient ESs or power.

The development of audio-visual temporal precision precedes its rapid recalibration

Through development, multisensory systems reach a balance between stability and flexibility: the systems integrate optimally cross-modal signals from the same events, while remaining adaptive to environmental changes. Is continuous intersensory recalibration required to shape optimal integration mechanisms, or does multisensory integration develop prior to recalibration? Here, we examined the development of multisensory integration and rapid recalibration in the temporal domain by re-analyzing published datasets for audio-visual, audio-tactile, and visual-tactile combinations. Results showed that children reach an adult level of precision in audio-visual simultaneity perception and show the first sign of rapid recalibration at 9 years of age. In contrast, there was very weak rapid recalibration for other cross-modal combinations at all ages, even when adult levels of temporal precision had developed. Thus, the development of audio-visual rapid recalibration appears to require the maturation of temporal precision. It may serve to accommodate distance-dependent travel time differences between light and sound.

The feeling of "kiki": Comparing developmental changes in sound-shape correspondence for audio-visual and audio-tactile stimuli

Sound-shape crossmodal correspondence, the naturally occurring associations between abstract visual shapes and nonsense sounds, is one aspect of multisensory processing that strengthens across early childhood. Little is known regarding whether school-aged children exhibit other variants of sound-shape correspondences such as audio-tactile (AT) associations between tactile shapes and nonsense sounds. Based on previous research in blind individuals suggesting the role of visual experience in establishing sound-shape correspondence, we hypothesized that children would show weaker AT association than adults and that children's AT association would be enhanced with visual experience of the shapes. In Experiment 1, we showed that, when asked to match shapes explored haptically via touch to nonsense words, 6- to 8-year-olds exhibited inconsistent AT associations, whereas older children and adults exhibited the expected AT associations, despite robust audio-visual (AV) associations found across all age groups in a related study. In Experiment 2, we confirmed the role of visual experience in enhancing AT association; here, 6- to 8-year-olds could exhibit the expected AT association if first exposed to the AV condition, whereas adults showed the expected AT association irrespective of whether the AV condition was tested first or second. Our finding suggests that AT sound-shape correspondence is weak early in development relative to AV sound-shape correspondence, paralleling previous findings on the development of other types of multisensory associations. The potential role of visual experience in the development of sound-shape correspondences in other senses is discussed.

Active touch facilitates object size perception in children but not adults: A multisensory event related potential study

In order to increase perceptual precision the adult brain dynamically combines redundant information from different senses depending on their reliability. During object size estimation, for example, visual, auditory and haptic information can be integrated to increase the precision of the final size estimate. Young children, however, do not integrate sensory information optimally and instead rely on active touch. Whether this early haptic dominance is reflected in age-related differences in neural mechanisms and whether it is driven by changes in bottom-up perceptual or top-down attentional processes has not yet been investigated. Here, we recorded event-related-potentials from a group of adults and children aged 5-7 years during an object size perception task using auditory, visual and haptic information. Multisensory information was presented either congruently (conveying the same information) or incongruently (conflicting information). No behavioral responses were required from participants. When haptic size information was available via actively tapping the objects, response amplitudes in the mid-parietal area were significantly reduced by information congruency in children but not in adults between 190 ms-250 ms and 310 ms-370 ms. These findings indicate that during object size perception only children's brain activity is modulated by active touch supporting a neural maturational shift from sensory dominance in early childhood to optimal multisensory benefit in adulthood.