Sensory dominance and multisensory integration as screening tools in aging

Perceptual training improves audiovisual integration by enhancing alpha-band oscillations and functional connectivity in older adults

Numerous studies on perceptual training exist, however, most have focused on the precision of temporal audiovisual perception, while fewer have concentrated on ability promotion for audiovisual integration (AVI). To investigate these issues, continuous 5-day audiovisual perceptual training was applied, during which electroencephalography was performed in response to auditory-only (A), visual-only (V) and audiovisual (AV) stimuli before and after training. The results showed that the perceptual sensitivity was greater for training group than for control group and was greater in the posttest than in the pretest. The response to the AV stimulus was significantly faster in the posttest than in the pretest for the older training group but was significantly greater for A and V stimuli for the younger training group. Electroencephalography analysis found higher P3 AVI amplitudes [AV-(A + V)] in the posttest than in the pretest for training group, which were subsequently reflected by an increased alpha (8-12 Hz) oscillatory response and strengthened global functional connectivity (weighted phase lag index). Furthermore, these facilitations were greater for older training groups than for younger training groups. These results confirm the age-related compensatory mechanism for AVI may be strengthened as audiovisual perceptual training progresses, providing an effective candidate for cognitive intervention in older adults.

The impact of premature birth on auditory-visual processes in very preterm schoolchildren

Interactions between stimuli from different sensory modalities and their integration are central to daily life, contributing to improved perception. Being born prematurely and the subsequent hospitalization can have an impact not only on sensory processes, but also on the manner in which information from different senses is combined-i.e., multisensory processes. Very preterm (VPT) children (<32 weeks gestational age) present impaired multisensory processes in early childhood persisting at least through the age of five. However, it remains largely unknown whether and how these consequences persist into later childhood. Here, we evaluated the integrity of auditory-visual multisensory processes in VPT schoolchildren. VPT children (N = 28; aged 8-10 years) received a standardized cognitive assessment and performed a simple detection task at their routine follow-up appointment. The simple detection task involved pressing a button as quickly as possible upon presentation of an auditory, visual, or simultaneous audio-visual stimulus. Compared to full-term (FT) children (N = 23; aged 6-11 years), reaction times of VPT children were generally slower and more variable, regardless of sensory modality. Nonetheless, both groups exhibited multisensory facilitation on mean reaction times and inter-quartile ranges. There was no evidence that standardized cognitive or clinical measures correlated with multisensory gains of VPT children. However, while gains in FT children exceeded predictions based on probability summation and thus forcibly invoked integrative processes, this was not the case for VPT children. Our findings provide evidence of atypical multisensory profiles in VPT children persisting into school-age. These results could help in targeting supportive interventions for this vulnerable population.

A drift diffusion model analysis of age-related impact on multisensory decision-making processes

Older adults (OAs) are typically slower and/or less accurate in forming perceptual choices relative to younger adults. Despite perceptual deficits, OAs gain from integrating information across senses, yielding multisensory benefits. However, the cognitive processes underlying these seemingly discrepant ageing effects remain unclear. To address this knowledge gap, 212 participants (18-90 years old) performed an online object categorisation paradigm, whereby age-related differences in Reaction Times (RTs) and choice accuracy between audiovisual (AV), visual (V), and auditory (A) conditions could be assessed. Whereas OAs were slower and less accurate across sensory conditions, they exhibited greater RT decreases between AV and V conditions, showing a larger multisensory benefit towards decisional speed. Hierarchical Drift Diffusion Modelling (HDDM) was fitted to participants' behaviour to probe age-related impacts on the latent multisensory decision formation processes. For OAs, HDDM demonstrated slower evidence accumulation rates across sensory conditions coupled with increased response caution for AV trials of higher difficulty. Notably, for trials of lower difficulty we found multisensory benefits in evidence accumulation that increased with age, but not for trials of higher difficulty, in which increased response caution was instead evident. Together, our findings reconcile age-related impacts on multisensory decision-making, indicating greater multisensory evidence accumulation benefits with age underlying enhanced decisional speed.

Sensational Dreams: The Prevalence of Sensory Experiences in Dreaming

Dreaming, a widely researched aspect of sleep, often mirrors waking-life experiences. Despite the prevalence of sensory perception during wakefulness, sensory experiences in dreams remain relatively unexplored. Free recall dream reports, where individuals describe their dreams freely, may not fully capture sensory dream experiences. In this study, we developed a dream diary with direct questions about sensory dream experiences. Participants reported sensory experiences in their dreams upon awakening, over multiple days, in a home-based setting (n = 3476 diaries). Our findings show that vision was the most common sensory dream experience, followed by audition and touch. Olfaction and gustation were reported at equally low rates. Multisensory dreams were far more prevalent than unisensory dreams. Additionally, the prevalence of sensory dream experiences varied across emotionally positive and negative dreams. A positive relationship was found between on the one hand sensory richness and, on the other emotional intensity of dreams and clarity of dream recall, for both positive and negative dreams. These results underscore the variety of dream experiences and suggest a link between sensory richness, emotional content and dream recall clarity. Systematic registration of sensory dream experiences offers valuable insights into dream manifestation, aiding the understanding of sleep-related memory consolidation and other aspects of sleep-related information processing.

Somatostatin and the pathophysiology of Alzheimer's disease

Among the central features of Alzheimer's disease (AD) progression are altered levels of the neuropeptide somatostatin (SST), and the colocalisation of SST-positive interneurons (SST-INs) with amyloid-β plaques, leading to cell death. In this theoretical review, I propose a molecular model for the pathogenesis of AD based on SST-IN hypofunction and hyperactivity. Namely, hypofunctional and hyperactive SST-INs struggle to control hyperactivity in medial regions in early stages, leading to axonal Aβ production through excessive presynaptic GABAB inhibition, GABAB1a/APP complex downregulation and internalisation. Concomitantly, excessive SST-14 release accumulates near SST-INs in the form of amyloids, which bind to Aβ to form toxic mixed oligomers. This leads to differential SST-IN death through excitotoxicity, further disinhibition, SST deficits, and increased Aβ release, fibrillation and plaque formation. Aβ plaques, hyperactive networks and SST-IN distributions thereby tightly overlap in the brain. Conversely, chronic stimulation of postsynaptic SST2/4 on gulutamatergic neurons by hyperactive SST-INs promotes intense Mitogen-Activated Protein Kinase (MAPK) p38 activity, leading to somatodendritic p-tau staining and apoptosis/neurodegeneration - in agreement with a near complete overlap between p38 and neurofibrillary tangles. This model is suitable to explain some of the principal risk factors and markers of AD progression, including mitochondrial dysfunction, APOE4 genotype, sex-dependent vulnerability, overactive glial cells, dystrophic neurites, synaptic/spine losses, inter alia. Finally, the model can also shed light on qualitative aspects of AD neuropsychology, especially within the domains of spatial and declarative (episodic, semantic) memory, under an overlying pattern of contextual indiscrimination, ensemble instability, interference and generalisation.

Correctly establishing evidence for cue combination via gains in sensory precision: Why the choice of comparator matters

Studying how sensory signals from different sources (sensory cues) are integrated within or across multiple senses allows us to better understand the perceptual computations that lie at the foundation of adaptive behaviour. As such, determining the presence of precision gains - the classic hallmark of cue combination - is important for characterising perceptual systems, their development and functioning in clinical conditions. However, empirically measuring precision gains to distinguish cue combination from alternative perceptual strategies requires careful methodological considerations. Here, we note that the majority of existing studies that tested for cue combination either omitted this important contrast, or used an analysis approach that, unknowingly, strongly inflated false positives. Using simulations, we demonstrate that this approach enhances the chances of finding significant cue combination effects in up to 100% of cases, even when cues are not combined. We establish how this error arises when the wrong cue comparator is chosen and recommend an alternative analysis that is easy to implement but has only been adopted by relatively few studies. By comparing combined-cue perceptual precision with the best single-cue precision, determined for each observer individually rather than at the group level, researchers can enhance the credibility of their reported effects. We also note that testing for deviations from optimal predictions alone is not sufficient to ascertain whether cues are combined. Taken together, to correctly test for perceptual precision gains, we advocate for a careful comparator selection and task design to ensure that cue combination is tested with maximum power, while reducing the inflation of false positives.

Visual processing speed and its association with future dementia development in a population-based prospective cohort: EPIC-Norfolk

Visual processing deficits have frequently been reported when studied in individuals with dementia, which suggests their potential utility in supporting dementia screening. The study uses EPIC-Norfolk Prospective Population Cohort Study data (n = 8623) to investigate the role of visual processing speed assessed by the Visual Sensitivity Test (VST) in identifying the risk of future dementia using Cox regression analyses. Individuals with lower scores on the simple and complex VST had a higher probability of a future dementia diagnosis HR1.39 (95% CI 1.12, 1.67, P < 0.01) and HR 1.56 (95% CI 1.27, 1.90, P < 0.01), respectively. Although other more commonly used cognitive dementia screening tests were better predictors of future dementia risk (HR 3.45 for HVLT and HR 2.66, for SF-EMSE), the complex VST showed greater sensitivity to variables frequently associated with dementia risk. Reduced complex visual processing speed is significantly associated with a high likelihood of a future dementia diagnosis and risk/protective factors in this cohort. Combining visual processing tests with other neuropsychological tests could improve the identification of future dementia risk.

Ability to Process Multisensory Information Is Impaired in Open Angle Glaucoma

PRCIS

Patients with glaucoma demonstrated deficiencies in their ability to process multisensory information when compared with controls, with those deficiencies being related to glaucoma severity. Impaired multisensory integration (MSI) may affect the quality of life in individuals with glaucoma and may contribute to the increased prevalence of falls and driving safety concerns. Therapeutic possibilities to influence cognition in glaucoma should be explored.

PURPOSE

Glaucoma is a neurodegenerative disease of the optic nerve that has also been linked to cognitive health decline. This study explored MSI as a function of glaucoma status and severity.

METHODS

MSI was assessed in 37 participants with open angle glaucoma relative to 18 age-matched healthy controls. The sound-induced flash illusion was used to assess MSI efficiency. Participants were presented with various combinations of simultaneous visual and/or auditory stimuli and were required to indicate the number of visual stimuli observed for each of the 96 total presentations. Central retinal sensitivity was assessed as an indicator of glaucoma severity (MAIA; CenterVue).

RESULTS

Participants with glaucoma performed with equivalent capacity to healthy controls on unisensory trials ( F1,53 =2.222, P =0.142). Both groups performed equivalently on congruent multisensory trials involving equal numbers of auditory and visual stimuli F1,53 =1.032, P =0.314). For incongruent presentations, that is, 2 beeps and 1 flash stimulus, individuals with glaucoma demonstrated a greater influence of the incongruent beeps when judging the number of flashes, indicating less efficient MSI relative to age-matched controls ( F1,53 =11.45, P <0.002). In addition, MSI performance was positively correlated with retinal sensitivity ( F3,49 =4.042, P <0.025), adjusted R ²=0.15).

CONCLUSIONS

Individuals with open angle glaucoma exhibited MSI deficiencies that relate to disease severity. The type of deficiencies observed were similar to those observed among older individuals with cognitive impairment and balance issues. Impaired MSI may, therefore, be relevant to the increased prevalence of falls observed among individuals with glaucoma, a concept that merits further investigation.

Perceptual Integration Compensates for Attention Deficit in Elderly during Repetitive Auditory-Based Sensorimotor Task

Sensorimotor integration (SI) brain functions that are vital for everyday life tend to decline in advanced age. At the same time, elderly people preserve a moderate level of neuroplasticity, which allows the brain's functionality to be maintained and slows down the process of neuronal degradation. Hence, it is important to understand which aspects of SI are modifiable in healthy old age. The current study focuses on an auditory-based SI task and explores: (i) if the repetition of such a task can modify neural activity associated with SI, and (ii) if this effect is different in young and healthy old age. A group of healthy older subjects and young controls underwent an assessment of the whole-brain electroencephalography (EEG) while repetitively executing a motor task cued by the auditory signal. Using EEG spectral power and functional connectivity analyses, we observed a differential age-related modulation of theta activity throughout the repetition of the SI task. Growth of the anterior stimulus-related theta oscillations accompanied by enhanced right-lateralized frontotemporal phase-locking was found in elderly adults. Their young counterparts demonstrated a progressive increase in prestimulus occipital theta power. Our results suggest that the short-term repetition of the auditory-based SI task modulates sensory processing in the elderly. Older participants most likely progressively improve perceptual integration rather than attention-driven processing compared to their younger counterparts.

Dual-stage cognitive assessment: a two-stage screening for cognitive impairment in primary care

BACKGROUND

Aging population has led to an increased proportion of older adults and cognitively impaired. We designed a brief and flexible two-stage cognitive screening scale, the Dual-Stage Cognitive Assessment (DuCA), for cognitive screening in primary care settings.

METHOD

In total, 1,772 community-dwelling participants were recruited, including those with normal cognition (NC, n = 1,008), mild cognitive impairment (MCI, n = 633), and Alzheimer's disease (AD, n = 131), and administered a neuropsychological test battery and the DuCA. To improve performance, the DuCA combines visual and auditory memory tests for an enhanced memory function test.

RESULTS

The correlation coefficient between DuCA-part 1 and DuCA-total was 0.84 (P < 0.001). The correlation coefficients of DuCA-part 1 with Addenbrooke's Cognitive Examination III (ACE-III) and Montreal Cognitive Assessment Basic (MoCA-B) were 0.66 (P < 0.001) and 0.85 (P < 0.001), respectively. The correlation coefficients of DuCA-total with ACE-III and MoCA-B were 0.78 (P < 0.001) and 0.83 (P < 0.001), respectively. DuCA-Part 1 showed a similar discrimination ability for MCI from NC (area under curve [AUC] = 0.87, 95%CI 0.848-0.883) as ACE III (AUC = 0.86, 95%CI 0.838-0.874) and MoCA-B (AUC = 0.85, 95%CI 0.830-0.868). DuCA-total had a higher AUC (0.93, 95%CI: 0.917-0.942). At different education levels, the AUC was 0.83-0.84 for DuCA-part 1, and 0.89-0.94 for DuCA-total. DuCA-part 1 and DuCA-total's ability to discriminate AD from MCI was 0.84 and 0.93, respectively.

CONCLUSION

DuCA-Part 1 would aid rapid screening and supplemented with the second part for a complete assessment. DuCA is suited for large-scale cognitive screening in primary care, saving time and eliminating the need for extensively training assessors.

Differential decay of gist and detail memory in older adults with amnestic mild cognitive impairment

Amnestic mild cognitive impairment (aMCI) has been identified as a risk factor for dementia due to Alzheimer's disease. The medial temporal structures, which are crucial for memory processing, are the earliest affected regions in the brains of patients with aMCI, and episodic memory performance has been identified as a reliable way to discriminate between patients with aMCI and cognitively normal older adults. However, whether the detail and gist memory of patients with aMCI and cognitively normal older adults decay differently remains unclear. In this study, we hypothesized that detail and gist memory would be retrieved differentially, with a larger group performance gap in detail memory than in gist memory. In addition, we explored whether an increasing group performance gap between detail memory and gist memory groups would be observed over a 14-day period. Furthermore, we hypothesized that unisensory (audio-only) and multisensory (audiovisual) encoding would lead to differences in retrievals, with the multisensory condition reducing between and within-group performance gaps observed under the unisensory condition. The analyses conducted were analyses of covariance controlling for age, sex, and education and correlational analyses to examine behavioral performance and the association between behavioral data and brain variables. Compared with cognitively normal older adults, the patients with aMCI performed poorly on both detail and gist memory tests, and this performance gap persisted over time. Moreover, the memory performance of the patients with aMCI was enhanced by the provision of multisensory information, and bimodal input was significantly associated with medial temporal structure variables. Overall, our findings suggest that detail and gist memory decay differently, with a longer lasting group gap in gist memory than in detail memory. Multisensory encoding effectively reduced or overcame the between- and within-group gaps between time intervals, especially for gist memory, compared with unisensory encoding.

Rescue of astrocyte activity by the calcium sensor STIM1 restores long-term synaptic plasticity in female mice modelling Alzheimer's disease

Calcium dynamics in astrocytes represent a fundamental signal that through gliotransmitter release regulates synaptic plasticity and behaviour. Here we present a longitudinal study in the PS2APP mouse model of Alzheimer's disease (AD) linking astrocyte Ca²⁺ hypoactivity to memory loss. At the onset of plaque deposition, somatosensory cortical astrocytes of AD female mice exhibit a drastic reduction of Ca²⁺ signaling, closely associated with decreased endoplasmic reticulum Ca²⁺ concentration and reduced expression of the Ca²⁺ sensor STIM1. In parallel, astrocyte-dependent long-term synaptic plasticity declines in the somatosensory circuitry, anticipating specific tactile memory loss. Notably, we show that both astrocyte Ca²⁺ signaling and long-term synaptic plasticity are fully recovered by selective STIM1 overexpression in astrocytes. Our data unveil astrocyte Ca²⁺ hypoactivity in neocortical astrocytes as a functional hallmark of early AD stages and indicate astrocytic STIM1 as a target to rescue memory deficits.

Modal-based attention modulates the redundant-signals effect: Role of unimodal target probability

Multisensory integration includes two behavioral manifestations: the modality dominance effect and the redundant-signals effect (RSE). RSE is a multisensory improvement effect in which individuals respond more quickly and accurately to bimodal audiovisual (AV) targets than to unimodal auditory (A) or visual (V) targets. Previous studies have confirmed that RSE is the product of modality interactions between different modalities. The goal of this study was to systematically investigate the effects of the modality dominance manipulated by modal-based attention and unimodal target probability on RSE. The results showed that when paying attention to both the A and V modalities (Exp. 1), RSE was not significantly different between unimodal target probabilities. When selectively paying attention to the A modality (Exp. 2A), RSE was also not significantly different between unimodal target probabilities. However, when selectively paying attention to the V modality (Exp. 2B), the magnitude of RSE showed a significant decreasing trend with the increasing probability of V targets. Our study is the first to reveal that the unimodal target probability significantly modulates RSE in visual selective attention, and this modulatory effect of the unimodal target probability on RSE is opposite to the modulatory effect on the modality dominance effect.

Increases in sensory noise predict attentional disruptions to audiovisual speech perception

We receive information about the world around us from multiple senses which combine in a process known as multisensory integration. Multisensory integration has been shown to be dependent on attention; however, the neural mechanisms underlying this effect are poorly understood. The current study investigates whether changes in sensory noise explain the effect of attention on multisensory integration and whether attentional modulations to multisensory integration occur via modality-specific mechanisms. A task based on the McGurk Illusion was used to measure multisensory integration while attention was manipulated via a concurrent auditory or visual task. Sensory noise was measured within modality based on variability in unisensory performance and was used to predict attentional changes to McGurk perception. Consistent with previous studies, reports of the McGurk illusion decreased when accompanied with a secondary task; however, this effect was stronger for the secondary visual (as opposed to auditory) task. While auditory noise was not influenced by either secondary task, visual noise increased with the addition of the secondary visual task specifically. Interestingly, visual noise accounted for significant variability in attentional disruptions to the McGurk illusion. Overall, these results strongly suggest that sensory noise may underlie attentional alterations to multisensory integration in a modality-specific manner. Future studies are needed to determine whether this finding generalizes to other types of multisensory integration and attentional manipulations. This line of research may inform future studies of attentional alterations to sensory processing in neurological disorders, such as Schizophrenia, Autism, and ADHD.

Age-related decrease in motor contribution to multisensory reaction times in primary school children

Traditional measurement of multisensory facilitation in tasks such as speeded motor reaction tasks (MRT) consistently show age-related improvement during early childhood. However, the extent to which motor function increases with age and hence contribute to multisensory motor reaction times in young children has seldom been examined. Thus, we aimed to investigate the contribution of motor development to measures of multisensory (auditory, visual, and audiovisual) and visuomotor processing tasks in three young school age groups of children (n = 69) aged (5-6, n = 21; 7-8, n = 25.; 9-10 n = 18 years). We also aimed to determine whether age-related sensory threshold times for purely visual inspection time (IT) tasks improved significantly with age. Bayesian results showed decisive evidence for age-group differences in multisensory MRT and visuo-motor processing tasks, though the evidence showed that threshold time for visual identification IT performance was only slower in the youngest age group children (5-6) compared to older groups. Bayesian correlations between performance on the multisensory MRT and visuo-motor processing tasks indicated moderate to decisive evidence in favor of the alternative hypothesis (BF10 = 4.71 to 91.346), though not with the threshold IT (BF10 < 1.35). This suggests that visual sensory system development in children older than 6 years makes a less significant contribution to the measure of multisensory facilitation, compared to motor development. In addition to this main finding, multisensory facilitation of MRT within race-model predictions was only found in the oldest group of children (9-10), supporting previous suggestions that multisensory integration is likely to continue into late childhood/early adolescence at least.

The relationship between multisensory associative learning and multisensory integration

Integrating sensory information from multiple modalities leads to more precise and efficient perception and behaviour. The process of determining which sensory information should be perceptually bound is reliant on both low-level stimulus features, as well as multisensory associations learned throughout development based on the statistics of our environment. Here, we explored the relationship between multisensory associative learning and multisensory integration using encephalography (EEG) and behavioural measures. Sixty-one participants completed a three-phase study. First, participants were exposed to novel audiovisual shape-tone pairings with frequent and infrequent stimulus pairings and complete a target detection task. EEG recordings of the mismatch negativity (MMN) and P3 were calculated as neural indices of multisensory associative learning. Next, the same learned stimulus pairs were presented in audiovisual as well as unisensory auditory and visual modalities while both early (<120 ms) and late neural indices of multisensory integration were recorded. Finally, participants completed an analogous behavioural speeded-response task, with behavioural indices of multisensory gain calculated using the Race Model. Significant relationships were found in fronto-central and occipital areas between neural measures of associative learning and both early and late indices of multisensory integration in frontal and centro-parietal areas, respectively. Participants who showed stronger indices of associative learning also exhibited stronger indices of multisensory integration of the stimuli they learned to associate. Furthermore, a significant relationship was found between neural index of early multisensory integration and behavioural indices of multisensory gain. These results provide insight into the neural underpinnings of how higher-order processes such as associative learning guide multisensory integration.

Visual and Auditory Spatial Localization in Younger and Older Adults

Visual and auditory localization abilities are crucial in real-life tasks such as navigation and social interaction. Aging is frequently accompanied by vision and hearing loss, affecting spatial localization. The purpose of the current study is to elucidate the effect of typical aging on spatial localization and to establish a baseline for older individuals with pathological sensory impairment. Using a verbal report paradigm, we investigated how typical aging affects visual and auditory localization performance, the reliance on vision during sound localization, and sensory integration strategies when localizing audiovisual targets. Fifteen younger adults (N = 15, mean age = 26 years) and thirteen older adults (N = 13, mean age = 68 years) participated in this study, all with age-adjusted normal vision and hearing based on clinical standards. There were significant localization differences between younger and older adults, with the older group missing peripheral visual stimuli at significantly higher rates, localizing central stimuli as more peripheral, and being less precise in localizing sounds from central locations when compared to younger subjects. Both groups localized auditory targets better when the test space was visible compared to auditory localization when blindfolded. The two groups also exhibited similar patterns of audiovisual integration, showing optimal integration in central locations that was consistent with a Maximum-Likelihood Estimation model, but non-optimal integration in peripheral locations. These findings suggest that, despite the age-related changes in auditory and visual localization, the interactions between vision and hearing are largely preserved in older individuals without pathological sensory impairments.

Urban and rural environments differentially shape multisensory perception in ageing

Recent studies suggest that the lived environment can affect cognition across the lifespan. We examined, in a large cohort of older adults (n = 3447), whether susceptibility to a multisensory illusion, the Sound-Induced Flash Illusion (SIFI), was influenced by the reported urbanity of current and childhood (at age 14 years) residence. If urban environments help to shape healthy perceptual function, we predicted reduced SIFI susceptibility in urban dwellers. Participants reporting urban, compared with rural, childhood residence were less susceptible to SIFI at longer Stimulus-Onset Asynchronies (SOAs). Those currently residing in urban environments were more susceptible to SIFI at longer SOAs, particularly if they scored low on general cognitive function. These findings held even when controlling for a several covariates, such as age, sex, education, social participation and cognitive ability. Exposure to urban environments in childhood may influence individual differences in perception and offer a multisensory perceptual benefit in older age.

Individual Differences in Multisensory Processing Are Related to Broad Differences in the Balance of Local versus Distributed Information

The brain's ability to extract information from multiple sensory channels is crucial to perception and effective engagement with the environment, but the individual differences observed in multisensory processing lack mechanistic explanation. We hypothesized that, from the perspective of information theory, individuals with more effective multisensory processing will exhibit a higher degree of shared information among distributed neural populations while engaged in a multisensory task, representing more effective coordination of information among regions. To investigate this, healthy young adults completed an audiovisual simultaneity judgment task to measure their temporal binding window (TBW), which quantifies the ability to distinguish fine discrepancies in timing between auditory and visual stimuli. EEG was then recorded during a second run of the simultaneity judgment task, and partial least squares was used to relate individual differences in the TBW width to source-localized EEG measures of local entropy and mutual information, indexing local and distributed processing of information, respectively. The narrowness of the TBW, reflecting more effective multisensory processing, was related to a broad pattern of higher mutual information and lower local entropy at multiple timescales. Furthermore, a small group of temporal and frontal cortical regions, including those previously implicated in multisensory integration and response selection, respectively, played a prominent role in this pattern. Overall, these findings suggest that individual differences in multisensory processing are related to widespread individual differences in the balance of distributed versus local information processing among a large subset of brain regions, with more distributed information being associated with more effective multisensory processing. The balance of distributed versus local information processing may therefore be a useful measure for exploring individual differences in multisensory processing, its relationship to higher cognitive traits, and its disruption in neurodevelopmental disorders and clinical conditions.

A Scoping Review of Audiovisual Integration Methodology: Screening for Auditory and Visual Impairment in Younger and Older Adults

With the rise of the aging population, many scientists studying multisensory integration have turned toward understanding how this process may change with age. This scoping review was conducted to understand and describe the scope and rigor with which researchers studying audiovisual sensory integration screen for hearing and vision impairment. A structured search in three licensed databases (Scopus, PubMed, and PsychInfo) using the key concepts of multisensory integration, audiovisual modality, and aging revealed 2,462 articles, which were screened for inclusion by two reviewers. Articles were included if they (1) tested healthy older adults (minimum mean or median age of 60) with younger adults as a comparison (mean or median age between 18 and 35), (2) measured auditory and visual integration, (3) were written in English, and (4) reported behavioral outcomes. Articles that included the following were excluded: (1) tested taste exclusively, (2) tested olfaction exclusively, (3) tested somatosensation exclusively, (4) tested emotion perception, (5) were not written in English, (6) were clinical commentaries, editorials, interviews, letters, newspaper articles, abstracts only, or non-peer reviewed literature (e.g., theses), and (7) focused on neuroimaging without a behavioral component. Data pertaining to the details of the study (e.g., country of publication, year of publication, etc.) were extracted, however, of higher importance to our research question, data pertaining to screening measures used for hearing and vision impairment (e.g., type of test used, whether hearing- and visual-aids were worn, thresholds used, etc.) were extracted, collated, and summarized. Our search revealed that only 64% of studies screened for age-abnormal hearing impairment, 51% screened for age-abnormal vision impairment, and that consistent definitions of normal or abnormal vision and hearing were not used among the studies that screened for sensory abilities. A total of 1,624 younger adults and 4,778 older participants were included in the scoping review with males composing approximately 44% and females composing 56% of the total sample and most of the data was obtained from only four countries. We recommend that studies investigating the effects of aging on multisensory integration should screen for normal vision and hearing by using the World Health Organization's (WHO) hearing loss and visual impairment cut-off scores in order to maintain consistency among other aging researchers. As mild cognitive impairment (MCI) has been defined as a “transitional” or a “transitory” stage between normal aging and dementia and because approximately 3–5% of the aging population will develop MCI each year, it is therefore important that when researchers aim to study a healthy aging population, that they appropriately screen for MCI. One of our secondary aims was to determine how often researchers were screening for cognitive impairment and the types of tests that were used to do so. Our results revealed that only 55 out of 72 studies tested for neurological and cognitive function, and only a subset used standardized tests. Additionally, among the studies that used standardized tests, the cut-off scores used were not always adequate for screening out mild cognitive impairment. An additional secondary aim of this scoping review was to determine the feasibility of whether a meta-analysis could be conducted in the future to further quantitatively evaluate the results (i.e., are the findings obtained from studies using self-reported vision and hearing impairment screening methods significantly different from those measuring vision and hearing impairment in the lab) and to assess the scope of this problem. We found that it may not be feasible to conduct a meta-analysis with the entire dataset of this scoping review. However, a meta-analysis can be conducted if stricter parameters are used (e.g., focusing on accuracy or response time data only).

Systematic Review Registration:https://doi.org/10.17605/OSF.IO/GTUHD.

Multisensory integration precision is associated with better cognitive performance over time in older adults: A large-scale exploratory study

Age-related sensory decline impacts cognitive performance and exposes individuals to a greater risk of cognitive decline. Integration across the senses also changes with age, yet the link between multisensory perception and cognitive ageing is poorly understood. We explored the relationship between multisensory integration and cognitive function in 2875 adults aged 50 + from The Irish Longitudinal Study on Ageing. Multisensory integration was assessed at several audio-visual temporal asynchronies using the Sound Induced Flash Illusion (SIFI). More precise integration (i.e. less illusion susceptibility with larger temporal asynchronies) was cross-sectionally associated with faster Choice Response Times and Colour Trail Task performance, and fewer errors on the Sustained Attention to Response Task. We then used k-means clustering to identify groups with different 10-year cognitive trajectories on measures available longitudinally; delayed recall, immediate recall and verbal fluency. Across measures, groups with consistently higher performance trajectories had more precise multisensory integration. These findings support broad links between multisensory integration and several cognitive measures, including processing speed, attention and memory, rather than association with any specific subdomain.

The illusion of having a large virtual body biases action-specific perception in patients with mild cognitive impairment

The illusion of having a large body makes us perceive objects as smaller than they really are. This action-specific perception effect occurs because we perceive the property of an object (i.e., size) differently according to our unique action capability (i.e., the affordance of body size). Although the body-ownership illusion contributing to this action-specific perception has been studied, its effects remain unclear in neurological patients. We examined the action-specific perception impairments of MCI patients by means of body-ownership illusion in a non-immersive virtual reality environment. Twenty healthy young adults, 21 healthy older adults, and 15 MCI patients were recruited. We assessed their “original-body action-specific perception” and “enlarged-body action-specific perception” using the original and enlarged sizes of their virtual bodies, respectively. The MCI patients’ original-body action-specific perception was no different than that of the healthy controls (p = 0.679). However, the enlarged-body action-specific perception of the MCI patients was significantly biased (p < 0.001). The inclusion of the enlarged-body action-specific perception provides additional discriminative power for early diagnosis of MCI (89.3% accuracy, 75.0% sensitivity, 100.0% specificity, and 87.5% balanced accuracy).

Manual Gestures Modulate Early Neural Responses in Loudness Perception

How different sensory modalities interact to shape perception is a fundamental question in cognitive neuroscience. Previous studies in audiovisual interaction have focused on abstract levels such as categorical representation (e.g., McGurk effect). It is unclear whether the cross-modal modulation can extend to low-level perceptual attributes. This study used motional manual gestures to test whether and how the loudness perception can be modulated by visual-motion information. Specifically, we implemented a novel paradigm in which participants compared the loudness of two consecutive sounds whose intensity changes around the just noticeable difference (JND), with manual gestures concurrently presented with the second sound. In two behavioral experiments and two EEG experiments, we investigated our hypothesis that the visual-motor information in gestures would modulate loudness perception. Behavioral results showed that the gestural information biased the judgment of loudness. More importantly, the EEG results demonstrated that early auditory responses around 100 ms after sound onset (N100) were modulated by the gestures. These consistent results in four behavioral and EEG experiments suggest that visual-motor processing can integrate with auditory processing at an early perceptual stage to shape the perception of a low-level perceptual attribute such as loudness, at least under challenging listening conditions.

Sensory Dysfunction in Old Age

BACKGROUND

The senses serve as the crucial interface between the individual and the environment. They are subject to aging and disease processes.

METHODS

This review is based on pertinent publications retrieved by a selective search in the Medline and Cochrane Library databases.

RESULTS

Approximately 40% of persons aged 70 to 79 manifest dysfunction in at least one, and more than 25% in multiple senses. Sensory changes are accompanied by diverse comorbidities which depend on the particular sense(s) affected. The presence of sensory deficits is associated with an increased risk of developing dementia (OR: 1.49 [95% confidence interval: 1.12; 1.98] for dysfunction in a single sensory modality, 2.85 [1.88; 4.30] for dysfunction in three or more sensory modalities). The risk of developing depressive symptoms is elevated as well (OR 3.36 [2.28; 4.96]). The individual's ability to cope with the demands of everyday life is largely determined by the ability to carry out multisensory integration, in which the perceptions of the different senses are bound together. This function itself is subject to age-related changes that can be either adaptive or maladaptive; it can, therefore, serve as an indicator for pathological aging processes.

CONCLUSION

Sensory dysfunction in old age should be detected as early as possible. This implies the need for close collaboration of all of the involved disciplines. It would be desirable to develop sensory screening tests as well as a procedure for testing multisensory integration in routine clinical practice.

Age-Related Changes in Audiovisual Simultaneity Perception and Their Relationship With Working Memory

OBJECTIVES

Perceiving simultaneity of a visual and an auditory signal is critical for humans to integrate these multisensory inputs effectively and respond properly. We examined age-related changes in audiovisual simultaneity perception, and the relationships between this perception and working memory performances with aging.

METHODS

Audiovisual simultaneity perception of young, middle-aged, and older adults was measured using a simultaneity judgment (SJ) task, in which a flash and a beep were presented at 1 of 11 stimulus-onset asynchronies (SOAs). Participants judged whether these two stimuli were perceived simultaneously. Precision of simultaneity perception, the SOA corresponding to the point of subjective simultaneity (PSS), and response errors at each SOA were estimated using model fitting. The precision and PSS are associated with multisensory perception per se, whereas the response error reflects executive ability when performing the SJ task. Visual working memory of the same middle-aged and older adults was measured using the Cambridge Neuropsychological Test Automated Battery (CANTAB) beforehand.

RESULTS

Compared to young adults' performances, middle-aged and older adults showed a decreased precision, a shift of PSS toward the visual-leading SOAs, and increased response errors at the visual-leading SOAs. Among these changes, only the increased response errors correlated with worse spatial recognition memory in middle-aged and older adults.

DISCUSSION

Age-related decrements in audiovisual simultaneity perception start from middle age and are manifested in both perceptual and executive parameters. Furthermore, higher-order executive ability is plausibly a common cause for age-related degenerations in the audiovisual simultaneity perception and visual working memory.

Individuals With Mild Cognitive Impairment and Alzheimer's Disease Benefit From Audiovisual Speech Cues and Supportive Sentence Context

Purpose Speech perception in noise becomes difficult with age but can be facilitated by audiovisual (AV) speech cues and sentence context in healthy older adults. However, individuals with Alzheimer's disease (AD) may present with deficits in AV integration, potentially limiting the extent to which they can benefit from AV cues. This study investigated the benefit of these cues in individuals with mild cognitive impairment (MCI), individuals with AD, and healthy older adult controls. Method This study compared auditory-only and AV speech perception of sentences presented in noise. These sentences had one of two levels of context: high (e.g., "Stir your coffee with a spoon") and low (e.g., "Bob didn't think about the spoon"). Fourteen older controls (M _age = 72.71 years, SD = 9.39), 13 individuals with MCI (M _age = 79.92 years, SD = 5.52), and nine individuals with probable Alzheimer's-type dementia (M _age = 79.38 years, SD = 3.40) completed the speech perception task and were asked to repeat the terminal word of each sentence. Results All three groups benefited (i.e., identified more terminal words) from AV and sentence context. Individuals with MCI showed a smaller AV benefit compared to controls in low-context conditions, suggesting difficulties with AV integration. Individuals with AD showed a smaller benefit in high-context conditions compared to controls, indicating difficulties with AV integration and context use in AD. Conclusions Individuals with MCI and individuals with AD do benefit from AV speech and semantic context during speech perception in noise (albeit to a lower extent than healthy older adults). This suggests that engaging in face-to-face communication and providing ample context will likely foster more effective communication between patients and caregivers, professionals, and loved ones.

Ageing and multisensory integration: A review of the evidence, and a computational perspective

The processing of multisensory signals is crucial for effective interaction with the environment, but our ability to perform this vital function changes as we age. In the first part of this review, we summarise existing research into the effects of healthy ageing on multisensory integration. We note that age differences vary substantially with the paradigms and stimuli used: older adults often receive at least as much benefit (to both accuracy and response times) as younger controls from congruent multisensory stimuli, but are also consistently more negatively impacted by the presence of intersensory conflict. In the second part, we outline a normative Bayesian framework that provides a principled and computationally informed perspective on the key ingredients involved in multisensory perception, and how these are affected by ageing. Applying this framework to the existing literature, we conclude that changes to sensory reliability, prior expectations (together with attentional control), and decisional strategies all contribute to the age differences observed. However, we find no compelling evidence of any age-related changes to the basic inference mechanisms involved in multisensory perception.

Aging and the (Chemical) Senses: Implications for Food Behaviour Amongst Elderly Consumers

The growing aging population are increasingly suffering from the negative health consequences of the age-related decline in their senses, especially their chemical senses. Unfortunately, however, unlike for the higher senses of vision and hearing, there is currently nothing that can be done to bring back the chemical senses once they are lost (or have started their inevitable decline). The evidence suggests that such chemosensory changes can result in a range of maladaptive food behaviours, including the addition of more salt and sugar to food and drink in order to experience the same taste intensity while, at the same time, reducing their overall consumption because food has lost its savour. Here, though, it is also important to stress the importance of the more social aspects of eating and drinking, given the evidence suggesting that a growing number of older individuals are consuming more of their meals alone than ever before. Various solutions have been put forward in order to try to enhance the food experience amongst the elderly, including everything from optimising the product-intrinsic food inputs provided to the remaining functional senses through to a variety of digital interventions. Ultimately, however, the aim has to be to encourage healthier patterns of food consumption amongst this rapidly-growing section of the population by optimising the sensory, nutritional, social, and emotional aspects of eating and drinking. An experimental dinner with the residents of one such home where nostalgic-flavoured healthy ice-creams were served is described.

Sensory capability and information integration independently explain the cognitive status of healthy older adults

While there is evidence that sensory processing and multisensory integration change with age, links between these alterations and their relation to cognitive status remain unclear. In this study, we assessed sensory thresholds and performance of healthy younger and older adults in a visuotactile delayed match-to-sample task. Using Bayesian structural equation modelling (BSEM), we explored the factors explaining cognitive status in the group of older adults. Additionally, we applied transcranial alternating current stimulation (tACS) to a parieto-central network found to underlie visuotactile interactions and working memory matching in our previous work. Response times and signal detection measures indicated enhanced multisensory integration and enhanced benefit from successful working memory matching in older adults. Further, tACS caused a frequency-specific speeding (20 Hz) and delaying (70 Hz) of responses. Data exploration suggested distinct underlying factors for sensory acuity and sensitivity d’ on the one side, and multisensory and working memory enhancement on the other side. Finally, BSEM showed that these two factors labelled ‘sensory capability’ and ‘information integration’ independently explained cognitive status. We conclude that sensory decline and enhanced information integration might relate to distinct processes of ageing and discuss a potential role of the parietal cortex in mediating augmented integration in older adults.

Gray matter volume in the right angular gyrus is associated with differential patterns of multisensory integration with aging

Multisensory perception might provide an important marker of brain function in aging. However, the cortical structures supporting multisensory perception in aging are poorly understood. In this study, we compared regional gray matter volume in a group of middle-aged (n = 101; 49-64 years) and older (n = 116; 71-87 years) adults from The Irish Longitudinal Study on Aging using voxel-based morphometry. Participants completed a measure of multisensory integration, the sound-induced flash illusion, and were grouped as per their illusion susceptibility. A significant interaction was observed in the right angular gyrus; in the middle-aged group, larger gray matter volume corresponded to stronger illusion perception while in older adults larger gray matter corresponded to less illusion susceptibility. This interaction remained significant even when controlling for a range of demographic, sensory, cognitive, and health variables. These findings show that multisensory integration is associated with specific structural differences in the aging brain and highlight the angular gyrus as a possible "cross-modal hub" associated with age-related change in multisensory perception.

Comparison of postural control in older adults under different dual-task conditions: A cross-sectional study

BACKGROUND

and purpose: Performing a cognitive task while maintaining postural stability, known as "dual-task" condition, can increase the cognitive demand and reduce the postural control capacity. The inability to allocate attention to postural control under dual-task conditions may lead to balance impairments, particularly in older adults. The present study aimed to compare the effects of different dual-task conditions of backward counting (BC) and visual attention (VA) on older adults' postural balance performance.

METHODS

Twenty asymptomatic volunteers (mean age: 70.4 ± 4.1 years) were recruited. Participants stood on a foam surface placed over a force plate, and displacement and sway velocity of their center of pressure (COP) in anterior-posterior (AP) and medial-lateral (ML) directions were recorded under three conditions: BC dual-task, VA dual-task (control of center of mass with a laser pointer), and quiet stance as the control task (CT).

RESULTS

Repeated measures ANOVA showed a significant difference in AP and ML sway velocities between conditions with p-values of 0.039 and 0.042, respectively. The LSD post-hoc test revealed that the BC task significantly increased AP sway velocity compared to the CT (p = 0.013), and the VA task significantly increased ML sway velocity compared to the CT (p = 0.034) and the BC tasks (p = 0.026). There were no statistically significant differences between conditions for ML (p = 0.058) and AP (p = 0.350) displacements and total sway velocity (p = 0.051).

CONCLUSION

Older adults' postural stability can be impaired under dual-task conditions and the present study revealed that various dual tasks increase postural sway in different directions.

How ageing shapes body and space representations: A comparison study between healthy young and older adults

To efficiently interact with the external world, the brain needs to represent the size of the involved body parts - body representations (BR) - and the space around the body in which the interactions with the environment take place - peripersonal space representation (PPS). BR and PPS are both highly flexible, being updated by the continuous flow of sensorimotor signals between the brain and the body, as observed for example after tool-use or immobilization. The progressive decline of sensorimotor abilities typically described in ageing could thus influence BR and PPS representations in the older adults. To explore this hypothesis, we compared BR and PPS in healthy young and older participants. By focusing on the upper limb, we adapted tasks previously used to evaluate BR and PPS plasticity, i.e., the body-landmarks localization task and audio-tactile interaction task, together with a new task targeting explicit BR (avatar adjustment task, AAT). Results show significantly higher distortions in the older rather than young participants in the perceived metric characteristic of the upper limbs. We found significant modifications in the implicit BR of the global shape (length and width) of both upper limbs, together with an underestimation in the arm length. Similar effects were also observed in the AAT task. Finally, both young and older adults showed equivalent multisensory facilitation in the space close to the hand, suggesting an intact PPS representation. Together, these findings demonstrated significant alterations of implicit and explicit BR in the older participants, probably associated with a less efficient contribution of bodily information typically subjected to age-related decline, whereas the comparable PPS representation in both groups could be supported by preserved multisensory abilities in older participants. These results provide novel empirical insight on how multiple representations of the body in space, subserving actions and perception, are shaped by the normal course of life.

Audio-Visual Training in Older Adults: 2-Interval-Forced Choice Task Improves Performance

A growing interest in ameliorating multisensory perception deficits in older adults arises from recent evidence showing that impaired multisensory processing, particularly in the temporal domain, may be associated with cognitive and functional impairments. Perceptual training has proved successful in improving multisensory temporal processing in young adults, but few studies have investigated this training approach in older adults. In the present study we used a simultaneity (or synchronicity) judgement task with feedback, to train the audio-visual abilities of community-dwelling, cognitively healthy older adults. We recruited 23 older adults (M = 74.17, SD = 6.23) and a group of 20 young adults (M = 24.20, SD = 4.23) who served as a comparison. Participants were tested before and after perceptual training using a 2-Interval Forced Choice Task (2-IFC); and the Sound-Induced Flash Illusion (SIFI). After 3 days of training, participants improved on the 2-IFC task, with a significant narrowing of the temporal window of integration (TWI) found for both groups. Generalization of training effects was not found, with no post-training differences in perceptual sensitivity to the SIFI for either group. These findings provide evidence perceptual narrowing can be achieved in older as well as younger adults after 3 days of perceptual training. These results provide useful information for future studies attempting to improve audio-visual temporal discrimination abilities in older people.

Processing moving visual scenes during upright stance in elderly patients with mild cognitive impairment

Background

The ability to maintain balance in an upright stance gradually worsens with age and is even more difficult for patients with cognitive disorders. Cognitive impairment plays a probable role in the worsening of stability. The purpose of this study was to expose subjects with mild cognitive impairment (MCI) and healthy, age-matched controls to moving visual scenes in order to examine their postural adaptation abilities.

Methods

We observed postural responses to moving visual stimulation while subjects stood on a force platform. The visual disturbance was created by interposing a moving picture in four directions (forward, backward, right, and left). The pre-stimulus (a static scene for 10 s), stimulus (a dynamic visual scene for 20 seconds) and post-stimulus (a static scene for 20 seconds) periods were evaluated. We separately analyzed the total path (TP) of the center of pressure (COP) and the root mean square (RMS) of the COP displacement in all four directions.

Results

We found differences in the TP of the COP during the post-stimulus period for all stimulus directions except in motion towards the subject (left p = 0.006, right p = 0.004, and away from the subject p = 0.009). Significant RMS differences between groups were also observed during the post-stimulus period in all directions except when directed towards the subject (left p = 0.002, right p = 0.007, and away from the subject p = 0.014).

Conclusion

Exposing subjects to a moving visual scene induced greater destabilization in MCI subjects compared to healthy elderly controls. Surprisingly, the moving visual scene also induced significant aftereffects in the MCI group. Our findings indicate that the MCI group had diminished adaptation to the dynamic visual scene and recovery. These results suggest that even mild cognitive deficits can impair sensory information integration and alter the sensory re-weighing process.

Neonatal Multisensory Processing in Preterm and Term Infants Predicts Sensory Reactivity and Internalizing Tendencies in Early Childhood

Multisensory processes include the capacity to combine information from the different senses, often improving stimulus representations and behavior. The extent to which multisensory processes are an innate capacity or instead require experience with environmental stimuli remains debated. We addressed this knowledge gap by studying multisensory processes in prematurely born and full-term infants. We recorded 128-channel event-related potentials (ERPs) from a cohort of 55 full-term and 61 preterm neonates (at an equivalent gestational age) in response to auditory, somatosensory, and combined auditory-somatosensory multisensory stimuli. Data were analyzed within an electrical neuroimaging framework, involving unsupervised topographic clustering of the ERP data. Multisensory processing in full-term infants was characterized by a simple linear summation of responses to auditory and somatosensory stimuli alone, which furthermore shared common ERP topographic features. We refer to the ERP topography observed in full-term infants as "typical infantile processing" (TIP). In stark contrast, preterm infants exhibited non-linear responses and topographies less-often characterized by TIP; there were distinct patterns of ERP topographies to multisensory and summed unisensory conditions. We further observed that the better TIP characterized an infant's ERPs, independently of prematurity, the more typical was the score on the Infant/Toddler Sensory Profile (ITSP) at 12 months of age and the less likely was the child to the show internalizing tendencies at 24 months of age. Collectively, these results highlight striking differences in the brain's responses to multisensory stimuli in children born prematurely; differences that relate to later sensory and internalizing functions.

Multisensory Gains in Simple Detection Predict Global Cognition in Schoolchildren

The capacity to integrate information from different senses is central for coherent perception across the lifespan from infancy onwards. Later in life, multisensory processes are related to cognitive functions, such as speech or social communication. During learning, multisensory processes can in fact enhance subsequent recognition memory for unisensory objects. These benefits can even be predicted; adults' recognition memory performance is shaped by earlier responses in the same task to multisensory - but not unisensory - information. Everyday environments where learning occurs, such as classrooms, are inherently multisensory in nature. Multisensory processes may therefore scaffold healthy cognitive development. Here, we provide the first evidence of a predictive relationship between multisensory benefits in simple detection and higher-level cognition that is present already in schoolchildren. Multiple regression analyses indicated that the extent to which a child (N = 68; aged 4.5-15years) exhibited multisensory benefits on a simple detection task not only predicted benefits on a continuous recognition task involving naturalistic objects (p = 0.009), even when controlling for age, but also the same relative multisensory benefit also predicted working memory scores (p = 0.023) and fluid intelligence scores (p = 0.033) as measured using age-standardised test batteries. By contrast, gains in unisensory detection did not show significant prediction of any of the above global cognition measures. Our findings show that low-level multisensory processes predict higher-order memory and cognition already during childhood, even if still subject to ongoing maturation. These results call for revision of traditional models of cognitive development (and likely also education) to account for the role of multisensory processing, while also opening exciting opportunities to facilitate early learning through multisensory programs. More generally, these data suggest that a simple detection task could provide direct insights into the integrity of global cognition in schoolchildren and could be further developed as a readily-implemented and cost-effective screening tool for neurodevelopmental disorders, particularly in cases when standard neuropsychological tests are infeasible or unavailable.

Aging Impairs Temporal Sensitivity, but not Perceptual Synchrony, Across Modalities

Encoding the temporal properties of external signals that comprise multimodal events is a major factor guiding everyday experience. However, during the natural aging process, impairments to sensory processing can profoundly affect multimodal temporal perception. Various mechanisms can contribute to temporal perception, and thus it is imperative to understand how each can be affected by age. In the current study, using three different temporal order judgement tasks (unisensory, multisensory, and sensorimotor), we investigated the effects of age on two separate temporal processes: synchronization and integration of multiple signals. These two processes rely on different aspects of temporal information, either the temporal alignment of processed signals or the integration/segregation of signals arising from different modalities, respectively. Results showed that the ability to integrate/segregate multiple signals decreased with age regardless of the task, and that the magnitude of such impairment correlated across tasks, suggesting a widespread mechanism affected by age. In contrast, perceptual synchrony remained stable with age, revealing a distinct intact mechanism. Overall, results from this study suggest that aging has differential effects on temporal processing, and general impairments with aging may impact global temporal sensitivity while context-dependent processes remain unaffected.

Multiple Sensory Impairment Is Associated With Increased Risk of Dementia Among Black and White Older Adults

BACKGROUND

Few studies have examined impairment in multiple senses (multisensory impairment) and risk of dementia in comparison to having a single or no sensory impairment.

METHODS

We studied 1,810 black and white nondemented participants from Health, Aging, and Body Composition (Health ABC) Study aged 70-79 years at enrollment. Sensory impairment was determined at our study baseline (Year 3-5 of Health ABC) using established cut points for vision (Bailey-Lovie visual acuity and Pelli-Robson contrast sensitivity test), hearing (audiometric testing), smell (12-item Cross-Cultural Smell Identification Test), and touch (peripheral nerve function tests). Incident dementia over 10 years of follow-up was based on hospitalization records, dementia medications, or at least 1.5 SD decline in Modified Mini-Mental State Examination score (race-specific). Cox proportional hazard models with adjustment for demographics, health behaviors, and health conditions evaluated the relationship between risk of dementia and increasing number of sensory impairments.

RESULTS

Sensory impairments were common: 28% had visual impairment, 35% had hearing loss, 22% had poor smell, 12% had touch insensitivity; 26% had more than two impairments, and 5.6% had more than three sensory impairments. Number of impairments was associated with risk of dementia in a graded fashion (p < .001). Compared to no sensory impairments, the adjusted hazard ratio was 1.49 (95% CI: 1.12, 1.98) for one sensory impairment, 1.91 (95% CI: 1.39, 2.63) for two sensory impairments, and 2.85 (95% CI: 1.88, 4.30) for more than three sensory impairments.

CONCLUSIONS

Multisensory impairment was strongly associated with increased risk of dementia. Although, the nature of this relationship needs further investigation, sensory function assessment in multiple domains may help identify patients at high risk of dementia.

Immediate improvement of speech-in-noise perception through multisensory stimulation via an auditory to tactile sensory substitution

BACKGROUND

Hearing loss is becoming a real social and health problem. Its prevalence in the elderly is an epidemic. The risk of developing hearing loss is also growing among younger people. If left untreated, hearing loss can perpetuate development of neurodegenerative diseases, including dementia. Despite recent advancements in hearing aid (HA) and cochlear implant (CI) technologies, hearing impaired users still encounter significant practical and social challenges, with or without aids. In particular, they all struggle with understanding speech in challenging acoustic environments, especially in presence of a competing speaker.

OBJECTIVES

In the current proof-of-concept study we tested whether multisensory stimulation, pairing audition and a minimal-size touch device would improve intelligibility of speech in noise.

METHODS

To this aim we developed an audio-to-tactile sensory substitution device (SSD) transforming low-frequency speech signals into tactile vibrations delivered on two finger tips. Based on the inverse effectiveness law, i.e., multisensory enhancement is strongest when signal-to-noise ratio is lowest between senses, we embedded non-native language stimuli in speech-like noise and paired it with a low-frequency input conveyed through touch.

RESULTS

We found immediate and robust improvement in speech recognition (i.e. in the Signal-To-Noise-ratio) in the multisensory condition without any training, at a group level as well as in every participant. The reported improvement at the group-level of 6 dB was indeed major considering that an increase of 10 dB represents a doubling of the perceived loudness.

CONCLUSIONS

These results are especially relevant when compared to previous SSD studies showing effects in behavior only after a demanding cognitive training. We discuss the implications of our results for development of SSDs and of specific rehabilitation programs for the hearing impaired either using or not using HAs or CIs. We also discuss the potential application of such a set-up for sense augmentation, such as when learning a new language.