Ageing and multisensory integration: A review of the evidence, and a computational perspective

Neural connectivity and balance control in aging: Insights from directed cortical networks during sensory conflict

Balance control is crucial for stability during daily activities, relying on the integration of sensory inputs from the visual, vestibular, and somatosensory systems. Aging impairs the efficiency of these systems, leading to an increased risk of falls; however, the neural mechanisms underlying this decline, particularly under sensory conflict, are not fully understood. This study investigated the effects of aging on neural connectivity and sensory integration during balance tasks. Ninety-six participants (47 older adults and 49 young adults) were subjected to balance perturbation tasks under sensory-congruent and sensory-conflict conditions using a virtual reality headset and rotating platform. Behavioral measures, including postural sway and perceptual accuracy, were recorded. Electroencephalography (EEG) data were analyzed using generalized partial directed coherence (GPDC) to assess the directed functional connectivity and network efficiency. Older adults exhibited significantly greater postural sway, reduced perceptual accuracy, and a diminished ability to detect sensory conflicts than young adults, particularly under conflict conditions. As demonstrated by connectivity analysis, young adults showed adaptive shifts in connectivity from the visual to somatosensory regions during sensory conflict. In contrast, older adults demonstrated a less adaptable mode of connectivity. At the same time, global efficiency and clustering coefficients of young adults were higher, suggesting more effective and modular brain networks. Correlation analyses in older adults revealed that higher visual cortex efficiency was linked to lower postural sway specifically during sensory conflict, whereas higher motor cortex efficiency was associated with greater sway only under sensory-congruent conditions. In short, neural adaptability is vital in sensory integration and balance control. Due to decreased neural flexibility and network efficiency in older adults, their sensory reweighting was undermined and instability increased during the sensory conflict. These findings establish a foundation for development of targeted interventions to strengthen balance and lower the risks of falls in older adults.

Audiovisual integration facilitates age-related perceptual decision making

OBJECTIVES

Aging populations commonly experience a decline in sensory functions, which negatively affects perceptual decision making. The decline in sensory functions has been shown to be partially compensated by audiovisual integration. Although audiovisual integration may have a positive effect on perception, it remains unclear whether the perceptual improvements observed in older adults during perceptual decision making are better explained by the early or late integration hypothesis.

METHODS

An audiovisual categorization task was used to explore responses to unisensory and audiovisual stimuli in young and older adults. Behavioral drift-diffusion model (DDM) and electroencephalography (EEG) were applied to characterize differences in cognitive and neural dynamics across groups.

RESULTS

The DDM showed that older adults exhibited higher drift rates and shorter nondecision times for audiovisual stimuli than for visual or auditory stimuli alone. The EEG results showed that during the early sensory encoding stage (150-300 ms), older adults exhibited greater audiovisual integration in beta band than younger adults. In the late decision-formation stage (500-700 ms), older adults exhibited greater audiovisual integration in beta band and greater audiovisual integration in the anterior frontal electrodes than younger adults.

DISCUSSION

These findings highlight the crucial role of audiovisual integration in both the early and late stages of perceptual decision making in older adults. The results suggest that enhanced audiovisual integration in older adults compared with younger adults may serve as a specific mechanism to mitigate the negative effects of aging on perceptual decision making.

Brain imaging studies of multisensory integration in emotion perception: A scoping review

Emotions are essential in everyday human functioning, yet accurately perceiving them is a complex task. Emotional cues originating from multiple sensory modalities need to be efficiently integrated to form holistic percepts. This process, known as emotional multisensory integration (eMSI), involves the recruitment of multiple brain regions and has been shown to enhance emotion perception. The present scoping review provides an updated and exhaustive overview of the current literature on brain regions underlying eMSI. In total, 12 relevant studies were identified for inclusion across four academic databases. Most included studies employed audio-visual paradigms, examined the integration of happy and angry emotional cues, and utilized functional magnetic resonance imaging to identify brain regions involved in eMSI. Findings support that brain regions underlying both multisensory (e.g., thalamus, posterior superior temporal sulcus/gyrus) and emotional integration (e.g., fusiform gyrus, medial temporal gyrus) interact to enhance eMSI, leading to improved emotion detection. A need for additional research was also identified due to a lack of diverse populations, sensory combinations, and emotions investigated, as well as methodological issues identified across included studies. Future research should aim to expand its focus to address these underexplored areas, thereby advancing our understanding of eMSI.

Correlates of gait speed changes during uneven terrain walking in older adults: differential roles of cognitive and sensorimotor function

Many studies of walking function and aging have measured walking on flat surfaces with and without dual-tasking (i.e., performing a concurrent cognitive task). Walking in the community increases the complexity with surface undulations and varying surface types. We hypothesized that changes in walking resulting from increasing terrain unevenness would be better predicted by sensorimotor function than cognitive function. Sixty-three community-dwelling older adults (65-93 yrs old; 32 males) performed overground walking under four uneven terrain conditions (Flat, Low, Medium, and High unevenness). Cognitive (cognitive flexibility, working memory, inhibition) and sensorimotor assessments (grip strength, 2-pt discrimination, pressure pain threshold) were measured as the primary predictors of walking performance. We found that walking speed decreased linearly with more elevated uneven terrain conditions across all participants; this was accentuated in older adults with lower mobility function. Greater rates of decline in walking speed from flat to uneven terrain were associated with worse attention and inhibitory function as well as lower 2-point tactile discrimination. Findings suggest that greater rates of decline with elevated terrain walking are associated with lower mobility function, lower executive functions and less somatosensation.

Realistic dual-task listening-while-balancing in older adults with normal hearing and hearing loss with and without hearing aids

Age-related hearing loss is a risk factor for mobility problems and falls, possibly due to poor access to spatial sounds or the higher allocation of attention required to listen, thereby reducing cognitive resources to support mobility. Introducing stabilizing spatial sounds or reducing cognitive load through hearing aids could possibly improve balance performance; however, evidence is mixed. Few studies have evaluated the effects of hearing aids and spatial sounds on balance during realistic, multisensory, dual-tasking conditions. This study used virtual reality to simulate a listening-while-balancing task in 22 older adults with normal hearing and 22 hearing aid users, tested with their aids on versus off. Participants performed a competing digits listening task (two, four digits) and a standing postural task, alone and in combination (dual task) under different visual, postural, and acoustical loads. Listening accuracy and postural outcomes (centre of pressure mean velocity, anterior-posterior standard deviation, medial-lateral standard deviation) were collected. With respect to listening accuracy, as expected, normal hearing adults had higher listening accuracy than those with hearing loss (aided better than unaided) and both groups performed better with eyes closed (vs. open) and under lower postural loads (firm vs. compliant). With respect to postural performance, hearing aids did not remarkably improve balance overall, with no effects on dual-task costs to posture. Other factors related to the complexity of the conditions (i.e., listening, visual, postural demands) differently influenced dual-task costs to posture in individuals with and without hearing loss. Overall, these results contribute to our understanding of how age-related hearing loss and hearing aids affect balance-related outcomes under realistic, complex, multisensory, multitasking conditions.

Sensory reweighting and self-motion perception for postural control under single-sensory and multisensory perturbations in older Tai Chi practitioners

Purpose

Impairment in perception and sensory reweighting could predispose older adults to falls. This exploratory study aimed to investigate the differences in sensory reweighting and self-motion perception for postural control under single-sensory and multisensory perturbations between older Tai Chi (TC) practitioners and healthy active older controls.

Methods

Twenty-four TC practitioners and 23 age-matched non-practitioners were recruited in this observational study. Participants stood on a force plate with or without a foam surface (baseline), followed by 36 s of visual rotation stimuli, vestibular rotation stimuli, or reduced somatosensory input (adaptation), and then continued standing for 44 s (reintegration). The center-of-pressure (COP) trajectories and self-motion perception were recorded. COP signals were analyzed using traditional sway, multiscale entropy, and wavelet analysis methods and the time-window-of-integration model to examine the postural balance performance and the flexibility and speed of sensory reweighting.

Results

Significant interaction effects of group with sensory perturbation and group with time window on COP parameters were observed (p < 0.05). Compared with non-practitioners, TC practitioners exhibited higher postural stability and complexity as the difficulty of standing tasks increased and smaller time windows to return to baseline levels as disturbance time evolved. Moreover, TC practitioners exhibited significantly greater weighting on unperturbed sensory systems, lower weighting on perturbed sensory systems for postural control, and higher self-motion perception ability under visual, vestibular, and visual-vestibular perturbations (p < 0.05).

Conclusion

Long-term TC practitioners exhibited superior postural stability and adaptability under challenging sensory perturbations, and smaller amplitudes and shorter durations of postural aftereffects over time during adaptation and reintegration. These improvements may be partly attributed to more rapid and flexible sensory reweighting and improved self-motion perception for postural control.

Older adults do not show enhanced benefits from multisensory information on speeded perceptual discrimination tasks

Some research has shown that older adults benefit more from multisensory information than do young adults. However, more recent evidence has shown that the multisensory age benefit varies considerably across tasks. In the current study, older (65 - 80) and young (18 - 30) adults (N = 191) completed a speeded perceptual discrimination task either online or face-to-face to assess task response speed. We examined whether presenting stimuli in multiple sensory modalities (audio-visual) instead of one (audio-only or visual-only) benefits older adults more than young adults. Across all three experiments, a consistent speeding of response was found in the multisensory condition compared to the unisensory conditions for both young and older adults. Furthermore, race model analysis showed a significant multisensory benefit across a broad temporal interval. Critically, there were no significant differences between young and older adults. Taken together, these findings provide strong evidence in favour of a multisensory benefit that does not differ across age groups, contrasting with prior research.

Multisensory perceptual and causal inference is largely preserved in medicated post-acute individuals with schizophrenia

Hallucinations and perceptual abnormalities in psychosis are thought to arise from imbalanced integration of prior information and sensory inputs. We combined psychophysics, Bayesian modeling, and electroencephalography (EEG) to investigate potential changes in perceptual and causal inference in response to audiovisual flash-beep sequences in medicated individuals with schizophrenia who exhibited limited psychotic symptoms. Seventeen participants with schizophrenia and 23 healthy controls reported either the number of flashes or the number of beeps of audiovisual sequences that varied in their audiovisual numeric disparity across trials. Both groups balanced sensory integration and segregation in line with Bayesian causal inference rather than resorting to simpler heuristics. Both also showed comparable weighting of prior information regarding the signals' causal structure, although the schizophrenia group slightly overweighted prior information about the number of flashes or beeps. At the neural level, both groups computed Bayesian causal inference through dynamic encoding of independent estimates of the flash and beep counts, followed by estimates that flexibly combine audiovisual inputs. Our results demonstrate that the core neurocomputational mechanisms for audiovisual perceptual and causal inference in number estimation tasks are largely preserved in our limited sample of medicated post-acute individuals with schizophrenia. Future research should explore whether these findings generalize to unmedicated patients with acute psychotic symptoms.

Audiovisual integration and sensory dominance effects in older adults with subjective cognitive decline: Enhanced redundant effects and stronger fusion illusion susceptibility

INTRODUCTION

Subjective cognitive decline (SCD) refers to individuals' perceived decline in memory and/or other cognitive abilities relative to their previous level of performance. Sensory decline is one of the main manifestations of decline in older adults with SCD. The efficient integration of visual and auditory information, known as audiovisual integration, is a crucial perceptual process. This study aims to evaluate audiovisual integration in older adults with SCD.

METHODS

We adopted the audiovisual detection task, the Colavita task, and the Sound-Induced Flash Illusion (SIFI) task to evaluate the audiovisual integration by examining both redundant and illusory effects. Older adults diagnosed with SCD (N = 50, mean age = 67.8 years) and a control group of non-SCD older adults (N = 51, mean age = 66.5 years) were recruited. All participants took part in the three aforementioned experiments.

RESULTS

The outcomes showed that a redundant effect occurred in both SCD and non-SCD older adults, with SCD older adults gaining more benefits in audiovisual detection task. Moreover, an equivalent amount of the visual dominance effect was observed among both SCD and non-SCD older adults in Colavita task. In addition, older adults with SCD perceived an equal fission illusion but a bigger fusion illusion compared with non-SCD older adults in SIFI task.

CONCLUSIONS

Overall, older adults with SCD exhibit increased audiovisual redundant effects and stronger fusion illusion susceptibility compared to non-SCD older adults. Besides, visual dominance was observed in both groups via the Colavita task, with no significant difference between non-SCD and SCD older adults. These findings implied that audiovisual integration might offer a potential way for the identification of SCD.

Perceptual training improves audiovisual integration by enhancing alpha-band oscillations and functional connectivity in older adults

Numerous studies on perceptual training exist, however, most have focused on the precision of temporal audiovisual perception, while fewer have concentrated on ability promotion for audiovisual integration (AVI). To investigate these issues, continuous 5-day audiovisual perceptual training was applied, during which electroencephalography was performed in response to auditory-only (A), visual-only (V) and audiovisual (AV) stimuli before and after training. The results showed that the perceptual sensitivity was greater for training group than for control group and was greater in the posttest than in the pretest. The response to the AV stimulus was significantly faster in the posttest than in the pretest for the older training group but was significantly greater for A and V stimuli for the younger training group. Electroencephalography analysis found higher P3 AVI amplitudes [AV-(A + V)] in the posttest than in the pretest for training group, which were subsequently reflected by an increased alpha (8-12 Hz) oscillatory response and strengthened global functional connectivity (weighted phase lag index). Furthermore, these facilitations were greater for older training groups than for younger training groups. These results confirm the age-related compensatory mechanism for AVI may be strengthened as audiovisual perceptual training progresses, providing an effective candidate for cognitive intervention in older adults.

Age Deficits in Associative Memory Are Not Alleviated by Multisensory Paradigms

OBJECTIVES

Age deficits in memory are widespread, this affects individuals at a personal level, and investigating memory has been a key focus in cognitive aging research. Age deficits occur in memory for an episode, where information from the environment is integrated through the senses into an episodic event via associative memory. Associating items in memory has been shown to be particularly difficult for older adults but can often be alleviated by providing support from the external environment. The current investigation explored the potential for increased sensory input (multimodal stimuli) to alleviate age deficits in associative memory. Here, we present compelling evidence, supported by Bayesian analysis, for a null age-by-modality interaction.

METHODS

Across three preregistered studies, young and older adults (n = 860) completed associative memory tasks either in single modalities or in multimodal formats. Study 1 used either visual text (unimodal) or video introductions (multimodal) to test memory for name-face associations. Studies 2 and 3 tested memory for paired associates. Study 2 used unimodal visual presentation or cross-modal visual-auditory word pairs in a cued recall paradigm. Study 3 presented word pairs as visual only, auditory only, or audiovisual and tested memory separately for items (individual words) or associations (word pairings).

RESULTS

Typical age deficits in associative memory emerged, but these were not alleviated by multimodal presentation.

DISCUSSION

The lack of multimodal support for associative memory indicates that perceptual manipulations are less effective than other forms of environmental support at alleviating age deficits in associative memory.

A drift diffusion model analysis of age-related impact on multisensory decision-making processes

Older adults (OAs) are typically slower and/or less accurate in forming perceptual choices relative to younger adults. Despite perceptual deficits, OAs gain from integrating information across senses, yielding multisensory benefits. However, the cognitive processes underlying these seemingly discrepant ageing effects remain unclear. To address this knowledge gap, 212 participants (18-90 years old) performed an online object categorisation paradigm, whereby age-related differences in Reaction Times (RTs) and choice accuracy between audiovisual (AV), visual (V), and auditory (A) conditions could be assessed. Whereas OAs were slower and less accurate across sensory conditions, they exhibited greater RT decreases between AV and V conditions, showing a larger multisensory benefit towards decisional speed. Hierarchical Drift Diffusion Modelling (HDDM) was fitted to participants' behaviour to probe age-related impacts on the latent multisensory decision formation processes. For OAs, HDDM demonstrated slower evidence accumulation rates across sensory conditions coupled with increased response caution for AV trials of higher difficulty. Notably, for trials of lower difficulty we found multisensory benefits in evidence accumulation that increased with age, but not for trials of higher difficulty, in which increased response caution was instead evident. Together, our findings reconcile age-related impacts on multisensory decision-making, indicating greater multisensory evidence accumulation benefits with age underlying enhanced decisional speed.

Effects of older age on visual and self-motion sensory cue integration in navigation

Older adults demonstrate impairments in navigation that cannot be explained by general cognitive and motor declines. Previous work has shown that older adults may combine sensory cues during navigation differently than younger adults, though this work has largely been done in dark environments where sensory integration may differ from full-cue environments. Here, we test whether aging adults optimally combine cues from two sensory systems critical for navigation: vision (landmarks) and body-based self-motion cues. Participants completed a homing (triangle completion) task using immersive virtual reality to offer the ability to navigate in a well-lit environment including visibility of the ground plane. An optimal model, based on principles of maximum-likelihood estimation, predicts that precision in homing should increase with multisensory information in a manner consistent with each individual sensory cue's perceived reliability (measured by variability). We found that well-aging adults (with normal or corrected-to-normal sensory acuity and active lifestyles) were more variable and less accurate than younger adults during navigation. Both older and younger adults relied more on their visual systems than a maximum likelihood estimation model would suggest. Overall, younger adults' visual weighting matched the model's predictions whereas older adults showed sub-optimal sensory weighting. In addition, high inter-individual differences were seen in both younger and older adults. These results suggest that older adults do not optimally weight each sensory system when combined during navigation, and that older adults may benefit from interventions that help them recalibrate the combination of visual and self-motion cues for navigation.

Older adults preserve audiovisual integration through enhanced cortical activations, not by recruiting new regions

Effective interactions with the environment rely on the integration of multisensory signals: Our brains must efficiently combine signals that share a common source, and segregate those that do not. Healthy ageing can change or impair this process. This functional magnetic resonance imaging study assessed the neural mechanisms underlying age differences in the integration of auditory and visual spatial cues. Participants were presented with synchronous audiovisual signals at various degrees of spatial disparity and indicated their perceived sound location. Behaviourally, older adults were able to maintain localisation accuracy. At the neural level, they integrated auditory and visual cues into spatial representations along dorsal auditory and visual processing pathways similarly to their younger counterparts but showed greater activations in a widespread system of frontal, temporal, and parietal areas. According to multivariate Bayesian decoding, these areas encoded critical stimulus information beyond that which was encoded in the brain areas commonly activated by both groups. Surprisingly, however, the boost in information provided by these areas with age-related activation increases was comparable across the 2 age groups. This dissociation-between comparable information encoded in brain activation patterns across the 2 age groups, but age-related increases in regional blood-oxygen-level-dependent responses-contradicts the widespread notion that older adults recruit new regions as a compensatory mechanism to encode task-relevant information. Instead, our findings suggest that activation increases in older adults reflect nonspecific or modulatory mechanisms related to less efficient or slower processing, or greater demands on attentional resources.

Multisensory Integration and Causal Inference in Typical and Atypical Populations

Multisensory perception is critical for effective interaction with the environment, but human responses to multisensory stimuli vary across the lifespan and appear changed in some atypical populations. In this review chapter, we consider multisensory integration within a normative Bayesian framework. We begin by outlining the complex computational challenges of multisensory causal inference and reliability-weighted cue integration, and discuss whether healthy young adults behave in accordance with normative Bayesian models. We then compare their behaviour with various other human populations (children, older adults, and those with neurological or neuropsychiatric disorders). In particular, we consider whether the differences seen in these groups are due only to changes in their computational parameters (such as sensory noise or perceptual priors), or whether the fundamental computational principles (such as reliability weighting) underlying multisensory perception may also be altered. We conclude by arguing that future research should aim explicitly to differentiate between these possibilities.

Evidence for an association between allostatic load and multisensory integration in middle-aged and older adults

Multisensory integration, the ability of the brain to integrate information from different sensory modalities, is critical for responding to environmental stimuli. While older adults show changes in multisensory integration with age, the impact of allostatic load (AL) (i.e., the effect of exposure to chronic stress, which can accelerate ageing) on multisensory perception remains understudied. We explored the relationship between multisensory integration and AL in 1,358 adults aged 50+ from The Irish Longitudinal Study on Ageing by performing a Sound Induced Flash Illusion (SIFI) task at multiple audio-visual temporal asynchronies. The AL score was created using a battery of biomarkers representing the activity of four major physiological systems: immunological, cardiovascular, metabolic, and renal. The number of biomarkers for which a participant was categorised in the highest risk quartile using sex-specific cutoffs was used to produce an overall AL score. We accounted for medication use when calculating our AL score. We analysed the accuracy of illusion trials on a SIFI task using generalised logistic mixed effects regression models adjusted for a number of covariates. Observation of cross-sectional and longitudinal results revealed that lower accuracy in integration (i.e., higher SIFI susceptibility with larger temporal asynchronies) was associated with higher AL. This confirmed the distinct patterns of multisensory integration in ageing.

Influence of Normal Aging and Multisensory Data Fusion on Cybersickness and Postural Adaptation in Immersive Virtual Reality

Immersive Virtual Reality (VR) systems are expanding as sensorimotor readaptation tools for older adults. However, this purpose may be challenged by cybersickness occurrences possibly caused by sensory conflicts. This study aims to analyze the effects of aging and multisensory data fusion processes in the brain on cybersickness and the adaptation of postural responses when exposed to immersive VR.

METHODS

We repeatedly exposed 75 participants, aged 21 to 86, to immersive VR while recording the trajectory of their Center of Pressure (CoP). Participants rated their cybersickness after the first and fifth exposure.

RESULTS

The repeated exposures increased cybersickness and allowed for a decrease in postural responses from the second repetition, i.e., increased stability. We did not find any significant correlation between biological age and cybersickness scores. On the contrary, even if some postural responses are age-dependent, a significant postural adaptation occurred independently of age. The CoP trajectory length in the anteroposterior axis and mean velocity were the postural parameters the most affected by age and repetition.

CONCLUSIONS

This study suggests that cybersickness and postural adaptation to immersive VR are not age-dependent and that cybersickness is unrelated to a deficit in postural adaptation or age. Age does not seem to influence the properties of multisensory data fusion.

Audio-visual integration is more precise in older adults with a high level of long-term physical activity

It is well established that physical activity leads to numerous health, cognitive, and psychological benefits. However, to date, very few studies have investigated the impact of physical activity on multisensory perception, that is, the brain's capacity to integrate information across sensory modalities. Furthermore, it is unknown what level of long-term physical activity is associated with multisensory integration in adults. We explored the relationship between multisensory integration and a ten-year physical activity trajectory in 2,974 adults aged 50+ from The Irish Longitudinal Study on Ageing by measuring susceptibility to the Sound Induced Flash Illusion (SIFI) at multiple audio-visual temporal asynchronies. Physical activity was measured using the International Physical Activity Questionnaire (IPAQ-SF) at 2 years intervals over ten years. We used latent class trajectory modelling to identify latent growth classes of individuals following a similar trajectory of physical activity over time. We analysed the association of this trajectory with performance accuracy to the illusion trials of the SIFI task with generalized logistic mixed effects regression models, adjusted for several covariates. Results showed that more precise integration (i.e., lower SIFI susceptibility with larger temporal asynchronies) was associated with a higher level of sustained physical activity across ten years. Although the use of self-reported physical activity and a short version of the SIFI task limit our conclusions to some extent, nonetheless, the results suggest that sustained physical activity is associated with more precise multisensory integration, which in turn is linked to better balance and a lower risk of falling in older adults.

The effect of unisensory and multisensory information on lexical decision and free recall in young and older adults

Studies using simple low-level stimuli show that multisensory stimuli lead to greater improvements in processing speed for older adults than young adults. However, there is insufficient evidence to explain how these benefits influence performance for more complex processes such as judgement and memory tasks. This study examined how presenting stimuli in multiple sensory modalities (audio-visual) instead of one (audio-only or visual-only) may help older adults to improve their memory and cognitive processing compared to young adults. Young and older adults completed lexical decision (real word vs. pseudoword judgement) and word recall tasks, either independently, or in combination (dual-task), with and without perceptual noise. Older adults were better able to remember words when encoding independently. In contrast, young adults were better able to remember words when encoding in combination with lexical decisions. Both young and older adults had better word recall in the audio-visual condition compared with the audio-only condition. The findings indicate significant age differences when dealing with multiple tasks during encoding. Crucially, there is no greater multisensory benefit for older adults compared to young adults in more complex processes, rather multisensory stimuli can be useful in enhancing cognitive performance for both young and older adults.

Multisensory perception constrains the formation of object categories: a review of evidence from sensory-driven and predictive processes on categorical decisions

Although object categorization is a fundamental cognitive ability, it is also a complex process going beyond the perception and organization of sensory stimulation. Here we review existing evidence about how the human brain acquires and organizes multisensory inputs into object representations that may lead to conceptual knowledge in memory. We first focus on evidence for two processes on object perception, multisensory integration of redundant information (e.g. seeing and feeling a shape) and crossmodal, statistical learning of complementary information (e.g. the 'moo' sound of a cow and its visual shape). For both processes, the importance attributed to each sensory input in constructing a multisensory representation of an object depends on the working range of the specific sensory modality, the relative reliability or distinctiveness of the encoded information and top-down predictions. Moreover, apart from sensory-driven influences on perception, the acquisition of featural information across modalities can affect semantic memory and, in turn, influence category decisions. In sum, we argue that both multisensory processes independently constrain the formation of object categories across the lifespan, possibly through early and late integration mechanisms, respectively, to allow us to efficiently achieve the everyday, but remarkable, ability of recognizing objects. This article is part of the theme issue 'Decision and control processes in multisensory perception'.

Age-related differences in temporal binding and the influence of action body parts

If voluntary action is followed by an effect with a short time delay, the time interval between action and effect is often perceived to be shorter than it actually is. This perceptual time compression is termed intentional binding or temporal binding. We investigated age-related changes in adulthood considering temporal binding and its dependence on action body parts (i.e., hand vs. foot). This experiment included 17 young adults (mean age: 21.71 ± 3.14 years) and 27 older adults (mean age: 74.41 ± 3.38 years). Participants performed a button press task using their index fingers (hand condition) or toes (foot condition). The results showed that older participants exhibited a strong time compression comparable to young participants in the voluntary condition. Older participants also showed a strong time compression in involuntary action, which was induced by a mechanical device, differently from young participants. In line with previous research, the present age-related differences in time compression considering involuntary action suggest that causal belief significantly influences event perception rather than the associated intention of action or sensory afferents. The present results also suggest that the nature of action body parts has no significant influence on temporal binding, independent of age group.

Longitudinal grip strength is associated with susceptibility to the Sound Induced Flash Illusion in older adults

The precision of temporal multisensory integration is associated with specific aspects of physical functioning in ageing, including gait speed and incidents of falling. However, it is unknown if such an association exists between multisensory integration and grip strength, an important index of frailty and brain health and predictor of disease and mortality in older adults. Here, we investigated whether temporal multisensory integration is associated with longitudinal (eight-year) grip strength trajectories in a large sample of 2,061 older adults (mean age = 64.42 years, SD = 7.20; 52% female) drawn from The Irish Longitudinal Study on Ageing (TILDA). Grip strength (kg) for the dominant hand was assessed with a hand-held dynamometer across four testing waves. Longitudinal k-means clustering was applied to these data separately for sex (male, female) and age group (50-64, 65-74, 75+ years). At wave 3, older adults participated in the Sound Induced Flash Illusion (SIFI), a measure of the precision of temporal audio-visual integration, which included three audio-visual stimulus onset asynchronies (SOAs): 70, 150 and 230 ms. Results showed that older adults with a relatively lower (i.e., weaker) grip strength were more susceptible to the SIFI at the longer SOAs compared to those with a relatively higher (i.e., stronger) grip strength (p <.001). These novel findings suggest that older adults with relatively weaker grip strength exhibit an expanded temporal binding window for audio-visual events, possibly reflecting a reduction in the integrity of the central nervous system.

Sensory and multisensory reasoning: Is Bayesian updating modality-dependent?

Bayesianism assumes that probabilistic updating does not depend on the sensory modality by which information is processed. In this study, we investigate whether probability judgments based on visual and auditory information conform to this assumption. In a series of five experiments, we found that this is indeed the case when information is acquired through a single modality (i.e., only auditory or only visual) but not necessarily so when it comes from multiple modalities (i.e., audio-visual). In the latter case, judgments prove more accurate when both visual and auditory information individually support (i.e., increase the probability of) the hypothesis they also jointly support (synergy condition) than when either visual or auditory information support one hypothesis that is not the one they jointly support (contrast condition). In the extreme case in which both visual and auditory information individually support an alternative hypothesis to the one they jointly support (i.e., double-contrast condition), participants' accuracy is not only lower than in the synergy condition but near chance. This synergy-contrast effect represents a violation of the assumption that information modality is irrelevant for Bayesian updating and indicates an important limitation of multisensory integration, one which has not been previously documented.

Successful aging of musicians: Preservation of sensorimotor regions aids audiovisual speech-in-noise perception

Musicianship can mitigate age-related declines in audiovisual speech-in-noise perception. We tested whether this benefit originates from functional preservation or functional compensation by comparing fMRI responses of older musicians, older nonmusicians, and young nonmusicians identifying noise-masked audiovisual syllables. Older musicians outperformed older nonmusicians and showed comparable performance to young nonmusicians. Notably, older musicians retained similar neural specificity of speech representations in sensorimotor areas to young nonmusicians, while older nonmusicians showed degraded neural representations. In the same region, older musicians showed higher neural alignment to young nonmusicians than older nonmusicians, which was associated with their training intensity. In older nonmusicians, the degree of neural alignment predicted better performance. In addition, older musicians showed greater activation in frontal-parietal, speech motor, and visual motion regions and greater deactivation in the angular gyrus than older nonmusicians, which predicted higher neural alignment in sensorimotor areas. Together, these findings suggest that musicianship-related benefit in audiovisual speech-in-noise processing is rooted in preserving youth-like representations in sensorimotor regions.

Aging effect of cross-modal interactions during audiovisual detection and discrimination by behavior and ERPs

Introduction

Numerous studies have shown that aging greatly affects audiovisual integration; however, it is still unclear when the aging effect occurs, and its neural mechanism has yet to be fully elucidated.

Methods

We assessed the audiovisual integration (AVI) of older (n = 40) and younger (n = 45) adults using simple meaningless stimulus detection and discrimination tasks. The results showed that the response was significantly faster and more accurate for younger adults than for older adults in both the detection and discrimination tasks. The AVI was comparable for older and younger adults during stimulus detection (9.37% vs. 9.43%); however, the AVI was lower for older than for younger adults during stimulus discrimination (9.48% vs. 13.08%) behaviorally. The electroencephalography (EEG) analysis showed that comparable AVI amplitude was found at 220-240 ms for both groups during stimulus detection and discrimination, but there was no significant difference between brain regions for older adults but a higher AVI amplitude in the right posterior for younger adults. Additionally, a significant AVI was found for younger adults in 290-310 ms but was absent for older adults during stimulus discrimination. Furthermore, significant AVI was found in the left anterior and right anterior at 290-310 ms for older adults but in the central, right posterior and left posterior for younger adults.

Discussion

These results suggested that the aging effect of AVI occurred in multiple stages, but the attenuated AVI mainly occurred in the later discriminating stage attributed to attention deficit.

Susceptibility to the sound-induced flash illusion is associated with gait speed in a large sample of middle-aged and older adults

BACKGROUND

Multisensory integration is the ability to appropriately merge information from different senses for the purpose of perceiving and acting in the environment. During walking, information from multiple senses must be integrated appropriately to coordinate effective movements. We tested the association between a well characterised multisensory task, the Sound-Induced Flash Illusion (SIFI), and gait speed in 3255 participants from The Irish Longitudinal Study on Ageing. High susceptibility to this illusion at longer stimulus onset asynchronies characterises older adults, and has been associated with cognitive and functional impairments, therefore it should be associated with slower gait speed.

METHOD

Gait was measured under three conditions; usual pace, cognitive dual tasking, and maximal walking speed. A separate logistic mixed effects regression model was run for 1) gait at usual pace, 2) change in gait speed for the cognitive dual tasking relative to usual pace and 3) change in maximal walking speed relative to usual pace. In all cases a binary response indicating a correct/incorrect response to each SIFI trial was the dependent variable. The model controlled for covariates including age, sex, education, vision and hearing abilities, Body Mass Index, and cognitive function.

RESULTS

Slower gait was associated with more illusions, particularly at longer temporal intervals between the flash-beep pair and the second beep, indicating that those who integrated incongruent sensory inputs over longer intervals, also walked slower. The relative changes in gait speed for cognitive dual tasking and maximal walking speed were also significantly associated with SIFI at longer SOAs.

CONCLUSIONS

These findings support growing evidence that mobility, susceptibility to falling and balance control are associated with multisensory processing in ageing.

Uneven terrain versus dual-task walking: differential challenges imposed on walking behavior in older adults are predicted by cognitive and sensorimotor function

Aging is associated with declines in walking function. To understand these mobility declines, many studies have obtained measurements while participants walk on flat surfaces in laboratory settings during concurrent cognitive task performance (dual-tasking). This may not adequately capture the real-world challenges of walking at home and around the community. Here, we hypothesized that uneven terrains in the walking path impose differential changes to walking speed compared to dual-task walking. We also hypothesized that changes in walking speed resulting from uneven terrains will be better predicted by sensorimotor function than cognitive function. Sixty-three community-dwelling older adults (65-93 yrs old) performed overground walking under varying walking conditions. Older adults were classified into two mobility function groups based on scores of the Short Physical Performance Battery. They performed uneven terrain walking across four surface conditions (Flat, Low, Medium, and High unevenness) and performed single and verbal dual-task walking on flat ground. Participants also underwent a battery of cognitive (cognitive flexibility, working memory, inhibition) and sensorimotor testing (grip strength, 2-pt discrimination, pressure pain threshold). Our results showed that walking speed decreased during both dual-task walking and across uneven terrain walking conditions compared to walking on flat terrain. Participants with lower mobility function had even greater decreases in uneven terrain walking speeds. The change in uneven terrain speed was associated with attention and inhibitory function. Changes in both dual-task and uneven terrain walking speeds were associated with 2-point tactile discrimination. This study further documents associations between mobility, executive functions, and somatosensation, highlights the differential costs to walking imposed by uneven terrains, and identifies that older adults with lower mobility function are more likely to experience these changes to walking function.

Digitally embodied lifespan neurocognitive development and Tactile Internet: Transdisciplinary challenges and opportunities

Mechanisms underlying perceptual processing and inference undergo substantial changes across the lifespan. If utilized properly, technologies could support and buffer the relatively more limited neurocognitive functions in the still developing or aging brains. Over the past decade, a new type of digital communication infrastructure, known as the "Tactile Internet (TI)," is emerging in the fields of telecommunication, sensor and actuator technologies and machine learning. A key aim of the TI is to enable humans to experience and interact with remote and virtual environments through digitalized multimodal sensory signals that also include the haptic (tactile and kinesthetic) sense. Besides their applied focus, such technologies may offer new opportunities for the research tapping into mechanisms of digitally embodied perception and cognition as well as how they may differ across age cohorts. However, there are challenges in translating empirical findings and theories about neurocognitive mechanisms of perception and lifespan development into the day-to-day practices of engineering research and technological development. On the one hand, the capacity and efficiency of digital communication are affected by signal transmission noise according to Shannon's (1949) Information Theory. On the other hand, neurotransmitters, which have been postulated as means that regulate the signal-to-noise ratio of neural information processing (e.g., Servan-Schreiber et al., 1990), decline substantially during aging. Thus, here we highlight neuronal gain control of perceptual processing and perceptual inference to illustrate potential interfaces for developing age-adjusted technologies to enable plausible multisensory digital embodiments for perceptual and cognitive interactions in remote or virtual environments.

Increases in sensory noise predict attentional disruptions to audiovisual speech perception

We receive information about the world around us from multiple senses which combine in a process known as multisensory integration. Multisensory integration has been shown to be dependent on attention; however, the neural mechanisms underlying this effect are poorly understood. The current study investigates whether changes in sensory noise explain the effect of attention on multisensory integration and whether attentional modulations to multisensory integration occur via modality-specific mechanisms. A task based on the McGurk Illusion was used to measure multisensory integration while attention was manipulated via a concurrent auditory or visual task. Sensory noise was measured within modality based on variability in unisensory performance and was used to predict attentional changes to McGurk perception. Consistent with previous studies, reports of the McGurk illusion decreased when accompanied with a secondary task; however, this effect was stronger for the secondary visual (as opposed to auditory) task. While auditory noise was not influenced by either secondary task, visual noise increased with the addition of the secondary visual task specifically. Interestingly, visual noise accounted for significant variability in attentional disruptions to the McGurk illusion. Overall, these results strongly suggest that sensory noise may underlie attentional alterations to multisensory integration in a modality-specific manner. Future studies are needed to determine whether this finding generalizes to other types of multisensory integration and attentional manipulations. This line of research may inform future studies of attentional alterations to sensory processing in neurological disorders, such as Schizophrenia, Autism, and ADHD.

Audiovisual integration of the dynamic hand-held tool at different stimulus intensities in aging

Introduction: In comparison to the audiovisual integration of younger adults, the same process appears more complex and unstable in older adults. Previous research has found that stimulus intensity is one of the most important factors influencing audiovisual integration. Methods: The present study compared differences in audiovisual integration between older and younger adults using dynamic hand-held tool stimuli, such as holding a hammer hitting the floor. Meanwhile, the effects of stimulus intensity on audiovisual integration were compared. The intensity of the visual and auditory stimuli was regulated by modulating the contrast level and sound pressure level. Results: Behavioral results showed that both older and younger adults responded faster and with higher hit rates to audiovisual stimuli than to visual and auditory stimuli. Further results of event-related potentials (ERPs) revealed that during the early stage of 60-100 ms, in the low-intensity condition, audiovisual integration of the anterior brain region was greater in older adults than in younger adults; however, in the high-intensity condition, audiovisual integration of the right hemisphere region was greater in younger adults than in older adults. Moreover, audiovisual integration was greater in the low-intensity condition than in the high-intensity condition in older adults during the 60-100 ms, 120-160 ms, and 220-260 ms periods, showing inverse effectiveness. However, there was no difference in the audiovisual integration of younger adults across different intensity conditions. Discussion: The results suggested that there was an age-related dissociation between high- and low-intensity conditions with audiovisual integration of the dynamic hand-held tool stimulus. Older adults showed greater audiovisual integration in the lower intensity condition, which may be due to the activation of compensatory mechanisms.

Audiovisual speech perception: Moving beyond McGurk

Although it is clear that sighted listeners use both auditory and visual cues during speech perception, the manner in which multisensory information is combined is a matter of debate. One approach to measuring multisensory integration is to use variants of the McGurk illusion, in which discrepant auditory and visual cues produce auditory percepts that differ from those based on unimodal input. Not all listeners show the same degree of susceptibility to the McGurk illusion, and these individual differences are frequently used as a measure of audiovisual integration ability. However, despite their popularity, we join the voices of others in the field to argue that McGurk tasks are ill-suited for studying real-life multisensory speech perception: McGurk stimuli are often based on isolated syllables (which are rare in conversations) and necessarily rely on audiovisual incongruence that does not occur naturally. Furthermore, recent data show that susceptibility to McGurk tasks does not correlate with performance during natural audiovisual speech perception. Although the McGurk effect is a fascinating illusion, truly understanding the combined use of auditory and visual information during speech perception requires tasks that more closely resemble everyday communication: namely, words, sentences, and narratives with congruent auditory and visual speech cues.

Multisensory Integration in Caenorhabditis elegans in Comparison to Mammals

Multisensory integration refers to sensory inputs from different sensory modalities being processed simultaneously to produce a unitary output. Surrounded by stimuli from multiple modalities, animals utilize multisensory integration to form a coherent and robust representation of the complex environment. Even though multisensory integration is fundamentally essential for animal life, our understanding of the underlying mechanisms, especially at the molecular, synaptic and circuit levels, remains poorly understood. The study of sensory perception in Caenorhabditis elegans has begun to fill this gap. We have gained a considerable amount of insight into the general principles of sensory neurobiology owing to C. elegans’ highly sensitive perceptions, relatively simple nervous system, ample genetic tools and completely mapped neural connectome. Many interesting paradigms of multisensory integration have been characterized in C. elegans, for which input convergence occurs at the sensory neuron or the interneuron level. In this narrative review, we describe some representative cases of multisensory integration in C. elegans, summarize the underlying mechanisms and compare them with those in mammalian systems. Despite the differences, we believe C. elegans is able to provide unique insights into how processing and integrating multisensory inputs can generate flexible and adaptive behaviors. With the emergence of whole brain imaging, the ability of C. elegans to monitor nearly the entire nervous system may be crucial for understanding the function of the brain as a whole.

Perceptual training narrows the temporal binding window of audiovisual integration in both younger and older adults

There is a growing body of evidence to suggest that multisensory processing changes with advancing age-usually in the form of an enlarged temporal binding window-with some studies linking these multisensory changes to negative clinical outcomes. Perceptual training regimes represent a promising means for enhancing the precision of multisensory integration in ageing; however, to date, the vast majority of studies examining the efficacy of multisensory perceptual learning have focused solely on healthy young adults. Here, we measured the temporal binding windows of younger and older participants before and after training on an audiovisual temporal discrimination task to assess (i) how perceptual training affected the shape of the temporal binding window and (ii) whether training effects were similar in both age groups. Our results replicated previous findings of an enlarged temporal binding window in older adults, as well as providing further evidence that both younger and older participants can improve the precision of their audiovisual timing estimation via perceptual training. We also show that this training protocol led to a narrowing of the temporal binding window associated with the sound-induced flash illusion in both age groups indicating a general refinement of audiovisual integration. However, while younger adults also displayed a general reduction in crossmodal interactions following training, this effect was not observed in the older adult group. Together, our results suggest that perceptual training narrows the temporal binding window of audiovisual integration in both younger and older adults but has less of an impact on prior expectations regarding the source of audiovisual signals in older adults.

Age-related changes in visuo-proprioceptive processing in perceived body position

This study investigated age-related change in visuo-proprioceptive processing in the perceived body position using mirror hand/foot illusions, focusing on its temporal characteristics, its dependency on body parts, and its association with older adults’ fall risk. Either immediately or 15 s after the exposure to the mirror-induced inconsistency of visuo-proprioceptive signals regarding the right hand or foot position, participants performed a reaching task using the unseen, illusion-affected hand or foot. Results showed clear age group differences. Specifically, older adults exhibited larger reaching errors than younger adults in the hand condition, and after the 15 s delay in the foot condition. Further, the reaching errors were constant across time for older adults but decreased after the delay in young adults, regardless of the tested body part. Particularly, older adults’ risk of falling, which was assessed by the timed up-and-go test, was negatively correlated with the reduction of reaching error across time. This suggests that older adults, especially those with a high risk of falling, face difficulties in appropriately processing visual and proprioceptive information for body perception in accordance with their external environment.

Audiovisual Integration for Saccade and Vergence Eye Movements Increases with Presbycusis and Loss of Selective Attention on the Stroop Test

Multisensory integration is a capacity allowing us to merge information from different sensory modalities in order to improve the salience of the signal. Audiovisual integration is one of the most used kinds of multisensory integration, as vision and hearing are two senses used very frequently in humans. However, the literature regarding age-related hearing loss (presbycusis) on audiovisual integration abilities is almost nonexistent, despite the growing prevalence of presbycusis in the population. In that context, the study aims to assess the relationship between presbycusis and audiovisual integration using tests of saccade and vergence eye movements to visual vs. audiovisual targets, with a pure tone as an auditory signal. Tests were run with the REMOBI and AIDEAL technologies coupled with the pupil core eye tracker. Hearing abilities, eye movement characteristics (latency, peak velocity, average velocity, amplitude) for saccade and vergence eye movements, and the Stroop Victoria test were measured in 69 elderly and 30 young participants. The results indicated (i) a dual pattern of aging effect on audiovisual integration for convergence (a decrease in the aged group relative to the young one, but an increase with age within the elderly group) and (ii) an improvement of audiovisual integration for saccades for people with presbycusis associated with lower scores of selective attention in the Stroop test, regardless of age. These results bring new insight on an unknown topic, that of audio visuomotor integration in normal aging and in presbycusis. They highlight the potential interest of using eye movement targets in the 3D space and pure tone sound to objectively evaluate audio visuomotor integration capacities.

Visual and Auditory Spatial Localization in Younger and Older Adults

Visual and auditory localization abilities are crucial in real-life tasks such as navigation and social interaction. Aging is frequently accompanied by vision and hearing loss, affecting spatial localization. The purpose of the current study is to elucidate the effect of typical aging on spatial localization and to establish a baseline for older individuals with pathological sensory impairment. Using a verbal report paradigm, we investigated how typical aging affects visual and auditory localization performance, the reliance on vision during sound localization, and sensory integration strategies when localizing audiovisual targets. Fifteen younger adults (N = 15, mean age = 26 years) and thirteen older adults (N = 13, mean age = 68 years) participated in this study, all with age-adjusted normal vision and hearing based on clinical standards. There were significant localization differences between younger and older adults, with the older group missing peripheral visual stimuli at significantly higher rates, localizing central stimuli as more peripheral, and being less precise in localizing sounds from central locations when compared to younger subjects. Both groups localized auditory targets better when the test space was visible compared to auditory localization when blindfolded. The two groups also exhibited similar patterns of audiovisual integration, showing optimal integration in central locations that was consistent with a Maximum-Likelihood Estimation model, but non-optimal integration in peripheral locations. These findings suggest that, despite the age-related changes in auditory and visual localization, the interactions between vision and hearing are largely preserved in older individuals without pathological sensory impairments.

Sensory Dysfunction in Old Age

BACKGROUND

The senses serve as the crucial interface between the individual and the environment. They are subject to aging and disease processes.

METHODS

This review is based on pertinent publications retrieved by a selective search in the Medline and Cochrane Library databases.

RESULTS

Approximately 40% of persons aged 70 to 79 manifest dysfunction in at least one, and more than 25% in multiple senses. Sensory changes are accompanied by diverse comorbidities which depend on the particular sense(s) affected. The presence of sensory deficits is associated with an increased risk of developing dementia (OR: 1.49 [95% confidence interval: 1.12; 1.98] for dysfunction in a single sensory modality, 2.85 [1.88; 4.30] for dysfunction in three or more sensory modalities). The risk of developing depressive symptoms is elevated as well (OR 3.36 [2.28; 4.96]). The individual's ability to cope with the demands of everyday life is largely determined by the ability to carry out multisensory integration, in which the perceptions of the different senses are bound together. This function itself is subject to age-related changes that can be either adaptive or maladaptive; it can, therefore, serve as an indicator for pathological aging processes.

CONCLUSION

Sensory dysfunction in old age should be detected as early as possible. This implies the need for close collaboration of all of the involved disciplines. It would be desirable to develop sensory screening tests as well as a procedure for testing multisensory integration in routine clinical practice.