Multisensory integration in the ventral intraparietal area of the macaque monkey

The remapping of peripersonal space after stroke, spinal cord injury and amputation: A PRISMA systematic review

Peripersonal space (PPS) is the body-centered area where interactions occur and objects can be reached. Its boundaries are dynamic, modulated by ongoing sensorimotor experiences: limb immobilization shrinks PPS, whereas tool use expands it. However, consistent clinical information on PPS alterations remains limited due to methodological heterogeneity, varying types and severities of sensorimotor disorders, and diverse experimental paradigms. This review explores the causal mechanisms of PPS processing by integrating findings from brain-lesioned patients and individuals with body deafferentation, such as amputees and spinal cord injury (SCI) patients. By comparing the effects of brain lesions and sensorimotor deafferentation, it clarifies how PPS is encoded, maintained, and reorganized following central nervous system damage, bodily changes, and the use of assistive devices. A systematic search of Scopus, Web of Science, and PubMed identified 17 studies: 4 on stroke patients (N = 100), 6 on SCI patients (N = 104), and 7 on amputees (N = 65). Risk of bias was assessed using the Quality Assessment Tool for Observational Cohort and Cross-Sectional Studies. Despite the limited number of studies and methodological variability, findings consistently show that sensorimotor changes significantly affect PPS. Notably, a contraction of PPS around the affected limb was observed in stroke, SCI patients, and amputees. Assistive devices were able to restore PPS after training, or even immediately in the case of prosthesis use. A shared neurophysiological mechanism across these conditions may underlie PPS as an online construct, continuously updated to reflect the body's current state and its interaction with the environment.

Locomotion-dependent auditory gating to the parietal cortex guides multisensory decisions

Decision-making in mammals fundamentally relies on integrating multiple sensory inputs, with conflicting information resolved flexibly based on a dominant sensory modality. However, the neural mechanisms underlying state-dependent changes in sensory dominance remain poorly understood. Our study demonstrates that locomotion in mice shifts auditory-dominant decisions toward visual dominance during audiovisual conflicts. Using circuit-specific calcium imaging and optogenetic manipulations, we found that weakened visual representation in the posterior parietal cortex (PPC) leads to auditory-dominant decisions in stationary mice. Prolonged locomotion, however, promotes visual dominance by inhibiting auditory cortical neurons projecting to the PPC (ACPPC). This shift is mediated by secondary motor cortical neurons projecting to the auditory cortex (M2AC), which specifically inhibit ACPPC neurons without affecting auditory cortical projections to the striatum (ACSTR). Our findings reveal the neural circuit mechanisms underlying auditory gating to the association cortex depending on locomotion states, providing insights into the state-dependent changes in sensory dominance during multisensory decision-making.

The prediction-confirmation account of the sense of body ownership: Evidence from a rubber hand illusion paradigm

We investigated the contribution of multisensory predictions to body ownership, and beyond, to the integration of body-related signals. Contrary to the prevailing idea, according to which, to be integrated, cues necessarily have to be perceived simultaneously, we instead proposed the prediction-confirmation account. According to this account, a perceived cue can be integrated with a predicted cue as long as both signals are relatively simultaneous. To test this hypothesis, a standard rubber hand illusion (RHI) paradigm was used. In the first part of each trial, the illusion was induced while participants observed the rubber hand being touched with a paintbrush. In the subsequent part of the trial, (i) both rubber hand and the participant's real hand were stroked as before (i.e., visible/synchronous condition), (ii) the rubber hand was not stroke anymore (i.e., visible/tactile-only condition), or (iii) both rubber hand and the participant's real hand were synchronously stroked while the location where the rubber hand was touched was occulted (i.e., occulted/synchronous condition). However, in this latter condition, participants still perceived the approaching movement of the paintbrush. Thus, based on this visual cue, the participants can properly predict the timepoint at which the tactile cue should occur (i.e., visuotactile predictions). Our major finding was that compared with the visible/tactile-only condition, the occulted/synchronous condition did not exhibit a decrease of the RHI as in the visible/synchronous condition. This finding supports the prediction-confirmation account and suggests that this mechanism operates even in the standard version of the RHI.

Macaque claustrum, pulvinar and putative dorsolateral amygdala support the cross-modal association of social audio-visual stimuli based on meaning

Social communication draws on several cognitive functions such as perception, emotion recognition and attention. The association of audio-visual information is essential to the processing of species-specific communication signals. In this study, we use functional magnetic resonance imaging in order to identify the subcortical areas involved in the cross-modal association of visual and auditory information based on their common social meaning. We identified three subcortical regions involved in audio-visual processing of species-specific communicative signals: the dorsolateral amygdala, the claustrum and the pulvinar. These regions responded to visual, auditory congruent and audio-visual stimulations. However, none of them was significantly activated when the auditory stimuli were semantically incongruent with the visual context, thus showing an influence of visual context on auditory processing. For example, positive vocalization (coos) activated the three subcortical regions when presented in the context of positive facial expression (lipsmacks) but not when presented in the context of negative facial expression (aggressive faces). In addition, the medial pulvinar and the amygdala presented multisensory integration such that audiovisual stimuli resulted in activations that were significantly higher than those observed for the highest unimodal response. Last, the pulvinar responded in a task-dependent manner, along a specific spatial sensory gradient. We propose that the dorsolateral amygdala, the claustrum and the pulvinar belong to a multisensory network that modulates the perception of visual socioemotional information and vocalizations as a function of the relevance of the stimuli in the social context. SIGNIFICANCE STATEMENT: Understanding and correctly associating socioemotional information across sensory modalities, such that happy faces predict laughter and escape scenes predict screams, is essential when living in complex social groups. With the use of functional magnetic imaging in the awake macaque, we identify three subcortical structures-dorsolateral amygdala, claustrum and pulvinar-that only respond to auditory information that matches the ongoing visual socioemotional context, such as hearing positively valenced coo calls and seeing positively valenced mutual grooming monkeys. We additionally describe task-dependent activations in the pulvinar, organizing along a specific spatial sensory gradient, supporting its role as a network regulator.

How we perceive the width of grasped objects: Insights into the central processes that govern proprioceptive judgements

Low-level proprioceptive judgements involve a single frame of reference, whereas high-level proprioceptive judgements are made across different frames of reference. The present study systematically compared low-level (grasp → $\rightarrow$ grasp) and high-level (vision → $\rightarrow$ grasp, grasp → $\rightarrow$ vision) proprioceptive tasks, and quantified the consistency of grasp → $\rightarrow$ vision and possible reciprocal nature of related high-level proprioceptive tasks. Experiment 1 (n = 30) compared performance across vision → $\rightarrow$ grasp, a grasp → $\rightarrow$ vision and a grasp → $\rightarrow$ grasp tasks. Experiment 2 (n = 30) compared performance on the grasp → $\rightarrow$ vision task between hands and over time. Participants were accurate (mean absolute error 0.27 cm [0.20 to 0.34]; mean [95% CI]) and precise (R 2 $R^2$ = 0.95 [0.93 to 0.96]) for grasp → $\rightarrow$ grasp judgements, with a strong correlation between outcomes (r = -0.85 [-0.93 to -0.70]). Accuracy and precision decreased in the two high-level tasks (R 2 $R^2$ = 0.86 and 0.89; mean absolute error = 1.34 and 1.41 cm), with most participants overestimating perceived width for the vision → $\rightarrow$ grasp task and underestimating it for grasp → $\rightarrow$ vision task. There was minimal correlation between accuracy and precision for these two tasks. Converging evidence indicated performance was largely reciprocal (inverse) between the vision → $\rightarrow$ grasp and grasp → $\rightarrow$ vision tasks. Performance on the grasp → $\rightarrow$ vision task was consistent between dominant and non-dominant hands, and across repeated sessions a day or week apart. Overall, there are fundamental differences between low- and high-level proprioceptive judgements that reflect fundamental differences in the cortical processes that underpin these perceptions. Moreover, the central transformations that govern high-level proprioceptive judgements of grasp are personalised, stable and reciprocal for reciprocal tasks. KEY POINTS: Low-level proprioceptive judgements involve a single frame of reference (e.g. indicating the width of a grasped object by selecting from a series of objects of different width), whereas high-level proprioceptive judgements are made across different frames of reference (e.g. indicating the width of a grasped object by selecting from a series of visible lines of different length). We highlight fundamental differences in the precision and accuracy of low- and high-level proprioceptive judgements. We provide converging evidence that the neural transformations between frames of reference that govern high-level proprioceptive judgements of grasp are personalised, stable and reciprocal for reciprocal tasks. This stability is likely key to precise judgements and accurate predictions in high-level proprioception.

Multisensory Integration Underlies the Distinct Representation of Odor-Taste Mixtures in the Gustatory Cortex of Behaving Rats

The perception of food relies on the integration of olfactory and gustatory signals originating from the mouth. This multisensory process generates robust associations between odors and tastes, significantly influencing the perceptual judgment of flavors. However, the specific neural substrates underlying this integrative process remain unclear. Previous electrophysiological studies identified the gustatory cortex as a site of convergent olfactory and gustatory signals, but whether neurons represent multimodal odor-taste mixtures as distinct from their unimodal odor and taste components is unknown. To investigate this, we recorded single-unit activity in the gustatory cortex of behaving female rats during the intraoral delivery of individual odors, individual tastes, and odor-taste mixtures. Our results demonstrate that chemoselective neurons in the gustatory cortex are broadly responsive to intraoral chemosensory stimuli, exhibiting time-varying multiphasic changes in activity. In a subset of these chemoselective neurons, odor-taste mixtures elicit nonlinear cross-modal responses that distinguish them from their olfactory and gustatory components. These findings provide novel insights into multimodal chemosensory processing by the gustatory cortex, highlighting the distinct representation of unimodal and multimodal intraoral chemosensory signals. Overall, our findings suggest that olfactory and gustatory signals interact nonlinearly in the gustatory cortex to enhance the identity coding of both unimodal and multimodal chemosensory stimuli.

Neural correlates of retrospective memory confidence during face-name associative learning

The ability to accurately assess one's own memory performance during learning is essential for adaptive behavior, but the brain mechanisms underlying this metamemory function are not well understood. We investigated the neural correlates of memory accuracy and retrospective memory confidence in a face-name associative learning task using magnetoencephalography in healthy young adults (n = 32). We found that high retrospective confidence was associated with stronger occipital event-related fields during encoding and widespread event-related fields during retrieval compared to low confidence. On the other hand, memory accuracy was linked to medial temporal activities during both encoding and retrieval, but only in low-confidence trials. A decrease in oscillatory power at alpha/beta bands in the parietal regions during retrieval was associated with higher memory confidence. In addition, representational similarity analysis at the single-trial level revealed distributed but differentiable neural activities associated with memory accuracy and confidence during both encoding and retrieval. In summary, our study unveiled distinct neural activity patterns related to memory confidence and accuracy during associative learning and underscored the crucial role of parietal regions in metamemory.

Cortical cellular encoding of thermotactile integration

Recent evidence suggests that primary sensory cortical regions play a role in the integration of information from multiple sensory modalities. How primary cortical neurons integrate different sources of sensory information is unclear, partly because non-primary sensory input to a cortical sensory region is often weak or modulatory. To address this question, we take advantage of the robust representation of thermal (cooling) and tactile stimuli in mouse forelimb primary somatosensory cortex (fS1). Using a thermotactile detection task, we show that the perception of threshold-level cool or tactile information is enhanced when they are presented simultaneously, compared with presentation alone. To investigate the cortical cellular correlates of thermotactile integration, we performed in vivo extracellular recordings from fS1 in awake resting and anesthetized mice during unimodal and bimodal stimulation of the forepaw. Unimodal stimulation evoked thermal- or tactile- specific excitatory and inhibitory responses of fS1 neurons. The most prominent features of combined thermotactile stimulation are the recruitment of unimodally silent fS1 neurons, non-linear integration features, and response dynamics that favor longer response durations with additional spikes. Together, we identify quantitative and qualitative changes in cortical encoding that may underlie the improvement in perception of thermotactile surfaces during haptic exploration.

Multisensory peripersonal space: Visual looming stimuli induce stronger response facilitation to tactile than auditory and visual stimulations

Anticipating physical contact with objects in the environment is a key component of efficient motor performance. Peripersonal neurons are thought to play a determinant role in these predictions by enhancing responses to touch when combined with visual stimuli in peripersonal space (PPS). However, recent research challenges the idea that this visuo-tactile integration contributing to the prediction of tactile events occurs strictly in PPS. We hypothesised that enhanced sensory sensitivity in a multisensory context involves not only contact anticipation but also heightened attention towards near-body visual stimuli. To test this hypothesis, Experiment 1 required participants to respond promptly to tactile (probing contact anticipation) and auditory (probing enhanced attention) stimulations presented at different moments of the trajectory of a (social and non-social) looming visual stimulus. Reduction in reaction time as compared to a unisensory baseline was observed from an egocentric distance of around 2 m (inside and outside PPS) for all multisensory conditions and types of visual stimuli. Experiment 2 tested whether these facilitation effects still occur in the absence of a multisensory context, i.e., in a visuo-visual condition. Overall, facilitation effects induced by the looming visual stimulus were comparable in the three sensory modalities outside PPS but were more pronounced for the tactile modality inside PPS (84 cm from the body as estimated by a reachability judgement task). Considered together, the results suggest that facilitation effects induced by visual looming stimuli in multimodal sensory processing rely on the combination of attentional factors and contact anticipation depending on their distance from the body.

Differential clustering of visual and choice- and saccade-related activity in macaque V3A and CIP

Neurons in sensory and motor cortices tend to aggregate in clusters with similar functional properties. Within the primate dorsal ("where") pathway, an important interface between three-dimensional (3-D) visual processing and motor-related functions consists of two hierarchically organized areas: V3A and the caudal intraparietal (CIP) area. In these areas, 3-D visual information, choice-related activity, and saccade-related activity converge, often at the single-neuron level. Characterizing the clustering of functional properties in areas with mixed selectivity, such as these, may help reveal organizational principles that support sensorimotor transformations. Here we quantified the clustering of visual feature selectivity, choice-related activity, and saccade-related activity by performing correlational and parametric comparisons of the responses of well-isolated, simultaneously recorded neurons in macaque monkeys. Each functional domain showed statistically significant clustering in both areas. However, there were also domain-specific differences in the strength of clustering across the areas. Visual feature selectivity and saccade-related activity were more strongly clustered in V3A than in CIP. In contrast, choice-related activity was more strongly clustered in CIP than in V3A. These differences in clustering may reflect the areas' roles in sensorimotor processing. Stronger clustering of visual and saccade-related activity in V3A may reflect a greater role in within-domain processing, as opposed to cross-domain synthesis. In contrast, stronger clustering of choice-related activity in CIP may reflect a greater role in synthesizing information across functional domains to bridge perception and action.NEW & NOTEWORTHY The occipital and parietal cortices of macaque monkeys are bridged by hierarchically organized areas V3A and CIP. These areas support 3-D visual transformations, carry choice-related activity during 3-D perceptual tasks, and possess saccade-related activity. This study quantifies the functional clustering of neuronal response properties within V3A and CIP for each of these domains. The findings reveal domain-specific cross-area differences in clustering that may reflect the areas' roles in sensorimotor processing.

Embodied Cross-Modal Interactions Based on an Altercentric Reference Frame

Accurate comprehension of others' thoughts and intentions is crucial for smooth social interactions, wherein understanding their perceptual experiences serves as a fundamental basis for this high-level social cognition. However, previous research has predominantly focused on the visual modality when investigating perceptual processing from others' perspectives, leaving the exploration of multisensory inputs during this process largely unexplored. By incorporating auditory stimuli into visual perspective-taking (VPT) tasks, we have designed a novel experimental paradigm in which the spatial correspondence between visual and auditory stimuli was limited to the altercentric rather than the egocentric reference frame. Overall, we found that when individuals engaged in explicit or implicit VPT to process visual stimuli from an avatar's viewpoint, the concomitantly presented auditory stimuli were also processed within this avatar-centered reference frame, revealing altercentric cross-modal interactions.

Separation of bimodal fMRI responses in mouse somatosensory areas into V1 and non-V1 contributions

Multisensory integration is necessary for the animal to survive in the real world. While conventional methods have been extensively used to investigate the multisensory integration process in various brain areas, its long-range interactions remain less explored. In this study, our goal was to investigate interactions between visual and somatosensory networks on a whole-brain scale using 15.2-T BOLD fMRI. We compared unimodal to bimodal BOLD fMRI responses and dissected potential cross-modal pathways with silencing of primary visual cortex (V1) by optogenetic stimulation of local GABAergic neurons. Our data showed that the influence of visual stimulus on whisker activity is higher than the influence of whisker stimulus on visual activity. Optogenetic silencing of V1 revealed that visual information is conveyed to whisker processing via both V1 and non-V1 pathways. The first-order ventral posteromedial thalamic nucleus (VPM) was functionally affected by non-V1 sources, while the higher-order posterior medial thalamic nucleus (POm) was predominantly modulated by V1 but not non-V1 inputs. The primary somatosensory barrel field (S1BF) was influenced by both V1 and non-V1 inputs. These observations provide valuable insights for into the integration of whisker and visual sensory information.

Mapping of facial and vocal processing in common marmosets with ultra-high field fMRI

Primate communication relies on multimodal cues, such as vision and audition, to facilitate the exchange of intentions, enable social interactions, avoid predators, and foster group cohesion during daily activities. Understanding the integration of facial and vocal signals is pivotal to comprehend social interaction. In this study, we acquire whole-brain ultra-high field (9.4 T) fMRI data from awake marmosets (Callithrix jacchus) to explore brain responses to unimodal and combined facial and vocal stimuli. Our findings reveal that the multisensory condition not only intensifies activations in the occipito-temporal face patches and auditory voice patches but also engages a more extensive network that includes additional parietal, prefrontal and cingulate areas, compared to the summed responses of the unimodal conditions. By uncovering the neural network underlying multisensory audiovisual integration in marmosets, this study highlights the efficiency and adaptability of the marmoset brain in processing facial and vocal social signals, providing significant insights into primate social communication.

Multisensory Integration in Body Representation

To be aware of and to move one's body, the brain must maintain a coherent representation of the body. While the body and the brain are connected by dense ascending and descending sensory and motor pathways, representation of the body is not hardwired. This is demonstrated by the well-known rubber hand illusion in which a visible fake hand is erroneously felt as one's own hand when it is stroked in synchrony with the viewer's unseen actual hand. Thus, body representation in the brain is not mere maps of tactile and proprioceptive inputs, but a construct resulting from the interpretation and integration of inputs across sensory modalities.

From Multisensory Integration to Multisensory Decision-Making

Organisms live in a dynamic environment in which sensory information from multiple sources is ever changing. A conceptually complex task for the organisms is to accumulate evidence across sensory modalities and over time, a process known as multisensory decision-making. This is a new concept, in terms of that previous researches have been largely conducted in parallel disciplines. That is, much efforts have been put either in sensory integration across modalities using activity summed over a duration of time, or in decision-making with only one sensory modality that evolves over time. Recently, a few studies with neurophysiological measurements emerge to study how different sensory modality information is processed, accumulated, and integrated over time in decision-related areas such as the parietal or frontal lobes in mammals. In this review, we summarize and comment on these studies that combine the long-existed two parallel fields of multisensory integration and decision-making. We show how the new findings provide insight into our understanding about neural mechanisms mediating multisensory information processing in a more complete way.

A multimodal cortical network of sensory expectation violation revealed by fMRI

The brain is subjected to multi-modal sensory information in an environment governed by statistical dependencies. Mismatch responses (MMRs), classically recorded with EEG, have provided valuable insights into the brain's processing of regularities and the generation of corresponding sensory predictions. Only few studies allow for comparisons of MMRs across multiple modalities in a simultaneous sensory stream and their corresponding cross-modal context sensitivity remains unknown. Here, we used a tri-modal version of the roving stimulus paradigm in fMRI to elicit MMRs in the auditory, somatosensory and visual modality. Participants (N = 29) were simultaneously presented with sequences of low and high intensity stimuli in each of the three senses while actively observing the tri-modal input stream and occasionally reporting the intensity of the previous stimulus in a prompted modality. The sequences were based on a probabilistic model, defining transition probabilities such that, for each modality, stimuli were more likely to repeat (p = .825) than change (p = .175) and stimulus intensities were equiprobable (p = .5). Moreover, each transition was conditional on the configuration of the other two modalities comprising global (cross-modal) predictive properties of the sequences. We identified a shared mismatch network of modality general inferior frontal and temporo-parietal areas as well as sensory areas, where the connectivity (psychophysiological interaction) between these regions was modulated during mismatch processing. Further, we found deviant responses within the network to be modulated by local stimulus repetition, which suggests highly comparable processing of expectation violation across modalities. Moreover, hierarchically higher regions of the mismatch network in the temporo-parietal area around the intraparietal sulcus were identified to signal cross-modal expectation violation. With the consistency of MMRs across audition, somatosensation and vision, our study provides insights into a shared cortical network of uni- and multi-modal expectation violation in response to sequence regularities.

Multisensory integration in the mammalian brain: diversity and flexibility in health and disease

Multisensory integration (MSI) occurs in a variety of brain areas, spanning cortical and subcortical regions. In traditional studies on sensory processing, the sensory cortices have been considered for processing sensory information in a modality-specific manner. The sensory cortices, however, send the information to other cortical and subcortical areas, including the higher association cortices and the other sensory cortices, where the multiple modality inputs converge and integrate to generate a meaningful percept. This integration process is neither simple nor fixed because these brain areas interact with each other via complicated circuits, which can be modulated by numerous internal and external conditions. As a result, dynamic MSI makes multisensory decisions flexible and adaptive in behaving animals. Impairments in MSI occur in many psychiatric disorders, which may result in an altered perception of the multisensory stimuli and an abnormal reaction to them. This review discusses the diversity and flexibility of MSI in mammals, including humans, primates and rodents, as well as the brain areas involved. It further explains how such flexibility influences perceptual experiences in behaving animals in both health and disease. This article is part of the theme issue 'Decision and control processes in multisensory perception'.

Quantifying body ownership information processing and perceptual bias in the rubber hand illusion

Bodily illusions have fascinated humankind for centuries, and researchers have studied them to learn about the perceptual and neural processes that underpin multisensory channels of bodily awareness. The influential rubber hand illusion (RHI) has been used to study changes in the sense of body ownership - that is, how a limb is perceived to belong to one's body, which is a fundamental building block in many theories of bodily awareness, self-consciousness, embodiment, and self-representation. However, the methods used to quantify perceptual changes in bodily illusions, including the RHI, have mainly relied on subjective questionnaires and rating scales, and the degree to which such illusory sensations depend on sensory information processing has been difficult to test directly. Here, we introduce a signal detection theory (SDT) framework to study the sense of body ownership in the RHI. We provide evidence that the illusion is associated with changes in body ownership sensitivity that depend on the information carried in the degree of asynchrony of correlated visual and tactile signals, as well as with perceptual bias and sensitivity that reflect the distance between the rubber hand and the participant's body. We found that the illusion's sensitivity to asynchrony is remarkably precise; even a 50 ms visuotactile delay significantly affected body ownership information processing. Our findings conclusively link changes in a complex bodily experience such as body ownership to basic sensory information processing and provide a proof of concept that SDT can be used to study bodily illusions.

Mouse frontal cortex mediates additive multisensory decisions

The brain can combine auditory and visual information to localize objects. However, the cortical substrates underlying audiovisual integration remain uncertain. Here, we show that mouse frontal cortex combines auditory and visual evidence; that this combination is additive, mirroring behavior; and that it evolves with learning. We trained mice in an audiovisual localization task. Inactivating frontal cortex impaired responses to either sensory modality, while inactivating visual or parietal cortex affected only visual stimuli. Recordings from >14,000 neurons indicated that after task learning, activity in the anterior part of frontal area MOs (secondary motor cortex) additively encodes visual and auditory signals, consistent with the mice's behavioral strategy. An accumulator model applied to these sensory representations reproduced the observed choices and reaction times. These results suggest that frontal cortex adapts through learning to combine evidence across sensory cortices, providing a signal that is transformed into a binary decision by a downstream accumulator.

Redundant representations are required to disambiguate simultaneously presented complex stimuli

A pedestrian crossing a street during rush hour often looks and listens for potential danger. When they hear several different horns, they localize the cars that are honking and decide whether or not they need to modify their motor plan. How does the pedestrian use this auditory information to pick out the corresponding cars in visual space? The integration of distributed representations like these is called the assignment problem, and it must be solved to integrate distinct representations across but also within sensory modalities. Here, we identify and analyze a solution to the assignment problem: the representation of one or more common stimulus features in pairs of relevant brain regions-for example, estimates of the spatial position of cars are represented in both the visual and auditory systems. We characterize how the reliability of this solution depends on different features of the stimulus set (e.g., the size of the set and the complexity of the stimuli) and the details of the split representations (e.g., the precision of each stimulus representation and the amount of overlapping information). Next, we implement this solution in a biologically plausible receptive field code and show how constraints on the number of neurons and spikes used by the code force the brain to navigate a tradeoff between local and catastrophic errors. We show that, when many spikes and neurons are available, representing stimuli from a single sensory modality can be done more reliably across multiple brain regions, despite the risk of assignment errors. Finally, we show that a feedforward neural network can learn the optimal solution to the assignment problem, even when it receives inputs in two distinct representational formats. We also discuss relevant results on assignment errors from the human working memory literature and show that several key predictions of our theory already have support.

Proprioceptive uncertainty promotes the rubber hand illusion

Body ownership is the multisensory perception of a body as one's own. Recently, the emergence of body ownership illusions like the visuotactile rubber hand illusion has been described by Bayesian causal inference models in which the observer computes the probability that visual and tactile signals come from a common source. Given the importance of proprioception for the perception of one's body, proprioceptive information and its relative reliability should impact this inferential process. We used a detection task based on the rubber hand illusion where participants had to report whether the rubber hand felt like their own or not. We manipulated the degree of asynchrony of visual and tactile stimuli delivered to the rubber hand and the real hand under two levels of proprioceptive noise using tendon vibration applied to the lower arm's antagonist extensor and flexor muscles. As hypothesized, the probability of the emergence of the rubber hand illusion increased with proprioceptive noise. Moreover, this result, well fitted by a Bayesian causal inference model, was best described by a change in the a priori probability of a common cause for vision and touch. These results offer new insights into how proprioceptive uncertainty shapes the multisensory perception of one's own body.

Effect of Lysinibacillus isolated from environment on probiotic properties and gut microbiota in mice

Soil microorganisms (SM) are primarily involved in organism degradation, plant nitrogen nutrient immobilization, host microorganisms and oxidation. However, research on the effect of soil-derived Lysinibacillus on the intestinal microbiota spatial disparity of mice is lacking. To test the probiotic properties of Lysinibacillus and the spatial disparity on mice intestinal microorganisms, hemolysis test, molecular phylogenetic analysis, antibiotic sensitivity testing, serum biochemical assays and 16S rRNA profiling were applied. The results showed that Lysinibacillus (LZS1 and LZS2) was resistant to two common antibiotics, Tetracyclines and Rifampin, and sensitive to other antibiotics among the 12 antibiotics tested and negative for hemolysis. In addition, the body weight of group L (treatment of Lysinibacillus, 1.0 × 10⁸ CFU/d for 21days) mice was significantly greater than that of the control group; serum biochemical tests showed that the TG and UREA were significantly lower in group L. The spatial disparity of intestinal microorganisms in mice was significant, treatment of Lysinibacillus (1.0 × 10⁸ CFU/d for 21days) reduced the intestinal microbial diversity and decreased the richness of Proteobacteria, Cyanobacteria and Bacteroidetes in mice. Furthermore, Lysinibacillus treatment enhanced Lactobacillus and Lachnospiraceae richness and significantly reduced 6 bacterial genera in jejunum community, reduced 8 bacterial genera, but increased bacteria at the 4 genera level in cecum microorganisms. In conclusion, this study demonstrated spatial disparity of intestinal microorganisms in mice and probiotic potential of Lysinibacillus isolated from soil.

F = ma. Is the macaque brain Newtonian?

Intuitive Physics, the ability to anticipate how the physical events involving mass objects unfold in time and space, is a central component of intelligent systems. Intuitive physics is a promising tool for gaining insight into mechanisms that generalize across species because both humans and non-human primates are subject to the same physical constraints when engaging with the environment. Physical reasoning abilities are widely present within the animal kingdom, but monkeys, with acute 3D vision and a high level of dexterity, appreciate and manipulate the physical world in much the same way humans do.

Effects of developmental alcohol exposure on cortical multisensory integration

Fetal alcohol spectrum disorder (FASD) is one of the most common causes of mental disabilities in the world with a prevalence of 1%-6% of all births. Sensory processing deficits and cognitive problems are a major feature in this condition. Because developmental alcohol exposure can impair neuronal plasticity, and neuronal plasticity is crucial for the establishment of neuronal circuits in sensory areas, we predicted that exposure to alcohol during the third trimester equivalent of human gestation would disrupt the development of multisensory integration (MSI) in the rostral portion of the posterior parietal cortex (PPr), an integrative visual-tactile area. We conducted in vivo electrophysiology in 17 ferrets from four groups (saline/alcohol; infancy/adolescence). A total of 1157 neurons were recorded after visual, tactile and combined visual-tactile stimulation. A multisensory (MS) enhancement or suppression is characterized by a significantly increased or decreased number of elicited spikes after combined visual-tactile stimulation compared to the strongest unimodal (visual or tactile) response. At the neuronal level, those in infant animals were more prone to show MS suppression whereas adolescents were more prone to show MS enhancement. Although alcohol-treated animals showed similar developmental changes between infancy and adolescence, they always 'lagged behind' controls showing more MS suppression and less enhancement. Our findings suggest that alcohol exposure during the last months of human gestation would stunt the development of MSI, which could underlie sensory problems seen in FASD.

Noise-rearing precludes the behavioral benefits of multisensory integration

Concordant visual-auditory stimuli enhance the responses of individual superior colliculus (SC) neurons. This neuronal capacity for "multisensory integration" is not innate: it is acquired only after substantial cross-modal (e.g. auditory-visual) experience. Masking transient auditory cues by raising animals in omnidirectional sound ("noise-rearing") precludes their ability to obtain this experience and the ability of the SC to construct a normal multisensory (auditory-visual) transform. SC responses to combinations of concordant visual-auditory stimuli are depressed, rather than enhanced. The present experiments examined the behavioral consequence of this rearing condition in a simple detection/localization task. In the first experiment, the auditory component of the concordant cross-modal pair was novel, and only the visual stimulus was a target. In the second experiment, both component stimuli were targets. Noise-reared animals failed to show multisensory performance benefits in either experiment. These results reveal a close parallel between behavior and single neuron physiology in the multisensory deficits that are induced when noise disrupts early visual-auditory experience.

Supramodal Representation of the Sense of Body Ownership in the Human Parieto-Premotor and Extrastriate Cortices

The sense of body ownership, defined as the sensation that one's body belongs to oneself, is a fundamental component of bodily self-consciousness. Several studies have shown the importance of multisensory integration for the emergence of the sense of body ownership, together with the involvement of the parieto-premotor and extrastriate cortices in bodily awareness. However, whether the sense of body ownership elicited by different sources of signal, especially visuotactile and visuomotor inputs, is represented by common neural patterns remains to be elucidated. We used functional magnetic resonance imaging (fMRI) to investigate the existence of neural correlates of the sense of body ownership independent of the sensory modalities. Participants received tactile stimulation or executed finger movements while given synchronous and asynchronous visual feedback of their hand. We used multivoxel patterns analysis (MVPA) to decode the synchronous and asynchronous conditions with cross-classification between two modalities: the classifier was first trained in the visuotactile sessions and then tested in the visuomotor sessions, and vice versa. Regions of interest (ROIs)-based and searchlight analyses revealed significant above-chance cross-classification accuracies in the bilateral intraparietal sulcus (IPS), the bilateral ventral premotor cortex (PMv), and the left extrastriate body area (EBA). Moreover, we observed a significant positive correlation between the cross-classification accuracy in the left PMv and the difference in subjective ratings of the sense of body ownership between the synchronous and asynchronous conditions. Our findings revealed the neural representations of the sense of body ownership in the IPS, PMv, and EBA that is invariant to the sensory modalities.

Multisensory integration of orally-sourced gustatory and olfactory inputs to the posterior piriform cortex in awake rats

Flavour refers to the sensory experience of food, which is a combination of sensory inputs sourced from multiple modalities during consumption, including taste and odour. Previous work has demonstrated that orally-sourced taste and odour cues interact to determine perceptual judgements of flavour stimuli, although the underlying cellular- and circuit-level neural mechanisms remain unknown. We recently identified a region of the piriform olfactory cortex in rats that responds to both taste and odour stimuli. Here, we investigated how converging taste and odour inputs to this area interact to affect single neuron responsiveness ensemble coding of flavour identity. To accomplish this, we recorded spiking activity from ensembles of single neurons in the posterior piriform cortex (pPC) in awake, tasting rats while delivering taste solutions, odour solutions and taste + odour mixtures directly into the oral cavity. Our results show that taste and odour inputs evoke highly selective, temporally-overlapping responses in multisensory pPC neurons. Comparing responses to mixtures and their unisensory components revealed that taste and odour inputs interact in a non-linear manner to produce unique response patterns. Taste input enhances trial-by-trial decoding of odour identity from small ensembles of simultaneously recorded neurons. Together, these results demonstrate that taste and odour inputs to pPC interact in complex, non-linear ways to form amodal flavour representations that enhance identity coding. KEY POINTS: Experience of food involves taste and smell, although how information from these different senses is combined by the brain to create our sense of flavour remains unknown. We recorded from small groups of neurons in the olfactory cortex of awake rats while they consumed taste solutions, odour solutions and taste + odour mixtures. Taste and smell solutions evoke highly selective responses. When presented in a mixture, taste and smell inputs interacted to alter responses, resulting in activation of unique sets of neurons that could not be predicted by the component responses. Synergistic interactions increase discriminability of odour representations. The olfactory cortex uses taste and smell to create new information representing multisensory flavour identity.

Causal Inference of Body Ownership in the Posterior Parietal Cortex

How do we come to sense that a hand in view belongs to our own body or not? Previous studies have suggested that the integration of vision and somatosensation in the frontoparietal areas plays a critical role in the sense of body ownership (i.e., the multisensory perception of limbs and body parts as our own). However, little is known about how these areas implement the multisensory integration process at the computational level and whether activity predicts illusion elicitation in individual participants on a trial-by-trial basis. To address these questions, we used functional magnetic resonance imaging and a rubber hand illusion-detection task and fitted the registered neural responses to a Bayesian causal inference model of body ownership. Thirty healthy human participants (male and female) performed 12 s trials with varying degrees of asynchronously delivered visual and tactile stimuli of a rubber hand (in view) and a (hidden) real hand. After the 12 s period, participants had to judge whether the rubber hand felt like their own. As hypothesized, activity in the premotor and posterior parietal cortices was related to illusion elicitation at the level of individual participants and trials. Importantly, activity in the posterior parietal cortex fit the predicted probability of illusion emergence of the Bayesian causal inference model based on each participant's behavioral response profile. Our findings suggest an important role for the posterior parietal cortex in implementing Bayesian causal inference of body ownership and reveal how trial-by-trial variations in neural signatures of multisensory integration relate to the elicitation of the rubber hand illusion.SIGNIFICANCE STATEMENT How does the brain create a coherent perceptual experience of one's own body based on information from the different senses? We examined how the likelihood of eliciting a classical bodily illusion that depends on vision and touch-the rubber hand illusion-is related to neural activity measured by functional magnetic resonance imaging. We found that trial-by-trial variations in the neural signal in the posterior parietal cortex, a well known center for sensory integration, fitted a statistical function that describes how likely it is that the brain infers that a rubber hand is one's own given the available visual and tactile evidence. Thus, probabilistic analysis of sensory information in the parietal lobe underlies our unitary sense of bodily self.

Multisensory integration in neurons of the medial pulvinar of macaque monkey

The pulvinar is a heterogeneous thalamic nucleus, which is well developed in primates. One of its subdivisions, the medial pulvinar, is connected to many cortical areas, including the visual, auditory, and somatosensory cortices, as well as with multisensory areas and premotor areas. However, except for the visual modality, little is known about its sensory functions. A hypothesis is that, as a region of convergence of information from different sensory modalities, the medial pulvinar plays a role in multisensory integration. To test this hypothesis, 2 macaque monkeys were trained to a fixation task and the responses of single-units to visual, auditory, and auditory-visual stimuli were examined. Analysis revealed auditory, visual, and multisensory neurons in the medial pulvinar. It also revealed multisensory integration in this structure, mainly suppressive (the audiovisual response is less than the strongest unisensory response) and subadditive (the audiovisual response is less than the sum of the auditory and the visual responses). These findings suggest that the medial pulvinar is involved in multisensory integration.

Socially meaningful visual context either enhances or inhibits vocalisation processing in the macaque brain

Social interactions rely on the interpretation of semantic and emotional information, often from multiple sensory modalities. Nonhuman primates send and receive auditory and visual communicative signals. However, the neural mechanisms underlying the association of visual and auditory information based on their common social meaning are unknown. Using heart rate estimates and functional neuroimaging, we show that in the lateral and superior temporal sulcus of the macaque monkey, neural responses are enhanced in response to species-specific vocalisations paired with a matching visual context, or when vocalisations follow, in time, visual information, but inhibited when vocalisation are incongruent with the visual context. For example, responses to affiliative vocalisations are enhanced when paired with affiliative contexts but inhibited when paired with aggressive or escape contexts. Overall, we propose that the identified neural network represents social meaning irrespective of sensory modality.

Social interaction involves processing semantic and emotional information. Here the authors show that in the macaque monkey lateral and superior temporal sulcus, cortical activity is enhanced in response to species-specific vocalisations predicted by matching face or social visual stimuli but inhibited when vocalisations are incongruent with the predictive visual context.

Influence of Tactile Flow on Visual Heading Perception

The integration of information from different sensory modalities is crucial for successful navigation through an environment. Among others, self-motion induces distinct optic flow patterns on the retina, vestibular signals and tactile flow, which contribute to determine traveled distance (path integration) or movement direction (heading). While the processing of combined visual-vestibular information is subject to a growing body of literature, the processing of visuo-tactile signals in the context of self-motion has received comparatively little attention. Here, we investigated whether visual heading perception is influenced by behaviorally irrelevant tactile flow. In the visual modality, we simulated an observer's self-motion across a horizontal ground plane (optic flow). Tactile self-motion stimuli were delivered by air flow from head-mounted nozzles (tactile flow). In blocks of trials, we presented only visual or tactile stimuli and subjects had to report their perceived heading. In another block of trials, tactile and visual stimuli were presented simultaneously, with the tactile flow within ±40° of the visual heading (bimodal condition). Here, importantly, participants had to report their perceived visual heading. Perceived self-motion direction in all conditions revealed a centripetal bias, i.e., heading directions were perceived as compressed toward straight ahead. In the bimodal condition, we found a small but systematic influence of task-irrelevant tactile flow on visually perceived headings as function of their directional offset. We conclude that tactile flow is more tightly linked to self-motion perception than previously thought.

Exploring Cognition with Brain-Machine Interfaces

Traditional brain-machine interfaces decode cortical motor commands to control external devices. These commands are the product of higher-level cognitive processes, occurring across a network of brain areas, that integrate sensory information, plan upcoming motor actions, and monitor ongoing movements. We review cognitive signals recently discovered in the human posterior parietal cortex during neuroprosthetic clinical trials. These signals are consistent with small regions of cortex having a diverse role in cognitive aspects of movement control and body monitoring, including sensorimotor integration, planning, trajectory representation, somatosensation, action semantics, learning, and decision making. These variables are encoded within the same population of cells using structured representations that bind related sensory and motor variables, an architecture termed partially mixed selectivity. Diverse cognitive signals provide complementary information to traditional motor commands to enable more natural and intuitive control of external devices.

MULTISENSORY RESPONSES IN A BELT REGION OF THE DORSAL AUDITORY CORTICAL PATHWAY

A basic function of the cerebral cortex is to receive and integrate information from different sensory modalities into a comprehensive percept of the environment. Neurons that demonstrate multisensory convergence occur across the necortex, but are especially prevalent in higher-order, association areas. However, a recent study of a cat higher-order auditory area, the dorsal zone (DZ) of auditory cortex, did not observe any multisensory features. Therefore, the goal of the present investigation was to address this conflict using recording and testing methodologies that are established for exposing and studying multisensory neuronal processing. Among the 482 neurons studied, we found that 76.6% were influenced by non-auditory stimuli. Of these neurons, 99% were affected by visual stimulation, but only 11% by somatosensory. Furthermore, a large proportion of the multisensory neurons showed integrated responses to multisensory stimulation, constituted a majority of the excitatory and inhibitory neurons encountered (as identified by the duration of their waveshape), and exhibited a distinct spatial distribution within DZ. These findings demonstrate that the dorsal zone of auditory cortex robustly exhibits multisensory properties and that the proportions of multisensory neurons encountered are consistent with those identified in other higher-order cortices.

The macaque ventral intraparietal area has expanded into three homologue human parietal areas

The macaque ventral intraparietal area (VIP) in the fundus of the intraparietal sulcus has been implicated in a diverse range of sensorimotor and cognitive functions such as motion processing, multisensory integration, processing of head peripersonal space, defensive behavior, and numerosity coding. Here, we exhaustively review macaque VIP function, cytoarchitectonics, and anatomical connectivity and integrate it with human studies that have attempted to identify a potential human VIP homologue. We show that human VIP research has consistently identified three, rather than one, bilateral parietal areas that each appear to subsume some, but not all, of the macaque area's functionality. Available evidence suggests that this human "VIP complex" has evolved as an expansion of the macaque area, but that some precursory specialization within macaque VIP has been previously overlooked. The three human areas are dominated, roughly, by coding the head or self in the environment, visual heading direction, and the peripersonal environment around the head, respectively. A unifying functional principle may be best described as prediction in space and time, linking VIP to state estimation as a key parietal sensorimotor function. VIP's expansive differentiation of head and self-related processing may have been key in the emergence of human bodily self-consciousness.

Precision control for a flexible body representation

Adaptive body representation requires the continuous integration of multisensory inputs within a flexible 'body model' in the brain. The present review evaluates the idea that this flexibility is augmented by the contextual modulation of sensory processing 'top-down'; which can be described as precision control within predictive coding formulations of Bayesian inference. Specifically, I focus on the proposal that an attenuation of proprioception may facilitate the integration of conflicting visual and proprioceptive bodily cues. Firstly, I review empirical work suggesting that the processing of visual vs proprioceptive body position information can be contextualised 'top-down'; for instance, by adopting specific attentional task sets. Building up on this, I review research showing a similar contextualisation of visual vs proprioceptive information processing in the rubber hand illusion and in visuomotor adaptation. Together, the reviewed literature suggests that proprioception, despite its indisputable importance for body perception and action control, can be attenuated top-down (through precision control) to facilitate the contextual adaptation of the brain's body model to novel visual feedback.

Frontal and parietal background connectivity and their dynamic changes account for individual differences in the multisensory representation of peripersonal space

Functional connectivity (FC) of brain networks dynamically fluctuates during both rest and task execution. Individual differences in dynamic FC have been associated with several cognitive and behavioral traits. However, whether dynamic FC also contributes to sensorimotor representations guiding body-environment interactions, such as the representation of peripersonal space (PPS), is currently unknown. PPS is the space immediately surrounding the body and acts as a multisensory interface between the individual and the environment. We used an audio-tactile task with approaching sounds to map the individual PPS extension, and fMRI to estimate the background FC. Specifically, we analyzed FC values for each stimulus type (near and far space) and its across-trial variability. FC was evaluated between task-relevant nodes of two fronto-parietal networks (the Dorsal Attention Network, DAN, and the Fronto-Parietal Network, FPN) and a key PPS region in the premotor cortex (PM). PM was significantly connected to specific task-relevant nodes of the DAN and the FPN during the audio-tactile task, and FC was stronger while processing near space, as compared to far space. At the individual level, less PPS extension was associated with stronger premotor-parietal FC during processing of near space, while the across-trial variability of premotor-parietal and premotor-frontal FC was higher during the processing of far space. Notably, only across-trial FC variability captured the near-far modulation of space processing. Our findings indicate that PM connectivity with task-relevant frontal and parietal regions and its dynamic changes participate in the mechanisms that enable PPS representation, in agreement with the idea that neural variability plays a crucial role in plastic and dynamic sensorimotor representations.

Vestibular Stimulation May Drive Multisensory Processing: Principles for Targeted Sensorimotor Therapy (TSMT)

At birth, the vestibular system is fully mature, whilst higher order sensory processing is yet to develop in the full-term neonate. The current paper lays out a theoretical framework to account for the role vestibular stimulation may have driving multisensory and sensorimotor integration. Accordingly, vestibular stimulation, by activating the parieto-insular vestibular cortex, and/or the posterior parietal cortex may provide the cortical input for multisensory neurons in the superior colliculus that is needed for multisensory processing. Furthermore, we propose that motor development, by inducing change of reference frames, may shape the receptive field of multisensory neurons. This, by leading to lack of spatial contingency between formally contingent stimuli, may cause degradation of prior motor responses. Additionally, we offer a testable hypothesis explaining the beneficial effect of sensory integration therapies regarding attentional processes. Key concepts of a sensorimotor integration therapy (e.g., targeted sensorimotor therapy (TSMT)) are also put into a neurological context. TSMT utilizes specific tools and instruments. It is administered in 8-weeks long successive treatment regimens, each gradually increasing vestibular and postural stimulation, so sensory-motor integration is facilitated, and muscle strength is increased. Empirically TSMT is indicated for various diseases. Theoretical foundations of this sensorimotor therapy are discussed.

Common functional localizers to enhance NHP & cross-species neuroscience imaging research

Functional localizers are invaluable as they can help define regions of interest, provide cross-study comparisons, and most importantly, allow for the aggregation and meta-analyses of data across studies and laboratories. To achieve these goals within the non-human primate (NHP) imaging community, there is a pressing need for the use of standardized and validated localizers that can be readily implemented across different groups. The goal of this paper is to provide an overview of the value of localizer protocols to imaging research and we describe a number of commonly used or novel localizers within NHPs, and keys to implement them across studies. As has been shown with the aggregation of resting-state imaging data in the original PRIME-DE submissions, we believe that the field is ready to apply the same initiative for task-based functional localizers in NHP imaging. By coming together to collect large datasets across research group, implementing the same functional localizers, and sharing the localizers and data via PRIME-DE, it is now possible to fully test their robustness, selectivity and specificity. To do this, we reviewed a number of common localizers and we created a repository of well-established localizer that are easily accessible and implemented through the PRIME-RE platform.

Subcortical circuits mediate communication between primary sensory cortical areas in mice

Integration of information across the senses is critical for perception and is a common property of neurons in the cerebral cortex, where it is thought to arise primarily from corticocortical connections. Much less is known about the role of subcortical circuits in shaping the multisensory properties of cortical neurons. We show that stimulation of the whiskers causes widespread suppression of sound-evoked activity in mouse primary auditory cortex (A1). This suppression depends on the primary somatosensory cortex (S1), and is implemented through a descending circuit that links S1, via the auditory midbrain, with thalamic neurons that project to A1. Furthermore, a direct pathway from S1 has a facilitatory effect on auditory responses in higher-order thalamic nuclei that project to other brain areas. Crossmodal corticofugal projections to the auditory midbrain and thalamus therefore play a pivotal role in integrating multisensory signals and in enabling communication between different sensory cortical areas.

Affective sounds entering the peripersonal space influence the whole-body action preparation

The peripersonal space (PPS), the space surrounding us, is found to have enhanced multisensory-motor representation in the brain. In this study, we investigate how approaching sounds stopping at different distances within the peripersonal space, and carrying emotional content (positive, negative, and neutral), modulate the preparation of action as performing a Step. Premotor reaction times were measured by means of anticipatory forces and muscular activations to capture action preparation, the kinematics of stepping was considered for defining action performance, and for each stimulus, the individual perceived level of arousal and valence was evaluated. In general, we found a prompter premotor reaction for closer sounds compared to the farther ones and the fastest reactions detected for the neutral sound at each distance. We interpreted this time facilitation for neutral sound due to the large frequency spectrum of the stimuli and the absence of affective component and semantical content to decode. Interestingly, while at the close distance, none difference was found between positive and negative emotional stimuli, at the far distance faster reactions were present for negative compared to the positive sounds indicating that when arousal is less enhanced individuals are able to differentiate the emotional content of a sound. The kinematics observed after action initiation sustained the anticipatory results by showing that larger steps were performed when reacting to close compared to far sounds, being perceived as more arousing, and this happened particularly for neutral and negative sounds. Altogether, the results showed that action preparation is influenced by the vicinity and by the valence carried by looming auditory stimuli. For discriminating the stimuli valence, a certain distance, still within the PPS, is necessary; when instead stimuli are too close to the body valence discrimination is not performed.

The Peripersonal Space in a social world

The PeriPersonal Space (PPS) has been defined as the space surrounding the body, where physical interactions with elements of the environment take place. As our world is social in nature, recent evidence revealed the complex modulation of social factors onto PPS representation. In light of the growing interest in the field, in this review we take a close look at the experimental approaches undertaken to assess the impact of social factors onto PPS representation. Our social world also influences the personal space (PS), a concept stemming from social psychology, defined as the space we keep between us and others to avoid discomfort. Here we analytically compare PPS and PS with the aim of understanding if and how they relate to each other. At the behavioral level, the multiplicity of experimental methodologies, whether well-established or novel, lead to somewhat divergent results and interpretations. Beyond behavior, we review physiological and neural signatures of PPS representation to discuss how interoceptive signals could contribute to PPS representation, as well as how these internal signals could shape the neural responses of PPS representation. In particular, by merging exteroceptive information from the environment and internal signals that come from the body, PPS may promote an integrated representation of the self, as distinct from the environment and the others. We put forward that integrating internal and external signals in the brain for perception of proximal environmental stimuli may also provide us with a better understanding of the processes at play during social interactions. Adopting such an integrative stance may offer novel insights about PPS representation in a social world. Finally, we discuss possible links between PPS research and social cognition, a link that may contribute to the understanding of intentions and feelings of others around us and promote appropriate social interactions.

Action-dependent processing of self-motion in parietal cortex of macaque monkeys

Successful interaction with the environment requires the dissociation of self-induced from externally induced sensory stimulation. Temporal proximity of action and effect is hereby often used as an indicator of whether an observed event should be interpreted as a result of own actions or not. We tested how the delay between an action (press of a touch bar) and an effect (onset of simulated self-motion) influences the processing of visually simulated self-motion in the ventral intraparietal area (VIP) of macaque monkeys. We found that a delay between the action and the start of the self-motion stimulus led to a rise of activity above the baseline activity before motion onset in a subpopulation of 21% of the investigated neurons. In the responses to the stimulus, we found a significantly lower sustained activity when the press of a touch bar and the motion onset were contiguous compared to the condition when the motion onset was delayed. We speculate that this weak inhibitory effect might be part of a mechanism that sharpens the tuning of VIP neurons during self-induced motion and thus has the potential to increase the precision of heading information that is required to adjust the orientation of self-motion in everyday navigational tasks.NEW & NOTEWORTHY Neurons in macaque ventral intraparietal area (VIP) are responding to sensory stimulation related to self-motion, e.g. visual optic flow. Here, we found that self-motion induced activation depends on the sense of agency, i.e., it differed when optic flow was perceived as self- or externally induced. This demonstrates that area VIP is well suited for study of the interplay between active behavior and sensory processing during self-motion.

Sensory feedback-dependent coding of arm position in local field potentials of the posterior parietal cortex

Although multisensory integration is crucial for sensorimotor function, it is unclear how visual and proprioceptive sensory cues are combined in the brain during motor behaviors. Here we characterized the effects of multisensory interactions on local field potential (LFP) activity obtained from the superior parietal lobule (SPL) as non-human primates performed a reaching task with either unimodal (proprioceptive) or bimodal (visual-proprioceptive) sensory feedback. Based on previous analyses of spiking activity, we hypothesized that evoked LFP responses would be tuned to arm location but would be suppressed on bimodal trials, relative to unimodal trials. We also expected to see a substantial number of recording sites with enhanced beta band spectral power for only one set of feedback conditions (e.g. unimodal or bimodal), as was previously observed for spiking activity. We found that evoked activity and beta band power were tuned to arm location at many individual sites, though this tuning often differed between unimodal and bimodal trials. Across the population, both evoked and beta activity were consistent with feedback-dependent tuning to arm location, while beta band activity also showed evidence of response suppression on bimodal trials. The results suggest that multisensory interactions can alter the tuning and gain of arm position-related LFP activity in the SPL.

Integration of predictions and afferent signals in body ownership

We aimed at investigating the contribution of sensory predictions triggered by the sight of an object moving towards the body for the sense of body ownership. We used a recently developed psychophysical discrimination task to assess body ownership in the rubber hand illusion. In this task, the participants had to choose which of the two right rubber hands in view felt most like their own, and the ownership discriminations were fitted to psychometric curves. In the current study, we occluded the visual impressions of the object moving towards one of the rubber hands (during the first two-thirds of the path) and only revealed the final third of the object's movement trajectory when it touched the rubber hand (approach-occluded condition). Alternatively, we occluded only the final part so that the main part of the movement towards the model hand was visible (touch-occluded). We compared these two conditions to an illusion baseline condition where the object was visible during the entire trajectory and contact (no-occlusion). The touch-occluded condition produced equally strong hand ownership as the baseline condition with no occlusion, while ownership perception was significantly reduced when vision of the object approaching the rubber hand was occluded (approach-occluded). Our results show that tactile predictions generated from seeing an object moving towards the body are temporally exact, and they contribute to the rubber hand illusion by integrating with temporally congruent afferent sensory signals. This finding highlights the importance of multisensory predictions in peripersonal space, object permanence, and the interplay between bottom-up sensory signals and top-down predictions in body ownership.

Phase-coupling of neural oscillations contributes to individual differences in peripersonal space

The peripersonal space (PPS) is a multisensory and sensorimotor interface between our body and the environment. The location of PPS boundary is not fixed. Rather, it adapts to the environmental context and differs greatly across individuals. Recent studies have started to unveil the neural correlates of individual differences in PPS extension; however, this picture is not clear yet. Here, we used approaching auditory stimuli and magnetoencephalography to capture the individual boundary of PPS and examine its neural underpinnings. In particular, building upon previous studies from our own group, we investigated the possible contribution of an intrinsic feature of the brain, that is the "resting state" functional connectivity, to the individual differences in PPS extension and the frequency specificity of this contribution. Specifically, we focused on the activity synchronized to the premotor cortex, where multisensory neurons encoding PPS have been described. Results showed that the stronger the connectivity between left premotor cortex (lPM) and a set of fronto-parietal, sensorimotor regions in the right and left hemisphere, the wider the extension of the PPS. Strikingly, such a correlation was observed only in the beta-frequency band. Overall, our results suggest that the individual extension of the PPS is coded in spatially- and spectrally-specific resting state functional links.

A multisensory perspective onto primate pulvinar functions

Perception in ambiguous environments relies on the combination of sensory information from various sources. Most associative and primary sensory cortical areas are involved in this multisensory active integration process. As a result, the entire cortex appears as heavily multisensory. In this review, we focus on the contribution of the pulvinar to multisensory integration. This subcortical thalamic nucleus plays a central role in visual detection and selection at a fast time scale, as well as in the regulation of visual processes, at a much slower time scale. However, the pulvinar is also densely connected to cortical areas involved in multisensory integration. In spite of this, little is known about its multisensory properties and its contribution to multisensory perception. Here, we review the anatomical and functional organization of multisensory input to the pulvinar. We describe how visual, auditory, somatosensory, pain, proprioceptive and olfactory projections are differentially organized across the main subdivisions of the pulvinar and we show that topography is central to the organization of this complex nucleus. We propose that the pulvinar combines multiple sources of sensory information to enhance fast responses to the environment, while also playing the role of a general regulation hub for adaptive and flexible cognition.

Interpersonal Motor Interactions Shape Multisensory Representations of the Peripersonal Space

This perspective review focuses on the proposal that predictive multisensory integration occurring in one's peripersonal space (PPS) supports individuals' ability to efficiently interact with others, and that integrating sensorimotor signals from the interacting partners leads to the emergence of a shared representation of the PPS. To support this proposal, we first introduce the features of body and PPS representations that are relevant for interpersonal motor interactions. Then, we highlight the role of action planning and execution on the dynamic expansion of the PPS. We continue by presenting evidence of PPS modulations after tool use and review studies suggesting that PPS expansions may be accounted for by Bayesian sensory filtering through predictive coding. In the central section, we describe how this conceptual framework can be used to explain the mechanisms through which the PPS may be modulated by the actions of our interaction partner, in order to facilitate interpersonal coordination. Last, we discuss how this proposal may support recent evidence concerning PPS rigidity in Autism Spectrum Disorder (ASD) and its possible relationship with ASD individuals' difficulties during interpersonal coordination. Future studies will need to clarify the mechanisms and neural underpinning of these dynamic, interpersonal modulations of the PPS.

Neural encoding of actual and imagined touch within human posterior parietal cortex

In the human posterior parietal cortex (PPC), single units encode high-dimensional information with partially mixed representations that enable small populations of neurons to encode many variables relevant to movement planning, execution, cognition, and perception. Here, we test whether a PPC neuronal population previously demonstrated to encode visual and motor information is similarly engaged in the somatosensory domain. We recorded neurons within the PPC of a human clinical trial participant during actual touch presentation and during a tactile imagery task. Neurons encoded actual touch at short latency with bilateral receptive fields, organized by body part, and covered all tested regions. The tactile imagery task evoked body part-specific responses that shared a neural substrate with actual touch. Our results are the first neuron-level evidence of touch encoding in human PPC and its cognitive engagement during a tactile imagery task, which may reflect semantic processing, attention, sensory anticipation, or imagined touch.

Which hand is mine? Discriminating body ownership perception in a two-alternative forced-choice task

The experience of one's body as one's own is referred to as the sense of body ownership. This central part of human conscious experience determines the boundary between the self and the external environment, a crucial distinction in perception, action, and cognition. Although body ownership is known to involve the integration of signals from multiple sensory modalities, including vision, touch, and proprioception, little is known about the principles that determine this integration process, and the relationship between body ownership and perception is unclear. These uncertainties stem from the lack of a sensitive and rigorous method to quantify body ownership. Here, we describe a two-alternative forced-choice discrimination task that allows precise and direct measurement of body ownership as participants decide which of two rubber hands feels more like their own in a version of the rubber hand illusion. In two experiments, we show that the temporal and spatial congruence principles of multisensory stimulation, which determine ownership discrimination, impose tighter constraints than previously thought and that texture congruence constitutes an additional principle; these findings are compatible with theoretical models of multisensory integration. Taken together, our results suggest that body ownership constitutes a genuine perceptual multisensory phenomenon that can be quantified with psychophysics in discrimination experiments.