Editorial: Multisensory Integration: Brain, Body, and World

Alpha-band sensory entrainment improves audiovisual temporal acuity

Visual and auditory stimuli are transmitted from the environment to sensory cortices with different timing, requiring the brain to encode when sensory inputs must be segregated or integrated into a single percept. The probability that different audiovisual (AV) stimuli are integrated into a single percept even when presented asynchronously is reflected in the construct of temporal binding window (TBW). There is a strong interest in testing whether it is possible to broaden or shrink TBW by using different neuromodulatory approaches that can speed up or slow down ongoing alpha oscillations, which have been repeatedly hypothesized to be an important determinant of the TBWs size. Here, we employed a web-based sensory entrainment protocol combined with a simultaneity judgment task using simple flash-beep stimuli. The aim was to test whether AV temporal acuity could be modulated trial by trial by synchronizing ongoing neural oscillations in the prestimulus period to a rhythmic sensory stream presented in the upper (∼12 Hz) or lower (∼8.5 Hz) alpha range. As a control, we implemented a nonrhythmic condition where only the first and the last entrainers were employed. Results show that upper alpha entrainment shrinks AV TBW and improves AV temporal acuity when compared with lower alpha and control conditions. Our findings represent a proof of concept of the efficacy of sensory entrainment to improve AV temporal acuity in a trial-by-trial manner, and they strengthen the idea that alpha oscillations may reflect the temporal unit of AV temporal binding.

Is the rubber hand illusion associated with somatic symptom reporting?

Current approaches to somatic symptom perception conceptualize somatic symptoms partly as somato-visceral or body illusions evoked by an interaction between bottom-up (sensory) and top-down (expectations, attention) processes. Similar processes of multisensory integration are assumed to contribute to the rubber hand illusion (RHI). Findings concerning the strength and direction of associations between these two phenomena, symptom perception and the RHI, are equivocal. Individuals of a non-clinical sample (N = 63; 56% females; Mage = 20.4; SD = 1.6) completed the Patient Health Questionnaire Somatic Symptom Scale (PHQ-15) and participated in an experiment that evoked the RHI. In repeated measures analyses of variance with the PHQ-15 score as covariate, no significant interaction effects between the PHQ-15 score and indicators of the RHI, i.e., proprioceptive drift (F(1,61) < 0.001 p = 0.993, partial η2 < 0.001; BF10 = 0.307), felt body ownership(F(1,59) = 0.043, p = 0.836, partial η2 = 0,001; BF10 = 0.501), and felt body disownership (F(1,59) = 0.148, p = 0.702, partial η2 = 0.002; BF10 = 1.972) were found. Overall, frequentist and Bayesian analysis indicated that the support for a possible association between the PHQ-15 and indicators of the RHI remains inconclusive, i.e., neither the null nor the alternative hypotheses were sufficiently supported. At least in this non-clinical sample, the association between somatic symptom distress and the strength of the RHI appears so weak (perhaps non-existing), that both phenomena (somatic symptom distress and the RHI) appear distinct and largely unrelated.

Lower multisensory temporal acuity in individuals with high schizotypal traits: a web-based study

Natural events are often multisensory, requiring the brain to combine information from the same spatial location and timing, across different senses. The importance of temporal coincidence has led to the introduction of the temporal binding window (TBW) construct, defined as the time range within which multisensory inputs are highly likely to be perceptually bound into a single entity. Anomalies in TBWs have been linked to confused perceptual experiences and inaccurate filtering of sensory inputs coming from different environmental sources. Indeed, larger TBWs have been associated with disorders such as schizophrenia and autism and are also correlated to a higher level of subclinical traits of these conditions in the general population. Here, we tested the feasibility of using a web-based version of a classic audio-visual simultaneity judgment (SJ) task with simple flash-beep stimuli in order to measure multisensory temporal acuity and its relationship with schizotypal traits as measured in the general population. Results show that: (i) the response distribution obtained in the web-based SJ task was strongly similar to those reported by studies carried out in controlled laboratory settings, and (ii) lower multisensory temporal acuity was associated with higher schizotypal traits in the “cognitive-perceptual” domains. Our findings reveal the possibility of adequately using a web-based audio-visual SJ task outside a controlled laboratory setting, available to a more diverse and representative pool of participants. These results provide additional evidence for a close relationship between lower multisensory acuity and the expression of schizotypal traits in the general population.

Interventions to Dispel Neuromyths in Educational Settings-A Review

Neuromyths are misconceptions about the brain and learning, for instance Tailoring instruction to students' preferred “learning styles” (e.g., visual, auditory, kinesthetic) promotes learning. Recent reviews indicate that the high prevalence of beliefs in neuromyths among educators did not decline over the past decade. Potential adverse effects of neuromyth beliefs on teaching practices prompted researchers to develop interventions to dispel these misconceptions in educational settings. This paper provides a critical review of current intervention approaches. The following questions are examined: Does neuroscience training protect against neuromyths? Are refutation-based interventions effective at dispelling neuromyths, and are corrective effects enduring in time? Why refutation-based interventions are not enough? Do reduced beliefs in neuromyths translate in the adoption of more evidence-based teaching practices? Are teacher professional development workshops and seminars on the neuroscience of learning effective at instilling neuroscience in the classroom? Challenges, issues, controversies, and research gaps in the field are highlighted, notably the so-called “backfire effect,” the social desirability bias, and the powerful intuitive thinking mode. Future directions are outlined.

Motor Cortex Causally Contributes to Vocabulary Translation following Sensorimotor-Enriched Training

The role of the motor cortex in perceptual and cognitive functions is highly controversial. Here, we investigated the hypothesis that the motor cortex can be instrumental for translating foreign language vocabulary. Human participants of both sexes were trained on foreign language (L2) words and their native language translations over 4 consecutive days. L2 words were accompanied by complementary gestures (sensorimotor enrichment) or pictures (sensory enrichment). Following training, participants translated the auditorily presented L2 words that they had learned. During translation, repetitive transcranial magnetic stimulation was applied bilaterally to a site within the primary motor cortex (Brodmann area 4) located in the vicinity of the arm functional compartment. Responses within the stimulated motor region have previously been found to correlate with behavioral benefits of sensorimotor-enriched L2 vocabulary learning. Compared to sham stimulation, effective perturbation by repetitive transcranial magnetic stimulation slowed down the translation of sensorimotor-enriched L2 words, but not sensory-enriched L2 words. This finding suggests that sensorimotor-enriched training induced changes in L2 representations within the motor cortex, which in turn facilitated the translation of L2 words. The motor cortex may play a causal role in precipitating sensorimotor-based learning benefits, and may directly aid in remembering the native language translations of foreign language words following sensorimotor-enriched training. These findings support multisensory theories of learning while challenging reactivation-based theories.SIGNIFICANCE STATEMENT Despite the potential for sensorimotor enrichment to serve as a powerful tool for learning in many domains, its underlying brain mechanisms remain largely unexplored. Using transcranial magnetic stimulation and a foreign language (L2) learning paradigm, we found that sensorimotor-enriched training can induce changes in L2 representations within the motor cortex, which in turn causally facilitate the translation of L2 words. The translation of recently acquired L2 words may therefore rely not only on auditory information stored in memory or on modality-independent L2 representations, but also on the sensorimotor context in which the words have been experienced.

Brain networks require a network-conscious psychopathological approach

In experimental psychology and neuroscience, technological advances and multisensory research have contributed to gradually dismiss a version of reductionism. Empirical results no longer support a brain model in which distinct "modules" perform discrete functions, but rather, a brain of partially overlapping networks. A similarly changed brain model is extending to psychopathology and clinical psychology, and partly accounts for the problems of reductionism.

Embodied Decision-Making Style: Below and Beyond Cognition

There is growing recognition of the essential role of sensorimotor processes as not just a supporter of the cognitive aspects of decision making, but rather as a foundation for all the coordinated physical and mental activities that go into how we make decisions. We illuminate concepts and methods for examining embodied decision making through the lens of Movement Pattern Analysis (MPA). MPA is as a prime example of a conceptually rooted observational methodology for deciphering embodied decision making and for decoding how people differ as decision makers with respect to cognitive motivational priorities. The historical origins of MPA that predated the formalized recognition of embodied cognition are presented, along with an overview of both the theoretical model and methodology. Advances in research on two psychometric benchmarks of observational research-inter-rater reliability and predictive validity-are highlighted as an empirical platform for the strong promise of MPA as a tool for understanding individual differences in embodied decision-making style. Future directions for research are considered-specifically with respect to the potential for utilizing automated coding, and the need for collaborative neuroscience research efforts-which would support further understanding of how decoding movement patterning captures human motivation at the level of sensory, motoric, cognitive and action integration which drives how people function as decision makers.

Scanning movements during haptic search: similarity with fixations during visual search

Finding relevant objects through vision, or visual search, is a crucial function that has received considerable attention in the literature. After decades of research, data suggest that visual fixations are more crucial to understanding how visual search works than are the attributes of stimuli. This idea receives further support from the field of haptic search.

Multi-Sensory Integration Impairment in Patients with Minimal Hepatic Encephalopathy

Paper-and-pencil-based psychometric tests are the gold standard for diagnosis of cognitive dysfunction in liver disease. However, they take time, can be affected by demographic factors, and lack ecological validity. This study explored multi-sensory integration ability to discriminate cognitive dysfunction in cirrhosis. Thirty-two healthy controls and 30 cirrhotic patients were recruited. The sensory integration test presents stimuli from two different modalities (e.g., image/sound) with a short time lag, and subjects judge which stimuli appeared first. Repetitive tests reveal the sensory integration capability. Performance in the sensory integration test, psychometric tests, and functional near-infrared spectroscopy for patients was compared to controls. Sensory integration capability, the perceptual threshold to discriminate the time gap between an image and sound stimulus, was significantly impaired in cirrhotic patients with minimal hepatic encephalopathy (MHE) compared to controls (p < 0.01) and non-MHE patients (p < 0.01). Sensory integration test showed good correlation with psychometric tests (NCT-A, r = 0.383, p = 0.002; NCT-B, r = 0.450, p < 0.01; DST-F, r = -0.322, p = 0.011; DST- B, r = -0.384, p = 0.002; ACPT, r = -0.467, p < 0.01). Psychometric tests were dependent on age and education level, while the sensory integration test was not affected. The sensory integration test, where a cut-off value for the perceptual threshold was 133.3ms, recognized MHE patients at 90% sensitivity and 86.5% specificity.

Sensory Substitution: The Spatial Updating of Auditory Scenes "Mimics" the Spatial Updating of Visual Scenes

Visual-to-auditory sensory substitution is used to convey visual information through audition, and it was initially created to compensate for blindness; it consists of software converting the visual images captured by a video-camera into the equivalent auditory images, or “soundscapes”. Here, it was used by blindfolded sighted participants to learn the spatial position of simple shapes depicted in images arranged on the floor. Very few studies have used sensory substitution to investigate spatial representation, while it has been widely used to investigate object recognition. Additionally, with sensory substitution we could study the performance of participants actively exploring the environment through audition, rather than passively localizing sound sources. Blindfolded participants egocentrically learnt the position of six images by using sensory substitution and then a judgment of relative direction task (JRD) was used to determine how this scene was represented. This task consists of imagining being in a given location, oriented in a given direction, and pointing towards the required image. Before performing the JRD task, participants explored a map that provided allocentric information about the scene. Although spatial exploration was egocentric, surprisingly we found that performance in the JRD task was better for allocentric perspectives. This suggests that the egocentric representation of the scene was updated. This result is in line with previous studies using visual and somatosensory scenes, thus supporting the notion that different sensory modalities produce equivalent spatial representation(s). Moreover, our results have practical implications to improve training methods with sensory substitution devices (SSD).