Multisensory integration of emotionally valenced olfactory-visual information in patients with schizophrenia and healthy controls

Effective connectivity reveals distinctive patterns in response to others' genuine affective experience of disgust

Empathy is significantly influenced by the identification of others' emotions. In a recent study, we have found increased activation in the anterior insular cortex (aIns) that could be attributed to affect sharing rather than perceptual saliency, when seeing another person genuinely experiencing pain as opposed to merely acting to be in pain. In that prior study, effective connectivity between aIns and the right supramarginal gyrus (rSMG) was revealed to represent what another person really feels. In the present study, we used a similar paradigm to investigate the corresponding neural signatures in the domain of empathy for disgust - with participants seeing others genuinely sniffing unpleasant odors as compared to pretending to smell something disgusting (in fact the disgust expressions in both conditions were acted for reasons of experimental control). Consistent with the previous findings on pain, we found stronger activations in aIns associated with affect sharing for genuine disgust (inferred) compared with pretended disgust. However, instead of rSMG we found engagement of the olfactory cortex. Using dynamic causal modeling (DCM), we estimated the neural dynamics of aIns and the olfactory cortex between the genuine and pretended conditions. This revealed an increased excitatory modulatory effect for genuine disgust compared to pretended disgust. For genuine disgust only, brain-to-behavior regression analyses highlighted a link between the observed modulatory effect and a few empathic traits. Altogether, the current findings complement and expand our previous work, by showing that perceptual saliency alone does not explain responses in the insular cortex. Moreover, it reveals that different brain networks are implicated in a modality-specific way when sharing the affective experiences associated with pain vs. disgust.

Smell what you hardly see: Odors assist visual categorization in the human brain

Visual categorization is the brain ability to rapidly and automatically respond to a certain category of inputs. Whether category-selective neural responses are purely visual or can be influenced by other sensory modalities remains unclear. Here, we test whether odors modulate visual categorization, expecting that odors facilitate the neural categorization of congruent visual objects, especially when the visual category is ambiguous. Scalp electroencephalogram (EEG) was recorded while natural images depicting various objects were displayed in rapid 12-Hz streams (i.e., 12 images / second) and variable exemplars of a target category (either human faces, cars, or facelike objects in dedicated sequences) were interleaved every 9^th stimulus to tag category-selective responses at 12/9 = 1.33 Hz in the EEG frequency spectrum. During visual stimulation, participants (N = 26) were implicitly exposed to odor contexts (either body, gasoline or baseline odors) and performed an orthogonal cross-detection task. We identify clear category-selective responses to every category over the occipito-temporal cortex, with the largest response for human faces and the lowest for facelike objects. Critically, body odor boosts the response to the ambiguous facelike objects (i.e., either perceived as nonface objects or faces) over the right hemisphere, especially for participants reporting their presence post-stimulation. By contrast, odors do not significantly modulate other category-selective responses, nor the general visual response recorded at 12 Hz, revealing a specific influence on the categorization of congruent ambiguous stimuli. Overall, these findings support the view that the brain actively uses cues from the different senses to readily categorize visual inputs, and that olfaction, which has long been considered as poorly functional in humans, is well placed to disambiguate visual information.

The processing characteristics of bodily expressions under the odor context: An ERP study

The recognition of facial expressions has been shown to be influenced by contextual odors. The aims of this study were (1) to investigate whether odor has a similar effect on the recognition of bodily expressions, and (2) to analyze the time-course of such effects. Sixty-nine adults were randomized into three groups to identify bodily expressions (happy, fearful, and neutral) in three odor environments (pleasant odor, unpleasant odor, and no odor). Event-related potentials (ERPs) induced by the viewing bodily expressions were analyzed. Behaviorally, the unpleasant odor context promoted the recognition of bodily expressions. The ERP results showed odor influences on bodily expression recognition in two phases. In a middle stage phase (150-200 ms post-stimulus onset), VPP amplitudes induced by bodily expressions were greater in an unpleasant odor context than in a pleasant odor context. In a mid-late stage phase (beyond 200 ms), an interaction between contextual odor and bodily expression type was observed. When exposed to an unpleasant contextual odor, N2 and LPP amplitudes related to fearful bodily expressions were smaller than when exposed to other odor contexts, showing the promoting effect of mood coherence effect. Behavioral and ERP evidence confirmed that contextual odor can modulate the visual processing of bodily expressions, with an overall promoting effect of an unpleasant odor on bodily expression processing (phase one) and a specific modulating influence of odors on affectively congruent/incongruent bodily expressions (phase two).

The scent of attraction and the smell of success: crossmodal influences on person perception

In recent decades, there has been an explosion of research into the crossmodal influence of olfactory cues on multisensory person perception. Numerous peer-reviewed studies have documented that a variety of olfactory stimuli, from ambient malodours through to fine fragrances, and even a range of chemosensory body odours can influence everything from a perceiver's judgments of another person's attractiveness, age, affect, health/disease status, and even elements of their personality. The crossmodal and multisensory contributions to such effects are reviewed and the limitations/peculiarities of the research that have been published to date are highlighted. At the same time, however, it is important to note that the presence of scent (and/or the absence of malodour) can also influence people's (i.e., a perceiver's) self-confidence which may, in turn, affect how attractive they appear to others. Several potential cognitive mechanisms have been put forward to try and explain such crossmodal/multisensory influences, and some of the neural substrates underpinning these effects have now been characterized. At the end of this narrative review, a number of the potential (and actual) applications for, and implications of, such crossmodal/multisensory phenomena involving olfaction are outlined briefly.

Affective Face Processing Modified by Different Tastes

Facial emotional recognition is something used often in our daily lives. How does the brain process the face search? Can taste modify such a process? This study employed two tastes (sweet and acidic) to investigate the cross-modal interaction between taste and emotional face recognition. The behavior responses (reaction time and correct response ratios) and the event-related potential (ERP) were applied to analyze the interaction between taste and face processing. Behavior data showed that when detecting a negative target face with a positive face as a distractor, the participants perform the task faster with an acidic taste than with sweet. No interaction effect was observed with correct response ratio analysis. The early (P1, N170) and mid-stage [early posterior negativity (EPN)] components have shown that sweet and acidic tastes modified the ERP components with the affective face search process in the ERP results. No interaction effect was observed in the late-stage (LPP) component. Our data have extended the understanding of the cross-modal mechanism and provided electrophysiological evidence that affective facial processing could be influenced by sweet and acidic tastes.

A Review of the Effects of Valenced Odors on Face Perception and Evaluation

How do valenced odors affect the perception and evaluation of facial expressions? We reviewed 25 studies published from 1989 to 2020 on cross-modal behavioral effects of odors on the perception of faces. The results indicate that odors may influence facial evaluations and classifications in several ways. Faces are rated as more arousing during simultaneous odor exposure, and the rated valence of faces is affected in the direction of the odor valence. For facial classification tasks, in general, valenced odors, whether pleasant or unpleasant, decrease facial emotion classification speed. The evidence for valence congruency effects was inconsistent. Some studies found that exposure to a valenced odor facilitates the processing of a similarly valenced facial expression. The results for facial evaluation were mirrored in classical conditioning studies, as faces conditioned with valenced odors were rated in the direction of the odor valence. However, the evidence of odor effects was inconsistent when the task was to classify faces. Furthermore, using a z-curve analysis, we found clear evidence for publication bias. Our recommendations for future research include greater consideration of individual differences in sensation and cognition, individual differences (e.g., differences in odor sensitivity related to age, gender, or culture), establishing standardized experimental assessments and stimuli, larger study samples, and embracing open research practices.

Multisensory Integration of Emotion in Schizophrenic Patients

Multisensory integration (MSI) of emotion has been increasingly recognized as an essential element of schizophrenic patients' impairments, leading to the breakdown of their interpersonal functioning. The present review provides an updated synopsis of schizophrenics' MSI abilities in emotion processing by examining relevant behavioral and neurological research. Existing behavioral studies have adopted well-established experimental paradigms to investigate how participants understand multisensory emotion stimuli, and interpret their reciprocal interactions. Yet it remains controversial with regard to congruence-induced facilitation effects, modality dominance effects, and generalized vs specific impairment hypotheses. Such inconsistencies are likely due to differences and variations in experimental manipulations, participants' clinical symptomatology, and cognitive abilities. Recent electrophysiological and neuroimaging research has revealed aberrant indices in event-related potential (ERP) and brain activation patterns, further suggesting impaired temporal processing and dysfunctional brain regions, connectivity and circuities at different stages of MSI in emotion processing. The limitations of existing studies and implications for future MSI work are discussed in light of research designs and techniques, study samples and stimuli, and clinical applications.

Unpleasant Food Odors Modulate the Processing of Facial Expressions: An Event-Related Potential Study

In real-life situations, emotional information is often expressed through multiple sensory channels, with cross-talk between channels. Previous research has established that odor environments regulate the recognition of facial expressions. Therefore, this study combined event-related potentials (ERPs) with a facial emotion recognition task to investigate the effect of food odor context on the recognition of facial expressions and its time course. Fifty-four participants were asked to identify happy, fearful, and neutral faces in an odor context (pleasant, unpleasant or neutral). Electroencephalography (EEG) was performed to extract event-related potentials (ERPs). Behaviorally, unpleasant food odors triggered faster recognition of facial expressions, especially fearful ones. ERP results found that in the early stage, unpleasant food odors within 80–110 ms evoked a larger P100 amplitude than pleasant food odors and no odors, which showed that the unpleasant odor environment promoted the rapid processing of facial expressions. Next, the interaction between odor environment and facial expressions occurred during the middle stage, and the fearful expression evoked a smaller VPP (vertex positive potential) amplitude than the happy and neutral expressions when exposed to the unpleasant food odor environment. This result indicates that unpleasant odor environment consumed fewer cognitive resources when judging fearful expression, showing the promoting effect of mood coherence effect. These findings provided evidence for how people chose odor environments to facilitate the recognition of facial expressions, and highlighted the advantages of unpleasant food odors in communicating emotional information across the olfactory and visual pathways.

Background odors affect behavior in a dot-probe task with emotionally expressive faces

Odors affect perception of social cues in visual environments. Although often underestimated, people use their sense of smell to guide approach or avoidance behavior in social contexts. However, underlying psychological mechanisms are not well known. Prior work suggested olfactory effects are due to increased attention or arousal, or depend on the congruency between olfactory and visual cues. Our aim was to assess how odors influence attentional processes using a dot-probe task with odor-congruent and odor-incongruent facial expressions (happy, disgusted and neutral expressions paired with pleasant odor, unpleasant odor and no-odor). In a preregistered analysis plan, we hypothesized either faster reaction times attributed to arousal from odors in general, or to faces that were emotionally congruent with the odors. We also hypothesized time-on-task effects specific to the odor compared to the control condition. Using Bayesian linear models, we found strong evidence that the faces were rated as more arousing and emotional in odor contexts. However, the dot-probe task did in fact not provide an effective cue to selective visual attention, and odors did not modulate overall attention to the faces. However, we found a time-on-task effect such that in the unpleasant odor condition, response times decreased over time, whereas in the no-odor and pleasant condition there was a slight increase in response times. We conclude that time-on-task effects is an interesting venue for odor-visual interaction research, and such effects might explain inconsistent findings in the prior research literature.

Implicit Affective Rivalry: A Behavioral and fMRI Study Combining Olfactory and Auditory Stimulation

Aversive odors are highly salient stimuli that serve a protective function. Thus, emotional reactions elicited by negative odors may be hardly influenceable. We aim to elucidate if negative mood induced by negative odors can be modulated automatically by positively valenced stimuli. We included 32 healthy participants (16 men) in an fMRI design combining aversive and neutral olfactory stimuli with positive and neutral auditory stimuli to test the influence of aversive olfactory stimuli on subjective emotional state and brain activation when combined with positive and neutral auditory stimuli. The behavioral results show an interaction of negative olfactory stimuli on ratings of disgust, perceived valence of music, and subjective affective state, while positive auditory stimulation did not show this interaction. On a neuronal level, we observed main effects for auditory and olfactory stimulation, which are largely congruent with previous literature. However, the pairing of both stimuli was associated with attenuated brain activity in a set of brain areas (supplementary motor area, temporal pole, superior frontal gyrus) which overlaps with multisensory processing areas and pave the way for automatic emotion regulation. Our behavioral results and the integrated neural patterns provide evidence of predominance of olfaction in processing of affective rivalry from multiple sensory modalities.

Effects of androstadienone on dominance perception in males with low and high social anxiety

Increasing evidence suggests that humans can communicate both trait-dominance and state-dominance via body odor. Androstadienone (androsta-4,16,-dien-3-one), a chemosignal found in human sweat, seems to be a likely candidate for signaling dominance in humans. The aim of the current study was to investigate the effects of androstadienone on the perception of social dominance. Moreover, we examined whether high levels of social anxiety, a psychopathology involving concerns that specifically pertain to social dominance, are associated with increased sensitivity to androstadienone as a chemical cue of dominance. In a double-blind, placebo-controlled, within-subject design, 64 heterosexual male participants (32 with high social anxiety and 32 with low social anxiety) viewed facial images of males depicting dominant, neutral and submissive postures, and were asked to recognize and rate the dominance expressed in those images. Participants completed the task twice, once under exposure to androstadienone and once under exposure to a control solution. The results indicate that androstadienone increased the perceived dominance of men's faces, specifically among participants with high social anxiety. These findings suggest a direct influence of androstadienone on dominance perception and further highlight the preferential processing of dominance and social threat signals evident in social anxiety.

Background Odors Modulate N170 ERP Component and Perception of Emotional Facial Stimuli

Successful social interaction relies on the accurate decoding of other peoples’ emotional signals, and their contextual integration. However, little is known about how contextual odors may lead to modulation of cortical processing in response to facial expressions. We investigated how unpleasant and pleasant contextual background odors affected emotion perception and cortical event-related potential (ERP) responses to pictures of faces expressing happy, neutral and disgusted facial expressions. Faces were, regardless of expression, rated more positively in the pleasant odor condition and more negatively in the unpleasant odor condition. Faces were overall rated as more emotionally arousing in the presence of an odor, irrespective of its valence. Contextual odors also interacted with facial expressions, such that happy faces were rated as especially non-arousing in the unpleasant odor condition. The early, face-sensitive N170 ERP component also displayed an interaction effect. Here, disgusted faces were affected by the odor context such that the N170 revealed a relatively larger negativity in the context of a pleasant odor compared with an unpleasant odor. There were no odor effects on the responses to faces in other measured ERP components (P1, VPP, P2, and LPP). These results suggest that odors bias socioemotional perception early stages of the visual processing stream. However, effects may vary across emotional expressions and measurements.

Do Valenced Odors and Trait Body Odor Disgust Affect Evaluation of Emotion in Dynamic Faces?

Disgust is a core emotion evolved to detect and avoid the ingestion of poisonous food as well as the contact with pathogens and other harmful agents. Previous research has shown that multisensory presentation of olfactory and visual information may strengthen the processing of disgust-relevant information. However, it is not known whether these findings extend to dynamic facial stimuli that changes from neutral to emotionally expressive, or if individual differences in trait body odor disgust may influence the processing of disgust-related information. In this preregistered study, we tested whether a classification of dynamic facial expressions as happy or disgusted, and an emotional evaluation of these facial expressions, would be affected by individual differences in body odor disgust sensitivity, and by exposure to a sweat-like, negatively valenced odor (valeric acid), as compared with a soap-like, positively valenced odor (lilac essence) or a no-odor control. Using Bayesian hypothesis testing, we found evidence that odors do not affect recognition of emotion in dynamic faces even when body odor disgust sensitivity was used as moderator. However, an exploratory analysis suggested that an unpleasant odor context may cause faster RTs for faces, independent of their emotional expression. Our results further our understanding of the scope and limits of odor effects on facial perception affect and suggest further studies should focus on reproducibility, specifying experimental circumstances where odor effects on facial expressions may be present versus absent.

When preschoolers follow their eyes and older children follow their noses: visuo-olfactory social affective matching in childhood

Recognition of emotional facial expressions is a crucial skill for adaptive behavior that most often occurs in a multi-sensory context. Affective matching tasks have been used across development to investigate how people integrate facial information with other senses. Given the relative affective strength of olfaction and its relevance in mediating social information since birth, we assessed olfactory-visual matching abilities in a group of 140 children between the ages of 3 and 11 years old. We presented one of three odor primes (rose, fish and no-odor, rated as pleasant or unpleasant by individual children) before a facial choice task (happy vs. disgusted face). Children were instructed to select one of two faces. As expected, children of all ages tended to choose happy faces. Children younger than 5 years of age were biased towards choosing the happy face, irrespective of the odor smelled. After age 5, an affective matching strategy guided children's choices. Smelling a pleasant odor predicted the choice of happy faces, whereas smelling the unpleasant or fish odor predicted the choice of disgusted faces. The present study fills a gap in the developmental literature on olfactory-visual affective strategies that affect decision-making, and represents an important step towards understanding the underlying developmental processes that shape the typical social mind.

Simultaneous face and voice processing in schizophrenia

While several studies have consistently demonstrated abnormalities in the unisensory processing of face and voice in schizophrenia (SZ), the extent of abnormalities in the simultaneous processing of both types of information remains unclear. To address this issue, we used event-related potentials (ERP) methodology to probe the multisensory integration of face and non-semantic sounds in schizophrenia. EEG was recorded from 18 schizophrenia patients and 19 healthy control (HC) subjects in three conditions: neutral faces (visual condition-VIS); neutral non-semantic sounds (auditory condition-AUD); neutral faces presented simultaneously with neutral non-semantic sounds (audiovisual condition-AUDVIS). When compared with HC, the schizophrenia group showed less negative N170 to both face and face-voice stimuli; later P270 peak latency in the multimodal condition of face-voice relative to unimodal condition of face (the reverse was true in HC); reduced P400 amplitude and earlier P400 peak latency in the face but not in the voice-face condition. Thus, the analysis of ERP components suggests that deficits in the encoding of facial information extend to multimodal face-voice stimuli and that delays exist in feature extraction from multimodal face-voice stimuli in schizophrenia. In contrast, categorization processes seem to benefit from the presentation of simultaneous face-voice information. Timepoint by timepoint tests of multimodal integration did not suggest impairment in the initial stages of processing in schizophrenia.

The Odor Context Facilitates the Perception of Low-Intensity Facial Expressions of Emotion

It has been established that the recognition of facial expressions integrates contextual information. In this study, we aimed to clarify the influence of contextual odors. The participants were asked to match a target face varying in expression intensity with non-ambiguous expressive faces. Intensity variations in the target faces were designed by morphing expressive faces with neutral faces. In addition, the influence of verbal information was assessed by providing half the participants with the emotion names. Odor cues were manipulated by placing participants in a pleasant (strawberry), aversive (butyric acid), or no-odor control context. The results showed two main effects of the odor context. First, the minimum amount of visual information required to perceive an expression was lowered when the odor context was emotionally congruent: happiness was correctly perceived at lower intensities in the faces displayed in the pleasant odor context, and the same phenomenon occurred for disgust and anger in the aversive odor context. Second, the odor context influenced the false perception of expressions that were not used in target faces, with distinct patterns according to the presence of emotion names. When emotion names were provided, the aversive odor context decreased intrusions for disgust ambiguous faces but increased them for anger. When the emotion names were not provided, this effect did not occur and the pleasant odor context elicited an overall increase in intrusions for negative expressions. We conclude that olfaction plays a role in the way facial expressions are perceived in interaction with other contextual influences such as verbal information.

Neural responses to dynamic multimodal stimuli and pathology-specific impairments of social cognition in schizophrenia and depression

BACKGROUND

Individuals with schizophrenia and people with depression both show abnormal behavioural and neural responses when perceiving and responding to emotional stimuli, but pathology-specific differences and commonalities remain mostly unclear.

AIMS

To directly compare empathic responses to dynamic multimodal emotional stimuli in a group with schizophrenia and a group with depression, and to investigate their neural correlates using functional magnetic resonance imaging (fMRI).

METHOD

The schizophrenia group (n = 20), the depression group (n = 24) and a control group (n = 24) were presented with portrait-shot video clips expressing emotion through three possible communication channels: facial expression, prosody and content. Participants rated their own and the actor's emotional state as an index of empathy.

RESULTS

Although no group differences were found in empathy ratings, characteristic differences emerged in the fMRI activation patterns. The schizophrenia group demonstrated aberrant activation patterns during the neutral speech content condition in regions implicated in multimodal integration and formation of semantic constructs. Those in the depression group were most affected during conditions with trimodal emotional and trimodal neutral stimuli, in key regions of the mentalising network.

CONCLUSIONS

Our findings reveal characteristic differences in patients with schizophrenia compared with those with depression in their cortical responses to dynamic affective stimuli. These differences indicate that impairments in responding to emotional stimuli may be caused by pathology-specific problems in social cognition.

The neural bases of crossmodal object recognition in non-human primates and rodents: a review

The ability to integrate information from different sensory modalities to form unique multisensory object representations is a highly adaptive cognitive function. Surprisingly, non-human animal studies of the neural substrates of this form of multisensory integration have been somewhat sparse until very recently, and this may be due in part to a relative paucity of viable testing methods. Here we review the historical development and use of various "crossmodal" cognition tasks for non-human primates and rodents, focusing on tests of "crossmodal object recognition", the ability to recognize an object across sensory modalities. Such procedures have great potential to elucidate the cognitive and neural bases of object representation as it pertains to perception and memory. Indeed, these studies have revealed roles in crossmodal cognition for various brain regions (e.g., prefrontal and temporal cortices) and neurochemical systems (e.g., acetylcholine). A recent increase in behavioral and physiological studies of crossmodal cognition in rodents augurs well for the future of this research area, which should provide essential information about the basic mechanisms of object representation in the brain, in addition to fostering a better understanding of the causes of, and potential treatments for, cognitive deficits in human diseases characterized by atypical multisensory integration.

Neural correlates of semantic associations in patients with schizophrenia

Patients with schizophrenia have semantic processing disturbances leading to expressive language deficits (formal thought disorder). The underlying pathology has been related to alterations in the semantic network and its neural correlates. Moreover, crossmodal processing, an important aspect of communication, is impaired in schizophrenia. Here we investigated specific processing abnormalities in patients with schizophrenia with regard to modality and semantic distance in a semantic priming paradigm. Fourteen patients with schizophrenia and fourteen demographically matched controls made visual lexical decisions on successively presented word-pairs (SOA = 350 ms) with direct or indirect relations, unrelated word-pairs, and pseudoword-target stimuli during fMRI measurement. Stimuli were presented in a unimodal (visual) or crossmodal (auditory-visual) fashion. On the neural level, the effect of semantic relation indicated differences (patients > controls) within the right angular gyrus and precuneus. The effect of modality revealed differences (controls > patients) within the left superior frontal, middle temporal, inferior occipital, right angular gyri, and anterior cingulate cortex. Semantic distance (direct vs. indirect) induced distinct activations within the left middle temporal, fusiform gyrus, right precuneus, and thalamus with patients showing fewer differences between direct and indirect word-pairs. The results highlight aberrant priming-related brain responses in patients with schizophrenia. Enhanced activation for patients possibly reflects deficits in semantic processes that might be caused by a delayed and enhanced spread of activation within the semantic network. Modality-specific decreases of activation in patients might be related to impaired perceptual integration. Those deficits could induce and increase the prominent symptoms of schizophrenia like impaired speech processing.

Olfaction in alcohol-dependence: a neglected yet promising research field

Olfaction research deeply renewed the knowledge of the pathophysiological mechanisms involved in various psychopathological states and showed that olfactory deficits might constitute an onset or trait marker in psychiatry. However, while alcohol-dependence is the most wide spread psychiatric disorder and while olfaction might be involved in its development and maintenance, olfactory abilities have been little explored in this population. The central aim of this paper is thus to underline the usefulness of olfaction research in alcohol-dependence. After reviewing the few olfaction studies available, a research agenda will be proposed, identifying the major challenges for future research, and particularly: (1) the identification of the origin, extent and cerebral correlates of olfaction deficits; (2) the links between olfaction and emotional-cognitive deficits, and the use of olfaction to understand the pathomechanisms of alcohol-dependence; (3) the interactions between olfaction and other sensory modalities; (4) the use of olfaction to predict the appearance and intensity of cognitive impairments; (5) the impact of olfaction deficits on everyday life in alcohol-dependence.

Upcoming tactile events and body ownership in schizophrenia

Schizophrenic patients may report unusual perception of their own body. Studies using the rubber hand illusion (RHI) proposed that they exhibit a distorted sense of body ownership. However, since the RHI is mostly achieved with the contribution of visuo-tactile integration, the stronger RHI observed in schizophrenic patients could reflect either a general increase of the response to multisensory stimuli or a larger influence of visual cues on the tactile sensory experience. The purpose of the present study is to investigate patients' perception of their own body by means of a behavioral paradigm that measures their proneness to the RHI without relying on multisensory integration occurring during actual experience of touch. In a previous study we demonstrated in healthy participants that expectation of touch experience arising at the sight of a human hand approaching a rubber hand is enough to induce a sense of ownership over the same hand. Here we take advantage of the same paradigm to investigate body ownership in schizophrenia. Patients observed the experimenter's hand while approaching--without touching--either a rubber hand or a piece of wood placed in front of them. The seen object could be either aligned to participant's hand or rotated by 180°. Phenomenology of the illusion revealed that schizophrenic patients exhibited sense of ownership over the rubber hand, but more weakly than healthy controls. The present study sheds new light on the experience of body ownership in schizophrenic patients, corroborating the notion that alterations of bodily self-awareness play an important role in schizophrenia.

Multisensory integration mechanisms during aging

The rapid demographical shift occurring in our society implies that understanding of healthy aging and age-related diseases is one of our major future challenges. Sensory impairments have an enormous impact on our lives and are closely linked to cognitive functioning. Due to the inherent complexity of sensory perceptions, we are commonly presented with a complex multisensory stimulation and the brain integrates the information from the individual sensory channels into a unique and holistic percept. The cerebral processes involved are essential for our perception of sensory stimuli and becomes especially important during the perception of emotional content. Despite ongoing deterioration of the individual sensory systems during aging, there is evidence for an increase in, or maintenance of, multisensory integration processing in aging individuals. Within this comprehensive literature review on multisensory integration we aim to highlight basic mechanisms and potential compensatory strategies the human brain utilizes to help maintain multisensory integration capabilities during healthy aging to facilitate a broader understanding of age-related pathological conditions. Further our goal was to identify where further research is needed.

Attention and multisensory integration of emotions in schizophrenia

The impairment of multisensory integration in schizophrenia is often explained by deficits of attentional selection. Emotion perception, however, does not always depend on attention because affective stimuli can capture attention automatically. In our study, we specify the role of attention in the multisensory perception of emotional stimuli in schizophrenia. We evaluated attention by interference between conflicting auditory and visual information in two multisensory paradigms in patients with schizophrenia and healthy participants. In the first paradigm, interference occurred between physical features of the dynamic auditory and visual stimuli. In the second paradigm, interference occurred between the emotional content of the auditory and visual stimuli, namely fearful and sad emotions. In patients with schizophrenia, the interference effect was observed in both paradigms. In contrast, in healthy participants, the interference occurred in the emotional paradigm only. These findings indicate that the information leakage between different modalities in patients with schizophrenia occurs at the perceptual level, which is intact in healthy participants. However, healthy participants can have problems with the separation of fearful and sad emotions similar to those of patients with schizophrenia.

Experimental and clinical usefulness of crossmodal paradigms in psychiatry: an illustration from emotional processing in alcohol-dependence

Crossmodal processing (i.e., the construction of a unified representation stemming from distinct sensorial modalities inputs) constitutes a crucial ability in humans' everyday life. It has been extensively explored at cognitive and cerebral levels during the last decade among healthy controls. Paradoxically however, and while difficulties to perform this integrative process have been suggested in a large range of psychopathological states (e.g., schizophrenia and autism), these crossmodal paradigms have been very rarely used in the exploration of psychiatric populations. The main aim of the present paper is thus to underline the experimental and clinical usefulness of exploring crossmodal processes in psychiatry. We will illustrate this proposal by means of the recent data obtained in the crossmodal exploration of emotional alterations in alcohol-dependence. Indeed, emotional decoding impairments might have a role in the development and maintenance of alcohol-dependence, and have been extensively investigated by means of experiments using separated visual or auditory stimulations. Besides these unimodal explorations, we have recently conducted several studies using audio-visual crossmodal paradigms, which has allowed us to improve the ecological validity of the unimodal experimental designs and to offer new insights on the emotional alterations among alcohol-dependent individuals. We will show how these preliminary results can be extended to develop a coherent and ambitious research program using crossmodal designs in various psychiatric populations and sensory modalities. We will finally end the paper by underlining the various potential clinical applications and the fundamental implications that can be raised by this emerging project.

Trait and state positive emotional experience in schizophrenia: a meta-analysis

BACKGROUND

Prior meta-analyses indicated that people with schizophrenia show impairment in trait hedonic capacity but retain their state hedonic experience (valence) in laboratory-based assessments. Little is known about what is the extent of differences for state positive emotional experience (especially arousal) between people with schizophrenia and healthy controls. It is also not clear whether negative symptoms and gender effect contribute to the variance of positive affect.

METHODS AND FINDINGS

The current meta-analysis examined 21 studies assessing state arousal experience, 40 studies measuring state valence experience, and 47 studies assessing trait hedonic capacity in schizophrenia. Patients with schizophrenia demonstrated significant impairment in trait hedonic capacity (Cohen's d = 0.81). However, patients and controls did not statistically differ in state hedonic (valence) as well as exciting (arousal) experience to positive stimuli (Cohen's d = -0.24 to 0.06). They also reported experiencing relatively robust state aversion and calmness to positive stimuli compared with controls (Cohen's d = 0.75, 0.56, respectively). Negative symptoms and gender contributed to the variance of findings in positive affect, especially trait hedonic capacity in schizophrenia.

CONCLUSIONS

Our findings suggest that schizophrenia patients have no deficit in state positive emotional experience but impairment in "noncurrent" hedonic capacity, which may be mediated by negative symptoms and gender effect.

The neural network sustaining crossmodal integration is impaired in alcohol-dependence: an fMRI study

INTRODUCTION

Crossmodality (i.e., the integration of stimulations coming from different sensory modalities) is a crucial ability in everyday life and has been extensively explored in healthy adults. Still, it has not yet received much attention in psychiatry, and particularly in alcohol-dependence. The present study investigates the cerebral correlates of crossmodal integration deficits in alcohol-dependence to assess whether these deficits are due to the mere accumulation of unimodal impairments or rather to specific alterations in crossmodal areas.

METHODS

Twenty-eight subjects [14 alcohol-dependent subjects (ADS), 14 paired controls] were scanned using fMRI while performing a categorization task on faces (F), voices (V) and face-voice pairs (FV). A subtraction contrast [FV-(F+V)] and a conjunction analysis [(FV-F) ∩ (FV-V)] isolated the brain areas specifically involved in crossmodal face-voice integration. The functional connectivity between unimodal and crossmodal areas was explored using psycho-physiological interactions (PPI).

RESULTS

ADS presented only moderate alterations during unimodal processing. More centrally, in the subtraction contrast and conjunction analysis, they did not show any specific crossmodal brain activation while controls presented activations in specific crossmodal areas (inferior occipital gyrus, middle frontal gyrus, superior parietal lobule). Moreover, PPI analyses showed reduced connectivity between unimodal and crossmodal areas in alcohol-dependence.

CONCLUSIONS

This first fMRI exploration of crossmodal processing in alcohol-dependence showed a specific face-voice integration deficit indexed by reduced activation of crossmodal areas and reduced connectivity in the crossmodal integration network. Using crossmodal paradigms is thus crucial to correctly evaluate the deficits presented by ADS in real-life situations.

Assessing implicit odor localization in humans using a cross-modal spatial cueing paradigm

Background

Navigation based on chemosensory information is one of the most important skills in the animal kingdom. Studies on odor localization suggest that humans have lost this ability. However, the experimental approaches used so far were limited to explicit judgements, which might ignore a residual ability for directional smelling on an implicit level without conscious appraisal.

Methods

A novel cueing paradigm was developed in order to determine whether an implicit ability for directional smelling exists. Participants performed a visual two-alternative forced choice task in which the target was preceded either by a side-congruent or a side-incongruent olfactory spatial cue. An explicit odor localization task was implemented in a second experiment.

Results

No effect of cue congruency on mean reaction times could be found. However, a time by condition interaction emerged, with significantly slower responses to congruently compared to incongruently cued targets at the beginning of the experiment. This cueing effect gradually disappeared throughout the course of the experiment. In addition, participants performed at chance level in the explicit odor localization task, thus confirming the results of previous research.

Conclusion

The implicit cueing task suggests the existence of spatial information processing in the olfactory system. Response slowing after a side-congruent olfactory cue is interpreted as a cross-modal attentional interference effect. In addition, habituation might have led to a gradual disappearance of the cueing effect. It is concluded that under immobile conditions with passive monorhinal stimulation, humans are unable to explicitly determine the location of a pure odorant. Implicitly, however, odor localization seems to exert an influence on human behaviour. To our knowledge, these data are the first to show implicit effects of odor localization on overt human behaviour and thus support the hypothesis of residual directional smelling in humans.

Olfactory priming leads to faster sound localization

Cross-modal interactions between vision, audition and touch have been extensively studied in the last decade. However, our understanding of how the chemical senses interact with other sensory modalities remains relatively scarce. We performed a cued auditory localization paradigm in healthy young adults by measuring reaction times to monaural auditory stimuli after subjects had been cued by unilateral olfactory stimuli, mixed olfactory/trigeminal stimuli or somatosensory stimuli. As expected, all cuing conditions led to enhanced performances in auditory localization. Further, both odors led to significantly shorter reaction times when compared to the somatosensory stimuli. We did not observe any effect of side-congruency between the cues and the targets. These results suggest facilitative effects of odorous cues independent of a possible trigeminal component in the interaction between olfaction and audition.

Identifying a network of brain regions involved in aversion-related processing: a cross-species translational investigation

The ability to detect and respond appropriately to aversive stimuli is essential for all organisms, from fruit flies to humans. This suggests the existence of a core neural network which mediates aversion-related processing. Human imaging studies on aversion have highlighted the involvement of various cortical regions, such as the prefrontal cortex, while animal studies have focused largely on subcortical regions like the periaqueductal gray and hypothalamus. However, whether and how these regions form a core neural network of aversion remains unclear. To help determine this, a translational cross-species investigation in humans (i.e., meta-analysis) and other animals (i.e., systematic review of functional neuroanatomy) was performed. Our results highlighted the recruitment of the anterior cingulate cortex, the anterior insula, and the amygdala as well as other subcortical (e.g., thalamus, midbrain) and cortical (e.g., orbitofrontal) regions in both animals and humans. Importantly, involvement of these regions remained independent of sensory modality. This study provides evidence for a core neural network mediating aversion in both animals and humans. This not only contributes to our understanding of the trans-species neural correlates of aversion but may also carry important implications for psychiatric disorders where abnormal aversive behavior can often be observed.