Electro-cortical correlates of multisensory integration using ecologically valid emotional stimuli: Differential effects for fear and disgust

Multisensory integration (MSI) is crucial for human communication and social interaction and has been investigated in healthy populations and neurodevelopmental disorders. However, the use of stimuli with high ecological validity is sparse, especially in event-related potential (ERP) studies. The present study examined the ERP correlates of MSI in healthy adults using short (500 ms) ecologically valid professional actor-produced emotions of fear or disgust as vocal exclamation or facial expression (unimodal conditions) or both (bimodal condition). Behaviourally, our results show a general visual dominance effect (similarly fast responses following bimodal and visual stimuli) and an MSI-related speedup of responses only for fear. Electrophysiologically, both P100 and N170 showed MSI-related amplitude increases only following fear, but not disgust stimuli. Our results show for the first time that the known differential neural processing of fear and disgust also holds for the integration of dynamic auditory and visual information.

Sex-contingent face aftereffects depend on perceptual category rather than structural encoding

Many studies have used visual adaptation to investigate how recent experience with faces influences perception. While faces similar to those seen during adaptation phases are typically perceived as more 'normal' after adaptation, it is possible to induce aftereffects in one direction for one category (e.g. female) and simultaneously induce aftereffects in the opposite direction for another category (e.g. male). Such aftereffects could reflect 'category-contingent' adaptation of neurons selective for perceptual category (e.g. male or female) or 'structure-contingent' adaptation of lower-level neurons coding the physical characteristics of different face patterns. We compared these explanations by testing for simultaneous opposite after effects following adaptation to (a) two groups of faces from distinct sex categories (male and female) or (b) two groups of faces from the same sex category (female and hyper-female) where the structural differences between the female and hyper-female groups were mathematically identical to those between male and female groups. We were able to induce opposite aftereffects following adaptation between sex categories but not after adaptation within a sex category. These findings indicate the involvement of neurons coding perceptual category in sex-contingent face aftereffects and cannot be explained by neurons coding only the physical aspects of face patterns.