Semantic processing of mathematical gestures

Influencing choices with conversational primes: How a magic trick unconsciously influences card choices

Past research demonstrates that unconscious primes can affect people's decisions. However, these free choice priming paradigms present participants with very few alternatives. Magicians' forcing techniques provide a powerful tool to investigate how natural implicit primes can unconsciously influence decisions with multiple alternatives. We used video and live performances of the mental priming force. This technique uses subtle nonverbal and verbal conversational primes to influence spectators to choose the three of diamonds. Our results show that a large number of participants chose the target card while reporting feeling free and in control of their choice. Even when they were influenced by the primes, participants typically failed to give the reason for their choice. These results show that naturally embedding primes within a person's speech and gestures effectively influenced people's decision making. This raises the possibility that this form of mind control could be used to effectively manipulate other mental processes.

Behavioural and electrophysiological effects related to semantic violations during braille reading

This study investigated the potential to detect event related potentials (ERPs) occurring in response to a specific task in braille reading. This would expand current methodologies for studying the cognitive processes underlying braille reading. An N400 effect paradigm was utilised, whereby proficient blind braille readers read congruent- and incongruent-ending braille sentences. Kinematic and electroencephalography (EEG) data were obtained simultaneously and synchronised. The ERPs differed between the incongruent and congruent sentences in a manner consistent with the N400 effect found with a previous sighted reading paradigm, demonstrating that ERPs can be obtained during braille reading. The frequency of finger reversals and the degree of intermittency in the finger velocity were significantly higher when reading incongruent versus congruent sentence endings. Both reversals and the potential N400 effect may reflect processes involved in semantic unification. These findings have significant implications for the modelling of braille reading. The refinement of the technique will enable other ERPs to be identified and related to behavioural responses, to further our understanding of the braille reading process.

Comprehending body language and mimics: an ERP and neuroimaging study on Italian actors and viewers

In this study, the neural mechanism subserving the ability to understand people’s emotional and mental states by observing their body language (facial expression, body posture and mimics) was investigated in healthy volunteers. ERPs were recorded in 30 Italian University students while they evaluated 280 pictures of highly ecological displays of emotional body language that were acted out by 8 male and female Italian actors. Pictures were briefly flashed and preceded by short verbal descriptions (e.g., “What a bore!”) that were incongruent half of the time (e.g., a picture of a very attentive and concentrated person shown after the previous example verbal description). ERP data and source reconstruction indicated that the first recognition of incongruent body language occurred 300 ms post-stimulus. swLORETA performed on the N400 identified the strongest generators of this effect in the right rectal gyrus (BA11) of the ventromedial orbitofrontal cortex, the bilateral uncus (limbic system) and the cingulate cortex, the cortical areas devoted to face and body processing (STS, FFA EBA) and the premotor cortex (BA6), which is involved in action understanding. These results indicate that face and body mimics undergo a prioritized processing that is mostly represented in the affective brain and is rapidly compared with verbal information. This process is likely able to regulate social interactions by providing on-line information about the sincerity and trustfulness of others.

N400 ERPs for actions: building meaning in context

Converging neuroscientific evidence suggests the existence of close links between language and sensorimotor cognition. Accordingly, during the comprehension of meaningful actions, our brain would recruit semantic-related operations similar to those associated with the processing of language information. Consistent with this view, electrophysiological findings show that the N400 component, traditionally linked to the semantic processing of linguistic material, can also be elicited by action-related material. This review outlines recent data from N400 studies that examine the understanding of action events. We focus on three specific domains, including everyday action comprehension, co-speech gesture integration, and the semantics involved in motor planning and execution. Based on the reviewed findings, we suggest that both negativities (the N400 and the action-N400) reflect a common neurocognitive mechanism involved in the construction of meaning through the expectancies created by previous experiences and current contextual information. To shed light on how this process is instantiated in the brain, a testable contextual fronto-temporo-parietal model is proposed.

Amusia results in abnormal brain activity following inappropriate intonation during speech comprehension

Pitch processing is a critical ability on which humans’ tonal musical experience depends, and which is also of paramount importance for decoding prosody in speech. Congenital amusia refers to deficits in the ability to properly process musical pitch, and recent evidence has suggested that this musical pitch disorder may impact upon the processing of speech sounds. Here we present the first electrophysiological evidence demonstrating that individuals with amusia who speak Mandarin Chinese are impaired in classifying prosody as appropriate or inappropriate during a speech comprehension task. When presented with inappropriate prosody stimuli, control participants elicited a larger P600 and smaller N100 relative to the appropriate condition. In contrast, amusics did not show significant differences between the appropriate and inappropriate conditions in either the N100 or the P600 component. This provides further evidence that the pitch perception deficits associated with amusia may also affect intonation processing during speech comprehension in those who speak a tonal language such as Mandarin, and suggests music and language share some cognitive and neural resources.

Are depictive gestures like pictures? commonalities and differences in semantic processing

Conversation is multi-modal, involving both talk and gesture. Does understanding depictive gestures engage processes similar to those recruited in the comprehension of drawings or photographs? Event-related brain potentials (ERPs) were recorded from neurotypical adults as they viewed spontaneously produced depictive gestures preceded by congruent and incongruent contexts. Gestures were presented either dynamically in short, soundless video-clips, or statically as freeze frames extracted from gesture videos. In a separate ERP experiment, the same participants viewed related or unrelated pairs of photographs depicting common real-world objects. Both object photos and gesture stimuli elicited less negative ERPs from 400 to 600ms post-stimulus when preceded by matching versus mismatching contexts (dN450). Object photos and static gesture stills also elicited less negative ERPs between 300 and 400ms post-stimulus (dN300). Findings demonstrate commonalities between the conceptual integration processes underlying the interpretation of iconic gestures and other types of image-based representations of the visual world.