Dimensions of affective semantic meaning--behavioral and evoked potential correlates in Chinese subjects

Gender Differences in Emotional Connotative Meaning of Words Measured by Osgood's Semantic Differential Techniques in Young Adults

Semantic differential techniques are a useful, well-validated tool to assess affective processing of stimuli and determine how that processing is impacted by various demographic factors, such as gender. In this paper, we explore differences in connotative word processing between men and women as measured by Osgood's semantic differential and what those differences imply about affective processing in the two genders. We recruited 94 young participants (47 men, 47 women, ages 18-39) using an online survey and collected their affective ratings of 120 words on three rating tasks: Evaluation (E), Potency (P), and Activity (A). With these data, we explored the theoretical and mathematical overlap between Osgood's affective meaning factor structure and other models of emotional processing commonly used in gender analyses. We then used Osgood's three-dimensional structure to assess gender-related differences in three affective classes of words (words with connotation that is Positive, Neutral, or Negative for each task) and found that there was no significant difference between the genders when rating Positive words and Neutral words on each of the three rating tasks. However, young women consistently rated Negative words more negatively than young men did on all three of the independent dimensions. This confirms the importance of taking gender effects into account when measuring emotional processing. Our results further indicate there may be differences between Osgood's structure and other models of affective processing that should be further explored.

Affective Meaning, Concreteness, and Subjective Frequency Norms for Indonesian Words

This study investigated the lexical-semantic space organized by the semantic and affective features of Indonesian words and their relationship with gender and cultural aspects. We recruited 1,402 participants who were native speakers of Indonesian to rate affective and lexico-semantic properties of 1,490 Indonesian words. Valence, Arousal, Dominance, Predictability, Subjective Frequency, and Concreteness ratings were collected for each word from at least 52 people. We explored cultural differences between American English ANEW (affective norms for English words), Spanish ANEW, and the new Indonesian inventory [called CEFI (concreteness, emotion, and subjective frequency norms for Indonesian words)]. We found functional relationships between the affective dimensions that were similar across languages, but also cultural differences dependent on gender.

Electrophysiological correlates of connotative meaning in healthy children

The affective, connotative meaning of words can be statistically quantified by the semantic differential technique. Words that are located clearly on one of the three dimensions called "Evaluation", "Potency", and "Activity" were used as visual stimuli in a topographic event related potential study (ERP). Stimuli had been statistically defined in a group of 249 children (Skrandies, Jpn Psychol Res 53: 65-76, 2011). We investigated electrical brain activity in 19 healthy children with normal intelligence and reading skills between 11 and 15 years of age. Words that belonged to different semantic classes were presented at random on a monitor, and EEG was measured from 30 channels. Evoked potentials were computed offline for each semantic class. In the ERP data we observed significant effects of word class on component latency, field strength and topography. Similar as with adult subjects such effects occurred at small latency of about 115 ms after word presentation. The language-evoked components in children were similar but not identical to those reported previously for various groups of adults. Our data show that visually evoked brain activity is modulated by connotative meaning of the stimuli at early processing stages not only in adults but also in children.

Evaluation of multisensory stimuli--dimensions of meaning and electrical brain activity

The semantic differential technique is used to statistically define connotative dimensions of meaning. The brain depends on these dimensions to process words. Earlier studies demonstrated that stimuli of the different semantic classes led to differences in neuronal processing. We investigated the influence of connotative meaning on multisensory processing (food words strongly related to odor, taste, vision or somatosensory texture). A group of 795 subjects rated 197 food words on the basis of 11 pairs of adjectives with opposite meanings. Factor analysis revealed three dimensions (Evaluation, Potency and Texture). Words with high positive or negative scores, and low scores on the other dimensions, were used as stimuli in an ERP experiment. EEG was recorded in 40 healthy adults from 30 channels and averaged according to semantic stimulus class. Component latency, global field power and topography were influenced by semantic meaning. These experiments determined that very early effects at 107 ms after stimulus presentation where latency and GFP were affected by stimulus class. When mapped topographically, different stimulus classes led to different scalp topography of evoked brain activity in sagittal direction already at an early state of processing (around 107 ms). The extent of lateralization of potential fields' centers of gravity was influenced by stimulus class around 304 ms. In summary, semantic dimensions influence neuronal processing of words related to multisensory perception. Such effects suggest a rapid and complex way of processing multisensory stimuli.

Emotional states modulate the recognition potential during word processing

This study examined emotional modulation of word processing, showing that the recognition potential (RP), an ERP index of word recognition, could be modulated by different emotional states. In the experiment, participants were instructed to compete with pseudo-competitors, and via manipulation of the outcome of this competition, they were situated in neutral, highly positive, slightly positive, highly negative or slightly negative emotional states. They were subsequently asked to judge whether the referent of a word following a series of meaningless character segmentations was an animal or not. The emotional induction task and the word recognition task were alternated. Results showed that 1) compared with the neutral emotion condition, the peak latency of the RP under different emotional states was earlier and its mean amplitude was smaller, 2) there was no significant difference between RPs elicited under positive and negative emotional states in either the mean amplitude or latency, and 3) the RP was not affected by different degrees of positive emotional states. However, compared to slightly negative emotional states, the mean amplitude of the RP was smaller and its latency was shorter in highly negative emotional states over the left hemisphere but not over the right hemisphere. The results suggest that emotional states influence word processing.

A role for the motor system in binding abstract emotional meaning

Sensorimotor areas activate to action- and object-related words, but their role in abstract meaning processing is still debated. Abstract emotion words denoting body internal states are a critical test case because they lack referential links to objects. If actions expressing emotion are crucial for learning correspondences between word forms and emotions, emotion word–evoked activity should emerge in motor brain systems controlling the face and arms, which typically express emotions. To test this hypothesis, we recruited 18 native speakers and used event-related functional magnetic resonance imaging to compare brain activation evoked by abstract emotion words to that by face- and arm-related action words. In addition to limbic regions, emotion words indeed sparked precentral cortex, including body-part–specific areas activated somatotopically by face words or arm words. Control items, including hash mark strings and animal words, failed to activate precentral areas. We conclude that, similar to their role in action word processing, activation of frontocentral motor systems in the dorsal stream reflects the semantic binding of sign and meaning of abstract words denoting emotions and possibly other body internal states.

Early MEG activation dynamics in the left temporal and inferior frontal cortex reflect semantic context integration

Traditional views link semantic context integration to neurophysiological activity at 300-500 msec. To study possible early dynamics related to semantic context integration, we recorded, in passive oddball paradigm, magnetic evoked responses to spoken word pairs, the second word being either congruent or incongruent with the first one. The same experimental words were placed in orthogonally varied context, thus providing a strict control for any effects of acoustic, phonological, and psycholinguistic stimulus features. Responses to the same critical words were obtained also outside of semantic context. We found that regardless of their acoustic features, semantically incongruent stimuli elicited a brain response already at approximately 115 msec after the critical word onset. The same words did not produce such deflection in semantically legal context. The responses were maximal at left temporal and inferior frontal cortical sites, which was also confirmed by distributed current source analysis. The left temporal activation preceded the frontal one by approximately 16 msec. No late response dynamics (>350 msec) were found that would reflect the semantic modulation in this nonattend passive design, indicating the possible role of attention in generating the later responses. Our results suggest that the earliest brain processes of semantic context integration can occur at approximately 100 msec after the onset of spoken words in the left inferior frontal and superior temporal cortex.

Match and Mismatch of Taste, Odor, and Color is Reflected by Electrical Activity in the Human Brain

We aimed at elucidating the relationship between odor, taste, color, and food stimuli where subjects were studied either with questionnaires or in electrophysiological experiments. First, a total of 144 word pairs were rated by 660 subjects who determined whether the first stimulus (odor or taste word) matched the second one (color or food word). In an electrophysiological experiment, EEG was recorded from 30 electrodes in 24 healthy adults while clearly matching, or nonmatching, word pairs were presented on a monitor. Evoked potentials were computed for different stimulus classes (matching or nonmatching combinations of odor or taste and color or food words). Six components were identified and compared between conditions. For most components, field strength (GFP) was lower for nonmatching than for matching word pairs. In addition to late effects, electrical brain activity was influenced by experimental conditions as early as at 100 ms latency. Most effects observed were in the time range between 100 and 250 ms. Our data show how color and food words are differently affected when paired with odor or taste words. Complex interactions between stimulus modality (taste/odor) and different target words (color/food) occurred depending on whether the pairs were seen by the subjects as appropriate or inappropriate. Topographical effects indicated that different neural populations were activated in different conditions. Most interestingly, there were many cognitive effects occurring quite early (on the order of 100 ms) after stimulus presentation, and our results suggest rapid cognitive processing of information on odor, taste, color, and food items. This is an important prerequisite for the preconscious and fast choice of food items in everyday behavior, and the data confirm earlier findings on rapid and preconscious semantic processing in the visual cortex.

Language experience shapes early electrophysiological responses to visual stimuli: the effects of writing system, stimulus length, and presentation duration

How language experience affects visual word recognition has been a topic of intense interest. Using event-related potentials (ERPs), the present study compared the early electrophysiological responses (i.e., N1) to familiar and unfamiliar writings under different conditions. Thirteen native Chinese speakers (with English as their second language) were recruited to passively view four types of scripts: Chinese (familiar logographic writings), English (familiar alphabetic writings), Korean Hangul (unfamiliar logographic writings), and Tibetan (unfamiliar alphabetic writings). Stimuli also differed in lexicality (words vs. non-words, for familiar writings only), length (characters/letters vs. words), and presentation duration (100 ms vs. 750 ms). We found no significant differences between words and non-words, and the effect of language experience (familiar vs. unfamiliar) was significantly modulated by stimulus length and writing system, and to a less degree, by presentation duration. That is, the language experience effect (i.e., a stronger N1 response to familiar writings than to unfamiliar writings) was significant only for alphabetic letters, but not for alphabetic and logographic words. The difference between Chinese characters and unfamiliar logographic characters was significant under the condition of short presentation duration, but not under the condition of long presentation duration. Long stimuli elicited a stronger N1 response than did short stimuli, but this effect was significantly attenuated for familiar writings. These results suggest that N1 response might not reliably differentiate familiar and unfamiliar writings. More importantly, our results suggest that N1 is modulated by visual, linguistic, and task factors, which has important implications for the visual expertise hypothesis.

Event-related potential study to aversive auditory stimuli

In an auditory oddball task emotionally negative (aversive) sounds (e.g. rubbing together of polystyrene) and everyday sounds (e.g. ringing of a bicycle bell) were presented as task-irrelevant (novel) sounds. Both the aversive and the everyday sounds elicited the orientation-related P3a component of the event-related potentials (ERPs). In the 154-250 ms range the ERPs for the aversive sounds were more negative than the ERP of the everyday sounds. For the aversive sounds, this negativity was followed by a frontal positive wave (372-456 ms). The aversive sounds elicited larger late positive shift than the everyday sounds. The early negativity is considered as an initial effect in a broad neural network including limbic structures, while the later is related to the cognitive assessment of the stimuli and to memory-related processes.

Neuroimaging methods in affective neuroscience: selected methodological issues

A current goal of affective neuroscience is to reveal the relationship between emotion and dynamic brain activity in specific neural circuits. In humans, noninvasive neuroimaging measures are of primary interest in this endeavor. However, methodological issues, unique to each neuroimaging method, have important implications for the design of studies, interpretation of findings, and comparison across studies. With regard to event-related brain potentials, we discuss the need for dense sensor arrays to achieve reference-independent characterization of field potentials and improved estimate of cortical brain sources. Furthermore, limitations and caveats regarding sparse sensor sampling are discussed. With regard to event-related magnetic field (ERF) recordings, we outline a method to achieve magnetoencephalography (MEG) sensor standardization, which improves effects' sizes in typical neuroscientific investigations, avoids the finding of ghost effects, and facilitates comparison of MEG waveforms across studies. Focusing on functional magnetic resonance imaging (fMRI), we question the unjustified application of proportional global signal scaling in emotion research, which can greatly distort statistical findings in key structures implicated in emotional processing and possibly contributing to conflicting results in affective neuroscience fMRI studies, in particular with respect to limbic and paralimbic structures. Finally, a distributed EEG/MEG source analysis with statistical parametric mapping is outlined providing a common software platform for hemodynamic and electromagnetic neuroimaging measures. Taken together, to achieve consistent and replicable patterns of the relationship between emotion and neuroimaging measures, methodological aspects associated with the various neuroimaging techniques may be of similar importance as the definition of emotional cues and task context used to study emotion.

Brain responses of explicit and implicit memory: an event-related potential study

Implicit memory is acquired by an unintentional or unconscious learning. Recognition memory involves either automatic knowing or consciously controlled remembering. We provided an event-related potential paradigm capable of differentiating memory for the explicitly learned, implicitly learned and unstudied materials. In the explicit memory, we obtained both frontal (controlled retrieval) and parietal (recollection) old/new effects. In the implicit memory, we found persistent occipitotemporal activation (visual priming) and late attenuation in the temporoparietooccipital (repetition suppression). Event-related potential provides an insight into the dissociable mechanism of memory function that supports the dual process model with an enhanced temporal resolution on the dynamic process of both explicit perceptual learning and implicit perceptual priming.

Language outside the focus of attention: The mismatch negativity as a tool for studying higher cognitive processes

Which aspects of language and cognitive processing take place irrespective of whether subjects focus their attention on incoming stimuli and are, in this sense, automatic? The Mismatch Negativity (MMN), a neurophysiological brain response recorded in the EEG and MEG, is elicited by attended and unattended stimuli alike. Recent studies investigating the cognitive processes underlying spoken language processing found that even under attentional withdrawal, MMN size and topography reflect the activation of memory traces for language elements in the human brain. Familiar sounds of one's native language elicit a larger MMN than unfamiliar sounds, and at the level of meaningful language units, words elicit a larger MMN than meaningless pseudowords. This suggests that the MMN reflects the activation of memory networks for language sounds and spoken words. Unattended word stimuli elicit an activation sequence starting in superior-temporal cortex and rapidly progressing to left-inferior-frontal lobe. The spatio-temporal patterns of cortical activation depend on lexical and semantic properties of word stems and affixes, thus indicating that the MMN can give clues about lexico-semantic information processing stored in long term memory. At the syntactic level, MMN size was found to reflect whether a word string conforms to abstract grammatical rules. This growing body of results suggests that lexical, semantic and syntactic information can be processed by the central nervous system outside the focus of attention in a largely automatic manner. Analysis of spatio-temporal patterns of generator activations underlying the MMN to speech may be an important tool for investigating the brain dynamics of spoken language processing and the activated distributed cortical circuits acting at long-term memory traces.

Emotional and semantic networks in visual word processing: insights from ERP studies

The event-related brain potential (ERP) literature concerning the impact of emotional content on visual word processing is reviewed and related to general knowledge on semantics in word processing: emotional connotation can enhance cortical responses at all stages of visual word processing following the assembly of visual word form (up to 200 ms), such as semantic access (around 200 ms), allocation of attentional resources (around 300 ms), contextual analysis (around 400 ms), and sustained processing and memory encoding (around 500 ms). Even earlier effects have occasionally been reported with subliminal or perceptual threshold presentation, particularly in clinical populations. Here, the underlying mechanisms are likely to diverge from the ones operational in standard natural reading. The variability in timing of the effects can be accounted for by dynamically changing lexical representations that can be activated as required by the subjects' motivational state, the task at hand, and additional contextual factors. Throughout, subcortical structures such as the amygdala are likely to contribute these enhancements. Further research will establish whether or when emotional arousal, valence, or additional emotional properties drive the observed effects and how experimental factors interact with these. Meticulous control of other word properties known to affect ERPs in visual word processing, such as word class, length, frequency, and concreteness and the use of more standardized EEG procedures is vital. Mapping the interplay between cortical and subcortical mechanisms that give rise to amplified cortical responses to emotional words will be of highest priority for future research.

Emerging Neurophysiological Specialization for Letter Strings

In adult readers, printed words and other letter strings activate specialized visual functions within 200 msec, as evident from neurophysiological recordings of brain activity. These fast, specialized responses to letter strings are thought to develop through plastic changes in the visual system. However, it is unknown whether this specialization emerges only with the onset of word reading, or represents a precursor of literacy. We compared 6-year-old kindergarten children who could not yet read words to adult readers. Both age groups detected immediate repetitions of visually presented words, pseudo-words, symbol strings, and pictures during event-related potential (ERP) mapping. Maps from seven corresponding ERP segments in children and adults were analyzed regarding fast (<250 msec) and slow (>300 msec) specialization for letter strings. Adults reliably differentiated words through increased fast (<150 msec) occipito-temporal N1 activity from symbols. Children showed a later, more mid-occipital N1 with marginal word-symbol differences, which were absent in those children with low letter knowledge. Children with high letter knowledge showed some fast sensitivity to letter strings, which was confined to right occipito-temporal sites, unlike the stronger adult N1 specialization. This suggests that a critical degree of early literacy induces some immature, but fast, specialization for letter strings before word reading becomes possible. Children also differentiated words from symbols in later segments through increased right occipito-temporal negativity for words. This slow specialization for letter strings was not modulated by letter knowledge and was absent in adults, possibly reflecting a visual precursor of literacy due to visual familiarity with letter strings.

Multichannel NIRS analysis of brain activity during semantic differential rating of drawing stimuli containing different affective polarities

We used 24-channel near-infrared spectroscopy (NIRS) to measure activity in the temporal, parietal, and frontal regions of the brain in eight Japanese women while the participants rated line drawings using semantic differential scales. Participants rated the seven line drawings on 15 bipolar semantic scales, each of which belonged to one of three semantic classes: Evaluation, Activity, or Potency. Suzuki et al. [M. Suzuki, J. Gyoba, Y. Sakuta, Multichannel near-infrared spectroscopy analysis of brain activities during semantic differential rating of drawings, Tohoku Psychologica Folia 62 (2003) 86-98.] had reported previously that the right superior temporal gyrus and the right inferior parietal lobule are associated with Activity rating, while the brain regions around the central fissure were related to Potency rating. Based on these suggestions, we investigated the brain activity in these regions during rating of stimuli containing different affective polarities. When drawings were reported as 'static' or 'calm', oxyhemoglobin concentration was higher around the right superior temporal gyrus as compared to when they were considered 'noisy' or 'excitable'. Oxyhemoglobin concentrations around the central fissure were also higher when drawings were rated as 'soft', 'smooth', or 'blunt' compared to 'hard', 'rough', or 'sharp'. Any characteristic oxyhemoglobin changes were not found during the ratings on the evaluation scales. Our results suggest that activation patterns of the temporal and parietal regions are significantly modified by semantic polarities of Activity and Potency.