Early signs of visual categorization for biological and non-biological stimuli in humans

Mentally ill, HIV-positive, or sexual predator? Determining myths perceived as representative of transgender people

The present study explored possible stereotypical beliefs, or myths, related to prejudice and discrimination toward transgender individuals in the US. In a 5 x 2 x 3 mixed factorial design, Amazon Mechanical Turk workers ( N = 1,450) read a description of a target depicted as a sexual predator, HIV-positive, having a mental illness, an ally of transgender people, or unfair to others. They then completed an intuitive judgment task regarding the target’s gender (male or female) and identity stigma detail (transgender, sexual minority, or no stigmatized detail), and provided feeling thermometer ratings for various groups. Results indicated that participants perceived mental illness as relatively representative of transgender people, but not HIV-status or sexual predation. Feeling thermometer ratings for transgender people were significantly lower than those for other gender/stigma categories and were negatively correlated with participant religiosity and conservatism. We discuss these findings in terms of gendered assumptions and present implications for gender-related stigma and the role of perceived mental illness in antitransgender prejudice.

The Effects of Face Inversion and Face Race on the P100 ERP

Research about the neural basis of face recognition has investigated the timing and anatomical substrates of different stages of face processing. Scalp-recorded ERP studies of face processing have focused on the N170, an ERP with a peak latency of ∼170 msec that has long been associated with the initial structural encoding of faces. However, several studies have reported earlier ERP differences related to faces, suggesting that face-specific processes might occur before N170. Here, we examined the influence of face inversion and face race on the timing of face-sensitive scalp-recorded ERPs by examining neural responses to upright and inverted line-drawn and luminance-matched white and black faces in a sample of white participants. We found that the P100 ERP evoked by inverted faces was significantly larger than that evoked by upright faces. Although this inversion effect was statistically significant at 100 msec, the inverted-upright ERP difference peaked at 138 msec, suggesting that it might represent an activity in neural sources that overlap with P100. Inverse modeling of the inversion effect difference waveform suggested possible neural sources in pericalcarine extrastriate visual cortex and lateral occipito-temporal cortex. We also found that the inversion effect difference wave was larger for white faces. These results are consistent with behavioral evidence that individuals process the faces of their own races more configurally than faces of other races. Taken together, the inversion and race effects observed in the current study suggest that configuration influences face processing by at least 100 msec.

The N170 component is sensitive to face-like stimuli: a study of Chinese Peking opera makeup

The N170 component is considered a neural marker of face-sensitive processing. In the present study, the face-sensitive N170 component of event-related potentials (ERPs) was investigated with a modified oddball paradigm using a natural face (the standard stimulus), human- and animal-like makeup stimuli, scrambled control images that mixed human- and animal-like makeup pieces, and a grey control image. Nineteen participants were instructed to respond within 1000 ms by pressing the 'F' or 'J' key in response to the standard or deviant stimuli, respectively. We simultaneously recorded ERPs, response accuracy, and reaction times. The behavioral results showed that the main effect of stimulus type was significant for reaction time, whereas there were no significant differences in response accuracies among stimulus types. In relation to the ERPs, N170 amplitudes elicited by human-like makeup stimuli, animal-like makeup stimuli, scrambled control images, and a grey control image progressively decreased. A right hemisphere advantage was observed in the N170 amplitudes for human-like makeup stimuli, animal-like makeup stimuli, and scrambled control images but not for grey control image. These results indicate that the N170 component is sensitive to face-like stimuli and reflect configural processing in face recognition.

How 'love' and 'hate' differ from 'sleep': using combined electro/magnetoencephalographic data to reveal the sources of early cortical responses to emotional words

Emotional words--as symbols for biologically relevant concepts--are preferentially processed in brain regions including the visual cortex, frontal and parietal regions, and a corticolimbic circuit including the amygdala. Some of the brain structures found in functional magnetic resonance imaging are not readily apparent in electro- and magnetoencephalographic (EEG; MEG) measures. By means of a combined EEG/MEG source localization procedure to fully exploit the available information, we sought to reduce these discrepancies and gain a better understanding of spatiotemporal brain dynamics underlying emotional-word processing. Eighteen participants read high-arousing positive and negative, and low-arousing neutral nouns, while EEG and MEG were recorded simultaneously. Combined current-density reconstructions (L2-minimum norm least squares) for two early emotion-sensitive time intervals, the P1 (80-120 ms) and the early posterior negativity (EPN, 200-300 ms), were computed using realistic individual head models with a cortical constraint. The P1 time window uncovered an emotion effect peaking in the left middle temporal gyrus. In the EPN time window, processing of emotional words was associated with enhanced activity encompassing parietal and occipital areas, and posterior limbic structures. We suggest that lexical access, being underway within 100 ms, is speeded and/or favored for emotional words, possibly on the basis of an "emotional tagging" of the word form during acquisition. This gives rise to their differential processing in the EPN time window. The EPN, as an index of natural selective attention, appears to reflect an elaborate interplay of distributed structures, related to cognitive functions, such as memory, attention, and evaluation of emotional stimuli.

On the Nature of Gender Categorization

In the present paper, relying on event-related brain potentials (ERPs), we investigated the automatic nature of gender categorization focusing on different stages of the ongoing process. In particular, we explored the degree to which gender categorization occurs automatically by manipulating the semantic vs. nonsemantic processing goals requested by the task (Study 1) and the complexity of the task itself (Study 2). Results of Study 1 highlighted the automatic nature of categorization at an early (N170) and on a later processing stage (P300). Findings of Study 2 showed that at an early stage categorization was automatically driven by the ease of extraction of category-based knowledge from faces while, at a later stage, categorization was more influenced by situational constrains.

ERP evidence for the speed of face categorization in the human brain: Disentangling the contribution of low-level visual cues from face perception

How fast are visual stimuli categorized as faces by the human brain? Because of their high temporal resolution and the possibility to record simultaneously from the whole brain, electromagnetic scalp measurements should be the ideal method to clarify this issue. However, this question remains debated, with studies reporting face-sensitive responses varying from 50 ms to 200 ms following stimulus onset. Here we disentangle the contribution of the information associated with the phenomenological experience of a face (phase) from low-level visual cues (amplitude spectrum, color) in accounting for early face-sensitivity in the human brain. Pictures of faces and of a category of familiar objects (cars), as well as their phase-scrambled versions, were presented to fifteen human participants tested with high-density (128 channels) EEG. We replicated an early face-sensitivity - larger response to pictures of faces than cars - at the level of the occipital event-related potential (ERP) P1 (80- ). However, a similar larger P1 to phase-scrambled faces than phase-scrambled cars was also found. In contrast, the occipito-temporal N170 was much larger in amplitude for pictures of intact faces than cars, especially in the right hemisphere, while the small N170 elicited by phase-scrambled stimuli did not differ for faces and cars. These findings show that sensitivity to faces on the visual evoked potentials P1 and N1 (N170) is functionally dissociated: the P1 face-sensitivity is driven by low-level visual cues while the N1 (or N170) face-sensitivity reflects the perception of a face. Altogether, these observations indicate that the earliest access to a high-level face representation, that is, a face percept, does not precede the N170 onset in the human brain. Furthermore, they allow resolving apparent discrepancies between the timing of rapid human saccades towards faces and the early activation of high-level facial representations as shown by electrophysiological studies in the primate brain. More generally, they put strong constraints on the interpretation of early (before 100 ms) face-sensitive effects in the human brain.

Dimension-based attention modulates early visual processing

Target selection can be based on spatial or dimensional/featural mechanisms operating in a location-independent manner. We investigated whether dimension-based attention affects processing in early visual stages. Subjects searched for a singleton target among an 8-item array, with the search display preceded by an identical cue array with a dimensionally non-predictive, but spatially predictive singleton. Reaction times (RTs) were increased for changes in the target-defining dimension but not for featural changes within a dimension. This RT effect was mirrored by modulations of the P1 and anterior transition N2 (tN2). Current density reconstructions revealed increased activity in dorsal occipital cortex and decreased activity in left frontopolar cortex owing to repeated dimensional pop-out identities. These findings strengthen dimension-based theories of visual attention by indicating dimension-, rather than feature-, specific influences within the first 110 ms of visual processing.

Early category-specific cortical activation revealed by visual stimulus inversion

Visual categorization may already start within the first 100-ms after stimulus onset, in contrast with the long-held view that during this early stage all complex stimuli are processed equally and that category-specific cortical activation occurs only at later stages. The neural basis of this proposed early stage of high-level analysis is however poorly understood. To address this question we used magnetoencephalography and anatomically-constrained distributed source modeling to monitor brain activity with millisecond-resolution while subjects performed an orientation task on the upright and upside-down presented images of three different stimulus categories: faces, houses and bodies. Significant inversion effects were found for all three stimulus categories between 70-100-ms after picture onset with a highly category-specific cortical distribution. Differential responses between upright and inverted faces were found in well-established face-selective areas of the inferior occipital cortex and right fusiform gyrus. In addition, early category-specific inversion effects were found well beyond visual areas. Our results provide the first direct evidence that category-specific processing in high-level category-sensitive cortical areas already takes place within the first 100-ms of visual processing, significantly earlier than previously thought, and suggests the existence of fast category-specific neocortical routes in the human brain.

The power of the feed-forward sweep

Vision is fast and efficient. A novel natural scene can be categorized (e.g. does it contain an animal, a vehicle?) by human observers in less than 150 ms, and with minimal attentional resources. This ability still holds under strong backward masking conditions. In fact, with a stimulus onset asynchrony of about 30 ms (the time between the scene and mask onset), the first 30 ms of selective behavioral responses are essentially unaffected by the presence of the mask, suggesting that this type of “ultra-rapid” processing can rely on a sequence of swift feed-forward stages, in which the mask information never “catches up” with the scene information. Simulations show that the feed-forward propagation of the first wave of spikes generated at stimulus onset may indeed suffice for crude re-cognition or categorization. Scene awareness, however, may take significantly more time to develop, and probably requires feed-back processes. The main implication of these results for theories of masking is that pattern or metacontrast (backward) masking do not appear to bar the progression of visual information at a low level. These ideas bear interesting similarities to existing conceptualizations of priming and masking, such as Direct Parameter Specification or the Rapid Chase theory.

Rapid and slow brain systems of abstract and concrete words differentiation

Previous studies have repeatedly found that late (300-800 ms) components of event-related potentials (ERP) reflected semantic analysis, i.e. the differentiation between abstract and concrete words. However, the human brain may detect the meaning of the words much earlier. This study investigated the brain mechanisms of the processing of abstract and concrete written words in four experimental conditions: i) Simple Reading, during which volunteers were required to silently read words; ii) Simple Classification, during which volunteers were required to classify the presented word into the abstract and concrete categories; and iii) Cued and iv) Uncued Selective Classification conditions, during which subjects had to classify only the words typed in a particular colour. 19-channel EEG was recorded during the experiment from 13 subjects. The ERP to abstract and concrete words differed not only at the late but also at early (40-100 ms) latencies in the Simple Reading and Classification conditions, as well as for the words that should not be explicitly classified in the Cued Selective Classification condition. This means that semantic analysis can occur in a manner which is both very rapid and implicit. Moreover, increasing task demands can even suppress this rapid semantic analysis. The functional microstate analysis revealed a topographical difference in response to abstract and concrete words, which indicated that at least partly distinct brain networks are involved in the processing of words during both early (implicit differentiation) and late (explicit classification) latencies.

The neural basis of visual body perception

The human body, like the human face, is a rich source of socially relevant information about other individuals. Evidence from studies of both humans and non-human primates points to focal regions of the higher-level visual cortex that are specialized for the visual perception of the body. These body-selective regions, which can be dissociated from regions involved in face perception, have been implicated in the perception of the self and the 'body schema', the perception of others' emotions and the understanding of actions.

Limits of Event-related Potential Differences in Tracking Object Processing Speed

We report results from two experiments in which subjects had to categorize briefly presented upright or inverted natural scenes. In the first experiment, subjects decided whether images contained animals or human faces presented at different scales. Behavioral results showed virtually identical processing speed between the two categories and very limited effects of inversion. One type of event-related potential (ERP) comparison, potentially capturing low-level physical differences, showed large effects with onsets at about 150 msec in the animal task. However, in the human face task, those differences started as early as 100 msec. In the second experiment, subjects responded to close-up views of animal faces or human faces in an attempt to limit physical differences between image sets. This manipulation almost completely eliminated small differences before 100 msec in both tasks. But again, despite very similar behavioral performances and short reaction times in both tasks, human faces were associated with earlier ERP differences compared with animal faces. Finally, in both experiments, as an alternative way to determine processing speed, we compared the ERP with the same images when seen as targets and nontargets in different tasks. Surprisingly, all task-dependent ERP differences had relatively long latencies. We conclude that task-dependent ERP differences fail to capture object processing speed, at least for some categories like faces. We discuss models of object processing that might explain our results, as well as alternative approaches.

Boundary completion is automatic and dissociable from shape discrimination

Normal visual perception readily overcomes suboptimal or degraded viewing conditions through perceptual filling-in processes, enhancing object recognition and discrimination abilities. This study used visual evoked potential (VEP) recordings in conjunction with electrical neuroimaging analyses to determine the spatiotemporal brain dynamics of boundary completion and shape discrimination processes in healthy humans performing the so-called "thin/fat" discrimination task (Ringach and Shapley, 1996) with stimuli producing illusory contours. First, results suggest that boundary completion processes occur independent of subjects' accuracy on the discrimination task. Modulation of the VEP to the presence versus absence of illusory contours [the IC effect (Murray et al., 2002)] was indistinguishable in terms of response magnitude and scalp topography over the 124-186 ms poststimulus period, regardless of whether task performance was correct. This suggests that failure on this discrimination task is not primarily a consequence of failed boundary completion. Second, the electrophysiological correlates of thin/fat shape discrimination processes are temporally dissociable from those of boundary completion, occurring during a substantially later phase of processing (approximately 330-406 ms). The earlier IC effect was unaffected by whether the perceived contour produced a thin or fat shape. In contrast, later time periods of the VEP modulated according to perceived shape only in the case of stimuli producing illusory contours, but not for control stimuli for which performance was at near-chance levels. Collectively, these data provide further support for a multistage model of object processing under degraded viewing conditions.

An event-related potential component sensitive to images of the human body

One of the critical functions of vision is to provide information about other individuals. Neuroimaging experiments examining the cortical regions that analyze the appearance of other people have found partially overlapping networks that respond selectively to human faces and bodies. In event-related potential (ERP) studies, faces systematically elicit a negative component peaking 170 ms after presentation - the N170. To characterize the electrophysiological response to human bodies, we compared the ERPs elicited by faces, bodies and various control stimuli. In Experiment 1, a comparison of ERPs elicited by faces, bodies, objects and places showed that pictures of the human body (without the head) elicit a negative component peaking at 190 ms (an N190). While broadly similar to the N170, the N190 differs in both spatial distribution and amplitude from the N1 components elicited by faces, objects and scenes and peaks significantly later than the N170. The difference between N190 and N170 was further supported using topographic analyses of ERPs and source localization techniques. A unique, stable map topography was found to characterize human bodies between 130 and 230 ms. In Experiment 2, we tested the four conditions from Experiment 1, as well as intact and scrambled silhouettes and stick figures of the human body. We found that intact silhouettes and stick figures elicited significantly greater N190 amplitudes than their scrambled counterparts. Thus, the N190 generalizes to some degree to schematic depictions of the human form. Overall, our findings are consistent with intertwined, but functionally distinct, neural representations of the human face and body.

Behavioral and physiological findings of gender differences in global-local visual processing

Hemispheric asymmetries in global-local visual processing are well-established, as are gender differences in cognition. Although hemispheric asymmetry presumably underlies gender differences in cognition, the literature on gender differences in global-local processing is sparse. We employed event related brain potential (ERP) recordings during performance of a global-local reaction time task to compare hemispheric asymmetries and processing biases in adult men (n=15) and women (n=15). Women responded more quickly to local targets while men did not differentially respond to hierarchical stimuli. ERP data indicated that women had P100 responses that were selectively lateralized to the left hemisphere in response to local targets and N150 responses that were smaller for global targets. They also had P300 responses that were greater following local stimuli. The physiological data demonstrate that male-female performance differences arise from biologically based differences in hemispheric asymmetry. Findings are discussed in the context of existing literature regarding gender differences, hemispheric specialization, and the role of stimulus characteristics.

Rapid brain discrimination of sounds of objects

Electrical neuroimaging in humans identified the speed and spatiotemporal brain mechanism whereby sounds of living and man-made objects are discriminated. Subjects performed an "oddball" target detection task, selectively responding to sounds of either living or man-made objects on alternating blocks, which were controlled for in their spectrogram and harmonics-to-noise ratios between categories. Analyses were conducted on 64-channel auditory evoked potentials (AEPs) from nontarget trials. Comparing responses to sounds of living versus man-made objects, these analyses tested for modulations in local AEP waveforms, global response strength, and the topography of the electric field at the scalp. In addition, the local autoregressive average distributed linear inverse solution was applied to periods of observed modulations. Just 70 ms after stimulus onset, a common network of brain regions within the auditory "what" processing stream responded more strongly to sounds of man-made versus living objects, with differential activity within the right temporal and left inferior frontal cortices. Over the 155-257 ms period, the duration of activity of a brain network, including bilateral temporal and premotor cortices, differed between categories of sounds. Responses to sounds of living objects peaked approximately 12 ms later and the activity of the brain network active over this period was prolonged relative to that in response to sounds of man-made objects. The earliest task-related effects were observed at approximately 100 ms poststimulus onset, placing an upper limit on the speed of cortical auditory object discrimination. These results provide critical temporal constraints on human auditory object recognition and semantic discrimination processes.

Ultra-rapid object detection with saccadic eye movements: visual processing speed revisited

Previous ultra-rapid go/no-go categorization studies with manual responses have demonstrated the remarkable speed and efficiency with which humans process natural scenes. Using a forced-choice saccade task we show here that when two scenes are simultaneously flashed in the left and right hemifields, human participants can reliably make saccades to the side containing an animal in as little as 120 ms. Low level differences between target and distractor images were unable to account for these exceptionally fast responses. The results suggest a very fast and unexpected route linking visual processing in the ventral stream with the programming of saccadic eye movements.

Electrical neuroimaging reveals early generator modulation to emotional words

Functional electrical neuroimaging investigated incidental emotional word processing. Previous research suggests that the brain may differentially respond to the emotional content of linguistic stimuli pre-lexically (i.e., before distinguishing that these stimuli are words). We investigated the spatiotemporal brain mechanisms of this apparent paradox and in particular whether the initial differentiation of emotional stimuli is marked by different brain generator configurations using high-density, event-related potentials. Such would support the existence of specific cerebral resources dedicated to emotional word processing. A related issue concerns the possibility of right-hemispheric specialization in the processing of emotional stimuli. Thirteen healthy men performed a go/no-go lexical decision task with bilateral word/non-word or non-word/non-word stimulus pairs. Words included equal numbers of neutral and emotional stimuli, but subjects made no explicit discrimination along this dimension. Emotional words appearing in the right visual field (ERVF) yielded the best overall performance, although the difference between emotional and neutral words was larger for left than for right visual field presentations. Electrophysiologically, ERVF presentations were distinguished from all other conditions over the 100-140 ms period by a distinct scalp topography, indicative of different intracranial generator configurations. A distributed linear source estimation (LAURA) of this distinct scalp potential field revealed bilateral lateral-occipital sources with a right hemisphere current density maximum. These data support the existence of a specialized brain network triggered by the emotional connotation of words at a very early processing stage.

Rapid discrimination of visual and multisensory memories revealed by electrical neuroimaging

Though commonly held that multisensory experiences enrich our memories and that memories influence ongoing sensory processes, their neural mechanisms remain unresolved. Here, electrical neuroimaging shows that auditory-visual multisensory experiences alter subsequent processing of unisensory visual stimuli during the same block of trials at early stages poststimulus onset and within visual object recognition areas. We show this with a stepwise analysis of scalp-recorded event-related potentials (ERPs) that statistically tested (1) ERP morphology and amplitude, (2) global electric field power, (3) topographic stability of and changes in the electric field configuration, and (4) intracranial distributed linear source estimations. Subjects performed a continuous recognition task, discriminating repeated vs. initial image presentations. Corresponding, but task-irrelevant, sounds accompanied half of the initial presentations during a given block of trials. On repeated presentations within a block of trials, only images appeared, yielding two situations-the image's prior presentation was only visual or with a sound. Image repetitions that had been accompanied by sounds yielded improved memory performance accuracy (old or new discrimination) and were differentiated as early as approximately 60-136 ms from images that had not been accompanied by sounds through generator changes in areas of the right lateral-occipital complex (LOC). It thus appears that unisensory percepts trigger multisensory representations associated with them. The collective data support the hypothesis that perceptual or memory traces for multisensory auditory-visual events involve a distinct cortical network that is rapidly activated by subsequent repetition of just the unisensory visual component.

Electrophysiological Correlates of Age and Gender Perception on Human Faces

In a previous experiment using scalp event-related potentials (ERPs), we have described the neuroelectric activities associated with the processing of gender information on human faces (Mouchetant-Rostaing, Giard, Bentin, Aguera, & Pernier, 2000). Here we extend this study by examining the processing of age on faces using a similar experimental paradigm, and we compare age and gender processing. In one session, faces were of the same gender (women) and of one age range (young or old), to reduce gender and age processing. In a second session, faces of young and old women were randomly intermixed but age was irrelevant for the task, hence, age discrimination, if any, was assumed to be incidental. In the third and fourth sessions, faces had to be explicitly categorized according to their age or gender, respectively (intentional discrimination). Neither age nor gender processing affected the occipito-temporal N170 component often associated with the detection of physiognomic features and global structural encoding of faces. Rather, the three age and gender discrimination conditions induced similar fronto-central activities around 145–185 msec. In our previous experiment, this ERP pattern was also found for implicit and explicit categorization of gender from faces but not in a control condition manipulating hand stimuli (Mouchetant-Rostaing, Giard, Bentin, et al., 2000). Whatever their exact nature, these 145–185 msec effects therefore suggest, first, that similar mechanisms could be engaged in age and gender perception, and second, that age and gender may be implicitly processed irrespective of their relevance to the task, through somewhat specialized mechanisms. Additional ERP effects were found at early latencies (45–90 msec) in all three discrimination conditions, and around 200–400 msec during explicit age and gender discrimination. These effects have been previously found in control conditions manipulating nonfacial stimuli and may therefore be related to more general categorization processes.

Non-spatial attentional effects on P1

OBJECTIVE

It has been suggested that P1, the earliest endogenous visual potential, is influenced primarily by spatial location. However, we have found that attention to non-spatial visual features can affect both the latency and amplitude of this component.

METHODS

A series of studies are reviewed, starting with 4 using simple geometric forms, and either serial presentation of single stimuli or presentation of stimulus arrays followed by two studies using natural complex images.

RESULTS

With simple stimuli, latency and amplitude effects are seen on the P1, but differ among the paradigms, depending on the demands of the task. The data further showed a facilitation effect and that binding occurs in parallel with single feature processing. For complex stimuli we found P1 shorter to faces than inverted faces, eyes or non-face stimuli, and larger to animal than non-animal pictures. The above effects were present in children as well as in adults.

CONCLUSIONS

These findings demonstrate that very early stages of processing can be modified by top-down attentional influences across a range of ages and experimental paradigms, concordant with visual processing models showing very rapid and dispersed activation with feedback at early cortical levels.

Binding occurs at early stages of processing in children and adults

Conjoining features in a high-rate serial presentation was studied in children and adults using event-related potentials. Three blocks of trials were run in which targets were defined by colour, by orientation or by a conjunction of colour and orientation. Only adults had faster RTs when detecting targets defined by a single feature than by a combination of features. Compared with adults, children had longer RTs, longer N1 and P2 latencies, and larger P1 and P2 amplitudes. Amplitudes asymmetries were consistent with differing cortical regions being implicated in the processing of colour and form. There were, however, no ERP latency effects as a function of task, suggesting that the binding of features proceeds in parallel with the processing of single features.