The representation of shape in the context of visual object categorization tasks

Superordinate Categorization Based on the Perceptual Organization of Parts

Plants and animals are among the most behaviorally significant superordinate categories for humans. Visually assigning objects to such high-level classes is challenging because highly distinct items must be grouped together (e.g., chimpanzees and geckos) while more similar items must sometimes be separated (e.g., stick insects and twigs). As both animals and plants typically possess complex multi-limbed shapes, the perceptual organization of shape into parts likely plays a crucial rule in identifying them. Here, we identify a number of distinctive growth characteristics that affect the spatial arrangement and properties of limbs, yielding useful cues for differentiating plants from animals. We developed a novel algorithm based on shape skeletons to create many novel object pairs that differ in their part structure but are otherwise very similar. We found that particular part organizations cause stimuli to look systematically more like plants or animals. We then generated other 110 sequences of shapes morphing from animal- to plant-like appearance by modifying three aspects of part structure: sprouting parts, curvedness of parts, and symmetry of part pairs. We found that all three parameters correlated strongly with human animal/plant judgments. Together our findings suggest that subtle changes in the properties and organization of parts can provide powerful cues in superordinate categorization.

Finding the neural correlates of collaboration using a three-person fMRI hyperscanning paradigm

Humans have an extraordinary ability to interact and cooperate with others. Despite the social and evolutionary significance of collaboration, research on finding its neural correlates has been limited partly due to restrictions on the simultaneous neuroimaging of more than one participant (also known as hyperscanning). Several studies have used dyadic fMRI hyperscanning to examine the interaction between two participants. However, to our knowledge, no study to date has aimed at revealing the neural correlates of social interactions using a three-person (or triadic) fMRI hyperscanning paradigm. Here, we simultaneously measured the blood-oxygenation level-dependent signal from 12 triads (n = 36 participants), while they engaged in a collaborative drawing task based on the social game of Pictionary General linear model analysis revealed increased activation in the brain regions previously linked with the theory of mind during the collaborative phase compared to the independent phase of the task. Furthermore, using intersubject correlation analysis, we revealed increased synchronization of the right temporo-parietal junction (R TPJ) during the collaborative phase. The increased synchrony in the R TPJ was observed to be positively associated with the overall team performance on the task. In sum, our paradigm revealed a vital role of the R TPJ among other theory-of-mind regions during a triadic collaborative drawing task.

Functional modulation of contralateral bias in early and object-selective areas after stroke of the occipital ventral cortices

Object agnosia is a rare symptom, occurring mainly after bilateral damage of the ventral visual cortex. Most patients suffering from unilateral ventral lesions are clinically non-agnosic. Here, we studied the effect of unilateral occipito-temporal lesions on object categorization and its underlying neural correlates in visual areas. Thirteen non-agnosic stroke patients and twelve control subjects performed an event-related rapid object categorization task in the fMRI scanner where images were presented either to the left or to the right of a fixed point. Eight patients had intact central visual fields within at least 10° eccentricity while five patients showed an incomplete hemianopia. Patients made more errors than controls for both contra- and ipsilesional presentation, meaning that object categorization was impaired bilaterally in both patient groups. The activity in cortical visual areas is usually higher when a stimulus is presented contralaterally compared to presented ipsilaterally (contralateral bias). A region of interest analysis of early visual (V1-V4) and object-selective areas (lateral occipital complex, LOC; fusiform face area, FFA; and parahippocampal place area, PPA) revealed that the lesioned-hemisphere of patients showed reduced contralateral bias in early visual areas and LOC. In contrast, literally no contralateral bias in FFA and PPA was found. These findings indicate disturbed processing in the lesioned hemisphere, which might be related to the processing of visually presented objects. Thus, unilateral occipito-temporal damage leads to altered contralateral bias in the lesioned hemisphere, which might be the cause of impaired categorization performance in both visual hemifields in clinically non-agnosic patients. We conclude that both hemispheres need to be functionally intact for unimpaired object processing.

Neuronal substrates characterizing two stages in visual object recognition

Visual object recognition is classically believed to involve two stages: a perception stage in which perceptual information is integrated, and a memory stage in which perceptual information is matched with an object's representation. The transition from the perception to the memory stage can be slowed to allow for neuroanatomical segregation using a degraded visual stimuli (DVS) task in which images are first presented at low spatial resolution and then gradually sharpened. In this functional magnetic resonance imaging study, we characterized these two stages using a DVS task based on the classic model. To separate periods that are assumed to dominate the perception, memory, and post-recognition stages, subjects responded once when they could guess the identity of the object in the image and a second time when they were certain of the identity. Activation of the right medial occipitotemporal region and the posterior part of the rostral medial frontal cortex was found to be characteristic of the perception and memory stages, respectively. Although the known role of the former region in perceptual integration was consistent with the classic model, a likely role of the latter region in monitoring for confirmation of recognition suggests the advantage of recently proposed interactive models.

Feature diagnosticity affects representations of novel and familiar objects

Many features can describe a concept, but only some features define a concept in that they enable discrimination of items that are instances of a concept from (similar) items that are not. We refer to this property of some features as feature diagnosticity. Previous work has described the behavioral effects of feature diagnosticity, but there has been little work on explaining why and how these effects arise. In this study, we aimed to understand the impact of feature diagnosticity on concept representations across two complementary experiments. In Experiment 1, we manipulated the diagnosticity of one feature, color, for a set of novel objects that human participants learned over the course of 1 week. We report behavioral and neural evidence that diagnostic features are likely to be automatically recruited during remembering. Specifically, individuals activated color-selective regions of ventral temporal cortex (specifically, left fusiform gyrus and left inferior temporal gyrus) when thinking about the novel objects, although color information was never explicitly probed during the task. Moreover, multiple behavioral and neural measures of the effects of feature diagnosticity were correlated across participants. In Experiment 2, we examined relative color association in familiar object categories, which varied in feature diagnosticity (fruits and vegetables, household items). Taken together, these results offer novel insights into the neural mechanisms underlying concept representations by demonstrating that automatic recruitment of diagnostic information gives rise to behavioral effects of feature diagnosticity.

Action relationships concatenate representations of separate objects in the ventral visual system

Objects in the real world are encountered in contexts where they interact together. Though it is known that neurons in the ventral visual stream mediate the recognition of individual objects, we have minimal knowledge of how multiple objects are processed at a neural level. We examined the neural response to pairs of objects using functional magnetic resonance imaging (fMRI). Objects positioned to interact together activated bilateral lateral occipital complex (LOC) and fusiform gyrus. This occurred irrespective of whether the objects were attended. In LOC, the effect of positioning objects for action was found regardless of whether the objects formed a familiar or unfamiliar action pair. In the fusiform gyrus activation was found when objects formed a familiar action pair. No changes were apparent in visuomotor (premotor and parietal) regions which might reflect a motor-based response to objects. These results show that ventral-stream regions respond to the interaction between objects, as well as to the sensory and functional properties of individual objects.

Effects of age and sex on developmental neural networks of visual-spatial attention allocation

Compared to our understanding of the functional maturation of brain networks underlying complex cognitive abilities, hardly anything is known of the neurofunctional development of simpler cognitive abilities such as visuo-spatial attention allocation. Furthermore, nothing is known on the effect of gender on the functional development of attention allocation. This study employed event related functional magnetic resonance imaging to investigate effects of age, sex, and sex by age interactions on the brain activation of 63 males and females, between 13 to 38years, during a visual-spatial oddball task. Behaviourally, with increasing age, speed was traded for accuracy, indicative of a less impulsive performance style in older subjects. Increasing age was associated with progressively increased activation in typical areas of selective attention of lateral fronto-striatal and temporo-parietal brain regions. Sex difference analysis showed enhanced activation in right-hemispheric inferior frontal and superior temporal regions in females, and in left-hemispheric inferior temporo-parietal regions in males. Importantly, the age by sex interaction findings showed that these sex-dimorphic patterns of brain activation may be the result of underlying sex differences in the functional maturation of these brain regions, as females had sex-specific progressive age-correlations in the same right inferior fronto-striato-temporal areas, while male-specific age-correlations were in left medial temporal and parietal areas. The findings demonstrate progressive functional maturation of fronto-striato-parieto-temporal networks of the relatively simple function of attention allocation between early adolescence and mid-adulthood. They furthermore show that sex-dimorphic patterns of enhanced reliance on right inferior frontal, striatal and superior temporal regions in females and of left temporo-parietal regions in males during attention allocation may be the result of underlying sex differences in the functional maturation of these brain regions.

When a Picasso is a "Picasso": the entry point in the identification of visual art

We investigated whether art is distinguished from other real world objects in human cognition, in that art allows for a special memorial representation and identification based on artists' specific stylistic appearances. Testing art-experienced viewers, converging empirical evidence from three experiments, which have proved sensitive to addressing the question of initial object recognition, suggest that identification of visual art is at the subordinate level of the producing artist. Specifically, in a free naming task it was found that art-objects as opposed to non-art-objects were most frequently named with subordinate level categories, with the artist's name as the most frequent category (Experiment 1). In a category-verification task (Experiment 2), art-objects were recognized faster than non-art-objects on the subordinate level with the artist's name. In a conceptual priming task, subordinate primes of artists' names facilitated matching responses to art-objects but subordinate primes did not facilitate responses to non-art-objects (Experiment 3). Collectively, these results suggest that the artist's name has a special status in the memorial representation of visual art and serves as a predominant entry point in recognition in art perception.

Beyond shape: how you learn about objects affects how they are represented in visual cortex

BACKGROUND

Experience can alter how objects are represented in the visual cortex. But experience can take different forms. It is unknown whether the kind of visual experience systematically alters the nature of visual cortical object representations.

METHODOLOGY/PRINCIPAL FINDINGS

We take advantage of different training regimens found to produce qualitatively different types of perceptual expertise behaviorally in order to contrast the neural changes that follow different kinds of visual experience with the same objects. Two groups of participants went through training regimens that required either subordinate-level individuation or basic-level categorization of a set of novel, artificial objects, called "Ziggerins". fMRI activity of a region in the right fusiform gyrus increased after individuation training and was correlated with the magnitude of configural processing of the Ziggerins observed behaviorally. In contrast, categorization training caused distributed changes, with increased activity in the medial portion of the ventral occipito-temporal cortex relative to more lateral areas.

CONCLUSIONS/SIGNIFICANCE

Our results demonstrate that the kind of experience with a category of objects can systematically influence how those objects are represented in visual cortex. The demands of prior learning experience therefore appear to be one factor determining the organization of activity patterns in visual cortex.

Similarity, typicality, and category-level matching of morphed outlines of everyday objects

During visual object categorisation, a match must be found between the input image and stored information about basic-level categories. Graf [2002 Form, Space and Object (Berlin: Wissenschaftlicher Verlag Berlin)] suggested the involvement of analogue transformational, shape-changing processes in aligning the memory representation of the category with the perceptual representation of the current stimulus. Here we compare the predictions of alignment models with those of exemplar-based models, using morphing between four exemplar outlines within each of eleven categories. Overall, with increasing transformational distance between two exemplars of the same category, reaction times to decide whether they belong to the same category in a sequential matching paradigm increased, while rated similarity between the two exemplars decreased. However, in contrast to alignment accounts, exemplar-based accounts can correctly predict the observed dissociation between typicality and categorisation time, and allow the observed deviations from sequential additivity and nonlinear relations between transformational distance and rated similarity. Discussion of integrations of exemplar-based theories with neglected processes, such as information accumulation, response competition, response priming, and gain-modulation leads to a view of the recognition process from input to response, which increases the validity and scope of modern exemplar-based categorisation and recognition models.

Cortical connections between dorsal and ventral visual streams in humans: Evidence by TMS/EEG co-registration

Parietal cortex subserves various cognitive tasks, ranging from attention to visuo-motor skills. It is part of a parieto-frontal network involved in attention, and part of the visual dorsal stream, opposed to the visual ventral stream, although increasing evidence suggests interchange of information between them. In this study, co-registration of Transcranial Magnetic Stimulation (TMS) and Electroencephalographic activity (EEG) has been used to investigate the spreading of cortical connections from the parietal cortex in healthy volunteers. TMS on the left parietal cortex activated a network of prefrontal regions in the contra-lateral hemisphere in a time range of 102-167 ms after the stimulus. Moreover, activation in the ipsi-lateral middle temporal and fusiform gyri was observed at 171-177 ms after delivery of TMS. Findings suggest the existence of late driven connections between parietal and prefrontal regions that could partially represent the neural pathway related to attention, even if, in this experiment, no attentional processing was requested. Late connections between dorsal and ventral streams were also evident, confirming previous evidence about interchange of information between them. Conclusively, the present investigation confirms that a great amount of information spreads from parietal cortex to different regions in the brain, supporting the idea that connections are more complex and articulated than those proposed. Present findings also suggest that the simultaneous recording of EEG during the application of TMS is a promising tool for the study of connections in the brain.

Subordinate Categorization Enhances the Neural Selectivity in Human Object-selective Cortex for Fine Shape Differences

There is substantial evidence that object representations in adults are dynamically updated by learning. However, it is not clear to what extent these effects are induced by active processing of visual objects in a particular task context on top of the effects of mere exposure to the same objects. Here we show that the task does matter. We performed an event-related fMRI adaptation study in which we derived neural selectivity from a release of adaptation. We had two training conditions: “categorized objects” were categorized at a subordinate level based on fine shape differences (Which type of fish is this?), whereas “control objects” were seen equally often in a task context requiring no subordinate categorization (Is this a vase or not?). After training, the object-selective cortex was more selective for differences among categorized objects than for differences among control objects. This result indicates that the task context during training modulates the extent to which object selectivity is enhanced as a result of training.

Mid-fusiform activation during object discrimination reflects the process of differentiating structural descriptions

The present study explored constraints on mid-fusiform activation during object discrimination. In three experiments, participants performed a matching task on simple line configurations, nameable objects, three dimensional (3-D) shapes, and colors. Significant bilateral mid-fusiform activation emerged when participants matched objects and 3-D shapes, as compared to when they matched two-dimensional (2-D) line configurations and colors, indicating that the mid-fusiform is engaged more strongly for processing structural descriptions (e.g., comparing 3-D volumetric shape) than perceptual descriptions (e.g., comparing 2-D or color information). In two of the experiments, the same mid-fusiform regions were also modulated by the degree of structural similarity between stimuli, implicating a role for the mid-fusiform in fine differentiation of similar visual object representations. Importantly, however, this process of fine differentiation occurred at the level of structural, but not perceptual, descriptions. Moreover, mid-fusiform activity was more robust when participants matched shape compared to color information using the identical stimuli, indicating that activity in the mid-fusiform gyrus is not driven by specific stimulus properties, but rather by the process of distinguishing stimuli based on shape information. Taken together, these findings further clarify the nature of object processing in the mid-fusiform gyrus. This region is engaged specifically in structural differentiation, a critical component process of object recognition and categorization.

Identification of everyday objects on the basis of silhouette and outline versions

Line drawings of everyday objects were modified into silhouettes by filling-in the complete area enclosed by boundary contours, and outline versions were created by extracting the contours from the silhouettes. A large number of participants was asked to try to identify these silhouette and outline versions in experiment 1. Identifiability ranged from 0% to 100% correct responses with a large range in-between. Several kinds of errors and several reasons for difficulties with identification emerged in our data set. In experiment 2, we compared the original identification rates to those of inverted silhouettes (white figures on a black background), and in experiment 3 we compared the original identification rates of objects with filled-in holes or background parts to those of versions without filling-in. These stimuli and identification norms are useful for additional research on priming and context effects of object identification, neuropsychological deficits of object identification, and all kinds of studies with silhouettes where the role of top down knowledge could be of interest.

High-frequency oscillations in distributed neural networks reveal the dynamics of human decision making

We examine the relative timing of numerous brain regions involved in human decisions that are based on external criteria, learned information, personal preferences, or unconstrained internal considerations. Using magnetoencephalography (MEG) and advanced signal analysis techniques, we were able to non-invasively reconstruct oscillations of distributed neural networks in the high-gamma frequency band (60–150 Hz). The time course of the observed neural activity suggested that two-alternative forced choice tasks are processed in four overlapping stages: processing of sensory input, option evaluation, intention formation, and action execution. Visual areas are activated first, and show recurring activations throughout the entire decision process. The temporo-occipital junction and the intraparietal sulcus are active during evaluation of external values of the options, 250–500 ms after stimulus presentation. Simultaneously, personal preference is mediated by cortical midline structures. Subsequently, the posterior parietal and superior occipital cortices appear to encode intention, with different subregions being responsible for different types of choice. The cerebellum and inferior parietal cortex are recruited for internal generation of decisions and actions, when all options have the same value. Action execution was accompanied by activation peaks in the contralateral motor cortex. These results suggest that high-gamma oscillations as recorded by MEG allow a reliable reconstruction of decision processes with excellent spatiotemporal resolution.

Object memory and change detection: dissociation as a function of visual and conceptual similarity

People often fail to detect a change between two visual scenes, a phenomenon referred to as change blindness. This study investigates how a post-change object's similarity to the pre-change object influences memory of the pre-change object and affects change detection. The results of Experiment 1 showed that similarity lowered detection sensitivity but did not affect the speed of identifying the pre-change object, suggesting that similarity between the pre- and post-change objects does not degrade the pre-change representation. Identification speed for the pre-change object was faster than naming the new object regardless of detection accuracy. Similarity also decreased detection sensitivity in Experiment 2 but improved the recognition of the pre-change object under both correct detection and detection failure. The similarity effect on recognition was greatly reduced when 20% of each pre-change stimulus was masked by random dots in Experiment 3. Together the results suggest that the level of pre-change representation under detection failure is equivalent to the level under correct detection and that the pre-change representation is almost complete. Similarity lowers detection sensitivity but improves explicit access in recognition. Dissociation arises between recognition and change detection as the two judgments rely on the match-to-mismatch signal and mismatch-to-match signal, respectively.

Implicit identification of irrelevant local objects interacts with global/local processing of hierarchical stimuli

This work aimed at studying interactions between automatic object identification and global/local perceptual processing. We designed a paradigm in which participants were presented with pairs of hierarchically organized items, composed of global forms made up of local forms. Both global and local forms could represent either objects or non-objects. Subjects were instructed to detect whether the two hierarchical items composing a pair were identical or different. In a dissimilar pair, items differed at one level (target level), the other level, made of similar forms on both sides, was irrelevant to perform the task. We hypothesized that the automatic identification of object could affect the global precedence principle defined by Navon. In agreement with our hypothesis, we found that when the irrelevant level was made of objects, the global precedence effect was reversed. In contrast, the irrelevant level had no effect when the target level included only objects, or when the irrelevant level was made of non-object, the global precedence principle was being preserved in these cases. This interaction is compatible with the existence of two distinct processes working in parallel, namely automatic identification and structural analysis, that could either interfere or act together for the detection of differences.

Shape configuration and category-specificity

We examined the neural correlates of visual shape configuration, the binding of local shape characteristics into wholistic object descriptions, by comparing the regional cerebral blood flow associated with recognition of outline drawings and fragmented drawings. We found no areas that responded more to fragmented drawings than to outline drawings even though fragmentation had a clear impact on recognition performance. Instead, a region extending from the inferior occipital gyri to the middle parts of the fusiform gyri was activated during shape configuration of both outline drawings and fragmented drawings. We also examined whether fragmentation had different impact on the recognition of natural objects and artefacts and found that recognition of artefacts was more affected by fragmentation than recognition of natural objects. Thus, the usual finding of an advantage for artefacts in difficult object decision tasks, which is also found in the present experiments with outlines, is reversed when the stimuli are fragmented. This interaction between category (natural versus artefacts) and stimulus type (outlines versus fragmented forms) is in accordance with predictions derived from a recent account of category-specificity and lends support to the notion that category-specific impairments can occur for both natural objects and artefacts following damage to pre-semantic stages in visual object recognition. The implications of the present findings are discussed in relation to theories of perceptual organization, visual object recognition and category-specificity.

Spatiotemporal dynamics of human object recognition processing: an integrated high-density electrical mapping and functional imaging study of "closure" processes

Humans are capable of recognizing objects, often despite highly adverse viewing conditions (e.g., occlusion). The term "perceptual closure" has been used to refer to the neural processes responsible for "filling-in" missing information in the visual image under such conditions. Closure phenomena have been linked to a group of object recognition areas, the so-called lateral-occipital complex (LOC). Here, we investigated the spatiotemporal dynamics of perceptual closure processes by coregistering data from high-density electrical recordings (ERPs) and functional magnetic resonance imaging (fMRI) while subjects participated in a perceptual closure task. Subjects were presented with highly fragmented images and control scrambled images. Fragmented images were calibrated to be 'just' recognizable as objects (that is, perceptual closure was necessary), whereas the scrambled images were unrecognizable. Comparison of responses to these two stimulus classes revealed the neural processes underlying perceptual closure. fMRI revealed an object recognition system that mediates these closure processes, the core of which consists of the LOC regions. ERP recordings resulted in the well-characterized N(CL) component (for negativity associated with closure), a robust relative negativity over bilateral occipito-temporal scalp that occurs in the 230-400 ms timeframe. Our investigations further revealed an extended network of dorsal and frontal regions, also involved in perceptual closure processes. Inverse source analysis showed that the major generators of N(CL) localized to the identical regions within LOC revealed by the fMRI recordings and detailed the temporal dynamics across these LOC regions including interactions between LOC and these other nodes of the object recognition circuit.

Estimation of temporary change of activation areas by moving an analysis time window in fMRI measurement

In this paper, we propose a method to acquire temporal changes of activations by moving an analysis time window. An advantage of this method is that it can acquire rough changes of activated areas even with the data having low time resolution. We ascertained that activations from our method do not contradict previous reports on the oddball paradigm, thus showing its effectiveness. Eight normal subjects participated in the study, which consisted of a random series of 30 target and 70 nontarget stimuli. We investigated the activated area in three kinds of analysis time sections, from stimulus onset to 5 s after the stimulus (time section A), from 2 to 7 s after (B) and from 4 to 9 s after (C). In time section A, representative activated areas were regions including the left and supplementary motor areas (SMA), and cerebellum. In B, regions including the left motor area and SMA, right parahippocampal gyrus (Broadmann Area (BA) 30), right limbic lobe and cerebellum were activated. In C, bilaterally postcentral gyrus (BA 3,40), right anterior cingulate (ACC, BA 32), left middle frontal gyrus (BA 9) and right parahippocampal gyrus were activated. Most activations were consistent with previous studies.

Anatomy and time course of discrimination and categorization processes in vision: an fMRI study

Studies investigating the cerebral areas involved in visual processes generally oppose either different tasks or different stimulus types. This work addresses, by fMRI, the interaction between the type of task (discrimination vs. categorization) and the type of stimulus (Latin letters, well-known geometrical figures, and Korean letters). Behavioral data revealed that the two tasks did not differ in term of percentage of errors or correct responses, but a delay of 185 ms was observed for the categorization task in comparison with the discrimination task. All conditions activated a common neural network that includes both striate and extrastriate areas, especially the fusiform gyri, the precunei, the insulae, and the dorsolateral frontal cortex. In addition, interaction analysis revealed that the right insula was sensitive to both tasks and stimuli, and that stimulus type induced several significant signal variations for the categorization task in right frontal cortex, the right middle occipital gyrus, the right cuneus, and the left and right fusiform gyri, whereas for the discrimination task, significant signal variations were observed in the right occipito-parietal junction only. Finally, analyzing the latency of the BOLD signal also revealed a differential neural dynamics according to tasks but not to stimulus type. These temporal differences suggest a parallel hemisphere processing in the discrimination task vs. a cooperative interhemisphere processing in the categorization task that may reflect the observed differences in reaction time.

Cortical regions associated with different aspects of object recognition performance

In the present object recognition study, we examined the relationship between brain activation and four behavioral measures: error rate, reaction time, observer sensitivity, and response bias. Subjects perceptually matched object pairs in which structural similarity (SS), an index of structural differentiation, and exposure duration (DUR), an index of task difficulty, were manipulated. The SS manipulation affected the fMRI signal in the left anterior fusiform and parietal cortices, which in turn reflected a bias to respond same. Conversely, an SS-modulated fMRI signal in the right middle frontal gyrus reflected a bias to respond different. The DUR manipulation affected the fMRI signal in occipital and posterior fusiform regions, which in turn reflected greater sensitivity, longer reaction times, and greater accuracy. These findings demonstrate that the regions most strongly implicated in processing object shape (SS-modulated regions) are associated with response bias, whereas regions that are not directly involved in shape processing are associated with successful recognition performance.

Revisiting Snodgrass and Vanderwart's object pictorial set: the role of surface detail in basic-level object recognition

Theories of object recognition differ to the extent that they consider object representations as being mediated only by the shape of the object, or shape and surface details, if surface details are part of the representation. In particular, it has been suggested that color information may be helpful at recognizing objects only in very special cases, but not during basic-level object recognition in good viewing conditions. In this study, we collected normative data (naming agreement, familiarity, complexity, and imagery judgments) for Snodgrass and Vanderwart's object database of 260 black-and-white line drawings, and then compared the data to exactly the same shapes but with added gray-level texture and surface details (set 2), and color (set 3). Naming latencies were also recorded. Whereas the addition of texture and shading without color only slightly improved naming agreement scores for the objects, the addition of color information unambiguously improved naming accuracy and speeded correct response times. As shown in previous studies, the advantage provided by color was larger for objects with a diagnostic color, and structurally similar shapes, such as fruits and vegetables, but was also observed for man-made objects with and without a single diagnostic color. These observations show that basic-level 'everyday' object recognition in normal conditions is facilitated by the presence of color information, and support a 'shape + surface' model of object recognition, for which color is an integral part of the object representation. In addition, the new stimuli (sets 2 and 3) and the corresponding normative data provide valuable materials for a wide range of experimental and clinical studies of object recognition.

Behavioral and functional MRI study of attention shift in human verbal working memory

The tripartite model of memory proposed the requirement of attentional switching when accessing different items in working memory [J. Exp. Psychol. Learn. Mem. Cogn. 27 (2001) 817]. This internal focus of attention is limited to just one item and the switching process is time-consuming [Mem. Cogn. 26 (1998) 263]. In the current study, given a three-digit list stored in working memory, we found that it took longer to shift attention in the direction of "Upstream" than "Downstream", and that each shift was a "single step" process. To investigate the neural basis of this type of attention switching, we performed a functional MRI study. The results revealed that at least three important brain areas are involved, including the left dorsal lateral prefrontal cortex, the cingulate gyrus, and the medial occipital cortex. These areas all showed greater activation in the attention shift condition compared to control conditions of no (or decreased) attention shift requirements. In addition, the hemodynamic activities in these areas are highly correlated, suggesting a strong functional connectivity between them. Taken together with evidence from several recent investigations, our results suggest that these areas each play an important and specific role in collaboratively supporting the function of attention shift in working memory.

Do separate processes identify objects as exemplars versus members of basic-level categories? Evidence from hemispheric specialization

When an object is identified as a specific exemplar, is it analyzed differently than when it is identified at the basic level? On the basis of a previous theory, we predicted that the left hemisphere (LH) is specialized for classifying objects at the basic level and the right hemisphere (RH) is specialized for classifying objects as specific exemplars. To test this prediction, participants were asked to view lateralized pictures of animals, artifacts, and faces of famous people; immediately after each picture was presented, a label was read aloud by the computer, and the participants decided whether the label was correct for that picture. A label could name the object at either the basic level (e.g., bird) or as an exemplar (e.g., robin). As predicted, we found that basic-level labels were matched faster when pictures were presented in the right visual field (and hence encoded initially in the LH), whereas exemplar labels were matched faster when pictures were presented in the left visual field (and hence encoded initially in the RH).

Neural timing of visual implicit categorization

Most of the neuroimaging studies that have shown visual category-specific activations or categorization effects have been based on a subtractive approach. In the present study, we investigated, by means of EEG, not only the net result of the categorization but also the dynamics of the process. Subjects had to perform a target detection task throughout an image set of distractors belonging to six categories: letters, geometrical figures, faces, tools, structured textures and Asiatic characters. Multivariate analyses were performed on the responses to the non-target stimuli according to their category. Categorical neural responses were only obtained on P2 latencies and N2 amplitudes. This result suggests that there are no differences in the first stage of the implicit categorization of the distractors (visual analysis and proximal stimulus representation elaboration from 100 to 220 ms) and that differences appear between 220 and 280 ms (matching to structural representations). Over-learned stimuli (e.g. letters) elicited the shortest P2 latency, contrasting with unknown categories (e.g. Asiatic characters) that revealed the longest P2 latencies and flattened N2 waves. Categorical differences indicate that the more a subject knows about an object, the less cognitive resources are used. In conclusion, our results suggest that a reduction in neural activity could reflect an improved accuracy in cognitive and cortical processing.

Effects of structural similarity on neural substrates for object recognition

Human occipitotemporal cortex (OTC) is critically involved in object recognition, but the functional organization of this brain region is controversial. In the present study, functional magnetic resonance imaging (fMRI) signal changes were recorded in humans during an animal-matching task that parametrically varied degree of structural (i.e., shape) similarity among the items. fMRI signal in the mid- to anterior-fusiform gyrus increased as animals overlapped more in terms of structure and as reaction time increased. In contrast, relatively more posterior aspects of the fusiform gyrus and inferior occipital cortex showed greater fMRI signal when the animals overlapped less in terms of structure. A similar organization emerged when three-dimensional geometric shapes were matched, indicating that OTC is differentially tuned to varying degrees of overlap in object structure, regardless of taxonomic category. We discuss how the present findings fit in with current functional neuroanatomical approaches to object recognition.

What does visual agnosia tell us about perceptual organization and its relationship to object perception?

The authors studied 2 patients, S.M. and R.N., to examine perceptual organization and its relationship to object recognition. Both patients had normal, low-level vision and performed simple grouping operations normally but were unable to apprehend a multielement stimulus as a whole. R.N. failed to derive global structure even under optimal stimulus conditions, was less sensitive to grouping by closure, and was more impaired in object recognition than S.M. These findings suggest that perceptual organization involves a multiplicity of processes, some of which are simpler and are instantiated in lower order areas of visual cortex (e.g., collinearity). Other processes are more complex and rely on higher order visual areas (e.g., closure and shape formation). The failure to exploit these latter configural processes adversely affects object recognition.

Functional magnetic resonance imaging of brain activity in the visual oddball task

Abnormalities in the P300 ERP, elicited by the oddball task and measured using EEG, have been found in a number of central nervous system disorders including schizophrenia, Alzheimer's disease, and alcohol dependence. While electrophysiological studies provide high temporal resolution, localizing the P300 deficit has been particularly difficult because the measurements are collected from the scalp. Knowing which brain regions are involved in this process would elucidate the behavioral correlates of P300. The aim of this study was to determine the brain regions involved in a visual oddball task using fMRI. In this study, functional and high-resolution anatomical MR images were collected from seven normal volunteers. The data were analyzed using a randomization-based statistical method that accounts for multiple comparisons, requires no assumptions about the noise structure of the data, and does not require spatial or temporal smoothing. Activations were detected (P<0.01) bilaterally in the supramarginal gyrus (SMG; BA 40), superior parietal lobule (BA 7), the posterior cingulate gyrus, thalamus, inferior occipitotemporal cortex (BA 19/37), insula, dorsolateral prefrontal cortex (BA 9), anterior cingulate cortex (ACC), medial frontal gyrus (BA 6), premotor area, and cuneus (BA 17). Our results are consistent with previous studies that have observed activation in ACC and SMG. Activation of thalamus, insula, and the occipitotemporal cortex has been reported less consistently. The present study lends further support to the involvement of these structures in visual target detection.

Brain activity related to integrative processes in visual object recognition: bottom-up integration and the modulatory influence of stored knowledge

We report evidence from a PET activation study that the inferior occipital gyri (likely to include area V2) and the posterior parts of the fusiform and inferior temporal gyri are involved in the integration of visual elements into perceptual wholes (single objects). Of these areas, the fusiform and inferior temporal gyri were more activated by tasks with recognizable stimuli than by tasks with unrecognizable stimuli. We propose that the posterior parts of the fusiform and inferior temporal gyri, compared with the inferior occipital gyri, are involved in higher level integration, due to the involvement of re-entrant activation from stored structural knowledge. Evidence in favor of this interpretation comes from the additional finding that activation of the anterior part of the left fusiform gyrus and a more anterior part of the right inferior temporal gyrus, areas previously associated with access to stored structural knowledge, was found with recognizable stimuli, but not with unrecognizable stimuli. This latter finding also indicates: (i) that subjects may not refrain from (automatically) identifying objects even if they only have to attend to the objects' global shape, and (ii) that perceptual and memorial processes can be dissociated on both functional and anatomical grounds. No evidence was obtained for the involvement of the parietal lobes in the integration of single objects.

Visual object categorisation at distinct levels of abstraction: a new stimulus set

We designed a new stimulus set with 269 line drawings of everyday artifacts and animals. The stimulus set contains several typical exemplars from a sample of 25 basic-level categories. We determined to what extent these stimuli were named at the basic level and at a more subordinate level. An additional experiment showed the validity of this calibration: typicality ratings were correlated significantly with the level of naming. In a final experiment we found that this effect depends largely on the global configuration of a stimulus as it was still apparent with degraded images obtained by locally shifting small fragments of the drawings.

Event-related functional magnetic resonance imaging study of the extrastriate cortex response to a categorically ambiguous stimulus primed by letters and familiar geometric figures

Functional neuroimaging studies have suggested a specific role of the extrastriate cortex in letter string and visual word form processing. However, this region has been shown to be involved in object recognition and its specificity for the processing of linguistic stimuli may be questioned. The authors used an event-related functional magnetic resonance imaging design with category priming to record the response elicited by the passive viewing of single letters, geometric figures, and of the categorically ambiguous stimulus "O" that pertains to both sets of familiar symbols. Bilateral activations in the extrastriate cortex were found, with a left predominance particularly pronounced for the ambiguous stimulus. Individual analysis of spatial extent and signal intensity showed a priming x stimulus x hemisphere interaction. When primed by the congruous categoric set, a bilateral decrease in activation was observed for letters and geometric figures. The ambiguous stimulus behaved as a letter for the left hemisphere, with decreased activation when primed by letters, whereas in the right hemisphere, an adaptation effect occurred when primed by geometric figures. These priming effects suggest that, for the ambiguous stimulus, letter processing was systematically involved in the left extrastriate cortex. The current results support the existence of a neural substrate for the abstract category of letters.

The lateral occipital complex and its role in object recognition

Here we review recent findings that reveal the functional properties of extra-striate regions in the human visual cortex that are involved in the representation and perception of objects. We characterize both the invariant and non-invariant properties of these regions and we discuss the correlation between activation of these regions and recognition. Overall, these results indicate that the lateral occipital complex plays an important role in human object recognition.

Can neuroimaging really tell us what the human brain is doing? The relevance of indirect measures of population activity

Neuroimaging studies using positron emission tomography (PET) and functional magnetic resonance imaging (fMRI) give an indication towards the localization of mental representations and processes in the human brain. It is not clear to what extent such global measures of neuronal activity, pooling across large populations of neurons, can reveal how certain computations are implemented by the neurons in such population ('computational neuroimaging'). Population activity is related tightly to single-cell activity when all neurons in the population have similar response properties. We describe some evidence from single-cell recordings in monkeys that indicates that neurons with similar response properties are not scattered randomly throughout the visual cortex. Notwithstanding this clustering, populations of nearby neurons are still rather heterogeneous, requiring some prudence in deriving single-cell response properties from population activity. The following review of recent neuroimaging studies of the visual system describes to what degree inferences about computations and representations can be drawn from these studies.