The effect of distinctive parts on recognition of depth-rotated objects by pigeons (Columba livia) and humans

Visual Perception of Photographs of Rotated 3D Objects in Goldfish (Carassius auratus)

This study examined goldfishes’ ability to recognize photographs of rotated 3D objects. Six goldfish were presented with color photographs of a plastic model turtle and frog at 0° in a two-alternative forced-choice task. Fish were tested with stimuli at 0°, 90°, 180°, and 270° rotated in the picture plane and two depth planes. All six fish performed significantly above chance at all orientations in the three rotation planes tested. There was no significant difference in performance as a function of aspect angle, which supported viewpoint independence. However, fish were significantly faster at 180° than at +/−90°, so there is also evidence for viewpoint-dependent representations. These fish subjects performed worse overall in the current study with 2D color photographs (M = 88.0%) than they did in our previous study with 3D versions of the same turtle and frog stimuli (M = 92.6%), although they performed significantly better than goldfish in our two past studies presented with black and white 2D stimuli (M = 67.6% and 69.0%). The fish may have relied on color as a salient cue. This study was a first attempt at examining picture-object recognition in fish. More work is needed to determine the conditions under which fish succeed at object constancy tasks, as well as whether they are capable of perceiving photographs as representations of real-world objects.

Comparative spatial memory and cue use: The contributions of Marcia L. Spetch to the study of small-scale spatial cognition

Dr. Marcia Spetch is a Canadian experimental psychologist who specializes in the study of comparative cognition. Her research over the past four decades has covered many diverse topics, but focused primarily on the comparative study of small-scale spatial cognition, navigation, decision making, and risky choice. Over the course of her career Dr. Spetch has had a profound influence on the study of these topics, and for her work she was named a Fellow of the Association for Psychological Science in 2012, and a Fellow of the Royal Society of Canada in 2017. In this review, I provide a biographical sketch of Dr. Spetch's academic career, and revisit her contributions to the study of small-scale spatial cognition in two broad areas: the use of environmental geometric cues, and how animals cope with cue conflict. The goal of this review is to highlight the contributions of Dr. Spetch, her students, and her collaborators to the field of comparative cognition and the study of small-scale spatial cognition. As such, this review stands to serve as a tribute and testament to Dr. Spetch's scientific legacy.

The Role of Edges in Object Recognition by Pigeons

In three experiments, we explored how pigeons use edges, corresponding to orientation and depth discontinuities, in visual recognition tasks. In experiment 1, we compared the pigeon's ability to recognize line drawings of four different geons when trained with shaded images. The birds were trained with either a single view or five different views of each object. Because the five training views had markedly different appearances and locations of shaded surfaces, reflectance edges, etc, the pigeons might have been expected to rely more on the orientation and depth discontinuities that were preserved over rotation and in the line drawings. In neither condition, however, was there any transfer from the rendered images to the outline drawings. In experiment 2, some pigeons were trained with line drawings and shaded images of the same objects associated with the same response (consistent condition), whereas other pigeons were trained with a line drawing and a shaded image of two different objects associated with the same response (inconsistent condition). If the pigeons perceived any correspondence between the stimulus types, then birds in the consistent condition should have learned the discrimination more quickly than birds in the inconsistent condition. But, there was no difference in performance between birds in the consistent and inconsistent conditions. In experiment 3, we explored pigeons' processing of edges by comparing their discrimination of shaded images or line drawings of four objects. Once trained, the pigeons were tested with planar rotations of those objects. The pigeons exhibited different patterns of generalization depending on whether they were trained with line drawings or shaded images. The results of these three experiments suggest that pigeons may place greater importance on surface features indicating materials, such as food or water. Such substances do not have definite boundaries—cued by edges—which are thought to be central to human recognition.

Promoting rotational-invariance in object recognition despite experience with only a single view

Different processes are assumed to underlie invariant object recognition across affine transformations, such as changes in size, and non-affine transformations, such as rotations in depth. From this perspective, promoting invariant object recognition across rotations in depth requires visual experience with the object from multiple viewpoints. One learning mechanism potentially contributing to invariant recognition is the error-driven learning of associations between relatively view-invariant visual properties and motor responses or object labels. This account uniquely predicts that experience with affine transformations of a single object view may also promote view-invariance, if view-invariant properties are also invariant across such affine transformations. We empirically confirmed this prediction in both people and pigeons, thereby suggesting that: (a) the hypothesized mechanism participates in view-invariance learning, (b) this mechanism is present across distantly-related vertebrates, and (c) the distinction between affine and non-affine transformations may not be fundamental for biological visual systems, as previously assumed.

Object similarity affects the perceptual strategy underlying invariant visual object recognition in rats

In recent years, a number of studies have explored the possible use of rats as models of high-level visual functions. One central question at the root of such an investigation is to understand whether rat object vision relies on the processing of visual shape features or, rather, on lower-order image properties (e.g., overall brightness). In a recent study, we have shown that rats are capable of extracting multiple features of an object that are diagnostic of its identity, at least when those features are, structure-wise, distinct enough to be parsed by the rat visual system. In the present study, we have assessed the impact of object structure on rat perceptual strategy. We trained rats to discriminate between two structurally similar objects, and compared their recognition strategies with those reported in our previous study. We found that, under conditions of lower stimulus discriminability, rat visual discrimination strategy becomes more view-dependent and subject-dependent. Rats were still able to recognize the target objects, in a way that was largely tolerant (i.e., invariant) to object transformation; however, the larger structural and pixel-wise similarity affected the way objects were processed. Compared to the findings of our previous study, the patterns of diagnostic features were: (i) smaller and more scattered; (ii) only partially preserved across object views; and (iii) only partially reproducible across rats. On the other hand, rats were still found to adopt a multi-featural processing strategy and to make use of part of the optimal discriminatory information afforded by the two objects. Our findings suggest that, as in humans, rat invariant recognition can flexibly rely on either view-invariant representations of distinctive object features or view-specific object representations, acquired through learning.

Mechanisms of object recognition: what we have learned from pigeons

Behavioral studies of object recognition in pigeons have been conducted for 50 years, yielding a large body of data. Recent work has been directed toward synthesizing this evidence and understanding the visual, associative, and cognitive mechanisms that are involved. The outcome is that pigeons are likely to be the non-primate species for which the computational mechanisms of object recognition are best understood. Here, we review this research and suggest that a core set of mechanisms for object recognition might be present in all vertebrates, including pigeons and people, making pigeons an excellent candidate model to study the neural mechanisms of object recognition. Behavioral and computational evidence suggests that error-driven learning participates in object category learning by pigeons and people, and recent neuroscientific research suggests that the basal ganglia, which are homologous in these species, may implement error-driven learning of stimulus-response associations. Furthermore, learning of abstract category representations can be observed in pigeons and other vertebrates. Finally, there is evidence that feedforward visual processing, a central mechanism in models of object recognition in the primate ventral stream, plays a role in object recognition by pigeons. We also highlight differences between pigeons and people in object recognition abilities, and propose candidate adaptive specializations which may explain them, such as holistic face processing and rule-based category learning in primates. From a modern comparative perspective, such specializations are to be expected regardless of the model species under study. The fact that we have a good idea of which aspects of object recognition differ in people and pigeons should be seen as an advantage over other animal models. From this perspective, we suggest that there is much to learn about human object recognition from studying the "simple" brains of pigeons.

View combination in recognition of 3-D virtual reality layouts

We investigated whether a normalization model or view combination model fit the performance of scene recognition of 3-D layouts using a virtual-reality paradigm. Participants learned a layout of seven objects from two training views (e.g., 0° and 48°) by discriminating the "correct" layout from distracters. Later, they performed a discrimination task using the training views (e.g., 0° and 48°), an interpolated view (e.g., 24°), an extrapolated view (e.g., 72°), and a far view (e.g., 96°). The results showed that the interpolated view was easier to discriminate than the extrapolated view and even easier than the training views. These results extend the applicability of view combination accounts of recognition to 3-D stimuli with stereoscopic depth information.

View-invariance learning in object recognition by pigeons depends on error-driven associative learning processes

A model hypothesizing that basic mechanisms of associative learning and generalization underlie object categorization in vertebrates can account for a large body of animal and human data. Here, we report two experiments which implicate error-driven associative learning in pigeons' recognition of objects across changes in viewpoint. Experiment 1 found that object recognition across changes in viewpoint depends on how well each view predicts reward. Analyses of generalization performance, spatial position of pecks to images, and learning curves all showed behavioral patterns analogous to those found in prior studies of relative validity in associative learning. In Experiment 2, pigeons were trained to recognize objects from multiple viewpoints, which usually promotes robust performance at novel views of the trained objects. However, when the objects possessed a salient, informative metric property for solving the task, the pigeons did not show view-invariant recognition of the training objects, a result analogous to the overshadowing effect in associative learning.

Visual object categorization in birds and primates: integrating behavioral, neurobiological, and computational evidence within a "general process" framework

Previous comparative work has suggested that the mechanisms of object categorization differ importantly for birds and primates. However, behavioral and neurobiological differences do not preclude the possibility that at least some of those mechanisms are shared across these evolutionarily distant groups. The present study integrates behavioral, neurobiological, and computational evidence concerning the "general processes" that are involved in object recognition in vertebrates. We start by reviewing work implicating error-driven learning in object categorization by birds and primates, and also consider neurobiological evidence suggesting that the basal ganglia might implement this process. We then turn to work with a computational model showing that principles of visual processing discovered in the primate brain can account for key behavioral findings in object recognition by pigeons, including cases in which pigeons' behavior differs from that of people. These results provide a proof of concept that the basic principles of visual shape processing are similar across distantly related vertebrate species, thereby offering important insights into the evolution of visual cognition.

Facilitation by view combination and coherent motion in dynamic object recognition

We compared the effect of motion cues on people's ability to: (1) recognize dynamic objects by combining information from more than one view and (2) perform more efficiently on views that followed the global direction of the trained views. Participants learned to discriminate two objects that were either structurally similar or distinct and that were rotating in depth in either a coherent or scrambled motion sequence. The Training views revealed 60 degrees of the object, with a center 30 degrees segment missing. For similar stimuli only, there was a facilitative effect of motion: Performance in the coherent condition was better on views following the training views than on equidistant preceding views. Importantly, the viewpoint between the two training viewpoints was responded to more efficiently than either the Pre- or Post-Training viewpoints for both the coherent and scrambled condition. The results indicate that view combination and processing coherent motion cues may occur through different processes.

Evidence for the role of self-priming in epistemic action: expertise and the effective use of memory

Epistemic actions are physical actions people take to simplify internal problem solving rather than to move closer to an external goal. When playing the video game Tetris, for instance, experts routinely rotate falling shapes more than is strictly needed to place the shapes. Maglio and Kirsh [Kirsh, D., & Maglio, P. (1994). On distinguishing epistemic from pragmatic action. Cognitive Science, 18, 513-549; Maglio, P. P. (1995). The computational basis of interactive skill. PhD thesis, University of California, San Diego] proposed that such actions might serve the purpose of priming memory by external means, reducing the need for internal computation (e.g., mental rotation), and resulting in performance improvements that exceed the cost of taking additional actions. The present study tests this priming hypothesis in a set of four experiments. The first three explored precisely the conditions under which priming produces benefits. Results showed that presentation of multiple orientations of a shape led to faster responses than did presentation of a single orientation, and that this effect depended on the interval between preview and test. The fourth explored whether the benefit of seeing shapes in multiple orientations outweighs the cost of taking the extra actions to rotate shapes physically. Benefits were measured using a novel statistical method for mapping reaction-time data onto an estimate of the increase in processing capacity afforded by seeing multiple orientations. Cost was measured using an empirical estimate of time needed to take action in Tetris. Results showed that indeed the increase in internal processing capacity obtained from seeing shapes in multiple orientations outweighed the time to take extra actions.

An advantage for concavities in shape perception by chimpanzees (Pan troglodytes)

The significance of concavity in object shape perception by chimpanzees (Pan troglodytes) was investigated in a matching-to-sample procedure. For the task, chimpanzees were required to choose a polygon stimulus that was identical in shape to a sample. The incorrect alternative was defined by the addition or subtraction of a concave or convex apex. Chimpanzees were more sensitive to the concave deformation than to the convex deformation. This tendency conforms to the theories of human visual perception that have treated concave features as important factors in reconstructing three-dimensional structures from two-dimensional images. Our results suggest that shape representation in chimpanzees is similar to that in humans and that chimpanzees visually process two-dimensional images in the same manner as humans.

Dynamic object recognition in pigeons and humans

We investigated the role of dynamic information in human and pigeon object recognition. Both species were trained to discriminate between two objects that each had a characteristic motion, so that either cue could be used to perform the task successfully. The objects were either easy or difficult to decompose into parts. At test, the learned objects could appear in their learned motions, the reverse of the learned motions, or an entirely new motion, or a new object could appear in one of the learned motions. For humans, any change in the learned motion produced a decrement in performance for both the decomposable and the nondecomposable objects, but participants did not respond differentially to new objects that appeared in the learned motions. Pigeons showed the same pattern of responding as did humans for the decomposable objects, except that pigeons responded differentially to new objects in the learned motions. For the nondecomposable objects, pigeons used motion cues exclusively. We suggest that for some types of objects, dynamic information may be weighted differently by pigeons and humans.

Rationale and methodology for testing auditory cognition in songbirds

Songbirds, and in particular zebra finches, present a wonderful opportunity to study cognition in species that have evolved specialized abilities and brain structures for auditory cognition. The authors describe the rationale, methods, and apparatus used to test the auditory perceptual and cognitive abilities of songbirds. They have developed an operant conditioning system for conducting discrimination experiments simultaneously with several songbirds. The system uses specialized single-board computers, standard personal computers, CD-ROMs, and custom-written software to present stimuli, control training, and record responses. Also, the authors describe software to produce high-quality synthesized and naturally occurring acoustic stimuli for use in studies of auditory cognition. Typical results from a challenging frequency-range discrimination are included.

Limits of dynamic object perception in pigeons: Dynamic stimulus presentation does not enhance perception and discrimination of complex shape

A go/no-go procedure was used to train pigeons to discriminate pictures of human faces differing only in shape, with either static images or movies of human faces dynamically rotating in depth. On the basis of experimental findings in humans and some earlier studies on three-dimensional object perception in pigeons, we expected dynamic stimulus presentation to support the pigeon's perception of the complex morphology of a human face. However, the performance of the subjects presented with movies was either worse than (AVI format movies) or did not differ from (uncompressed dynamic presentation) that of the subjects trained with a single or with multiple static images of the faces. Furthermore, generalization tests to other presentation conditions and to novel static views revealed no promoting effect of dynamic training. Except for the subjects trained on multiple static views, performance dropped to chance level with views outside the training range. These results are in contrast to some prior reports from the literature, since they suggest that pigeons, unlike humans, have difficulty using the additional structural information provided by the dynamic presentation and integrating the multiple views into a three-dimensional object.

Recognition by humans and pigeons of novel views of 3-D objects and their photographs

Humans and pigeons were trained to discriminate between 2 views of actual 3-D objects or their photographs. They were tested on novel views that were either within the closest rotational distance between the training views (interpolated) or outside of that range (extrapolated). When training views were 60 degrees apart, pigeons, but not humans, recognized novel views of actual objects better than their pictures. Further, both species recognized interpolated views of both stimulus types better than extrapolated views, but a single distinctive geon enhanced recognition of novel views only for humans. When training views were 90 degrees apart, pigeons recognized interpolated views better than extrapolated views with actual objects but not with photographs. Thus, pigeons may represent actual objects differently than their pictures.

Recognition of static and dynamic images of depth-rotated human faces by pigeons

In three experiments, we examined pigeons' recognition of video images of human faces. In Experiment 1, pigeons were trained to discriminate between frontal views of human faces in a go/no-go discrimination procedure. They then showed substantial generalization to novel views, even though human faces change radically as viewpoint changes. In Experiment 2, the pigeons tested in Experiment 1 failed to transfer to the faces dynamically rotating in depth. In Experiment 3, the pigeons trained to discriminate the dynamic stimuli showed excellent transfer to the corresponding static views, but responses to the positive faces decreased at novel viewpoints outside the range spanned by the dynamic stimuli. These results suggest that pigeons are insensitive to the three-dimensional properties of video images. Consideration is given to the nature of the task, relating to the identification of three-dimensional objects and to perceptual classifications based on similarity judgments.

An automated apparatus for presenting depth-rotated three-dimensional objects in human and animal object recognition research

For practical reasons, research on the recognition of objects from different viewpoints has relied almost exclusively on the use of two-dimensional representations of three-dimensional objects. We describe an apparatus that enables the presentation of three-dimensional objects in a discrimination learning paradigm. Three chambers positioned on a movable table allow each of two objects to be presented on either the left or the right side; a viewing window exposes only two of the objects at a time. The objects can be arbitrarily designated as either an S+ or an S-. In addition, they can be placed precisely in any arbitrary start position and rotated in depth in 100 steps of 3.6 degrees each. We have successfully used this apparatus to investigate recognition of depth-rotated objects by both pigeons and humans. By varying the stimuli, number of stimulus chambers, and software programs, the apparatus can be used for other types of tasks and to investigate other types of processes.

Recognizing rotated views of objects: interpolation versus generalization by humans and pigeons

Pigeons and humans were trained to discriminate between pictures of three-dimensional objects that differed in global shape. Each pair of objects was shown at two orientations that differed by a depth rotation of 90 degrees during training. Pictures of the objects at novel depth rotations were then tested for recognition. The novel test rotations were 30 degrees, 45 degrees, and 90 degrees from the nearest trained orientation and were either interpolated between the trained orientations or extrapolated outside of the training range. For both pigeons and humans, recognition accuracy and/or speed decreased as a function of distance from the nearest trained orientation. However, humans, but not pigeons, were more accurate in recognizing novel interpolated views than novel extrapolated views. The results suggest that pigeons' recognition was based on independent generalization from each training view, whereas humans showed view-combination processes that resulted in a benefit for novel views interpolated between the training views.