Phenomenology, Quantity, and Numerosity

There are many situations in which we interact with collections of objects, from a crowd of people to a bowl of blackberries. There is an experience of the quantity of these items, although not a precise number, and we have this impression quickly and effortlessly. It can be described as an expressive property of the whole. In the literature, the study of this sense of numerosity has a long history, which is reviewed here with examples. I argue that numerosity is a direct perceptual experience, and that all experiences of numerosity, not only estimations, are affected by perceptual organisation.

The role of awareness in shaping responses in human visual cortex

The visual cortex contains information about stimuli even when they are not consciously perceived. However, it remains unknown whether the visual system integrates local features into global objects without awareness. Here, we tested this by measuring brain activity in human observers viewing fragmented shapes that were either visible or rendered invisible by fast counterphase flicker. We then projected measured neural responses to these stimuli back into visual space. Visible stimuli caused robust responses reflecting the positions of their component fragments. Their neural representations also strongly resembled one another regardless of local features. By contrast, representations of invisible stimuli differed from one another and, crucially, also from visible stimuli. Our results demonstrate that even the early visual cortex encodes unconscious visual information differently from conscious information, presumably by only encoding local features. This could explain previous conflicting behavioural findings on unconscious visual processing.

Deriving the number of salience maps an observer has from the number and quality of concurrent centroid judgments

[C. Koch, S. Ullman, Hum. Neurobiol.4, 219-227 (1985)] proposed a 2D topographical salience map that took feature-map outputs as its input and represented the importance "saliency" of the feature inputs at each location as a real number. The computation on the map, "winner-take-all," was used to predict action priority. We propose that the same or a similar map is used to compute centroid judgments, the center of a cloud of diverse items. [P. Sun, V. Chu, G. Sperling, Atten. Percept. Psychophys.83, 934-955 (2021)] demonstrated that following a 250-msec exposure of a 24-dot array of 3 intermixed colors, subjects could accurately report the centroid of each dot color, thereby indicating that these subjects had at least three salience maps. Here, we use a postcue, partial-report paradigm to determine how many more salience maps subjects might have. In 11 experiments, subjects viewed 0.3-s flashes of 28 to 32 item arrays composed of M, M = 3,...,8, different features followed by a cue to mouse-click the centroid of items of just the post-cued feature. Ideal detector response analyses show that subjects utilized at least 12 to 17 stimulus items. By determining whether a subject's performance in (M-1)-feature experiments could/could-not predict performance in M-feature experiments, we conclude that one subject has at least 7 and the other two have at least five salience maps. A computational model shows that the primary performance-limiting factors are channel capacity for representing so many concurrently presented groups of items and working-memory capacity for so many computed centroids.

Solving the binding problem: Assemblies form when neurons enhance their firing rate-they don't need to oscillate or synchronize

When we look at an image, its features are represented in our visual system in a highly distributed manner, calling for a mechanism that binds them into coherent object representations. There have been different proposals for the neuronal mechanisms that can mediate binding. One hypothesis is that binding is achieved by oscillations that synchronize neurons representing features of the same perceptual object. This view allows separate communication channels between different brain areas. Another hypothesis is that binding of features that are represented in different brain regions occurs when the neurons in these areas that respond to the same object simultaneously enhance their firing rate, which would correspond to directing object-based attention to these features. This review summarizes evidence in favor of and against these two hypotheses, examining the neuronal correlates of binding and assessing the time course of perceptual grouping. I conclude that enhanced neuronal firing rates bind features into coherent object representations, whereas oscillations and synchrony are unrelated to binding.

The long and short of it? A novel geometric illusion

Here we present what we believe to be a novel geometric illusion where identical lines are perceived as being of differing lengths. Participants were asked to report which of the two parallel rows of horizontal lines contained the longer individual lines (two lines on one row and 15 on the other). Using an adaptive staircase we adjusted the length of the lines on the row containing two to estimate the point of subjective equality (PSE). At the PSE, the two lines were consistently shorter than the row containing the fixed length of 15 lines demonstrating a disparity in perceived length such that lines of identical length are perceived as longer in a row of two than in a row of 15. The illusion magnitude was unaffected by which row was presented above the other. Additionally, the effect persisted when using one as opposed to two test lines, and when the line stimuli on both rows were presented with alternating luminance polarity the illusion magnitude decreased, but was not abolished. The data indicate a robust geometric illusion that may be modulated by perceptual grouping processes.

Neural decoding dissociates perceptual grouping between proximity and similarity in visual perception

Unlike single grouping principle, cognitive neural mechanism underlying the dissociation across two or more grouping principles is still unclear. In this study, a dimotif lattice paradigm that can adjust the strength of one grouping principle was used to inspect how, when, and where the processing of two grouping principles (proximity and similarity) were carried out in human brain. Our psychophysical findings demonstrated that similarity grouping effect was enhanced with reduced proximity effect when the grouping cues of proximity and similarity were presented simultaneously. Meanwhile, EEG decoding was performed to reveal the specific cognitive patterns involved in each principle by using time-resolved MVPA. More importantly, the onsets of dissociation between 2 grouping principles coincided within 3 time windows: the early-stage proximity-defined local visual element arrangement in middle occipital cortex, the middle-stage processing for feature selection modulating low-level visual cortex such as inferior occipital cortex and fusiform cortex, and the high-level cognitive integration to make decisions for specific grouping preference in the parietal areas. In addition, it was discovered that the brain responses were highly correlated with behavioral grouping. Therefore, our study provides direct evidence for a link between the human perceptual space of grouping decision-making and neural space of brain activation patterns.

Heuristic Attention Representation Learning for Self-Supervised Pretraining

Recently, self-supervised learning methods have been shown to be very powerful and efficient for yielding robust representation learning by maximizing the similarity across different augmented views in embedding vector space. However, the main challenge is generating different views with random cropping; the semantic feature might exist differently across different views leading to inappropriately maximizing similarity objective. We tackle this problem by introducing Heuristic Attention Representation Learning (HARL). This self-supervised framework relies on the joint embedding architecture in which the two neural networks are trained to produce similar embedding for different augmented views of the same image. HARL framework adopts prior visual object-level attention by generating a heuristic mask proposal for each training image and maximizes the abstract object-level embedding on vector space instead of whole image representation from previous works. As a result, HARL extracts the quality semantic representation from each training sample and outperforms existing self-supervised baselines on several downstream tasks. In addition, we provide efficient techniques based on conventional computer vision and deep learning methods for generating heuristic mask proposals on natural image datasets. Our HARL achieves +1.3% advancement in the ImageNet semi-supervised learning benchmark and +0.9% improvement in AP₅₀ of the COCO object detection task over the previous state-of-the-art method BYOL. Our code implementation is available for both TensorFlow and PyTorch frameworks.

The time course of holistic processing is similar for face and non-face Gestalt stimuli

There is evidence that holistic processing of faces and other stimuli rich in Gestalt perceptual grouping cues recruit overlapping mechanisms at early processing stages, but not at later stages where faces and objects of expertise likely overlap. This has led to suggestions of dual pathways supporting holistic processing; an early stimulus-based pathway (supporting processing of stimuli rich in perceptual grouping cues) and an experience-based pathway (supporting processing of object of expertise), with both pathways supporting face processing. Holistic processing markers are present when upright faces are presented for as little as 50-ms. If the overlap between holistic processing of faces and stimuli rich in grouping cues occurs early in processing, markers of holistic processing for these Gestalt stimuli should be present as early as those for faces. In Experiment 1, we investigate the time-course of the emergence of holistic processing markers for face and non-face Gestalt stimuli. The emergence of these markers for faces and the Gestalt stimuli was strikingly similar; both emerged with masked presentations as little as 50-ms. In Experiment 2, where the stimulus presentation was not masked, thus the presentation duration, but not the post-presentation perceptual processing, was constrained, patterns of holistic processing for these stimuli still did not diverge. These findings are consistent with an early, and possibly extended, temporal locus for the overlap in the holistic processing of faces and non-face stimuli rich in grouping cues.

Perceptual Grouping of Random Dot Patterns in the Presence of a Tilting Frame

The objective of this study was to investigate the effect of tilting a frame on the perceptual organization in random dot patterns. Ten random patterns of nine dots were generated. For each pattern, a square frame was tilted at seven angles around the dots. Ten observers were asked to indicate the groups of dots in each stimulus. Each stimulus was seen 4 times by each observer which enabled us to study within-subject consistencies provided grouping reports. Within- and between-subject consistencies were computed to study if the responses provided by participants were consistent and thus reliable. The dominant group was defined as the most repeated group in all 40 reports (10 participants, 4 repetitions) obtained for each stimulus. We studied how tilting a frame affected the dominant group in each dot pattern. Perceptual grouping was not affected by tilting the frame. Based on a qualitative inspection, we remark that fundamental principles, for example, proximity, good continuation, and closure, respectively, in the order of strength, may remain the main drivers of the grouping behavior, irrespective of differences in the number of dots in each group, and the frame orientation. The numerosity condition did not affect our results. Similar trends were observed in patterns of 9 and 18 dots patterns.

The dynamics of grouping-induced biases in apparent numerosity revealed by a continuous tracking technique

Connecting pairs of items causes robust underestimation of the numerosity of an ensemble, presumably by invoking grouping mechanisms. Here we asked whether this underestimation in numerosity judgments could be revealed and further explored by continuous tracking, a newly developed technique that allows for fast and efficient data acquisition and monitors the dynamics of the responses. Participants continuously reproduced the perceived numerosity of a cloud of dots by moving a cursor along a number line, while the number of dots and the proportion connected by lines varied over time following two independent random walks. The technique was robust and efficient, and correlated well with results obtained with a standard psychophysics task. Connecting objects with lines caused an underestimation of approximately 15% during tracking, agreeing with previous studies. The response to the lines was slower than the response to the physical numerosity, with a delay of approximately 150 ms, suggesting that this extra time is necessary for processing the grouping effect.

Intertap interval dependence of the subdivision effect in auditory-synchronised tapping

Precise temporal synchronisation between action and perception is crucial in daily life. Interestingly, synchronised tapping for every other tone or more (1:n tapping) is more precise than that for each tone (1:1 tapping), and this phenomenon is called 'subdivision benefit'. One hypothesis to explain this phenomenon is that there is a tendency to underestimate an empty interval, but the subdivision is used as an additional temporal reference and causes an illusionary longer intertap interval (ITI). The other hypothesis is based on strong/weak beats in a tone sequence made by subdivision. Because the strong beat improves the sensitivity of duration perception, synchronisation with strong beats should be better compared with other beats. Instead, the first hypothesis suggests that the subdivision benefit occurs irrespective of beat strength. The present study aimed to clarify this discrepancy using a 1:3 tapping task for a sequence of three-tone patterns and a 1:1 tapping task for a sequence of a single tone repetition. A further aim was to clarify the effect of musical experience. When the ITI was 900 ms or more, the variability of tapping showed the subdivision benefit, irrespective of beat strength. This result supports the first hypothesis, and musicians obtained more benefits than non-musicians. Instead, the timing of tap did not shorten by subdivision, except for the ITI of 900 ms. The findings implicate that the subdivision benefit is due to the additional temporal reference by the subdivided tones, and the benefit is dependent on the ITI length.

Young chicks rely on symmetry/asymmetry in perceptual grouping to discriminate sets of elements

Grouping sets of elements into smaller, equal-sized, subsets constitutes a perceptual strategy employed by humans and other animals to enhance cognitive performance. Here, we show that day-old chicks can solve extremely complex numerical discriminations (Exp.1), and that their performance can be enhanced by the presence of symmetrical/asymmetrical colour grouping (Exp.2 versus Exp.3). Newborn chicks were habituated for 1 h to even numerosities (sets of elements presented on a screen) and then tested for their spontaneous choice among what for humans would be considered a prime and a non-prime odd numerosity. Chicks discriminated and preferred the prime over the composite set of elements irrespective of its relative magnitude (i.e. 7 versus 9 and 11 versus 9). We discuss this result in terms of novelty preference. By employing a more complex contrast (i.e. 13 versus 15), we investigated the limits of such a mechanism and showed that induced grouping positively affects chicks' performance. Our results suggest the existence of a spontaneous mechanism that enables chicks to create symmetrical (i.e. same-sized) subgroups of sets of elements. Chicks preferentially inspected numerosities for which same-sized grouping is never possible (i.e. the prime numerosity) rather than numerosities allowing for symmetrical grouping (i.e. composite).

Effect of Non-canonical Spatial Symmetry on Subitizing

Subitizing refers to ability of people to accurately and effortlessly enumerate a small number of items, with a capacity around four elements. Previous research showed that "canonical" organizations, such as familiar layouts on a dice, can readily improve subitizing performance of people. However, almost all canonical shapes found in the world are also highly symmetrical; therefore, it is unclear whether previously reported facilitative effect of canonical organization is really due to canonicality, or simply driven by spatial symmetry. Here, we investigated the possible effect of symmetry on subitizing by using symmetrical, yet non-canonical, shape structures. These symmetrical layouts were compared with highly controlled random patterns (Experiment 1), as well as fully random and canonical patterns (Experiment 2). Our results showed that symmetry facilitates subitizing performance, but only at set size of 6, suggesting that the effect is insufficient to improve performance of people in the lower or upper range. This was also true, although weaker, in reaction time (RT), error distance measures, and Weber Fractions. On the other hand, canonical layouts produced faster and more accurate subitizing performances across multiple set sizes. We conclude that, although previous findings mixed symmetry in their canonical shapes, their findings on shape canonicality cannot be explained by symmetry alone. We also propose that our symmetrical and canonical results are best explained by the "groupitizing" and pattern recognition accounts, respectively.

Is There a "Gestalt Bias" in Indulgence? Subjectively Constructing Food Units Into Wholes (vs. Parts) Increases Desire to Eat and Actual Consumption

In the present work we extend research into the unit bias effect and its extension—the portion size effect—by demonstrating the existence of a “Gestalt bias.” Drawing on the tenets of Gestalt psychology, we show that a unit bias effect can be observed for food portions that are composed of identical basic units, but which are subjectively grouped into, or perceived as a Gestalt—a larger whole. In three studies, we find that such subjectively constructed food wholes constitute a new (perceptual) unit that is perceived bigger than the units it is constructed from, thereby prompting increased eating and desire to eat.

A Canonical Laminar Neocortical Circuit Whose Bottom-Up, Horizontal, and Top-Down Pathways Control Attention, Learning, and Prediction

All perceptual and cognitive circuits in the human cerebral cortex are organized into layers. Specializations of a canonical laminar network of bottom-up, horizontal, and top-down pathways carry out multiple kinds of biological intelligence across different neocortical areas. This article describes what this canonical network is and notes that it can support processes as different as 3D vision and figure-ground perception; attentive category learning and decision-making; speech perception; and cognitive working memory (WM), planning, and prediction. These processes take place within and between multiple parallel cortical streams that obey computationally complementary laws. The interstream interactions that are needed to overcome these complementary deficiencies mix cell properties so thoroughly that some authors have noted the difficulty of determining what exactly constitutes a cortical stream and the differences between streams. The models summarized herein explain how these complementary properties arise, and how their interstream interactions overcome their computational deficiencies to support effective goal-oriented behaviors.

Competition between perceptual grouping cues in an indirect objective task

The integration between Gestalt grouping cues has been a relatively unexplored issue in vision science. The present work introduces an objective indirect method based on the repetition discrimination task to determine the rules that govern the dominance dynamics of the competition between both intrinsic (Experiment 1: proximity vs luminance similarity) and extrinsic grouping cues (Experiment 2: common region vs connectedness) by means of objective measures of grouping (reaction times and accuracy). Prior to the main task, a novel objective equating task was introduced with the aim of equating the grouping strength of the cues for the visuomotor system. The main task included two single conditions with the grouping cues acting alone as well as two competing conditions displaying the grouping factors pitted against one another. Conventional aggregated analyses were combined with individual analysis and both revealed a consistent pattern of processing dominance of: (1) luminance similarity over proximity and (2) common region over connectedness. Interestingly, the individual analyses showed that, despite the heterogeneous responses to the single conditions, the pattern of dominance between cues was robustly homogeneous among the participants in the competing conditions.

Discriminating Global Orientation of Two Element Sets

Perceived global organization of visual patterns is based upon the aggregate contribution of constituent components. Patterns constructed from multiple sources cooperate or compete for global organization. An investigation was made here of interactions between two interspersed element sets on global orientation. It was hypothesized that each set would operate as an integrated unit, and contribute independently to global orientation. Participants viewed a 10 × 10 array of Gabor patches, and indicated the predominant orientation of the array. In Experiment 1 all elements were rotated. Rotation up to 23° had little effect, whereas greater rotation produced a progressive shift on global orientation. In Experiment 2 a proportion of elements remained aligned while remaining elements were rotated. Embedding a proportion of aligned elements stabilized global orientation, which was dependent upon the proportion of aligned elements. Specifically, with 20% alignment, global orientation was similar to rotating all elements, whereas 80% alignment strongly biased perception towards aligned elements. The stabilizing effect varied with rotation of the second element set. Across levels of rotation, alignment effects rose to a peak then declined as element sets became orthogonal. In Experiment 3, each element set was rotated independently. Independent rotation of both sets altered global orientation, compressing the psychometric function for the single-element condition. Together, for interspersed element sets with explicit orientations, each set does not contribute independently to global orientation. Instead, element sets interact, where the contribution of one set, presented at a fixed rotation and fixed proportion, varies with the change to the second set.

Incongruent Audiovisual Inducer Information and Fission/Fusion Illusions

In research studies on how people perceive simultaneously presented audiovisual information, researchers have often shown that the number of visual flashes participants perceive on a computer screen can be altered by varying the number of accompanying auditory, visual, or combined audiovisual cues or inducers. In the present study, we examined the effects of number-incongruent audiovisual inducer stimuli on the participants' perceived number of target flashes. We instructed 16 participants (eight males and eight females; M_age = 21.56; SD_age = 1.93) to report their perceived number of target flashes while ignoring the visual and auditory inducers. Across 18 different experimental conditions, we presented one or two target flashes in association with varied numbers (0, 1, 2) of auditory and visual inducer stimuli. In the condition with one target flash paired with one visual and two auditory inducers, the number of visual inducers (i.e., one) had a greater influence on the number of perceived target flashes than did the number of auditory inducers (i.e., two). Under all other number incongruent audiovisual inducer conditions, the participants' perceived number of target flashes was influenced more by the number of auditory than the number of visual inducers. We discuss these findings in the context of perceptual grouping and perceptual temporal uncertainty.

Contextual and Spatial Associations Between Objects Interactively Modulate Visual Processing

Much of what we know about object recognition arises from the study of isolated objects. In the real world, however, we commonly encounter groups of contextually associated objects (e.g., teacup and saucer), often in stereotypical spatial configurations (e.g., teacup above saucer). Here we used electroencephalography to test whether identity-based associations between objects (e.g., teacup–saucer vs. teacup–stapler) are encoded jointly with their typical relative positioning (e.g., teacup above saucer vs. below saucer). Observers viewed a 2.5-Hz image stream of contextually associated object pairs intermixed with nonassociated pairs as every fourth image. The differential response to nonassociated pairs (measurable at 0.625 Hz in 28/37 participants) served as an index of contextual integration, reflecting the association of object identities in each pair. Over right occipitotemporal sites, this signal was larger for typically positioned object streams, indicating that spatial configuration facilitated the extraction of the objects’ contextual association. This high-level influence of spatial configuration on object identity integration arose ~ 320 ms post-stimulus onset, with lower-level perceptual grouping (shared with inverted displays) present at ~ 130 ms. These results demonstrate that contextual and spatial associations between objects interactively influence object processing. We interpret these findings as reflecting the high-level perceptual grouping of objects that frequently co-occur in highly stereotyped relative positions.

On Visually-Grounded Reference Production: Testing the Effects of Perceptual Grouping and 2D/3D Presentation Mode

When referring to a target object in a visual scene, speakers are assumed to consider certain distractor objects to be more relevant than others. The current research predicts that the way in which speakers come to a set of relevant distractors depends on how they perceive the distance between the objects in the scene. It reports on the results of two language production experiments, in which participants referred to target objects in photo-realistic visual scenes. Experiment 1 manipulated three factors that were expected to affect perceived distractor distance: two manipulations of perceptual grouping (region of space and type similarity), and one of presentation mode (2D vs. 3D). In line with most previous research on visually-grounded reference production, an offline measure of visual attention was taken here: the occurrence of overspecification with color. The results showed effects of region of space and type similarity on overspecification, suggesting that distractors that are perceived as being in the same group as the target are more often considered relevant distractors than distractors in a different group. Experiment 2 verified this suggestion with a direct measure of visual attention, eye tracking, and added a third manipulation of grouping: color similarity. For region of space in particular, the eye movements data indeed showed patterns in the expected direction: distractors within the same region as the target were fixated more often, and longer, than distractors in a different region. Color similarity was found to affect overspecification with color, but not gaze duration or the number of distractor fixations. Also the expected effects of presentation mode (2D vs. 3D) were not convincingly borne out by the data. Taken together, these results provide direct evidence for the close link between scene perception and language production, and indicate that perceptual grouping principles can guide speakers in determining the distractor set during reference production.

Discrimination of empty and filled intervals marked by auditory signals with different durations and directions of intensity change

A time interval marked by two short sounds ("empty interval") is perceived to be longer when one or more short sounds are inserted within this time interval ("filled interval"). This illusion is known as the filled-duration illusion (FDI), which has been mainly observed above 500 ms. Previous evidence has mostly shown, however, that the FDI within 500 ms is not robust due to individual differences. FDI in this short range has been less influenced by the properties of sound markers (such as amplitude, time duration, and sound energy distribution). I questioned whether the mixed evidence in the short range could be due to the methods and time ranges adopted. Here, I asked whether and how the perceived duration of both the empty interval and the filled interval (a continuous beep) was modulated by markers with different yet short durations, and by markers with intensity changes (ascending vs. descending). The results showed that the longer markers led to more expansion of the perceived time interval than did the short markers. The empty interval (300 ms) was perceived as shorter in the rising intensity (first tone marker)-decreasing intensity (second tone marker) condition, but as longer in the decreasing-decreasing condition. However, the filled interval (300 ms) bounded in the decreasing-decreasing condition was perceived as shorter. Therefore, perception of short empty and filled intervals (enclosed by auditory marks) could be modulated by the temporal properties of the markers. Those findings could be accounted for by the Gestalt perceptual groupings between the auditory markers and the to-be-timed gap/stimulus intervals in an adaptive way.

Kanizsa-figure object completion gates selection in the attentional blink

Previous work has demonstrated that perceptual grouping modulates the selectivity of attention across space. By contrast, how grouping influences the allocation of attention over time is much less clear. This study investigated this issue, using an attentional blink (AB) paradigm to test how grouping influences the initial selection and the subsequent short-term memory consolidation of a target. On a given trial, two red Kanizsa-type targets (T1 and T2) with varying grouping strength were embedded in a rapid serial visual presentation stream of irrelevant distractors. Our results showed the typical AB finding: impaired identification of T2 when presented close in time following T1. Moreover, the AB was modulated by the T2 grouping-independently of the T1 structure-with stronger grouping leading to a decreased AB and overall higher performance. Conversely, a reversed pattern, namely an increased AB with increasing grouping strength was observed when the Kanizsa figure was not task-relevant. Together, these findings suggest that the grouping benefit emerges at early perceptual stages, automatically drawing attentional resources, thereby leading to either sustained benefits or transient costs-depending on the task-relevance of the grouped object. This indicates that grouping modulates processing of objects in time.

High-capacity preconscious processing in concurrent groupings of colored dots

Grouping is a perceptual process in which a subset of stimulus components (a group) is selected for a subsequent-typically implicit-perceptual computation. Grouping is a critical precursor to segmenting objects from the background and ultimately to object recognition. Here, we study grouping by color. We present subjects with 300-ms exposures of 12 dots colored with the same but unknown identical color interspersed among 14 dots of seven different colors. To indicate grouping, subjects point-click the remembered centroid ("center of gravity") of the set of homogeneous dots, of heterogeneous dots, or of all dots. Subjects accurately judge all of these centroids. Furthermore, after a single stimulus exposure, subjects can judge both the heterogeneous and homogeneous centroids, that is, subjects simultaneously group by similarity and by dissimilarity. The centroid paradigm reveals the relative weight of each dot among targets and distractors to the underlying grouping process, offering a more detailed, quantitative description of grouping than was previously possible. A change detection experiment reveals that conscious memory contains less than two dots and their locations, whereas an ideal detector would have to perfectly process at least 15 of 26 dots to match the subjects' centroid judgments-indicating an extraordinary capacity for preconscious grouping. A different color set yielded identical results. Grouping theories that rely on predefined feature maps would fail to explain these results. Rather, the results indicate that preconscious grouping is automatic, flexible, and rapid, and a far more complex process than previously believed.

Early sensitivity of evoked potentials to surface and volumetric structure during the visual perception of three-dimensional object shape

This study used event-related potentials (ERPs) to elucidate how the human visual system processes three-dimensional (3-D) object shape structure. In particular, we examined whether the perceptual mechanisms that support the analysis of 3-D shape are differentially sensitive to higher order surface and volumetric part structure. Observers performed a whole-part novel object matching task in which part stimuli comprised sub-regions of closed edge contour, surfaces or volumetric parts. Behavioural response latency data showed an advantage in matching surfaces and volumetric parts to whole objects over contours, but no difference between surfaces and volumes. ERPs were analysed using a convergence of approaches based on stimulus dependent amplitude modulations of evoked potentials, topographic segmentation, and spatial frequency oscillations. The results showed early differential perceptual processing of contours, surfaces, and volumetric part stimuli. This was first reliably observed over occipitoparietal electrodes during the N1 (140-200 ms) with a mean peak latency of 170 ms, and continued on subsequent P2 (220-260 ms) and N2 (260-320 ms) components. The differential sensitivity in perceptual processing during the N1 was accompanied by distinct microstate patterns that distinguished among contours, surfaces and volumes, and predominant theta band activity around 4-7 Hz over right occipitoparietal and orbitofrontal sites. These results provide the first evidence of early differential perceptual processing of higher order surface and volumetric shape structure within the first 200 ms of stimulus processing. The findings challenge theoretical models of object recognition that do not attribute functional significance to surface and volumetric object structure during visual perception.

Remediation of perceptual organisation in schizophrenia

Introduction Impaired perceptual organisation in schizophrenia has been repeatedly described in clinical and research literatures. It has also been associated with problems in more complex aspects of visual function, including visuospatial and visual cognitive test performance. Two therapeutic interventions were developed here that target perceptual organisation: (1) Computer-based training, which emphasized stimulus-driven processing (bottom-up approach), and (2) Instrumental Enrichment therapy, which is a therapist-guided interactive learning method (top-down approach). Methods Twenty-eight patients diagnosed with schizophrenia or schizoaffective disorder participated in a 12-week programme. For both forms of interventions, task difficulty increased progressively, based upon successful performance. The third group of patients, which served as controls, received a similar therapeutic intervention that did not include a perceptual organisation component. Before and after intervention, participants received tests of perceptual organisation, as well as a battery of neuropsychological tests. Results Results indicate that both forms of intervention improved perceptual organisation ability relative to the control condition. In addition, the improvement was found for select neuropsychological tests, although the pattern of improvement did not favour capacities more closely associated with visual organisational or visuospatial function. Conclusions Together, results demonstrate the effectiveness of new remediation protocols that target mid-level visual processing, which generalized to select visual cognitive functions.

Not-So-CLEVR: learning same-different relations strains feedforward neural networks

The advent of deep learning has recently led to great successes in various engineering applications. As a prime example, convolutional neural networks, a type of feedforward neural network, now approach human accuracy on visual recognition tasks like image classification and face recognition. However, here we will show that feedforward neural networks struggle to learn abstract visual relations that are effortlessly recognized by non-human primates, birds, rodents and even insects. We systematically study the ability of feedforward neural networks to learn to recognize a variety of visual relations and demonstrate that same-different visual relations pose a particular strain on these networks. Networks fail to learn same-different visual relations when stimulus variability makes rote memorization difficult. Further, we show that learning same-different problems becomes trivial for a feedforward network that is fed with perceptually grouped stimuli. This demonstration and the comparative success of biological vision in learning visual relations suggests that feedback mechanisms such as attention, working memory and perceptual grouping may be the key components underlying human-level abstract visual reasoning.

Adaptive and Selective Time Averaging of Auditory Scenes

To overcome variability, estimate scene characteristics, and compress sensory input, perceptual systems pool data into statistical summaries. Despite growing evidence for statistical representations in perception, the underlying mechanisms remain poorly understood. One example of such representations occurs in auditory scenes, where background texture appears to be represented with time-averaged sound statistics. We probed the averaging mechanism using "texture steps"-textures containing subtle shifts in stimulus statistics. Although generally imperceptible, steps occurring in the previous several seconds biased texture judgments, indicative of a multi-second averaging window. Listeners seemed unable to willfully extend or restrict this window but showed signatures of longer integration times for temporally variable textures. In all cases the measured timescales were substantially longer than previously reported integration times in the auditory system. Integration also showed signs of being restricted to sound elements attributed to a common source. The results suggest an integration process that depends on stimulus characteristics, integrating over longer extents when it benefits statistical estimation of variable signals and selectively integrating stimulus components likely to have a common cause in the world. Our methodology could be naturally extended to examine statistical representations of other types of sensory signals.

Can Rotational Grouping Be Determined by the Initial Conditions?

Objects rotating in depth with an ambiguous rotation direction frequently appear to rotate together. Corotation is especially strong when the objects are interpretable as having a shared axis. We manipulated the initial conditions of the experiment by having pairs of objects initially appear to be unambiguous, and then make either a sudden or gradual transition to ambiguous spin. We find that in neither case do coaxial counter-rotating objects persist in being perceived as counter-rotating. This implies that the perceptual constraint that favors coaxial corotation overrides the initial perceptual state of the objects.

Uncovering the Spatial Profile of Contour Integration from Fixational Saccades: Evidence for Widespread Processing in V1

During contour integration, neuronal populations in the primary visual cortex (V1) enhance their responses to the contour while suppressing their responses to the noisy background. However, the spatial extent and profile of these responses are not fully understood. To investigate this question, 2 monkeys were trained on a contour detection task while we measured population responses in V1 using voltage-sensitive dyes. During stimulus presentation the animals made few fixational saccades, and we used their changing gaze position to image and analyze neuronal responses from large part of the stimulus, encoding multiple contour/background elements. We found that contour enhancement was present over the entire contour-mapped areas. The background suppression increased with distance from the contour, extending into background-mapped areas remotely located from the contour. The spatial profile of enhancement and suppression fitted well with a Gaussian model. These results imply that the divergent cortical responses to contour integration are modulated independently and extend over large areas in V1.

Interactions between feedback and lateral connections in the primary visual cortex

Perceptual grouping of line segments into object contours has been thought to be mediated, in part, by long-range horizontal connectivity intrinsic to the primary visual cortex (V1), with a contribution by top-down feedback projections. To dissect the contributions of intraareal and interareal connections during contour integration, we applied conditional Granger causality analysis to assess directional influences among neural signals simultaneously recorded from visual cortical areas V1 and V4 of monkeys performing a contour detection task. Our results showed that discounting the influences from V4 markedly reduced V1 lateral interactions, indicating dependence on feedback signals of the effective connectivity within V1. On the other hand, the feedback influences were reciprocally dependent on V1 lateral interactions because the modulation strengths from V4 to V1 were greatly reduced after discounting the influences from other V1 neurons. Our findings suggest that feedback and lateral connections closely interact to mediate image grouping and segmentation.

Improving the Reliability of Tinnitus Screening in Laboratory Animals

Behavioral screening remains a contentious issue for animal studies of tinnitus. Most paradigms base a positive tinnitus test on an animal's natural tendency to respond to the "sound" of tinnitus as if it were an actual sound. As a result, animals with tinnitus are expected to display sound-conditioned behaviors when no sound is present or to miss gaps in background sounds because tinnitus "fills in the gap." Reliable confirmation of the behavioral indications of tinnitus can be problematic because the reinforcement contingencies of conventional discrimination tasks break down an animal's tendency to group tinnitus with sound. When responses in silence are rewarded, animals respond in silence regardless of their tinnitus status. When responses in silence are punished, animals stop responding. This study introduces stimulus classification as an alternative approach to tinnitus screening. Classification procedures train animals to respond to the common perceptual features that define a group of sounds (e.g., high pitch or narrow bandwidth). Our procedure trains animals to drink when they hear tinnitus and to suppress drinking when they hear other sounds. Animals with tinnitus are revealed by their tendency to drink in the presence of unreinforced probe sounds that share the perceptual features of the tinnitus classification. The advantages of this approach are illustrated by taking laboratory rats through a testing sequence that includes classification training, the experimental induction of tinnitus, and postinduction screening. Behavioral indications of tinnitus are interpreted and then verified by simulating a known tinnitus percept with objective sounds.

From Grouping to Coupling: A New Perceptual Organization in Vision, Psychology, and Biology

In this work, perceptual organization has been studied with the same spirit and phenomenological methods used by Gestalt psychologists. This was accomplished through new conditions that cannot be explained in terms of the classical principles of grouping. Perceptual grouping represents the way through which our visual system builds integrated elements on the basis of the maximal homogeneity among the components of the stimulus pattern. Our results demonstrated the inconsistency of organization by grouping, and more importantly, the inconsistency of the principle of similarity. On the contrary, they suggested the unique role played by the principle of dissimilarity among elements that behaves like an accent or a visual emphasis within a whole. The principle of accentuation was here considered as imparting a directional structure to the elements and to the whole object thus creating new phenomena. The salience of the resulting phenomena reveals the supremacy of dissimilarity in relation to similarity and the fact that it belongs to a further organization dynamics that we called “coupling.” In biology, coupling and its principle of accentuation are very strongly related to disruptive camouflage. Moreover, they are source of sexual attraction. They advertise the presence and elicit species identification/communication. In human beings accentuation is needed to show ourselves to others, to understand the way we dress, choose, and create clothes or invent fashion, the way we change our body accentuating several parts and hiding some others, the way we use maquillage. The existence of maquillage itself is derived from the need to accentuate something with the purpose to increase sexual attraction, to exhibit physical strength and beauty, to show or hide social status (e.g., being the king, a warrior, a priest, etc.). Last but not least, accentuation plays a basic role also in making it easier or difficult to read and understand written words.

Neural Computation of Surface Border Ownership and Relative Surface Depth from Ambiguous Contrast Inputs

The segregation of image parts into foreground and background is an important aspect of the neural computation of 3D scene perception. To achieve such segregation, the brain needs information about border ownership; that is, the belongingness of a contour to a specific surface represented in the image. This article presents psychophysical data derived from 3D percepts of figure and ground that were generated by presenting 2D images composed of spatially disjoint shapes that pointed inward or outward relative to the continuous boundaries that they induced along their collinear edges. The shapes in some images had the same contrast (black or white) with respect to the background gray. Other images included opposite contrasts along each induced continuous boundary. Psychophysical results demonstrate conditions under which figure-ground judgment probabilities in response to these ambiguous displays are determined by the orientation of contrasts only, not by their relative contrasts, despite the fact that many border ownership cells in cortical area V2 respond to a preferred relative contrast. Studies are also reviewed in which both polarity-specific and polarity-invariant properties obtain. The FACADE and 3D LAMINART models are used to explain these data.

Serial grouping of 2D-image regions with object-based attention in humans

After an initial stage of local analysis within the retina and early visual pathways, the human visual system creates a structured representation of the visual scene by co-selecting image elements that are part of behaviorally relevant objects. The mechanisms underlying this perceptual organization process are only partially understood. We here investigate the time-course of perceptual grouping of two-dimensional image-regions by measuring the reaction times of human participants and report that it is associated with the gradual spread of object-based attention. Attention spreads fastest over large and homogeneous areas and is slowed down at locations that require small-scale processing. We find that the time-course of the object-based selection process is well explained by a 'growth-cone' model, which selects surface elements in an incremental, scale-dependent manner. We discuss how the visual cortical hierarchy can implement this scale-dependent spread of object-based attention, leveraging the different receptive field sizes in distinct cortical areas.

DOI:http://dx.doi.org/10.7554/eLife.14320.001

When we look at an object, we perceive it as a whole. However, this is not how the brain processes objects. Instead, cells at early stages of the visual system respond selectively to single features of the object, such as edges. Moreover, each cell responds to its target feature in only a small region of space known as its receptive field. At higher levels of the visual system, cells respond to more complex features: angles rather than edges, for example. The receptive fields of the cells are also larger. For us to see an object, the brain must therefore 'stitch' together diverse features into a unified impression.

This process is termed perceptual grouping. But how does it work? Jeurissen et al. hypothesized that this process depends on the visual system’s attention spreading over a region in the image occupied by an object, and that the speed of the process will depend on the size of the receptive fields involved. If an image region is narrow, the visual system must recruit cells with small receptive fields to process the individual features. Grouping will therefore be slow. By contrast, if the object consists of large uniform areas lacking in detail, grouping should be fast. These assumptions give rise to a model called the “growth-conemodel”, which makes a number of specific predictions about reaction times during perceptual grouping.

Jeurissen et al. tested the growth-cone model’s predictions by measuring the speed of perceptual grouping in 160 human volunteers. These volunteers looked at an image made up of two simple shapes, and reported whether two dots fell on the same or different shapes. The results supported the growth-cone model. People were able to group large and uniform areas quickly, but were slower for narrow areas. Grouping also took more time when the distance between the dots increased. Hence, perceptual grouping of everyday objects calls on a step-by-step process that resembles solving a small maze.

The results also revealed that perceptual grouping of simple shapes relies on the spreading of visual attention over the relevant object. Furthermore, the data support the hypothesis that perceptual grouping makes use of the different sizes of receptive fields at various levels of the visual system. Further research will be needed to translate these findings to the more complex natural scenes we encounter in our daily lives.

DOI:http://dx.doi.org/10.7554/eLife.14320.002

Slowed Search in the Context of Unimpaired Grouping in Autism: Evidence from Multiple Conjunction Search

In multiple conjunction search, the target is not known in advance but is defined only with respect to the distractors in a given search array, thus reducing the contributions of bottom-up and top-down attentional and perceptual processes during search. This study investigated whether the superior visual search skills typically demonstrated by individuals with autism spectrum disorder (ASD) would be evident in multiple conjunction search. Thirty-two children with ASD and 32 age- and nonverbal IQ-matched typically developing (TD) children were administered a multiple conjunction search task. Contrary to findings from the large majority of studies on visual search in ASD, response times of individuals with ASD were significantly slower than those of their TD peers. Evidence of slowed performance in ASD suggests that the mechanisms responsible for superior ASD performance in other visual search paradigms are not available in multiple conjunction search. Although the ASD group failed to exhibit superior performance, they showed efficient search and intertrial priming levels similar to the TD group. Efficient search indicates that ASD participants were able to group distractors into distinct subsets. In summary, while demonstrating grouping and priming effects comparable to those exhibited by their TD peers, children with ASD were slowed in their performance on a multiple conjunction search task, suggesting that their usual superior performance in visual search tasks is specifically dependent on top-down and/or bottom-up attentional and perceptual processes.

The forest or the trees: preference for global over local image processing is reversed by prior experience in honeybees

Traditional models of insect vision have assumed that insects are only capable of low-level analysis of local cues and are incapable of global, holistic perception. However, recent studies on honeybee (Apis mellifera) vision have refuted this view by showing that this insect also processes complex visual information by using spatial configurations or relational rules. In the light of these findings, we asked whether bees prioritize global configurations or local cues by setting these two levels of image analysis in competition. We trained individual free-flying honeybees to discriminate hierarchical visual stimuli within a Y-maze and tested bees with novel stimuli in which local and/or global cues were manipulated. We demonstrate that even when local information is accessible, bees prefer global information, thus relying mainly on the object's spatial configuration rather than on elemental, local information. This preference can be reversed if bees are pre-trained to discriminate isolated local cues. In this case, bees prefer the hierarchical stimuli with the local elements previously primed even if they build an incorrect global configuration. Pre-training with local cues induces a generic attentional bias towards any local elements as local information is prioritized in the test, even if the local cues used in the test are different from the pre-trained ones. Our results thus underline the plasticity of visual processing in insects and provide new insights for the comparative analysis of visual recognition in humans and animals.

Perceptual Grouping Affects Haptic Enumeration Over the Fingers

Spatial arrangement is known to influence enumeration times in vision. In haptic enumeration, it has been shown that dividing the total number of items over the two hands can speed up enumeration. Here we investigated how spatial arrangement of items and non-items presented to the individual fingers impacts enumeration times. More specifically, we tested whether grouping by proximity facilitates haptic serial enumeration (counting). Participants were asked to report the number of tangible items, amongst non-items, presented to the finger pads of both hands. In the first experiment, we divided the tangible items in one, two, or three groups that were defined by proximity (i.e., one nonitem in between two groups) and found that number of groups and not number of items were the critical factor in enumeration times. In a second experiment, we found that this grouping even takes place when groups extend across fingers of both hands. These results suggest that grouping by proximity affects haptic serial enumeration and that this grouping takes place on a spatial level possibly in addition to the somatotopic level. Our results support the idea that grouping by proximity, a principle introduced in vision, also greatly affects haptic processing of spatial information.

Perception of visual apparent motion is modulated by a gap within concurrent auditory glides, even when it is illusory

Auditory and visual events often happen concurrently, and how they group together can have a strong effect on what is perceived. We investigated whether/how intra- or cross-modal temporal grouping influenced the perceptual decision of otherwise ambiguous visual apparent motion. To achieve this, we juxtaposed auditory gap transfer illusion with visual Ternus display. The Ternus display involves a multi-element stimulus that can induce either of two different percepts of apparent motion: ‘element motion’ (EM) or ‘group motion’ (GM). In “EM,” the endmost disk is seen as moving back and forth while the middle disk at the central position remains stationary; while in “GM,” both disks appear to move laterally as a whole. The gap transfer illusion refers to the illusory subjective transfer of a short gap (around 100 ms) from the long glide to the short continuous glide when the two glides intercede at the temporal middle point. In our experiments, observers were required to make a perceptual discrimination of Ternus motion in the presence of concurrent auditory glides (with or without a gap inside). Results showed that a gap within a short glide imposed a remarkable effect on separating visual events, and led to a dominant perception of GM as well. The auditory configuration with gap transfer illusion triggered the same auditory capture effect. Further investigations showed that visual interval which coincided with the gap interval (50–230 ms) in the long glide was perceived to be shorter than that within both the short glide and the ‘gap-transfer’ auditory configurations in the same physical intervals (gaps). The results indicated that auditory temporal perceptual grouping takes priority over the cross-modal interaction in determining the final readout of the visual perception, and the mechanism of selective attention on auditory events also plays a role.

Zen Mountains: An Illusion of Perceptual Transparency

The human visual system is usually very successful in segmenting complex natural scenes. During a trip to the Nepalese Himalayas, we observed an impossible example of Nature's beauty: "transparent" mountains. The scene is captured in a photograph in which a pair of mountain peaks viewed in the far distance appear to be transparent. This illusion results from a fortuitous combination of lighting and scene conditions, which induce an erroneous integration of multiple segmentation cues. The illusion unites three classic principles of visual perception: Metelli's constraints for perceptual transparency, the Gestalt principle of good continuation, and depth from contrast and atmospheric scattering. This real-world "failure" of scene segmentation reinforces how ingeniously the human visual system typically integrates complex sources of perceptual information using heuristics based on likelihood as shortcuts to veridical perception.

Coupled Segmentation of Nuclear and Membrane-bound Macromolecules through Voting and Multiphase Level Set

Membrane-bound macromolecules play an important role in tissue architecture and cell-cell communication, and is regulated by almost one-third of the genome. At the optical scale, one group of membrane proteins expresses themselves as linear structures along the cell surface boundaries, while others are sequestered; and this paper targets the former group. Segmentation of these membrane proteins on a cell-by-cell basis enables the quantitative assessment of localization for comparative analysis. However, such membrane proteins typically lack continuity, and their intensity distributions are often very heterogeneous; moreover, nuclei can form large clump, which further impedes the quantification of membrane signals on a cell-by-cell basis. To tackle these problems, we introduce a three-step process to (i) regularize the membrane signal through iterative tangential voting, (ii) constrain the location of surface proteins by nuclear features, where clumps of nuclei are segmented through a delaunay triangulation approach, and (iii) assign membrane-bound macromolecules to individual cells through an application of multi-phase geodesic level-set. We have validated our method using both synthetic data and a dataset of 200 images, and are able to demonstrate the efficacy of our approach with superior performance.

Inter-element orientation and distance influence the duration of persistent contour integration

Contour integration is a fundamental form of perceptual organization. We introduce a new method of studying the mechanisms responsible for contour integration. This method capitalizes on the perceptual persistence of contours under conditions of impending camouflage. Observers viewed arrays of randomly arranged line segments upon which circular contours comprised of similar line segments were superimposed via abrupt onset. Crucially, these contours remained visible for up to a few seconds following onset, but eventually disappeared due to the camouflaging effects of surrounding background line segments. Our main finding was that the duration of contour visibility depended on the distance and degree of co-alignment between adjacent contour segments such that relatively dense smooth contours persisted longest. The stimulus-related effects reported here parallel similar results from contour detection studies, and complement previous reported top–down influences on contour persistence (Strother et al., 2011). We propose that persistent contour visibility reflects the sustained activity of recurrent processing loops within and between visual cortical areas involved in contour integration and other important stages of visual object recognition.

Speeded classification in simultaneous masking

In simultaneous masking, flanking elements impair performance on a visual target. Previous studies on simultaneous masking have predominantly used discrimination threshold estimation to quantify performance on the target. Results based on thresholds suggest that an important factor in simultaneous masking is the strength of grouping between the target and the flankers. Recently Panis and Hermens (2014) showed that error rates in a speeded discrimination task, using the same simultaneous masking paradigm, provide a very similar pattern of results compared to thresholds from previous studies. In contrast, response times were found to deviate from the pattern in the error rates in some of the conditions, possibly providing a method to tap into low-level visual processes within the same paradigm. However, only a small number of masks was used, and it is therefore unclear to what extent differences can be found between thresholds, error rates, and response times. Here, we address this issue by examining speeded classification performance on a vernier target for a broad range of simultaneous mask layouts. Results suggest that thresholds and error rates are strongly associated, and that response times generally show the same pattern of results, although to a slightly weaker extent. We suggest that masking strength, defined by either measure, appears to be linked to target-flanker grouping rather than to low-level interactions.

How the venetian blind percept emerges from the laminar cortical dynamics of 3D vision

The 3D LAMINART model of 3D vision and figure-ground perception is used to explain and simulate a key example of the Venetian blind effect and to show how it is related to other well-known perceptual phenomena such as Panum's limiting case. The model proposes how lateral geniculate nucleus (LGN) and hierarchically organized laminar circuits in cortical areas V1, V2, and V4 interact to control processes of 3D boundary formation and surface filling-in that simulate many properties of 3D vision percepts, notably consciously seen surface percepts, which are predicted to arise when filled-in surface representations are integrated into surface-shroud resonances between visual and parietal cortex. Interactions between layers 4, 3B, and 2/3 in V1 and V2 carry out stereopsis and 3D boundary formation. Both binocular and monocular information combine to form 3D boundary and surface representations. Surface contour surface-to-boundary feedback from V2 thin stripes to V2 pale stripes combines computationally complementary boundary and surface formation properties, leading to a single consistent percept, while also eliminating redundant 3D boundaries, and triggering figure-ground perception. False binocular boundary matches are eliminated by Gestalt grouping properties during boundary formation. In particular, a disparity filter, which helps to solve the Correspondence Problem by eliminating false matches, is predicted to be realized as part of the boundary grouping process in layer 2/3 of cortical area V2. The model has been used to simulate the consciously seen 3D surface percepts in 18 psychophysical experiments. These percepts include the Venetian blind effect, Panum's limiting case, contrast variations of dichoptic masking and the correspondence problem, the effect of interocular contrast differences on stereoacuity, stereopsis with polarity-reversed stereograms, da Vinci stereopsis, and perceptual closure. These model mechanisms have also simulated properties of 3D neon color spreading, binocular rivalry, 3D Necker cube, and many examples of 3D figure-ground separation.

fMRI correlates of object-based attentional facilitation vs. suppression of irrelevant stimuli, dependent on global grouping and endogenous cueing

Theories of object-based attention often make two assumptions: that attentional resources are facilitatory, and that they spread automatically within grouped objects. Consistent with this, ignored visual stimuli can be easier to process, or more distracting, when perceptually grouped with an attended target stimulus. But in past studies, the ignored stimuli often shared potentially relevant features or locations with the target. In this fMRI study, we measured the effects of attention and grouping on Blood Oxygenation Level Dependent (BOLD) responses in the human brain to entirely task-irrelevant events. Two checkerboards were displayed each in opposite hemifields, while participants responded to check-size changes in one pre-cued hemifield, which varied between blocks. Grouping (or segmentation) between hemifields was manipulated between blocks, using common (vs. distinct) motion cues. Task-irrelevant transient events were introduced by randomly changing the color of either checkerboard, attended or ignored, at unpredictable intervals. The above assumptions predict heightened BOLD signals for irrelevant events in attended vs. ignored hemifields for ungrouped contexts, but less such attentional modulation under grouping, due to automatic spreading of facilitation across hemifields. We found the opposite pattern, in primary visual cortex. For ungrouped stimuli, BOLD signals associated with task-irrelevant changes were lower, not higher, in the attended vs. ignored hemifield; furthermore, attentional modulation was not reduced but actually inverted under grouping, with higher signals for events in the attended vs. ignored hemifield. These results challenge two popular assumptions underlying object-based attention. We consider a broader biased-competition framework: task-irrelevant stimuli are suppressed according to how strongly they compete with task-relevant stimuli, with intensified competition when the irrelevant features or locations comprise the same object.

Segmentation decreases the magnitude of the tilt illusion

In the tilt illusion, the perceived orientation of a target grating depends strongly on the orientation of a surround. When the orientations of the center and surround gratings differ by a small angle, the center grating appears to tilt away from the surround orientation (repulsion), whereas for a large difference in angle, the center appears to tilt toward the surround orientation (attraction). In order to understand how segmentation/perceptual grouping of the center and surround affect the magnitude of the tilt illusion, we conducted three psychophysical experiments in which we measured observers' perception of center orientation as a function of center-surround relative contrast, relative disparity depth, and geometric features such as occlusion and collinearity. All of these manipulations affected the strength of perceived orientation bias in the center. Our results suggest that if stronger segmentation/perceptual grouping is induced between the center and surround, the tilt repulsion bias decreases/increases. A grouping-dependent tilt illusion plays an important role in visual search and detection by enhancing the sensitivity of our visual system to feature discrepancies, especially in relatively homogenous environments.

Individual differences in the perception of biological motion and fragmented figures are not correlated

We live in a cluttered, dynamic visual environment that poses a challenge for the visual system: for objects, including those that move about, to be perceived, information specifying those objects must be integrated over space and over time. Does a single, omnibus mechanism perform this grouping operation, or does grouping depend on separate processes specialized for different feature aspects of the object? To address this question, we tested a large group of healthy young adults on their abilities to perceive static fragmented figures embedded in noise and to perceive dynamic point-light biological motion figures embedded in dynamic noise. There were indeed substantial individual differences in performance on both tasks, but none of the statistical tests we applied to this data set uncovered a significant correlation between those performance measures. These results suggest that the two tasks, despite their superficial similarity, require different segmentation and grouping processes that are largely unrelated to one another. Whether those processes are embodied in distinct neural mechanisms remains an open question.

Configural Gestalts remain nothing more than the sum of their parts in visual agnosia

We report converging evidence that higher stages of the visual system are critically required for the whole to become more than the sum of its parts by studying patient DF with visual agnosia using a configural superiority paradigm. We demonstrate a clear dissociation between this patient and normal controls such that she could more easily report information about parts, demonstrating a striking reversal of the normal configural superiority effect. Furthermore, by comparing DF's performance to earlier neuroimaging and novel modeling work, we found a compelling consistency between her performance and representations in the early visual areas, which are spared in this patient. The reversed pattern of performance in this patient highlights that in some cases visual Gestalts do not emerge early on without processing in higher visual areas. More broadly, this study demonstrates how neuropsychological patients can be used to unmask representations maintained at early stages of processing.

Collinear integration affects visual search at V1

Perceptual grouping plays an indispensable role in figure-ground segregation and attention distribution. For example, a column pops out if it contains element bars orthogonal to uniformly oriented element bars. Jingling and Tseng (2013) have reported that contextual grouping in a column matters to visual search behavior: When a column is grouped into a collinear (snakelike) structure, a target positioned on it became harder to detect than on other noncollinear (ladderlike) columns. How and where perceptual grouping interferes with selective attention is still largely unknown. This article contributes to this little-studied area by asking whether collinear contour integration interacts with visual search before or after binocular fusion. We first identified that the previously mentioned search impairment occurs with a distractor of five or nine elements but not one element in a 9 × 9 search display. To pinpoint the site of this effect, we presented the search display with a short collinear bar (one element) to one eye and the extending collinear bars to the other eye, such that when properly fused, the combined binocular collinear length (nine elements) exceeded the critical length. No collinear search impairment was observed, implying that collinear information before binocular fusion shaped participants' search behavior, although contour extension from the other eye after binocular fusion enhanced the effect of collinearity on attention. Our results suggest that attention interacts with perceptual grouping as early as V1.

Using a staircase procedure for the objective measurement of auditory stream integration and segregation thresholds

Auditory scene analysis describes the ability to segregate relevant sounds out from the environment and to integrate them into a single sound stream using the characteristics of the sounds to determine whether or not they are related. This study aims to contrast task performances in objective threshold measurements of segregation and integration using identical stimuli, manipulating two variables known to influence streaming, inter-stimulus-interval (ISI) and frequency difference (Δf). For each measurement, one parameter (either ISI or Δf) was held constant while the other was altered in a staircase procedure. By using this paradigm, it is possible to test within-subject across multiple conditions, covering a wide Δf and ISI range in one testing session. The objective tasks were based on across-stream temporal judgments (facilitated by integration) and within-stream deviance detection (facilitated by segregation). Results show the objective integration task is well suited for combination with the staircase procedure, as it yields consistent threshold measurements for separate variations of ISI and Δf, as well as being significantly related to the subjective thresholds. The objective segregation task appears less suited to the staircase procedure. With the integration-based staircase paradigm, a comprehensive assessment of streaming thresholds can be obtained in a relatively short space of time. This permits efficient threshold measurements particularly in groups for which there is little prior knowledge on the relevant parameter space for streaming perception.