The neural basis of visual symmetry and its role in mid- and high-level visual processing

The interplay between spatial and non-spatial grouping cues over approximate number perception

Humans and animals share the cognitive ability to quickly extract approximate number information from sets. Main psychophysical models suggest that visual approximate numerosity relies on segmented units, which can be affected by Gestalt rules. Indeed, arrays containing spatial grouping cues, such as connectedness, closure, and even symmetry, are underestimated compared to ungrouped arrays with equal low-level features. Recent evidence suggests that non-spatial cues, such as color-similarity, also trigger numerosity underestimation. However, in natural vision, several grouping cues may coexist in the scene. Notably, conjunction of grouping cues (color and closure) reduces perceived numerosity following an additive rule. To test whether the conjunction-effect holds for other Gestalt cues, we investigated the effect of connectedness and symmetry over numerosity perception both in isolation and, critically, in conjunction with luminance similarity. Participants performed a comparison-task between a reference and a test stimulus varying in numerosity. In Experiment 1, test stimuli contained two isolated groupings (connectedness or luminance), a conjunction (connectedness and luminance), and a neutral condition (no groupings). Results show that point of subjective equality was higher in both isolated grouping conditions compared to the neutral condition. Furthermore, in the conjunction condition, the biases from isolated grouping cues added linearly, resulting in a numerosity underestimation equal to the sum of the isolated biases. In Experiment 2 we found that conjunction of symmetry and luminance followed the same additive rule. These findings strongly suggest that both spatial and non-spatial isolated cues affect numerosity perception. Crucially, we show that their conjunction effect extends to symmetry and connectedness.

When does perceptual organization happen?

Reflectional (mirror) symmetry is an important visual cue for perceptual organization. The brain processes symmetry rapidly and efficiently. Previous work suggests that symmetry activates the extrastriate cortex and generates an event related potential (ERP) called the Sustained Posterior Negativity (SPN). It has been claimed that no tasks completely block symmetry processing and abolish the SPN. We tested the limits of this claim with a series of eight new Electroencephalography (EEG) experiments (344 participants in total). All experiments used the same symmetrical or asymmetrical dot patterns. When participants attended to regularity in Experiment 1, there was a substantial SPN (Mean amplitude = -2.423 μV). The SPN was reduced, but not abolished, when participants discriminated dot luminance in Experiments 2 and 3 (-.835 and -1.410 μV) or the aspect ratio of a superimposed cross in Experiments 4 and 5 (-.722 and -.601 μV). The SPN also survived when the background pattern was potentially disruptive to the primary task in Experiment 6 (-1.358 μV) and when participants classified negative superimposed words in Experiment 7 (-.510 μV). Finally, the SPN remained when participants attended to the orientation of a diagonal line in Experiment 8 (-.589 μV). While task manipulations can turn down the extrastriate symmetry activation, they cannot render the system completely unresponsive. Permanent readiness to detect reflectional symmetry at the centre of the visual field could be an evolved adaptation.

The extrastriate symmetry response is robust to alcohol intoxication

Visual symmetry activates a network of regions in the extrastriate cortex and generates an event-related potential (ERP) called the sustained posterior negativity (SPN). Previous work has found that the SPN is robust to experimental manipulations of task, spatial attention, and memory load. In the current study, we investigated whether the SPN is also robust to alcohol-induced changes in mental state. A pilot experiment (N = 13) found that alcohol unexpectedly increased SPN amplitude. We followed this unexpected result with two new experiments on separate groups, using an alcohol challenge paradigm. One group completed an Oddball discrimination task (N = 26). Another group completed a Regularity discrimination task (N = 26). In both groups, participants consumed a medium dose of alcohol (0.65 g/kg body weight) and a placebo drink, in separate sessions. Alcohol reduced SPN amplitude in the Oddball task (contrary to the pilot results) but had no effect on SPN amplitude in the Regularity task. In contrast, the N1 wave was consistently dampened by alcohol in all experiments. Exploratory analysis indicated that the inconsistent effect of alcohol on SPN amplitude may be partly explained by individual differences in alcohol use. Alcohol reduced the SPN in light drinkers and increased it in heavier drinkers. Despite remaining questions, the results highlight the automaticity of symmetry processing. Symmetry still produces a large SPN response, even when participants are intoxicated, and even when symmetry is not task relevant.

Event related potentials (ERP) reveal a robust response to visual symmetry in unattended visual regions

Visual symmetry at fixation generates a bilateral Event Related Potential (ERP) called the Sustained Posterior Negativity (SPN). Symmetry presented in the left visual hemifield generates a contralateral SPN over the right hemisphere and vice versa. The current study examined whether the contralateral SPN is modulated by the focus of spatial attention. On each trial there were two dot patterns, one to the left of fixation, and one to the right of fixation. A central arrow cue pointed to one of the patterns and participants discriminated its regularity (symmetry or random). We compared contralateral SPN amplitude generated by symmetry at attended and unattended spatial locations. While the response to attended symmetry was slightly enhanced, the response to unattended symmetry was still substantial. Although visual symmetry detection is a computational challenge, we conclude that the brain processes visual symmetry in unattended parts of the visual field.

The quest for psychological symmetry through figural goodness, randomness, and complexity: A selective review

Of the four interrelated concepts in the title, only symmetry has an exact mathematical definition. In mathematical development, symmetry is a graded variable-in marked contrast with the popular binary conception of symmetry in and out of the laboratory (i.e. an object is either symmetrical or nonsymmetrical). Because the notion does not have a direct graded perceptual counterpart (experimental participants are not asked about the amount of symmetry of an object), students of symmetry have taken various detours to characterize the perceptual effects of symmetry. Current approaches have been informed by information theory, mathematical group theory, randomness research, and complexity. Apart from reviewing the development of the main approaches, for the first time we calculated associations between figural goodness as measured in the Garner tradition and measures of algorithmic complexity and randomness developed in recent research. We offer novel ideas and analyses by way of integrating the various approaches.

Combining and segmenting geometric shapes into parts depending on symmetry type: Evidence from children and adults

Symmetry is an important geometric feature that affects object segmentation into parts, though De Winter and Wagemans note that partly occluded objects can still be identified by the remaining visible parts. In two sets of experiments with children (n = 31, age 7-11, M = 8.8, SD = 1.4) and adults (n = 19, age 17-57, M = 30.4, SD = 12.6), we used 13 basic geometric figures distinguished by symmetry types to test how they are naturally segmented or combined and what the developmental impacts are on the segmentation and combination. In the first experiment, participants were asked to cut figures into two along a straight line; in the second experiment, participants had to create five sets of connected two-figure combinations where overlapping figures were allowed. The results confirmed the importance of the symmetry axis in both tasks. Other relevant criteria were dividing into half, maximal/minimal curvature, and use of edges or corners for reference. This study allows comparisons of the impact of symmetry type on the segmentation and combining of geometric figures and indicates developmental differences between children and adults.

Let's put a smile on that face-A positive facial expression improves aesthetics of portrait photographs

In today's age of social media and smartphones, portraits-such as selfies or pictures of friends and family-are very frequently produced, shared and viewed images. Despite their prevalence, the psychological factors that characterize a 'good' photo-one that people will generally like, keep, and think is especially aesthetically pleasing-are not well understood. Here, we studied how a subtle change in facial expression (smiling) in portraits determines their aesthetic image value (beyond a more positive appearance of the depicted person). We used AI-based image processing tools in a broad set of portrait photographs and generated neutral and slightly smiling versions of the same pictures. Consistent across two experiments, portraits with a subtle smile increased both spontaneous aesthetic preferences in a swiping task as well as improving more explicit aesthetic ratings after prolonged viewing. Participants distinguished between aspects associated with image beauty and the depicted person's attractiveness, resulting in specific interactions between variables related to participant traits, image content, and task. Our study confirms that a subtle-and in this case fully artificial-smile reliably increases the aesthetic quality of portraits, illustrating how current image processing methods can target psychologically important variables and thereby increase the aesthetic value of photographs.

An Attempt to Explain Visual Aesthetic Appreciation

We suggest an evolutionary based explanation for why humans are preoccupied with aesthetic aspects of visual input. Briefly, humans evolved to be swayed by positive and negative feelings in the form of rewards and punishments, and to pursue situations that induce rewards, even when the feeling is not sufficiently strong to be recognized as a reward. The brain is designed to offer rewards when a person focuses on certain types of visual stimuli. For example, warm colors are typically pleasant because they are associated with edible fruits, and complex images appeal to curiosity. At some point people began exploiting these types of brain rewards by beautifying objects and creating art. The utility of objects, and the associative (or communicative) aspects of art, may dominate the design, but the artist tends to add aesthetic elements. These elements imply visual aspects that do not add to the functional value or evoke memories or associations based on easily recognized features in the picture. The adaptive rationale for the rewards offered by the aesthetic elements should help explain human aesthetic appreciation.

Effects of the social context on the neurophysiological correlates of observed error monitoring

Monitoring the motor performance of others, including the correctness of their actions, is crucial for the human behavior. However, while performance (and error) monitoring of the own actions has been studied extensively at the neurophysiological level, the corresponding studies on monitoring of others' errors are scarce, especially for ecological actions. Moreover, the role of the context of the observed action has not been sufficiently explored. To fill this gap, the present study investigated electroencephalographic (EEG) indices of error monitoring during observation of images of interrupted reach-to-grasp actions in social (an object held in another person's hand) and non-social (an object placed on a table) contexts. Analysis in time- and time-frequency domain showed that, at the level of conscious error awareness, there were no effects of the social context (observed error positivity was present for erroneous actions in both contexts). However, the effects of the context were present at the level of hand image processing: observing erroneous actions in the non-social context was related to larger occipito-temporal N1 and theta activity, while in the social context this pattern was reversed, i.e., larger N1 and theta activity were present for the correct actions. These results suggest that, in case of easily predictable ecological actions, action correctness is processed as early as at the level of hand image perception, since the hand posture conveys information about the action (e.g., motor intention). The social context of actions might make the correct actions more salient, possibly through the saliency of the correctly achieved common goal.

Symmetries and asymmetries in the neural encoding of 3D space

The neural coding of space centres on three foundational cell types: place cells, head direction cells and grid cells. One notable characteristic of these neurons is the symmetry properties of their spatial firing patterns. In symmetric environments, firing patterns are often also symmetric: for example, place cells show translational symmetry in aligned sub-compartments of a multi-compartment environment. A single head direction cell has a mirror-symmetric firing pattern, while a sub-class of head direction cells can show multi-fold rotational symmetries in multi-compartment environments, matching the symmetry of the recently experienced environment. The entorhinal grid cells are notable for the symmetry of their firing patterns in both rotational and translational domains. However, these symmetries are broken in a variety of situations. These symmetry-making and -breaking observations shed light on the underlying computations that generate these firing patterns, and also invite speculation as to whether they may have a functional role. This article outlines these findings and speculates on the consequences of the resultant firing symmetries and asymmetries for spatial coding and cognition. This article is part of a discussion meeting issue 'New approaches to 3D vision'.

Mirror symmetry and aging: The role of stimulus figurality and attention to colour

Symmetry perception studies have generally used two stimulus types: figural and dot patterns. Here, we designed a novel figural stimulus-a wedge pattern-made of centrally aligned pseudorandomly positioned wedges. To study the effect of pattern figurality and colour on symmetry perception, we compared symmetry detection in multicoloured wedge patterns with nonfigural dot patterns in younger and older adults. Symmetry signal was either segregated or nonsegregated by colour, and the symmetry detection task was performed under two conditions: with or without colour-based attention. In the first experiment, we compared performance for colour-symmetric patterns that varied in the number of wedges (24 vs. 36) and number of colours (2 vs. 3) and found that symmetry detection was facilitated by attention to colour when symmetry and noise signals were segregated by colour. In the second experiment, we compared performance for wedge and dot patterns on a sample of younger and older participants. Effects of attention to colour in segregated stimuli were magnified for wedge compared with dot patterns, with older and younger adults showing different effects of attention to colour on performance. Older adults significantly underperformed on uncued wedge patterns compared with dot patterns, but their performance improved greatly through colour cueing, reaching performance levels similar to young participants. Thus, while confirming the age-related decline in symmetry detection, we found that this deficit could be alleviated in figural multicoloured patterns by attending to the colour that carries the symmetry signal.

The contour effect: Differences in the aesthetic preference and stress response to photo-realistic living environments

The interest in the response to contours has recently re-emerged, with various studies suggesting a universal preference for curved over angular stimuli. Although no consensus has yet been reached on the reasons for this preference, similar effects have been proposed in interior environments. However, the scarcely available research primarily depends on schematic or unmatched stimuli and faces heterogeneity in the reported results. In a within-subject design, we investigated the claimed contour effect in photo-realistic indoor environments using stimulus material previously tested in virtual reality (VR). A total of 198 online participants rated 20 living room images, exclusively manipulated on the contours (angular vs. curved) and style (modern vs. classic) levels. The scales represented aesthetic (beauty and liking) and stress (rest and stress) responses. Beyond our main focus on contours, we additionally examined style and sex effects to account for potential interactions. Results revealed a significant main effect of contours on both aesthetic (η2g = 1–2%) and stress (η2g = 8–12%) ratings. As expected, images of curved (vs. angular) contours scored higher on beauty, liking, and rest scales, and lower on stress. Regarding interactions with style, curvature was aesthetically preferred over angularity only within images depicting modern interiors, however, its positive effect on stress responses remained significant irrespective of style. Furthermore, we observed sex differences in aesthetic but not in stress evaluations, with curvature preference only found in participants who indicated female as their sex. In sum, our study primarily confirms positive effects of curvature, however, with multiple layers. First, the impact on aesthetic preference seems to be influenced by individual and contextual factors. Second, in terms of stress responses, which might be especially relevant for designs intended to promote mental-health, the consistent effects suggest a more generalizable, potentially biophilic characteristic of curves. To the best of our knowledge, this is the first study to demonstrate these effects in fully-matched, photo-realistic, and multi-perspective interior design stimuli. From the background of a previous VR trial from our research group, whereby the same rooms did not elicit any differences, our findings propose that static vs. immersive presentations might yield different results in the response to contours.

Overlapping Neural Responses to Reflectional Symmetry and Glass Patterns Revealed by an ERP Priming Paradigm

The extrastriate visual cortex is activated by visual regularity and generates an ERP known as the sustained posterior negativity (SPN). Spatial filter models offer a biologically plausible account of regularity detection based on the spectral properties of an image. These models are specific to reflection and therefore imply that reflectional symmetry and Glass patterns are coded by different neural populations. We utilised the SPN priming effect to probe representational overlap between reflection and Glass patterns. For each trial, participants were presented with a rapid succession of three patterns. In the Repeated condition, three reflections or three Glass patterns were presented. In the Changing condition, patterns alternated between reflection and Glass patterns. An increase in SPN amplitude (priming) was observed in both the Repeated and Changing conditions. Results indicate a greater representational overlap in the brain between reflection and Glass patterns than predicted by spatial filter models.

Lessons from a catalogue of 6674 brain recordings

It is now possible for scientists to publicly catalogue all the data they have ever collected on one phenomenon. For a decade, we have been measuring a brain response to visual symmetry called the sustained posterior negativity (SPN). Here we report how we have made a total of 6674 individual SPNs from 2215 participants publicly available, along with data extraction and visualization tools (https://osf.io/2sncj/). We also report how re-analysis of the SPN catalogue has shed light on aspects of the scientific process, such as statistical power and publication bias, and revealed new scientific insights.

The emergence of view-symmetric neural responses to familiar and unfamiliar faces

Successful recognition of familiar faces is thought to depend on the ability to integrate view-dependent representations of a face into a view-invariant representation. It has been proposed that a key intermediate step in achieving view invariance is the representation of symmetrical views. However, key unresolved questions remain, such as whether these representations are specific for naturally occurring changes in viewpoint and whether view-symmetric representations exist for familiar faces. To address these issues, we compared behavioural and neural responses to natural (canonical) and unnatural (noncanonical) rotations of the face. Similarity judgements revealed that symmetrical viewpoints were perceived to be more similar than non-symmetrical viewpoints for both canonical and non-canonical rotations. Next, we measured patterns of neural response from early to higher level regions of visual cortex. Early visual areas showed a view-dependent representation for natural or canonical rotations of the face, such that the similarity between patterns of response were related to the difference in rotation. View symmetric patterns of neural response to canonically rotated faces emerged in higher visual areas, particularly in face-selective regions. The emergence of a view-symmetric representation from a view-dependent representation for canonical rotations of the face was also evident for familiar faces, suggesting that view-symmetry is an important intermediate step in generating view-invariant representations. Finally, we measured neural responses to unnatural or non-canonical rotations of the face. View-symmetric patterns of response were also found in face-selective regions. However, in contrast to natural or canonical rotations of the face, these view-symmetric responses did not arise from an initial view-dependent representation in early visual areas. This suggests differences in the way that view-symmetrical representations emerge with canonical or non-canonical rotations. The similarity in the neural response to canonical views of familiar and unfamiliar faces in the core face network suggests that the neural correlates of familiarity emerge at later stages of processing.

Superordinate Categorization Based on the Perceptual Organization of Parts

Plants and animals are among the most behaviorally significant superordinate categories for humans. Visually assigning objects to such high-level classes is challenging because highly distinct items must be grouped together (e.g., chimpanzees and geckos) while more similar items must sometimes be separated (e.g., stick insects and twigs). As both animals and plants typically possess complex multi-limbed shapes, the perceptual organization of shape into parts likely plays a crucial rule in identifying them. Here, we identify a number of distinctive growth characteristics that affect the spatial arrangement and properties of limbs, yielding useful cues for differentiating plants from animals. We developed a novel algorithm based on shape skeletons to create many novel object pairs that differ in their part structure but are otherwise very similar. We found that particular part organizations cause stimuli to look systematically more like plants or animals. We then generated other 110 sequences of shapes morphing from animal- to plant-like appearance by modifying three aspects of part structure: sprouting parts, curvedness of parts, and symmetry of part pairs. We found that all three parameters correlated strongly with human animal/plant judgments. Together our findings suggest that subtle changes in the properties and organization of parts can provide powerful cues in superordinate categorization.

Haemodynamic Signatures of Temporal Integration of Visual Mirror Symmetry

EEG, fMRI and TMS studies have implicated the extra-striate cortex, including the Lateral Occipital Cortex (LOC), in the processing of visual mirror symmetries. Recent research has found that the sustained posterior negativity (SPN), a symmetry specific electrophysiological response identified in the region of the LOC, is generated when temporally displaced asymmetric components are integrated into a symmetric whole. We aim to expand on this finding using dynamic dot-patterns with systematically increased intra-pair temporal delay to map the limits of temporal integration of visual mirror symmetry. To achieve this, we used functional near-infrared spectroscopy (fNIRS) which measures the changes in the haemodynamic response to stimulation using near infrared light. We show that a symmetry specific haemodynamic response can be identified following temporal integration of otherwise meaningless dot-patterns, and the magnitude of this response scales with the duration of temporal delay. These results contribute to our understanding of when and where mirror symmetry is processed in the visual system. Furthermore, we highlight fNIRS as a promising but so far underutilised method of studying the haemodynamics of mid-level visual processes in the brain.

Swipes and Saves: A Taxonomy of Factors Influencing Aesthetic Assessments and Perceived Beauty of Mobile Phone Photographs

Digital images taken by mobile phones are the most frequent class of images created today. Due to their omnipresence and the many ways they are encountered, they require a specific focus in research. However, to date, there is no systematic compilation of the various factors that may determine our evaluations of such images, and thus no explanation of how users select and identify relatively “better” or “worse” photos. Here, we propose a theoretical taxonomy of factors influencing the aesthetic appeal of mobile phone photographs. Beyond addressing relatively basic/universal image characteristics, perhaps more related to fast (bottom-up) perceptual processing of an image, we also consider factors involved in the slower (top-down) re-appraisal or deepened aesthetic appreciation of an image. We span this taxonomy across specific types of picture genres commonly taken—portraits of other people, selfies, scenes and food. We also discuss the variety of goals, uses, and contextual aspects of users of mobile phone photography. As a working hypothesis, we propose that two main decisions are often made with mobile phone photographs: (1) Users assess images at a first glance—by swiping through a stack of images—focusing on visual aspects that might be decisive to classify them from “low quality” (too dark, out of focus) to “acceptable” to, in rare cases, “an exceptionally beautiful picture.” (2) Users make more deliberate decisions regarding one’s “favorite” picture or the desire to preserve or share a picture with others, which are presumably tied to aspects such as content, framing, but also culture or personality, which have largely been overlooked in empirical research on perception of photographs. In sum, the present review provides an overview of current focal areas and gaps in research and offers a working foundation for upcoming research on the perception of mobile phone photographs as well as future developments in the fields of image recording and sharing technology.

Perspective Slant Makes Symmetry Harder to Detect and Less Aesthetically Appealing

Abstract symmetric patterns are generally preferred to less regular patterns. Here, we studied 2D patterns presented as 2D images in the plane, and therefore producing a symmetric pattern on the retina, and the same patterns seen in perspective. This perspective transformation eliminates the presence of perfect symmetry in terms of retinotopic coordinates. Stimuli were abstract patterns of local coplanar elements, or irregular polygons. In both cases they can be understood as 2D patterns on a transparent glass pane. In the first study we found that perspective increased reaction time and errors in a classification task, even when the viewing angle was kept constant over many images. In a second study we tested a large sample (148 participants) and asked for a rating of beauty for the same images. In addition, we used the Cognitive Reflection Test (CRT) to test the hypothesis that people who tend to give the more immediate and intuitive answer would also show a stronger preference for the symmetry presented in the frontoparallel plane (in the image and on the retina). Preference for symmetry was confirmed, and there was a cost for perspective viewing. CRT scores were not related to preference, thus not supporting the hypothesis of a stronger preference for symmetry in the image when people follow a more immediate and intuitive gut response.

Electrophysiological evidence of the amodal representation of symmetry in extrastriate areas

Extrastriate visual areas are strongly activated by image symmetry. Less is known about symmetry representation at object-level rather than image-level. Here we investigated electrophysiological responses to symmetry, generated by amodal completion of partially-occluded polygon shapes. We used a similar paradigm in four experiments (N = 112). A fully-visible abstract shape (either symmetric or asymmetric) was presented for 250 ms (t0). A large rectangle covered it entirely for 250 ms (t1) and then moved to one side to reveal one half of the shape hidden behind (t2, 1000 ms). Note that at t2 no symmetry could be extracted from retinal image information. In half of the trials the shape was the same as previously presented, in the other trials it was replaced by a novel shape. Participants matched shapes similarity (Exp. 1 and Exp. 2), or their colour (Exp. 3) or the orientation of a triangle superimposed to the shapes (Exp. 4). The fully-visible shapes (t0-t1) elicited automatic symmetry-specific ERP responses in all experiments. Importantly, there was an exposure-dependent symmetry-response to the occluded shapes that were recognised as previously seen (t2). Exp. 2 and Exp.4 confirmed this second ERP (t2) did not reflect a reinforcement of a residual carry-over response from t0. We conclude that the extrastriate symmetry-network can achieve amodal representation of symmetry from occluded objects that have been previously experienced as wholes.

Neural correlates of local parallelism during naturalistic vision

Human observers can rapidly perceive complex real-world scenes. Grouping visual elements into meaningful units is an integral part of this process. Yet, so far, the neural underpinnings of perceptual grouping have only been studied with simple lab stimuli. We here uncover the neural mechanisms of one important perceptual grouping cue, local parallelism. Using a new, image-computable algorithm for detecting local symmetry in line drawings and photographs, we manipulated the local parallelism content of real-world scenes. We decoded scene categories from patterns of brain activity obtained via functional magnetic resonance imaging (fMRI) in 38 human observers while they viewed the manipulated scenes. Decoding was significantly more accurate for scenes containing strong local parallelism compared to weak local parallelism in the parahippocampal place area (PPA), indicating a central role of parallelism in scene perception. To investigate the origin of the parallelism signal we performed a model-based fMRI analysis of the public BOLD5000 dataset, looking for voxels whose activation time course matches that of the locally parallel content of the 4916 photographs viewed by the participants in the experiment. We found a strong relationship with average local symmetry in visual areas V1-4, PPA, and retrosplenial cortex (RSC). Notably, the parallelism-related signal peaked first in V4, suggesting V4 as the site for extracting paralleism from the visual input. We conclude that local parallelism is a perceptual grouping cue that influences neuronal activity throughout the visual hierarchy, presumably starting at V4. Parallelism plays a key role in the representation of scene categories in PPA.

The chronometry of symmetry detection in the lateral occipital (LO) cortex

The lateral occipital cortex (LO) has been shown to code the presence of both vertical and horizontal visual symmetry in dot patterns. However, the specific time window at which LO is causally involved in symmetry encoding has not been investigated. This was assessed using a chronometric transcranial magnetic stimulation (TMS) approach. Participants were presented with a series of dot configurations and instructed to judge whether they were symmetric along the vertical axis or not while receiving a double pulse of TMS over either the right LO (rLO) or the vertex (baseline) at different time windows (ranging from 50 ms to 290 ms from stimulus onset). We found that TMS delivered over the rLO significantly decreased participants' accuracy in discriminating symmetric from non-symmetric patterns when TMS was applied between 130 ms and 250 ms from stimulus onset, suggesting that LO is causally involved in symmetry perception within this time window. These findings confirm and extend prior neuroimaging and ERP evidence by demonstrating not only that LO is causally involved in symmetry encoding but also that its contribution occurs in a relatively large temporal window, at least in tasks requiring fast discrimination of mirror symmetry in briefly (75 ms) presented patterns as in our study.

Neural responses to reflection symmetry for shapes defined by binocular disparity, and for shapes perceived as regions of background

Human perception of symmetry is associated with activation in an extended network of extrastriate visual areas. This activation generates an ERP called the Sustained Posterior Negativity (SPN). In most studies so far, the stimuli have been defined by luminance. We tested whether the SPN is present when stimuli are defined by stereoscopic disparity using random dot stereograms (RDS). In Experiment 1, we compared the SPN signal for contours specified by binocular disparity and contours specified by monocular cues. The SPN was equivalent, suggesting that the type of contour does not alter the SPN signal. In Experiment 2 we exploited the unique property of RDS to provide unambiguous figure-ground arrangements. Psychophysical work has shown that symmetry is more easily detected when it is a property of a single object (i.e., within a figure), compared to a property of a gap between two objects (i.e., the ground). Therefore, the target regions in this experiment could either be foreground or background. The SPN onset was delayed when the symmetry was in a ground region. This may be because object formation interferes with the processing of shape information in the ground region.

The Perceived Beauty of Convex Polygon Tilings: The Influence of Regularity, Curvature, and Density

Polygon tilings in natural and man-made objects show great variety. Unlike previous studies that have mainly focused on their classification and production methods, this study aimed at exploring factors that may contribute to the perceived beauty of convex polygon tilings. We analyze the dimensions of regularity, curvature, and density, as well as individual differences. Triangle tilings and hexagon tilings were tested in Experiment 1 and 2, respectively. The results showed that the perceived beauty of convex polygon tilings can be enhanced by higher levels of regularity and nonobvious local curvature. Surprisingly, the effect of density appeared to be different, with the dense triangle tilings and the less dense hexagon tilings scoring higher than the reverse. We discuss a possible explanation based on trypophobia caused by different types of polygons, as well as the observers' personality trait of agreeableness.

Symmetry Processing in the Macaque Visual Cortex

Symmetry is a highly salient feature of the natural world that is perceived by many species. In humans, the cerebral areas processing symmetry are now well identified from neuroimaging measurements. Macaque could constitute a good animal model to explore the underlying neural mechanisms, but a previous comparative study concluded that functional magnetic resonance imaging responses to mirror symmetry in this species were weaker than those observed in humans. Here, we re-examined symmetry processing in macaques from a broader perspective, using both rotation and reflection symmetry embedded in regular textures. Highly consistent responses to symmetry were found in a large network of areas (notably in areas V3 and V4), in line with what was reported in humans under identical experimental conditions. Our results suggest that the cortical networks that process symmetry in humans and macaques are potentially more similar than previously reported and point toward macaque as a relevant model for understanding symmetry processing.

The extrastriate symmetry response is robust to variation in visual memory load

An Event Related Potential response to visual symmetry, known as the Sustained Posterior Negativity (SPN), is generated whether symmetry is task relevant or not, and whether symmetry is attended or not. However, no study has yet examined interference from concurrent memory tasks. To answer this fundamental question, we investigated whether the SPN is robust to variation in Visual Working Memory (VWM) load. In Experiment 1 (N = 24), each trial involved a sample display, a probe and a test display. Sample and test displays contained either four colors or four black shapes, and the probe was either a symmetrical or random pattern. We compared a memory task and a passive viewing task. In the memory task, participants held color or shape information in VWM when the probe was presented. In the passive viewing task, there were no memory demands. Contrary to our predictions, there was no evidence that VWM interfered with the symmetry response. Instead, there was a general SPN enhancement during both color and shape memory tasks compared to passive viewing. In Experiment 2 (N = 24), we used symmetrical patterns themselves as sample and test to maximize interference. Again, the SPN was enhanced in the memory task compared to passive viewing. We conclude that the visual symmetry response is not impaired by concurrent VWM tasks, even when these tasks involve remembering symmetry itself. It seems that the SPN is not only attention-proof, but also memory-proof. This adds to evidence that symmetry perception is robust and automatic.

Spinning objects and partial occlusion: Smart neural responses to symmetry

In humans, extrastriate visual areas are strongly activated by symmetry. However, perfect symmetry is rare in natural visual images. Recent findings showed that when parts of a symmetric shape are presented at different points in time the process relies on a perceptual memory buffer. Does this temporal integration need a retinotopic reference frame? For the first time we tested integration of parts both in the temporal and spatial domain, using a non-retinotopic frame of reference. In Experiment 1, an irregular polygonal shape (either symmetric or asymmetric) was partly occluded by a rectangle for 500 ms (T1). The rectangle moved to the opposite side to reveal the other half of the shape, whilst occluding the previously visible half (T2). The reference frame for the object was static: the two parts stimulated retinotopically corresponding receptive fields (revealed over time). A symmetry-specific ERP response from ~300 ms after T2 was observed. In Experiment 2 dynamic occlusion was combined with an additional step at T2: the new half-shape and occluder were rotated by 90°. Therefore, there was a moving frame of reference and the retinal correspondence between the two parts was disrupted. A weaker but significant symmetry-specific response was recorded. This result extends previous findings: global symmetry representation can be achieved in extrastriate areas non-retinotopically, through integration in both temporal and spatial domain.

Electrophysiological priming effects demonstrate independence and overlap of visual regularity representations in the extrastriate cortex

An Event Related Potential (ERP) component called the Sustained Posterior Negativity (SPN) is generated by regular visual patterns (e.g. vertical reflectional symmetry, horizontal reflectional symmetry or rotational symmetry). Behavioural studies suggest symmetry becomes increasingly salient when the exemplars update rapidly. In line with this, Experiment 1 (N = 48) found that SPN amplitude increased when three different reflectional symmetry patterns were presented sequentially. We call this effect ‘SPN priming’. We then exploited SPN priming to investigate independence of different symmetry representations. SPN priming did not survive changes in retinal location (Experiment 2, N = 48) or non-orthogonal changes in axis orientation (Experiment 3, N = 48). However, SPN priming transferred between vertical and horizontal axis orientations (Experiment 4, N = 48) and between reflectional and rotational symmetry (Experiment 5, N = 48). SPN priming is interesting in itself, and a useful new method for identifying functional boundaries of the symmetry response. We conclude that visual regularities at different retinal locations are coded independently. However, there is some overlap between different regularities presented at the same retinal location.

Interaction of surface pattern and contour shape in the tilt after effects evoked by symmetry

Integration of multiple properties of an object is a fundamental function of the visual cortex in object recognition. For instance, surface patterns and contour shapes are thought to be crucial characteristics that jointly contribute to recognition. However, the mechanisms of integration and corresponding cortical representations have not been fully clarified. We investigated the integration of surfaces and shapes by examining the tilt after effects (TAEs) evoked by the symmetry of patterns and contours. As symmetry in both pattern and contour evokes TAEs, we can directly measure the interaction between the two. The measured TAEs exhibited mutual transfer between the symmetry of the pattern (SP) and that of the contour shape (SS), i.e., adaptation by SP (SS) evoked TAEs when tested by SS (SP), suggesting the existence of an integrated representation. Next, we examined the interaction between SP and SS when both were simultaneously presented in adaptation. Congruent adaptors wherein their symmetry axes aligned evoked compressive interaction, whereas incongruent adaptors wherein the axes of SP and SS tilted to the opposite directions evoked subtractive interaction. These results suggest the existence of a cortical representation that integrates the properties of the surface and shape with suppressive interactions, which can provide crucial insights into the formation of object representation as well as the integration of visual information in the cortex.

Right lateralized alpha desynchronization increases with the proportion of symmetry in the stimulus

Research into the neural basis of symmetry perception has intensified in the last two decades; however, the functional role of neural oscillations remains unclear. In previous work Makin et al. (2014, Journal of Vision, 14, 1-12) and Wright et al. (2015, Psychophysiology, 52, 638-647) examined occipital alpha event-related desynchronization (alpha ERD). It was concluded that alpha ERD is right lateralized during active regularity discrimination but not during a secondary task. Furthermore, alpha ERD was unaffected by stimulus properties, such as the type of regularity. These conclusions are refuted by new time-frequency analysis on an electroencephalography (EEG) data set first introduced by Makin et al. (2020, Journal of Cognitive Neuroscience, 32, 353-366). We compared alpha ERD across five tasks. First, we found that right lateralization of alpha ERD was evident in all tasks, not just active regularity discrimination. This was caused by hemispheric differences in alpha power during prestimulus baseline (left < right), which equalized after stimulus onset (left = right). Second, we found that Alpha ERD increased with the proportion of symmetric elements in the image (PSYMM). Sensitivity to PSYMM was stronger on the right. These findings suggest that known extrastriate symmetry activations are accompanied by reduced alpha power.

Source dipole analysis reveals a new brain response to visual symmetry

Visual regularity activates a network of brain regions in the extrastriate cortex. Previous EEG studies have found that this response scales parametrically with proportion of symmetry in symmetry + noise displays. The parametric symmetry response happens in many tasks, but it is enhanced during active regularity discrimination. However, the origins and time course of this selective enhancement are unclear. Here we answered remaining questions with new source dipole analysis. As assumed, the parametric symmetry response found at the sensor level was generated by a pair of dipoles in the left and right extrastriate cortex. This bilateral activity was itself enhanced during regularity discrimination. However, we identified a third, and later, symmetry response in the posterior cingulate during regularity discrimination. Unlike the extrastriate response, this previously unknown activation only indexes strong, task relevant regularity signals. This clarifies the neural circuits which mediate the perceptual and cognitive aspects of symmetry discrimination.

Spontaneous Ocular Scanning of Visual Symmetry Is Similar During Classification and Evaluation Tasks

Visual symmetry perception and symmetry preference have been studied extensively. However, less is known about how people spontaneously scan symmetrical stimuli with their eyes. We thus examined spontaneous saccadic eye movements when participants (N = 20) observed patterns with horizontal or vertical mirror reflection. We found that participants tend to make saccades along the axis of reflection and that this oculomotor behaviour was similar during objective classification and subjective evaluation tasks. The axis-scanning behaviour generates a dynamic sequence of novel symmetrical images from a single static stimulus. This could aid symmetry perception and evaluation by enhancing the neural response to symmetry.

The response to symmetry in extrastriate areas and its time course are modulated by selective attention

Neurophysiological studies have shown a strong activation in visual areas in response to symmetry. Electrophysiological (EEG) studies, in particular, have confirmed that amplitude at posterior electrodes is more negative for symmetrical compared to asymmetrical patterns. This response is present even when observers perform tasks that do not require processing of symmetry. In this sense the activation is automatic. In this study we test this automaticity more directly by presenting stimuli that contain both symmetry and asymmetry, as overlapping patterns of dots of different colour (black and white). Observers were asked to respond to symmetry in only one of the two colours. If feature-based attention has no role the response should depend on properties of the image. If attention fully filters only the relevant colour the response should depend on properties of the relevant colour only. Neither of these models fully explained the data. We conclude that selective attention does modulate the neural response to symmetry, however we also found a significant contribution from the irrelevant pattern.

The Effect of Blindness on Spatial Asymmetries

The human cerebral cortex is asymmetrically organized with hemispheric lateralization pervading nearly all neural systems of the brain. Whether the lack of normal visual development affects hemispheric specialization subserving the deployment of visuospatial attention asymmetries is controversial. In principle, indeed, the lack of early visual experience may affect the lateralization of spatial functions, and the blind may rely on a different sensory input compared to the sighted. In this review article, we thus present a current state-of-the-art synthesis of empirical evidence concerning the effects of visual deprivation on the lateralization of various spatial processes (i.e., including line bisection, mirror symmetry, and localization tasks). Overall, the evidence reviewed indicates that spatial processes are supported by a right hemispheric network in the blind, hence, analogously to the sighted. Such a right-hemisphere dominance, however, seems more accentuated in the blind as compared to the sighted as indexed by the greater leftward bias shown in different spatial tasks. This is possibly the result of the more pronounced involvement of the right parietal cortex during spatial tasks in blind individuals compared to the sighted, as well as of the additional recruitment of the right occipital cortex, which would reflect the cross-modal plastic phenomena that largely characterize the blind brain.

Electrophysiological priming effects confirm that the extrastriate symmetry network is not gated by luminance polarity

It is known that the extrastriate cortex is activated by visual symmetry. This activation generates an ERP component called the Sustained Posterior Negativity (SPN). SPN amplitude increases (i.e., becomes more negative) with repeated presentations. We exploited this SPN priming effect to test whether the extrastriate symmetry response is gated by element luminance polarity. On each trial, participants observed three stimuli (patterns of dots) in rapid succession (500 ms. with 200 ms. gaps). The patterns were either symmetrical or random. The dot elements were either black or white on a grey background. The triplet sequences either showed repeated luminance (black > black > black, or white > white > white) or changing luminance (black > white > black, or white > black > white). As predicted, SPN priming was comparable in repeated and changing luminance conditions. Therefore, symmetry with black elements is not processed independently from symmetry with white elements. Source waveform analysis confirmed that this priming happened within the extrastriate symmetry network. We conclude that the network pools information across luminance polarity channels.

The extrastriate symmetry response can be elicited by flowers and landscapes as well as abstract shapes

Previous research has investigated the neural response to visual symmetry. It is well established that symmetry activates a network of extrastriate visual regions, including V4 and the Lateral Occipital Complex. This symmetry response generates an event-related potential called the sustained posterior negativity (SPN). However, previous work has used abstract stimuli, typically dot patterns or shapes. We tested the generality of the SPN. We confirmed that the SPN wave was present and of similar amplitude for symmetrical shapes, flowers and landscapes, whether participants were responding either to image symmetry or to image color. We conclude that the extrastriate symmetry response can be generated by any two-dimensional image and is similar in different stimulus domains.

Electrophysiological responses to regularity show specificity to global form: The case of Glass patterns

The holographic weight of evidence model (van der Helm & Leeuwenberg, J Math Psychol, 35, 1991, 151; van der Helm & Leeuwenberg, Psychol Rev, 103, 1996, 429) estimates that the perceptual goodness of moiré structures (Glass patterns), irrespective of their global form, is comparable to that of reflection symmetry. However, both behavioural and neuroscience evidences suggest that certain Glass forms (i.e. circular and radial structures) are perceptually more salient than others (i.e. translation structures) and may recruit different perceptual mechanisms. In this study, we tested whether brain responses for circular, radial and translation Glass patterns are comparable to the response for onefold bilateral reflection symmetry. We recorded an event‐related potential (ERP), called the sustained posterior negativity (SPN), which has been shown to index perceptual goodness of a range of regularities. We found that circular and radial Glass patterns generated a comparable SPN amplitude to onefold reflection symmetry (in line with the prediction of the holographic model), starting approx. 180 ms after stimulus onset. Conversely, the SPN response to translation Glass patterns had a longer latency (approx. 400 ms). These results show that Glass patterns are a special case of visual regularity, and perceptual goodness may not be fully explained by the holographic identities that constitute it. Specialised processing mechanisms might exist in the regularity‐sensitive extrastriate areas, which are tuned to global form configurations.

The Formation of Symmetrical Gestalts Is Task-Independent, but Can Be Enhanced by Active Regularity Discrimination

The brain can organize elements into perceptually meaningful gestalts. Visual symmetry is a useful tool to study gestalt formation, and we know that there are symmetry-sensitive regions in the extrastriate cortex. However, it is unclear whether symmetrical gestalt formation happens automatically, whatever the participant's current task is. Does the visual brain always organize and interpret the retinal image when possible, or only when necessary? To test this, we recorded an ERP called the sustained posterior negativity (SPN). SPN amplitude increases with the proportion of symmetry in symmetry + noise displays. We compared the SPN across five tasks with different cognitive and perceptual demands. Contrary to our predictions, the SPN was the same across four of the five tasks but selectively enhanced during active regularity discrimination. Furthermore, during regularity discrimination, the SPN was present on hit trials and false alarm trials but absent on miss and correct rejection trials. We conclude that gestalt formation is automatic and task-independent, although it occasionally fails on miss trials. However, it can be enhanced by attention to visual regularity.

Symmetric patterns with different luminance polarity (anti-symmetry) generate an automatic response in extrastriate cortex

People can quickly detect bilateral reflection in an image. This is true when elements of the same luminance are matched on either side of the axis (symmetry) and when they have opposite luminance polarity (anti-symmetry). Using electroencephalography, we measured the well-established sustained posterior negativity (SPN) response to symmetry and anti-symmetry. In one task, participants judged the presence or absence of regularity (Regularity Discrimination Task). In another, they judged the presence or absence of rare colored oddball trials (Colored Oddball Task). Previous work has concluded that anti-symmetry is only detected indirectly, through serial visual search of element locations. This selective attention account predicts that the anti-symmetry SPN should be abolished in the Colored Oddball Task because there is no need to search for anti-symmetry. However, this prediction was not confirmed: The symmetry and anti-symmetry SPN waves were not modulated by task. We conclude that at least some forms of anti-symmetry can be extracted from the image automatically, in much the same way as symmetry. This is an important consideration for models of symmetry perception, which must be flexible enough to accommodate opposite luminance polarity, while also accounting for the fact anti-symmetry is often perceptually weaker than symmetry.

Sustained response to symmetry in extrastriate areas after stimulus offset: An EEG study

Electrophysiological (EEG) studies of human perception have found that amplitude at posterior electrodes is more negative for symmetrical patterns compared to asymmetrical patterns. This negativity lasts for hundreds of milliseconds and it has been called sustained posterior negativity (SPN). Symmetry activates a network of visual areas, including the lateral occipital complex (LOC). The SPN is a response to presence of symmetry in the image. Given the sustained nature of this activation, in this study we tested the persistence of the SPN after stimulus offset. Two shapes were presented (for 0.5 s each) with a 1 s blank interval in between. We observed a sustained response after stimulus offset, irrespective of whether the task required processing of shape information. This supports the idea that the response to symmetry is generated by information in the image, independently of task, and that it is sustained over approximately one second post stimulus onset.

Symmetrical Viewpoint Representations in Face-Selective Regions Convey an Advantage in the Perception and Recognition of Faces

Learning new identities is crucial for effective social interaction. A critical aspect of this process is the integration of different images from the same face into a view-invariant representation that can be used for recognition. The representation of symmetrical viewpoints has been proposed to be a key computational step in achieving view-invariance. The aim of this study was to determine whether the representation of symmetrical viewpoints in face-selective regions is directly linked to the perception and recognition of face identity. In Experiment 1, we measured fMRI responses while male and female human participants viewed images of real faces from different viewpoints (-90, -45, 0, 45, and 90° from full-face view). Within the face regions, patterns of neural response to symmetrical views (-45 and 45° or -90 and 90°) were more similar than responses to nonsymmetrical views in the fusiform face area and superior temporal sulcus, but not in the occipital face area. In Experiment 2, participants made perceptual similarity judgements to pairs of face images. Images with symmetrical viewpoints were reported as being more similar than nonsymmetric views. In Experiment 3, we asked whether symmetrical views also convey an advantage when learning new faces. We found that recognition was best when participants were tested with novel face images that were symmetrical to the learning viewpoint. Critically, the pattern of perceptual similarity and recognition across different viewpoints predicted the pattern of neural response in face-selective regions. Together, our results provide support for the functional value of symmetry as an intermediate step in generating view-invariant representations.SIGNIFICANCE STATEMENT The recognition of identity from faces is crucial for successful social interactions. A critical step in this process is the integration of different views into a unified, view-invariant representation. The representation of symmetrical views (e.g., left profile and right profile) has been proposed as an important intermediate step in computing view-invariant representations. We found view symmetric representations were specific to some face-selective regions, but not others. We also show that these neural representations influence the perception of faces. Symmetric views were perceived to be more similar and were recognized more accurately than nonsymmetric views. Moreover, the perception and recognition of faces at different viewpoints predicted patterns of response in those face regions with view symmetric representations.

Speed tuning properties of mirror symmetry detection mechanisms

The human visual system is often tasked with extracting image properties such as symmetry from rapidly moving objects and scenes. The extent to which motion speed and symmetry processing mechanisms interact is not known. Here we examine speed-tuning properties of symmetry detection mechanisms using dynamic dot-patterns containing varying amounts of position and local motion-direction symmetry. We measured symmetry detection thresholds for stimuli in which symmetric and noise elements either drifted with different relative speeds, were relocated at different relative temporal frequencies or were static. We also measured percentage correct responses under two stimulus conditions: a segregated condition in which symmetric and noise elements drifted at different speeds, and a non-segregated condition in which the symmetric elements drifted at two different speeds in equal proportions, as did the noise elements. We found that performance (i) improved gradually with increasing the difference in relative speed between symmetric and noise elements, but was invariant across relative temporal frequencies/lifetime duration differences between symmetric and noise elements, (ii) was higher in the segregated compared to non-segregated conditions, and in the moving compared to the static conditions. We conclude that symmetry detection mechanisms are broadly tuned to speed, with speed-selective symmetry channels combining their outputs by probability summation.

Mid-level Priming by Completion vs. Mosaic Solutions

We report two experiments on the role of mid-level processes in image segmentation and completion. In the primed matching task of Experiment 1, a cue→prime sequence was presented before the imperative stimulus consisting of target shapes with positive versus negative contour curvature polarity and one versus two axes of mirror symmetry. Priming shapes were included in two composite occlusion displays with the same T-junction information and different geometric features supporting a distinct balance between completion and mosaic solutions. A cue, either congruent or incongruent with targets, preceded the presentation of the composite priming display. Matching performance was affected by primes in the expected direction, while cue congruency participated only in a marginally significant three-way interaction, and prime duration had no effect. In Experiment 2, the cue→prime sequence was replaced by a fixation cross to control for the priming effect obtained in Experiment 1. The study confirmed that contour connectability and curvature polarity are effective structural factors capable of competing with symmetry in mid-level image segmentation and completion processes.

The representation of symmetry in multi-voxel response patterns and functional connectivity throughout the ventral visual stream

Several computational models explain how symmetry might be detected and represented in the human brain. However, while there is an abundance of psychophysical studies on symmetry detection and several neural studies showing where and when symmetry is detected in the brain, important questions remain about how this detection happens and how symmetric patterns are represented. We studied the representation of (vertical) symmetry in regions of the ventral visual stream, using multi-voxel pattern analyses (MVPA) and functional connectivity analyses. Our results suggest that neural representations gradually change throughout the ventral visual stream, from very similar part-based representations for symmetrical and asymmetrical stimuli in V1 and V2, over increasingly different representations for symmetrical and asymmetrical stimuli which are nevertheless still part-based in both V3 and V4, to a more holistic representation for symmetrical compared to asymmetrical stimuli in high-level LOC. This change in representations is accompanied by increased communication between left and right retinotopic areas, evidenced by higher interhemispheric functional connectivity during symmetry perception in areas V2 and V4.

Invariance to low-level features and partial transfer over space in the tilt aftereffects evoked by symmetrical patterns

The symmetry axis is the midline that divides a pattern into congruent halves, which is physically nonexistent but evokes tilt aftereffect (TAE). To investigate the cortical correspondence of the symmetry axis, we examined the invariance of symmetry-induced TAE with regard to low-level visual features and the spatial transfer of TAE over visual fields. When the adaptation pattern was rotated and changed sequentially with the orientation of the symmetry axis unchanged, the measured TAE decreased only slightly (18%) compared to stationary patterns. This effect persisted when the adaptation and test patterns were presented in different visual fields. These results indicate that the cortical representation of symmetry is generated independently of low-level features and involves higher-level visual areas.