Diagnosing the Periphery: Using the Rey-Osterrieth Complex Figure Drawing Test to Characterize Peripheral Visual Function

Anisotropic representations of visual space modulate visual numerosity estimation

Humans can estimate the number of visually displayed items without counting. This capacity of numerosity perception has often been attributed to a dedicated system to estimate numerosity, or alternatively to the exploitation of various stimulus features, such as density, convex hull, the size of items, and occupancy area. The distribution of the presented items is usually not varied with eccentricity in the visual field. However, our visual fields are highly asymmetric. To date, it is unclear how inhomogeneities of the visual field impact numerosity perception. Besides eccentricity, a pronounced asymmetry is the radial-tangential anisotropy. For example, in crowding, radially placed flankers interfere more strongly with target perception than tangentially placed flankers. Similarly, in redundancy masking, the number of perceived items in repeating patterns is reduced when the items are arranged radially but not when they are arranged tangentially. Here, we investigated whether numerosity perception is subject to the radial-tangential anisotropy of spatial vision to shed light on the underlying topology of numerosity perception. In Experiment 1, observers were presented with varying numbers of discs, predominantly arranged radially or tangentially, and asked to report their perceived number. In Experiment 2, observers were presented with the same displays as in Experiment 1, and were asked to encircle items that were perceived as a group. We found that numerosity estimation depended on the arrangement of discs, suggesting a radial-tangential anisotropy of numerosity perception. Grouping among discs did not seem to explain our results. We suggest that the topology of spatial vision modulates numerosity estimation and that asymmetries of visual space should be taken into account when investigating numerosity estimation.

Configural properties of face portraits change between childhood and adulthood

Adult observers are sensitive to the configuration of facial features within a face, able to distinguish between relative differences in feature spacing, and detecting deviations from typical facial appearance. How does the representation of the typical configuration of facial features develop? While there is a great deal of work describing children’s developing abilities to detect differences in feature spacing across face images, there is substantially less work examining what children think constitutes a typical arrangement of facial features. In the current study, we investigated this issue using a production task in which adults and 5- to 10-year-old children created a face “portrait” by arranging the eyes, nose, and mouth of a standard face within an empty outline. Using this simple task, we found differences in face configuration across age groups, such that children of all ages made far larger errors than adult participants, expanding facial features outward from the center of the face more than adults. These results were not affected by face inversion, potentially implying a domain-general rather than face-specific process. We also found that children of all ages endorsed the correct configuration as a best likeness in a perceptual task. We discuss these results in terms of ongoing debate regarding the extent to which configural processing is a meaningful component of face recognition and the conclusions we can draw from production paradigms as compared to purely perceptual tasks.

Modeling Users' Cognitive Performance Using Digital Pen Features

Digital pen features model characteristics of sketches and user behavior, and can be used for various supervised machine learning (ML) applications, such as multi-stroke sketch recognition and user modeling. In this work, we use a state-of-the-art set of more than 170 digital pen features, which we implement and make publicly available. The feature set is evaluated in the use case of analyzing paper-pencil-based neurocognitive assessments in the medical domain. Most cognitive assessments, for dementia screening for example, are conducted with a pen on normal paper. We record these tests with a digital pen as part of a new interactive cognitive assessment tool with automatic analysis of pen input. The physician can, first, observe the sketching process in real-time on a mobile tablet, e.g., in telemedicine settings or to follow Covid-19 distancing regulations. Second, the results of an automatic test analysis are presented to the physician in real-time, thereby reducing manual scoring effort and producing objective reports. As part of our evaluation we examine how accurately different feature-based, supervised ML models can automatically score cognitive tests, with and without semantic content analysis. A series of ML-based sketch recognition experiments is conducted, evaluating 10 modern off-the-shelf ML classifiers (i.e., SVMs, Deep Learning, etc.) on a sketch data set which we recorded with 40 subjects from a geriatrics daycare clinic. In addition, an automated ML approach (AutoML) is explored for fine-tuning and optimizing classification performance on the data set, achieving superior recognition accuracies. Using standard ML techniques our feature set outperforms all previous approaches on the cognitive tests considered, i.e., the Clock Drawing Test, the Rey-Osterrieth Complex Figure Test, and the Trail Making Test, by automatically scoring cognitive tests with up to 87.5% accuracy in a binary classification task.

A survey of visual and procedural handwriting analysis for neuropsychological assessment

To date, Artificial Intelligence systems for handwriting and drawing analysis have primarily targeted domains such as writer identification and sketch recognition. Conversely, the automatic characterization of graphomotor patterns as biomarkers of brain health is a relatively less explored research area. Despite its importance, the work done in this direction is limited and sporadic. This paper aims to provide a survey of related work to provide guidance to novice researchers and highlight relevant study contributions. The literature has been grouped into “visual analysis techniques” and “procedural analysis techniques”. Visual analysis techniques evaluate offline samples of a graphomotor response after completion. On the other hand, procedural analysis techniques focus on the dynamic processes involved in producing a graphomotor reaction. Since the primary goal of both families of strategies is to represent domain knowledge effectively, the paper also outlines the commonly employed handwriting representation and estimation methods presented in the literature and discusses their strengths and weaknesses. It also highlights the limitations of existing processes and the challenges commonly faced when designing such systems. High-level directions for further research conclude the paper.

Atypical visual field asymmetries in redundancy masking

Redundancy masking is the reduction of the perceived number of items in repeating patterns. It shares a number of characteristics with crowding, the impairment of target identification in visual clutter. Crowding strongly depends on the location of the target in the visual field. For example, it is stronger in the upper compared to the lower visual field and is usually weakest on the horizontal meridian. This pattern of visual field asymmetries is common in spatial vision, as revealed by tasks measuring, for example, spatial resolution and contrast sensitivity. Here, to characterize redundancy masking and reveal its similarities to and differences from other spatial tasks, we investigated whether redundancy masking shows the same typical visual field asymmetries. Observers were presented with three to six radially arranged lines at 10° eccentricity at one of eight locations around fixation and were asked to report the number of lines. We found asymmetries that differed pronouncedly from those found in crowding. Redundancy masking did not differ between upper and lower visual fields. Importantly, redundancy masking was stronger on the horizontal meridian than on the vertical meridian, the opposite of what is usually found in crowding. These results show that redundancy masking diverges from crowding in regard to visual field asymmetries, suggesting different underlying mechanisms of redundancy masking and crowding. We suggest that the observed atypical visual field asymmetries in redundancy masking are due to the superior extraction of regularity and a more pronounced compression of visual space on the horizontal compared to the vertical meridian.

Emergence of crowding: The role of contrast and orientation salience

Crowding causes difficulties in judging attributes of an object surrounded by other objects. We investigated crowding for stimuli that isolated either S-cone or luminance mechanisms or combined them. By targeting different retinogeniculate mechanisms with contrast-matched stimuli, we aim to determine the earliest site at which crowding emerges. Discrimination was measured in an orientation judgment task where Gabor targets were presented parafoveally among flankers. In the first experiment, we assessed flanked and unflanked orientation discrimination thresholds for pure S-cone and achromatic stimuli and their combinations. In the second experiment, to capture individual differences, we measured unflanked detection and orientation sensitivity, along with performance under flanker interference for stimuli containing luminance only or combined with S-cone contrast. We confirmed that orientation sensitivity was lower for unflanked S-cone stimuli. When flanked, the pattern of results for S-cone stimuli was the same as for achromatic stimuli with comparable (i.e. low) contrast levels. We also found that flanker interference exhibited a genuine signature of crowding only when orientation discrimination threshold was reliably surpassed. Crowding, therefore, emerges at a stage that operates on signals representing task-relevant featural (here, orientation) information. Because luminance and S-cone mechanisms have very different spatial tuning properties, it is most parsimonious to conclude that crowding takes place at a neural processing stage after they have been combined.

A bias in saccadic suppression of shape change

Processing of visual information in the central (foveal) and peripheral visual field is vastly different. To achieve a homogeneous representation of the visual world across eye movements, the visual system needs to compensate for these differences. By introducing subtle changes between peripheral and foveal inputs across saccades, one can test this compensation. We morphed shapes between a triangle and a circle and presented two different change directions (circularity decrease or increase) at varying magnitudes across a saccade. In a change-discrimination task, observers disproportionally often reported percepts of circularity increase. To test the relationship with visual-field differences, we measured perception when shapes were exclusively presented either in the periphery (before a saccade), or in the fovea (after a saccade). We found that overall shapes were perceived as more circular before than after a saccade and the more pronounced this difference was for a participant, the smaller was their circularity-increase bias in the change-discrimination task. We propose that visual-field differences have a direct and an indirect influence on transsaccadic perception of shape change. The direct influence is based on the distinct appearance of shape in the central and peripheral visual field in a trial, causing an increase of the perceptual magnitude of circularity-decrease changes. The indirect influence is based on long-term build-up of transsaccadic expectations; if a change is opposite (circularity increase) to the expectation (circularity decrease), it should elicit a strong error signal facilitating change detection. We discuss the concept of transsaccadic expectations and theoretical implications for transsaccadic perception of other feature changes.

Geometrically restricted image descriptors: A method to capture the appearance of shape

Shape perception varies depending on many factors. For example, presenting a stimulus in the periphery often yields a different appearance compared with its foveal presentation. However, how exactly shape appearance is altered under different conditions remains elusive. One reason for this is that studies typically measure identification performance, leaving details about target appearance unknown. The lack of appearance-based methods and general challenges to quantify appearance complicate the investigation of shape appearance. Here, we introduce Geometrically Restricted Image Descriptors (GRIDs), a method to investigate the appearance of shapes. Stimuli in the GRID paradigm are shapes consisting of distinct line elements placed on a grid by connecting grid nodes. Each line is treated as a discrete target. Observers are asked to capture target appearance by placing lines on a freely viewed response grid. We used GRIDs to investigate the appearance of letters and letter-like shapes. Targets were presented at 10° eccentricity in the right visual field. Gaze-contingent stimulus presentation was used to prevent eye movements to the target. The data were analyzed by quantifying the differences between targets and response in regard to overall accuracy, element discriminability, and several distinct error types. Our results show how shape appearance can be captured by GRIDs, and how a fine-grained analysis of stimulus parts provides quantifications of appearance typically not available in standard measures of performance. We propose that GRIDs are an effective tool to investigate the appearance of shapes.

Hidden by bias: how standard psychophysical procedures conceal crucial aspects of peripheral visual appearance

The perception of a target depends on other stimuli surrounding it in time and space. This contextual modulation is ubiquitous in visual perception, and is usually quantified by measuring performance on sets of highly similar stimuli. Implicit or explicit comparisons among the stimuli may, however, inadvertently bias responses and conceal strong variability of target appearance. Here, we investigated the influence of contextual stimuli on the perception of a repeating pattern (a line triplet), presented in the visual periphery. In the neutral condition, the triplet was presented a single time to capture its minimally biased perception. In the similar and dissimilar conditions, it was presented within stimulus sets composed of lines similar to the triplet, and distinct shapes, respectively. The majority of observers reported perceiving a line pair in the neutral and dissimilar conditions, revealing 'redundancy masking', the reduction of the perceived number of repeating items. In the similar condition, by contrast, the number of lines was overestimated. Our results show that the similar context did not reveal redundancy masking which was only observed in the neutral and dissimilar context. We suggest that the influence of contextual stimuli has inadvertently concealed this crucial aspect of peripheral appearance.

Redundancy masking: The loss of repeated items in crowded peripheral vision

Crowding is the deterioration of target identification in the presence of neighboring objects. Recent studies using appearance-based methods showed that the perceived number of target elements is often diminished in crowding. Here we introduce a related type of diminishment in repeating patterns (sets of parallel lines), which we term “redundancy masking.” In four experiments, observers were presented with arrays of small numbers of lines centered at 10° eccentricity. The task was to indicate the number of lines. In Experiment 1, spatial characteristics of redundancy masking were examined by varying the inter-line spacing. We found that redundancy masking decreased with increasing inter-line spacing and ceased at spacings of approximately 0.25 times the eccentricity. In Experiment 2, we assessed whether the strength of redundancy masking differed between radial and tangential arrangements of elements as it does in crowding. Redundancy masking was strong with radially arranged lines (horizontally arranged vertical lines), and absent with tangentially arranged lines (vertically arranged horizontal lines). In Experiment 3, we investigated whether target size (line width and length) modulated redundancy masking. There was an effect of width: Thinner lines yielded stronger redundancy masking. We did not find any differences between the tested line lengths. In Experiment 4, we varied the regularity of the line arrays by vertically or horizontally jittering the positions of the lines. Redundancy masking was strongest with regular spacings and weakened with decreasing regularity. Our experiments show under which conditions whole items are lost in crowded displays, and how this redundancy masking resembles—and partly diverges from—crowded identification. We suggest that redundancy masking is a contributor to the deterioration of performance in crowded displays with redundant patterns.

Emergent features break the rules of crowding

Crowding is the deleterious influence of surrounding objects (flankers) on target identification. A central rule of crowding is that it is stronger when the target and the flankers are similar. Here, we show in three experiments how emergent features break this rule. Observers identified targets with various emergent features consisting of a pair of adjacent chevrons either pointing in opposite ('Diamonds' and 'Xs'), or the same (both up or down) directions. Targets were flanked by Diamonds or Xs, resulting in conditions with different levels of target-flanker similarity. Despite high target-flanker similarity, Diamonds were identified better than Xs when flanked by Diamonds. Participants' judgments of target conspicuity, however, showed that Diamonds were not perceived to stand out more strongly from X than Diamond flankers. Next, we asked observers to indicate whether all presented items were identical. We found superior performance with all Diamonds compared to all Xs, indicating that display uniformity judgments benefitted from the emergent features of Diamonds. Our results showed that emergent features and the information content of the entire display strongly modulated crowding. We suggest that conventional crowding rules only hold when target and flankers are artificially constrained to be mutually independent.

Letters Lost: Capturing Appearance in Crowded Peripheral Vision Reveals a New Kind of Masking

Peripheral vision is strongly limited by crowding, the deleterious influence of flanking items on target perception. Distinguishing what is seen from what is merely inferred in crowding is difficult because task demands and prior knowledge may influence observers' reports. Here, we used a standard identification task in which participants were susceptible to these influences, and to minimize them, we used a free-report-and-drawing paradigm. Three letters were presented in the periphery. In Experiment 1, 10 participants were asked to identify the central target letter. In Experiment 2, 25 participants freely named and drew what they saw. When three identical letters were presented, performance was almost perfect in Experiment 1, but it was very poor in Experiment 2, in which most participants reported only two letters. Our study reveals limitations of standard crowding paradigms and uncovers a hitherto unrecognized effect that we call redundancy masking.

Emergent features in the crowding zone: When target-flanker grouping surmounts crowding

Crowding is the impairment of target identification when the target is surrounded by nearby flankers. Two hallmarks of crowding are that it is stronger when the flankers are close to the target and when the target strongly groups with the flankers. Here we show the opposite of both. A chevron target (pointing up or down) was presented at 8° eccentricity in the right visual field. It was surrounded by four flankers. Three of the flankers varied (pointing left or right). The fourth, the critical flanker (CF), was fixed in one orientation (left, right, up, down), yielding different configurations with the target. The CF's distance to the target was varied. Target identification depended strongly on the distance and the orientation of the CF. Remarkably, when the target and the CF grouped into a good configuration and elicited an emergent feature, performance was high if the CF was close to the target. This effect was particularly strong when participants were informed about the different CF-target configurations before the experiment. Reducing crowding and grouping by asynchronous presentation of the CF and the other items abolished the effect. When participants reported the entire configuration of the CF and the target, performance rapidly decreased with increasing spacing when the CF and the target were different but not when they were the same, indicating different spatial extents of the corresponding grouping processes. Our results show that the features emerging from the configurations of the target and a flanker strongly modulate crowding. Strong target-flanker grouping can benefit performance.

Prediction shapes peripheral appearance

Peripheral perception is limited in terms of visual acuity, contrast sensitivity, and positional uncertainty. In the present study we used an image-manipulation algorithm (the Eidolon Factory) based on a formal description of the visual field as a tool to investigate how peripheral stimuli appear in the presence of such limitations. Observers were asked to match central and peripheral stimuli, both configurations of superimposed geometric shapes and patches of natural images, in terms of the parameters controlling the amplitude of the perturbation (reach) and the cross-scale similarity of the perturbation (coherence). We found that observers systematically tended to report the peripheral stimuli as having shorter reach and higher coherence. This means that their matches both were less distorted and had sharper edges relative to the actual stimulus. Overall, the results indicate that the way we see objects in our peripheral visual field is complemented by our assumptions about the way the same objects would appear if they were viewed foveally.

Amodal Volume Completion and the Thin Building Illusion

We report results from an experiment showing that a tall pillar with a triangular base evokes radically different three-dimensional (3D) percepts depending on the vantage point from which it is observed. The base of the pillar is an isosceles right triangle, but the pillar is perceived as just a thin plane when viewed from some vantage points. Viewed from other vantage points, the perceived 3D shape of the pillar corresponds to a square or rectangular base. In general, our results suggest that the visual system uses a preference for rectangularity (or symmetry) to determine the 3D shape of objects. The amodal impressions of the invisible backside of the pillar are often quite compelling, and the corresponding illusions persist even when the observers know the true shape of the pillar. Interestingly, though, the compellingness and definiteness of the amodal impression of the pillar's backside depends on the vantage point. This is reflected in corresponding differences in the interobserver variability of the 3D shape judgments. We also discuss how variants of this illusion are used as a powerful tool in the art of magic.