The contribution of semantic distance knowledge to size constancy in perception and grasping when visual cues are limited

To achieve a stable perception of object size in spite of variations in viewing distance, our visual system needs to combine retinal image information and distance cues. Previous research has shown that, not only retinal cues, but also extraretinal sensory signals can provide reliable information about depth and that different neural networks (perception versus action) can exhibit preferences in the use of these different sources of information during size-distance computations. Semantic knowledge of distance, a purely cognitive signal, can also provide distance information. Do the perception and action systems show differences in their ability to use this information in calculating object size and distance? To address this question, we presented 'glow-in-the-dark' objects of different physical sizes at different real distances in a completely dark room. Participants viewed the objects monocularly through a 1-mm pinhole. They either estimated the size and distance of the objects or attempted to grasp them. Semantic knowledge was manipulated by providing an auditory cue about the actual distance of the object: "20 cm", "30 cm", and "40 cm". We found that semantic knowledge of distance contributed to some extent to size constancy operations during perceptual estimation and grasping, but size constancy was never fully restored. Importantly, the contribution of knowledge about distance to size constancy was equivalent between perception and action. Overall, our study reveals similarities and differences between the perception and action systems in the use of semantic distance knowledge and suggests that this cognitive signal is useful but not a reliable depth cue for size constancy under restricted viewing conditions.

Revisiting the effect of visual illusions on grasping in left and right handers

Visual illusions have provided compelling evidence for a dissociation between perception and action. For example, when two different-sized objects are placed on opposite ends of the Ponzo illusion, people erroneously perceive the physically smaller object to be bigger than the physically larger one, but when they pick up the objects, their grip aperture reflects the real difference in size between the objects. This and similar findings have been demonstrated almost entirely for the right hand in right handers. The scarce research that has examined right and left-handed subjects in this context, has typically used only small samples. Here, we extended this research with a larger sample size (more than 50 in each group) in a version of the Ponzo illusion that allowed us to disentangle the effects of real and illusory size on action and perception in much more powerful way. We also collected a wide range of kinematic measures to assess possible differences in visuomotor control in left and right handers. The results showed that the dissociation between perception and action persisted for both hands in right handers, but only for the right hand in left handers. The left hand of left handers was sensitive to the illusion. Left handers also showed more variable and slower movements, as well as larger safety margins in both hands. These findings suggest that grasping in left handers may require more cognitive supervision, which could lead to greater sensitivity to visual context , particularly with their dominant left hand.

Neural correlates of visual acuity for fine text

Human sensitivity to visual input often scales with the magnitude of evoked responses in the brain. Here, we demonstrate an exception. We record electroencephalography (EEG) while people attempt to resolve fine print - similar to people attempting to read eye charts (the world's most popular means of testing vision). We find that the ability to resolve fine print is associated with smaller evoked responses recorded by large clusters of occipital-parietal sensors ∼150 ms after people see words. Moreover, we find that a better ability to resolve fine print is associated with enhanced alpha-band oscillatory brain activity immediately prior to word presentations. These investigations were inspired by psychophysical data, which suggested the ability to resolve fine print can be enhanced by pre-adaptation to flicker, which should encourage a reduced neural response to inputs. We included this manipulation in this study, and our results are broadly consistent with this conjecture. As alpha-band activity has been linked to inhibitory interactions in visual cortex, we regard our data as evidence that smaller neural responses to fine print can be promoted by inhibitory processes that target unhelpful blur-related signals, which thereby sharpen subsequent visual experiences.

Looking at the Ebbinghaus illusion: differences in neurocomputational requirements, not gaze-mediated attention, explain a classic perception-action dissociation

Perceiving and grasping an object present an animal with different sets of computational problems. The solution in primates entails the specialization of separate neural networks for visual processing with different object representations. This explains why the Ebbinghaus illusion minimally affects the grasping hand's in-flight aperture, which normally scales with target size, even though the size of the target disc remains misperceived. An attractive alternative account, however, posits that grasps are refractory to the illusion because participants fixate on the target and fail to attend to the surrounding context. To test this account, we tracked both limb and gaze while participants made forced-choice judgments of relative disc size in the Ebbinghaus illusion or did so in combination with grasping or manually estimating the size of one of the discs. We replicated the classic dissociation: grasp aperture was refractory to the measured illusory effect on perceived size, while judgments and manual estimates of disc size were not. Importantly, the number of display-wide saccades per second and the percentage of total fixation time or fixations directed at the selected disc failed to explain the dissociation. Our findings support the contention that object perception and goal-directed action rely on distinct visual representations. This article is part of a discussion meeting issue 'New approaches to 3D vision'.

Biases in human perception of facial age are present and more exaggerated in current AI technology

Our estimates of a person's age from their facial appearance suffer from several well-known biases and inaccuracies. Typically, for example, we tend to overestimate the age of smiling faces compared to those with a neutral expression, and the accuracy of our estimates decreases for older faces. The growing interest in age estimation using artificial intelligence (AI) technology raises the question of how AI compares to human performance and whether it suffers from the same biases. Here, we compared human performance with the performance of a large sample of the most prominent AI technology available today. The results showed that AI is even less accurate and more biased than human observers when judging a person's age-even though the overall pattern of errors and biases is similar. Thus, AI overestimated the age of smiling faces even more than human observers did. In addition, AI showed a sharper decrease in accuracy for faces of older adults compared to faces of younger age groups, for smiling compared to neutral faces, and for female compared to male faces. These results suggest that our estimates of age from faces are largely driven by particular visual cues, rather than high-level preconceptions. Moreover, the pattern of errors and biases we observed could provide some insights for the design of more effective AI technology for age estimation from faces.

Faster social attention disengagement in individuals with higher autism traits

INTRODUCTION

Atypical visual and social attention has often been associated with clinically diagnosed autism spectrum disorder (ASD), and with the broader autism phenotype. Atypical social attention is of particular research interest given the importance of facial expressions for social communication, with faces tending to attract and hold attention in neurotypical individuals. In autism, this is not necessarily so, where there is debate about the temporal differences in the ability to disengage attention from a face.

METHOD

Thus, we have used eye-tracking to record saccadic latencies as a measure of time to disengage attention from a central task-irrelevant face before orienting to a newly presented peripheral nonsocial target during a gap-overlap task. Neurotypical participants with higher or lower autism-like traits (AT) completed the task that included central stimuli with varied expressions of facial emotion as well as an inverted face.

RESULTS

High AT participants demonstrated faster saccadic responses to detect the nonsocial target than low AT participants when disengaging attention from a face. Furthermore, faster saccadic responses were recorded when comparing disengagement from upright to inverted faces in low AT but not in high AT participants.

CONCLUSIONS

Together, these results extend findings of atypical social attention disengagement in autism and highlight how differences in attention to faces in the broader autism phenotype can lead to apparently superior task performance under certain conditions. Specifically, autism traits were linked to faster attention orienting to a nonsocial target due to the reduced attentional hold of the task irrelevant face stimuli. The absence of an inversion effect in high AT participants also reinforces the suggestion that they process upright or inverted faces similarly, unlike low AT participants for whom inverted faces are thought to be less socially engaging, thus allowing faster disengagement.

Smiling makes you look older, even when you wear a mask: the effect of face masks on age perception

The widespread use of face masks in the era of the Covid-19 pandemic has promoted research on their effect on the perception and recognition of faces. There is growing evidence that masks hinder the recognition of identity and expression, as well as the interpretation of speech from facial cues. It is less clear whether and in what manner masks affect the perception of age from facial cues. Recent research has emphasized the role of the upper region of the face, a part not covered by a mask, in the evaluation of age. For example, smile-related wrinkles in the region of the eyes make smiling faces appear older than neutral faces of the same individuals (the aging effect of smiling, AES). In two experiments, we tested the effect of face masks on age evaluations of neutral and smiling faces in a range of different age groups from 20 to 80 years. The results showed that smiling faces were perceived as older than neutral faces even when individuals were wearing a face mask—and there was no effect of masks on bias in age evaluations. Additional analyses showed reduced accuracy in age evaluations for smiling compared to neutral faces and for masked compared to unmasked faces. The results converge on previous studies emphasizing the importance of the upper region of the face in evaluations of age.

A priming study on naming real versus pictures of tools

There is a growing body of literature demonstrating the relationship between the activation of sensorimotor processes in object recognition. It is unclear, however, if these processes are influenced by the differences in how real (3D) tools and two-dimensional (2D) images of tools are processed by the brain. Here, we examined if these differences could influence the naming of tools. Participants were presented with a prime stimulus that was either a picture of a tool, or a real tool, followed by a target stimulus that was always a real tool. They were then required to name each tool as they appeared. The functional use action required by the target tool was either the same (i.e., squeegee-paint roller) or different (i.e. knife-whisk) to the prime. We found that the format in which the prime tool was presented (i.e., a picture or real tool) had no influence on the participants' response times to naming the target tool. Furthermore, participants were faster at naming target tools relative to prime tools when the exact same tool was presented as both the prime and target. There was no difference in response times to naming the target tool relative to the prime when they were different tools, regardless of whether the tools' functional actions were the same or different. We also found more errors in naming target tools relative to the primes when different tools had a different functional action compared to when the same tool was presented as both the prime and the target. Taken together, our results highlight that the functional actions associated with tools do not facilitate or interfere with the recognition of tools for the purposes of naming. The theoretical implications of these results are discussed.

The Role of Haptic Expectations in Reaching to Grasp: From Pantomime to Natural Grasps and Back Again

When we reach to pick up an object, our actions are effortlessly informed by the object's spatial information, the position of our limbs, stored knowledge of the object's material properties, and what we want to do with the object. A substantial body of evidence suggests that grasps are under the control of "automatic, unconscious" sensorimotor modules housed in the "dorsal stream" of the posterior parietal cortex. Visual online feedback has a strong effect on the hand's in-flight grasp aperture. Previous work of ours exploited this effect to show that grasps are refractory to cued expectations for visual feedback. Nonetheless, when we reach out to pretend to grasp an object (pantomime grasp), our actions are performed with greater cognitive effort and they engage structures outside of the dorsal stream, including the ventral stream. Here we ask whether our previous finding would extend to cued expectations for haptic feedback. Our method involved a mirror apparatus that allowed participants to see a "virtual" target cylinder as a reflection in the mirror at the start of all trials. On "haptic feedback" trials, participants reached behind the mirror to grasp a size-matched cylinder, spatially coincident with the virtual one. On "no-haptic feedback" trials, participants reached behind the mirror and grasped into "thin air" because no cylinder was present. To manipulate haptic expectation, we organized the haptic conditions into blocked, alternating, and randomized schedules with and without verbal cues about the availability of haptic feedback. Replicating earlier work, we found the strongest haptic effects with the blocked schedules and the weakest effects in the randomized uncued schedule. Crucially, the haptic effects in the cued randomized schedule was intermediate. An analysis of the influence of the upcoming and immediately preceding haptic feedback condition in the cued and uncued random schedules showed that cuing the upcoming haptic condition shifted the haptic influence on grip aperture from the immediately preceding trial to the upcoming trial. These findings indicate that, unlike cues to the availability of visual feedback, participants take advantage of cues to the availability of haptic feedback, flexibly engaging pantomime, and natural modes of grasping to optimize the movement.

Pupil size is modulated by the size of equal-luminance gratings

Pupil size changes with light. For this reason, researchers studying the effect of attention, contextual processing, and arousal on the pupillary response have matched the mean luminance of their stimuli across conditions to eliminate the contribution of differences in light levels. Here, we argue that the match of mean luminance is not enough. In Experiment 1, we presented a circular sinewave grating on a gray background for 2 seconds. The area of the grating could be 3°, 6°, or 9°. The mean luminance of each grating was equal to the luminance of the gray background, such that regardless of the size of the grating there was no change in mean luminance between conditions. Participants were asked to fixate the center of the grating and passively view it. We found that in all size conditions, there was a pupil constriction starting at about 300 ms after stimulus onset, and the pupil constriction increased with the size of the grating. In Experiment 2, when a small grating was presented immediately after the presentation of a large grating (or vice versa), the pupil constriction changed accordingly. In Experiment 3, we replicated Experiment 1 but had the subjects perform an attention-demanding fixation task in one session, and passively view the stimuli in the other. We found that the main effect of task was not significant. In sum, our results show that stimulus size can modulate pupil size robustly and steadily even when the luminance is matched across the different stimuli.

Grip Constancy but Not Perceptual Size Constancy Survives Lesions of Early Visual Cortex

Object constancies are central constructs in theories of visual phenomenology. A powerful example is "size constancy," in which the perceived size of an object remains stable despite changes in viewing distance [1-4]. Evidence from neuropsychology [5], neuroimaging [6-11], transcranial magnetic stimulation [12, 13], single-unit and lesion studies in monkey [14-20], and computational modeling [21] suggests that re-entrant processes involving reciprocal interactions between primary visual cortex (V1) and extrastriate visual areas [22-26] play an essential role in mediating size constancy. It is seldom appreciated, however, that object constancies must also operate for the visual guidance of goal-directed action. For example, when reaching out to pick up an object, the hand's in-flight aperture scales with size of the goal object [27-30] and is refractory to the decrease in retinal-image size with increased viewing distance [31-41] (Figure 1), a phenomenon we call "grip constancy." Does grip constancy, like perceptual constancy, depend on V1 or can it be mediated by pathways that bypass it altogether? We tested these possibilities in an individual, M.C., who has bilateral lesions encompassing V1 and much of the ventral visual stream. We show that her perceptual estimates of object size co-vary with retinal-image size rather than real-world size as viewing distance varies. In contrast, M.C. shows near-normal scaling of in-flight grasp aperture to object size despite changes in viewing distance. Thus, although early visual cortex is necessary for perceptual object constancy, it is unnecessary for grip constancy, which is mediated instead by separate visual inputs to dorsal-stream visuomotor areas [42-48].

The Age-Dependent Neural Substrates of Blindsight

Some patients who are considered cortically blind due to the loss of their primary visual cortex (V1) show a remarkable ability to act upon or discriminate between visual stimuli presented to their blind field, without any awareness of those stimuli. This phenomenon is often referred to as blindsight. Despite the range of spared visual abilities, the identification of the pathways mediating blindsight remains an active and contentious topic in the field. In this review, we discuss recent findings of the candidate pathways and their relative contributions to different forms of blindsight across the lifespan to illustrate the varied nature of unconscious visual processing.

Saccade Latency Provides Evidence for Reduced Face Inversion Effects With Higher Autism Traits

Individuals on the autism spectrum are reported to show impairments in the processing of social information, including aspects of eye-movements towards faces. Abnormalities in basic-level visual processing are also reported. In the current study, we sought to determine if the latency of saccades made towards social targets (faces) in a natural scene as opposed to inanimate targets (cars) would be related to sub-clinical autism traits (ATs) in individuals drawn from a neurotypical population. The effect of stimulus inversion was also examined given that difficulties with processing inverted faces are thought to be a function of face expertise. No group differences in saccadic latency were established for face or car targets, regardless of image orientation. However, as expected, we found that individuals with higher autism-like traits did not demonstrate a saccadic face inversion effect, but those with lower autism-like traits did. Neither group showed a car inversion effect. Thus, these results suggest that neurotypical individuals with high autism-like traits also show anomalies in detecting and orienting to faces. In particular, the reduced saccadic face inversion effect established in these participants with high ATs suggests that speed of visual processing and orienting towards faces may be associated with the social difficulties found across the broader autism spectrum.

Changing the Real Viewing Distance Reveals the Temporal Evolution of Size Constancy in Visual Cortex

Our visual system provides a distance-invariant percept of object size by integrating retinal image size with viewing distance (size constancy). Single-unit studies with animals have shown that some distance cues, especially oculomotor cues such as vergence and accommodation, can modulate the signals in the thalamus or V1 at the initial processing stage [1-7]. Accordingly, one might predict that size constancy emerges much earlier in time [8-10], even as visual signals are being processed in the thalamus. So far, the studies that have looked directly at size coding have either used fMRI (poor temporal resolution [11-13]) or relied on inadequate stimuli (pictorial illusions presented on a monitor at a fixed distance [11, 12, 14, 15]). Here, we physically moved the monitor to different distances, a more ecologically valid paradigm that emulates what happens in everyday life and is an example of the increasing trend of "bringing the real world into the lab." Using this paradigm in combination with electroencephalography (EEG), we examined the computation of size constancy in real time with real-world viewing conditions. Our study provides strong evidence that, even though oculomotor distance cues have been shown to modulate the spiking rate of neurons in the thalamus and in V1, the integration of viewing distance cues and retinal image size takes at least 150 ms to unfold, which suggests that the size-constancy-related activation patterns in V1 reported in previous fMRI studies (e.g., [12, 13]) reflect the later processing within V1 and/or top-down input from other high-level visual areas.

What Role Does "Elongation" Play in "Tool-Specific" Activation and Connectivity in the Dorsal and Ventral Visual Streams?

Images of tools induce stronger activation than images of nontools in a left-lateralized network that includes ventral-stream areas implicated in tool identification and dorsal-stream areas implicated in tool manipulation. Importantly, however, graspable tools tend to be elongated rather than stubby, and so the tool-selective responses in some of these areas may, to some extent, reflect sensitivity to elongation rather than "toolness" per se. Using functional magnetic resonance imaging, we investigated the role of elongation in driving tool-specific activation in the 2 streams and their interconnections. We showed that in some "tool-selective" areas, the coding of toolness and elongation coexisted, but in others, elongation and toolness were coded independently. Psychophysiological interaction analysis revealed that toolness, but not elongation, had a strong modulation of the connectivity between the ventral and dorsal streams. Dynamic causal modeling revealed that viewing tools (either elongated or stubby) increased the connectivity from the ventral- to the dorsal-stream tool-selective areas, but only viewing elongated tools increased the reciprocal connectivity between these areas. Overall, these data disentangle how toolness and elongation affect the activation and connectivity of the tool network and help to resolve recent controversies regarding the relative contribution of "toolness" versus elongation in driving dorsal-stream "tool-selective" areas.

When perception intrudes on 2D grasping: evidence from Garner interference

When participants reach out to pick up a real 3-D object, their grip aperture reflects the size of the object well before contact is made. At the same time, the classical psychophysical laws and principles of relative size and shape that govern visual perception do not appear to intrude into the control of such movements, which are instead tuned only to the relevant dimension for grasping. In contrast, accumulating evidence suggests that grasps directed at flat 2D objects are not immune to perceptual effects. Thus, in 2D but not 3D grasping, the aperture of the fingers has been shown to be affected by relative and contextual information about the size and shape of the target object. A notable example of this dissociation comes from studies of Garner interference, which signals holistic processing of shape. Previous research has shown that 3D grasping shows no evidence for Garner interference but 2D grasping does (Freud & Ganel, 2015). In a recent study published in this journal (Löhr-Limpens et al., 2019), participants were presented with 2D objects in a Garner paradigm. The pattern of results closely replicated the previously published results with 2D grasping. Unfortunately, the authors, who appear to be unaware the potential differences between 2D and 3D grasping, used their findings to draw an overgeneralized and unwarranted conclusion about the relation between 3D grasping and perception. In this short methodological commentary, we discuss current literature on aperture shaping during 2D grasping and suggest that researchers should play close attention to the nature of the target stimuli they use before drawing conclusions about visual processing for perception and action.

Investigating the perceived timing of sensory events triggering actions in patients with Parkinson's disease and the effects of dopaminergic therapy

Few studies have investigated if Parkinson's disease (PD), advancing age, or exogenous dopamine therapy affect the perceived timing of past events. Here we show a phenomenon of 'temporal repulsion' of a sensory event relative to an action decision in patients with PD. In these patients, the timing of a sensory event triggering an action was perceived to have occurred earlier in time than it really did. In other words, the event appeared to be pushed away in time from the performance of the action. This finding stands in sharp contrast to the 'temporal binding' we have observed here and elsewhere (Yabe et al., 2017; Yabe & Goodale, 2015) in young healthy participants for whom the perceived onset of a sensory event triggering an action is typically delayed, as if it were pulled towards the action in time. In elderly patients, sensory events were neither repulsed nor pulled toward the action decision event. Exogenous dopamine alleviated the temporal repulsion in PD patients and normalized the temporal binding in healthy elderly controls. In contrast, dopaminergic therapy worsened temporal binding in healthy young participants. We discuss this pattern of findings, relating temporal binding processes to dopaminergic and striatal mechanisms.

The material-weight illusion disappears or inverts in objects made of two materials

The material-weight illusion (MWI) occurs when an object that looks heavy (e.g., stone) and one that looks light (e.g., Styrofoam) have the same mass. When such stimuli are lifted, the heavier-looking object feels lighter than the lighter-looking object, presumably because well-learned priors about the density of different materials are violated. We examined whether a similar illusion occurs when a certain weight distribution is expected (such as the metal end of a hammer being heavier), but weight is uniformly distributed. In experiment 1, participants lifted bipartite objects that appeared to be made of two materials (combinations of stone, Styrofoam, and wood) but were manipulated to have a uniform weight distribution. Most participants experienced an inverted MWI (i.e., the heavier-looking side felt heavier), suggesting an integration of incoming sensory information with density priors. However, a replication of the classic MWI was found when the objects appeared to be uniformly made of just one of the materials (experiment 2). Both illusions seemed to be independent of the forces used when the objects were lifted. When lifting bipartite objects but asked to judge the weight of the whole object, participants experienced no illusion (experiment 3). In experiment 4, we investigated weight perception in objects with a nonuniform weight distribution and again found evidence for an integration of prior and sensory information. Taken together, our seemingly contradictory results challenge most theories about the MWI. However, Bayesian integration of competing density priors with the likelihood of incoming sensory information may explain the opposing illusions.

NEW & NOTEWORTHY We report a novel weight illusion that contradicts all current explanations of the material-weight illusion: When lifting an object composed of two materials, the heavier-looking side feels heavier, even when the true weight distribution is uniform. The opposite (classic) illusion is found when the same materials are lifted in two separate objects. Identifying the common mechanism underlying both illusions will have implications for perception more generally. A potential candidate is Bayesian inference with competing priors.

Transient visual pathway critical for normal development of primate grasping behavior

An evolutionary hallmark of anthropoid primates, including humans, is the use of vision to guide precise manual movements. These behaviors are reliant on a specialized visual input to the posterior parietal cortex. Here, we show that normal primate reaching-and-grasping behavior depends critically on a visual pathway through the thalamic pulvinar, which is thought to relay information to the middle temporal (MT) area during early life and then swiftly withdraws. Small MRI-guided lesions to a subdivision of the inferior pulvinar subnucleus (PIm) in the infant marmoset monkey led to permanent deficits in reaching-and-grasping behavior in the adult. This functional loss coincided with the abnormal anatomical development of multiple cortical areas responsible for the guidance of actions. Our study reveals that the transient retino-pulvinar-MT pathway underpins the development of visually guided manual behaviors in primates that are crucial for interacting with complex features in the environment.

The dorsal "action" pathway

In 1992, Goodale and Milner proposed a division of labor in the visual pathways of the primate cerebral cortex. According to their account, the ventral pathway, which projects to occipitotemporal cortex, constructs our visual percepts, while the dorsal pathway, which projects to posterior parietal cortex, mediates the visual control of action. Although the framing of the two-visual-system hypothesis has not been without controversy, it is clear that vision for action and vision for perception have distinct computational requirements, and significant support for the proposed neuroanatomic division has continued to emerge over the last two decades from human neuropsychology, neuroimaging, behavioral psychophysics, and monkey neurophysiology. In this chapter, we review much of this evidence, with a particular focus on recent findings from human neuroimaging and monkey neurophysiology, demonstrating a specialized role for parietal cortex in visually guided behavior. But even though the available evidence suggests that dedicated circuits mediate action and perception, in order to produce adaptive goal-directed behavior there must be a close coupling and seamless integration of information processing across these two systems. We discuss such ventral-dorsal-stream interactions and argue that the two pathways play different, yet complementary, roles in the production of skilled behavior.

The Sander parallelogram illusion dissociates action and perception despite control for the litany of past confounds

The two visual systems hypothesis proposes that human vision is supported by an occipito-temporal network for the conscious visual perception of the world and a fronto-parietal network for visually-guided, object-directed actions. Two specific claims about the fronto-parietal network's role in sensorimotor control have generated much data and controversy: (1) the network relies primarily on the absolute metrics of target objects, which it rapidly transforms into effector-specific frames of reference to guide the fingers, hands, and limbs, and (2) the network is largely unaffected by scene-based information extracted by the occipito-temporal network for those same targets. These two claims lead to the counter-intuitive prediction that in-flight anticipatory configuration of the fingers during object-directed grasping will resist the influence of pictorial illusions. The research confirming this prediction has been criticized for confounding the difference between grasping and explicit estimates of object size with differences in attention, sensory feedback, obstacle avoidance, metric sensitivity, and priming. Here, we address and eliminate each of these confounds. We asked participants to reach out and pick up 3D target bars resting on a picture of the Sander Parallelogram illusion and to make explicit estimates of the length of those bars. Participants performed their grasps without visual feedback, and were permitted to grasp the targets after making their size-estimates to afford them an opportunity to reduce illusory error with haptic feedback. The results show unequivocally that the effect of the illusion is stronger on perceptual judgments than on grasping. Our findings from the normally-sighted population provide strong support for the proposal that human vision is comprised of functionally and anatomically dissociable systems.

A TMS Investigation on the Role of Lateral Occipital Complex and Caudal Intraparietal Sulcus in the Perception of Object Form and Orientation

We used TMS to assess the causal roles of the lateral occipital (LO) and caudal intraparietal sulcus (cIPS) areas in the perceptual discrimination of object features. All participants underwent fMRI to localize these areas using a protocol in which they passively viewed images of objects that varied in both form and orientation. fMRI identified six significant brain regions: LO, cIPS, and the fusiform gyrus, bilaterally. In a separate experimental session, we applied TMS to LO or cIPS while the same participants performed match-to-sample form or orientation discrimination tasks. Compared with sham stimulation, TMS to either the left or right LO increased RTs for form but not orientation discrimination, supporting a critical role for LO in form processing for perception- and judgment-based tasks. In contrast, we did not observe any effects when we applied TMS to cIPS. Thus, despite the clear functional evidence of engagement for both LO and cIPS during the passive viewing of objects in the fMRI experiment, the TMS experiment revealed that cIPS is not critical for making perceptual judgments about their form or orientation.

Orientation Discrimination in a Visual Form Agnosic: Evidence from the McCollough Effect

The McCollough effect is a color aftereffect contingent on pattern orientation. The effect was induced in a woman who has a profound impairment in orientation perception due to brain damage. The fact that she experiences the McCollough effect indicates that her visual system is still representing orientation at some level. Further, the finding that her occipital lobe damage is confined mainly to the prestriate regions suggests that the McCollough effect may be mediated by mechanisms at a low level in the visual system, perhaps in area 17.

The Effects of Different Aperture-Viewing Conditions on the Recognition of Novel Objects

The process of learning the structure of novel objects involves the selective use of information available in the distal stimulus. By allowing participants to explore the object within a limited field of view, we were able to examine more rigorously what regions of the object are actually selected in the learning process. Participants explored objects either by moving a circular aperture over a stationary novel object (the aperture-movement condition), or by moving the object behind a stationary aperture (the object-movement condition). Given the differences in how the spatial layout of object parts is revealed in the two study conditions, we expected that exploration would be more systematic in the aperture-movement condition than it would be in the object-movement condition, and would lead to better object recognition. We show evidence that in the aperture-movement condition exploration patterns were more related to the structure of the object and, as a consequence, the aperture-movement condition resulted in more accurate recognition in a later old--new discrimination test.

Temporal distortion in the perception of actions and events

In everyday life, actions and sensory events occur in complex sequences, with events triggering actions that in turn give rise to additional events and so on. Earlier work has shown that a sensory event that is triggered by a voluntary action is perceived to have occurred earlier in time than an identical event that is not triggered by an action. In other words, events that are believed to be caused by our actions are drawn forward in time towards our actions. Similarly, when a sensory event triggers an action, that event is again drawn in time towards the action and is thus perceived to have occurred later than it really did. This alteration in time perception serves to bind together events and actions that are causally linked. It is not clear, however, whether or not the perceived timing of a sensory event embedded within a longer series of actions and sensory events is also temporally bound to the actions in that sequence. In the current study, we measured the temporal binding in sequences consisting of two simple dyads of event-action and action-event in a series of manual action tasks: an event-action-event triad (Experiment 1) and an action-event-action triad (Experiment 2). Auditory tones either triggered an action or were presented 250ms after an action was performed. To reduce the influence of sensory events other than the tone, such as a noise associated with pressing a key on a keyboard, we used an optical sensor to detect hand movements where no contact was made with a surface. In Experiment 1, there appeared to be no change in the perceived onset of an auditory tone when the onset of that tone followed a hand movement and then the tone triggered a second hand movement. It was as if the temporal binding between the action and the tone and then the tone and the subsequent action summed algebraically and cancelled each other out. In Experiment 2, both the perceived onset of an initial tone which triggered an action and the perceived onset of a second tone which was presented 250ms after the action were temporally bound to the action. Taken together, the present study suggests that the temporal binding between our actions and sensory events occur separately in each dyad within a longer sequence of actions and events.

Echolocation in humans: an overview

Bats and dolphins are known for their ability to use echolocation. They emit bursts of sounds and listen to the echoes that bounce back to detect the objects in their environment. What is not as well-known is that some blind people have learned to do the same thing, making mouth clicks, for example, and using the returning echoes from those clicks to sense obstacles and objects of interest in their surroundings. The current review explores some of the research that has examined human echolocation and the changes that have been observed in the brains of echolocation experts. We also discuss potential applications and assistive technology based on echolocation. Blind echolocation experts can sense small differences in the location of objects, differentiate between objects of various sizes and shapes, and even between objects made of different materials, just by listening to the reflected echoes from mouth clicks. It is clear that echolocation may enable some blind people to do things that are otherwise thought to be impossible without vision, potentially providing them with a high degree of independence in their daily lives and demonstrating that echolocation can serve as an effective mobility strategy in the blind. Neuroimaging has shown that the processing of echoes activates brain regions in blind echolocators that would normally support vision in the sighted brain, and that the patterns of these activations are modulated by the information carried by the echoes. This work is shedding new light on just how plastic the human brain is. WIREs Cogn Sci 2016, 7:382-393. doi: 10.1002/wcs.1408 For further resources related to this article, please visit the WIREs website.

Equal-magnitude size-weight illusions experienced within and between object categories

In the size-weight illusion (SWI), small objects feel heavier than larger objects of the same mass. This effect is typically thought to be a consequence of the lifter's expectation that the large object will outweigh the small object, because objects of the same type typically get heavier as they get larger. Here, we show that this perceptual effect can occur across object category, where there are no strong expectations about the correspondence between size and mass. One group of participants lifted same-colored large and small cubes with the same mass as one another, while another group lifted differently-colored large and small cubes with the same mass as one another. The group who lifted the same-colored cubes experienced a robust SWI and initially lifted the large object with more force than the small object. By contrast, the group who lifted the different-colored objects did so with equal initial forces on the first trial, but experienced just as strong an illusion as those who lifted the same-colored objects. These results demonstrate that color cues can selectively influence the application of fingertip force rates while not impacting at all upon the lifter's perception of object weight, highlighting a stark dissociation in how prior information affects perception and action.

Perception of the Mccollough Effect Correlates with Activity in Extrastriate Cortex: A Functional Magnetic Resonance Imaging Study

The McCollough effect is a striking color aftereffect that is linked to the orientation of the patterns used to induce it. To produce the McCollough effect, two differently oriented grating patterns, such as a red-and-black vertical grating and a green-and-black horizontal grating, are viewed alternately for a few minutes. After such colored gratings are viewed, the white sections of a vertical black-and-white test grating appear to be tinged with green, and the white sections of a horizontal grating appear to be tinged with pink. We present evidence from a functional magnetic resonance imaging study that the perception of the McCollough effect correlates with increased activation in the lingual and fusiform gyri—extrastriate visual areas that have been implicated in color perception in humans.

Greater magnocellular saccadic suppression in high versus low autistic tendency suggests a causal path to local perceptual style

Saccadic suppression-the reduction of visual sensitivity during rapid eye movements-has previously been proposed to reflect a specific suppression of the magnocellular visual system, with the initial neural site of that suppression at or prior to afferent visual information reaching striate cortex. Dysfunction in the magnocellular visual pathway has also been associated with perceptual and physiological anomalies in individuals with autism spectrum disorder or high autistic tendency, leading us to question whether saccadic suppression is altered in the broader autism phenotype. Here we show that individuals with high autistic tendency show greater saccadic suppression of low versus high spatial frequency gratings while those with low autistic tendency do not. In addition, those with high but not low autism spectrum quotient (AQ) demonstrated pre-cortical (35-45 ms) evoked potential differences (saccade versus fixation) to a large, low contrast, pseudo-randomly flashing bar. Both AQ groups showed similar differential visual evoked potential effects in later epochs (80-160 ms) at high contrast. Thus, the magnocellular theory of saccadic suppression appears untenable as a general description for the typically developing population. Our results also suggest that the bias towards local perceptual style reported in autism may be due to selective suppression of low spatial frequency information accompanying every saccadic eye movement.

A cortical network that marks the moment when conscious representations are updated

In order to survive in a complex, noisy and constantly changing environment we need to categorize the world (e.g., Is this food edible or poisonous?) and we need to update our interpretations when things change. How does our brain update when object categories change from one to the next? We investigated the neural correlates associated with this updating process. We used event-related fMRI while people viewed a sequence of images that morphed from one object (e.g., a plane) to another (e.g., a shark). All participants were naïve as to the identity of the second object. The point at which participants 'saw' the second object was unpredictable and uncontaminated by any dramatic or salient change to the images themselves. The moment when subjective perceptual representations changed activated a circumscribed network including the anterior insula, medial and inferior frontal regions and inferior parietal cortex. In a setting where neither the timing nor nature of the visual transition was predictable, this restricted cortical network signals the time of updating a perceptual representation. The anterior insula and mid-frontal regions (including the ACC) were activated not only at the actual time when change was reported, but also immediately before, suggesting that these areas are also involved in processing alternative options after a mismatch has been detected.

Are there right hemisphere contributions to visually-guided movement? Manipulating left hand reaction time advantages in dextrals

Many studies have argued for distinct but complementary contributions from each hemisphere in the control of movements to visual targets. Investigators have attempted to extend observations from patients with unilateral left- and right-hemisphere damage, to those using neurologically-intact participants, by assuming that each hand has privileged access to the contralateral hemisphere. Previous attempts to illustrate right hemispheric contributions to the control of aiming have focussed on increasing the spatial demands of an aiming task, to attenuate the typical right hand advantages, to try to enhance a left hand reaction time advantage in right-handed participants. These early attempts have not been successful. The present study circumnavigates some of the theoretical and methodological difficulties of some of the earlier experiments, by using three different tasks linked directly to specialized functions of the right hemisphere: bisecting, the gap effect, and visuospatial localization. None of these tasks were effective in reducing the magnitude of left hand reaction time advantages in right handers. Results are discussed in terms of alternatives to right hemispheric functional explanations of the effect, the one-dimensional nature of our target arrays, power and precision given the size of the left hand RT effect, and the utility of examining the proportions of participants who show these effects, rather than exclusive reliance on measures of central tendency and their associated null hypothesis significance tests.

Transient visual responses reset the phase of low-frequency oscillations in the skeletomotor periphery

We recorded muscle activity from an upper limb muscle while human subjects reached towards peripheral targets. We tested the hypothesis that the transient visual response sweeps not only through the central nervous system, but also through the peripheral nervous system. Like the transient visual response in the central nervous system, stimulus-locked muscle responses (< 100 ms) were sensitive to stimulus contrast, and were temporally and spatially dissociable from voluntary orienting activity. Also, the arrival of visual responses reduced the variability of muscle activity by resetting the phase of ongoing low-frequency oscillations. This latter finding critically extends the emerging evidence that the feedforward visual sweep reduces neural variability via phase resetting. We conclude that, when sensory information is relevant to a particular effector, detailed information about the sensorimotor transformation, even from the earliest stages, is found in the peripheral nervous system.

Real-time vision, tactile cues, and visual form agnosia: removing haptic feedback from a "natural" grasping task induces pantomime-like grasps

Investigators study the kinematics of grasping movements (prehension) under a variety of conditions to probe visuomotor function in normal and brain-damaged individuals. “Natural” prehensile acts are directed at the goal object and are executed using real-time vision. Typically, they also entail the use of tactile, proprioceptive, and kinesthetic sources of haptic feedback about the object (“haptics-based object information”) once contact with the object has been made. Natural and simulated (pantomimed) forms of prehension are thought to recruit different cortical structures: patient DF, who has visual form agnosia following bilateral damage to her temporal-occipital cortex, loses her ability to scale her grasp aperture to the size of targets (“grip scaling”) when her prehensile movements are based on a memory of a target previewed 2 s before the cue to respond or when her grasps are directed towards a visible virtual target but she is denied haptics-based information about the target. In the first of two experiments, we show that when DF performs real-time pantomimed grasps towards a 7.5 cm displaced imagined copy of a visible object such that her fingers make contact with the surface of the table, her grip scaling is in fact quite normal. This finding suggests that real-time vision and terminal tactile feedback are sufficient to preserve DF’s grip scaling slopes. In the second experiment, we examined an “unnatural” grasping task variant in which a tangible target (along with any proxy such as the surface of the table) is denied (i.e., no terminal tactile feedback). To do this, we used a mirror-apparatus to present virtual targets with and without a spatially coincident copy for the participants to grasp. We compared the grasp kinematics from trials with and without terminal tactile feedback to a real-time-pantomimed grasping task (one without tactile feedback) in which participants visualized a copy of the visible target as instructed in our laboratory in the past. Compared to natural grasps, removing tactile feedback increased RT, slowed the velocity of the reach, reduced in-flight grip aperture, increased the slopes relating grip aperture to target width, and reduced the final grip aperture (FGA). All of these effects were also observed in the real time-pantomime grasping task. These effects seem to be independent of those that arise from using the mirror in general as we also compared grasps directed towards virtual targets to those directed at real ones viewed directly through a pane of glass. These comparisons showed that the grasps directed at virtual targets increased grip aperture, slowed the velocity of the reach, and reduced the slopes relating grip aperture to the widths of the target. Thus, using the mirror has real consequences on grasp kinematics, reflecting the importance of task-relevant sources of online visual information for the programming and updating of natural prehensile movements. Taken together, these results provide compelling support for the view that removing terminal tactile feedback, even when the grasps are target-directed, induces a switch from real-time visual control towards one that depends more on visual perception and cognitive supervision. Providing terminal tactile feedback and real-time visual information can evidently keep the dorsal visuomotor system operating normally for prehensile acts.

The two-visual-systems hypothesis and the perspectival features of visual experience

Some critics of the two-visual-systems hypothesis (TVSH) argue that it is incompatible with the fundamentally egocentric nature of visual experience (what we call the 'perspectival account'). The TVSH proposes that the ventral stream, which delivers up our visual experience of the world, works in an allocentric frame of reference, whereas the dorsal stream, which mediates the visual control of action, uses egocentric frames of reference. Given that the TVSH is also committed to the claim that dorsal-stream processing does not contribute to the contents of visual experience, it has been argued that the TVSH cannot account for the egocentric features of our visual experience. This argument, however, rests on a misunderstanding about how the operations mediating action and the operations mediating perception are specified in the TVSH. In this article, we emphasize the importance of the 'outputs' of the two-systems to the specification of their respective operations. We argue that once this point is appreciated, it becomes evident that the TVSH is entirely compatible with a perspectival account of visual experience.

A blind human expert echolocator shows size constancy for objects perceived by echoes

Some blind humans make clicking noises with their mouth and use the reflected echoes to perceive objects and surfaces. This technique can operate as a crude substitute for vision, allowing human echolocators to perceive silent, distal objects. Here, we tested if echolocation would, like vision, show size constancy. To investigate this, we asked a blind expert echolocator (EE) to echolocate objects of different physical sizes presented at different distances. The EE consistently identified the true physical size of the objects independent of distance. In contrast, blind and blindfolded sighted controls did not show size constancy, even when encouraged to use mouth clicks, claps, or other signals. These findings suggest that size constancy is not a purely visual phenomenon, but that it can operate via an auditory-based substitute for vision, such as human echolocation.

The size-weight illusion induced through human echolocation

Certain blind individuals have learned to interpret the echoes of self-generated sounds to perceive the structure of objects in their environment. The current work examined how far the influence of this unique form of sensory substitution extends by testing whether echolocation-induced representations of object size could influence weight perception. A small group of echolocation experts made tongue clicks or finger snaps toward cubes of varying sizes and weights before lifting them. These echolocators experienced a robust size-weight illusion. This experiment provides the first demonstration of a sensory substitution technique whereby the substituted sense influences the conscious perception through an intact sense.