Extracting 3D from motion: differences in human and monkey intraparietal cortex

Contrasting neurofunctional correlates of face- and visuospatial-processing in children and adolescents with Williams syndrome: convergent results from four fMRI paradigms

Understanding neurogenetic mechanisms underlying neuropsychiatric disorders such as schizophrenia and autism is complicated by their inherent clinical and genetic heterogeneity. Williams syndrome (WS), a rare neurodevelopmental condition in which both the genetic alteration (hemideletion of ~ twenty-six 7q11.23 genes) and the cognitive/behavioral profile are well-defined, offers an invaluable opportunity to delineate gene-brain-behavior relationships. People with WS are characterized by increased social drive, including particular interest in faces, together with hallmark difficulty in visuospatial processing. Prior work, primarily in adults with WS, has searched for neural correlates of these characteristics, with reports of altered fusiform gyrus function while viewing socioemotional stimuli such as faces, along with hypoactivation of the intraparietal sulcus during visuospatial processing. Here, we investigated neural function in children and adolescents with WS by using four separate fMRI paradigms, two that probe each of these two cognitive/behavioral domains. During the two visuospatial tasks, but not during the two face processing tasks, we found bilateral intraparietal sulcus hypoactivation in WS. In contrast, during both face processing tasks, but not during the visuospatial tasks, we found fusiform hyperactivation. These data not only demonstrate that previous findings in adults with WS are also present in childhood and adolescence, but also provide a clear example that genetic mechanisms can bias neural circuit function, thereby affecting behavioral traits.

A new 'CFS tracking' paradigm reveals uniform suppression depth regardless of target complexity or salience

When the eyes view separate and incompatible images, the brain suppresses one image and promotes the other into visual awareness. Periods of interocular suppression can be prolonged during continuous flash suppression (CFS) - when one eye views a static 'target' while the other views a complex dynamic stimulus. Measuring the time needed for a suppressed image to break CFS (bCFS) has been widely used to investigate unconscious processing, and the results have generated controversy regarding the scope of visual processing without awareness. Here, we address this controversy with a new 'CFS tracking' paradigm (tCFS) in which the suppressed monocular target steadily increases in contrast until breaking into awareness (as in bCFS) after which it decreases until it again disappears (reCFS), with this cycle continuing for many reversals. Unlike bCFS, tCFS provides a measure of suppression depth by quantifying the difference between breakthrough and suppression thresholds. tCFS confirms that (i) breakthrough thresholds indeed differ across target types (e.g. faces vs gratings, as bCFS has shown) - but (ii) suppression depth does not vary across target types. Once the breakthrough contrast is reached for a given stimulus, all stimuli require a strikingly uniform reduction in contrast to reach the corresponding suppression threshold. This uniform suppression depth points to a single mechanism of CFS suppression, one that likely occurs early in visual processing because suppression depth was not modulated by target salience or complexity. More fundamentally, it shows that variations in bCFS thresholds alone are insufficient for inferring whether the barrier to achieving awareness exerted by interocular suppression is weaker for some categories of visual stimuli compared to others.

Mesoscale organization of ventral and dorsal visual pathways in macaque monkey revealed by 7T fMRI

In human and nonhuman primate brains, columnar (mesoscale) organization has been demonstrated to underlie both lower and higher order aspects of visual information processing. Previous studies have focused on identifying functional preferences of mesoscale domains in specific areas; but there has been little understanding of how mesoscale domains may cooperatively respond to single visual stimuli across dorsal and ventral pathways. Here, we have developed ultrahigh-field 7 T fMRI methods to enable simultaneous mapping, in individual macaque monkeys, of response in both dorsal and ventral pathways to single simple color and motion stimuli. We provide the first evidence that anatomical V2 cytochrome oxidase-stained stripes are well aligned with fMRI maps of V2 stripes, settling a long-standing controversy. In the ventral pathway, a systematic array of paired color and luminance processing domains across V4 was revealed, suggesting a novel organization for surface information processing. In the dorsal pathway, in addition to high quality motion direction maps of MT, MST and V3A, alternating color and motion direction domains in V3 are revealed. As well, submillimeter motion domains were observed in peripheral LIPd and LIPv. In sum, our study provides a novel global snapshot of how mesoscale networks in the ventral and dorsal visual pathways form the organizational basis of visual objection recognition and vision for action.

A focus on the multiple interfaces between action and perception and their neural correlates

Successful behaviour relies on the appropriate interplay between action and perception. The well-established dorsal and ventral stream theories depicted two distinct functional pathways for the processes of action and perception, respectively. In physiological conditions, the two pathways closely cooperate in order to produce successful adaptive behaviour. As the coupling between perception and action exists, this requires an interface that is responsible for a common reading of the two functions. Several studies have proposed different types of perception and action interfaces, suggesting their role in the creation of the shared interaction channel. In the present review, we describe three possible perception and action interfaces: i) the motor code, including common coding approaches, ii) attention, and iii) object affordance; we highlight their potential neural correlates. From this overview, a recurrent neural substrate that underlies all these interface functions appears to be crucial: the parieto-frontal circuit. This network is involved in the mirror mechanism which underlies the perception and action interfaces identified as common coding and motor code theories. The same network is also involved in the spotlight of attention and in the encoding of potential action towards objects; these are manifested in the perception and action interfaces for common attention and object affordance, respectively. Within this framework, most studies were dedicated to the description of the role of the inferior parietal lobule; growing evidence, however, suggests that the superior parietal lobule also plays a crucial role in the interplay between action and perception. The present review proposes a novel model that is inclusive of the superior parietal regions and their relative contribution to the different action and perception interfaces.

Orientation representation in human visual cortices: contributions of non-visual information and action-related process

Orientation processing in the human brain plays a crucial role in guiding grasping actions toward an object. Remarkably, despite the absence of visual input, the human visual cortex can still process orientation information. Instead of visual input, non-visual information, including tactile and proprioceptive sensory input from the hand and arm, as well as feedback from action-related processes, may contribute to orientation processing. However, the precise mechanisms by which the visual cortices process orientation information in the context of non-visual sensory input and action-related processes remain to be elucidated. Thus, our study examined the orientation representation within the visual cortices by analyzing the blood-oxygenation-level-dependent (BOLD) signals under four action conditions: direct grasp (DG), air grasp (AG), non-grasp (NG), and uninformed grasp (UG). The images of the cylindrical object were shown at +45° or - 45° orientations, corresponding to those of the real object to be grasped with the whole-hand gesture. Participants judged their orientation under all conditions. Grasping was performed without online visual feedback of the hand and object. The purpose of this design was to investigate the visual areas under conditions involving tactile feedback, proprioception, and action-related processes. To address this, a multivariate pattern analysis was used to examine the differences among the cortical patterns of the four action conditions in orientation representation by classification. Overall, significant decoding accuracy over chance level was discovered for the DG; however, during AG, only the early visual areas showed significant accuracy, suggesting that the object's tactile feedback influences the orientation process in higher visual areas. The NG showed no statistical significance in any area, indicating that without the grasping action, visual input does not contribute to cortical pattern representation. Interestingly, only the dorsal and ventral divisions of the third visual area (V3d and V3v) showed significant decoding accuracy during the UG despite the absence of visual instructions, suggesting that the orientation representation was derived from action-related processes in V3d and visual recognition of object visualization in V3v. The processing of orientation information during non-visually guided grasping of objects relies on other non-visual sources and is specifically divided by the purpose of action or recognition.

The brain lateralization and development of math functions: progress since Sperry, 1974

In 1974, Roger Sperry, based on his seminal studies on the split-brain condition, concluded that math was almost exclusively sustained by the language dominant left hemisphere. The right hemisphere could perform additions up to sums less than 20, the only exception to a complete left hemisphere dominance. Studies on lateralized focal lesions came to a similar conclusion, except for written complex calculation, where spatial abilities are needed to display digits in the right location according to the specific requirements of calculation procedures. Fifty years later, the contribution of new theoretical and instrumental tools lead to a much more complex picture, whereby, while left hemisphere dominance for math in the right-handed is confirmed for most functions, several math related tasks seem to be carried out in the right hemisphere. The developmental trajectory in the lateralization of math functions has also been clarified. This corpus of knowledge is reviewed here. The right hemisphere does not simply offer its support when calculation requires generic space processing, but its role can be very specific. For example, the right parietal lobe seems to store the operation-specific spatial layout required for complex arithmetical procedures and areas like the right insula are necessary in parsing complex numbers containing zero. Evidence is found for a complex orchestration between the two hemispheres even for simple tasks: each hemisphere has its specific role, concurring to the correct result. As for development, data point to right dominance for basic numerical processes. The picture that emerges at school age is a bilateral pattern with a significantly greater involvement of the right-hemisphere, particularly in non-symbolic tasks. The intraparietal sulcus shows a left hemisphere preponderance in response to symbolic stimuli at this age.

Dissociating representations of affect and motion in visual cortices

While a delicious dessert being presented to us may elicit strong feelings of happiness and excitement, the same treat falling slowly away can lead to sadness and disappointment. Our emotional response to the item depends on its visual motion direction. Despite this importance, it remains unclear whether (and how) cortical areas devoted to decoding motion direction represents or integrates emotion with perceived motion direction. Motion-selective visual area V5/MT+ sits, both functionally and anatomically, at the nexus of dorsal and ventral visual streams. These pathways, however, differ in how they are modulated by emotional cues. The current study was designed to disentangle how emotion and motion perception interact, as well as use emotion-dependent modulation of visual cortices to understand the relation of V5/MT+ to canonical processing streams. During functional magnetic resonance imaging (fMRI), approaching, receding, or static motion after-effects (MAEs) were induced on stationary positive, negative, and neutral stimuli. An independent localizer scan was conducted to identify the visual-motion area V5/MT+. Through univariate and multivariate analyses, we demonstrated that emotion representations in V5/MT+ share a more similar response profile to that observed in ventral visual than dorsal, visual structures. Specifically, V5/MT+ and ventral structures were sensitive to the emotional content of visual stimuli, whereas dorsal visual structures were not. Overall, this work highlights the critical role of V5/MT+ in the representation and processing of visually acquired emotional content. It further suggests a role for this region in utilizing affectively salient visual information to augment motion perception of biologically relevant stimuli.

Two fine-scale channels for encoding motion and stereopsis within the human magnocellular stream

In humans and non-human primates (NHPs), motion and stereopsis are processed within fine-scale cortical sites, including V2 thick stripes and their extensions into areas V3 and V3A that are believed to be under the influence of magnocellular stream. However, in both species, the relative functional organization (overlapping vs. none overlapping) of these sites remains unclear. Using high-resolution functional MRI (fMRI), we found evidence for two minimally-overlapping channels within human extrastriate areas that contribute to processing motion and stereopsis. Across multiple experiments that included different stimuli (random dots, gratings, and natural scenes), the functional selectivity of these channels for motion vs. stereopsis remained consistent. Furthermore, an analysis of resting-state functional connectivity revealed stronger functional connectivity within the two channels rather than between them. This finding provides a new perspective toward the mesoscale organization of the magnocellular stream within the human extrastriate visual cortex, beyond our previous understanding based on animal models.

Neural Research on Depth Perception and Stereoscopic Visual Fatigue in Virtual Reality

Virtual reality (VR) technology provides highly immersive depth perception experiences; nevertheless, stereoscopic visual fatigue (SVF) has become an important factor currently hindering the development of VR applications. However, there is scant research on the underlying neural mechanism of SVF, especially those induced by VR displays, which need further research. In this paper, a Go/NoGo paradigm based on disparity variations is proposed to induce SVF associated with depth perception, and the underlying neural mechanism of SVF in a VR environment was investigated. The effects of disparity variations as well as SVF on the temporal characteristics of visual evoked potentials (VEPs) were explored. Point-by-point permutation statistical with repeated measures ANOVA results revealed that the amplitudes and latencies of the posterior VEP component P2 were modulated by disparities, and posterior P2 amplitudes were modulated differently by SVF in different depth perception situations. Cortical source localization analysis was performed to explore the original cortex areas related to certain fatigue levels and disparities, and the results showed that posterior P2 generated from the precuneus could represent depth perception in binocular vision, and therefore could be performed to distinguish SVF induced by disparity variations. Our findings could help to extend an understanding of the neural mechanisms underlying depth perception and SVF as well as providing beneficial information for improving the visual experience in VR applications.

Using High-Density Electroencephalography to Explore Spatiotemporal Representations of Object Categories in Visual Cortex

Visual object perception involves neural processes that unfold over time and recruit multiple regions of the brain. Here, we use high-density EEG to investigate the spatiotemporal representations of object categories across the dorsal and ventral pathways. In , human participants were presented with images from two animate object categories (birds and insects) and two inanimate categories (tools and graspable objects). In , participants viewed images of tools and graspable objects from a different stimulus set, one in which a shape confound that often exists between these categories (elongation) was controlled for. To explore the temporal dynamics of object representations, we employed time-resolved multivariate pattern analysis on the EEG time series data. This was performed at the electrode level as well as in source space of two regions of interest: one encompassing the ventral pathway and another encompassing the dorsal pathway. Our results demonstrate shape, exemplar, and category information can be decoded from the EEG signal. Multivariate pattern analysis within source space revealed that both dorsal and ventral pathways contain information pertaining to shape, inanimate object categories, and animate object categories. Of particular interest, we note striking similarities obtained in both ventral stream and dorsal stream regions of interest. These findings provide insight into the spatio-temporal dynamics of object representation and contribute to a growing literature that has begun to redefine the traditional role of the dorsal pathway.

Structural Brain Asymmetries for Language: A Comparative Approach across Primates

Humans are the only species that can speak. Nonhuman primates, however, share some ‘domain-general’ cognitive properties that are essential to language processes. Whether these shared cognitive properties between humans and nonhuman primates are the results of a continuous evolution [homologies] or of a convergent evolution [analogies] remain difficult to demonstrate. However, comparing their respective underlying structure—the brain—to determinate their similarity or their divergence across species is critical to help increase the probability of either of the two hypotheses, respectively. Key areas associated with language processes are the Planum Temporale, Broca’s Area, the Arcuate Fasciculus, Cingulate Sulcus, The Insula, Superior Temporal Sulcus, the Inferior Parietal lobe, and the Central Sulcus. These structures share a fundamental feature: They are functionally and structurally specialised to one hemisphere. Interestingly, several nonhuman primate species, such as chimpanzees and baboons, show human-like structural brain asymmetries for areas homologous to key language regions. The question then arises: for what function did these asymmetries arise in non-linguistic primates, if not for language per se? In an attempt to provide some answers, we review the literature on the lateralisation of the gestural communication system, which may represent the missing behavioural link to brain asymmetries for language area’s homologues in our common ancestor.

Investigate the Neuro Mechanisms of Stereoscopic Visual Fatigue

Stereoscopic visual fatigue (SVF) due to prolonged immersion in the virtual environment can lead to negative user experience, thus hindering the development of virtual reality (VR) industry. Previous studies have focused on investigating the evaluation indicators associated with SVF, while few studies have been conducted to reveal the underlying neural mechanism, especially in VR applications. In this paper, a modified Go/NoGo paradigm was adopted to induce SVF in VR environment with Go trials for maintaining participants' attention to experimental viewing tasks and NoGo trials for investigating the neural effects under SVF. Random dot stereograms (RDSs) with 11 disparities and 2 types of shapes (arrow and rectangle) were presented to evoke the depth-related visual evoked potentials (DVEPs) during 64-channel EEG recordings. EEG datasets collected from 15 participants in NoGo trials were selected to conduct individual processing and group analysis, in which the characteristics of the DVEPs components for various fatigue degrees were compared with one-way repeated-measurement ANOVA and independent components were clustered to explore the original cortex areas related to SVF. Point-by-point permutation statistics revealed that DVEPs sample points from 230ms to 280ms in most brain areas changed significantly with SVF. More specifically, we found that amplitudes of component P2 changed significantly when SVF increased. Additionally, independent component analysis (ICA) identified that component P2 which originated from posterior cingulate cortex and precuneus, was associated statistically with SVF. We believe that SVF is rather a conscious status concerning the changes of self-awareness or self-location awareness than the performance reduction of retinal image processing. Moreover, we suggest that indicators representing higher conscious state may be a better indicator for SVF evaluation in VR environments.

Visual Motion Coherence Responses in Human Visual Cortex

Random dot kinematograms (RDKs) have recently been used to train subjects with cortical scotomas to perform direction of motion discrimination, partially restoring visual motion perception. To study the recovery of visual perception, it is important to understand how visual areas in normal subjects and subjects with cortical scotomas respond to RDK stimuli. Studies in normal subjects have shown that blood oxygen level-dependent (BOLD) responses in human area hV5/MT+ increase monotonically with coherence, in general agreement with electrophysiology studies in primates. However, RDK responses in prior studies were obtained while the subject was performing fixation, not a motion discrimination condition. Furthermore, BOLD responses were gauged against a baseline condition of uniform illumination or static dots, potentially decreasing the specificity of responses for the spatial integration of local motion signals (motion coherence). Here, we revisit this question starting from a baseline RDK condition of no coherence, thereby isolating the component of BOLD response due specifically to the spatial integration of local motion signals. In agreement with prior studies, we found that responses in the area hV5/MT+ of healthy subjects were monotonically increasing when subjects fixated without performing a motion discrimination task. In contrast, when subjects were performing an RDK direction of motion discrimination task, responses in the area hV5/MT+ remained flat, changing minimally, if at all, as a function of motion coherence. A similar pattern of responses was seen in the area hV5/MT+ of subjects with dense cortical scotomas performing direction of motion discrimination for RDKs presented inside the scotoma. Passive RDK presentation within the scotoma elicited no significant hV5/MT+ responses. These observations shed further light on how visual cortex responses behave as a function of motion coherence, helping to prepare the ground for future studies using these methods to study visual system recovery after injury.

Receptor architecture of macaque and human early visual areas: not equal, but comparable

Existing cytoarchitectonic maps of the human and macaque posterior occipital cortex differ in the number of areas they display, thus hampering identification of homolog structures. We applied quantitative in vitro receptor autoradiography to characterize the receptor architecture of the primary visual and early extrastriate cortex in macaque and human brains, using previously published cytoarchitectonic criteria as starting point of our analysis. We identified 8 receptor architectonically distinct areas in the macaque brain (mV1d, mV1v, mV2d, mV2v, mV3d, mV3v, mV3A, mV4v), and their respective counterpart areas in the human brain (hV1d, hV1v, hV2d, hV2v, hV3d, hV3v, hV3A, hV4v). Mean densities of 14 neurotransmitter receptors were quantified in each area, and ensuing receptor fingerprints used for multivariate analyses. The 1st principal component segregated macaque and human early visual areas differ. However, the 2nd principal component showed that within each species, area-specific differences in receptor fingerprints were associated with the hierarchical processing level of each area. Subdivisions of V2 and V3 were found to cluster together in both species and were segregated from subdivisions of V1 and from V4v. Thus, comparative studies like this provide valuable architectonic insights into how differences in underlying microstructure impact evolutionary changes in functional processing of the primate brain and, at the same time, provide strong arguments for use of macaque monkey brain as a suitable animal model for translational studies.

Parietal maps of visual signals for bodily action planning

The posterior parietal cortex (PPC) has long been understood as a high-level integrative station for computing motor commands for the body based on sensory (i.e., mostly tactile and visual) input from the outside world. In the last decade, accumulating evidence has shown that the parietal areas not only extract the pragmatic features of manipulable objects, but also subserve sensorimotor processing of others’ actions. A paradigmatic case is that of the anterior intraparietal area (AIP), which encodes the identity of observed manipulative actions that afford potential motor actions the observer could perform in response to them. On these bases, we propose an AIP manipulative action-based template of the general planning functions of the PPC and review existing evidence supporting the extension of this model to other PPC regions and to a wider set of actions: defensive and locomotor actions. In our model, a hallmark of PPC functioning is the processing of information about the physical and social world to encode potential bodily actions appropriate for the current context. We further extend the model to actions performed with man-made objects (e.g., tools) and artifacts, because they become integral parts of the subject’s body schema and motor repertoire. Finally, we conclude that existing evidence supports a generally conserved neural circuitry that transforms integrated sensory signals into the variety of bodily actions that primates are capable of preparing and performing to interact with their physical and social world.

Myelin densities in retinotopically defined dorsal visual areas of the macaque

The visuotopic organization of dorsal visual cortex rostral to area V2 in primates has been a longstanding source of controversy. Using sub-millimeter phase-encoded retinotopic fMRI mapping, we recently provided evidence for a surprisingly similar visuotopic organization in dorsal visual cortex of macaques compared to previously published maps in New world monkeys (Zhu and Vanduffel, Proc Natl Acad Sci USA 116:2306–2311, 2019). Although individual quadrant representations could be robustly delineated in that study, their grouping into hemifield representations remains a major challenge. Here, we combined in-vivo high-resolution myelin density mapping based on MR imaging (400 µm isotropic resolution) with fine-grained retinotopic fMRI to quantitatively compare myelin densities across retinotopically defined visual areas in macaques. Complementing previously documented differences in populational receptive-field (pRF) size and visual field signs, myelin densities of both quadrants of the dorsolateral posterior area (DLP) and area V3A are significantly different compared to dorsal and ventral area V3. Moreover, no differences in myelin density were observed between the two matching quadrants belonging to areas DLP, V3A, V1, V2 and V4, respectively. This was not the case, however, for the dorsal and ventral quadrants of area V3, which showed significant differences in MR-defined myelin densities, corroborating evidence of previous myelin staining studies. Interestingly, the pRF sizes and visual field signs of both quadrant representations in V3 are not different. Although myelin density correlates with curvature and anticorrelates with cortical thickness when measured across the entire cortex, exactly as in humans, the myelin density results in the visual areas cannot be explained by variability in cortical thickness and curvature between these areas. The present myelin density results largely support our previous model to group the two quadrants of DLP and V3A, rather than grouping DLP- with V3v into a single area VLP, or V3d with V3A+ into DM.

Common functional localizers to enhance NHP & cross-species neuroscience imaging research

Functional localizers are invaluable as they can help define regions of interest, provide cross-study comparisons, and most importantly, allow for the aggregation and meta-analyses of data across studies and laboratories. To achieve these goals within the non-human primate (NHP) imaging community, there is a pressing need for the use of standardized and validated localizers that can be readily implemented across different groups. The goal of this paper is to provide an overview of the value of localizer protocols to imaging research and we describe a number of commonly used or novel localizers within NHPs, and keys to implement them across studies. As has been shown with the aggregation of resting-state imaging data in the original PRIME-DE submissions, we believe that the field is ready to apply the same initiative for task-based functional localizers in NHP imaging. By coming together to collect large datasets across research group, implementing the same functional localizers, and sharing the localizers and data via PRIME-DE, it is now possible to fully test their robustness, selectivity and specificity. To do this, we reviewed a number of common localizers and we created a repository of well-established localizer that are easily accessible and implemented through the PRIME-RE platform.

Unique Neural Activity Patterns Among Lower Order Cortices and Shared Patterns Among Higher Order Cortices During Processing of Similar Shapes With Different Stimulus Types

We investigated the neural mechanism of the processing of three-dimensional (3D) shapes defined by disparity and perspective. We measured blood oxygenation level-dependent signals as participants viewed and classified 3D images of convex-concave shapes. According to the cue (disparity or perspective) and element type (random dots or black and white dotted lines), three types of stimuli were used: random dot stereogram, black and white dotted lines with perspective, and black and white dotted lines with binocular disparity. The blood oxygenation level-dependent images were then classified by multivoxel pattern analysis. To identify areas selective to shape, we assessed convex-concave classification accuracy with classifiers trained and tested using signals evoked by the same stimulus type (same cue and element type). To identify cortical regions with similar neural activity patterns regardless of stimulus type, we assessed the convex-concave classification accuracy of transfer classification in which classifiers were trained and tested using different stimulus types (different cues or element types). Classification accuracy using the same stimulus type was high in the early visual areas and subregions of the intraparietal sulcus (IPS), whereas transfer classification accuracy was high in the dorsal subregions of the IPS. These results indicate that the early visual areas process the specific features of stimuli, whereas the IPS regions perform more generalized processing of 3D shapes, independent of a specific stimulus type.

Optimization of a quadrature birdcage coil for functional imaging of squirrel monkey brain at 9.4T

A quadrature transmit/receive birdcage coil was optimized for squirrel monkey functional imaging at the high field of 9.4 T. The coil length was chosen to gain maximum coil efficiency/signal-to-noise ratio (SNR) and meanwhile provide enough homogenous RF field in the whole brain area. Based on the numerical simulation results, a 16-rung high-pass birdcage coil with the optimal length of 9 cm was constructed and evaluated on phantom and in vivo experiments. Compared to a general-purpose non-optimized coil, it exhibits approximately 25% in vivo SNR improvement. In addition to the volume coil, details about how to design and construct the associated animal preparation system were provided.

Activity Strength within Optic Flow-Sensitive Cortical Regions Is Associated with Visual Path Integration Accuracy in Aged Adults

Spatial navigation is a cognitive skill fundamental to successful interaction with our environment, and aging is associated with weaknesses in this skill. Identifying mechanisms underlying individual differences in navigation ability in aged adults is important to understanding these age-related weaknesses. One understudied factor involved in spatial navigation is self-motion perception. Important to self-motion perception is optic flow–the global pattern of visual motion experienced while moving through our environment. A set of optic flow-sensitive (OF-sensitive) cortical regions was defined in a group of young (n = 29) and aged (n = 22) adults. Brain activity was measured in this set of OF-sensitive regions and control regions using functional magnetic resonance imaging while participants performed visual path integration (VPI) and turn counting (TC) tasks. Aged adults had stronger activity in RMT+ during both tasks compared to young adults. Stronger activity in the OF-sensitive regions LMT+ and RpVIP during VPI, not TC, was associated with greater VPI accuracy in aged adults. The activity strength in these two OF-sensitive regions measured during VPI explained 42% of the variance in VPI task performance in aged adults. The results of this study provide novel support for global motion processing as a mechanism underlying visual path integration in normal aging.

Neural Selectivity for Visual Motion in Macaque Area V3A

The processing of visual motion is conducted by dedicated pathways in the primate brain. These pathways originate with populations of direction-selective neurons in the primary visual cortex, which projects to dorsal structures like the middle temporal (MT) and medial superior temporal (MST) areas. Anatomical and imaging studies have suggested that area V3A might also be specialized for motion processing, but there have been very few studies of single-neuron direction selectivity in this area. We have therefore performed electrophysiological recordings from V3A neurons in two macaque monkeys (one male and one female) and measured responses to a large battery of motion stimuli that includes translation motion, as well as more complex optic flow patterns. For comparison, we simultaneously recorded the responses of MT neurons to the same stimuli. Surprisingly, we find that overall levels of direction selectivity are similar in V3A and MT and moreover that the population of V3A neurons exhibits somewhat greater selectivity for optic flow patterns. These results suggest that V3A should be considered as part of the motion processing machinery of the visual cortex, in both human and non-human primates.

Neanderthal-Derived Genetic Variation is Associated with Functional Connectivity in the Brains of Living Humans

Aim: To determine whether Neanderthal-derived genetic variation relates to functional connectivity patterns in the brains of living modern humans. Introduction: Nearly 50,000 years ago, Neanderthals interbred with ancestors of modern humans, imparting a genetic legacy that lives on today. The vestiges of this Neanderthal-derived genetic variation have been previously shown to be enriched in genes coding for neurogenesis and myelination and to alter skull shape and brain structure in living people. Materials and Methods: Using two independent cohorts totaling 553 healthy individuals, we employed multivariate distance matrix regression (MDMR) to determine whether any brain areas exhibited whole-brain functional connectivity patterns that significantly related to the degree of Neanderthal introgression. Identified clusters were then used as regions of interest in follow-up seed-based functional connectivity analyses to determine the connectivity patterns driving the relationships. Results: The MDMR analysis revealed that the percentage of Neanderthal-originating polymorphisms was significantly associated with the functional connectivity patterns of an area of the intraparietal sulcus (IPS) that was nearly identical in both cohorts. Using these IPS clusters as regions of interest in seed-based connectivity analyses, we found, again in both cohorts, that individuals with a higher proportion of Neanderthal-derived genetic variation showed increased IPS functional connectivity with visual processing regions, but decreased IPS connectivity with regions underlying social cognition. Conclusions: These findings demonstrate that the remnants of Neanderthal admixture continue to influence human brain function today, in ways that are consistent with anthropological conceptualizations of Neanderthal phenotypes, including the possibility that Neanderthals may have depended upon visual processing capabilities at the expense of social cognition, and this may have contributed to the extinction of this species through reduced cultural maintenance and inability to cope with fluctuating resources. This and other studies capitalizing on the emerging science surrounding ancient DNA provide a window through which to view an ancient lineage long past.

What Does Dorsal Cortex Contribute to Perception?

According to the influential "Two Visual Pathways" hypothesis, the cortical visual system is segregated into two pathways, with the ventral, occipitotemporal pathway subserving object perception, and the dorsal, occipitoparietal pathway subserving the visuomotor control of action. However, growing evidence suggests that the dorsal pathway also plays a functional role in object perception. In the current article, we present evidence that the dorsal pathway contributes uniquely to the perception of a range of visuospatial attributes that are not redundant with representations in ventral cortex. We describe how dorsal cortex is recruited automatically during perception, even when no explicit visuomotor response is required. Importantly, we propose that dorsal cortex may selectively process visual attributes that can inform the perception of potential actions on objects and environments, and we consider plausible developmental and cognitive mechanisms that might give rise to these representations. As such, we consider whether naturalistic stimuli, such as real-world solid objects, might engage dorsal cortex more so than simplified or artificial stimuli such as images that do not afford action, and how the use of suboptimal stimuli might limit our understanding of the functional contribution of dorsal cortex to visual perception.

Spatiotemporal Differences in the Regional Cortical Plate and Subplate Volume Growth during Fetal Development

The regional specification of the cerebral cortex can be described by protomap and protocortex hypotheses. The protomap hypothesis suggests that the regional destiny of cortical neurons and the relative size of the cortical area are genetically determined early during embryonic development. The protocortex hypothesis suggests that the regional growth rate is predominantly shaped by external influences. In order to determine regional volumes of cortical compartments (cortical plate (CP) or subplate (SP)) and estimate their growth rates, we acquired T2-weighted in utero MRIs of 40 healthy fetuses and grouped them into early (<25.5 GW), mid- (25.5-31.6 GW), and late (>31.6 GW) prenatal periods. MRIs were segmented into CP and SP and further parcellated into 22 gyral regions. No significant difference was found between periods in regional volume fractions of the CP or SP. However, during the early and mid-prenatal periods, we found significant differences in relative growth rates (% increase per GW) between regions of cortical compartments. Thus, the relative size of these regions are most likely conserved and determined early during development whereas more subtle growth differences between regions are fine-tuned later, during periods of peak thalamocortical growth. This is in agreement with both the protomap and protocortex hypothesis.

Stereomotion Processing in the Nonhuman Primate Brain

The cortical areas that process disparity-defined motion-in-depth (i.e., cyclopean stereomotion [CSM]) were characterized with functional magnetic resonance imaging (fMRI) in two awake, behaving macaques. The experimental protocol was similar to previous human neuroimaging studies. We contrasted the responses to dynamic random-dot patterns that continuously changed their binocular disparity over time with those to a control condition that shared the same properties, except that the temporal frames were shuffled. A whole-brain voxel-wise analysis revealed that in all four cortical hemispheres, three areas showed consistent sensitivity to CSM. Two of them were localized respectively in the lower bank of the superior temporal sulcus (CSMSTS) and on the neighboring infero-temporal gyrus (CSMITG). The third area was situated in the posterior parietal cortex (CSMPPC). Additional regions of interest-based analyses within retinotopic areas defined in both animals indicated weaker but significant responses to CSM within the MT cluster (most notably in areas MSTv and FST). Altogether, our results are in agreement with previous findings in both human and macaque and suggest that the cortical areas that process CSM are relatively well preserved between the two primate species.

Shape specificity of neural persistence for the kinetic-depth effect matches perceptual adaptation but not sensory memory

When multistable displays-stimuli that are compatible with several comparably likely perceptual interpretations-are presented intermittently, the perceptual state at the stimulus onset shows a complex dependence on the duration of the preceding blank interval. Specifically, perception is maximally destabilized for interruptions that are approximately 500 ms long, but it is stabilized by the use of shorter or longer blank intervals. This nonmonotonic dependence of perceptual stability on the blank interval duration raises questions about a number of history effects that are involved and about their nature, including the underlying neural representations. One way to characterize history effects is by looking at their specificity to the change of display properties. Here we measured the shape specificity for perception of the kinetic-depth effect when interruptions were brief (50 ms). For this time interval, perception is thought to be stabilized by neural persistence, a lingering trace of the prior neural activity. We found that perceptual stability depended on the shapes of the objects presented both before and after the break, but not on the similarity between the objects. These results matched earlier reports of the shape specificity of neural adaptation (destabilizing aftereffect for blanks 200-800 ms long). However, our results were markedly different from the shape specificity of sensory memory of multistable perception (a stabilizing effect for blanks > 800-1,000 ms). We concluded that whereas neural persistence and adaptation both act on the same motion-selective neural representation, sensory memory depends on another, possibly partially overlapping, shape-selective neural ensemble.

Generalized Representation of Stereoscopic Surface Shape and Orientation in the Human Visual Cortex

The brain's ability to extract three-dimensional (3D) shape and orientation information from viewed objects is vital in daily life. Stereoscopic 3D surface perception relies on binocular disparity. Neurons selective to binocular disparity are widely distributed among visual areas, but the manner in these areas are involved in stereoscopic 3D surface representation is unclear. To address this, participants were instructed to observe random dot stereograms (RDS) depicting convex and concave curved surfaces and the blood oxygenation level-dependent (BOLD) signal of visual cortices was recorded. Two surface types were: (i) horizontally positioned surfaces defined by shear disparity; and (ii) vertically positioned surfaces defined by compression disparity. The surfaces were presented at different depth positions per trial. Functional magnetic resonance imaging (fMRI) data were classified from early visual areas to higher visual areas. We determined whether cortical areas were selective to shape and orientation by assessing same-type stimuli classification accuracies based on multi-voxel activity patterns per area. To identify whether some areas were related to a more generalized sign of curvature or orientation representation, transfer classification was used by training classifiers on one dataset type and testing classifiers on another type. Same-type stimuli classification results showed that most selected visual areas were selective to shape and all were selective to the orientation of disparity-defined 3D surfaces. Transfer classification results showed that in the dorsal visual area V3A, classification accuracies for the discriminate sign of surface curvature were higher than the baseline of statistical significance for all types of classifications, demonstrating that V3A is related to generalized shape representation. Classification accuracies for discriminating horizontal-vertical surfaces in higher dorsal areas V3A and V7 and ventral area lateral occipital complex (LOC) as well as in some areas of intraparietal sulcus (IPS) were higher than the baseline of statistical significance, indicating their relation to the generalized representation of 3D surface orientation.

Ventral midbrain stimulation induces perceptual learning and cortical plasticity in primates

Practice improves perception and enhances neural representations of trained visual stimuli, a phenomenon known as visual perceptual learning (VPL). While attention to task-relevant stimuli plays an important role in such learning, Pavlovian stimulus-reinforcer associations are sufficient to drive VPL, even subconsciously. It has been proposed that reinforcement facilitates perceptual learning through the activation of neuromodulatory centers, but this has not been directly confirmed in primates. Here, we paired task-irrelevant visual stimuli with microstimulation of a dopaminergic center, the ventral tegmental area (VTA), in macaques. Pairing VTA microstimulation with a task-irrelevant visual stimulus increased fMRI activity and improved classification of fMRI activity patterns selectively for the microstimulation-paired stimulus. Moreover, pairing VTA microstimulation with a task-irrelevant visual stimulus improved the subject’s capacity to discriminate that stimulus. This is the first causal demonstration of the role of neuromodulatory centers in VPL in primates.

Practice can improve the perception of stimuli used to achieve a task (perceptual learning). Here, the authors show in monkeys that perceptual learning can be produced even for irrelevant stimuli if the stimuli are paired with stimulation of a dopaminergic centre, the ventral tegmental area (VTA).

Differential cortical activation during the perception of moving objects along different trajectories

Detection of 3D object-motion trajectories depends on the integration of two distinct visual cues: translational displacement and looming. Electrophysiological studies have identified distinct neuronal populations, whose activity depends on the precise motion cues present in the stimulus. This distinction, however, has been less clear in humans, and it is confounded by differences in the behavioral task being performed. We analyzed whole-brain fMRI, while subjects performed a common time-to-arrival task for objects moving along three trajectories: moving directly towards the observer (collision course), with trajectories parallel to the line of sight (passage course), and with trajectories perpendicular to the line of sight (gap closure). We found that there was substantial overlap in the pattern of activation associated with each of the three tasks, with differences among conditions limited to the human motion area (hMT+), which showed greater activation extent in the gap closure condition than for either collision or passage courses. These results support a common substrate for temporal judgments of an object's time-to-arrival, wherein the special cases of object motion directly toward, or perpendicular to, the observer represent two extremes within the broader continuum of 3D passage trajectories relative to the observer.

Representation of shape, space, and attention in monkey cortex

Attentional deficits are core to numerous developmental, neurological, and psychiatric disorders. At the single-cell level, much knowledge has been garnered from studies of shape and spatial properties, as well as from numerous demonstrations of attentional modulation of those properties. Despite this wealth of knowledge of single-cell responses across many brain regions, little is known about how these cellular characteristics relate to population level representations and how such representations relate to behavior; in particular, how these cellular responses relate to the representation of shape, space, and attention, and how these representations differ across cortical areas and streams. Here we will emphasize the role of population coding as a missing link for connecting single-cell properties with behavior. Using a data-driven intrinsic approach to population decoding, we show that both 'what' and 'where' cortical visual streams encode shape, space, and attention, yet demonstrate striking differences in these representations. We suggest that both pathways fully process shape and space, but that differences in representation may arise due to their differing functions and input and output constraints. Moreover, differences in the effects of attention on shape and spatial population representations in the two visual streams suggest two distinct strategies: in a ventral area, attention or task demands modulate the population representations themselves (perhaps to expand or enhance one part at the expense of other parts) while in a dorsal area, at a population representation level, attention effects are weak and nearly non-existent, perhaps in order to maintain veridical representations needed for visuomotor control. We show that an intrinsic approach, as opposed to theory-driven and labeled approaches, is useful for understanding how representations develop and differ across brain regions. Most importantly, these approaches help link cellular properties more tightly with behavior, a much-needed step to better understand and interpret cellular findings and key to providing insights to improve interventions in human disorders.

Asymmetries between achromatic and chromatic extraction of 3D motion signals

Motion in depth (MID) can be cued by high-resolution changes in binocular disparity over time (CD), and low-resolution interocular velocity differences (IOVD). Computational differences between these two mechanisms suggest that they may be implemented in visual pathways with different spatial and temporal resolutions. Here, we used fMRI to examine how achromatic and S-cone signals contribute to human MID perception. Both CD and IOVD stimuli evoked responses in a widespread network that included early visual areas, parts of the dorsal and ventral streams, and motion-selective area hMT+. Crucially, however, we measured an interaction between MID type and chromaticity. fMRI CD responses were largely driven by achromatic stimuli, but IOVD responses were better driven by isoluminant S-cone inputs. In our psychophysical experiments, when S-cone and achromatic stimuli were matched for perceived contrast, participants were equally sensitive to the MID in achromatic and S-cone IOVD stimuli. In comparison, they were relatively insensitive to S-cone CD. These findings provide evidence that MID mechanisms asymmetrically draw on information in precortical pathways. An early opponent motion signal optimally conveyed by the S-cone pathway may provide a substantial contribution to the IOVD mechanism.

Dissociating neural activity associated with the subjective phenomenology of monocular stereopsis: An EEG study

The subjective phenomenology associated with stereopsis, of solid tangible objects separated by a palpable negative space, is conventionally thought to be a by-product of the derivation of depth from binocular disparity. However, the same qualitative impression has been reported in the absence of disparity, e.g., when viewing pictorial images monocularly through an aperture. Here we aimed to explore if we could identify dissociable neural activity associated with the qualitative impression of stereopsis in the absence of the processing of binocular disparities. We measured EEG activity while subjects viewed pictorial (non-stereoscopic) images of 2D and 3D geometric forms under four different viewing conditions (binocular, monocular, binocular aperture, monocular aperture). EEG activity was analysed by oscillatory source localization (beamformer technique) to examine power change in occipital and parietal regions across viewing and stimulus conditions in targeted frequency bands (alpha: 8-13 Hz & gamma: 60-90 Hz). We observed expected event-related gamma synchronization and alpha desynchronization in occipital cortex and predominant gamma synchronization in parietal cortex across viewing and stimulus conditions. However, only the viewing condition predicted to generate the strongest impression of stereopsis (monocular aperture) revealed significantly elevated gamma synchronization within the parietal cortex for the critical contrasts (3D vs. 2D form). These findings suggest dissociable neural processes specific to the qualitative impression of stereopsis as distinguished from disparity processing.

Perceiving animacy purely from visual motion cues involves intraparietal sulcus

Distinguishing animate from inanimate objects is fundamental for social perception in humans and animals. Visual motion cues indicative of self-propelled object motion are useful for animacy perception: they can be detected over a wide expanse of visual field, at distance and in low visibility conditions, can attract attention and provide clues about object behaviour. However, the neural correlates of animacy perception evoked exclusively by visual motion cues, i.e. not relying on form, background or visual context, are unclear. We aimed to address this question in four psychophysical experiments in humans, two of which performed during neuroimaging. The stimulus was a single dot with constant form that moved on a blank background and evoked controlled degrees of perceived animacy through parametric variations of self-propelled motion cues. BOLD signals reflecting perceived animacy in a graded manner irrespective of eye movements were found in one intraparietal region. Additional whole-brain and region-of-interest analyses revealed no comparable effects in brain regions associated with social processing or other areas. Our study shows that animacy perception evoked solely by visual motion cues, a basic perceptual process in social cognition, engages brain regions not primarily associated with social cognition.

Areal differences in depth cue integration between monkey and human

Electrophysiological evidence suggested primarily the involvement of the middle temporal (MT) area in depth cue integration in macaques, as opposed to human imaging data pinpointing area V3B/kinetic occipital area (V3B/KO). To clarify this conundrum, we decoded monkey functional MRI (fMRI) responses evoked by stimuli signaling near or far depths defined by binocular disparity, relative motion, and their combination, and we compared results with those from an identical experiment previously performed in humans. Responses in macaque area MT are more discriminable when two cues concurrently signal depth, and information provided by one cue is diagnostic of depth indicated by the other. This suggests that monkey area MT computes fusion of disparity and motion depth signals, exactly as shown for human area V3B/KO. Hence, these data reconcile previously reported discrepancies between depth processing in human and monkey by showing the involvement of the dorsal stream in depth cue integration using the same technique, despite the engagement of different regions.

In everyday life, we interact with a three-dimensional world that we perceive via our two-dimensional retinas. Our brain can reconstruct the third dimension from these flat retinal images using multiple sources of visual information, or cues. The horizontal displacement of the two retinal images, known as binocular disparity, and the relative motion between different objects are two important depth cues. However, to make the most of the information provided by each cue, our brains must efficiently integrate across them. To examine this process, we used neuroimaging in monkeys to record brain responses evoked by stimuli signaling depths defined by either binocular disparity or relative motion in isolation, and also when the two cues are combined congruently or incongruently. We found that cortical area MT in monkeys is involved in the fusion of these two particular depth cues, in contrast to previous human imaging data that pinpoint a more posterior cortical area, V3B/KO. Our findings support the existence of depth cue integration mechanisms in primates; however, this fusion appears to be computed in slightly different areas in humans and monkeys.

Brain Map of Intrinsic Functional Flexibility in Anesthetized Monkeys and Awake Humans

Emerging neuroimaging studies emphasize the dynamic organization of spontaneous brain activity in both human and non-human primates, even under anesthesia. In a recent study, we were able to characterize the heterogeneous architecture of intrinsic functional flexibility in the awake, resting human brain using time-resolved analysis and a probabilistic model. However, it is unknown whether this organizational principle is preserved in the anesthetized monkey brain, and how anesthesia affects dynamic and static measurements of spontaneous brain activity. To investigate these issues, we collected resting-state functional magnetic resonance imaging (fMRI) datasets from 178 awake humans and 11 anesthetized monkeys (all healthy). Our recently established method, a complexity measurement (i.e., Shannon entropy) of dynamic functional connectivity patterns of each brain region, was used to map the intrinsic functional flexibility across the cerebral cortex. To further explore the potential effects of anesthesia, we performed time series analysis and correlation analysis between dynamic and static measurements within awake human and anesthetized monkey brains, respectively. We observed a heterogeneous profile of intrinsic functional flexibility in the anesthetized monkey brain, which showed some similarities to that of awake humans (r = 0.30, p = 0.007). However, we found that brain activity in anesthetized monkeys generally shifted toward random fluctuations. Moreover, there is a negative correlation between nodal entropy for the distribution of dynamic functional connectivity patterns and static functional connectivity strength in anesthetized monkeys, but not in awake humans. Our findings indicate that the heterogeneous architecture of intrinsic functional flexibility across cortex probably reflects an evolutionarily conserved aspect of functional brain organization, which persists across levels of cognitive processing (states of consciousness). The coupling between nodal entropy for the distribution of dynamic functional connectivity patterns and static functional connectivity strength may serve as a potential signature of anesthesia. This study not only offers fresh insight into the evolution of brain functional architecture, but also advances our understanding of the dynamics of spontaneous brain activity.

Homology and Specificity of Natural Sound-Encoding in Human and Monkey Auditory Cortex

Understanding homologies and differences in auditory cortical processing in human and nonhuman primates is an essential step in elucidating the neurobiology of speech and language. Using fMRI responses to natural sounds, we investigated the representation of multiple acoustic features in auditory cortex of awake macaques and humans. Comparative analyses revealed homologous large-scale topographies not only for frequency but also for temporal and spectral modulations. In both species, posterior regions preferably encoded relatively fast temporal and coarse spectral information, whereas anterior regions encoded slow temporal and fine spectral modulations. Conversely, we observed a striking interspecies difference in cortical sensitivity to temporal modulations: While decoding from macaque auditory cortex was most accurate at fast rates (> 30 Hz), humans had highest sensitivity to ~3 Hz, a relevant rate for speech analysis. These findings suggest that characteristic tuning of human auditory cortex to slow temporal modulations is unique and may have emerged as a critical step in the evolution of speech and language.

Single-cell responses to three-dimensional structure in a functionally defined patch in macaque area TEO

Both dorsal and ventral visual pathways harbor several areas sensitive to gradients of binocular disparity (i.e., higher-order disparity). Although a wealth of information exists about disparity processing in early visual (V1, V2, and V3) and end-stage areas, TE in the ventral stream, and the anterior intraparietal area (AIP) in the dorsal stream, little is known about midlevel area TEO in the ventral pathway. We recorded single-unit responses to disparity-defined curved stimuli in a functional magnetic resonance imaging (fMRI) activation elicited by curved surfaces compared with flat surfaces in the macaque area TEO. This fMRI activation contained a small proportion of disparity-selective neurons, with very few of them second-order disparity selective. Overall, this population of TEO neurons did not preserve its three-dimensional structure selectivity across positions in depth, indicating a lack of higher-order disparity selectivity, but showed stronger responses to flat surfaces than to curved surfaces, as predicted by the fMRI experiment. The receptive fields of the responsive TEO cells were relatively small and generally foveal. A linear support vector machine classifier showed that this population of disparity-selective TEO neurons contains reliable information about the sign of curvature and the position in depth of the stimulus. NEW & NOTEWORTHY We recorded in a part of the macaque area TEO that is activated more by curved surfaces than by flat surfaces at different disparities using the same stimuli. In contrast to previous studies, this functional magnetic resonance imaging-defined patch did not contain a large number of higher-order disparity-selective neurons. However, a linear support vector machine could reliably classify both the sign of the disparity gradient and the position in depth of the stimuli.

Visual brain plasticity induced by central and peripheral visual field loss

Disorders that specifically affect central and peripheral vision constitute invaluable models to study how the human brain adapts to visual deafferentation. We explored cortical changes after the loss of central or peripheral vision. Cortical thickness (CoTks) and resting-state cortical entropy (rs-CoEn), as a surrogate for neural and synaptic complexity, were extracted in 12 Stargardt macular dystrophy, 12 retinitis pigmentosa (tunnel vision stage), and 14 normally sighted subjects. When compared to controls, both groups with visual loss exhibited decreased CoTks in dorsal area V3d. Peripheral visual field loss also showed a specific CoTks decrease in early visual cortex and ventral area V4, while central visual field loss in dorsal area V3A. Only central visual field loss exhibited increased CoEn in LO-2 area and FG1. Current results revealed biomarkers of brain plasticity within the dorsal and the ventral visual streams following central and peripheral visual field defects.

Towards a unified perspective of object shape and motion processing in human dorsal cortex

Although object-related areas were discovered in human parietal cortex a decade ago, surprisingly little is known about the nature and purpose of these representations, and how they differ from those in the ventral processing stream. In this article, we review evidence for the unique contribution of object areas of dorsal cortex to three-dimensional (3-D) shape representation, the localization of objects in space, and in guiding reaching and grasping actions. We also highlight the role of dorsal cortex in form-motion interaction and spatiotemporal integration, possible functional relationships between 3-D shape and motion processing, and how these processes operate together in the service of supporting goal-directed actions with objects. Fundamental differences between the nature of object representations in the dorsal versus ventral processing streams are considered, with an emphasis on how and why dorsal cortex supports veridical (rather than invariant) representations of objects to guide goal-directed hand actions in dynamic visual environments.

Real-time visuomotor behavior and electrophysiology recording setup for use with humans and monkeys

Large-scale network dynamics in multiple visuomotor areas is of great interest in the study of eye-hand coordination in both human and monkey. To explore this, it is essential to develop a setup that allows for precise tracking of eye and hand movements. It is desirable that it is able to generate mechanical or visual perturbations of hand trajectories so that eye-hand coordination can be studied in a variety of conditions. There are simple solutions that satisfy these requirements for hand movements performed in the horizontal plane while visual stimuli and hand feedback are presented in the vertical plane. However, this spatial dissociation requires cognitive rules for eye-hand coordination different from eye-hand movements performed in the same space, as is the case in most natural conditions. Here we present an innovative solution for the precise tracking of eye and hand movements in a single reference frame. Importantly, our solution allows behavioral explorations under normal and perturbed conditions in both humans and monkeys. It is based on the integration of two noninvasive commercially available systems to achieve online control and synchronous recording of eye (EyeLink) and hand (KINARM) positions during interactive visuomotor tasks. We also present an eye calibration method compatible with different eye trackers that compensates for nonlinearities caused by the system's geometry. Our setup monitors the two effectors in real time with high spatial and temporal resolution and simultaneously outputs behavioral and neuronal data to an external data acquisition system using a common data format.

NEW & NOTEWORTHY We developed a new setup for studying eye-hand coordination in humans and monkeys that monitors the two effectors in real time in a common reference frame. Our eye calibration method allows us to track gaze positions relative to visual stimuli presented in the horizontal workspace of the hand movements. This method compensates for nonlinearities caused by the system’s geometry and transforms kinematics signals from the eye tracker into the same coordinate system as hand and targets.

Processing of Egomotion-Consistent Optic Flow in the Rhesus Macaque Cortex

The cortical network that processes visual cues to self-motion was characterized with functional magnetic resonance imaging in 3 awake behaving macaques. The experimental protocol was similar to previous human studies in which the responses to a single large optic flow patch were contrasted with responses to an array of 9 similar flow patches. This distinguishes cortical regions where neurons respond to flow in their receptive fields regardless of surrounding motion from those that are sensitive to whether the overall image arises from self-motion. In all 3 animals, significant selectivity for egomotion-consistent flow was found in several areas previously associated with optic flow processing, and notably dorsal middle superior temporal area, ventral intra-parietal area, and VPS. It was also seen in areas 7a (Opt), STPm, FEFsem, FEFsac and in a region of the cingulate sulcus that may be homologous with human area CSv. Selectivity for egomotion-compatible flow was never total but was particularly strong in VPS and putative macaque CSv. Direct comparison of results with the equivalent human studies reveals several commonalities but also some differences.

Cortical responses to shape-from-motion stimuli in the infant

Our ability to extract three-dimensional (3-D) object structure from motion-carried information is a basic visual capacity that is fundamental to object perception. Despite a rich body of behavioral work demonstrating that infants are sensitive to motion-carried information from the early months of life, little is known about the cortical networks that support infants' use of motion-carried information to extract 3-D object structure. This study assessed patterns of cortical activation in infants aged 4 to 6 months as they viewed two types of visual stimuli: (a) shape-from-motion (SFM) displays, where coherent motion of randomly distributed dots gave rise to the percept of 3-D shape and (b) random motion (RM) displays, where dots' motions lacked a coherent structure and gave rise to the percept of randomly moving dots. Functional near-infrared spectroscopy was used to assess activation in occipital, inferior parietal, and posterior temporal cortex. The optical imaging data revealed differential responding to SFM and RM in lower level object processing areas than typically observed in the adult. Possible explanations for this pattern of results are considered.

A neuroanatomical predictor of mirror self-recognition in chimpanzees

The ability to recognize one's own reflection is shared by humans and only a few other species, including chimpanzees. However, this ability is highly variable across individual chimpanzees. In humans, self-recognition involves a distributed, right-lateralized network including frontal and parietal regions involved in the production and perception of action. The superior longitudinal fasciculus (SLF) is a system of white matter tracts linking these frontal and parietal regions. The current study measured mirror self-recognition (MSR) and SLF anatomy in 60 chimpanzees using diffusion tensor imaging. Successful self-recognition was associated with greater rightward asymmetry in the white matter of SLFII and SLFIII, and in SLFIII's gray matter terminations in Broca's area. We observed a visible progression of SLFIII's prefrontal extension in apes that show negative, ambiguous, and compelling evidence of MSR. Notably, SLFIII's terminations in Broca's area are not right-lateralized or particularly pronounced at the population level in chimpanzees, as they are in humans. Thus, chimpanzees with more human-like behavior show more human-like SLFIII connectivity. These results suggest that self-recognition may have co-emerged with adaptations to frontoparietal circuitry.

Attentive Motion Discrimination Recruits an Area in Inferotemporal Cortex

Attentional selection requires the interplay of multiple brain areas. Theoretical accounts of selective attention predict different areas with different functional properties to support endogenous covert attention. To test these predictions, we devised a demanding attention task requiring motion discrimination and spatial selection and performed whole-brain imaging in macaque monkeys. Attention modulated the early visual cortex, motion-selective dorsal stream areas, the lateral intraparietal area, and the frontal eye fields. This pattern of activation supports early selection, feature-based, and biased-competition attention accounts, as well as the frontoparietal theory of attentional control. While high-level motion-selective dorsal stream areas did not exhibit strong attentional modulation, ventral stream areas V4d and the dorsal posterior inferotemporal cortex (PITd) did. The PITd in fact was, consistently across task variations, the most significantly and most strongly attention-modulated area, even though it did not exhibit signs of motion selectivity. Thus the recruitment of the PITd in attention tasks involving different kinds of motion analysis is not predicted by any theoretical account of attention. These functional data, together with known anatomical connections, suggest a general and possibly critical role of the PITd in attentional selection.

SIGNIFICANCE STATEMENT

Attention is the key cognitive function that selects sensory information relevant to the current goals, relegating other information to the shadows of consciousness. To better understand the neural mechanisms of this interplay between sensory processing and internal cognitive state, we must learn more about the brain areas supporting attentional selection. Here, to test theoretical accounts of attentional selection, we used a novel task requiring sustained attention to motion. We found that, surprisingly, among the most strongly attention-modulated areas is one that is neither selective for the sensory feature relevant for current goals nor one hitherto thought to be involved in attentional control. This discovery suggests a need for an extension of current theoretical accounts of the brain circuits for attentional selection.

Neanderthal-Derived Genetic Variation Shapes Modern Human Cranium and Brain

Before their disappearance from the fossil record approximately 40,000 years ago, Neanderthals, the ancient hominin lineage most closely related to modern humans, interbred with ancestors of present-day humans. The legacy of this gene flow persists through Neanderthal-derived variants that survive in modern human DNA; however, the neural implications of this inheritance are uncertain. Here, using MRI in a large cohort of healthy individuals of European-descent, we show that the amount of Neanderthal-originating polymorphism carried in living humans is related to cranial and brain morphology. First, as a validation of our approach, we demonstrate that a greater load of Neanderthal-derived genetic variants (higher “NeanderScore”) is associated with skull shapes resembling those of known Neanderthal cranial remains, particularly in occipital and parietal bones. Next, we demonstrate convergent NeanderScore-related findings in the brain (measured by gray- and white-matter volume, sulcal depth, and gyrification index) that localize to the visual cortex and intraparietal sulcus. This work provides insights into ancestral human neurobiology and suggests that Neanderthal-derived genetic variation is neurologically functional in the contemporary population.