Development of the macaque face-patch system

Face detection mechanisms: Nature vs. nurture

For many animals, faces are a vitally important visual stimulus. Hence, it is not surprising that face perception has become a very popular research topic in neuroscience, with ca. 2000 papers published every year. As a result, significant progress has been made in understanding the intricate mechanisms underlying this phenomenon. However, the ontogeny of face perception, in particular the role of innate predispositions, remains largely unexplored at the neural level. Several influential studies in monkeys have suggested that seeing faces is necessary for the development of the face-selective brain domains. At the same time, behavioural experiments with newborn human babies and newly-hatched domestic chicks demonstrate that a spontaneous preference towards faces emerges early in life without pre-existing experience. Moreover, we were recently able to record face-selective neural responses in the brain of young, face-naïve chicks, thus demonstrating the existence of an innate face detection mechanism. In this review, we discuss these seemingly contradictory results and propose potential experimental approaches to resolve some of the open questions.

Developmentally stable representations of naturalistic image structure in macaque visual cortex

We studied visual development in macaque monkeys using texture stimuli, matched in local spectral content but varying in "naturalistic" structure. In adult monkeys, naturalistic textures preferentially drive neurons in areas V2 and V4, but not V1. We paired behavioral measurements of naturalness sensitivity with separately-obtained neuronal population recordings from neurons in areas V1, V2, V4, and inferotemporal cortex (IT). We made behavioral measurements from 16 weeks of age and physiological measurements as early as 20 weeks, and continued through 56 weeks. Behavioral sensitivity reached half of maximum at roughly 25 weeks of age. Neural sensitivities remained stable from the earliest ages tested. As in adults, neural sensitivity to naturalistic structure increased from V1 to V2 to V4. While sensitivities in V2 and IT were similar, the dimensionality of the IT representation was more similar to V4's than to V2's.

Toddlers' sensitivity to dominance traits from faces

In adults, seeing individual faces is sufficient to trigger dominance evaluations, even when conflict is absent. From early on, infants represent dyadic dominance relations and they can infer conflict outcomes based on a variety of cues. To date, it is unclear if toddlers also make automatic dominance trait evaluations of individual faces. Here we asked if toddlers are sensitive to dominance traits from faces, and whether their sensitivity depends on their face experience. We employed a visual preference paradigm to study 18- and 24-month-old toddlers' sensitivity to dominance traits from three types of faces: artificial, male, female. When presented with artificial faces (Experiment 1), 18- and 24-month-olds attended longer to the non-dominant faces, but only when they were in upright orientation. For real male faces (Experiment 2), toddlers showed equivalent looking durations to the dominant and non-dominant upright faces. However, when looking at female faces (Experiment 3), toddlers displayed a visual preference for the upright non-dominant faces at 24 months. To our knowledge, this is the first study to show that toddlers already display sensitivity to facial cues of dominance from 18 months of age, at least for artificial face stimuli.

The Wire Is Not the Territory: Understanding Representational Drift in Olfaction With Dynamical Systems Theory

Representational drift is a phenomenon of increasing interest in the cognitive and neural sciences. While investigations are ongoing for other sensory cortices, recent research has demonstrated the pervasiveness in which it occurs in the piriform cortex for olfaction. This gradual weakening and shifting of stimulus-responsive cells has critical implications for sensory stimulus-response models and perceptual decision-making. While representational drift may complicate traditional sensory processing models, it could be seen as an advantage in olfaction, as animals live in environments with constantly changing and unpredictable chemical information. Non-topographical encoding in the olfactory system may aid in contextualizing reactions to promiscuous odor stimuli, facilitating adaptive animal behavior and survival. This article suggests that traditional models of stimulus-(neural) response mapping in olfaction may need to be reevaluated and instead motivates the use of dynamical systems theory as a methodology and conceptual framework.

Short-latency preference for faces in the primate superior colliculus

Face processing is fundamental to primates and has been extensively studied in higher-order visual cortex. Here we report that visual neurons in the midbrain superior colliculus (SC) display a preference for faces, that the preference emerges within 50ms of stimulus onset - well before "face patches" in visual cortex - and that this activity can distinguish faces from other visual objects with accuracies of ~80%. This short-latency preference in SC depends on signals routed through early visual cortex, because inactivating the lateral geniculate nucleus, the key relay from retina to cortex, virtually eliminates visual responses in SC, including face-related activity. These results reveal an unexpected circuit in the primate visual system for rapidly detecting faces in the periphery, complementing the higher-order areas needed for recognizing individual faces.

Spikiness and animacy as potential organizing principles of human ventral visual cortex

Considerable research has been devoted to understanding the fundamental organizing principles of the ventral visual pathway. A recent study revealed a series of 3-4 topographical maps arranged along the macaque inferotemporal (IT) cortex. The maps articulated a two-dimensional space based on the spikiness and animacy of visual objects, with "inanimate-spiky" and "inanimate-stubby" regions of the maps constituting two previously unidentified cortical networks. The goal of our study was to determine whether a similar functional organization might exist in human IT. To address this question, we presented the same object stimuli and images from "classic" object categories (bodies, faces, houses) to humans while recording fMRI activity at 7 Tesla. Contrasts designed to reveal the spikiness-animacy object space evoked extensive significant activation across human IT. However, unlike the macaque, we did not observe a clear sequence of complete maps, and selectivity for the spikiness-animacy space was deeply and mutually entangled with category-selectivity. Instead, we observed multiple new stimulus preferences in category-selective regions, including functional sub-structure related to object spikiness in scene-selective cortex. Taken together, these findings highlight spikiness as a promising organizing principle of human IT and provide new insights into the role of category-selective regions in visual object processing.

Towards an optimization of functional localizers in non-human primate neuroimaging with (fMRI) frequency-tagging

Non-human primate (NHP) neuroimaging can provide essential insights into the neural basis of human cognitive functions. While functional magnetic resonance imaging (fMRI) localizers can play an essential role in reaching this objective (Russ et al., 2021), they often differ substantially across species in terms of paradigms, measured signals, and data analysis, biasing the comparisons. Here we introduce a functional frequency-tagging face localizer for NHP imaging, successfully developed in humans and outperforming standard face localizers (Gao et al., 2018). FMRI recordings were performed in two awake macaques. Within a rapid 6 Hz stream of natural non-face objects images, human or monkey face stimuli were presented in bursts every 9 s. We also included control conditions with phase-scrambled versions of all images. As in humans, face-selective activity was objectively identified and quantified at the peak of the face-stimulation frequency (0.111 Hz) and its second harmonic (0.222 Hz) in the Fourier domain. Focal activations with a high signal-to-noise ratio were observed in regions previously described as face-selective, mainly in the STS (clusters PL, ML, MF; also, AL, AF), both for human and monkey faces. Robust face-selective activations were also found in the prefrontal cortex of one monkey (PVL and PO clusters). Face-selective neural activity was highly reliable and excluded all contributions from low-level visual cues contained in the amplitude spectrum of the stimuli. These observations indicate that fMRI frequency-tagging provides a highly valuable approach to objectively compare human and monkey visual recognition systems within the same framework.

Functional maturation in visual pathways predicts attention to the eyes in infant rhesus macaques: Effects of social status

Differences in looking at the eyes of others are one of the earliest behavioral markers for social difficulties in neurodevelopmental disabilities, including autism. However, it is unknown how early visuo-social experiences relate to the maturation of infant brain networks that process visual social stimuli. We investigated functional connectivity (FC) within the ventral visual object pathway as a contributing neural system. Densely sampled, longitudinal eye-tracking and resting state fMRI (rs-fMRI) data were collected from infant rhesus macaques, an important model of human social development, from birth through 6 months of age. Mean trajectories were fit for both datasets and individual trajectories from subjects with both eye-tracking and rs-fMRI data were used to test for brain-behavior relationships. Exploratory findings showed infants with greater increases in FC between left V1 to V3 visual areas have an earlier increase in eye-looking before 2 months. This relationship was moderated by social status such that infants with low social status had a stronger association between left V1 to V3 connectivity and eye-looking than high status infants. Results indicated that maturation of the visual object pathway may provide an important neural substrate supporting adaptive transitions in social visual attention during infancy.

Progressive neuronal plasticity in primate visual cortex during stimulus familiarization

The primate brain is equipped to learn and remember newly encountered visual stimuli such as faces and objects. In the macaque inferior temporal (IT) cortex, neurons mark the familiarity of a visual stimulus through response modification, often involving a decrease in spiking rate. Here, we investigate the emergence of this neural plasticity by longitudinally tracking IT neurons during several weeks of familiarization with face images. We found that most neurons in the anterior medial (AM) face patch exhibited a gradual decline in their late-phase visual responses to multiple stimuli. Individual neurons varied from days to weeks in their rates of plasticity, with time constants determined by the number of days of exposure rather than the cumulative number of presentations. We postulate that the sequential recruitment of neurons with experience-modified responses may provide an internal and graded measure of familiarity strength, which is a key mnemonic component of visual recognition.

Exploring pattern recognition: what is the relationship between the recognition of words, faces and other objects?

Debate surrounds processes of visual recognition, with no consensus as to whether recognition of distinct object categories (faces, bodies, cars, and words) is domain specific or subserved by domain-general visual recognition mechanisms. Here, we investigated correlations between the performance of 74 participants on recognition tasks for words, faces and other object categories. Participants completed a counter-balanced test battery of the Cambridge Face, Car and Body Parts Memory tests, as well as a standard four category lexical decision task, with response time and recognition accuracy as dependent variables. Results revealed significant correlations across domains for both recognition accuracy and response time, providing some support for domain-general pattern recognition. Further exploration of the data using principal component analysis (PCA) revealed a two-component model for both the response time and accuracy data. However, how the various word and object recognition tasks fitted these components varied considerably but did hint at familiarity/expertise as a common factor. In sum, we argue a complex relationship exists between domain-specific processing and domain-general processing, but that this is shaped by expertise. To further our understanding of pattern recognition, research investigating the recognition of words, faces and other objects in dyslexic individuals is recommended, as is research exploiting neuroimaging methodologies, with excellent temporal resolution, to chart the temporal specifics of different forms of visual pattern recognition.

Visual category representations in the infant brain

Visual categorization is a human core cognitive capacity^1,2 that depends on the development of visual category representations in the infant brain.^3,4,5,6,7 However, the exact nature of infant visual category representations and their relationship to the corresponding adult form remains unknown.⁸ Our results clarify the nature of visual category representations from electroencephalography (EEG) data in 6- to 8-month-old infants and their developmental trajectory toward adult maturity in the key characteristics of temporal dynamics,^2,9 representational format,^10,11,12 and spectral properties.^13,14 Temporal dynamics change from slowly emerging, developing representations in infants to quickly emerging, complex representations in adults. Despite those differences, infants and adults already partly share visual category representations. The format of infants' representations is visual features of low to intermediate complexity, whereas adults' representations also encode high-complexity features. Theta band activity contributes to visual category representations in infants, and these representations are shifted to the alpha/beta band in adults. Together, we reveal the developmental neural basis of visual categorization in humans, show how information transmission channels change in development, and demonstrate the power of advanced multivariate analysis techniques in infant EEG research for theory building in developmental cognitive science.

The retrocalcarine sulcus maps different retinotopic representations in macaques and humans

Primate cerebral cortex is highly convoluted with much of the cortical surface buried in sulcal folds. The origins of cortical folding and its functional relevance have been a major focus of systems and cognitive neuroscience, especially when considering stereotyped patterns of cortical folding that are shared across individuals within a primate species and across multiple species. However, foundational questions regarding organizing principles shared across species remain unanswered. Taking a cross-species comparative approach with a careful consideration of historical observations, we investigate cortical folding relative to primary visual cortex (area V1). We identify two macroanatomical structures-the retrocalcarine and external calcarine sulci-in 24 humans and 6 macaque monkeys. We show that within species, these sulci are identifiable in all individuals, fall on a similar part of the V1 retinotopic map, and thus, serve as anatomical landmarks predictive of functional organization. Yet, across species, the underlying eccentricity representations corresponding to these macroanatomical structures differ strikingly across humans and macaques. Thus, the correspondence between retinotopic representation and cortical folding for an evolutionarily old structure like V1 is species-specific and suggests potential differences in developmental and experiential constraints across primates.

Representation of expression and identity by ventral prefrontal neurons

Evidence has suggested that the ventrolateral prefrontal cortex (VLPFC) processes social stimuli, including faces and vocalizations, which are essential for communication. Features embedded within audiovisual stimuli, including emotional expression and caller identity, provide abundant information about an individual's intention, emotional state, motivation, and social status, which are important to encode in a social exchange. However, it is unknown to what extent the VLPFC encodes such features. To investigate the role of VLPFC during social communication, we recorded single-unit activity while rhesus macaques (Macaca mulatta) performed a nonmatch-to-sample task using species-specific face-vocalization stimuli that differed in emotional expression or caller identity. 75% of recorded cells were task-related and of these >70% were responsive during the nonmatch period. A larger proportion of nonmatch cells encoded the stimulus rather than the context of the trial type. A subset of responsive neurons were most commonly modulated by the identity of the nonmatch stimulus and less by the emotional expression, or both features within the face-vocalization stimuli presented during the nonmatch period. Neurons encoding identity were found in VLPFC across a broader region than expression related cells which were confined to only the anterolateral portion of the recording chamber in VLPFC. These findings suggest that, within a working memory paradigm, VLPFC processes features of face and vocal stimuli, such as emotional expression and identity, in addition to task and contextual information. Thus, stimulus and contextual information may be integrated by VLPFC during social communication.

The cortical and subcortical correlates of face pareidolia in the macaque brain

Face detection is a foundational social skill for primates. This vital function is thought to be supported by specialized neural mechanisms; however, although several face-selective regions have been identified in both humans and nonhuman primates, there is no consensus about which region(s) are involved in face detection. Here, we used naturally occurring errors of face detection (i.e. objects with illusory facial features referred to as examples of 'face pareidolia') to identify regions of the macaque brain implicated in face detection. Using whole-brain functional magnetic resonance imaging to test awake rhesus macaques, we discovered that a subset of face-selective patches in the inferior temporal cortex, on the lower lateral edge of the superior temporal sulcus, and the amygdala respond more to objects with illusory facial features than matched non-face objects. Multivariate analyses of the data revealed differences in the representation of illusory faces across the functionally defined regions of interest. These differences suggest that the cortical and subcortical face-selective regions contribute uniquely to the detection of facial features. We conclude that face detection is supported by a multiplexed system in the primate brain.

Social connections predict brain structure in a multidimensional free-ranging primate society

Reproduction and survival in most primate species reflects management of both competitive and cooperative relationships. Here, we investigated the links between neuroanatomy and sociality in free-ranging rhesus macaques. In adults, the number of social partners predicted the volume of the mid-superior temporal sulcus and ventral-dysgranular insula, implicated in social decision-making and empathy, respectively. We found no link between brain structure and other key social variables such as social status or indirect connectedness in adults, nor between maternal social networks or status and dependent infant brain structure. Our findings demonstrate that the size of specific brain structures varies with the number of direct affiliative social connections and suggest that this relationship may arise during development. These results reinforce proposed links between social network size, biological success, and the expansion of specific brain circuits.

Emerged human-like facial expression representation in a deep convolutional neural network

Recent studies found that the deep convolutional neural networks (DCNNs) trained to recognize facial identities spontaneously learned features that support facial expression recognition, and vice versa. Here, we showed that the self-emerged expression-selective units in a VGG-Face trained for facial identification were tuned to distinct basic expressions and, importantly, exhibited hallmarks of human expression recognition (i.e., facial expression confusion and categorical perception). We then investigated whether the emergence of expression-selective units is attributed to either face-specific experience or domain-general processing by conducting the same analysis on a VGG-16 trained for object classification and an untrained VGG-Face without any visual experience, both having the identical architecture with the pretrained VGG-Face. Although similar expression-selective units were found in both DCNNs, they did not exhibit reliable human-like characteristics of facial expression perception. Together, these findings revealed the necessity of domain-specific visual experience of face identity for the development of facial expression perception, highlighting the contribution of nurture to form human-like facial expression perception.

Lateral Habenula Responses During Eye Contact in a Reward Conditioning Task

For many animals, social interaction may have intrinsic reward value over and above its utility as a means to the desired end. Eye contact is the starting point of interactions in many social animals, including primates, and abnormal patterns of eye contact are present in many mental disorders. Whereas abundant previous studies have shown that negative emotions such as fear strongly affect eye contact behavior, modulation of eye contact by reward has received scant attention. Here we recorded eye movement patterns and neural activity in lateral habenula while monkeys viewed faces in the context of Pavlovian and instrumental conditioning tasks. Faces associated with larger rewards spontaneously elicited longer periods of eye contact from the monkeys, even though this behavior was not required or advantaged in the task. Concurrently, lateral habenula neurons were suppressed by faces signaling high value and excited by faces signaling low value. These results suggest that the reward signaling of lateral habenula may contribute to social behavior and disorders, presumably through its connections with the basal ganglia.

Self-tuition as an essential design feature of the brain

We are curious by nature, particularly when young. Evolution has endowed our brain with an inbuilt obligation to educate itself. In this perspectives article, we posit that self-tuition is an evolved principle of vertebrate brain design that is reflected in its basic architecture and critical for its normal development. Self-tuition involves coordination between functionally distinct components of the brain, with one set of areas motivating exploration that leads to the experiences that train another set. We review key hypothalamic and telencephalic structures involved in this interplay, including their anatomical connections and placement within the segmental architecture of conserved forebrain circuits. We discuss the nature of educative behaviours motivated by the hypothalamus, innate stimulus biases, the relationship to survival in early life, and mechanisms by which telencephalic areas gradually accumulate knowledge. We argue that this aspect of brain function is of paramount importance for systems neuroscience, as it confers neural specialization and allows animals to attain far more sophisticated behaviours than would be possible through genetic mechanisms alone. Self-tuition is of particular importance in humans and other primates, whose large brains and complex social cognition rely critically on experience-based learning during a protracted childhood period.

This article is part of the theme issue ‘Systems neuroscience through the lens of evolutionary theory’.

Selective responses to faces, scenes, and bodies in the ventral visual pathway of infants

Three of the most robust functional landmarks in the human brain are the selective responses to faces in the fusiform face area (FFA), scenes in the parahippocampal place area (PPA), and bodies in the extrastriate body area (EBA). Are the selective responses of these regions present early in development or do they require many years to develop? Prior evidence leaves this question unresolved. We designed a new 32-channel infant magnetic resonance imaging (MRI) coil and collected high-quality functional MRI (fMRI) data from infants (2-9 months of age) while they viewed stimuli from four conditions-faces, bodies, objects, and scenes. We find that infants have face-, scene-, and body-selective responses in the location of the adult FFA, PPA, and EBA, respectively, powerfully constraining accounts of cortical development.

Face detection in untrained deep neural networks

Face-selective neurons are observed in the primate visual pathway and are considered as the basis of face detection in the brain. However, it has been debated as to whether this neuronal selectivity can arise innately or whether it requires training from visual experience. Here, using a hierarchical deep neural network model of the ventral visual stream, we suggest a mechanism in which face-selectivity arises in the complete absence of training. We found that units selective to faces emerge robustly in randomly initialized networks and that these units reproduce many characteristics observed in monkeys. This innate selectivity also enables the untrained network to perform face-detection tasks. Intriguingly, we observed that units selective to various non-face objects can also arise innately in untrained networks. Our results imply that the random feedforward connections in early, untrained deep neural networks may be sufficient for initializing primitive visual selectivity.

Cortical recycling in high-level visual cortex during childhood development

Human ventral temporal cortex contains category-selective regions that respond preferentially to ecologically relevant categories such as faces, bodies, places and words and that are causally involved in the perception of these categories. How do these regions develop during childhood? We used functional magnetic resonance imaging to measure longitudinal development of category selectivity in school-age children over 1 to 5 years. We discovered that, from young childhood to the teens, face- and word-selective regions in ventral temporal cortex expand and become more category selective, but limb-selective regions shrink and lose their preference for limbs. Critically, as a child develops, increases in face and word selectivity are directly linked to decreases in limb selectivity, revealing that during childhood, limb selectivity in ventral temporal cortex is repurposed into word and face selectivity. These data provide evidence for cortical recycling during childhood development. This has important implications for understanding typical as well as atypical brain development and necessitates a rethinking of how cortical function develops during childhood.

One object, two networks? Assessing the relationship between the face and body-selective regions in the primate visual system

Faces and bodies are often treated as distinct categories that are processed separately by face- and body-selective brain regions in the primate visual system. These regions occupy distinct regions of visual cortex and are often thought to constitute independent functional networks. Yet faces and bodies are part of the same object and their presence inevitably covary in naturalistic settings. Here, we re-evaluate both the evidence supporting the independent processing of faces and bodies and the organizational principles that have been invoked to explain this distinction. We outline four hypotheses ranging from completely separate networks to a single network supporting the perception of whole people or animals. The current evidence, especially in humans, is compatible with all of these hypotheses, making it presently unclear how the representation of faces and bodies is organized in the cortex.

Naïve and Experienced Honeybee Foragers Learn Normally Configured Flowers More Easily Than Non-configured or Highly Contrasted Flowers

Angiosperms have evolved to attract and/or deter specific pollinators. Flowers provide signals and cues such as scent, colour, size, pattern, and shape, which allow certain pollinators to more easily find and visit the same type of flower. Over evolutionary time, bees and angiosperms have co-evolved resulting in flowers being more attractive to bee vision and preferences, and allowing bees to recognise specific flower traits to make decisions on where to forage. Here we tested whether bees are instinctively tuned to process flower shape by training both flower-experienced and flower-naïve honeybee foragers to discriminate between pictures of two different flower species when images were either normally configured flowers or flowers which were scrambled in terms of spatial configuration. We also tested whether increasing picture contrast, to make flower features more salient, would improve or impair performance. We used four flower conditions: (i) normally configured greyscale flower pictures, (ii) scrambled flower configurations, (iii) high contrast normally configured flowers, and (iv) asymmetrically scrambled flowers. While all flower pictures contained very similar spatial information, both experienced and naïve bees were better able to learn to discriminate between normally configured flowers than between any of the modified versions. Our results suggest that a specialisation in flower recognition in bees is due to a combination of hard-wired neural circuitry and experience-dependent factors.

On the relationship between maps and domains in inferotemporal cortex

How does the brain encode information about the environment? Decades of research have led to the pervasive notion that the object-processing pathway in primate cortex consists of multiple areas that are each specialized to process different object categories (such as faces, bodies, hands, non-face objects and scenes). The anatomical consistency and modularity of these regions have been interpreted as evidence that these regions are innately specialized. Here, we propose that ventral-stream modules do not represent clusters of circuits that each evolved to process some specific object category particularly important for survival, but instead reflect the effects of experience on a domain-general architecture that evolved to be able to adapt, within a lifetime, to its particular environment. Furthermore, we propose that the mechanisms underlying the development of domains are both evolutionarily old and universal across cortex. Topographic maps are fundamental, governing the development of specializations across systems, providing a framework for brain organization.

Reading: The Confluence of Vision and Language

The scientific study of reading has a rich history that spans disciplines from vision science to linguistics, psychology, cognitive neuroscience, neurology, and education. The study of reading can elucidate important general mechanisms in spatial vision, attentional control, object recognition, and perceptual learning, as well as the principles of plasticity and cortical topography. However, literacy also prompts the development of specific neural circuits to process a unique and artificial stimulus. In this review, we describe the sequence of operations that transforms visual features into language, how the key neural circuits are sculpted by experience during development, and what goes awry in children for whom learning to read is a struggle. Expected final online publication date for the Annual Review of Vision Science, Volume 7 is September 2021. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

Curvilinear features are important for animate/inanimate categorization in macaques

The current experiment investigated the extent to which perceptual categorization of animacy (i.e., the ability to discriminate animate and inanimate objects) is facilitated by image-based features that distinguish the two object categories. We show that, with nominal training, naïve macaques could classify a trial-unique set of 1000 novel images with high accuracy. To test whether image-based features that naturally differ between animate and inanimate objects, such as curvilinear and rectilinear information, contribute to the monkeys’ accuracy, we created synthetic images using an algorithm that distorted the global shape of the original animate/inanimate images while maintaining their intermediate features (Portilla & Simoncelli, 2000). Performance on the synthesized images was significantly above chance and was predicted by the amount of curvilinear information in the images. Our results demonstrate that, without training, macaques can use an intermediate image feature, curvilinearity, to facilitate their categorization of animate and inanimate objects.

Dynamic Suppression of Average Facial Structure Shapes Neural Tuning in Three Macaque Face Patches

The visual perception of identity in humans and other primates is thought to draw upon cortical areas specialized for the analysis of facial structure. A prominent theory of face recognition holds that the brain computes and stores average facial structure, which it then uses to efficiently determine individual identity, though the neural mechanisms underlying this process are controversial. Here, we demonstrate that the dynamic suppression of average facial structure plays a prominent role in the responses of neurons in three fMRI-defined face patches of the macaque. Using photorealistic face stimuli that systematically varied in identity level according to a psychophysically based face space, we found that single units in the AF, AM, and ML face patches exhibited robust tuning around average facial structure. This tuning emerged after the initial excitatory response to the face and was expressed as the selective suppression of sustained responses to low-identity faces. The coincidence of this suppression with increased spike timing synchrony across the population suggests a mechanism of active inhibition underlying this effect. Control experiments confirmed that the diminished responses to low-identity faces were not due to short-term adaptation processes. We propose that the brain's neural suppression of average facial structure facilitates recognition by promoting the extraction of distinctive facial characteristics and suppressing redundant or irrelevant responses across the population.

Anatomical correlates of face patches in macaque inferotemporal cortex

Primate brains typically have regions within the ventral visual stream that are selectively responsive to faces. In macaques, these face patches are located in similar parts of inferotemporal cortex across individuals although correspondence with particular anatomical features has not been reported previously. Here, using high-resolution functional and anatomical imaging, we show that small "bumps," or buried gyri, along the lower bank of the superior temporal sulcus are predictive of the location of face-selective regions. Recordings from implanted multielectrode arrays verified that these bumps contain face-selective neurons. These bumps were present in monkeys raised without seeing faces and that lack face patches, indicating that these anatomical landmarks are predictive of, but not sufficient for, the presence of face selectivity. These bumps are found across primate species that span taxonomy lines, indicating common evolutionary developmental mechanisms. The bumps emerge during fetal development in macaques, indicating that they arise from general developmental mechanisms that result in the regularity of cortical folding of the entire brain.

Visual experience is not necessary for the development of face-selectivity in the lateral fusiform gyrus

The fusiform face area responds selectively to faces and is causally involved in face perception. How does face-selectivity in the fusiform arise in development, and why does it develop so systematically in the same location across individuals? Preferential cortical responses to faces develop early in infancy, yet evidence is conflicting on the central question of whether visual experience with faces is necessary. Here, we revisit this question by scanning congenitally blind individuals with fMRI while they haptically explored 3D-printed faces and other stimuli. We found robust face-selective responses in the lateral fusiform gyrus of individual blind participants during haptic exploration of stimuli, indicating that neither visual experience with faces nor fovea-biased inputs is necessary for face-selectivity to arise in the lateral fusiform gyrus. Our results instead suggest a role for long-range connectivity in specifying the location of face-selectivity in the human brain.

Human and monkey infant attention to dynamic social and nonsocial stimuli

The present study explored behavioral norms for infant social attention in typically developing human and nonhuman primate infants. We examined the normative development of attention to dynamic social and nonsocial stimuli longitudinally in macaques (Macaca mulatta) at 1, 3, and 5 months of age (N = 75) and humans at 2, 4, 6, 8, and 13 months of age (N = 69) using eye tracking. All infants viewed concurrently played silent videos-one social video and one nonsocial video. Both macaque and human infants were faster to look to the social than the nonsocial stimulus, and both species grew faster to orient to the social stimulus with age. Further, macaque infants' social attention increased linearly from 1 to 5 months. In contrast, human infants displayed a nonlinear pattern of social interest, with initially greater attention to the social stimulus, followed by a period of greater interest in the nonsocial stimulus, and then a rise in social interest from 6 to 13 months. Overall, human infants looked longer than macaque infants, suggesting humans have more sustained attention in the first year of life. These findings highlight potential species similarities and differences, and reflect a first step in establishing baseline patterns of early social attention development.

Curvature processing in human visual cortical areas

Curvature is one of many visual features shown to be important for visual perception. We recently showed that curvilinear features provide sufficient information for categorizing animate vs. inanimate objects, while rectilinear features do not (Zachariou et al., 2018). Results from our fMRI study in rhesus monkeys (Yue et al., 2014) have shed light on some of the neural substrates underlying curvature processing by revealing a network of visual cortical patches with a curvature response preference. However, it is unknown whether a similar network exists in human visual cortex. Thus, the current study was designed to investigate cortical areas with a preference for curvature in the human brain using fMRI at 7T. Consistent with our monkey fMRI results, we found a network of curvature preferring cortical patches-some of which overlapped well-known face-selective areas. Moreover, principal component analysis (PCA) using all visually-responsive voxels indicated that curvilinear features of visual stimuli were associated with specific retinotopic regions in visual cortex. Regions associated with positive curvilinear PC values encompassed the central visual field representation of early visual areas and the lateral surface of temporal cortex, while those associated with negative curvilinear PC values encompassed the peripheral visual field representation of early visual areas and the medial surface of temporal cortex. Thus, we found that broad areas of curvature preference, which encompassed face-selective areas, were bound by central visual field representations. Our results support the hypothesis that curvilinearity preference interacts with central-peripheral processing biases as primary features underlying the organization of temporal cortex topography in the adult human brain.

A Naturalistic Dynamic Monkey Head Avatar Elicits Species-Typical Reactions and Overcomes the Uncanny Valley

Research on social perception in monkeys may benefit from standardized, controllable, and ethologically valid renditions of conspecifics offered by monkey avatars. However, previous work has cautioned that monkeys, like humans, show an adverse reaction toward realistic synthetic stimuli, known as the "uncanny valley" effect. We developed an improved naturalistic rhesus monkey face avatar capable of producing facial expressions (fear grin, lip smack and threat), animated by motion capture data of real monkeys. For validation, we additionally created decreasingly naturalistic avatar variants. Eight rhesus macaques were tested on the various videos and avoided looking at less naturalistic avatar variants, but not at the most naturalistic or the most unnaturalistic avatar, indicating an uncanny valley effect for the less naturalistic avatar versions. The avoidance was deepened by motion and accompanied by physiological arousal. Only the most naturalistic avatar evoked facial expressions comparable to those toward the real monkey videos. Hence, our findings demonstrate that the uncanny valley reaction in monkeys can be overcome by a highly naturalistic avatar.

A Nexus Model of Restricted Interests in Autism Spectrum Disorder

Restricted interests (RIs) in autism spectrum disorder (ASD) are clinically impairing interests of unusual focus or intensity. They are a subtype of restricted and repetitive behaviors which are one of two diagnostic criteria for the disorder. Despite the near ubiquity of RIs in ASD, the neural basis for their development is not well understood. However, recent cognitive neuroscience findings from nonclinical samples and from individuals with ASD shed light on neural mechanisms that may explain the emergence of RIs. We propose the nexus model of RIs in ASD, a novel conceptualization of this symptom domain that suggests that RIs may reflect a co-opting of brain systems that typically serve to integrate complex attention, memory, semantic, and social communication functions during development. The nexus model of RIs hypothesizes that when social communicative development is compromised, brain functions typically located within the lateral surface of cortex may expand into social processing brain systems and alter cortical representations of various cognitive functions during development. These changes, in turn, promote the development of RIs as an alternative process mediated by these brain networks. The nexus model of RIs makes testable predictions about reciprocal relations between the impaired development of social communication and the emergence of RIs in ASD and suggests novel avenues for treatment development.

Early developmental changes in visual social engagement in infant rhesus monkeys

Impairments in social interaction in Autism Spectrum Disorder (ASD) differ greatly across individuals and vary throughout an individual’s lifetime. Yet, an important marker of ASD in infancy is deviations in social-visual engagement, such as the reliably detectable early deviations in attention to the eyes or to biological movement (Klin et al., 2015). Given the critical nature of these early developmental periods, understanding its neurobehavioral underpinnings by means of a nonhuman primate model will be instrumental to understanding the pathophysiology of ASD. Like humans, rhesus macaques 1) develop in rich and complex social behaviors, 2) progressively develop social skills throughout infancy, and 3) have high similarities with humans in brain anatomy and cognitive functions (Machado and Bachevalier, 2003). In this study, male infant rhesus macaques living with their mothers in complex social groups were eye-tracked longitudinally from birth to 6 months while viewing full-faced videos of unfamiliar rhesus monkeys differing in age and sex. The results indicated a critical period for the refinement of social skills around 4–8 weeks of age in rhesus macaques. Specifically, infant monkeys’ fixation to the eyes shows an inflection in developmental trajectory, increasing from birth to 8 weeks, decreasing slowly to a trough between 14–18 weeks, before increasing again. These results parallel the developmental trajectory of social visual engagement published in human infants (Jones & Klin, 2013) and suggest the presence of a switch in the critical networks supporting these early developing social skills that is highly conserved between rhesus macaque and human infant development.

Connectivity at the origins of domain specificity in the cortical face and place networks

It is well established that the adult brain contains a mosaic of domain-specific networks. But how do these domain-specific networks develop? Here we tested the hypothesis that the brain comes prewired with connections that precede the development of domain-specific function. Using resting-state fMRI in the youngest sample of newborn humans tested to date, we indeed found that cortical networks that will later develop strong face selectivity (including the "proto" occipital face area and fusiform face area) and scene selectivity (including the "proto" parahippocampal place area and retrosplenial complex) by adulthood, already show domain-specific patterns of functional connectivity as early as 27 d of age (beginning as early as 6 d of age). Furthermore, we asked how these networks are functionally connected to early visual cortex and found that the proto face network shows biased functional connectivity with foveal V1, while the proto scene network shows biased functional connectivity with peripheral V1. Given that faces are almost always experienced at the fovea, while scenes always extend across the entire periphery, these differential inputs may serve to facilitate domain-specific processing in each network after that function develops, or even guide the development of domain-specific function in each network in the first place. Taken together, these findings reveal domain-specific and eccentricity-biased connectivity in the earliest days of life, placing new constraints on our understanding of the origins of domain-specific cortical networks.

Genetic influence is linked to cortical morphology in category-selective areas of visual cortex

Human visual cortex contains discrete areas that respond selectively to specific object categories such as faces, bodies, and places. A long-standing question is whether these areas are shaped by genetic or environmental factors. To address this question, here we analyzed functional MRI data from an unprecedented number (n = 424) of monozygotic (MZ) and dizygotic (DZ) twins. Category-selective maps were more identical in MZ than DZ twins. Within each category-selective area, distinct subregions showed significant genetic influence. Structural MRI analysis revealed that the ‘genetic voxels’ were predominantly located in regions with higher cortical curvature (gyral crowns in face areas and sulcal fundi in place areas). Moreover, we found that cortex was thicker and more myelinated in genetic voxels of face areas, while it was thinner and less myelinated in genetic voxels of place areas. This double dissociation suggests a differential development of face and place areas in cerebral cortex.

It remains unclear whether the functional organization of the visual cortex is shaped by genetic or environmental factors. Using fMRI in twins (n = 424), these authors show that activation patterns in category-selective areas are heritable, and that the genetic effects in these areas are linked to structural properties of cortical tissue.

Successful Reorganization of Category-Selective Visual Cortex following Occipito-temporal Lobectomy in Childhood

Investigations of functional (re)organization in children who have undergone large cortical resections offer a unique opportunity to elucidate the nature and extent of cortical plasticity. We report findings from a 3-year investigation of a child, U.D., who underwent surgical removal of the right occipital and posterior temporal lobes at age 6 years 9 months. Relative to controls, post-surgically, U.D. showed age-appropriate intellectual performance and visuoperceptual face and object recognition skills. Using fMRI at five different time points, we observed a persistent hemianopia and no visual field remapping. In category-selective visual cortices, however, object- and scene-selective regions in the intact left hemisphere were stable early on, but regions subserving face and word recognition emerged later and evinced competition for cortical representation. These findings reveal alterations in the selectivity and topography of category-selective regions when confined to a single hemisphere and provide insights into dynamic functional changes in extrastriate cortical architecture.

The Value of Failure in Science: The Story of Grandmother Cells in Neuroscience

The annals of science are filled with successes. Only in footnotes do we hear about the failures, the cul-de-sacs, and the forgotten ideas. Failure is how research advances. Yet it hardly features in theoretical perspectives on science. That is a mistake. Failures, whether clear-cut or ambiguous, are heuristically fruitful in their own right. Thinking about failure questions our measures of success, including the conceptual foundations of current practice, that can only be transient in an experimental context. This article advances the heuristics of failure analysis, meaning the explicit treatment of certain ideas or models as failures. The value of failures qua being a failure is illustrated with the example of grandmother cells; the contested idea of a hypothetical neuron that encodes a highly specific but complex stimulus, such as the image of one's grandmother. Repeatedly evoked in popular science and maintained in textbooks, there is sufficient reason to critically review the theoretical and empirical background of this idea.

How Areal Specification Shapes the Local and Interareal Circuits in a Macaque Model of Congenital Blindness

There is little understanding of the structural underpinnings of the functional reorganization of the cortex in the congenitally blind human. Taking advantage of the extensive characterization of the macaque visual system, we examine in macaque the influence of congenital blindness resulting from the removal of the retina during in utero development. This effectively removes the normal influence of the thalamus on cortical development leading to an induced hybrid cortex (HC) combining features of primary visual and extrastriate cortex. Retrograde tracers injected in HC reveal a local, intrinsic connectivity characteristic of higher order areas and show that the HC receives a uniquely strong, purely feedforward projection from striate cortex but no ectopic inputs, except from subiculum, and entorhinal cortex. Statistical modeling of quantitative connectivity data shows that HC is relatively high in the cortical hierarchy and receives a reinforced input from ventral stream areas while the overall organization of the functional streams are conserved. The directed and weighted anophthalmic cortical graph from the present study can be used to construct dynamic and structural models. These findings show how the sensory periphery governs cortical phenotype and reveal the importance of developmental arealization for understanding the functional reorganization in congenital blindness.

Universal Mechanisms and the Development of the Face Network: What You See Is What You Get

Our assignment was to review the development of the face-processing network, an assignment that carries the presupposition that a face-specific developmental program exists. We hope to cast some doubt on this assumption and instead argue that the development of face processing is guided by the same ubiquitous rules that guide the development of cortex in general.

Perceptual Function and Category-Selective Neural Organization in Children with Resections of Visual Cortex

The consequences of cortical resection, a treatment for humans with pharmaco-resistant epilepsy, provide a unique opportunity to advance our understanding of the nature and extent of cortical (re)organization. Despite the importance of visual processing in daily life, the neural and perceptual sequellae of occipitotemporal resections remain largely unexplored. Using psychophysical and fMRI investigations, we compared the neural and visuoperceptual profiles of 10 children or adolescents following unilateral cortical resections and their age- and gender-matched controls. Dramatically, with the exception of two individuals, both of whom had relatively greater cortical alterations, all patients showed normal perceptual performance on tasks of intermediate- and high-level vision, including face and object recognition. Consistently, again with the exception of the same two individuals, both univariate and multivariate fMRI analyses revealed normal selectivity and representational structure of category-selective regions. Furthermore, the spatial organization of category-selective regions obeyed the typical medial-to-lateral topographic organization albeit unilaterally in the structurally preserved hemisphere rather than bilaterally. These findings offer novel insights into the malleability of cortex in the pediatric population and suggest that, although experience may be necessary for the emergence of neural category-selectivity, this emergence is not necessarily contingent on the integrity of particular cortical structures.SIGNIFICANCE STATEMENT One approach to reduce seizure activity in patients with pharmaco-resistant epilepsy involves the resection of the epileptogenic focus. The impact of these resections on the perceptual behaviors and organization of visual cortex remain largely unexplored. Here, we characterized the visuoperceptual and neural profiles of ventral visual cortex in a relatively large sample of post-resection pediatric patients. Two major findings emerged. First, most patients exhibited preserved visuoperceptual performance across a wide-range of visual behaviors. Second, normal topography, magnitude, and representational structure of category-selective organization were uncovered in the spared hemisphere. These comprehensive imaging and behavioral investigations uncovered novel evidence concerning the neural representations and visual functions in children who have undergone cortical resection, and have implications for cortical plasticity more generally.

Representational similarity precedes category selectivity in the developing ventral visual pathway

Many studies have investigated the development of face-, scene-, and body-selective regions in the ventral visual pathway. This work has primarily focused on comparing the size and univariate selectivity of these neural regions in children versus adults. In contrast, very few studies have investigated the developmental trajectory of more distributed activation patterns within and across neural regions. Here, we scanned both children (ages 5-7) and adults to test the hypothesis that distributed representational patterns arise before category selectivity (for faces, bodies, or scenes) in the ventral pathway. Consistent with this hypothesis, we found mature representational patterns in several ventral pathway regions (e.g., FFA, PPA, etc.), even in children who showed no hint of univariate selectivity. These results suggest that representational patterns emerge first in each region, perhaps forming a scaffold upon which univariate category selectivity can subsequently develop. More generally, our findings demonstrate an important dissociation between category selectivity and distributed response patterns, and raise questions about the relative roles of each in development and adult cognition.

A behavioral face preference deficit in a monkey with an incomplete face patch system

Primates are experts in face perception and naturally show a preference for faces under free-viewing conditions. The primate ventral stream is characterized by a network of face patches that selectively responds to faces, but it remains uncertain how important such parcellation is for face perception. Here we investigated free-viewing behavior in a female monkey who naturally lacks fMRI-defined posterior and middle lateral face patches. We presented a series of content-rich images of scenes that included faces or other objects to that monkey during a free-viewing task and tested a group of 10 control monkeys on the same task for comparison. We found that, compared to controls, the monkey with missing face patches showed a marked reduction of face viewing preference that was most pronounced for the first few fixations. In addition, her gaze fixation patterns were substantially distinct from those of controls, especially for pictures with a face. These data demonstrate an association between the clustering of neurons in face selective patches and a behavioral bias for faces in natural images.

Cortical route for facelike pattern processing in human newborns

Humans are endowed with an exceptional ability for detecting faces, a competence that, in adults, is supported by a set of face-specific cortical patches. Human newborns, already shortly after birth, preferentially orient to faces, even when they are presented in the form of highly schematic geometrical patterns vs. perceptually equivalent nonfacelike stimuli. The neural substrates underlying this early preference are still largely unexplored. Is the adult face-specific cortical circuit already active at birth, or does its specialization develop slowly as a function of experience and/or maturation? We measured EEG responses in 1- to 4-day-old awake, attentive human newborns to schematic facelike patterns and nonfacelike control stimuli, visually presented with slow oscillatory "peekaboo" dynamics (0.8 Hz) in a frequency-tagging design. Despite the limited duration of newborns' attention, reliable frequency-tagged responses could be estimated for each stimulus from the peak of the EEG power spectrum at the stimulation frequency. Upright facelike stimuli elicited a significantly stronger frequency-tagged response than inverted facelike controls in a large set of electrodes. Source reconstruction of the underlying cortical activity revealed the recruitment of a partially right-lateralized network comprising lateral occipitotemporal and medial parietal areas overlapping with the adult face-processing circuit. This result suggests that the cortical route specialized in face processing is already functional at birth.

Idiosyncratic, Retinotopic Bias in Face Identification Modulated by Familiarity

The perception of gender and age of unfamiliar faces is reported to vary idiosyncratically across retinal locations such that, for example, the same androgynous face may appear to be male at one location but female at another. Here, we test spatial heterogeneity for the recognition of the identity of personally familiar faces in human participants. We found idiosyncratic biases that were stable within participants and that varied more across locations for low as compared to high familiar faces. These data suggest that like face gender and age, face identity is processed, in part, by independent populations of neurons monitoring restricted spatial regions and that the recognition responses vary for the same face across these different locations. Moreover, repeated and varied social interactions appear to lead to adjustments of these independent face recognition neurons so that the same familiar face is eventually more likely to elicit the same recognition response across widely separated visual field locations. We provide a mechanistic account of this reduced retinotopic bias based on computational simulations.

The effects of breastfeeding versus formula-feeding on cerebral cortex maturation in infant rhesus macaques

Breastfeeding is positively associated with several outcomes reflecting early brain development and cognitive functioning. Brain neuroimaging studies have shown that exclusively breastfed children have increased white matter and subcortical gray matter volume compared to formula-fed children. However, it is difficult to disentangle the effects of nutrition in breast milk from other confounding factors that affect brain development, particularly in studies of human subjects. Among the nutrients provided by human breast milk are the carotenoid lutein and the natural form of tocopherol, both of which are selectively deposited in brain. Lutein is the predominant carotenoid in breast milk but not in most infant formulas, whereas infant formulas are supplemented with the synthetic form of tocopherol. In this study, a non-human primate model was used to investigate the effects of breastfeeding versus formula-feeding, as well as lutein and natural RRR-α-tocopherol supplementation of infant formula, on brain maturation under controlled experimental conditions. Infant rhesus macaques (Macaca mulatta) were exclusively breastfed, or were fed infant formulas with different levels and sources of lutein and α-tocopherol. Of note, the breastfed group were mother-reared whereas the formula-fed infants were nursery-reared. Brain structural and diffusion MR images were collected, and brain T₂ was measured, at two, four and six months of age. The mother-reared breastfed group was observed to differ from the formula-fed groups by possessing higher diffusion fractional anisotropy (FA) in the corpus callosum, and lower FA in the cerebral cortex at four and six months of age. Cortical regions exhibiting the largest differences include primary motor, premotor, lateral prefrontal, and inferior temporal cortices. No differences were found between the formula groups. Although this study did not identify a nutritional component of breast milk that could be provided to infant formula to facilitate brain maturation consistent with that observed in breastfed animals, our findings indicate that breastfeeding promoted maturation of the corpus callosum and cerebral cortical gray matter in the absence of several confounding factors that affect studies in human infants. However, differences in rearing experience remain as a potential contributor to brain structural differences between breastfed and formula fed infants.

Social Origins of Cortical Face Areas

Recently acquired fMRI data from human and macaque infants provide novel insights into the origins of cortical networks specialized for perceiving faces. Data from both species converge: cortical regions responding preferentially to faces are present and spatially organized early in infancy, although fully selective face areas emerge much later. What explains the earliest cortical responses to faces? We review two proposed mechanisms: proto-organization for simple shapes in visual cortex, and an innate subcortical schematic face template. In addition, we propose a third mechanism: infants choose to look at faces to engage in positively valenced, contingent social interactions. Activity in medial prefrontal cortex during social interactions may, directly or indirectly, guide the organization of cortical face areas.

The functional neuroanatomy of face perception: from brain measurements to deep neural networks

A central goal in neuroscience is to understand how processing within the ventral visual stream enables rapid and robust perception and recognition. Recent neuroscientific discoveries have significantly advanced understanding of the function, structure and computations along the ventral visual stream that serve as the infrastructure supporting this behaviour. In parallel, significant advances in computational models, such as hierarchical deep neural networks (DNNs), have brought machine performance to a level that is commensurate with human performance. Here, we propose a new framework using the ventral face network as a model system to illustrate how increasing the neural accuracy of present DNNs may allow researchers to test the computational benefits of the functional architecture of the human brain. Thus, the review (i) considers specific neural implementational features of the ventral face network, (ii) describes similarities and differences between the functional architecture of the brain and DNNs, and (iii) provides a hypothesis for the computational value of implementational features within the brain that may improve DNN performance. Importantly, this new framework promotes the incorporation of neuroscientific findings into DNNs in order to test the computational benefits of fundamental organizational features of the visual system.