Parallel functional subnetworks embedded in the macaque face patch system

Brainwide mesoscale functional networks revealed by focal infrared neural stimulation of the amygdala

The primate amygdala serves to evaluate the emotional content of sensory inputs and modulate emotional and social behaviors; it modulates cognitive, multisensory and autonomic circuits predominantly via the basal, lateral and central nuclei, respectively. Recent evidence has suggested the mesoscale (millimeter-scale) nature of intra-amygdala functional organization. However, the connectivity patterns by which these mesoscale regions interact with brainwide networks remain unclear. Using infrared neural stimulation of single mesoscale sites coupled with mapping in ultrahigh field 7-T functional magnetic resonance imaging, we have discovered that these mesoscale sites exert influence over a surprisingly extensive scope of the brain. Our findings strongly indicate that mesoscale sites within the amygdala modulate brainwide networks through a 'one-to-many' (integral) way. Meanwhile, these connections exhibit a point-to-point (focal) topography. Our work provides new insights into the functional architecture underlying emotional and social behavioral networks, thereby opening up possibilities for individualized modulation of psychological disorders.

Face pareidolia minimally engages macaque face selective neurons

The macaque cerebral cortex contains concentrations of neurons that prefer faces over inanimate objects. Although these so-called face patches are thought to be specialized for the analysis of facial signals, their exact tuning properties remain unclear. For example, what happens when an object by chance resembles a face? Everyday objects can sometimes, through the accidental positioning of their internal components, appear as faces. This phenomenon is known as face pareidolia. Behavioral experiments have suggested that macaques, like humans, perceive illusory faces in such objects. However, it is an open question whether such stimuli would naturally stimulate neurons residing in cortical face patches. To address this question, we recorded single unit activity from four fMRI-defined face-selective regions: the anterior medial (AM), anterior fundus (AF), prefrontal orbital (PO), and perirhinal cortex (PRh) face patches. We compared neural responses elicited by images of real macaque faces, pareidolia-evoking objects, and matched control objects. Contrary to expectations, we found no evidence of a general preference for pareidolia-evoking objects over control objects. Although a subset of neurons exhibited stronger responses to pareidolia-evoking objects, the population responses to both categories of objects were similar, and collectively much less than to real macaque faces. These results suggest that neural responses in the four regions we tested are principally concerned with the analysis of realistic facial characteristics, whereas the special attention afforded to face-like pareidolia stimuli is supported by activity elsewhere in the brain.

The big mixup: Neural representation during natural modes of primate visual behavior

The primate brain has evolved specialized visual capacities to navigate complex physical and social environments. Researchers studying cortical circuits underlying these capacities have traditionally favored the use of simplified tasks and brief stimulus presentations in order to isolate cognitive variables with tight experimental control. As a result, operational theories about visual brain function have come to emphasize feature detection, hierarchical stimulus encoding, top-down task modulation, and functional segregation in distinct cortical areas. Recently, however, experimental paradigms combining natural behavior with electrophysiological recordings have begun to offer a distinctly different portrait of how the brain takes in and analyzes its visual surroundings. The present article reviews recent work in this area, highlighting some of the more surprising findings in domains of social vision and spatial navigation along with shifts in thinking that have begun to emanate from this approach.

Neuronal Mechanisms Underlying Face Recognition in Non-human Primates

Humans and primates rely on visual face recognition for social interactions. Damage to specific brain areas causes prosopagnosia, a condition characterized by the inability to recognize familiar faces, indicating the presence of specialized brain areas for face processing. A breakthrough finding came from a non-human primate (NHP) study conducted in the early 2000s; it was the first to identify multiple face processing areas in the temporal lobe, termed face patches. Subsequent studies have demonstrated the unique role of each face patch in the structural analysis of faces. More recent studies have expanded these findings by exploring the role of face patch networks in social and memory functions and the importance of early face exposure in the development of the system. In this review, we discuss the neuronal mechanisms responsible for analyzing facial features, categorizing faces, and associating faces with memory and social contexts within both the cerebral cortex and subcortical areas. Use of NHPs in neuropsychological and neurophysiological studies can highlight the mechanistic aspects of the neuronal circuit underlying face recognition at both the single-neuron and whole-brain network levels.

Closed-loop microstimulations of the orbitofrontal cortex during real-life gaze interaction enhance dynamic social attention

Neurons from multiple prefrontal areas encode several key variables of social gaze interaction. To explore the causal roles of the primate prefrontal cortex in real-life gaze interaction, we applied weak closed-loop microstimulations that were precisely triggered by specific social gaze events. Microstimulations of the orbitofrontal cortex, but not the dorsomedial prefrontal cortex or the anterior cingulate cortex, enhanced momentary dynamic social attention in the spatial dimension by decreasing the distance of fixations relative to a partner's eyes and in the temporal dimension by reducing the inter-looking interval and the latency to reciprocate the other's directed gaze. By contrast, on a longer timescale, microstimulations of the dorsomedial prefrontal cortex modulated inter-individual gaze dynamics relative to one's own gaze positions. These findings demonstrate that multiple regions in the primate prefrontal cortex may serve as functionally accessible nodes in controlling different aspects of dynamic social attention and suggest their potential for a therapeutic brain interface.

The neural basis of resting-state fMRI functional connectivity in fronto-limbic circuits revealed by chemogenetic manipulation

Measures of fMRI resting-state functional connectivity (rs-FC) are an essential tool for basic and clinical investigations of fronto-limbic circuits. Understanding the relationship between rs-FC and the underlying patterns of neural activity in these circuits is therefore vital. Here we introduced inhibitory designer receptors exclusively activated by designer drugs (DREADDs) into the amygdala of two male macaques. We evaluated the causal effect of activating the DREADD receptors on rs-FC and neural activity within circuits connecting amygdala and frontal cortex. Activating the inhibitory DREADD increased rs-FC between amygdala and ventrolateral prefrontal cortex. Neurophysiological recordings revealed that the DREADD-induced increase in fMRI rs-FC was associated with increased local field potential coherency in the alpha band (6.5-14.5 Hz) between amygdala and ventrolateral prefrontal cortex. Thus, our multi-modal approach reveals the specific signature of neuronal activity that underlies rs-FC in fronto-limbic circuits.

Closed-loop microstimulations of the orbitofrontal cortex during real-life gaze interaction enhance dynamic social attention

The prefrontal cortex is extensively involved in social exchange. During dyadic gaze interaction, multiple prefrontal areas exhibit neuronal encoding of social gaze events and context-specific mutual eye contact, supported by a widespread neural mechanism of social gaze monitoring. To explore causal manipulation of real-life gaze interaction, we applied weak closed-loop microstimulations that were precisely triggered by specific social gaze events to three prefrontal areas in monkeys. Microstimulations of orbitofrontal cortex (OFC), but not dorsomedial prefrontal or anterior cingulate cortex, enhanced momentary dynamic social attention in the spatial dimension by decreasing distance of one's gaze fixations relative to partner monkey's eyes. In the temporal dimension, microstimulations of OFC reduced the inter-looking interval for attending to another agent and the latency to reciprocate other's directed gaze. These findings demonstrate that primate OFC serves as a functionally accessible node in controlling dynamic social attention and suggest its potential for a therapeutic brain interface.

Modeling naturalistic face processing in humans with deep convolutional neural networks

Deep convolutional neural networks (DCNNs) trained for face identification can rival and even exceed human-level performance. The ways in which the internal face representations in DCNNs relate to human cognitive representations and brain activity are not well understood. Nearly all previous studies focused on static face image processing with rapid display times and ignored the processing of naturalistic, dynamic information. To address this gap, we developed the largest naturalistic dynamic face stimulus set in human neuroimaging research (700+ naturalistic video clips of unfamiliar faces). We used this naturalistic dataset to compare representational geometries estimated from DCNNs, behavioral responses, and brain responses. We found that DCNN representational geometries were consistent across architectures, cognitive representational geometries were consistent across raters in a behavioral arrangement task, and neural representational geometries in face areas were consistent across brains. Representational geometries in late, fully connected DCNN layers, which are optimized for individuation, were much more weakly correlated with cognitive and neural geometries than were geometries in late-intermediate layers. The late-intermediate face-DCNN layers successfully matched cognitive representational geometries, as measured with a behavioral arrangement task that primarily reflected categorical attributes, and correlated with neural representational geometries in known face-selective topographies. Our study suggests that current DCNNs successfully capture neural cognitive processes for categorical attributes of faces but less accurately capture individuation and dynamic features.

An open-access dataset of naturalistic viewing using simultaneous EEG-fMRI

In this work, we present a dataset that combines functional magnetic imaging (fMRI) and electroencephalography (EEG) to use as a resource for understanding human brain function in these two imaging modalities. The dataset can also be used for optimizing preprocessing methods for simultaneously collected imaging data. The dataset includes simultaneously collected recordings from 22 individuals (ages: 23-51) across various visual and naturalistic stimuli. In addition, physiological, eye tracking, electrocardiography, and cognitive and behavioral data were collected along with this neuroimaging data. Visual tasks include a flickering checkerboard collected outside and inside the MRI scanner (EEG-only) and simultaneous EEG-fMRI recordings. Simultaneous recordings include rest, the visual paradigm Inscapes, and several short video movies representing naturalistic stimuli. Raw and preprocessed data are openly available to download. We present this dataset as part of an effort to provide open-access data to increase the opportunity for discoveries and understanding of the human brain and evaluate the correlation between electrical brain activity and blood oxygen level-dependent (BOLD) signals.

Progressive neuronal plasticity in primate visual cortex during stimulus familiarization

The primate brain is equipped to learn and remember newly encountered visual stimuli such as faces and objects. In the macaque inferior temporal (IT) cortex, neurons mark the familiarity of a visual stimulus through response modification, often involving a decrease in spiking rate. Here, we investigate the emergence of this neural plasticity by longitudinally tracking IT neurons during several weeks of familiarization with face images. We found that most neurons in the anterior medial (AM) face patch exhibited a gradual decline in their late-phase visual responses to multiple stimuli. Individual neurons varied from days to weeks in their rates of plasticity, with time constants determined by the number of days of exposure rather than the cumulative number of presentations. We postulate that the sequential recruitment of neurons with experience-modified responses may provide an internal and graded measure of familiarity strength, which is a key mnemonic component of visual recognition.

Brain-wide functional connectivity of face patch neurons during rest

The brain is a highly organized, dynamic system whose network architecture is often assessed through resting functional magnetic resonance imaging (fMRI) functional connectivity. The functional interactions between brain areas, including those observed during rest, are assumed to stem from the collective influence of action potentials carried by long-range neural projections. However, the contribution of individual neurons to brain-wide functional connectivity has not been systematically assessed. Here we developed a method to concurrently measure and compare the spiking activity of local neurons with fMRI signals measured across the brain during rest. We recorded spontaneous activity from neural populations in cortical face patches in the macaque during fMRI scanning sessions. Individual cells exhibited prominent, bilateral coupling with fMRI fluctuations in a restricted set of cortical areas inside and outside the face patch network, partially matching the pattern of known anatomical projections. Within each face patch population, a subset of neurons was positively coupled with the face patch network and another was negatively coupled. The same cells showed inverse correlations with distinct subcortical structures, most notably the lateral geniculate nucleus and brainstem neuromodulatory centers. Corresponding connectivity maps derived from fMRI seeds and local field potentials differed from the single unit maps, particularly in subcortical areas. Together, the results demonstrate that the spiking fluctuations of neurons are selectively coupled with discrete brain regions, with the coupling governed in part by anatomical network connections and in part by indirect neuromodulatory pathways.