Visual experience is not necessary for the development of face-selectivity in the lateral fusiform gyrus

Regional homogeneity as a marker of sensory cortex dysmaturity in preterm infants

Atypical perinatal sensory experience in preterm infants is thought to increase their risk of neurodevelopmental disabilities by altering the development of the sensory cortices. Here, we used resting-state fMRI data from preterm and term-born infants scanned between 32 and 48 weeks post-menstrual age to assess the effect of early ex-utero exposure on sensory cortex development. Specifically, we utilized a measure of local correlated-ness called regional homogeneity (ReHo). First, we demonstrated that the brain-wide distribution of ReHo mirrors the known gradient of cortical maturation. Next, we showed that preterm birth differentially reduces ReHo across the primary sensory cortices. Finally, exploratory analyses showed that the reduction of ReHo in the primary auditory cortex of preterm infants is related to increased risk of autism at 18 months. In sum, we show that local connectivity within sensory cortices has different developmental trajectories, is differentially affected by preterm birth, and may be associated with later neurodevelopment.

Developing cortex is functionally pluripotent: Evidence from blindness

How rigidly does innate architecture constrain function of developing cortex? What is the contribution of early experience? We review insights into these questions from visual cortex function in people born blind. In blindness, occipital cortices are active during auditory and tactile tasks. What 'cross-modal' plasticity tells us about cortical flexibility is debated. On the one hand, visual networks of blind people respond to higher cognitive information, such as sentence grammar, suggesting drastic repurposing. On the other, in line with 'metamodal' accounts, sighted and blind populations show shared domain preferences in ventral occipito-temporal cortex (vOTC), suggesting visual areas switch input modality but perform the same or similar perceptual functions (e.g., face recognition) in blindness. Here we bring these disparate literatures together, reviewing and synthesizing evidence that speaks to whether visual cortices have similar or different functions in blind and sighted people. Together, the evidence suggests that in blindness, visual cortices are incorporated into higher-cognitive (e.g., fronto-parietal) networks, which are a major source long-range input to the visual system. We propose the connectivity-constrained experience-dependent account. Functional development is constrained by innate anatomical connectivity, experience and behavioral needs. Infant cortex is pluripotent, the same anatomical constraints develop into different functional outcomes.

Dissecting abstract, modality-specific and experience-dependent coding of affect in the human brain

Emotion and perception are tightly intertwined, as affective experiences often arise from the appraisal of sensory information. Nonetheless, whether the brain encodes emotional instances using a sensory-specific code or in a more abstract manner is unclear. Here, we answer this question by measuring the association between emotion ratings collected during a unisensory or multisensory presentation of a full-length movie and brain activity recorded in typically developed, congenitally blind and congenitally deaf participants. Emotional instances are encoded in a vast network encompassing sensory, prefrontal, and temporal cortices. Within this network, the ventromedial prefrontal cortex stores a categorical representation of emotion independent of modality and previous sensory experience, and the posterior superior temporal cortex maps the valence dimension using an abstract code. Sensory experience more than modality affects how the brain organizes emotional information outside supramodal regions, suggesting the existence of a scaffold for the representation of emotional states where sensory inputs during development shape its functioning.

Neural specialization for 'visual' concepts emerges in the absence of vision

Vision provides a key source of information about many concepts, including 'living things' (e.g., tiger) and visual events (e.g., sparkle). According to a prominent theoretical framework, neural specialization for different conceptual categories is shaped by sensory features, e.g., living things are neurally dissociable from navigable places because living things concepts depend more on visual features. We tested this framework by comparing the neural basis of 'visual' concepts across sighted (n=22) and congenitally blind (n=21) adults. Participants judged the similarity of words varying in their reliance on vision while undergoing fMRI. We compared neural responses to living things nouns (birds, mammals) and place nouns (natural, manmade). In addition, we compared visual event verbs (e.g., 'sparkle') to non-visual events (sound emission, hand motion, mouth motion). People born blind exhibited distinctive univariate and multivariate responses to living things in a temporo-parietal semantic network activated by nouns, including the precuneus (PC). To our knowledge, this is the first demonstration that neural selectivity for living things does not require vision. We additionally observed preserved neural signatures of 'visual' light events in the left middle temporal gyrus (LMTG+). Across a wide range of semantic types, neural representations of sensory concepts develop independent of sensory experience.

A unified model for cross-modal plasticity and skill acquisition

Historically, cross-modal plasticity following early blindness has been largely studied in the context of visual deprivation. However, more recently, there has been a shift in focus towards understanding cross-modal plasticity from the perspective of skill acquisition: the striking plasticity observed in early blind individuals reflects the extraordinary perceptual and cognitive challenges they solve. Here, inspired by two seminal papers on skill learning (the "cortical recycling" theory) and cross-modal plasticity (the "metamodal" hypothesis) respectively, we present a unified hypothesis of cortical specialization that describes how shared functional, algorithmic, and structural constraints might mediate both types of plasticity.

Sound-encoded faces activate the left fusiform face area in the early blind

Face perception in humans and nonhuman primates is accomplished by a patchwork of specialized cortical regions. How these regions develop has remained controversial. In sighted individuals, facial information is primarily conveyed via the visual modality. Early blind individuals, on the other hand, can recognize shapes using auditory and tactile cues. Here we demonstrate that such individuals can learn to distinguish faces from houses and other shapes by using a sensory substitution device (SSD) presenting schematic faces as sound-encoded stimuli in the auditory modality. Using functional MRI, we then asked whether a face-selective brain region like the fusiform face area (FFA) shows selectivity for faces in the same subjects, and indeed, we found evidence for preferential activation of the left FFA by sound-encoded faces. These results imply that FFA development does not depend on experience with visual faces per se but may instead depend on exposure to the geometry of facial configurations.

Predicting an individual's cerebellar activity from functional connectivity fingerprints

The cerebellum is gaining scientific attention as a key neural substrate of cognitive function; however, individual differences in the cerebellar organization have not yet been well studied. Individual differences in functional brain organization can be closely tied to individual differences in brain connectivity. 'Connectome Fingerprinting' is a modeling approach that predicts an individual's brain activity from their connectome. Here, we extend 'Connectome Fingerprinting' (CF) to the cerebellum. We examined functional MRI data from 160 subjects (98 females) of the Human Connectome Project young adult dataset. For each of seven cognitive task paradigms, we constructed CF models from task activation maps and resting-state cortico-cerebellar functional connectomes, using a set of training subjects. For each model, we then predicted task activation in novel individual subjects, using their resting-state functional connectomes. In each cognitive paradigm, the CF models predicted individual subject cerebellar activity patterns with significantly greater precision than did predictions from the group average task activation. Examination of the CF models revealed that the cortico-cerebellar connections that carried the most information were those made with the non-motor portions of the cerebral cortex. These results demonstrate that the fine-scale functional connectivity between the cerebral cortex and cerebellum carries important information about individual differences in cerebellar functional organization. Additionally, CF modeling may be useful in the examination of patients with cerebellar dysfunction, since model predictions require only resting-state fMRI data which is more easily obtained than task fMRI.

The development of upright face perception depends on evolved orientation-specific mechanisms and experience

Here we examine whether our impressive ability to perceive upright faces arises from evolved orientation-specific mechanisms, our extensive experience with upright faces, or both factors. To do so, we tested Claudio, a man with a congenital joint disorder causing his head to be rotated back so that it is positioned between his shoulder blades. As a result, Claudio has seen more faces reversed in orientation to his own face than matched to it. Controls exhibited large inversion effects on all tasks, but Claudio performed similarly with upright and inverted faces in both detection and identity-matching tasks, indicating these abilities are the product of evolved mechanisms and experience. In contrast, he showed clear upright superiority when detecting "Thatcherized" faces (faces with vertically flipped features), suggesting experience plays a greater role in this judgment. Together, these findings indicate that both evolved orientation-specific mechanisms and experience contribute to our proficiency with upright faces.

Modeling Biological Face Recognition with Deep Convolutional Neural Networks

Deep convolutional neural networks (DCNNs) have become the state-of-the-art computational models of biological object recognition. Their remarkable success has helped vision science break new ground, and recent efforts have started to transfer this achievement to research on biological face recognition. In this regard, face detection can be investigated by comparing face-selective biological neurons and brain areas to artificial neurons and model layers. Similarly, face identification can be examined by comparing in vivo and in silico multidimensional "face spaces." In this review, we summarize the first studies that use DCNNs to model biological face recognition. On the basis of a broad spectrum of behavioral and computational evidence, we conclude that DCNNs are useful models that closely resemble the general hierarchical organization of face recognition in the ventral visual pathway and the core face network. In two exemplary spotlights, we emphasize the unique scientific contributions of these models. First, studies on face detection in DCNNs indicate that elementary face selectivity emerges automatically through feedforward processing even in the absence of visual experience. Second, studies on face identification in DCNNs suggest that identity-specific experience and generative mechanisms facilitate this particular challenge. Taken together, as this novel modeling approach enables close control of predisposition (i.e., architecture) and experience (i.e., training data), it may be suited to inform long-standing debates on the substrates of biological face recognition.

Multisensory perception constrains the formation of object categories: a review of evidence from sensory-driven and predictive processes on categorical decisions

Although object categorization is a fundamental cognitive ability, it is also a complex process going beyond the perception and organization of sensory stimulation. Here we review existing evidence about how the human brain acquires and organizes multisensory inputs into object representations that may lead to conceptual knowledge in memory. We first focus on evidence for two processes on object perception, multisensory integration of redundant information (e.g. seeing and feeling a shape) and crossmodal, statistical learning of complementary information (e.g. the 'moo' sound of a cow and its visual shape). For both processes, the importance attributed to each sensory input in constructing a multisensory representation of an object depends on the working range of the specific sensory modality, the relative reliability or distinctiveness of the encoded information and top-down predictions. Moreover, apart from sensory-driven influences on perception, the acquisition of featural information across modalities can affect semantic memory and, in turn, influence category decisions. In sum, we argue that both multisensory processes independently constrain the formation of object categories across the lifespan, possibly through early and late integration mechanisms, respectively, to allow us to efficiently achieve the everyday, but remarkable, ability of recognizing objects. This article is part of the theme issue 'Decision and control processes in multisensory perception'.

Spontaneous changes in brain network centrality in patients with pathological myopia: A voxel-wise degree centrality analysis

BACKGROUND

Myopia has become a worldwide problem that endangers public health and adds a serious socioeconomic burden. Current research has focused on the pathogenesis and manifestations of pathological myopia (PM). However, few studies have been conducted on the spontaneous activity of the patient's brain.

PURPOSE

To study the potential brain network activity in patients with PM by the degree centrality (DC) method.

MATERIALS AND METHODS

This experiment included 15 PM patients and 15 healthy controls (HCs). Every participant experienced a resting-state functional magnetic resonance imaging (rs-fMRI) scan. Receiver operating characteristic (ROC) curve analysis was used to distinguish between PM patients and HCs. Correlation analysis was used to explore the relationships between mean DC values and clinical performance in different brain regions.

RESULTS

It showed that patients with PM had lower DC values in the right fusiform gyrus (FR) and right cingulate (CAR). The ROC curve was used to indicate the accuracy of the correlation. It showed that in PM group, left best corrected visual acuity (BCVA-L) and right best corrected visual acuity (BCVA-R) were negatively correlated with the DC value of FR.

CONCLUSION

The occurrence of PM is mainly related to the abnormal activity of the fusiform and cingulum. DC value might be used as a biological marker of abnormal brain activity in PM patients.

White matter connections of high-level visual areas predict cytoarchitecture better than category-selectivity in childhood, but not adulthood

Ventral temporal cortex (VTC) consists of high-level visual regions that are arranged in consistent anatomical locations across individuals. This consistency has led to several hypotheses about the factors that constrain the functional organization of VTC. A prevailing theory is that white matter connections influence the organization of VTC, however, the nature of this constraint is unclear. Here, we test 2 hypotheses: (1) white matter tracts are specific for each category or (2) white matter tracts are specific to cytoarchitectonic areas of VTC. To test these hypotheses, we used diffusion magnetic resonance imaging to identify white matter tracts and functional magnetic resonance imaging to identify category-selective regions in VTC in children and adults. We find that in childhood, white matter connections are linked to cytoarchitecture rather than category-selectivity. In adulthood, however, white matter connections are linked to both cytoarchitecture and category-selectivity. These results suggest a rethinking of the view that category-selective regions in VTC have category-specific white matter connections early in development. Instead, these findings suggest that the neural hardware underlying the processing of categorical stimuli may be more domain-general than previously thought, particularly in childhood.

Sensory modality and spoken language shape reading network in blind readers of Braille

The neural basis of reading is highly consistent across many languages and scripts. Are there alternative neural routes to reading? How does the sensory modality of symbols (tactile vs. visual) influence their neural representations? We examined these questions by comparing reading of visual print (sighted group, n = 19) and tactile Braille (congenitally blind group, n = 19). Blind and sighted readers were presented with written (words, consonant strings, non-letter shapes) and spoken stimuli (words, backward speech) that varied in word-likeness. Consistent with prior work, the ventral occipitotemporal cortex (vOTC) was active during Braille and visual reading. A posterior/anterior vOTC word-form gradient was observed only in sighted readers with more anterior regions preferring larger orthographic units (words). No such gradient was observed in blind readers. Consistent with connectivity predictions, in blind compared to sighted readers, posterior parietal cortices were recruited to a greater degree and contained word-preferring patches. Lateralization of Braille in blind readers was predicted by laterality of spoken language and reading hand. The effect of spoken language increased along a cortical hierarchy, whereas effect of reading hand waned. These results suggested that the neural basis of reading is influenced by symbol modality and spoken language and support connectivity-based views of cortical function.

A modality-independent proto-organization of human multisensory areas

The processing of multisensory information is based upon the capacity of brain regions, such as the superior temporal cortex, to combine information across modalities. However, it is still unclear whether the representation of coherent auditory and visual events requires any prior audiovisual experience to develop and function. Here we measured brain synchronization during the presentation of an audiovisual, audio-only or video-only version of the same narrative in distinct groups of sensory-deprived (congenitally blind and deaf) and typically developed individuals. Intersubject correlation analysis revealed that the superior temporal cortex was synchronized across auditory and visual conditions, even in sensory-deprived individuals who lack any audiovisual experience. This synchronization was primarily mediated by low-level perceptual features, and relied on a similar modality-independent topographical organization of slow temporal dynamics. The human superior temporal cortex is naturally endowed with a functional scaffolding to yield a common representation across multisensory events.

CNNs reveal the computational implausibility of the expertise hypothesis

Face perception has long served as a classic example of domain specificity of mind and brain. But an alternative "expertise" hypothesis holds that putatively face-specific mechanisms are actually domain-general, and can be recruited for the perception of other objects of expertise (e.g., cars for car experts). Here, we demonstrate the computational implausibility of this hypothesis: Neural network models optimized for generic object categorization provide a better foundation for expert fine-grained discrimination than do models optimized for face recognition.

Functionally and structurally distinct fusiform face area(s) in over 1000 participants

The fusiform face area (FFA) is a widely studied region causally involved in face perception. Even though cognitive neuroscientists have been studying the FFA for over two decades, answers to foundational questions regarding the function, architecture, and connectivity of the FFA from a large (N>1000) group of participants are still lacking. To fill this gap in knowledge, we quantified these multimodal features of fusiform face-selective regions in 1053 participants in the Human Connectome Project. After manually defining over 4,000 fusiform face-selective regions, we report five main findings. First, 68.76% of hemispheres have two cortically separate regions (pFus-faces/FFA-1 and mFus-faces/FFA-2). Second, in 26.69% of hemispheres, pFus-faces/FFA-1 and mFus-faces/FFA-2 are spatially contiguous, yet are distinct based on functional, architectural, and connectivity metrics. Third, pFus-faces/FFA-1 is more face-selective than mFus-faces/FFA-2, and the two regions have distinct functional connectivity fingerprints. Fourth, pFus-faces/FFA-1 is cortically thinner and more heavily myelinated than mFus-faces/FFA-2. Fifth, face-selective patterns and functional connectivity fingerprints of each region are more similar in monozygotic than dizygotic twins and more so than architectural gradients. As we share our areal definitions with the field, future studies can explore how structural and functional features of these regions will inform theories regarding how visual categories are represented in the brain.

Associations between abstract working memory abilities and brain activity underlying long-term recognition of auditory sequences

Memory is a complex cognitive process composed of several subsystems, namely short- and long-term memory and working memory (WM). Previous research has shown that adequate interaction between subsystems is crucial for successful memory processes such as encoding, storage, and manipulation of information. However, few studies have investigated the relationship between different subsystems at the behavioral and neural levels. Thus, here we assessed the relationship between individual WM abilities and brain activity underlying the recognition of previously memorized auditory sequences. First, recognition of previously memorized versus novel auditory sequences was associated with a widespread network of brain areas comprising the cingulate gyrus, hippocampus, insula, inferior temporal cortex, frontal operculum, and orbitofrontal cortex. Second, we observed positive correlations between brain activity underlying auditory sequence recognition and WM. We showed a sustained positive correlation in the medial cingulate gyrus, a brain area that was widely involved in the auditory sequence recognition. Remarkably, we also observed positive correlations in the inferior temporal, temporal-fusiform, and postcentral gyri, brain areas that were not strongly associated with auditory sequence recognition. In conclusion, we discovered positive correlations between WM abilities and brain activity underlying long-term recognition of auditory sequences, providing new evidence on the relationship between memory subsystems. Furthermore, we showed that high WM performers recruited a larger brain network including areas associated with visual processing (i.e., inferior temporal, temporal-fusiform, and postcentral gyri) for successful auditory memory recognition.

Brain-like functional specialization emerges spontaneously in deep neural networks

The human brain contains multiple regions with distinct, often highly specialized functions, from recognizing faces to understanding language to thinking about what others are thinking. However, it remains unclear why the cortex exhibits this high degree of functional specialization in the first place. Here, we consider the case of face perception using artificial neural networks to test the hypothesis that functional segregation of face recognition in the brain reflects a computational optimization for the broader problem of visual recognition of faces and other visual categories. We find that networks trained on object recognition perform poorly on face recognition and vice versa and that networks optimized for both tasks spontaneously segregate themselves into separate systems for faces and objects. We then show functional segregation to varying degrees for other visual categories, revealing a widespread tendency for optimization (without built-in task-specific inductive biases) to lead to functional specialization in machines and, we conjecture, also brains.

Congenitally blind adults can learn to identify face-shapes via auditory sensory substitution and successfully generalize some of the learned features

Unlike sighted individuals, congenitally blind individuals have little to no experience with face shapes. Instead, they rely on non-shape cues, such as voices, to perform character identification. The extent to which face-shape perception can be learned in adulthood via a different sensory modality (i.e., not vision) remains poorly explored. We used a visual-to-auditory Sensory Substitution Device (SSD) that enables conversion of visual images to the auditory modality while preserving their visual characteristics. Expert SSD users were systematically taught to identify cartoon faces via audition. Following a tailored training program lasting ~ 12 h, congenitally blind participants successfully identified six trained faces with high accuracy. Furthermore, they effectively generalized their identification to the untrained, inverted orientation of the learned faces. Finally, after completing the extensive 12-h training program, participants learned six new faces within 2 additional hours of training, suggesting internalization of face-identification processes. Our results document for the first time that facial features can be processed through audition, even in the absence of visual experience across the lifespan. Overall, these findings have important implications for both non-visual object recognition and visual rehabilitation practices and prompt the study of the neural processes underlying auditory face perception in the absence of vision.

Early visual exposure primes future cross-modal specialization of the fusiform face area in tactile face processing in the blind

The fusiform face area (FFA) is a core cortical region for face information processing. Evidence suggests that its sensitivity to faces is largely innate and tuned by visual experience. However, how experience in different time windows shape the plasticity of the FFA remains unclear. In this study, we investigated the role of visual experience at different time points of an individual's early development in the cross-modal face specialization of the FFA. Participants (n = 74) were classified into five groups: congenital blind, early blind, late blind, low vision, and sighted control. Functional magnetic resonance imaging data were acquired when the participants haptically processed carved faces and other objects. Our results showed a robust and highly consistent face-selective activation in the FFA region in the early blind participants, invariant to size and level of abstraction of the face stimuli. The cross-modal face activation in the FFA was much less consistent in other groups. These results suggest that early visual experience primes cross-modal specialization of the FFA, and even after the absence of visual experience for more than 14 years in early blind participants, their FFA can engage in cross-modal processing of face information.

Naturalistic Audio-Movies reveal common spatial organization across "visual" cortices of different blind individuals

Occipital cortices of different sighted people contain analogous maps of visual information (e.g. foveal vs. peripheral). In congenital blindness, "visual" cortices respond to nonvisual stimuli. Do visual cortices of different blind people represent common informational maps? We leverage naturalistic stimuli and inter-subject pattern similarity analysis to address this question. Blindfolded sighted (n = 22) and congenitally blind (n = 22) participants listened to 6 sound clips (5-7 min each): 3 auditory excerpts from movies; a naturalistic spoken narrative; and matched degraded auditory stimuli (Backwards Speech, scrambled sentences), during functional magnetic resonance imaging scanning. We compared the spatial activity patterns evoked by each unique 10-s segment of the different auditory excerpts across blind and sighted people. Segments of meaningful naturalistic stimuli produced distinctive activity patterns in frontotemporal networks that were shared across blind and across sighted individuals. In the blind group only, segment-specific, cross-subject patterns emerged in visual cortex, but only for meaningful naturalistic stimuli and not Backwards Speech. Spatial patterns of activity within visual cortices are sensitive to time-varying information in meaningful naturalistic auditory stimuli in a broadly similar manner across blind individuals.

Face detection in untrained deep neural networks

Face-selective neurons are observed in the primate visual pathway and are considered as the basis of face detection in the brain. However, it has been debated as to whether this neuronal selectivity can arise innately or whether it requires training from visual experience. Here, using a hierarchical deep neural network model of the ventral visual stream, we suggest a mechanism in which face-selectivity arises in the complete absence of training. We found that units selective to faces emerge robustly in randomly initialized networks and that these units reproduce many characteristics observed in monkeys. This innate selectivity also enables the untrained network to perform face-detection tasks. Intriguingly, we observed that units selective to various non-face objects can also arise innately in untrained networks. Our results imply that the random feedforward connections in early, untrained deep neural networks may be sufficient for initializing primitive visual selectivity.

Visuospatial coding as ubiquitous scaffolding for human cognition

For more than 100 years we have known that the visual field is mapped onto the surface of visual cortex, imposing an inherently spatial reference frame on visual information processing. Recent studies highlight visuospatial coding not only throughout visual cortex, but also brain areas not typically considered visual. Such widespread access to visuospatial coding raises important questions about its role in wider cognitive functioning. Here, we synthesise these recent developments and propose that visuospatial coding scaffolds human cognition by providing a reference frame through which neural computations interface with environmental statistics and task demands via perception-action loops.

One object, two networks? Assessing the relationship between the face and body-selective regions in the primate visual system

Faces and bodies are often treated as distinct categories that are processed separately by face- and body-selective brain regions in the primate visual system. These regions occupy distinct regions of visual cortex and are often thought to constitute independent functional networks. Yet faces and bodies are part of the same object and their presence inevitably covary in naturalistic settings. Here, we re-evaluate both the evidence supporting the independent processing of faces and bodies and the organizational principles that have been invoked to explain this distinction. We outline four hypotheses ranging from completely separate networks to a single network supporting the perception of whole people or animals. The current evidence, especially in humans, is compatible with all of these hypotheses, making it presently unclear how the representation of faces and bodies is organized in the cortex.

Elements of Neuroanthropology

Neuroanthropology is the integration of neuroscience into anthropology and aims to understand “brains in the wild.” This interdisciplinary field examines patterns of human variation in field settings and provides empirical research that complements work done in clinical and laboratory settings. Neuroanthropology often uses ethnography in combination with theories and methods from cognitive science as a way to capture how culture, mind, and brain interact. This article describes nine elements that outline how to do neuroanthropology research: (1) integrating biology and culture through neuroscience and biocultural anthropology; (2) extending focus of anthropology on what people say and do to include what people process; (3) sizing culture appropriately, from broad patterns of culture to culture in small-scale settings; (4) understanding patterns of cultural variation, in particular how culture produces patterns of shared variation; (5) considering individuals in interaction with culture, with levels of analysis that can go from biology to social structures; (6) focusing on interactive elements that bring together biological and cultural processes; (7) conceptual triangulation, which draws on anthropology, psychology, and neuroscience in conjunction with field, clinic, and laboratory; (8) critical complementarity as a way to integrate the strengths of critical scholarship with interdisciplinary work; and (9) using methodological triangulation as a way to advance interdisciplinary research. These elements are illustrated through three case studies: research on US combat veterans and how they use Brazilian Jiu Jitsu as a way to manage the transition to becoming civilians, work on human-raptor interactions to understand how and why these interactions can prove beneficial for human handlers, and adapting cue reactivity research on addiction to a field-based approach to understand how people interact with cues in naturalistic settings.

Cochlea to categories: The spatiotemporal dynamics of semantic auditory representations

How does the auditory system categorize natural sounds? Here we apply multimodal neuroimaging to illustrate the progression from acoustic to semantically dominated representations. Combining magnetoencephalographic (MEG) and functional magnetic resonance imaging (fMRI) scans of observers listening to naturalistic sounds, we found superior temporal responses beginning ∼55 ms post-stimulus onset, spreading to extratemporal cortices by ∼100 ms. Early regions were distinguished less by onset/peak latency than by functional properties and overall temporal response profiles. Early acoustically-dominated representations trended systematically toward category dominance over time (after ∼200 ms) and space (beyond primary cortex). Semantic category representation was spatially specific: Vocalizations were preferentially distinguished in frontotemporal voice-selective regions and the fusiform; scenes and objects were distinguished in parahippocampal and medial place areas. Our results are consistent with real-world events coded via an extended auditory processing hierarchy, in which acoustic representations rapidly enter multiple streams specialized by category, including areas typically considered visual cortex.

Computational models of category-selective brain regions enable high-throughput tests of selectivity

Cortical regions apparently selective to faces, places, and bodies have provided important evidence for domain-specific theories of human cognition, development, and evolution. But claims of category selectivity are not quantitatively precise and remain vulnerable to empirical refutation. Here we develop artificial neural network-based encoding models that accurately predict the response to novel images in the fusiform face area, parahippocampal place area, and extrastriate body area, outperforming descriptive models and experts. We use these models to subject claims of category selectivity to strong tests, by screening for and synthesizing images predicted to produce high responses. We find that these high-response-predicted images are all unambiguous members of the hypothesized preferred category for each region. These results provide accurate, image-computable encoding models of each category-selective region, strengthen evidence for domain specificity in the brain, and point the way for future research characterizing the functional organization of the brain with unprecedented computational precision.

On the relationship between maps and domains in inferotemporal cortex

How does the brain encode information about the environment? Decades of research have led to the pervasive notion that the object-processing pathway in primate cortex consists of multiple areas that are each specialized to process different object categories (such as faces, bodies, hands, non-face objects and scenes). The anatomical consistency and modularity of these regions have been interpreted as evidence that these regions are innately specialized. Here, we propose that ventral-stream modules do not represent clusters of circuits that each evolved to process some specific object category particularly important for survival, but instead reflect the effects of experience on a domain-general architecture that evolved to be able to adapt, within a lifetime, to its particular environment. Furthermore, we propose that the mechanisms underlying the development of domains are both evolutionarily old and universal across cortex. Topographic maps are fundamental, governing the development of specializations across systems, providing a framework for brain organization.

A Data-Driven Functional Mapping of the Anterior Temporal Lobes

Although the anterior temporal lobe (ATL) comprises several anatomic and functional subdivisions, it is often reduced to a homogeneous theoretical entity, such as a domain-general convergence zone, or "hub," for semantic information. Methodological limitations are largely to blame for the imprecise mapping of function to structure in the ATL. There are two major obstacles to using fMRI to identify the precise functional organization of the ATL: the difficult choice of stimuli and tasks to activate, and dissociate, specific regions within the ATL; and poor signal quality because of magnetic field distortions near the sinuses. To circumvent these difficulties, we developed a data-driven parcellation routine using resting-state fMRI data (24 females, 64 males) acquired using a sequence that was optimized to enhance signal in the ATL. Focusing on patterns of functional connectivity between each ATL voxel and the rest of the brain, we found that the ATL comprises at least 34 distinct functional parcels that are arranged into bands along the lateral and ventral cortical surfaces, extending from the posterior temporal lobes into the temporal poles. In addition, the anterior region of the fusiform gyrus, most often cited as the location of the semantic hub, was found to be part of a domain-specific network associated with face and social processing, rather than a domain-general semantic hub. These findings offer a fine-grained functional map of the ATL and offer an initial step toward using more precise language to describe the locations of functional responses in this heterogeneous region of human cortex.SIGNIFICANCE STATEMENT The functional role of the anterior aspects of the temporal lobes (ATL) is a contentious issue. While it is likely that different regions within the ATL subserve unique cognitive functions, most studies revert to vaguely referring to particular functional regions as "the ATL," and, thus, the mapping of function to anatomy remains unclear. We used resting-state fMRI connectivity patterns between the ATL and the rest of the brain to reveal that the ATL comprises at least 34 distinct functional parcels that are organized into a three-level functional hierarchy. These results provide a detailed functional map of the anterior temporal lobes that can guide future research on how distinct regions within the ATL support diverse cognitive functions.

Face-like configurations modulate electrophysiological mismatch responses

The human face is one of the most salient stimuli in the environment. It has been suggested that even basic face-like configurations (three dots composing a downward pointing triangle) may convey salience. Interestingly, stimulus salience can be signaled by mismatch detection phenomena, characterized by greater amplitudes of event-related potentials (ERPs) in response to relevant novel stimulation as compared to non-relevant repeated events. Here, we investigate whether basic face-like stimuli are salient enough to modulate mismatch detection phenomena. ERPs are elicited by a pair of sequentially presented visual stimuli (S1-S2), delivered at a constant 1-s interval, representing either a face-like stimulus (Upright configuration) or three neutral configurations (Inverted, Leftwards, and Rightwards configurations), that are obtained by rotating the Upright configuration along the three different axes. In pairs including a canonical face-like stimulus, we observe a more effective mismatch detection mechanism, with significantly larger N270 and P300 components when S2 is different from S1 as compared to when S2 is identical to S1. This ERP modulation, not significant in pairs excluding face-like stimuli, reveals that mismatch detection phenomena are significantly affected by basic face-like configurations. Even though further experiments are needed to ascertain whether this effect is specifically elicited by face-like configuration rather than by particular orientation changes, our findings suggest that face essential, structural attributes are salient enough to affect change detection processes.

Visual experience dependent plasticity in humans

While sensitive periods in brain development have often been studied by investigating the recovery of visual functions after a congenital phase of visual deprivation in non-human animals, research in humans who had recovered sight after a transient phase of congenital blindness is still scarce. Here, we discuss the hypothesis put forward based on non-human primate work which states that the effects of experience increase downstream the visual processing hierarchy. Recent results from behavioral and neuroscience studies in sight recovery individuals are discussed in the context of research findings from permanently congenitally blind humans as well as from prospective studies in infants and children.

Learning in Infancy Is Active, Endogenously Motivated, and Depends on the Prefrontal Cortices

A common view of learning in infancy emphasizes the role of incidental sensory experiences from which increasingly abstract statistical regularities are extracted. In this view, infant brains initially support basic sensory and motor functions, followed by maturation of higher-level association cortex. Here, we critique this view and posit that, by contrast and more like adults, infants are active, endogenously motivated learners who structure their own learning through flexible selection of attentional targets and active interventions on their environment. We further argue that the infant brain, and particularly the prefrontal cortex (PFC), is well equipped to support these learning behaviors. We review recent progress in characterizing the function of the infant PFC, which suggests that, as in adults, the PFC is functionally specialized and highly connected. Together, we present an integrative account of infant minds and brains, in which the infant PFC represents multiple intrinsic motivations, which are leveraged for active learning.