Cortical hierarchy, dual counterstream architecture and the importance of top-down generative networks

Hierarchy between forelimb premotor and primary motor cortices and its manifestation in their firing patterns

Though hierarchy is commonly invoked in descriptions of motor cortical function, its presence and manifestation in firing patterns remain poorly resolved. Here we use optogenetic inactivation to demonstrate that short-latency influence between forelimb premotor and primary motor cortices is asymmetric during reaching in mice, demonstrating a partial hierarchy between the endogenous activity in each region. Multi-region recordings revealed that some activity is captured by similar but delayed patterns where either region's activity leads, with premotor activity leading more. Yet firing in each region is dominated by patterns shared between regions and is equally predictive of firing in the other region at the single-neuron level. In dual-region network models fit to data, regions differed in their dependence on across-region input, rather than the amount of such input they received. Our results indicate that motor cortical hierarchy, while present, may not be exposed when inferring interactions between populations from firing patterns alone.

Distinct feedforward and feedback pathways for cell-type specific attention effects

Selective attention is thought to depend on enhanced firing activity in extrastriate areas. Theories suggest that this enhancement depends on selective inter-areal communication via gamma (30-80 Hz) phase-locking. To test this, we simultaneously recorded from different cell types and cortical layers of macaque V1 and V4. We find that while V1-V4 gamma phase-locking between local field potentials increases with attention, the V1 gamma rhythm does not engage V4 excitatory-neurons, but only fast-spiking interneurons in L4 of V4. By contrast, attention enhances V4 spike-rates in both excitatory and inhibitory cells, most strongly in L2/3. The rate increase in L2/3 of V4 precedes V1 in time. These findings suggest enhanced signal transmission with attention does not depend on inter-areal gamma phase-locking and show that the endogenous gamma rhythm has cell-type- and layer-specific effects on downstream target areas. Similar findings were made in the mouse visual system, based on opto-tagging of identified interneurons.

The meso-connectomes of mouse, marmoset, and macaque: network organization and the emergence of higher cognition

The recent publications of the inter-areal connectomes for mouse, marmoset, and macaque cortex have allowed deeper comparisons across rodent vs. primate cortical organization. In general, these show that the mouse has very widespread, "all-to-all" inter-areal connectivity (i.e. a "highly dense" connectome in a graph theoretical framework), while primates have a more modular organization. In this review, we highlight the relevance of these differences to function, including the example of primary visual cortex (V1) which, in the mouse, is interconnected with all other areas, therefore including other primary sensory and frontal areas. We argue that this dense inter-areal connectivity benefits multimodal associations, at the cost of reduced functional segregation. Conversely, primates have expanded cortices with a modular connectivity structure, where V1 is almost exclusively interconnected with other visual cortices, themselves organized in relatively segregated streams, and hierarchically higher cortical areas such as prefrontal cortex provide top-down regulation for specifying precise information for working memory storage and manipulation. Increased complexity in cytoarchitecture, connectivity, dendritic spine density, and receptor expression additionally reveal a sharper hierarchical organization in primate cortex. Together, we argue that these primate specializations permit separable deconstruction and selective reconstruction of representations, which is essential to higher cognition.

Atypical connectome topography and signal flow in temporal lobe epilepsy

Temporal lobe epilepsy (TLE) is the most common pharmaco-resistant epilepsy in adults. While primarily associated with mesiotemporal pathology, recent evidence suggests that brain alterations in TLE extend beyond the paralimbic epicenter and impact macroscale function and cognitive functions, particularly memory. Using connectome-wide manifold learning and generative models of effective connectivity, we examined functional topography and directional signal flow patterns between large-scale neural circuits in TLE at rest. Studying a multisite cohort of 95 patients with TLE and 95 healthy controls, we observed atypical functional topographies in the former group, characterized by reduced differentiation between sensory and transmodal association cortices, with most marked effects in bilateral temporo-limbic and ventromedial prefrontal cortices. These findings were consistent across all study sites, present in left and right lateralized patients, and validated in a subgroup of patients with histopathological validation of mesiotemporal sclerosis and post-surgical seizure freedom. Moreover, they were replicated in an independent cohort of 30 TLE patients and 40 healthy controls. Further analyses demonstrated that reduced differentiation related to decreased functional signal flow into and out of temporolimbic cortical systems and other brain networks. Parallel analyses of structural and diffusion-weighted MRI data revealed that topographic alterations were independent of TLE-related cortical thinning but partially mediated by white matter microstructural changes that radiated away from paralimbic circuits. Finally, we found a strong association between the degree of functional alterations and behavioral markers of memory dysfunction. Our work illustrates the complex landscape of macroscale functional imbalances in TLE, which can serve as intermediate markers bridging microstructural changes and cognitive impairment.

Cytoarchitectonic gradients of laminar degeneration in behavioral variant frontotemporal dementia

Behavioral variant frontotemporal dementia (bvFTD) is a clinical syndrome primarily caused by either tau (bvFTD-tau) or TDP-43 (bvFTD-TDP) proteinopathies. We previously found lower cortical layers and dorsolateral regions accumulate greater tau than TDP-43 pathology; however, patterns of laminar neurodegeneration across diverse cytoarchitecture in bvFTD is understudied. We hypothesized that bvFTD-tau and bvFTD-TDP have distinct laminar distributions of pyramidal neurodegeneration along cortical gradients, a topologic order of cytoarchitectonic subregions based on increasing pyramidal density and laminar differentiation. Here, we tested this hypothesis in a frontal cortical gradient consisting of five cytoarchitectonic types (i.e., periallocortex, agranular mesocortex, dysgranular mesocortex, eulaminate-I isocortex, eulaminate-II isocortex) spanning anterior cingulate, paracingulate, orbitofrontal, and mid-frontal gyri in bvFTD-tau (n=27), bvFTD-TDP (n=47), and healthy controls (HC; n=32). We immunostained all tissue for total neurons (NeuN; neuronal-nuclear protein) and pyramidal neurons (SMI32; non-phosphorylated neurofilament) and digitally quantified NeuN-immunoreactivity (ir) and SMI32-ir in supragranular II-III, infragranular V-VI, and all I-VI layers in each cytoarchitectonic type. We used linear mixed-effects models adjusted for demographic and biologic variables to compare SMI32-ir between groups and examine relationships with the cortical gradient, long-range pathways, and clinical symptoms. We found regional and laminar distributions of SMI32-ir expected for HC, validating our measures within the cortical gradient framework. While SMI32-ir loss was not related to the cortical gradient in bvFTD-TDP, SMI32-ir progressively decreased along the cortical gradient of bvFTD-tau and included greater SMI32-ir loss in supragranular eulaminate-II isocortex in bvFTD-tau vs bvFTD-TDP ( p =0.039). In a structural model for long-range laminar connectivity between infragranular mesocortex and supragranular isocortex, we found a larger laminar ratio of mesocortex-to-isocortex SMI32-ir in bvFTD-tau vs bvFTD-TDP ( p =0.019), suggesting select long-projecting pathways may contribute to isocortical-predominant degeneration in bvFTD-tau. In cytoarchitectonic types with the highest NeuN-ir, we found lower SMI32-ir in bvFTD-tau vs bvFTD-TDP ( p =0.047), suggesting pyramidal neurodegeneration may occur earlier in bvFTD-tau. Lastly, we found that reduced SMI32-ir related to behavioral severity and frontal-mediated letter fluency, not temporal-mediated confrontation naming, demonstrating the clinical relevance and specificity of frontal pyramidal neurodegeneration to bvFTD-related symptoms. Our data suggest loss of neurofilament-rich pyramidal neurons is a clinically relevant feature of bvFTD that selectively worsens along a frontal cortical gradient in bvFTD-tau, not bvFTD-TDP. Therefore, tau-mediated degeneration may preferentially involve pyramidal-rich layers that connect more distant cytoarchitectonic types. Moreover, the hierarchical arrangement of cytoarchitecture along cortical gradients may be an important neuroanatomical framework for identifying which types of cells and pathways are differentially involved between proteinopathies.

Predictability of cortico-cortical connections in the mammalian brain

Despite a five order of magnitude range in size, the brains of mammals share many anatomical and functional characteristics that translate into cortical network commonalities. Here we develop a machine learning framework to quantify the degree of predictability of the weighted interareal cortical matrix. Partial network connectivity data were obtained with retrograde tract-tracing experiments generated with a consistent methodology, supplemented by projection length measurements in a nonhuman primate (macaque) and a rodent (mouse). We show that there is a significant level of predictability embedded in the interareal cortical networks of both species. At the binary level, links are predictable with an area under the ROC curve of at least 0.8 for the macaque. Weighted medium and strong links are predictable with an 85%-90% accuracy (mouse) and 70%-80% (macaque), whereas weak links are not predictable in either species. These observations reinforce earlier observations that the formation and evolution of the cortical network at the mesoscale is, to a large extent, rule based. Using the methodology presented here, we performed imputations on all area pairs, generating samples for the complete interareal network in both species. These are necessary for comparative studies of the connectome with minimal bias, both within and across species.

Markov Blankets and Mirror Symmetries-Free Energy Minimization and Mesocortical Anatomy

A theoretical account of development in mesocortical anatomy is derived from the free energy principle, operating in a neural field with both Hebbian and anti-Hebbian neural plasticity. An elementary structural unit is proposed, in which synaptic connections at mesoscale are arranged in paired patterns with mirror symmetry. Exchanges of synaptic flux in each pattern form coupled spatial eigenmodes, and the line of mirror reflection between the paired patterns operates as a Markov blanket, so that prediction errors in exchanges between the pairs are minimized. The theoretical analysis is then compared to the outcomes from a biological model of neocortical development, in which neuron precursors are selected by apoptosis for cell body and synaptic connections maximizing synchrony and also minimizing axonal length. It is shown that this model results in patterns of connection with the anticipated mirror symmetries, at micro-, meso- and inter-arial scales, among lateral connections, and in cortical depth. This explains the spatial organization and functional significance of neuron response preferences, and is compatible with the structural form of both columnar and noncolumnar cortex. Multi-way interactions of mirrored representations can provide a preliminary anatomically realistic model of cortical information processing.

Cortical depth profiles in primary visual cortex for illusory and imaginary experiences

Visual illusions and mental imagery are non-physical sensory experiences that involve cortical feedback processing in the primary visual cortex. Using laminar functional magnetic resonance imaging (fMRI) in two studies, we investigate if information about these internal experiences is visible in the activation patterns of different layers of primary visual cortex (V1). We find that imagery content is decodable mainly from deep layers of V1, whereas seemingly 'real' illusory content is decodable mainly from superficial layers. Furthermore, illusory content shares information with perceptual content, whilst imagery content does not generalise to illusory or perceptual information. Together, our results suggest that illusions and imagery, which differ immensely in their subjective experiences, also involve partially distinct early visual microcircuits. However, overlapping microcircuit recruitment might emerge based on the nuanced nature of subjective conscious experience.

Computational components of visual predictive coding circuitry

If a full visual percept can be said to be a 'hypothesis', so too can a neural 'prediction' - although the latter addresses one particular component of image content (such as 3-dimensional organisation, the interplay between lighting and surface colour, the future trajectory of moving objects, and so on). And, because processing is hierarchical, predictions generated at one level are conveyed in a backward direction to a lower level, seeking to predict, in fact, the neural activity at that prior stage of processing, and learning from errors signalled in the opposite direction. This is the essence of 'predictive coding', at once an algorithm for information processing and a theoretical basis for the nature of operations performed by the cerebral cortex. Neural models for the implementation of predictive coding invoke specific functional classes of neuron for generating, transmitting and receiving predictions, and for producing reciprocal error signals. Also a third general class, 'precision' neurons, tasked with regulating the magnitude of error signals contingent upon the confidence placed upon the prediction, i.e., the reliability and behavioural utility of the sensory data that it predicts. So, what is the ultimate source of a 'prediction'? The answer is multifactorial: knowledge of the current environmental context and the immediate past, allied to memory and lifetime experience of the way of the world, doubtless fine-tuned by evolutionary history too. There are, in consequence, numerous potential avenues for experimenters seeking to manipulate subjects' expectation, and examine the neural signals elicited by surprising, and less surprising visual stimuli. This review focuses upon the predictive physiology of mouse and monkey visual cortex, summarising and commenting on evidence to date, and placing it in the context of the broader field. It is concluded that predictive coding has a firm grounding in basic neuroscience and that, unsurprisingly, there remains much to learn.

Cellular and laminar architecture: A short history and commentary

The feedforward/feedback classification, as originally stated in relation to early visual areas in the macaque monkey, has had a significant influence on ideas of laminar interactions, area reciprocity, and cortical hierarchical organization. In some contrast with this macroscale "laminar connectomics," a more cellular approach to cortical connections, as briefly surveyed here, points to a still underappreciated heterogeneity of neuronal subtypes and complex microcircuitries. From the perspective of heterogeneities, the question of how brain regions interact and influence each other quickly leads to discussions about concurrent hierarchical and nonhierarchical cortical features, brain organization as a multiscale system forming nested groups and hierarchies, connectomes annotated by multiple biological attributes, and interleaved and overlapping scales of organization.

Layer 1 of somatosensory cortex: an important site for input to a tiny cortical compartment

Neocortical layer 1 has been proposed to be at the center for top-down and bottom-up integration. It is a locus for interactions between long-range inputs, layer 1 interneurons, and apical tuft dendrites of pyramidal neurons. While input to layer 1 has been studied intensively, the level and effect of input to this layer has still not been completely characterized. Here we examined the input to layer 1 of mouse somatosensory cortex with retrograde tracing and optogenetics. Our assays reveal that local input to layer 1 is predominantly from layers 2/3 and 5 pyramidal neurons and interneurons, and that subtypes of local layers 5 and 6b neurons project to layer 1 with different probabilities. Long-range input from sensory-motor cortices to layer 1 of somatosensory cortex arose predominantly from layers 2/3 neurons. Our optogenetic experiments showed that intra-telencephalic layer 5 pyramidal neurons drive layer 1 interneurons but have no effect locally on layer 5 apical tuft dendrites. Dual retrograde tracing revealed that a fraction of local and long-range neurons was both presynaptic to layer 5 neurons and projected to layer 1. Our work highlights the prominent role of local inputs to layer 1 and shows the potential for complex interactions between long-range and local inputs, which are both in position to modify the output of somatosensory cortex.

The regional variation of laminar thickness in the human isocortex is related to cortical hierarchy and interregional connectivity

The human isocortex consists of tangentially organized layers with unique cytoarchitectural properties. These layers show spatial variations in thickness and cytoarchitecture across the neocortex, which is thought to support function through enabling targeted corticocortical connections. Here, leveraging maps of the 6 cortical layers based on 3D human brain histology, we aimed to quantitatively characterize the systematic covariation of laminar structure in the cortex and its functional consequences. After correcting for the effect of cortical curvature, we identified a spatial pattern of changes in laminar thickness covariance from lateral frontal to posterior occipital regions, which differentiated the dominance of infra- versus supragranular layer thickness. Corresponding to the laminar regularities of cortical connections along cortical hierarchy, the infragranular-dominant pattern of laminar thickness was associated with higher hierarchical positions of regions, mapped based on resting-state effective connectivity in humans and tract-tracing of structural connections in macaques. Moreover, we show that regions with similar laminar thickness patterns have a higher likelihood of structural connections and strength of functional connections. In sum, here we characterize the organization of laminar thickness in the human isocortex and its association with cortico-cortical connectivity, illustrating how laminar organization may provide a foundational principle of cortical function.

New Challenges for Anatomists in the Era of Omics

Anatomic studies have traditionally relied on macroscopic, microscopic, and histological techniques to investigate the structure of tissues and organs. Anatomic studies are essential in many fields, including medicine, biology, and veterinary science. Advances in technology, such as imaging techniques and molecular biology, continue to provide new insights into the anatomy of living organisms. Therefore, anatomy remains an active and important area in the scientific field. The consolidation in recent years of some omics technologies such as genomics, transcriptomics, proteomics, and metabolomics allows for a more complete and detailed understanding of the structure and function of cells, tissues, and organs. These have been joined more recently by "omics" such as radiomics, pathomics, and connectomics, supported by computer-assisted technologies such as neural networks, 3D bioprinting, and artificial intelligence. All these new tools, although some are still in the early stages of development, have the potential to strongly contribute to the macroscopic and microscopic characterization in medicine. For anatomists, it is time to hitch a ride and get on board omics technologies to sail to new frontiers and to explore novel scenarios in anatomy.

Identification of interacting neural populations: methods and statistical considerations

As improved recording technologies have created new opportunities for neurophysiological investigation, emphasis has shifted from individual neurons to multiple populations that form circuits, and it has become important to provide evidence of cross-population coordinated activity. We review various methods for doing so, placing them in six major categories while avoiding technical descriptions and instead focusing on high-level motivations and concerns. Our aim is to indicate what the methods can achieve and the circumstances under which they are likely to succeed. Toward this end, we include a discussion of four cross-cutting issues: the definition of neural populations, trial-to-trial variability and Poisson-like noise, time-varying dynamics, and causality.

Spatially heterogeneous structure-function coupling in haemodynamic and electromagnetic brain networks

The relationship between structural and functional connectivity in the brain is a key question in connectomics. Here we quantify patterns of structure-function coupling across the neocortex, by comparing structural connectivity estimated using diffusion MRI with functional connectivity estimated using both neurophysiological (MEG-based) and haemodynamic (fMRI-based) recordings. We find that structure-function coupling is heterogeneous across brain regions and frequency bands. The link between structural and functional connectivity is generally stronger in multiple MEG frequency bands compared to resting state fMRI. Structure-function coupling is greater in slower and intermediate frequency bands compared to faster frequency bands. We also find that structure-function coupling systematically follows the archetypal sensorimotor-association hierarchy, as well as patterns of laminar differentiation, peaking in granular layer IV. Finally, structure-function coupling is better explained using structure-informed inter-regional communication metrics than using structural connectivity alone. Collectively, these results place neurophysiological and haemodynamic structure-function relationships in a common frame of reference and provide a starting point for a multi-modal understanding of structure-function coupling in the brain.

A transthalamic pathway crucial for perception

Perception arises from activity between cortical areas, first primary cortex and then higher order cortices. This communication is served in part by transthalamic (cortico-thalamo-cortical) pathways, which ubiquitously parallel direct corticocortical pathways, but their role in sensory processing has largely remained unexplored. Here, we show that the transthalamic pathway linking somatosensory cortices propagates task-relevant information required for correct sensory decisions. Using optogenetics, we specifically inhibited the pathway at its synapse in higher order somatosensory thalamus of mice performing a texture-based discrimination task. We concurrently monitored the cellular effects of inhibition in primary or secondary cortex using two-photon calcium imaging. Inhibition severely impaired performance despite intact direct corticocortical projections, thus challenging the purely corticocentric map of perception. Interestingly, the inhibition did not reduce overall cell responsiveness to texture stimulation in somatosensory cortex, but rather disrupted the texture selectivity of cells, a discriminability that develops over task learning. This discriminability was more disrupted in the secondary than primary somatosensory cortex, emphasizing the feedforward influence of the transthalamic route. Transthalamic pathways thus appear critical in delivering performance-relevant information to higher order cortex and are critical hierarchical pathways in perceptual decision-making.

Atypical connectome topography and signal flow in temporal lobe epilepsy

Temporal lobe epilepsy (TLE) is one of the most common pharmaco-resistant epilepsies in adults. While hippocampal pathology is the hallmark of this condition, emerging evidence indicates that brain alterations extend beyond the mesiotemporal epicenter and affect macroscale brain function and cognition. We studied macroscale functional reorganization in TLE, explored structural substrates, and examined cognitive associations. We investigated a multisite cohort of 95 patients with pharmaco-resistant TLE and 95 healthy controls using state-of-the-art multimodal 3T magnetic resonance imaging (MRI). We quantified macroscale functional topographic organization using connectome dimensionality reduction techniques and estimated directional functional flow using generative models of effective connectivity. We observed atypical functional topographies in patients with TLE relative to controls, manifesting as reduced functional differentiation between sensory/motor networks and transmodal systems such as the default mode network, with peak alterations in bilateral temporal and ventromedial prefrontal cortices. TLE-related topographic changes were consistent in all three included sites and reflected reductions in hierarchical flow patterns between cortical systems. Integration of parallel multimodal MRI data indicated that these findings were independent of TLE-related cortical grey matter atrophy, but mediated by microstructural alterations in the superficial white matter immediately beneath the cortex. The magnitude of functional perturbations was robustly associated with behavioral markers of memory function. Overall, this work provides converging evidence for macroscale functional imbalances, contributing microstructural alterations, and their associations with cognitive dysfunction in TLE.

Nothing in evolution makes sense except in the light of code biology

This article highlights the potential contribution of biological codes to the course and dynamics of evolution. The concept of organic codes, developed by Marcello Barbieri, has fundamentally changed our view of how living systems function. The notion that molecular interactions built on adaptors that arbitrarily link molecules from different "worlds" in a conventional, i.e., rule-based way, departs significantly from the law-based constraints imposed on livening things by physical and chemical mechanisms. In other words, living and non-living things behave like rules and laws, respectively, but this important distinction is rarely considered in current evolutionary theory. The many known codes allow quantification of codes that relate to a cell, or comparisons between different biological systems and may pave the way to a quantitative and empirical research agenda in code biology. A starting point for such an endeavour is the introduction of a simple dichotomous classification of structural and regulatory codes. This classification can be used as a tool to analyse and quantify key organising principles of the living world, such as modularity, hierarchy, and robustness, based on organic codes. The implications for evolutionary research are related to the unique dynamics of codes, or ´Eigendynamics´ (self-momentum) and how they determine the behaviour of biological systems from within, whereas physical constraints are imposed mainly from without. A speculation on the drivers of macroevolution in light of codes is followed by the conclusion that a meaningful and comprehensive understanding of evolution depends including codes into the equation of life.

Feedback information sharing in the human brain reflects bistable perception in the absence of report

In the search for the neural basis of conscious experience, perception and the cognitive processes associated with reporting perception are typically confounded as neural activity is recorded while participants explicitly report what they experience. Here, we present a novel way to disentangle perception from report using eye movement analysis techniques based on convolutional neural networks and neurodynamical analyses based on information theory. We use a bistable visual stimulus that instantiates two well-known properties of conscious perception: integration and differentiation. At any given moment, observers either perceive the stimulus as one integrated unitary object or as two differentiated objects that are clearly distinct from each other. Using electroencephalography, we show that measures of integration and differentiation based on information theory closely follow participants' perceptual experience of those contents when switches were reported. We observed increased information integration between anterior to posterior electrodes (front to back) prior to a switch to the integrated percept, and higher information differentiation of anterior signals leading up to reporting the differentiated percept. Crucially, information integration was closely linked to perception and even observed in a no-report condition when perceptual transitions were inferred from eye movements alone. In contrast, the link between neural differentiation and perception was observed solely in the active report condition. Our results, therefore, suggest that perception and the processes associated with report require distinct amounts of anterior-posterior network communication and anterior information differentiation. While front-to-back directed information is associated with changes in the content of perception when viewing bistable visual stimuli, regardless of report, frontal information differentiation was absent in the no-report condition and therefore is not directly linked to perception per se.

Principles of large-scale neural interactions

What mechanisms underlie flexible inter-areal communication in the cortex? We consider four mechanisms for temporal coordination and their contributions to communication: (1) Oscillatory synchronization (communication-through-coherence); (2) communication-through-resonance; (3) non-linear integration; and (4) linear signal transmission (coherence-through-communication). We discuss major challenges for communication-through-coherence based on layer- and cell-type-specific analyses of spike phase-locking, heterogeneity of dynamics across networks and states, and computational models for selective communication. We argue that resonance and non-linear integration are viable alternative mechanisms that facilitate computation and selective communication in recurrent networks. Finally, we consider communication in relation to cortical hierarchy and critically examine the hypothesis that feedforward and feedback communication use fast (gamma) and slow (alpha/beta) frequencies, respectively. Instead, we propose that feedforward propagation of prediction errors relies on the non-linear amplification of aperiodic transients, whereas gamma and beta rhythms represent rhythmic equilibrium states that facilitate sustained and efficient information encoding and amplification of short-range feedback via resonance.

Ensuring wholeness: Using Code Biology to overcome the autonomy-heteronomy divide

This paper presents an alternative to Autopoietic Enactivism in the form of a Code Biology-informed account on human sense-making. It demonstrates the possibility of avoiding a dualism between, on the one hand, the autonomy of individual sense-makers and, on the other, the heteronomy of social facts. This is possible because code biological principles are pertinent to different levels of biological and non-biological organization and cut across the organismic self-non-self border. Analytically, one can maintain the overall integrity of an agent as a separable unit of (inter)action while also avoiding an autonomy-heteronomy divide. We therefore emphasise the constitutive role of codified relations that, while irreducible to operational closure, connect the sense-making agent's social interactions to those of other agents. The move grants a central, constitutive role to external norms (or, heteronomy) as altering the internal, embodied integrity of an autonomous agent. Drawing on the case of prosthetics use in amputees, we show that successful integration of a prothesis cannot be reduced to the substitution of a missing limb. Rather, it demands experienced bodily wholeness on the part of the agent which can only be achieved by attuning and adapting to use of a prosthesis while also internalizing social norms and values. It is concluded that many aspects of the living actualize codified relations which incorporate both heteronomous and autonomous traits.

Asymmetric signaling across the hierarchy of cytoarchitecture within the human connectome

Cortical variations in cytoarchitecture form a sensory-fugal axis that shapes regional profiles of extrinsic connectivity and is thought to guide signal propagation and integration across the cortical hierarchy. While neuroimaging work has shown that this axis constrains local properties of the human connectome, it remains unclear whether it also shapes the asymmetric signaling that arises from higher-order topology. Here, we used network control theory to examine the amount of energy required to propagate dynamics across the sensory-fugal axis. Our results revealed an asymmetry in this energy, indicating that bottom-up transitions were easier to complete compared to top-down. Supporting analyses demonstrated that asymmetries were underpinned by a connectome topology that is wired to support efficient bottom-up signaling. Lastly, we found that asymmetries correlated with differences in communicability and intrinsic neuronal time scales and lessened throughout youth. Our results show that cortical variation in cytoarchitecture may guide the formation of macroscopic connectome topology.

The inevitable inequality of cortical columns

The idea of columns as an organizing cortical unit emerged from physiologic studies in the sensory systems. Connectional studies and molecular markers pointed to widespread presence of modular label that necessitated revision of the classical concept of columns. The general principle of cortical systematic variation in laminar structure is at the core of cortical organization. Systematic variation can be traced to the phylogenetically ancient limbic cortices, which have the simplest laminar structure, and continues through eulaminate cortices that show sequential elaboration of their six layers. Connections are governed by relational rules, whereby columns or modules with a vertical organization represent the feedforward mode of communication from earlier- to later processing cortices. Conversely, feedback connections are laminar-based and connect later- with earlier processing areas; both patterns are established in development. Based on studies in primates, the columnar/modular pattern of communication appears to be newer in evolution, while the broadly based laminar pattern represents an older system. The graded variation of cortices entails a rich variety of patterns of connections into modules, layers, and mixed arrangements as the laminar and modular patterns of communication intersect in the cortex. This framework suggests an ordered architecture poised to facilitate seamless recruitment of areas in behavior, in patterns that are affected in diseases of developmental origin.

Theory of the Multiregional Neocortex: Large-Scale Neural Dynamics and Distributed Cognition

The neocortex is a complex neurobiological system with many interacting regions. How these regions work together to subserve flexible behavior and cognition has become increasingly amenable to rigorous research. Here, I review recent experimental and theoretical work on the modus operandi of a multiregional cortex. These studies revealed several general principles for the neocortical interareal connectivity, low-dimensional macroscopic gradients of biological properties across cortical areas, and a hierarchy of timescales for information processing. Theoretical work suggests testable predictions regarding differential excitation and inhibition along feedforward and feedback pathways in the cortical hierarchy. Furthermore, modeling of distributed working memory and simple decision-making has given rise to a novel mathematical concept, dubbed bifurcation in space, that potentially explains how different cortical areas, with a canonical circuit organization but gradients of biological heterogeneities, are able to subserve their respective (e.g., sensory coding versus executive control) functions in a modularly organized brain.

Twenty years of investigation with the case of prosopagnosia PS to understand human face identity recognition. Part II: Neural basis

Patient PS sustained her dramatic brain injury in 1992, the same year as the first report of a neuroimaging study of human face recognition. The present paper complements the review on the functional nature of PS's prosopagnosia (part I), illustrating how her case study directly, i.e., through neuroimaging investigations of her brain structure and activity, but also indirectly, through neural studies performed on other clinical cases and neurotypical individuals, inspired and constrained neural models of human face recognition. In the dominant right hemisphere for face recognition in humans, PS's main lesion concerns (inputs to) the inferior occipital gyrus (IOG), in a region where face-selective activity is typically found in normal individuals ('Occipital Face Area', OFA). Her case study initially supported the criticality of this region for face identity recognition (FIR) and provided the impetus for transcranial magnetic stimulation (TMS), intracerebral electrical stimulation, and cortical surgery studies that have generally supported this view. Despite PS's right IOG lesion, typical face-selectivity is found anteriorly in the middle portion of the fusiform gyrus, a hominoid structure (termed the right 'Fusiform Face Area', FFA) that is widely considered to be the most important region for human face recognition. This finding led to the original proposal of direct anatomico-functional connections from early visual cortices to the FFA, bypassing the IOG/OFA (lulu), a hypothesis supported by further neuroimaging studies of PS, other neurological cases and neuro-typical individuals with original visual stimulation paradigms, data recordings and analyses. The proposal of a lack of sensitivity to face identity in PS's right FFA due to defective reentrant inputs from the IOG/FFA has also been supported by other cases, functional connectivity and cortical surgery studies. Overall, neural studies of, and based on, the case of prosopagnosia PS strongly question the hierarchical organization of the human neural face recognition system, supporting a more flexible and dynamic view of this key social brain function.

Dendritic Domain-Specific Sampling of Long-Range Axons Shapes Feedforward and Feedback Connectivity of L5 Neurons

Feedforward and feedback pathways interact in specific dendritic domains to enable cognitive functions such as predictive processing and learning. Based on axonal projections, hierarchically lower areas are thought to form synapses primarily on dendrites in middle cortical layers, whereas higher-order areas are thought to target dendrites in layer 1 and in deep layers. However, the extent to which functional synapses form in regions of axodendritic overlap has not been extensively studied. Here, we use viral tracing in the secondary visual cortex of male mice to map brain-wide inputs to thick-tufted layer 5 pyramidal neurons. Furthermore, we provide a comprehensive map of input locations through subcellular optogenetic circuit mapping. We show that input pathways target distinct dendritic domains with far greater specificity than appears from their axonal branching, often deviating substantially from the canonical patterns. Common assumptions regarding the dendrite-level interaction of feedforward and feedback inputs may thus need revisiting.SIGNIFICANCE STATEMENT Perception and learning depend on the ability of the brain to shape neuronal representations across all processing stages. Long-range connections across different hierarchical levels enable diverse sources of contextual information, such as predictions or motivational state, to modify feedforward signals. Assumptions regarding the organization of this hierarchical connectivity have not been extensively verified. Here, we assess the synaptic connectivity of brain-wide projections onto pyramidal neurons in the visual cortex of mice. Using trans-synaptic viral tracing and subcellular optogenetic circuit mapping, we show that functional synapses do not follow the consistent connectivity rule predicted by their axonal branching patterns. These findings highlight the diversity of computational strategies operating throughout cortical networks and may aid in building better artificial networks.

Deficient Recurrent Cortical Processing in Congenital Deafness

The influence of sensory experience on cortical feedforward and feedback interactions has rarely been studied in the auditory cortex. Previous work has documented a dystrophic effect of deafness in deep cortical layers, and a reduction of interareal couplings between primary and secondary auditory areas in congenital deafness which was particularly pronounced in the top-down direction (from the secondary to the primary area). In the present study, we directly quantified the functional interaction between superficial (supragranular, I to III) and deep (infragranular, V and VI) layers of feline’s primary auditory cortex A1, and also between superficial/deep layers of A1 and a secondary auditory cortex, namely the posterior auditory field (PAF). We compared adult hearing cats under acoustic stimulation and cochlear implant (CI) stimulation to adult congenitally deaf cats (CDC) under CI stimulation. Neuronal activity was recorded from auditory fields A1 and PAF simultaneously with two NeuroNexus electrode arrays. We quantified the spike field coherence (i.e., the statistical dependence of spike trains at one electrode with local field potentials on another electrode) using pairwise phase consistency (PPC). Both the magnitude as well as the preferred phase of synchronization was analyzed. The magnitude of PPC was significantly smaller in CDCs than in controls. Furthermore, controls showed no significant difference between the preferred phase of synchronization between supragranular and infragranular layers, both in acoustic and electric stimulation. In CDCs, however, there was a large difference in the preferred phase between supragranular and infragranular layers. These results demonstrate a loss of synchrony and for the first time directly document a functional decoupling of the interaction between supragranular and infragranular layers of the primary auditory cortex in congenital deafness. Since these are key for the influence of top-down to bottom-up computations, the results suggest a loss of recurrent cortical processing in congenital deafness and explain the outcomes of previous studies by deficits in intracolumnar microcircuitry.

Hierarchical and nonhierarchical features of the mouse visual cortical network

Neocortical computations underlying vision are performed by a distributed network of functionally specialized areas. Mouse visual cortex, a dense interareal network that exhibits hierarchical properties, comprises subnetworks interconnecting distinct processing streams. To determine the layout of the mouse visual hierarchy, we have evaluated the laminar patterns formed by interareal axonal projections originating in each of ten areas. Reciprocally connected pairs of areas exhibit feedforward/feedback relationships consistent with a hierarchical organization. Beta regression analyses, which estimate a continuous hierarchical distance measure, indicate that the network comprises multiple nonhierarchical circuits embedded in a hierarchical organization of overlapping levels. Single-unit recordings in anaesthetized mice show that receptive field sizes are generally consistent with the hierarchy, with the ventral stream exhibiting a stricter hierarchy than the dorsal stream. Together, the results provide an anatomical metric for hierarchical distance, and reveal both hierarchical and nonhierarchical motifs in mouse visual cortex.

Mouse visual cortex is a dense, interconnected network of distinct areas. D’Souza et al. identify an anatomical index to quantify the hierarchical nature of pathways, and highlight the hierarchical and nonhierarchical features of the network.

A mechanism for inter-areal coherence through communication based on connectivity and oscillatory power

Inter-areal coherence between field potentials is a widespread phenomenon in cortex. Coherence has been hypothesized to reflect phase-synchronization between oscillators and flexibly gate communication according to behavioral and cognitive demands. We reveal an alternative mechanism where coherence is not the cause but the consequence of communication and naturally emerges because spiking activity in a sending area causes post-synaptic potentials both in the same and in other areas. Consequently, coherence depends in a lawful manner on power and phase-locking in the sender and connectivity. Changes in oscillatory power explained prominent changes in fronto-parietal and LGN-V1 coherence across behavioral conditions. Optogenetic experiments and excitatory-inhibitory network simulations identified afferent synaptic inputs rather than spiking entrainment as the principal determinant of coherence. These findings suggest that unique spectral profiles of different brain areas automatically give rise to large-scale coherence patterns that follow anatomical connectivity and continuously reconfigure as a function of behavior and cognition.

Functional Segregation within the Dorsal Frontoparietal Network: A Multimodal Dynamic Causal Modeling Study

Discrimination and integration of motion direction requires the interplay of multiple brain areas. Theoretical accounts of perception suggest that stimulus-related (i.e., exogenous) and decision-related (i.e., endogenous) factors affect distributed neuronal processing at different levels of the visual hierarchy. To test these predictions, we measured brain activity of healthy participants during a motion discrimination task, using electroencephalography (EEG) and functional magnetic resonance imaging (fMRI). We independently modeled the impact of exogenous factors (task demand) and endogenous factors (perceptual decision-making) on the activity of the motion discrimination network and applied Dynamic Causal Modeling (DCM) to both modalities. DCM for event-related potentials (DCM-ERP) revealed that task demand impacted the reciprocal connections between the primary visual cortex (V1) and medial temporal areas (V5). With practice, higher visual areas were increasingly involved, as revealed by DCM-fMRI. Perceptual decision-making modulated higher levels (e.g., V5-to-Frontal Eye Fields, FEF), in a manner predictive of performance. Our data suggest that lower levels of the visual network support early, feature-based selection of responses, especially when learning strategies have not been implemented. In contrast, perceptual decision-making operates at higher levels of the visual hierarchy by integrating sensory information with the internal state of the subject.

Anatomical and functional connectomes underlying hierarchical visual processing in mouse visual system

Over the last 10 years, there has been a surge in interest in the rodent visual system resulting from the discovery of visual processing functions shared with primates V1, and of a complex anatomical structure in the extrastriate visual cortex. This surprisingly intricate visual system was elucidated by recent investigations using rapidly growing genetic tools primarily available in the mouse. Here, we examine the structural and functional connections of visual areas that have been identified in mice mostly during the past decade, and the impact of these findings on our understanding of brain functions associated with vision. Special attention is paid to structure-function relationships arising from the hierarchical organization, which is a prominent feature of the primate visual system. Recent evidence supports the existence of a hierarchical organization in rodents that contains levels that are poorly resolved relative to those observed in primates. This shallowness of the hierarchy indicates that the mouse visual system incorporates abundant non-hierarchical processing. Thus, the mouse visual system provides a unique opportunity to study non-hierarchical processing and its relation to hierarchical processing.

A dopamine gradient controls access to distributed working memory in the large-scale monkey cortex

Dopamine is required for working memory, but how it modulates the large-scale cortex is unknown. Here, we report that dopamine receptor density per neuron, measured by autoradiography, displays a macroscopic gradient along the macaque cortical hierarchy. This gradient is incorporated in a connectome-based large-scale cortex model endowed with multiple neuron types. The model captures an inverted U-shaped dependence of working memory on dopamine and spatial patterns of persistent activity observed in over 90 experimental studies. Moreover, we show that dopamine is crucial for filtering out irrelevant stimuli by enhancing inhibition from dendrite-targeting interneurons. Our model revealed that an activity-silent memory trace can be realized by facilitation of inter-areal connections and that adjusting cortical dopamine induces a switch from this internal memory state to distributed persistent activity. Our work represents a cross-level understanding from molecules and cell types to recurrent circuit dynamics underlying a core cognitive function distributed across the primate cortex.

Rare long-range cortical connections enhance human information processing

What are the key topological features of connectivity critically relevant for generating the dynamics underlying efficient cortical function? A candidate feature that has recently emerged is that the connectivity of the mammalian cortex follows an exponential distance rule, which includes a small proportion of long-range high-weight anatomical exceptions to this rule. Whole-brain modeling of large-scale human neuroimaging data in 1,003 participants offers the unique opportunity to create two models, with and without long-range exceptions, and explicitly study their functional consequences. We found that rare long-range exceptions are crucial for significantly improving information processing. Furthermore, modeling in a simplified ring architecture shows that this improvement is greatly enhanced by the turbulent regime found in empirical neuroimaging data. Overall, the results provide strong empirical evidence for the immense functional benefits of long-range exceptions combined with turbulence for information processing.

The Role of Unimodal Feedback Pathways in Gender Perception During Activation of Voice and Face Areas

Cross-modal effects provide a model framework for investigating hierarchical inter-areal processing, particularly, under conditions where unimodal cortical areas receive contextual feedback from other modalities. Here, using complementary behavioral and brain imaging techniques, we investigated the functional networks participating in face and voice processing during gender perception, a high-level feature of voice and face perception. Within the framework of a signal detection decision model, Maximum likelihood conjoint measurement (MLCM) was used to estimate the contributions of the face and voice to gender comparisons between pairs of audio-visual stimuli in which the face and voice were independently modulated. Top–down contributions were varied by instructing participants to make judgments based on the gender of either the face, the voice or both modalities (N = 12 for each task). Estimated face and voice contributions to the judgments of the stimulus pairs were not independent; both contributed to all tasks, but their respective weights varied over a 40-fold range due to top–down influences. Models that best described the modal contributions required the inclusion of two different top–down interactions: (i) an interaction that depended on gender congruence across modalities (i.e., difference between face and voice modalities for each stimulus); (ii) an interaction that depended on the within modalities’ gender magnitude. The significance of these interactions was task dependent. Specifically, gender congruence interaction was significant for the face and voice tasks while the gender magnitude interaction was significant for the face and stimulus tasks. Subsequently, we used the same stimuli and related tasks in a functional magnetic resonance imaging (fMRI) paradigm (N = 12) to explore the neural correlates of these perceptual processes, analyzed with Dynamic Causal Modeling (DCM) and Bayesian Model Selection. Results revealed changes in effective connectivity between the unimodal Fusiform Face Area (FFA) and Temporal Voice Area (TVA) in a fashion that paralleled the face and voice behavioral interactions observed in the psychophysical data. These findings explore the role in perception of multiple unimodal parallel feedback pathways.

Network Path Convergence Shapes Low-Level Processing in the Visual Cortex

Hierarchical counterstream via feedforward and feedback interactions is a major organizing principle of the cerebral cortex. The counterstream, as a topological feature of the network of cortical areas, is captured by the convergence and divergence of paths through directed links. So defined, the convergence degree (CD) reveals the reciprocal nature of forward and backward connections, and also hierarchically relevant integrative properties of areas through their inward and outward connections. We asked if topology shapes large-scale cortical functioning by studying the role of CD in network resilience and Granger causal coupling in a model of hierarchical network dynamics. Our results indicate that topological synchronizability is highly vulnerable to attacking edges based on CD, while global network efficiency depends mostly on edge betweenness, a measure of the connectedness of a link. Furthermore, similar to anatomical hierarchy determined by the laminar distribution of connections, CD highly correlated with causal coupling in feedforward gamma, and feedback alpha-beta band synchronizations in a well-studied subnetwork, including low-level visual cortical areas. In contrast, causal coupling did not correlate with edge betweenness. Considering the entire network, the CD-based hierarchy correlated well with both the anatomical and functional hierarchy for low-level areas that are far apart in the hierarchy. Conversely, in a large part of the anatomical network where hierarchical distances are small between the areas, the correlations were not significant. These findings suggest that CD-based and functional hierarchies are interrelated in low-level processing in the visual cortex. Our results are consistent with the idea that the interplay of multiple hierarchical features forms the basis of flexible functional cortical interactions.

A Canonical Laminar Neocortical Circuit Whose Bottom-Up, Horizontal, and Top-Down Pathways Control Attention, Learning, and Prediction

All perceptual and cognitive circuits in the human cerebral cortex are organized into layers. Specializations of a canonical laminar network of bottom-up, horizontal, and top-down pathways carry out multiple kinds of biological intelligence across different neocortical areas. This article describes what this canonical network is and notes that it can support processes as different as 3D vision and figure-ground perception; attentive category learning and decision-making; speech perception; and cognitive working memory (WM), planning, and prediction. These processes take place within and between multiple parallel cortical streams that obey computationally complementary laws. The interstream interactions that are needed to overcome these complementary deficiencies mix cell properties so thoroughly that some authors have noted the difficulty of determining what exactly constitutes a cortical stream and the differences between streams. The models summarized herein explain how these complementary properties arise, and how their interstream interactions overcome their computational deficiencies to support effective goal-oriented behaviors.

Deafness Weakens Interareal Couplings in the Auditory Cortex

The function of the cerebral cortex essentially depends on the ability to form functional assemblies across different cortical areas serving different functions. Here we investigated how developmental hearing experience affects functional and effective interareal connectivity in the auditory cortex in an animal model with years-long and complete auditory deprivation (deafness) from birth, the congenitally deaf cat (CDC). Using intracortical multielectrode arrays, neuronal activity of adult hearing controls and CDCs was registered in the primary auditory cortex and the secondary posterior auditory field (PAF). Ongoing activity as well as responses to acoustic stimulation (in adult hearing controls) and electric stimulation applied via cochlear implants (in adult hearing controls and CDCs) were analyzed. As functional connectivity measures pairwise phase consistency and Granger causality were used. While the number of coupled sites was nearly identical between controls and CDCs, a reduced coupling strength between the primary and the higher order field was found in CDCs under auditory stimulation. Such stimulus-related decoupling was particularly pronounced in the alpha band and in top–down direction. Ongoing connectivity did not show such a decoupling. These findings suggest that developmental experience is essential for functional interareal interactions during sensory processing. The outcomes demonstrate that corticocortical couplings, particularly top-down connectivity, are compromised following congenital sensory deprivation.

Brain connectomes come of age

Databases of consistent, directed- and weighted inter-areal connectivity for mouse, macaque and marmoset monkeys have recently become available and begun to be used to build structural and dynamical models. A structural hierarchy can be defined based by laminar patterns of cortical connections. A large-scale dynamical model of the macaque cortex endowed with a laminar structure accounts for empirically observed frequency-modulated interplay between bottom-up and top-down processes. Signal propagation in the model with spiking neurons displays a threshold of stimulus amplitude for the activity to gain access to the prefrontal cortex, reminiscent of the ignition phenomenon associated with conscious perception. These two examples illustrate how connectomics inform structurally based dynamic models of multi-regional brain systems. Theory raises novel questions for future anatomical and physiological empirical research, in a back-and-forth collaboration between experimentalists and theorists. Directed- and weighted inter-areal cortical connectivity matrices of macaque, marmoset and mouse exhibit similarities as well as marked differences. The new connectomic data provide quantitative information for structural and dynamical modeling of multi-regional cortical circuit providing insight to the global cortical function. Quantification of cortical hierarchy guides investigations of interplay between bottom-up and top-down information processes.