Developmental self-construction and -configuration of functional neocortical neuronal networks

Adaptive rewiring: a general principle for neural network development

The nervous system, especially the human brain, is characterized by its highly complex network topology. The neurodevelopment of some of its features has been described in terms of dynamic optimization rules. We discuss the principle of adaptive rewiring, i.e., the dynamic reorganization of a network according to the intensity of internal signal communication as measured by synchronization or diffusion, and its recent generalization for applications in directed networks. These have extended the principle of adaptive rewiring from highly oversimplified networks to more neurally plausible ones. Adaptive rewiring captures all the key features of the complex brain topology: it transforms initially random or regular networks into networks with a modular small-world structure and a rich-club core. This effect is specific in the sense that it can be tailored to computational needs, robust in the sense that it does not depend on a critical regime, and flexible in the sense that parametric variation generates a range of variant network configurations. Extreme variant networks can be associated at macroscopic level with disorders such as schizophrenia, autism, and dyslexia, and suggest a relationship between dyslexia and creativity. Adaptive rewiring cooperates with network growth and interacts constructively with spatial organization principles in the formation of topographically distinct modules and structures such as ganglia and chains. At the mesoscopic level, adaptive rewiring enables the development of functional architectures, such as convergent-divergent units, and sheds light on the early development of divergence and convergence in, for example, the visual system. Finally, we discuss future prospects for the principle of adaptive rewiring.

Calibration of stochastic, agent-based neuron growth models with approximate Bayesian computation

Understanding how genetically encoded rules drive and guide complex neuronal growth processes is essential to comprehending the brain's architecture, and agent-based models (ABMs) offer a powerful simulation approach to further develop this understanding. However, accurately calibrating these models remains a challenge. Here, we present a novel application of Approximate Bayesian Computation (ABC) to address this issue. ABMs are based on parametrized stochastic rules that describe the time evolution of small components-the so-called agents-discretizing the system, leading to stochastic simulations that require appropriate treatment. Mathematically, the calibration defines a stochastic inverse problem. We propose to address it in a Bayesian setting using ABC. We facilitate the repeated comparison between data and simulations by quantifying the morphological information of single neurons with so-called morphometrics and resort to statistical distances to measure discrepancies between populations thereof. We conduct experiments on synthetic as well as experimental data. We find that ABC utilizing Sequential Monte Carlo sampling and the Wasserstein distance finds accurate posterior parameter distributions for representative ABMs. We further demonstrate that these ABMs capture specific features of pyramidal cells of the hippocampus (CA1). Overall, this work establishes a robust framework for calibrating agent-based neuronal growth models and opens the door for future investigations using Bayesian techniques for model building, verification, and adequacy assessment.

Retinal self-organization: a model of retinal ganglion cells and starburst amacrine cells mosaic formation

Individual retinal cell types exhibit semi-regular spatial patterns called retinal mosaics. Retinal ganglion cells (RGCs) and starburst amacrine cells (SACs) are known to exhibit such layouts. Mechanisms responsible for the formation of mosaics are not well understood but follow three main principles: (i) homotypic cells prevent nearby cells from adopting the same type, (ii) cell tangential migration and (iii) cell death. Alongside experiments in mouse, we use BioDynaMo, an agent-based simulation framework, to build a detailed and mechanistic model of mosaic formation. We investigate the implications of the three theories for RGC's mosaic formation. We report that the cell migration mechanism yields the most regular mosaics. In addition, we propose that low-density RGC type mosaics exhibit on average low regularities, and thus we question the relevance of regular spacing as a criterion for a group of RGCs to form a RGC type. We investigate SAC mosaics formation and interactions between the ganglion cell layer (GCL) and inner nuclear layer (INL) populations. We propose that homotypic interactions between the GCL and INL populations during mosaics creation are required to reproduce the observed SAC mosaics' characteristics. This suggests that the GCL and INL populations of SACs might not be independent during retinal development.

Creative Destruction: A Basic Computational Model of Cortical Layer Formation

One of the most characteristic properties of many vertebrate neural systems is the layered organization of different cell types. This cytoarchitecture exists in the cortex, the retina, the hippocampus, and many other parts of the central nervous system. The developmental mechanisms of neural layer formation have been subject to substantial experimental efforts. Here, we provide a general computational model for cortical layer formation in 3D physical space. We show that this multiscale, agent-based model, comprising two distinct stages of apoptosis, can account for the wide range of neuronal numbers encountered in different cortical areas and species. Our results demonstrate the phenotypic richness of a basic state diagram structure. Importantly, apoptosis allows for changing the thickness of one layer without automatically affecting other layers. Therefore, apoptosis increases the flexibility for evolutionary change in layer architecture. Notably, slightly changed gene regulatory dynamics recapitulate the characteristic properties observed in neurodevelopmental diseases. Overall, we propose a novel computational model using gene-type rules, exhibiting many characteristics of normal and pathological cortical development.

Adaptive Rewiring in Weighted Networks Shows Specificity, Robustness, and Flexibility

Brain network connections rewire adaptively in response to neural activity. Adaptive rewiring may be understood as a process which, at its every step, is aimed at optimizing the efficiency of signal diffusion. In evolving model networks, this amounts to creating shortcut connections in regions with high diffusion and pruning where diffusion is low. Adaptive rewiring leads over time to topologies akin to brain anatomy: small worlds with rich club and modular or centralized structures. We continue our investigation of adaptive rewiring by focusing on three desiderata: specificity of evolving model network architectures, robustness of dynamically maintained architectures, and flexibility of network evolution to stochastically deviate from specificity and robustness. Our adaptive rewiring model simulations show that specificity and robustness characterize alternative modes of network operation, controlled by a single parameter, the rewiring interval. Small control parameter shifts across a critical transition zone allow switching between the two modes. Adaptive rewiring exhibits greater flexibility for skewed, lognormal connection weight distributions than for normally distributed ones. The results qualify adaptive rewiring as a key principle of self-organized complexity in network architectures, in particular of those that characterize the variety of functional architectures in the brain.

The growth of cognition: Free energy minimization and the embryogenesis of cortical computation

The assumption that during cortical embryogenesis neurons and synaptic connections are selected to form an ensemble maximising synchronous oscillation explains mesoscopic cortical development, and a mechanism for cortical information processing is implied by consistency with the Free Energy Principle and Dynamic Logic. A heteroclinic network emerges, with stable and unstable fixed points of oscillation corresponding to activity in symmetrically connected, versus asymmetrically connected, sets of neurons. Simulations of growth explain a wide range of anatomical observations for columnar and non-columnar cortex, superficial patch connections, and the organization and dynamic interactions of neurone response properties. An antenatal scaffold is created, upon which postnatal learning can establish continuously ordered neuronal representations, permitting matching of co-synchronous fields in multiple cortical areas to solve optimization problems as in Dynamic Logic. Fast synaptic competition partitions equilibria, minimizing "the curse of dimensionality", while perturbations between imperfectly partitioned synchronous fields, under internal reinforcement, enable the cortex to become adaptively self-directed. As learning progresses variational free energy is minimized and entropy bounded.

Adaptive rewiring evolves brain-like structure in weighted networks

Activity-dependent plasticity refers to a range of mechanisms for adaptively reshaping neuronal connections. We model their common principle in terms of adaptive rewiring of network connectivity, while representing neural activity by diffusion on the network: Where diffusion is intensive, shortcut connections are established, while underused connections are pruned. In binary networks, this process is known to steer initially random networks robustly to high levels of structural complexity, reflecting the global characteristics of brain anatomy: modular or centralized small world topologies. We investigate whether this result extends to more realistic, weighted networks. Both normally- and lognormally-distributed weighted networks evolve either modular or centralized topologies. Which of these prevails depends on a single control parameter, representing global homeostatic or normalizing regulation mechanisms. Intermediate control parameter values exhibit the greatest levels of network complexity, incorporating both modular and centralized tendencies. The simulation results allow us to propose diffusion based adaptive rewiring as a parsimonious model for activity-dependent reshaping of brain connectivity structure.

A generative growth model for thalamocortical axonal branching in primary visual cortex

Axonal morphology displays large variability and complexity, yet the canonical regularities of the cortex suggest that such wiring is based on the repeated initiation of a small set of genetically encoded rules. Extracting underlying developmental principles can hence shed light on what genetically encoded instructions must be available during cortical development. Within a generative model, we investigate growth rules for axonal branching patterns in cat area 17, originating from the lateral geniculate nucleus of the thalamus. This target area of synaptic connections is characterized by extensive ramifications and a high bouton density, characteristics thought to preserve the spatial resolution of receptive fields and to enable connections for the ocular dominance columns. We compare individual and global statistics, such as a newly introduced length-weighted asymmetry index and the global segment-length distribution, of generated and biological branching patterns as the benchmark for growth rules. We show that the proposed model surpasses the statistical accuracy of the Galton-Watson model, which is the most commonly employed model for biological growth processes. In contrast to the Galton-Watson model, our model can recreate the log-normal segment-length distribution of the experimental dataset and is considerably more accurate in recreating individual axonal morphologies. To provide a biophysical interpretation for statistical quantifications of the axonal branching patterns, the generative model is ported into the physically accurate simulation framework of Cx3D. In this 3D simulation environment we demonstrate how the proposed growth process can be formulated as an interactive process between genetic growth rules and chemical cues in the local environment.

The search of "canonical" explanations for the cerebral cortex

This paper addresses a fundamental line of research in neuroscience: the identification of a putative neural processing core of the cerebral cortex, often claimed to be "canonical". This "canonical" core would be shared by the entire cortex, and would explain why it is so powerful and diversified in tasks and functions, yet so uniform in architecture. The purpose of this paper is to analyze the search for canonical explanations over the past 40 years, discussing the theoretical frameworks informing this research. It will highlight a bias that, in my opinion, has limited the success of this research project, that of overlooking the dimension of cortical development. The earliest explanation of the cerebral cortex as canonical was attempted by David Marr, deriving putative cortical circuits from general mathematical laws, loosely following a deductive-nomological account. Although Marr's theory turned out to be incorrect, one of its merits was to have put the issue of cortical circuit development at the top of his agenda. This aspect has been largely neglected in much of the research on canonical models that has followed. Models proposed in the 1980s were conceived as mechanistic. They identified a small number of components that interacted as a basic circuit, with each component defined as a function. More recent models have been presented as idealized canonical computations, distinct from mechanistic explanations, due to the lack of identifiable cortical components. Currently, the entire enterprise of coming up with a single canonical explanation has been criticized as being misguided, and the premise of the uniformity of the cortex has been strongly challenged. This debate is analyzed here. The legacy of the canonical circuit concept is reflected in both positive and negative ways in recent large-scale brain projects, such as the Human Brain Project. One positive aspect is that these projects might achieve the aim of producing detailed simulations of cortical electrical activity, a negative one regards whether they will be able to find ways of simulating how circuits actually develop.

Mechanisms of Connectome Development

At the centenary of D'Arcy Thompson's seminal work 'On Growth and Form', pioneering the description of principles of morphological changes during development and evolution, recent experimental advances allow us to study change in anatomical brain networks. Here, we outline potential principles for connectome development. We will describe recent results on how spatial and temporal factors shape connectome development in health and disease. Understanding the developmental origins of brain diseases in individuals will be crucial for deciding on personalized treatment options. We argue that longitudinal studies, experimentally derived parameters for connection formation, and biologically realistic computational models are needed to better understand the link between brain network development, network structure, and network function.

Nonlinear growth: an origin of hub organization in complex networks

Many real-world networks contain highly connected nodes called hubs. Hubs are often crucial for network function and spreading dynamics. However, classical models of how hubs originate during network development unrealistically assume that new nodes attain information about the connectivity (for example the degree) of existing nodes. Here, we introduce hub formation through nonlinear growth where the number of nodes generated at each stage increases over time and new nodes form connections independent of target node features. Our model reproduces variation in number of connections, hub occurrence time, and rich-club organization of networks ranging from protein-protein, neuronal and fibre tract brain networks to airline networks. Moreover, nonlinear growth gives a more generic representation of these networks compared with previous preferential attachment or duplication-divergence models. Overall, hub creation through nonlinear network expansion can serve as a benchmark model for studying the development of many real-world networks.

The BioDynaMo Project

Computer simulations have become a very powerful tool for scientific research. Given the vast complexity that comes with many open scientific questions, a purely analytical or experimental approach is often not viable. For example, biological systems comprise an extremely complex organization and heterogeneous interactions across different spatial and temporal scales. In order to facilitate research on such problems, the BioDynaMo project aims at a general platform for computer simulations for biological research. Since scientific investigations require extensive computer resources, this platform should be executable on hybrid cloud computing systems, allowing for the efficient use of state-of-the-art computing technology. This chapter describes challenges during the early stages of the software development process. In particular, we describe issues regarding the implementation and the highly interdisciplinary as well as international nature of the collaboration. Moreover, we explain the methodologies, the approach, and the lessons learned by the team during these first stages.

Biomaterials and computation: a strategic alliance to investigate emergent responses of neural cells

Synergistic use of biomaterials and computation allows to identify and unravel neural cell responses.

Further Work on the Shaping of Cortical Development and Function by Synchrony and Metabolic Competition

This paper furthers our attempts to resolve two major controversies-whether gamma synchrony plays a role in cognition, and whether cortical columns are functionally important. We have previously argued that the configuration of cortical cells that emerges in development is that which maximizes the magnitude of synchronous oscillation and minimizes metabolic cost. Here we analyze the separate effects in development of minimization of axonal lengths, and of early Hebbian learning and selective distribution of resources to growing synapses, by showing in simulations that these effects are partially antagonistic, but their interaction during development produces accurate anatomical and functional properties for both columnar and non-columnar cortex. The resulting embryonic anatomical order can provide a cortex-wide scaffold for postnatal learning that is dimensionally consistent with the representation of moving sensory objects, and, as learning progressively overwrites the embryonic order, further associations also occur in a dimensionally consistent framework. The role ascribed to cortical synchrony does not demand specific frequency, amplitude or phase variation of pulses to mediate "feature linking." Instead, the concerted interactions of pulse synchrony with short-term synaptic dynamics, and synaptic resource competition can further explain cortical information processing in analogy to Hopfield networks and quantum computation.

The effect of the neural activity on topological properties of growing neural networks

The connectivity structure in cortical networks defines how information is transmitted and processed, and it is a source of the complex spatiotemporal patterns of network's development, and the process of creation and deletion of connections is continuous in the whole life of the organism. In this paper, we study how neural activity influences the growth process in neural networks. By using a two-dimensional activity-dependent growth model we demonstrated the neural network growth process from disconnected neurons to fully connected networks. For making quantitative investigation of the network's activity influence on its topological properties we compared it with the random growth network not depending on network's activity. By using the random graphs theory methods for the analysis of the network's connections structure it is shown that the growth in neural networks results in the formation of a well-known "small-world" network.