Understanding neural circuit development through theory and models

Modeling the Emergence of Circuit Organization and Function during Development

Developing neural circuits show unique patterns of spontaneous activity and structured network connectivity shaped by diverse activity-dependent plasticity mechanisms. Based on extensive experimental work characterizing patterns of spontaneous activity in different brain regions over development, theoretical and computational models have played an important role in delineating the generation and function of individual features of spontaneous activity and their role in the plasticity-driven formation of circuit connectivity. Here, we review recent modeling efforts that explore how the developing cortex and hippocampus generate spontaneous activity, focusing on specific connectivity profiles and the gradual strengthening of inhibition as the key drivers behind the observed developmental changes in spontaneous activity. We then discuss computational models that mechanistically explore how different plasticity mechanisms use this spontaneous activity to instruct the formation and refinement of circuit connectivity, from the formation of single neuron receptive fields to sensory feature maps and recurrent architectures. We end by highlighting several open challenges regarding the functional implications of the discussed circuit changes, wherein models could provide the missing step linking immature developmental and mature adult information processing capabilities.

Information content in continuous attractor neural networks is preserved in the presence of moderate disordered background connectivity

Continuous attractor neural networks (CANN) form an appealing conceptual model for the storage of information in the brain. However a drawback of CANN is that they require finely tuned interactions. We here study the effect of quenched noise in the interactions on the coding of positional information within CANN. Using the replica method we compute the Fisher information for a network with position-dependent input and recurrent connections composed of a short-range (in space) and a disordered component. We find that the loss in positional information is small for not too large disorder strength, indicating that CANN have a regime in which the advantageous effects of local connectivity on information storage outweigh the detrimental ones. Furthermore, a substantial part of this information can be extracted with a simple linear readout.

Formation and computational implications of assemblies in neural circuits

In the brain, patterns of neural activity represent sensory information and store it in non-random synaptic connectivity. A prominent theoretical hypothesis states that assemblies, groups of neurons that are strongly connected to each other, are the key computational units underlying perception and memory formation. Compatible with these hypothesised assemblies, experiments have revealed groups of neurons that display synchronous activity, either spontaneously or upon stimulus presentation, and exhibit behavioural relevance. While it remains unclear how assemblies form in the brain, theoretical work has vastly contributed to the understanding of various interacting mechanisms in this process. Here, we review the recent theoretical literature on assembly formation by categorising the involved mechanisms into four components: synaptic plasticity, symmetry breaking, competition and stability. We highlight different approaches and assumptions behind assembly formation and discuss recent ideas of assemblies as the key computational unit in the brain. Abstract figure legend Assembly Formation. Assemblies are groups of strongly connected neurons formed by the interaction of multiple mechanisms and with vast computational implications. Four interacting components are thought to drive assembly formation: synaptic plasticity, symmetry breaking, competition and stability. This article is protected by copyright. All rights reserved.

Emergence of synaptic organization and computation in dendrites

Single neurons in the brain exhibit astounding computational capabilities, which gradually emerge throughout development and enable them to become integrated into complex neural circuits. These capabilities derive in part from the precise arrangement of synaptic inputs on the neurons' dendrites. While the full computational benefits of this arrangement are still unknown, a picture emerges in which synapses organize according to their functional properties across multiple spatial scales. In particular, on the local scale (tens of microns), excitatory synaptic inputs tend to form clusters according to their functional similarity, whereas on the scale of individual dendrites or the entire tree, synaptic inputs exhibit dendritic maps where excitatory synapse function varies smoothly with location on the tree. The development of this organization is supported by inhibitory synapses, which are carefully interleaved with excitatory synapses and can flexibly modulate activity and plasticity of excitatory synapses. Here, we summarize recent experimental and theoretical research on the developmental emergence of this synaptic organization and its impact on neural computations.

LRRTM3 regulates activity-dependent synchronization of synapse properties in topographically connected hippocampal neural circuits

Synaptic cell-adhesion molecules (CAMs) organize the architecture and properties of neural circuits. However, whether synaptic CAMs are involved in activity-dependent remodeling of specific neural circuits is incompletely understood. Leucine-rich repeat transmembrane protein 3 (LRRTM3) is required for the excitatory synapse development of hippocampal dentate gyrus (DG) granule neurons. Here, we report that Lrrtm3-deficient mice exhibit selective reductions in excitatory synapse density and synaptic strength in projections involving the medial entorhinal cortex (MEC) and DG granule neurons, accompanied by increased neurotransmitter release and decreased excitability of granule neurons. LRRTM3 deletion significantly reduced excitatory synaptic innervation of hippocampal mossy fibers (Mf) of DG granule neurons onto thorny excrescences in hippocampal CA3 neurons. Moreover, LRRTM3 loss in DG neurons significantly decreased mossy fiber long-term potentiation (Mf-LTP). Remarkably, silencing MEC-DG circuits protected against the decrease in the excitatory synaptic inputs onto DG and CA3 neurons, excitability of DG granule neurons, and Mf-LTP in Lrrtm3-deficient mice. These results suggest that LRRTM3 may be a critical factor in activity-dependent synchronization of the topography of MEC-DG-CA3 excitatory synaptic connections. Collectively, our data propose that LRRTM3 shapes the target-specific structural and functional properties of specific hippocampal circuits.

Neurophysiology of the Developing Cerebral Cortex: What We Have Learned and What We Need to Know

This review article aims to give a brief summary on the novel technologies, the challenges, our current understanding, and the open questions in the field of the neurophysiology of the developing cerebral cortex in rodents. In the past, in vitro electrophysiological and calcium imaging studies on single neurons provided important insights into the function of cellular and subcellular mechanism during early postnatal development. In the past decade, neuronal activity in large cortical networks was recorded in pre- and neonatal rodents in vivo by the use of novel high-density multi-electrode arrays and genetically encoded calcium indicators. These studies demonstrated a surprisingly rich repertoire of spontaneous cortical and subcortical activity patterns, which are currently not completely understood in their functional roles in early development and their impact on cortical maturation. Technological progress in targeted genetic manipulations, optogenetics, and chemogenetics now allow the experimental manipulation of specific neuronal cell types to elucidate the function of early (transient) cortical circuits and their role in the generation of spontaneous and sensory evoked cortical activity patterns. Large-scale interactions between different cortical areas and subcortical regions, characterization of developmental shifts from synchronized to desynchronized activity patterns, identification of transient circuits and hub neurons, role of electrical activity in the control of glial cell differentiation and function are future key tasks to gain further insights into the neurophysiology of the developing cerebral cortex.

On the Role of LGN/V1 Spontaneous Activity as an Innate Learning Pattern for Visual Development

Correlated, spontaneous neural activity is known to play a necessary role in visual development, but the higher-order statistical structure of these coherent, amorphous patterns has only begun to emerge in the past decade. Several computational studies have demonstrated how this endogenous activity can be used to train a developing visual system. Models that generate spontaneous activity analogous to retinal waves have shown that these waves can serve as stimuli for efficient coding models of V1. This general strategy in development has one clear advantage: The same learning algorithm can be used both before and after eye-opening. This same insight can be applied to understanding LGN/V1 spontaneous activity. Although lateral geniculate nucleus (LGN) activity has been less discussed in the literature than retinal waves, here we argue that the waves found in the LGN have a number of properties that fill the role of a training pattern. We make the case that the role of “innate learning” with spontaneous activity is not only possible, but likely in later stages of visual development, and worth pursuing further using an efficient coding paradigm.

Ensemble synchronization in the reassembly of Hydra's nervous system

Although much is known about how the structure of the nervous system develops, it is still unclear how its functional modularity arises. A dream experiment would be to observe the entire development of a nervous system, correlating the emergence of functional units with their associated behaviors. This is possible in the cnidarian Hydra vulgaris, which, after its complete dissociation into individual cells, can reassemble itself back together into a normal animal. We used calcium imaging to monitor the complete neuronal activity of dissociated Hydra as they reaggregated over several days. Initially uncoordinated neuronal activity became synchronized into coactive neuronal ensembles. These local modules then synchronized with others, building larger functional ensembles that eventually extended throughout the entire reaggregate, generating neuronal rhythms similar to those of intact animals. Global synchronization was not due to neurite outgrowth but to strengthening of functional connections between ensembles. We conclude that Hydra's nervous system achieves its functional reassembly through the hierarchical modularity of neuronal ensembles.

Adaptation of spontaneous activity in the developing visual cortex

Spontaneous activity drives the establishment of appropriate connectivity in different circuits during brain development. In the mouse primary visual cortex, two distinct patterns of spontaneous activity occur before vision onset: local low-synchronicity events originating in the retina and global high-synchronicity events originating in the cortex. We sought to determine the contribution of these activity patterns to jointly organize network connectivity through different activity-dependent plasticity rules. We postulated that local events shape cortical input selectivity and topography, while global events homeostatically regulate connection strength. However, to generate robust selectivity, we found that global events should adapt their amplitude to the history of preceding cortical activation. We confirmed this prediction by analyzing in vivo spontaneous cortical activity. The predicted adaptation leads to the sparsification of spontaneous activity on a slower timescale during development, demonstrating the remarkable capacity of the developing sensory cortex to acquire sensitivity to visual inputs after eye-opening.

Autonomous emergence of connectivity assemblies via spike triplet interactions

Non-random connectivity can emerge without structured external input driven by activity-dependent mechanisms of synaptic plasticity based on precise spiking patterns. Here we analyze the emergence of global structures in recurrent networks based on a triplet model of spike timing dependent plasticity (STDP), which depends on the interactions of three precisely-timed spikes, and can describe plasticity experiments with varying spike frequency better than the classical pair-based STDP rule. We derive synaptic changes arising from correlations up to third-order and describe them as the sum of structural motifs, which determine how any spike in the network influences a given synaptic connection through possible connectivity paths. This motif expansion framework reveals novel structural motifs under the triplet STDP rule, which support the formation of bidirectional connections and ultimately the spontaneous emergence of global network structure in the form of self-connected groups of neurons, or assemblies. We propose that under triplet STDP assembly structure can emerge without the need for externally patterned inputs or assuming a symmetric pair-based STDP rule common in previous studies. The emergence of non-random network structure under triplet STDP occurs through internally-generated higher-order correlations, which are ubiquitous in natural stimuli and neuronal spiking activity, and important for coding. We further demonstrate how neuromodulatory mechanisms that modulate the shape of the triplet STDP rule or the synaptic transmission function differentially promote structural motifs underlying the emergence of assemblies, and quantify the differences using graph theoretic measures.

Emergent non-random connectivity structures in different brain regions are tightly related to specific patterns of neural activity and support diverse brain functions. For instance, self-connected groups of neurons, known as assemblies, have been proposed to represent functional units in brain circuits and can emerge even without patterned external instruction. Here we investigate the emergence of non-random connectivity in recurrent networks using a particular plasticity rule, triplet STDP, which relies on the interaction of spike triplets and can capture higher-order statistical dependencies in neural activity. We derive the evolution of the synaptic strengths in the network and explore the conditions for the self-organization of connectivity into assemblies. We demonstrate key differences of the triplet STDP rule compared to the classical pair-based rule in terms of how assemblies are formed, including the realistic asymmetric shape and influence of novel connectivity motifs on network plasticity driven by higher-order correlations. Assembly formation depends on the specific shape of the STDP window and synaptic transmission function, pointing towards an important role of neuromodulatory signals on formation of intrinsically generated assemblies.

Theoretical Models of Neural Development

Constructing a functioning nervous system requires the precise orchestration of a vast array of mechanical, molecular, and neural-activity-dependent cues. Theoretical models can play a vital role in helping to frame quantitative issues, reveal mathematical commonalities between apparently diverse systems, identify what is and what is not possible in principle, and test the abilities of specific mechanisms to explain the data. This review focuses on the progress that has been made over the last decade in our theoretical understanding of neural development.

Internal State Dependent Odor Processing and Perception-The Role of Neuromodulation in the Fly Olfactory System

Animals rely heavily on their sense of olfaction to perform various vital interactions with an ever-in-flux environment. The turbulent and combinatorial nature of air-borne odorant cues demands the employment of various coding strategies, which allow the animal to attune to its internal needs and past or present experiences. Furthermore, these internal needs can be dependent on internal states such as hunger, reproductive state and sickness. Neuromodulation is a key component providing flexibility under such conditions. Understanding the contributions of neuromodulation, such as sensory neuron sensitization and choice bias requires manipulation of neuronal activity on a local and global scale. With Drosophila's genetic toolset, these manipulations are feasible and even allow a detailed look on the functional role of classical neuromodulators such as dopamine, octopamine and neuropeptides. The past years unraveled various mechanisms adapting chemosensory processing and perception to internal states such as hunger and reproductive state. However, future research should also investigate the mechanisms underlying other internal states including the modulatory influence of endogenous microbiota on Drosophila behavior. Furthermore, sickness induced by pathogenic infection could lead to novel insights as to the neuromodulators of circuits that integrate such a negative postingestive signal within the circuits governing olfactory behavior and learning. The enriched emporium of tools Drosophila provides will help to build a concrete picture of the influence of neuromodulation on olfaction and metabolism, adaptive behavior and our overall understanding of how a brain works.