Modulation of Spike-Timing Dependent Plasticity: Towards the Inclusion of a Third Factor in Computational Models

Stabilizing sequence learning in stochastic spiking networks with GABA-Modulated STDP

Cortical networks are capable of unsupervised learning and spontaneous replay of complex temporal sequences. Endowing artificial spiking neural networks with similar learning abilities remains a challenge. In particular, it is unresolved how different plasticity rules can contribute to both learning and the maintenance of network stability during learning. Here we introduce a biologically inspired form of GABA-Modulated Spike Timing-Dependent Plasticity (GMS) and demonstrate its ability to permit stable learning of complex temporal sequences including natural language in recurrent spiking neural networks. Motivated by biological findings, GMS utilizes the momentary level of inhibition onto excitatory cells to adjust both the magnitude and sign of Spike Timing-Dependent Plasticity (STDP) of connections between excitatory cells. In particular, high levels of inhibition in the network cause depression of excitatory-to-excitatory connections. We demonstrate the effectiveness of this mechanism during several sequence learning experiments with character- and token-based text inputs as well as visual input sequences. We show that GMS maintains stability during learning and spontaneous replay and permits the network to form a clustered hierarchical representation of its input sequences. Overall, we provide a biologically inspired model of unsupervised learning of complex sequences in recurrent spiking neural networks.

Anti-Hebbian plasticity drives sequence learning in striatum

Spatio-temporal activity patterns have been observed in a variety of brain areas in spontaneous activity, prior to or during action, or in response to stimuli. Biological mechanisms endowing neurons with the ability to distinguish between different sequences remain largely unknown. Learning sequences of spikes raises multiple challenges, such as maintaining in memory spike history and discriminating partially overlapping sequences. Here, we show that anti-Hebbian spike-timing dependent plasticity (STDP), as observed at cortico-striatal synapses, can naturally lead to learning spike sequences. We design a spiking model of the striatal output neuron receiving spike patterns defined as sequential input from a fixed set of cortical neurons. We use a simple synaptic plasticity rule that combines anti-Hebbian STDP and non-associative potentiation for a subset of the presented patterns called rewarded patterns. We study the ability of striatal output neurons to discriminate rewarded from non-rewarded patterns by firing only after the presentation of a rewarded pattern. In particular, we show that two biological properties of striatal networks, spiking latency and collateral inhibition, contribute to an increase in accuracy, by allowing a better discrimination of partially overlapping sequences. These results suggest that anti-Hebbian STDP may serve as a biological substrate for learning sequences of spikes.

Sensory Reinforced Corticostriatal Plasticity

BACKGROUND

Regional changes in corticostriatal transmission induced by phasic dopaminergic signals are an essential feature of the neural network responsible for instrumental reinforcement during discovery of an action. However, the timing of signals that are thought to contribute to the induction of corticostriatal plasticity is difficult to reconcile within the framework of behavioural reinforcement learning, because the reinforcer is normally delayed relative to the selection and execution of causally-related actions.

OBJECTIVE

While recent studies have started to address the relevance of delayed reinforcement signals and their impact on corticostriatal processing, our objective was to establish a model in which a sensory reinforcer triggers appropriately delayed reinforcement signals relayed to the striatum via intact neuronal pathways and to investigate the effects on corticostriatal plasticity.

METHODS

We measured corticostriatal plasticity with electrophysiological recordings using a light flash as a natural sensory reinforcer, and pharmacological manipulations were applied in an in vivo anesthetized rat model preparation.

RESULTS

We demonstrate that the spiking of striatal neurons evoked by single-pulse stimulation of the motor cortex can be potentiated by a natural sensory reinforcer, operating through intact afferent pathways, with signal timing approximating that required for behavioural reinforcement. The pharmacological blockade of dopamine receptors attenuated the observed potentiation of corticostriatal neurotransmission.

CONCLUSION

This novel in vivo model of corticostriatal plasticity offers a behaviourally relevant framework to address the physiological, anatomical, cellular, and molecular bases of instrumental reinforcement learning.

Synaptic plasticity through a naturalistic lens

From the myriad of studies on neuronal plasticity, investigating its underlying molecular mechanisms up to its behavioral relevance, a very complex landscape has emerged. Recent efforts have been achieved toward more naturalistic investigations as an attempt to better capture the synaptic plasticity underpinning of learning and memory, which has been fostered by the development of in vivo electrophysiological and imaging tools. In this review, we examine these naturalistic investigations, by devoting a first part to synaptic plasticity rules issued from naturalistic in vivo-like activity patterns. We next give an overview of the novel tools, which enable an increased spatio-temporal specificity for detecting and manipulating plasticity expressed at individual spines up to neuronal circuit level during behavior. Finally, we put particular emphasis on works considering brain-body communication loops and macroscale contributors to synaptic plasticity, such as body internal states and brain energy metabolism.

Supporting Post-Stroke Language and Cognition with Pharmacotherapy: Tools for Each Phase of Care

PURPOSE OF REVIEW

There is enormous enthusiasm for the possibility of pharmacotherapies to treat language deficits that can arise after stroke. Speech language therapy remains the most frequently utilized and most strongly evidenced treatment, but the numerous barriers to patients receiving the therapy necessary to recover have motivated the creation of a relatively modest, yet highly cited, body of evidence to support the use of pharmacotherapy to treat post-stroke aphasia directly or to augment traditional post-stroke aphasia treatment. In this review, we survey the use of pharmacotherapy to preserve and support language and cognition in the context of stroke across phases of care, discuss key ongoing clinical trials, and identify targets that may become emerging interventions in the future.

RECENT FINDINGS

Recent trials have shifted focus from short periods of drug therapy supporting therapy in the chronic phase to longer terms approaching pharmacological maintenance beginning more acutely. Recent innovations in hyperacute stroke care, such as tenecteplase, and acute initiation of neuroprotective agents and serotonin reuptake inhibitors are important areas of ongoing research that complement the ongoing search for effective adjuvants to later therapy. Currently there are no drugs approved in the United States for the treatment of aphasia. Nevertheless, pharmacological intervention may provide a benefit to all phases of stroke care.

The plasticitome of cortical interneurons

Hebb postulated that, to store information in the brain, assemblies of excitatory neurons coding for a percept are bound together via associative long-term synaptic plasticity. In this view, it is unclear what role, if any, is carried out by inhibitory interneurons. Indeed, some have argued that inhibitory interneurons are not plastic. Yet numerous recent studies have demonstrated that, similar to excitatory neurons, inhibitory interneurons also undergo long-term plasticity. Here, we discuss the many diverse forms of long-term plasticity that are found at inputs to and outputs from several types of cortical inhibitory interneuron, including their plasticity of intrinsic excitability and their homeostatic plasticity. We explain key plasticity terminology, highlight key interneuron plasticity mechanisms, extract overarching principles and point out implications for healthy brain functionality as well as for neuropathology. We introduce the concept of the plasticitome - the synaptic plasticity counterpart to the genome or the connectome - as well as nomenclature and definitions for dealing with this rich diversity of plasticity. We argue that the great diversity of interneuron plasticity rules is best understood at the circuit level, for example as a way of elucidating how the credit-assignment problem is solved in deep biological neural networks.

Adaptive control of synaptic plasticity integrates micro- and macroscopic network function

Synaptic plasticity configures interactions between neurons and is therefore likely to be a primary driver of behavioral learning and development. How this microscopic-macroscopic interaction occurs is poorly understood, as researchers frequently examine models within particular ranges of abstraction and scale. Computational neuroscience and machine learning models offer theoretically powerful analyses of plasticity in neural networks, but results are often siloed and only coarsely linked to biology. In this review, we examine connections between these areas, asking how network computations change as a function of diverse features of plasticity and vice versa. We review how plasticity can be controlled at synapses by calcium dynamics and neuromodulatory signals, the manifestation of these changes in networks, and their impacts in specialized circuits. We conclude that metaplasticity-defined broadly as the adaptive control of plasticity-forges connections across scales by governing what groups of synapses can and can't learn about, when, and to what ends. The metaplasticity we discuss acts by co-opting Hebbian mechanisms, shifting network properties, and routing activity within and across brain systems. Asking how these operations can go awry should also be useful for understanding pathology, which we address in the context of autism, schizophrenia and Parkinson's disease.

Striatum expresses region-specific plasticity consistent with distinct memory abilities

The striatum mediates two learning modalities: goal-directed behavior in dorsomedial (DMS) and habits in dorsolateral (DLS) striata. The synaptic bases of these learnings are still elusive. Indeed, while ample research has described DLS plasticity, little remains known about DMS plasticity and its involvement in procedural learning. Here, we find symmetric and asymmetric anti-Hebbian spike-timing-dependent plasticity (STDP) in DMS and DLS, respectively, with opposite plasticity dominance upon increasing corticostriatal activity. During motor-skill learning, plasticity is engaged in DMS and striatonigral DLS neurons only during early learning stages, whereas striatopallidal DLS neurons are mobilized only during late phases. With a mathematical modeling approach, we find that symmetric anti-Hebbian STDP favors memory flexibility, while asymmetric anti-Hebbian STDP favors memory maintenance, consistent with memory processes at play in procedural learning.

Periodicity Pitch Perception Part III: Sensibility and Pachinko Volatility

Neuromorphic computer models are used to explain sensory perceptions. Auditory models generate cochleagrams, which resemble the spike distributions in the auditory nerve. Neuron ensembles along the auditory pathway transform sensory inputs step by step and at the end pitch is represented in auditory categorical spaces. In two previous articles in the series on periodicity pitch perception an extended auditory model had been successfully used for explaining periodicity pitch proved for various musical instrument generated tones and sung vowels. In this third part in the series the focus is on octopus cells as they are central sensitivity elements in auditory cognition processes. A powerful numerical model had been devised, in which auditory nerve fibers (ANFs) spike events are the inputs, triggering the impulse responses of the octopus cells. Efficient algorithms are developed and demonstrated to explain the behavior of octopus cells with a focus on a simple event-based hardware implementation of a layer of octopus neurons. The main finding is, that an octopus' cell model in a local receptive field fine-tunes to a specific trajectory by a spike-timing-dependent plasticity (STDP) learning rule with synaptic pre-activation and the dendritic back-propagating signal as post condition. Successful learning explains away the teacher and there is thus no need for a temporally precise control of plasticity that distinguishes between learning and retrieval phases. Pitch learning is cascaded: At first octopus cells respond individually by self-adjustment to specific trajectories in their local receptive fields, then unions of octopus cells are collectively learned for pitch discrimination. Pitch estimation by inter-spike intervals is shown exemplary using two input scenarios: a simple sinus tone and a sung vowel. The model evaluation indicates an improvement in pitch estimation on a fixed time-scale.

The Origin of Abnormal Beta Oscillations in the Parkinsonian Corticobasal Ganglia Circuits

Parkinson's disease (PD) is a neurodegenerative brain disorder associated with motor and nonmotor symptoms. Exaggerated beta band (15–30 Hz) neuronal oscillations are widely observed in corticobasal ganglia (BG) circuits during parkinsonism. Abnormal beta oscillations have been linked to motor symptoms of PD, but their exact relationship is poorly understood. Nevertheless, reduction of beta oscillations can induce therapeutic effects in PD patients. While it is widely believed that the external globus pallidus (GPe) and subthalamic nucleus (STN) are jointly responsible for abnormal rhythmogenesis in the parkinsonian BG, the role of other cortico-BG circuits cannot be ignored. To shed light on the origin of abnormal beta oscillations in PD, here we review changes of neuronal activity observed in experimental PD models and discuss how the cortex and different BG nuclei cooperate to generate and stabilize abnormal beta oscillations during parkinsonism. This may provide further insights into the complex relationship between abnormal beta oscillations and motor dysfunction in PD, which is crucial for potential target-specific therapeutic interventions in PD patients.

Spike-timing-dependent plasticity rewards synchrony rather than causality

Spike-timing-dependent plasticity (STDP) is a candidate mechanism for information storage in the brain, but the whole-cell recordings required for the experimental induction of STDP are typically limited to 1 h. This mismatch of time scales is a long-standing weakness in synaptic theories of memory. Here we use spectrally separated optogenetic stimulation to fire precisely timed action potentials (spikes) in CA3 and CA1 pyramidal cells. Twenty minutes after optogenetic induction of STDP (oSTDP), we observed timing-dependent depression (tLTD) and timing-dependent potentiation (tLTP), depending on the sequence of spiking. As oSTDP does not require electrodes, we could also assess the strength of these paired connections three days later. At this late time point, late tLTP was observed for both causal (CA3 before CA1) and anticausal (CA1 before CA3) timing, but not for asynchronous activity patterns (Δt = 50 ms). Blocking activity after induction of oSTDP prevented stable potentiation. Our results confirm that neurons wire together if they fire together, but suggest that synaptic depression after anticausal activation (tLTD) is a transient phenomenon.

Better language through chemistry: Augmenting speech-language therapy with pharmacotherapy in the treatment of aphasia

Speech and language therapy is the standard treatment of aphasia. However, many individuals have barriers in seeking this measure of extensive rehabilitation treatment. Investigating ways to augment therapy is key to improving poststroke language outcomes for all patients with aphasia, and pharmacotherapies provide one such potential solution. Although no medications are currently approved for the treatment of aphasia by the United States Food and Drug Administration, numerous candidate mechanisms for pharmaceutical manipulation continue to be identified based on our evolving understanding of the neurometabolic experience of stroke recovery across molecular, cellular, and functional levels of inquiry. This chapter will review evidence for catecholaminergic, glutamatergic, cholinergic, and serotonergic drug therapies and discuss future directions for both candidate drug selection and pharmacotherapy practice in people with aphasia.

Brain is modulated by neuronal plasticity during postnatal development

Neuroplasticity is referred to the ability of the nervous system to change its structure or functions as a result of former stimuli. It is a plausible mechanism underlying a dynamic brain through adaptation processes of neural structure and activity patterns. Nevertheless, it is still unclear how the plastic neural systems achieve and maintain their equilibrium. Additionally, the alterations of balanced brain dynamics under different plasticity rules have not been explored either. Therefore, the present article primarily aims to review recent research studies regarding homosynaptic and heterosynaptic neuroplasticity characterized by the manipulation of excitatory and inhibitory synaptic inputs. Moreover, it attempts to understand different mechanisms related to the main forms of synaptic plasticity at the excitatory and inhibitory synapses during the brain development processes. Hence, this study comprised surveying those articles published since 1988 and available through PubMed, Google Scholar and science direct databases on a keyword-based search paradigm. All in all, the study results presented extensive and corroborative pieces of evidence for the main types of plasticity, including the long-term potentiation (LTP) and long-term depression (LTD) of the excitatory and inhibitory postsynaptic potentials (EPSPs and IPSPs).

A computational model of dopaminergic modulation of hippocampal Schaffer collateral-CA1 long-term plasticity

Dopamine plays a critical role in modulating the long-term synaptic plasticity of the hippocampal Schaffer collateral-CA1 pyramidal neuron synapses (SC-CA1), a widely accepted cellular model of learning and memory. Limited results from hippocampal slice experiments over the last four decades have shown that the timing of the activation of dopamine D1/D5 receptors relative to a high/low-frequency stimulation (HFS/LFS) in SC-CA1 synapses regulates the modulation of HFS/LFS-induced long-term potentiation/depression (LTP/LTD) in these synapses. However, the existing literature lacks a complete picture of how various concentrations of D1/D5 agonists and the relative timing between the activation of D1/D5 receptors and LTP/LTD induction by HFS/LFS, affect the spatiotemporal modulation of SC-CA1 synaptic dynamics. In this paper, we have developed a computational model, a first of its kind, to make quantitative predictions of the temporal dose-dependent modulation of the HFS/LFS induced LTP/LTD in SC-CA1 synapses by various D1/D5 agonists. Our model combines the biochemical effects with the electrical effects at the electrophysiological level. We have estimated the model parameters from the published electrophysiological data, available from diverse hippocampal CA1 slice experiments, in a Bayesian framework. Our modeling results demonstrate the capability of our model in making quantitative predictions of the available experimental results under diverse HFS/LFS protocols. The predictions from our model show a strong nonlinear dependency of the modulated LTP/LTD by D1/D5 agonists on the relative timing between the activated D1/D5 receptors and the HFS/LFS protocol and the applied concentration of D1/D5 agonists.

Emergence of local and global synaptic organization on cortical dendrites

Synaptic inputs on cortical dendrites are organized with remarkable subcellular precision at the micron level. This organization emerges during early postnatal development through patterned spontaneous activity and manifests both locally where nearby synapses are significantly correlated, and globally with distance to the soma. We propose a biophysically motivated synaptic plasticity model to dissect the mechanistic origins of this organization during development and elucidate synaptic clustering of different stimulus features in the adult. Our model captures local clustering of orientation in ferret and receptive field overlap in mouse visual cortex based on the receptive field diameter and the cortical magnification of visual space. Including action potential back-propagation explains branch clustering heterogeneity in the ferret and produces a global retinotopy gradient from soma to dendrite in the mouse. Therefore, by combining activity-dependent synaptic competition and species-specific receptive fields, our framework explains different aspects of synaptic organization regarding stimulus features and spatial scales.

A Computational Model Integrating Multiple Phenomena on Cued Fear Conditioning, Extinction, and Reinstatement

Conditioning, extinction, and reinstatement are fundamental learning processes of animal adaptation, also strongly involved in human pathologies such as post-traumatic stress disorder, anxiety, depression, and dependencies. Cued fear conditioning, extinction, restatement, and systematic manipulations of the underlying brain amygdala and medial prefrontal cortex, represent key experimental paradigms to study such processes. Numerous empirical studies have revealed several aspects and the neural systems and plasticity underlying them, but at the moment we lack a comprehensive view. Here we propose a computational model based on firing rate leaky units that contributes to such integration by accounting for 25 different experiments on fear conditioning, extinction, and restatement, on the basis of a single neural architecture having a structure and plasticity grounded in known brain biology. This allows the model to furnish three novel contributions to understand these open issues: (a) the functioning of the central and lateral amygdala system supporting conditioning; (b) the role played by the endocannabinoids system in within- and between-session extinction; (c) the formation of three important types of neurons underlying fear processing, namely fear, extinction, and persistent neurons. The model integration of the results on fear conditioning goes substantially beyond what was done in previous models.

Astrocyte-mediated spike-timing-dependent long-term depression modulates synaptic properties in the developing cortex

Astrocytes have been shown to modulate synaptic transmission and plasticity in specific cortical synapses, but our understanding of the underlying molecular and cellular mechanisms remains limited. Here we present a new biophysicochemical model of a somatosensory cortical layer 4 to layer 2/3 synapse to study the role of astrocytes in spike-timing-dependent long-term depression (t-LTD) in vivo. By applying the synapse model and electrophysiological data recorded from rodent somatosensory cortex, we show that a signal from a postsynaptic neuron, orchestrated by endocannabinoids, astrocytic calcium signaling, and presynaptic N-methyl-D-aspartate receptors coupled with calcineurin signaling, induces t-LTD which is sensitive to the temporal difference between post- and presynaptic firing. We predict for the first time the dynamics of astrocyte-mediated molecular mechanisms underlying t-LTD and link complex biochemical networks at presynaptic, postsynaptic, and astrocytic sites to the time window of t-LTD induction. During t-LTD a single astrocyte acts as a delay factor for fast neuronal activity and integrates fast neuronal sensory processing with slow non-neuronal processing to modulate synaptic properties in the brain. Our results suggest that astrocytes play a critical role in synaptic computation during postnatal development and are of paramount importance in guiding the development of brain circuit functions, learning and memory.

In vivo odorant input induces distinct synaptic plasticity of GABAergic synapses in developing zebrafish olfactory bulb

In the first station of central odor processing, the main olfactory bulb, signal processing is regulated by synaptic interactions between glutamatergic and GABAergic inputs of the mitral cells (MCs), the major projection neurons. Our previous study has found that repetitive postsynaptic spiking within a critical time window after presynaptic activation by natural odorant stimulation results in persistent enhancement of glutamatergic inputs of MCs in larval zebrafish. Here we observed a long-term depression of GABAergic synapses induced by the same protocol. This long-term depression was mediated by presynaptic NMDA receptors (NMDARs). Further dissecting GABAergic neurotransmission revealed that the STDP-induction protocol induced persistent modification in recurrent and lateral inhibition with opposite directions and distinct requirements on NMDARs. Thus, at the plasticity level, different types of GABAergic inhibition may utilize different mechanisms to cooperate or compete with excitatory inputs to optimize patterns of olfactory bulb output.

Unifying Long-Term Plasticity Rules for Excitatory Synapses by Modeling Dendrites of Cortical Pyramidal Neurons

A large number of experiments have indicated that precise spike times, firing rates, and synapse locations crucially determine the dynamics of long-term plasticity induction in excitatory synapses. However, it remains unknown how plasticity mechanisms of synapses distributed along dendritic trees cooperate to produce the wide spectrum of outcomes for various plasticity protocols. Here, we propose a four-pathway plasticity framework that is well grounded in experimental evidence and apply it to a biophysically realistic cortical pyramidal neuron model. We show in computer simulations that several seemingly contradictory experimental landmark studies are consistent with one unifying set of mechanisms when considering the effects of signal propagation in dendritic trees with respect to synapse location. Our model identifies specific spatiotemporal contributions of dendritic and axo-somatic spikes as well as of subthreshold activation of synaptic clusters, providing a unified parsimonious explanation not only for rate and timing dependence but also for location dependence of synaptic changes.

•

A phenomenological synaptic plasticity rule is applied to a pyramidal neuron model

•

Model reproduces rate-, timing-, and location-dependent plasticity results

•

Active dendrites allow plasticity via dendritic spikes and subthreshold events

•

Cooperative plasticity exists across the dendritic tree and within single branches

VIP Modulation of Hippocampal Synaptic Plasticity: A Role for VIP Receptors as Therapeutic Targets in Cognitive Decline and Mesial Temporal Lobe Epilepsy

Vasoactive intestinal peptide (VIP) is an important modulatory peptide throughout the CNS acting as a neurotransmitter, neurotrophic or neuroprotective factor. In the hippocampus, a brain area implicated in learning and memory processes, VIP has a crucial role in the control of GABAergic transmission and pyramidal cell activity in response to specific network activity by either VIP-containing basket cells or interneuron-selective (IS) interneurons and this appears to have a differential impact in hippocampal-dependent cognition. At the cellular level, VIP regulates synaptic transmission by either promoting disinhibition, through activation of VPAC₁ receptors, or enhancing pyramidal cell excitability, through activation of VPAC₂ receptors. These actions also control several important synaptic plasticity phenomena such as long-term potentiation (LTP) and long-term depression (LTD). This paper reviews the current knowledge on the activation and multiple functions of VIP expressing cells in the hippocampus and their role in controlling synaptic transmission, synaptic plasticity and learning and memory processes, discussing also the role of VPAC₁ and VPAC₂ VIP receptors in the regulation of these different processes. Furthermore, we address the current knowledge regarding changes in VIP mediated neurotransmission in epileptogenesis and mesial temporal lobe epilepsy with hippocampal sclerosis (MTLE-HS), and discuss the therapeutic opportunities of using selective VIP receptor ligands to prevent epileptogenesis and cognitive decline in MTLE-HS.

Pull-push neuromodulation of cortical plasticity enables rapid bi-directional shifts in ocular dominance

Neuromodulatory systems are essential for remodeling glutamatergic connectivity during experience-dependent cortical plasticity. This permissive/enabling function of neuromodulators has been associated with their capacity to facilitate the induction of Hebbian forms of long-term potentiation (LTP) and depression (LTD) by affecting cellular and network excitability. In vitro studies indicate that neuromodulators also affect the expression of Hebbian plasticity in a pull-push manner: receptors coupled to the G-protein Gs promote the expression of LTP at the expense of LTD, and Gq-coupled receptors promote LTD at the expense of LTP. Here we show that pull-push mechanisms can be recruited in vivo by pairing brief monocular stimulation with pharmacological or chemogenetical activation of Gs- or Gq-coupled receptors to respectively enhance or reduce neuronal responses in primary visual cortex. These changes were stable, inducible in adults after the termination of the critical period for ocular dominance plasticity, and can rescue deficits induced by prolonged monocular deprivation.

Autonomous emergence of connectivity assemblies via spike triplet interactions

Non-random connectivity can emerge without structured external input driven by activity-dependent mechanisms of synaptic plasticity based on precise spiking patterns. Here we analyze the emergence of global structures in recurrent networks based on a triplet model of spike timing dependent plasticity (STDP), which depends on the interactions of three precisely-timed spikes, and can describe plasticity experiments with varying spike frequency better than the classical pair-based STDP rule. We derive synaptic changes arising from correlations up to third-order and describe them as the sum of structural motifs, which determine how any spike in the network influences a given synaptic connection through possible connectivity paths. This motif expansion framework reveals novel structural motifs under the triplet STDP rule, which support the formation of bidirectional connections and ultimately the spontaneous emergence of global network structure in the form of self-connected groups of neurons, or assemblies. We propose that under triplet STDP assembly structure can emerge without the need for externally patterned inputs or assuming a symmetric pair-based STDP rule common in previous studies. The emergence of non-random network structure under triplet STDP occurs through internally-generated higher-order correlations, which are ubiquitous in natural stimuli and neuronal spiking activity, and important for coding. We further demonstrate how neuromodulatory mechanisms that modulate the shape of the triplet STDP rule or the synaptic transmission function differentially promote structural motifs underlying the emergence of assemblies, and quantify the differences using graph theoretic measures.

Emergent non-random connectivity structures in different brain regions are tightly related to specific patterns of neural activity and support diverse brain functions. For instance, self-connected groups of neurons, known as assemblies, have been proposed to represent functional units in brain circuits and can emerge even without patterned external instruction. Here we investigate the emergence of non-random connectivity in recurrent networks using a particular plasticity rule, triplet STDP, which relies on the interaction of spike triplets and can capture higher-order statistical dependencies in neural activity. We derive the evolution of the synaptic strengths in the network and explore the conditions for the self-organization of connectivity into assemblies. We demonstrate key differences of the triplet STDP rule compared to the classical pair-based rule in terms of how assemblies are formed, including the realistic asymmetric shape and influence of novel connectivity motifs on network plasticity driven by higher-order correlations. Assembly formation depends on the specific shape of the STDP window and synaptic transmission function, pointing towards an important role of neuromodulatory signals on formation of intrinsically generated assemblies.

Environmental enrichment shapes striatal spike-timing-dependent plasticity in vivo

Behavioural experience, such as environmental enrichment (EE), induces long-term effects on learning and memory. Learning can be assessed with the Hebbian paradigm, such as spike-timing-dependent plasticity (STDP), which relies on the timing of neuronal activity on either side of the synapse. Although EE is known to control neuronal excitability and consequently spike timing, whether EE shapes STDP remains unknown. Here, using in vivo long-duration intracellular recordings at the corticostriatal synapses we show that EE promotes asymmetric anti-Hebbian STDP, i.e. spike-timing-dependent-potentiation (tLTP) for post-pre pairings and spike-timing-dependent-depression (tLTD) for pre-post pairings, whereas animals grown in standard housing show mainly tLTD and a high failure rate of plasticity. Indeed, in adult rats grown in standard conditions, we observed unidirectional plasticity (mainly symmetric anti-Hebbian tLTD) within a large temporal window (~200 ms). However, rats grown for two months in EE displayed a bidirectional STDP (tLTP and tLTD depending on spike timing) in a more restricted temporal window (~100 ms) with low failure rate of plasticity. We also found that the effects of EE on STDP characteristics are influenced by the anaesthesia status: the deeper the anaesthesia, the higher the absence of plasticity. These findings establish a central role for EE and the anaesthetic regime in shaping in vivo, a synaptic Hebbian learning rule such as STDP.

Neuromodulators and Long-Term Synaptic Plasticity in Learning and Memory: A Steered-Glutamatergic Perspective

The molecular pathways underlying the induction and maintenance of long-term synaptic plasticity have been extensively investigated revealing various mechanisms by which neurons control their synaptic strength. The dynamic nature of neuronal connections combined with plasticity-mediated long-lasting structural and functional alterations provide valuable insights into neuronal encoding processes as molecular substrates of not only learning and memory but potentially other sensory, motor and behavioural functions that reflect previous experience. However, one key element receiving little attention in the study of synaptic plasticity is the role of neuromodulators, which are known to orchestrate neuronal activity on brain-wide, network and synaptic scales. We aim to review current evidence on the mechanisms by which certain modulators, namely dopamine, acetylcholine, noradrenaline and serotonin, control synaptic plasticity induction through corresponding metabotropic receptors in a pathway-specific manner. Lastly, we propose that neuromodulators control plasticity outcomes through steering glutamatergic transmission, thereby gating its induction and maintenance.

GABA Regulation of Burst Firing in Hippocampal Astrocyte Neural Circuit: A Biophysical Model

It is now widely accepted that glia cells and gamma-aminobutyric acidergic (GABA) interneurons dynamically regulate synaptic transmission and neuronal activity in time and space. This paper presents a biophysical model that captures the interaction between an astrocyte cell, a GABA interneuron and pre/postsynaptic neurons. Specifically, GABA released from a GABA interneuron triggers in astrocytes the release of calcium (Ca²⁺) from the endoplasmic reticulum via the inositol 1, 4, 5-trisphosphate (IP₃) pathway. This results in gliotransmission which elevates the presynaptic transmission probability rate (PR) causing weight potentiation and a gradual increase in postsynaptic neuronal firing, that eventually stabilizes. However, by capturing the complex interactions between IP₃, generated from both GABA and the 2-arachidonyl glycerol (2-AG) pathway, and PR, this paper shows that this interaction not only gives rise to an initial weight potentiation phase but also this phase is followed by postsynaptic bursting behavior. Moreover, the model will show that there is a presynaptic frequency range over which burst firing can occur. The proposed model offers a novel cellular level mechanism that may underpin both seizure-like activity and neuronal synchrony across different brain regions.

Multi-scale modeling of the circadian modulation of learning and memory

We propose a multi-scale model to explain the time-of-day effects on learning and memory. We specifically model the circadian variation of hippocampus (HC) dependent long-term potentiation (LTP), depression (LTD), and the fear conditioning paradigm in amygdala. The model we built has both Goodwin type circadian gene regulatory network (GRN) and the conductance model of Morris-Lecar (ML) type to explain the spontaneous firing patterns (SFR) in suprachiasmatic nucleus (SCN). In the conductance model, we also include N-Methyl-D-aspartic acid receptor (NMDAR) to study the circadian dependent changes in LTP/LTD in hippocampus and include both NMDAR and α-amino-3-hydroxy-5-methyl-4-isoxazolepropionic acid receptor (AMPAR) dynamics to explain the circadian modulation of fear conditioning paradigm in memory acquisition, recall, and extinction as seen in amygdala. Our multi-scale model captures the essential dynamics seen in the experiments and strongly supports the circadian time-of-the-day effects on learning and memory.

Neuromodulation of central pattern generators and its role in the functional recovery of central pattern generator activity

Neuromodulators play an important role in how the nervous system organizes activity that results in behavior. Disruption of the normal patterns of neuromodulatory release or production is known to be related to the onset of severe pathologies such as Parkinson's disease, Rett syndrome, Alzheimer's disease, and affective disorders. Some of these pathologies involve neuronal structures that are called central pattern generators (CPGs), which are involved in the production of rhythmic activities throughout the nervous system. Here I discuss the interplay between CPGs and neuromodulatory activity, with particular emphasis on the potential role of neuromodulators in the recovery of disrupted neuronal activity. I refer to invertebrate and vertebrate model systems and some of the lessons we have learned from research on these systems and propose a few avenues for future research. I make one suggestion that may guide future research in the field: neuromodulators restrict the parameter landscape in which CPG components operate, and the removal of neuromodulators may enable a perturbed CPG in finding a new set of parameter values that can allow it to regain normal function.

BDNF Controls Bidirectional Endocannabinoid Plasticity at Corticostriatal Synapses

The dorsal striatum exhibits bidirectional corticostriatal synaptic plasticity, NMDAR and endocannabinoids (eCB) mediated, necessary for the encoding of procedural learning. Therefore, characterizing factors controlling corticostriatal plasticity is of crucial importance. Brain-derived neurotrophic factor (BDNF) and its receptor, the tropomyosine receptor kinase-B (TrkB), shape striatal functions, and their dysfunction deeply affects basal ganglia. BDNF/TrkB signaling controls NMDAR plasticity in various brain structures including the striatum. However, despite cross-talk between BDNF and eCBs, the role of BDNF in eCB plasticity remains unknown. Here, we show that BDNF/TrkB signaling promotes eCB-plasticity (LTD and LTP) induced by rate-based (low-frequency stimulation) or spike-timing–based (spike-timing–dependent plasticity, STDP) paradigm in striatum. We show that TrkB activation is required for the expression and the scaling of both eCB-LTD and eCB-LTP. Using 2-photon imaging of dendritic spines combined with patch-clamp recordings, we show that TrkB activation prolongs intracellular calcium transients, thus increasing eCB synthesis and release. We provide a mathematical model for the dynamics of the signaling pathways involved in corticostriatal plasticity. Finally, we show that TrkB activation enlarges the domain of expression of eCB-STDP. Our results reveal a novel role for BDNF/TrkB signaling in governing eCB-plasticity expression in striatum and thus the engram of procedural learning.

From membrane receptors to protein synthesis and actin cytoskeleton: Mechanisms underlying long lasting forms of synaptic plasticity

Synaptic plasticity, the activity dependent change in synaptic strength, forms the molecular foundation of learning and memory. Synaptic plasticity includes structural changes, with spines changing their size to accomodate insertion and removal of postynaptic receptors, which are correlated with functional changes. Of particular relevance for memory storage are the long lasting forms of synaptic plasticity which are protein synthesis dependent. Due to the importance of spine structural plasticity and protein synthesis, this review focuses on the signaling pathways that connect synaptic stimulation with regulation of protein synthesis and remodeling of the actin cytoskeleton. We also review computational models that implement novel aspects of molecular signaling in synaptic plasticity, such as the role of neuromodulators and spatial microdomains, as well as highlight the need for computational models that connect activation of memory kinases with spine actin dynamics.

Constraints of Metabolic Energy on the Number of Synaptic Connections of Neurons and the Density of Neuronal Networks

Neuronal networks in the brain are the structural basis of human cognitive function, and the plasticity of neuronal networks is thought to be the principal neural mechanism underlying learning and memory. Dominated by the Hebbian theory, researchers have devoted extensive effort to studying the changes in synaptic connections between neurons. However, understanding the network topology of all synaptic connections has been neglected over the past decades. Furthermore, increasing studies indicate that synaptic activities are tightly coupled with metabolic energy, and metabolic energy is a unifying principle governing neuronal activities. Therefore, the network topology of all synaptic connections may also be governed by metabolic energy. Here, by implementing a computational model, we investigate the general synaptic organization rules for neurons and neuronal networks from the perspective of energy metabolism. We find that to maintain the energy balance of individual neurons in the proposed model, the number of synaptic connections is inversely proportional to the average of the synaptic weights. This strategy may be adopted by neurons to ensure that the ability of neurons to transmit signals matches their own energy metabolism. In addition, we find that the density of neuronal networks is also an important factor in the energy balance of neuronal networks. An abnormal increase or decrease in the network density could lead to failure of energy metabolism in the neuronal network. These rules may change our view of neuronal networks in the brain and have guiding significance for the design of neuronal network models.

Bridging the gap between striatal plasticity and learning

The striatum, the main input nucleus of the basal ganglia, controls goal-directed behavior and procedural learning. Striatal projection neurons integrate glutamatergic inputs from cortex and thalamus together with neuromodulatory systems, and are subjected to plasticity. Striatal projection neurons exhibit bidirectional plasticity (LTP and LTD) when exposed to Hebbian paradigms. Importantly, correlative and even causal links between procedural learning and striatal plasticity have recently been shown. This short review summarizes the current view on striatal plasticity (with a focus on spike-timing-dependent plasticity), recent studies aiming at bridging in vivo skill acquisition and striatal plasticity, the temporal credit-assignment problem, and the gaps that remain to be filled.

Dopamine Receptor Activation Is Required for GABAergic Spike Timing-Dependent Plasticity in Response to Complex Spike Pairing in the Ventral Tegmental Area

One of the most influential synaptic learning rules explored in the past decades is activity dependent spike-timing-dependent plasticity (STDP). In STDP, synapses are either potentiated or depressed based on the order of pre- and postsynaptic neuronal activation within narrow, milliseconds-long, time intervals. STDP is subject to neuromodulation by dopamine (DA), a potent neurotransmitter that significantly impacts synaptic plasticity and reward-related behavioral learning. Previously, we demonstrated that GABAergic synapses onto ventral tegmental area (VTA) DA neurons are able to express STDP (Kodangattil et al., 2013), however it is still unclear whether DA modulates inhibitory STDP in the VTA. Here, we used whole-cell recordings in rat midbrain slices to investigate whether DA D1-like and/or D2-like receptor (D1R/D2R) activation is required for induction of STDP in response to a complex pattern of spiking. We found that VTA but not Substantia nigra pars compact (SNc) DA neurons exhibit long-term depression (LTD_GABA) in response to a combination of positive (pre-post) and negative (post-pre) timing of spiking (a complex STDP protocol). Blockade of either D1Rs or D2Rs prevented the induction of LTD_GABA while activation of D1Rs did not affect the plasticity in response to this complex STDP protocol in VTA DA neurons.Our data suggest that this DA-dependent GABAergic STDP is selectively expressed at GABAergic synapses onto VTA DA neurons which could be targeted by drugs of abuse to mediate drug-induced modulation of DA signaling within the VTA, as well as in VTA-projection areas, thereby affecting reward-related learning and drug-associated memories.