Synaptic modification by correlated activity: Hebb's postulate revisited

Learning-prolonged maintenance of stimulus information in CA1 and subiculum during trace fear conditioning

Temporal associative learning binds discontiguous conditional stimuli (CSs) and unconditional stimuli (USs), possibly by maintaining CS information in the hippocampus after its offset. Yet, how learning regulates such maintenance of CS information in hippocampal circuits remains largely unclear. Using the auditory trace fear conditioning (TFC) paradigm, we identify a projection from the CA1 to the subiculum critical for TFC. Deep-brain calcium imaging shows that the peak of trace activity in the CA1 and subiculum is extended toward the US and that the CS representation during the trace period is enhanced during learning. Interestingly, such plasticity is consolidated only in the CA1, not the subiculum, after training. Moreover, CA1 neurons, but not subiculum neurons, increasingly become active during CS-and-trace and shock periods, respectively, and correlate with CS-evoked fear retrieval afterward. These results indicate that learning dynamically enhances stimulus information maintenance in the CA1-subiculum circuit during learning while storing CS and US memories primarily in the CA1 area.

A brain-inspired algorithm that mitigates catastrophic forgetting of artificial and spiking neural networks with low computational cost

Neuromodulators in the brain act globally at many forms of synaptic plasticity, represented as metaplasticity, which is rarely considered by existing spiking (SNNs) and nonspiking artificial neural networks (ANNs). Here, we report an efficient brain-inspired computing algorithm for SNNs and ANNs, referred to here as neuromodulation-assisted credit assignment (NACA), which uses expectation signals to induce defined levels of neuromodulators to selective synapses, whereby the long-term synaptic potentiation and depression are modified in a nonlinear manner depending on the neuromodulator level. The NACA algorithm achieved high recognition accuracy with substantially reduced computational cost in learning spatial and temporal classification tasks. Notably, NACA was also verified as efficient for learning five different class continuous learning tasks with varying degrees of complexity, exhibiting a markedly mitigated catastrophic forgetting at low computational cost. Mapping synaptic weight changes showed that these benefits could be explained by the sparse and targeted synaptic modifications attributed to expectation-based global neuromodulation.

Mean-Field Approximations With Adaptive Coupling for Networks With Spike-Timing-Dependent Plasticity

Understanding the effect of spike-timing-dependent plasticity (STDP) is key to elucidating how neural networks change over long timescales and to design interventions aimed at modulating such networks in neurological disorders. However, progress is restricted by the significant computational cost associated with simulating neural network models with STDP and by the lack of low-dimensional description that could provide analytical insights. Phase-difference-dependent plasticity (PDDP) rules approximate STDP in phase oscillator networks, which prescribe synaptic changes based on phase differences of neuron pairs rather than differences in spike timing. Here we construct mean-field approximations for phase oscillator networks with STDP to describe part of the phase space for this very high-dimensional system. We first show that single-harmonic PDDP rules can approximate a simple form of symmetric STDP, while multiharmonic rules are required to accurately approximate causal STDP. We then derive exact expressions for the evolution of the average PDDP coupling weight in terms of network synchrony. For adaptive networks of Kuramoto oscillators that form clusters, we formulate a family of low-dimensional descriptions based on the mean-field dynamics of each cluster and average coupling weights between and within clusters. Finally, we show that such a two-cluster mean-field model can be fitted to synthetic data to provide a low-dimensional approximation of a full adaptive network with symmetric STDP. Our framework represents a step toward a low-dimensional description of adaptive networks with STDP, and could for example inform the development of new therapies aimed at maximizing the long-lasting effects of brain stimulation.

How coupled slow oscillations, spindles and ripples coordinate neuronal processing and communication during human sleep

Learning and plasticity rely on fine-tuned regulation of neuronal circuits during offline periods. An unresolved puzzle is how the sleeping brain, in the absence of external stimulation or conscious effort, coordinates neuronal firing rates (FRs) and communication within and across circuits to support synaptic and systems consolidation. Using intracranial electroencephalography combined with multiunit activity recordings from the human hippocampus and surrounding medial temporal lobe (MTL) areas, we show that, governed by slow oscillation (SO) up-states, sleep spindles set a timeframe for ripples to occur. This sequential coupling leads to a stepwise increase in (1) neuronal FRs, (2) short-latency cross-correlations among local neuronal assemblies and (3) cross-regional MTL interactions. Triggered by SOs and spindles, ripples thus establish optimal conditions for spike-timing-dependent plasticity and systems consolidation. These results unveil how the sequential coupling of specific sleep rhythms orchestrates neuronal processing and communication during human sleep.

The study of plasticity has always been about gradients

The experimental study of learning and plasticity has always been driven by an implicit question: how can physiological changes be adaptive and improve performance? For example, in Hebbian plasticity only synapses from presynaptic neurons that were active are changed, avoiding useless changes. Similarly, in dopamine-gated learning synapse changes depend on reward or lack thereof and do not change when everything is predictable. Within machine learning we can make the question of which changes are adaptive concrete: performance improves when changes correlate with the gradient of an objective function quantifying performance. This result is general for any system that improves through small changes. As such, physiology has always implicitly been seeking mechanisms that allow the brain to approximate gradients. Coming from this perspective we review the existing literature on plasticity-related mechanisms, and we show how these mechanisms relate to gradient estimation. We argue that gradients are a unifying idea to explain the many facets of neuronal plasticity.

Individualized closed-loop TMS synchronized with exoskeleton for modulation of cortical-excitability in patients with stroke: a proof-of-concept study

Background

Repetitive TMS is used in stroke rehabilitation with predefined passive low and high-frequency stimulation. Brain State-Dependent Stimulation (BSDS)/Activity-Dependent Stimulation (ADS) using bio-signal has been observed to strengthen synaptic connections. Without the personalization of brain-stimulation protocols, we risk a one-size-fits-all approach.

Methods

We attempted to close the ADS loop via intrinsic-proprioceptive (via exoskeleton-movement) and extrinsic-visual-feedback to the brain. We developed a patient-specific brain stimulation platform with a two-way feedback system, to synchronize single-pulse TMS with exoskeleton along with adaptive performance visual feedback, in real-time, for a focused neurorehabilitation strategy to voluntarily engage the patient in the brain stimulation process.

Results

The novel TMS Synchronized Exoskeleton Feedback (TSEF) platform, controlled by the patient's residual Electromyogram, simultaneously triggered exoskeleton movement and single-pulse TMS, once in 10 s, implying 0.1 Hz frequency. The TSEF platform was tested for a demonstration on three patients (n = 3) with different spasticity on the Modified Ashworth Scale (MAS = 1, 1+, 2) for one session each. Three patients completed their session in their own timing; patients with (more) spasticity tend to take (more) inter-trial intervals. A proof-of-concept study on two groups-TSEF-group and a physiotherapy control-group was performed for 45 min/day for 20-sessions. Dose-matched Physiotherapy was given to control-group. Post 20 sessions, an increase in ipsilesional cortical-excitability was observed; Motor Evoked Potential increased by ~48.5 μV at a decreased Resting Motor Threshold by ~15.6%, with improvement in clinical scales relevant to the Fugl-Mayer Wrist/Hand joint (involved in training) by 2.6 units, an effect not found in control-group. This strategy could voluntarily engage the patient.

Conclusion

A brain stimulation platform with a real-time two-way feedback system was developed to voluntarily engage the patients during the brain stimulation process and a proof-of-concept study on three patients indicates clinical gains with increased cortical excitability, an effect not observed in the control-group; and the encouraging results nudge for further investigations on a larger cohort.

Brain-oscillation-synchronized stimulation to enhance motor recovery in early subacute stroke: a randomized controlled double-blind three- arm parallel-group exploratory trial comparing personalized, non- personalized and sham repetitive transcranial magnetic stimulation (Acronym: BOSS-STROKE)

BACKGROUND

Stroke is a major cause of death and the most frequent cause of permanent disability in western countries. Repetitive transcranial brain stimulation (rTMS) has been used to enhance neuronal plasticity after stroke, yet with only moderate effect sizes. Here we will apply a highly innovative technology that synchronizes rTMS to specific brain states identified by real-time analysis of electroencephalography.

METHODS

One hundred forty-four patients with early subacute ischemic motor stroke will be included in a multicenter 3-arm parallel, randomized, double-blind, standard rTMS and sham rTMS-controlled exploratory trial in Germany. In the experimental condition, rTMS will be synchronized to the trough of the sensorimotor µ-oscillation, a high-excitability state, over ipsilesional motor cortex. In the standard rTMS control condition the identical protocol will be applied, but non-synchronized to the ongoing µ-oscillation. In the sham condition, the same µ-oscillation-synchronized protocol as in experimental condition will be applied, but with ineffective rTMS, using the sham side of an active/placebo TMS coil. The treatment will be performed over five consecutive work days (1,200 pulses per day, 6,000 pulses total). The primary endpoint will be motor performance after the last treatment session as measured by the Fugl-Meyer Assessment Upper Extremity.

DISCUSSION

This study investigates, for the first time, the therapeutic efficacy of personalized, brain-state-dependent rTMS. We hypothesize that synchronization of rTMS with a high-excitability state will lead to significantly stronger improvement of paretic upper extremity motor function than standard or sham rTMS. Positive results may catalyze a paradigm-shift towards personalized brain-state-dependent stimulation therapies.

TRIAL REGISTRATION

This study was registered at ClinicalTrials.gov (NCT05600374) on 10-21-2022.

Distributing task-related neural activity across a cortical network through task-independent connections

Task-related neural activity is widespread across populations of neurons during goal-directed behaviors. However, little is known about the synaptic reorganization and circuit mechanisms that lead to broad activity changes. Here we trained a subset of neurons in a spiking network with strong synaptic interactions to reproduce the activity of neurons in the motor cortex during a decision-making task. Task-related activity, resembling the neural data, emerged across the network, even in the untrained neurons. Analysis of trained networks showed that strong untrained synapses, which were independent of the task and determined the dynamical state of the network, mediated the spread of task-related activity. Optogenetic perturbations suggest that the motor cortex is strongly-coupled, supporting the applicability of the mechanism to cortical networks. Our results reveal a cortical mechanism that facilitates distributed representations of task-variables by spreading the activity from a subset of plastic neurons to the entire network through task-independent strong synapses.

Short-term synaptic plasticity in emerging devices for neuromorphic computing

Neuromorphic computing is a promising computing paradigm toward building next-generation artificial intelligence machines, in which diverse types of synaptic plasticity play an active role in information processing. Compared to long-term plasticity (LTP) forming the foundation of learning and memory, short-term plasticity (STP) is essential for critical computational functions. So far, the practical applications of LTP have been widely investigated, whereas the implementation of STP in hardware is still elusive. Here, we review the development of STP by bridging the physics in emerging devices and biological behaviors. We explore the computational functions of various STP in biology and review their recent progress. Finally, we discuss the main challenges of introducing STP into synaptic devices and offer the potential approaches to utilize STP to enrich systems' capabilities. This review is expected to provide prospective ideas for implementing STP in emerging devices and may promote the construction of high-level neuromorphic machines.

Pairing Transcranial Magnetic Stimulation and Loud Sounds Produces Plastic Changes in Motor Output

Most current methods for neuromodulation target the cortex. Approaches for inducing plasticity in subcortical motor pathways, such as the reticulospinal tract, could help to boost recovery after damage (e.g., stroke). In this study, we paired loud acoustic stimulation (LAS) with transcranial magnetic stimulation (TMS) over the motor cortex in male and female healthy humans. LAS activates the reticular formation; TMS activates descending systems, including corticoreticular fibers. Two hundred paired stimuli were used, with 50 ms interstimulus interval at which LAS suppresses TMS responses. Before and after stimulus pairing, responses in the contralateral biceps muscle to TMS alone were measured. Ten, 20, and 30 min after stimulus pairing ended, TMS responses were enhanced, indicating the induction of LTP. No long-term changes were seen in control experiments which used 200 unpaired TMS or LAS, indicating the importance of associative stimulation. Following paired stimulation, no changes were seen in responses to direct corticospinal stimulation at the level of the medulla, or in the extent of reaction time shortening by a loud sound (StartReact effect), suggesting that plasticity did not occur in corticospinal or reticulospinal synapses. Direct measurements in female monkeys undergoing a similar paired protocol revealed no enhancement of corticospinal volleys after paired stimulation, suggesting no changes occurred in intracortical connections. The most likely substrate for the plastic changes, consistent with all our measurements, is an increase in the efficacy of corticoreticular connections. This new protocol may find utility, as it seems to target different motor circuits compared with other available paradigms.SIGNIFICANCE STATEMENT Induction of plasticity by neurostimulation protocols may be promising to enhance functional recovery after damage such as following stroke, but current protocols mainly target cortical circuits. In this study, we developed a novel paradigm which may generate long-term changes in connections between cortex and brainstem. This could provide an additional tool to modulate and improve recovery.

Biological function simulation in neuromorphic devices: from synapse and neuron to behavior

As the boom of data storage and processing, brain-inspired computing provides an effective approach to solve the current problem. Various emerging materials and devices have been reported to promote the development of neuromorphic computing. Thereinto, the neuromorphic device represented by memristor has attracted extensive research due to its outstanding property to emulate the brain's functions from synaptic plasticity, sensory-memory neurons to some intelligent behaviors of living creatures. Herein, we mainly review the progress of these brain functions mimicked by neuromorphic devices, concentrating on synapse (i.e. various synaptic plasticity trigger by electricity and/or light), neurons (including the various sensory nervous system) and intelligent behaviors (such as conditioned reflex represented by Pavlov's dog experiment). Finally, some challenges and prospects related to neuromorphic devices are presented.

Interaction between Theta Phase and Spike Timing-Dependent Plasticity Simulates Theta-Induced Memory Effects

Rodent studies suggest that spike timing relative to hippocampal theta activity determines whether potentiation or depression of synapses arise. Such changes also depend on spike timing between presynaptic and postsynaptic neurons, known as spike timing-dependent plasticity (STDP). STDP, together with theta phase-dependent learning, has inspired several computational models of learning and memory. However, evidence to elucidate how these mechanisms directly link to human episodic memory is lacking. In a computational model, we modulate long-term potentiation (LTP) and long-term depression (LTD) of STDP, by opposing phases of a simulated theta rhythm. We fit parameters to a hippocampal cell culture study in which LTP and LTD were observed to occur in opposing phases of a theta rhythm. Further, we modulated two inputs by cosine waves with 0° and asynchronous phase offsets and replicate key findings in human episodic memory. Learning advantage was found for the in-phase condition, compared with the out-of-phase conditions, and was specific to theta-modulated inputs. Importantly, simulations with and without each mechanism suggest that both STDP and theta phase-dependent plasticity are necessary to replicate the findings. Together, the results indicate a role for circuit-level mechanisms, which bridge the gap between slice preparation studies and human memory.

Neural Field Continuum Limits and the Structure-Function Partitioning of Cognitive-Emotional Brain Networks

In The cognitive-emotional brain, Pessoa overlooks continuum effects on nonlinear brain network connectivity by eschewing neural field theories and physiologically derived constructs representative of neuronal plasticity. The absence of this content, which is so very important for understanding the dynamic structure-function embedding and partitioning of brains, diminishes the rich competitive and cooperative nature of neural networks and trivializes Pessoa's arguments, and similar arguments by other authors, on the phylogenetic and operational significance of an optimally integrated brain filled with variable-strength neural connections. Riemannian neuromanifolds, containing limit-imposing metaplastic Hebbian- and antiHebbian-type control variables, simulate scalable network behavior that is difficult to capture from the simpler graph-theoretic analysis preferred by Pessoa and other neuroscientists. Field theories suggest the partitioning and performance benefits of embedded cognitive-emotional networks that optimally evolve between exotic classical and quantum computational phases, where matrix singularities and condensations produce degenerate structure-function homogeneities unrealistic of healthy brains. Some network partitioning, as opposed to unconstrained embeddedness, is thus required for effective execution of cognitive-emotional network functions and, in our new era of neuroscience, should be considered a critical aspect of proper brain organization and operation.

Artificial intelligence techniques for retinal prostheses: a comprehensive review and future direction

Objective. Retinal prostheses are promising devices to restore vision for patients with severe age-related macular degeneration or retinitis pigmentosa disease. The visual processing mechanism embodied in retinal prostheses play an important role in the restoration effect. Its performance depends on our understanding of the retina's working mechanism and the evolvement of computer vision models. Recently, remarkable progress has been made in the field of processing algorithm for retinal prostheses where the new discovery of the retina's working principle and state-of-the-arts computer vision models are combined together.Approach. We investigated the related research on artificial intelligence techniques for retinal prostheses. The processing algorithm in these studies could be attributed to three types: computer vision-related methods, biophysical models, and deep learning models.Main results. In this review, we first illustrate the structure and function of the normal and degenerated retina, then demonstrate the vision rehabilitation mechanism of three representative retinal prostheses. It is necessary to summarize the computational frameworks abstracted from the normal retina. In addition, the development and feature of three types of different processing algorithms are summarized. Finally, we analyze the bottleneck in existing algorithms and propose our prospect about the future directions to improve the restoration effect.Significance. This review systematically summarizes existing processing models for predicting the response of the retina to external stimuli. What's more, the suggestions for future direction may inspire researchers in this field to design better algorithms for retinal prostheses.

Ameliorating Hemianopia with Multisensory Training

Hemianopia (unilateral blindness), a common consequence of stroke and trauma to visual cortex, is a debilitating disorder for which there are few treatments. Research in an animal model has suggested that visual-auditory stimulation therapy, which exploits the multisensory architecture of the brain, may be effective in restoring visual sensitivity in hemianopia. It was tested in two male human patients who were hemianopic for at least 8 months following a stroke. The patients were repeatedly exposed to congruent visual-auditory stimuli within their blinded hemifield during 2 h sessions over several weeks. The results were dramatic. Both recovered the ability to detect and describe visual stimuli throughout their formerly blind field within a few weeks. They could also localize these stimuli, identify some of their features, and perceive multiple visual stimuli simultaneously in both fields. These results indicate that the multisensory therapy is a rapid and effective method for restoring visual function in hemianopia.SIGNIFICANCE STATEMENT Hemianopia (blindness on one side of space) is widely considered to be a permanent disorder. Here, we show that a simple multisensory training paradigm can ameliorate this disorder in human patients.

Asymmetric adaptivity induces recurrent synchronization in complex networks

Rhythmic activities that alternate between coherent and incoherent phases are ubiquitous in chemical, ecological, climate, or neural systems. Despite their importance, general mechanisms for their emergence are little understood. In order to fill this gap, we present a framework for describing the emergence of recurrent synchronization in complex networks with adaptive interactions. This phenomenon is manifested at the macroscopic level by temporal episodes of coherent and incoherent dynamics that alternate recurrently. At the same time, the dynamics of the individual nodes do not change qualitatively. We identify asymmetric adaptation rules and temporal separation between the adaptation and the dynamics of individual nodes as key features for the emergence of recurrent synchronization. Our results suggest that asymmetric adaptation might be a fundamental ingredient for recurrent synchronization phenomena as seen in pattern generators, e.g., in neuronal systems.

Retina-Inspired Organic Photonic Synapses for Selective Detection of SWIR Light

Photonic synapses with the dual function of optical signal detection and information processing can simulate human visual system. However, photonic synapses with selective detection of short-wavelength infrared (SWIR) light have never been reported, which can not only broaden the human vision region but also integrate neuromorphic computation and infrared optical communication. Here, organic photonic synapses based on a new donor-acceptor copolymer P1 are fabricated, which exhibit excellent synaptic characteristics with selective detection for SWIR and extremely low energy consumption (2.85 fJ). The working mechanism is rooted in energy level barriers and unbalanced charge transportation. Moreover, these photonic synapses demonstrate excellent performance in multi-signal logic editing, letter imaging and memory with noise reduction function. This contribution provides ideas of constructing selective-response synapses for artificial visual system and neuromorphic computing.

TMS and neocortical neurons: an integrative review on the micro-macro connection in neuroplasticity

Tian D, Izumi S. TMS and neocortical neurons: an integrative review on the micro-macro connection in neuroplasticity. Jpn J Compr Rehabil Sci 2023; 14: 1-9. Neuroplasticity plays a pivotal role in neuroscience and neurorehabilitation as it bridges the organization and reorganization properties of the brain. Among the numerous neuroplastic protocols, transcranial magnetic stimulation (TMS) is a well-established non-invasive protocol to induce plastic changes in the brain. Here, we review the findings of four plasticity-inducing TMS protocols in the human motor cortex with relatively evident mechanisms: conventional repetitive TMS (rTMS), theta-burst stimulation (TBS), quadripulse stimulation (QPS) and paired associative stimulation (PAS). Based on the reviewed evidence and a preliminary TMS neurocytological model proposed in our previous report, we further integrate the neurophysiological evidence and plasticity rules of these protocols to present an updated micro-macro connection model between neocortical neurons and the neurophysiological evidence in TMS. This prototypical model will guide further efforts to understand the neural circuit of the motor cortex, the mechanisms of TMS, and the advance of neuroplasticity technologies and their outcomes.

Dopaminergic regulation of hippocampal plasticity, learning, and memory

The hippocampus is responsible for encoding behavioral episodes into short-term and long-term memory. The circuits that mediate these processes are subject to neuromodulation, which involves regulation of synaptic plasticity and local neuronal excitability. In this review, we present evidence to demonstrate the influence of dopaminergic neuromodulation on hippocampus-dependent memory, and we address the controversy surrounding the source of dopamine innervation. First, we summarize historical and recent retrograde and anterograde anatomical tracing studies of direct dopaminergic projections from the ventral tegmental area and discuss dopamine release from the adrenergic locus coeruleus. Then, we present evidence of dopaminergic modulation of synaptic plasticity in the hippocampus. Plasticity mechanisms are examined in brain slices and in recordings from in vivo neuronal populations in freely moving rodents. Finally, we review pharmacological, genetic, and circuitry research that demonstrates the importance of dopamine release for learning and memory tasks while dissociating anatomically distinct populations of direct dopaminergic inputs.

Natural Organic Materials Based Memristors and Transistors for Artificial Synaptic Devices in Sustainable Neuromorphic Computing Systems

Natural organic materials such as protein and carbohydrates are abundant in nature, renewable, and biodegradable, desirable for the construction of artificial synaptic devices for emerging neuromorphic computing systems with energy efficient operation and environmentally friendly disposal. These artificial synaptic devices are based on memristors or transistors with the memristive layer or gate dielectric formed by natural organic materials. The fundamental requirement for these synaptic devices is the ability to mimic the memory and learning behaviors of biological synapses. This paper reviews the synaptic functions emulated by a variety of artificial synaptic devices based on natural organic materials and provides a useful guidance for testing and investigating more of such devices.

How can artificial neural networks approximate the brain?

The article reviews the history development of artificial neural networks (ANNs), then compares the differences between ANNs and brain networks in their constituent unit, network architecture, and dynamic principle. The authors offer five points of suggestion for ANNs development and ten questions to be investigated further for the interdisciplinary field of brain simulation. Even though brain is a super-complex system with 1011 neurons, its intelligence does depend rather on the neuronal type and their energy supply mode than the number of neurons. It might be possible for ANN development to follow a new direction that is a combination of multiple modules with different architecture principle and multiple computation, rather than very large scale of neural networks with much more uniformed units and hidden layers.

Transcranial cortico-cortical paired associative stimulation (ccPAS) over ventral premotor-motor pathways enhances action performance and corticomotor excitability in young adults more than in elderly adults

Transcranial magnetic stimulation (TMS) methods such as cortico-cortical paired associative stimulation (ccPAS) can increase the strength of functional connectivity between ventral premotor cortex (PMv) and primary motor cortex (M1) via spike timing-dependent plasticity (STDP), leading to enhanced motor functions in young adults. However, whether this STDP-inducing protocol is effective in the aging brain remains unclear. In two groups of young and elderly healthy adults, we evaluated manual dexterity with the 9-hole peg task before and after ccPAS of the left PMv-M1 circuit. We observed that ccPAS enhanced dexterity in young adults, and this effect was anticipated by a progressive increase in motor-evoked potentials (MEPs) during ccPAS administration. No similar effects were observed in elderly individuals or in a control task. Across age groups, we observed that the magnitude of MEP changes predicted larger behavioral improvements. These findings demonstrate that left PMv-to-M1 ccPAS induces functionally specific improvements in young adults' manual dexterity and an increase in corticomotor excitability, but altered plasticity prevents the effectiveness of ccPAS in the elderly.

Forgetting memristor based STDP learning circuit for neural networks

The circuit implementation of STDP based on memristor is of great significance for the application of neural network. However, recent research shows that the research on the pure circuit implementation of forgetting memristor and STDP is still rare. This paper proposes a new STDP learning rule implementation circuit based on the forgetting memristor. This kind of forgetting memory resistance synapse makes the neural network have the function of time-division multiplexing, but the instability of short-term memory will affect the learning ability of the neural network. This paper analyzes and discusses the influence of synapses with long-term and short-term memory on the learning characteristics of neural network STDP, which lays a foundation for the construction of time-division multiplexing neural network with long-term and short-term memory synapses. Through this circuit, it is found that the volatile memristor has different behaviors to the stimulus signal in different initial states, and the resulting LTP phenomenon is more in line with the forgetting effect in biology. This circuit has multiple adjustable parameters, which can fit the STDP learning rules under different conditions. The application of neural network proves the availability of this circuit.

Tuning Convolutional Spiking Neural Network With Biologically Plausible Reward Propagation

Spiking neural networks (SNNs) contain more biologically realistic structures and biologically inspired learning principles than those in standard artificial neural networks (ANNs). SNNs are considered the third generation of ANNs, powerful on the robust computation with a low computational cost. The neurons in SNNs are nondifferential, containing decayed historical states and generating event-based spikes after their states reaching the firing threshold. These dynamic characteristics of SNNs make it difficult to be directly trained with the standard backpropagation (BP), which is also considered not biologically plausible. In this article, a biologically plausible reward propagation (BRP) algorithm is proposed and applied to the SNN architecture with both spiking-convolution (with both 1-D and 2-D convolutional kernels) and full-connection layers. Unlike the standard BP that propagates error signals from postsynaptic to presynaptic neurons layer by layer, the BRP propagates target labels instead of errors directly from the output layer to all prehidden layers. This effort is more consistent with the top-down reward-guiding learning in cortical columns of the neocortex. Synaptic modifications with only local gradient differences are induced with pseudo-BP that might also be replaced with the spike-timing-dependent plasticity (STDP). The performance of the proposed BRP-SNN is further verified on the spatial (including MNIST and Cifar-10) and temporal (including TIDigits and DvsGesture) tasks, where the SNN using BRP has reached a similar accuracy compared to other state-of-the-art (SOTA) BP-based SNNs and saved 50% more computational cost than ANNs. We think that the introduction of biologically plausible learning rules to the training procedure of biologically realistic SNNs will give us more hints and inspiration toward a better understanding of the biological system's intelligent nature.

Aftereffects of Frontoparietal Theta tACS on Verbal Working Memory: Behavioral and Neurophysiological Analysis

Verbal working memory is supported by a left-lateralized frontoparietal theta oscillatory (4–8 Hz) network. We tested whether stimulating the left frontoparietal network at theta frequency during verbal working memory can produce observable after-stimulation effects in behavior and neurophysiology. Weak theta-band alternating electric currents were delivered via two 4 × 1 HD electrode arrays centered at F3 and P3. Three stimulation configurations, including in-phase, anti-phase, or sham, were tested on three different days in a cross-over (within-subject) design. On each test day, the subject underwent three experimental sessions: pre-, during- and post-stimulation sessions. In all sessions, the subject performed a Sternberg verbal working memory task with three levels of memory load (load 2, 4 and 6), imposing three levels of cognitive demand. Analyzing behavioral and EEG data from the post-stimulation session, we report two main observations. First, in-phase stimulation improved task performance in subjects with higher working memory capacity (WMC) under higher memory load (load 6). Second, in-phase stimulation enhanced frontoparietal theta synchrony during working memory retention in subjects with higher WMC under higher memory loads (load 4 and load 6), and the enhanced frontoparietal theta synchronization is mainly driven by enhanced frontal→parietal theta Granger causality. These observations suggest that (1) in-phase theta transcranial alternating current stimulation (tACS) during verbal working memory can result in observable behavioral and neurophysiological consequences post stimulation, (2) the short-term plasticity effects are state- and individual-dependent, and (3) enhanced executive control underlies improved behavioral performance.

•

Frontoparietal network was stimulated at theta frequency (4 - 8Hz) during verbal working memory and aftereffeccts analyzed

•

In-phase frontoparietal theta stimulation improved working memory performance in participants with higher working memory capacity

•

Enhanced behavioral performance was accompanied by enhanced frontoparietal theta synchrony

•

Enhanced frontoparietal theta synchronization was driven by enhanced frontal→parietal theta Granger causality

Brian2CUDA: Flexible and Efficient Simulation of Spiking Neural Network Models on GPUs

Graphics processing units (GPUs) are widely available and have been used with great success to accelerate scientific computing in the last decade. These advances, however, are often not available to researchers interested in simulating spiking neural networks, but lacking the technical knowledge to write the necessary low-level code. Writing low-level code is not necessary when using the popular Brian simulator, which provides a framework to generate efficient CPU code from high-level model definitions in Python. Here, we present Brian2CUDA, an open-source software that extends the Brian simulator with a GPU backend. Our implementation generates efficient code for the numerical integration of neuronal states and for the propagation of synaptic events on GPUs, making use of their massively parallel arithmetic capabilities. We benchmark the performance improvements of our software for several model types and find that it can accelerate simulations by up to three orders of magnitude compared to Brian's CPU backend. Currently, Brian2CUDA is the only package that supports Brian's full feature set on GPUs, including arbitrary neuron and synapse models, plasticity rules, and heterogeneous delays. When comparing its performance with Brian2GeNN, another GPU-based backend for the Brian simulator with fewer features, we find that Brian2CUDA gives comparable speedups, while being typically slower for small and faster for large networks. By combining the flexibility of the Brian simulator with the simulation speed of GPUs, Brian2CUDA enables researchers to efficiently simulate spiking neural networks with minimal effort and thereby makes the advancements of GPU computing available to a larger audience of neuroscientists.

A brain-inspired intention prediction model and its applications to humanoid robot

With the development of artificial intelligence and robotic technology in recent years, robots are gradually integrated into human daily life. Most of the human-robot interaction technologies currently applied to home service robots are programmed by the manufacturer first, and then instruct the user to trigger the implementation through voice commands or gesture commands. Although these methods are simple and effective, they lack some flexibility, especially when the programming program is contrary to user habits, which will lead to a significant decline in user experience satisfaction. To make that robots can better serve human beings, adaptable, simple, and flexible human-robot interaction technology is essential. Based on the neural mechanism of reinforcement learning, we propose a brain-inspired intention prediction model to enable the robot to perform actions according to the user's intention. With the spike-timing-dependent plasticity (STDP) mechanisms and the simple feedback of right or wrong, the humanoid robot NAO could successfully predict the user's intentions in Human Intention Prediction Experiment and Trajectory Tracking Experiment. Compared with the traditional Q-learning method, the training times required by the proposed model are reduced by (N² − N)/4, where N is the number of intentions.

Neural synchrony in cortical networks: mechanisms and implications for neural information processing and coding

Synchronization of neuronal discharges on the millisecond scale has long been recognized as a prevalent and functionally important attribute of neural activity. In this article, I review classical concepts and corresponding evidence of the mechanisms that govern the synchronization of distributed discharges in cortical networks and relate those mechanisms to their possible roles in coding and cognitive functions. To accommodate the need for a selective, directed synchronization of cells, I propose that synchronous firing of distributed neurons is a natural consequence of spike-timing-dependent plasticity (STDP) that associates cells repetitively receiving temporally coherent input: the “synchrony through synaptic plasticity” hypothesis. Neurons that are excited by a repeated sequence of synaptic inputs may learn to selectively respond to the onset of this sequence through synaptic plasticity. Multiple neurons receiving coherent input could thus actively synchronize their firing by learning to selectively respond at corresponding temporal positions. The hypothesis makes several predictions: first, the position of the cells in the network, as well as the source of their input signals, would be irrelevant as long as their input signals arrive simultaneously; second, repeating discharge patterns should get compressed until all or some part of the signals are synchronized; and third, this compression should be accompanied by a sparsening of signals. In this way, selective groups of cells could emerge that would respond to some recurring event with synchronous firing. Such a learned response pattern could further be modulated by synchronous network oscillations that provide a dynamic, flexible context for the synaptic integration of distributed signals. I conclude by suggesting experimental approaches to further test this new hypothesis.

Multi-Stimuli-Responsive Synapse Based on Vertical van der Waals Heterostructures

Brain-inspired intelligent systems demand diverse neuromorphic devices beyond simple functionalities. Merging biomimetic sensing with weight-updating capabilities in artificial synaptic devices represents one of the key research focuses. Here, we report a multiresponsive synapse device that integrates synaptic and optical-sensing functions. The device adopts vertically stacked graphene/h-BN/WSe₂ heterostructures, including an ultrahigh-mobility readout layer, a weight-control layer, and a dual-stimuli-responsive layer. The unique structure endows synapse devices with excellent synaptic plasticity, short response time (3 μs), and excellent optical responsivity (10⁵ A/W). To demonstrate the application in neuromorphic computing, handwritten digit recognition was simulated based on an unsupervised spiking neural network (SNN) with a precision of 90.89%, well comparable with the state-of-the-art results. Furthermore, multiterminal neuromorphic devices are demonstrated to mimic dendritic integration and photoswitching logic. Different from other synaptic devices, the research work validates multifunctional integration in synaptic devices, supporting the potential fusion of sensing and self-learning in neuromorphic networks.

Network resonance can be generated independently at distinct levels of neuronal organization

Resonance is defined as maximal response of a system to periodic inputs in a limited frequency band. Resonance may serve to optimize inter-neuronal communication, and has been observed at multiple levels of neuronal organization. However, it is unknown how neuronal resonance observed at the network level is generated and how network resonance depends on the properties of the network building blocks. Here, we first develop a metric for quantifying spike timing resonance in the presence of background noise, extending the notion of spiking resonance for in vivo experiments. Using conductance-based models, we find that network resonance can be inherited from resonances at other levels of organization, or be intrinsically generated by combining mechanisms across distinct levels. Resonance of membrane potential fluctuations, postsynaptic potentials, and single neuron spiking can each be generated independently of resonance at any other level and be propagated to the network level. At all levels of organization, interactions between processes that give rise to low- and high-pass filters generate the observed resonance. Intrinsic network resonance can be generated by the combination of filters belonging to different levels of organization. Inhibition-induced network resonance can emerge by inheritance from resonance of membrane potential fluctuations, and be sharpened by presynaptic high-pass filtering. Our results demonstrate a multiplicity of qualitatively different mechanisms that can generate resonance in neuronal systems, and provide analysis tools and a conceptual framework for the mechanistic investigation of network resonance in terms of circuit components, across levels of neuronal organization.

How one part of the brain responds to periodic input from another part depends on resonant circuit properties. Resonance is a basic property of physical systems, and has been experimentally observed at various levels of neuronal organization both in vitro and in vivo. Yet how resonance is generated in neuronal networks is largely unknown. In particular, whether resonance can be generated directly at the level of a network of spiking neurons remains to be determined. Using detailed biophysical modeling, we develop a conceptual framework according to which resonance at a given level of organization is generated by the interplay of low- and high-pass filters, implemented at either the same or across levels of neuronal organization. We tease apart representative, biophysically-plausible generative mechanisms of resonance at four different levels of organization: membrane potential fluctuations, single neuron spiking, synaptic transmission, and neuronal networks. We identify conditions under which resonance at one level can be inherited to another level of organization, provide conclusive evidence that resonance at each level can be generated without resonance at any other level, and describe a number of representative routes to network resonance. The proposed framework facilitates the investigation of resonance in neuronal systems.

DNA Strand-Displacement Temporal Logic Circuits

Molecular circuits capable of processing temporal information are essential for complex decision making in response to both the presence and history of a molecular environment. A particular type of temporal information that has been recognized to be important is the relative timing of signals. Here we demonstrate the strategy of temporal memory combined with logic computation in DNA strand-displacement circuits capable of making decisions based on specific combinations of inputs as well as their relative timing. The circuit encodes the timing information on inputs in a set of memory strands, which allows for the construction of logic gates that act on current and historical signals. We show that mismatches can be employed to reduce the complexity of circuit design and that shortening specific toeholds can be useful for improving the robustness of circuit behavior. We also show that a detailed model can provide critical insights for guiding certain aspects of experimental investigations that an abstract model cannot. We envision that the design principles explored in this study can be generalized to more complex temporal logic circuits and incorporated into other types of circuit architectures, including DNA-based neural networks, enabling the implementation of timing-dependent learning rules and opening up new opportunities for embedding intelligent behaviors into artificial molecular machines.

Multisensory Concept Learning Framework Based on Spiking Neural Networks

Concept learning highly depends on multisensory integration. In this study, we propose a multisensory concept learning framework based on brain-inspired spiking neural networks to create integrated vectors relying on the concept's perceptual strength of auditory, gustatory, haptic, olfactory, and visual. With different assumptions, two paradigms: Independent Merge (IM) and Associate Merge (AM) are designed in the framework. For testing, we employed eight distinct neural models and three multisensory representation datasets. The experiments show that integrated vectors are closer to human beings than the non-integrated ones. Furthermore, we systematically analyze the similarities and differences between IM and AM paradigms and validate the generality of our framework.

The neural coding framework for learning generative models

Neural generative models can be used to learn complex probability distributions from data, to sample from them, and to produce probability density estimates. We propose a computational framework for developing neural generative models inspired by the theory of predictive processing in the brain. According to predictive processing theory, the neurons in the brain form a hierarchy in which neurons in one level form expectations about sensory inputs from another level. These neurons update their local models based on differences between their expectations and the observed signals. In a similar way, artificial neurons in our generative models predict what neighboring neurons will do, and adjust their parameters based on how well the predictions matched reality. In this work, we show that the neural generative models learned within our framework perform well in practice across several benchmark datasets and metrics and either remain competitive with or significantly outperform other generative models with similar functionality (such as the variational auto-encoder).

Memristive LIF Spiking Neuron Model and Its Application in Morse Code

The leaky integrate-and-fire (LIF) spiking model can successively mimic the firing patterns and information propagation of a biological neuron. It has been applied in neural networks, cognitive computing, and brain-inspired computing. Due to the resistance variability and the natural storage capacity of the memristor, the LIF spiking model with a memristor (MLIF) is presented in this article to simulate the function and working mode of neurons in biological systems. First, the comparison between the MLIF spiking model and the LIF spiking model is conducted. Second, it is experimentally shown that a single memristor could mimic the function of the integration and filtering of the dendrite and emulate the function of the integration and firing of the soma. Finally, the feasibility of the proposed MLIF spiking model is verified by the generation and recognition of Morse code. The experimental results indicate that the presented MLIF model efficiently performs good biological frequency adaptation, high firing frequency, and rich spiking patterns. A memristor can be used as the dendrite and the soma, and the MLIF spiking model can emulate the axon. The constructed single neuron can efficiently complete the generation and propagation of firing patterns.

Optimal reinforcement learning near the edge of a synchronization transition

Recent experimental and theoretical studies have indicated that the putative criticality of cortical dynamics may correspond to a synchronization phase transition. The critical dynamics near such a critical point needs further investigation specifically when compared to the critical behavior near the standard absorbing state phase transition. Since the phenomena of learning and self-organized criticality (SOC) at the edge of synchronization transition can emerge jointly in spiking neural networks due to the presence of spike-timing dependent plasticity (STDP), it is tempting to ask the following: what is the relationship between synchronization and learning in neural networks? Further, does learning benefit from SOC at the edge of synchronization transition? In this paper, we intend to address these important issues. Accordingly, we construct a biologically inspired model of a cognitive system which learns to perform stimulus-response tasks. We train this system using a reinforcement learning rule implemented through dopamine-modulated STDP. We find that the system exhibits a continuous transition from synchronous to asynchronous neural oscillations upon increasing the average axonal time delay. We characterize the learning performance of the system and observe that it is optimized near the synchronization transition. We also study neuronal avalanches in the system and provide evidence that optimized learning is achieved in a slightly supercritical state.

'Stateful' threshold switching for neuromorphic learning

Memristors have promising prospects in developing neuromorphic chips that parallel the brain-level power efficiency and brain-like computational functions. However, the limited available ON/OFF states and high switching voltage in conventional resistive switching (RS) constrain its practical and flexible implementations to emulate biological synaptic functions with low power consumption. We present 'stateful' threshold switching (TS) within the millivoltage range depending on the resistive states of RS, which originates from the charging/discharging parasitic elements of a memristive circuit. Fundamental neuromorphic learning can be facilely implemented based on a single memristor by utilizing four resistive states in 'stateful' TS. Besides the metaplasticity of synaptic learning-forgetting behaviors, multifunctional associative learning, involving acquisition, extinction, recovery, generalization and protective inhibition, was realized with nonpolar operation and power consumption of 5.71 pW. The featured 'stateful' TS with flexible tunability, enriched states, and ultralow operating voltage will provide new directions toward a massive storage unit and bio-inspired neuromorphic system.

Adaptive erasure of spurious sequences in sensory cortical circuits

Sequential activity reflecting previously experienced temporal sequences is considered a hallmark of learning across cortical areas. However, it is unknown how cortical circuits avoid the converse problem: producing spurious sequences that are not reflecting sequences in their inputs. We develop methods to quantify and study sequentiality in neural responses. We show that recurrent circuit responses generally include spurious sequences, which are specifically prevented in circuits that obey two widely known features of cortical microcircuit organization: Dale’s law and Hebbian connectivity. In particular, spike-timing-dependent plasticity in excitation-inhibition networks leads to an adaptive erasure of spurious sequences. We tested our theory in multielectrode recordings from the visual cortex of awake ferrets. Although responses to natural stimuli were largely non-sequential, responses to artificial stimuli initially included spurious sequences, which diminished over extended exposure. These results reveal an unexpected role for Hebbian experience-dependent plasticity and Dale’s law in sensory cortical circuits.

•

Recurrent circuits generate spurious sequences without sequential inputs

•

A principled measure of total sequentiality in population responses is developed

•

Theory predicts that Hebbian plasticity should abolish spurious sequences

•

Spurious sequences in the visual cortex diminish with experience

Toward Efficient Processing and Learning With Spikes: New Approaches for Multispike Learning

Spikes are the currency in central nervous systems for information transmission and processing. They are also believed to play an essential role in low-power consumption of the biological systems, whose efficiency attracts increasing attentions to the field of neuromorphic computing. However, efficient processing and learning of discrete spikes still remain a challenging problem. In this article, we make our contributions toward this direction. A simplified spiking neuron model is first introduced with the effects of both synaptic input and firing output on the membrane potential being modeled with an impulse function. An event-driven scheme is then presented to further improve the processing efficiency. Based on the neuron model, we propose two new multispike learning rules which demonstrate better performance over other baselines on various tasks, including association, classification, and feature detection. In addition to efficiency, our learning rules demonstrate high robustness against the strong noise of different types. They can also be generalized to different spike coding schemes for the classification task, and notably, the single neuron is capable of solving multicategory classifications with our learning rules. In the feature detection task, we re-examine the ability of unsupervised spike-timing-dependent plasticity with its limitations being presented, and find a new phenomenon of losing selectivity. In contrast, our proposed learning rules can reliably solve the task over a wide range of conditions without specific constraints being applied. Moreover, our rules cannot only detect features but also discriminate them. The improved performance of our methods would contribute to neuromorphic computing as a preferable choice.

From Biological Synapses to “Intelligent” Robots

This selective review explores biologically inspired learning as a model for intelligent robot control and sensing technology on the basis of specific examples. Hebbian synaptic learning is discussed as a functionally relevant model for machine learning and intelligence, as explained on the basis of examples from the highly plastic biological neural networks of invertebrates and vertebrates. Its potential for adaptive learning and control without supervision, the generation of functional complexity, and control architectures based on self-organization is brought forward. Learning without prior knowledge based on excitatory and inhibitory neural mechanisms accounts for the process through which survival-relevant or task-relevant representations are either reinforced or suppressed. The basic mechanisms of unsupervised biological learning drive synaptic plasticity and adaptation for behavioral success in living brains with different levels of complexity. The insights collected here point toward the Hebbian model as a choice solution for “intelligent” robotics and sensor systems.

Heterogeneous Responses to Changes in Inhibitory Synaptic Strength in Networks of Spiking Neurons

How does the dynamics of neurons in a network respond to changes in synaptic weights? Answer to this question would be important for a full understanding of synaptic plasticity. In this article, we report our numerical study of the effects of changes in inhibitory synaptic weights on the spontaneous activity of networks of spiking neurons with conductance-based synapses. Networks with biologically realistic features, which were reconstructed from multi-electrode array recordings taken in a cortical neuronal culture, and their modifications were used in the simulations. The magnitudes of the synaptic weights of all the inhibitory connections are decreased by a uniform amount subjecting to the condition that inhibitory connections would not be turned into excitatory ones. Our simulation results reveal that the responses of the neurons are heterogeneous: while the firing rate of some neurons increases as expected, the firing rate of other neurons decreases or remains unchanged. The same results show that heterogeneous responses also occur for an enhancement of inhibition. This heterogeneity in the responses of neurons to changes in inhibitory synaptic strength suggests that activity-induced modification of synaptic strength does not necessarily generate a positive feedback loop on the dynamics of neurons connected in a network. Our results could be used to understand the effects of bicuculline on spiking and bursting activities of neuronal cultures. Using reconstructed networks with biologically realistic features enables us to identify a long-tailed distribution of average synaptic weights for outgoing links as a crucial feature in giving rise to bursting in neuronal networks and in determining the overall response of the whole network to changes in synaptic strength. For networks whose average synaptic weights for outgoing links have a long-tailed distribution, bursting is observed and the average firing rate of the whole network increases upon inhibition suppression or decreases upon inhibition enhancement. For networks whose average synaptic weights for outgoing links are approximately normally distributed, bursting is not found and the average firing rate of the whole network remains approximately constant upon changes in inhibitory synaptic strength.

Strength-frequency curve for micromagnetic neurostimulation through excitatory postsynaptic potentials (EPSPs) on rat hippocampal neurons and numerical modeling of magnetic microcoil (μcoil)

OBJECTIVE

The objective of this study was to measure the effect of micromagnetic stimulation (μMS) on hippocampal neurons, by using single microcoil (μcoil) prototype, Magnetic Pen (MagPen). MagPen will be used to stimulate the CA3 magnetically and excitatory post synaptic potential (EPSP) measurements will be made from the CA1. The threshold for μMS as a function of stimulation frequency of the current driving the µcoil will be demonstrated. Finally, the optimal stimulation frequency of the current driving the μcoil to minimize power will be estimated.

APPROACH

A biocompatible prototype, MagPen was built, and customized such that it is easy to adjust the orientation of the μcoil over the hippocampal tissue in an in vitro setting. Finite element modeling (FEM) of the μcoil was performed to estimate the spatial profiles of the magnetic flux density (in T) and the induced electric fields (in V/m). The induced electric field profiles generated at different values of current applied to the µcoil whether can elicit a neuron response was validated by numerical modeling. The modeling settings were replicated in experiments on rat hippocampal neurons.

MAIN RESULTS

The preferred orientation of MagPen over the Schaffer Collateral fibers was demonstrated such that they elicit a neuron response. The recorded EPSPs from CA1 due to μMS at CA3 were validated by applying tetrodotoxin (TTX). Finally, it was interpreted through numerical analysis that increasing frequency of the current driving the μcoil, led to a decrease in the current amplitude threshold for μMS.

SIGNIFICANCE

This work reports that μMS can be used to evoke population EPSPs in the CA1 of hippocampus. It demonstrates the strength-frequency curve for µMS and its unique features related to orientation dependence of the µcoils, spatial selectivity and distance dependence. Finally, the challenges related to µMS experiments were studied including ways to overcome them.

Predictive Neuronal Adaptation as a Basis for Consciousness

Being able to correctly predict the future and to adjust own actions accordingly can offer a great survival advantage. In fact, this could be the main reason why brains evolved. Consciousness, the most mysterious feature of brain activity, also seems to be related to predicting the future and detecting surprise: a mismatch between actual and predicted situation. Similarly at a single neuron level, predicting future activity and adapting synaptic inputs accordingly was shown to be the best strategy to maximize the metabolic energy for a neuron. Following on these ideas, here we examined if surprise minimization by single neurons could be a basis for consciousness. First, we showed in simulations that as a neural network learns a new task, then the surprise within neurons (defined as the difference between actual and expected activity) changes similarly to the consciousness of skills in humans. Moreover, implementing adaptation of neuronal activity to minimize surprise at fast time scales (tens of milliseconds) resulted in improved network performance. This improvement is likely because adapting activity based on the internal predictive model allows each neuron to make a more "educated" response to stimuli. Based on those results, we propose that the neuronal predictive adaptation to minimize surprise could be a basic building block of conscious processing. Such adaptation allows neurons to exchange information about own predictions and thus to build more complex predictive models. To be precise, we provide an equation to quantify consciousness as the amount of surprise minus the size of the adaptation error. Since neuronal adaptation can be studied experimentally, this can allow testing directly our hypothesis. Specifically, we postulate that any substance affecting neuronal adaptation will also affect consciousness. Interestingly, our predictive adaptation hypothesis is consistent with multiple ideas presented previously in diverse theories of consciousness, such as global workspace theory, integrated information, attention schema theory, and predictive processing framework. In summary, we present a theoretical, computational, and experimental support for the hypothesis that neuronal adaptation is a possible biological mechanism of conscious processing, and we discuss how this could provide a step toward a unified theory of consciousness.

Adaptive rewiring in nonuniform coupled oscillators

Structural plasticity of the brain can be represented in a highly simplified form as adaptive rewiring, the relay of connections according to the spontaneous dynamic synchronization in network activity. Adaptive rewiring, over time, leads from initial random networks to brain-like complex networks, that is, networks with modular small-world structures and a rich-club effect. Adaptive rewiring has only been studied, however, in networks of identical oscillators with uniform or random coupling strengths. To implement information-processing functions (e.g., stimulus selection or memory storage), it is necessary to consider symmetry-breaking perturbations of oscillator amplitudes and coupling strengths. We studied whether nonuniformities in amplitude or connection strength could operate in tandem with adaptive rewiring. Throughout network evolution, either amplitude or connection strength of a subset of oscillators was kept different from the rest. In these extreme conditions, subsets might become isolated from the rest of the network or otherwise interfere with the development of network complexity. However, whereas these subsets form distinctive structural and functional communities, they generally maintain connectivity with the rest of the network and allow the development of network complexity. Pathological development was observed only in a small proportion of the models. These results suggest that adaptive rewiring can robustly operate alongside information processing in biological and artificial neural networks.

Oscillations support short latency co-firing of neurons during human episodic memory formation

Theta and gamma oscillations in the medial temporal lobe are suggested to play a critical role for human memory formation via establishing synchrony in neural assemblies. Arguably, such synchrony facilitates efficient information transfer between neurons and enhances synaptic plasticity, both of which benefit episodic memory formation. However, to date little evidence exists from humans that would provide direct evidence for such a specific role of theta and gamma oscillations for episodic memory formation. Here, we investigate how oscillations shape the temporal structure of neural firing during memory formation in the medial temporal lobe. We measured neural firing and local field potentials in human epilepsy patients via micro-wire electrode recordings to analyze whether brain oscillations are related to co-incidences of firing between neurons during successful and unsuccessful encoding of episodic memories. The results show that phase-coupling of neurons to faster theta and gamma oscillations correlates with co-firing at short latencies (~20-30 ms) and occurs during successful memory formation. Phase-coupling at slower oscillations in these same frequency bands, in contrast, correlates with longer co-firing latencies and occurs during memory failure. Thus, our findings suggest that neural oscillations play a role for the synchronization of neural firing in the medial temporal lobe during the encoding of episodic memories.

Activity dependent stimulation increases synaptic efficacy in spared pathways in an anesthetized rat model of spinal cord contusion injury

BACKGROUND

Closed-loop neuromodulation systems have received increased attention in recent years as potential therapeutic approaches for treating neurological injury and disease.

OBJECTIVE

The purpose of this study was to assess the ability of intraspinal microstimulation (ISMS), triggered by action potentials (spikes) recorded in motor cortex, to alter synaptic efficacy in descending motor pathways in an anesthetized rat model of spinal cord injury (SCI).

METHODS

Experiments were carried out in adult, male, Sprague Dawley rats with a moderate contusion injury at T8. For activity-dependent stimulation (ADS) sessions, a recording microelectrode was used to detect neuronal spikes in motor cortex that triggered ISMS in the spinal cord grey matter. SCI rats were randomly assigned to one of four experimental groups differing by: a) cortical spike-ISMS stimulus delay (10 or 25 ms) and b) number of ISMS pulses (1 or 3). Four weeks after SCI, ADS sessions were conducted in three consecutive 1-hour conditioning bouts for a total of 3 hours. At the end of each conditioning bout, changes in synaptic efficacy were assessed using intracortical microstimulation (ICMS) to examine the number of spikes evoked in spinal cord neurons during 5-minute test bouts. A multichannel microelectrode recording array was used to record cortically-evoked spike activity from multiple layers of the spinal cord.

RESULTS

The results showed that ADS resulted in an increase in cortically-evoked spikes in spinal cord neurons at specific combinations of spike-ISMS delays and numbers of pulses. Efficacy in descending motor pathways was increased throughout all dorsoventral depths of the hindlimb spinal cord.

CONCLUSIONS

These results show that after an SCI, ADS can increase synaptic efficacy in spared pathways between motor cortex and spinal cord. This study provides further support for the potential of ADS therapy as an effective method for enhancing descending motor control after SCI.

Noise-induced network bursts and coherence in a calcium-mediated neural network

Noise-induced population bursting has been widely identified to play important roles in information processes. We construct a mathematical model for a random and sparse heterogeneous neural network where bursting can be induced from a resting state by a global stochastic stimulus. Importantly, the noise-induced bursting dynamics of this network are mediated by calcium conductance. We use two spectral measures to evaluate network coherence in the context of the network bursts, the spike trains of all neurons, and the individual bursts of all neurons. Our results show that the coherence of the network is optimized by an optimal level of the stochastic stimulus, which is known as coherence resonance (CR). We also demonstrate that the interplay of the calcium conductance and noise intensity can modify the degree of CR.

Distributed Phase Oscillatory Excitation Efficiently Produces Attractors Using Spike-Timing-Dependent Plasticity

The brain is thought to represent information in the form of activity in distributed groups of neurons known as attractors. We show here that in a randomly connected network of simulated spiking neurons, periodic stimulation of neurons with distributed phase offsets, along with standard spike-timing-dependent plasticity (STDP), efficiently creates distributed attractors. These attractors may have a consistent ordered firing pattern or become irregular, depending on the conditions. We also show that when two such attractors are stimulated in sequence, the same STDP mechanism can create a directed association between them, forming the basis of an associative network. We find that for an STDP time constant of 20 ms, the dependence of the efficiency of attractor creation on the driving frequency has a broad peak centered around 8 Hz. Upon restimulation, the attractors self-oscillate, but with an oscillation frequency that is higher than the driving frequency, ranging from 10 to 100 Hz.

Toward Learning in Neuromorphic Circuits Based on Quantum Phase Slip Junctions

We explore the use of superconducting quantum phase slip junctions (QPSJs), an electromagnetic dual to Josephson Junctions (JJs), in neuromorphic circuits. These small circuits could serve as the building blocks of neuromorphic circuits for machine learning applications because they exhibit desirable properties such as inherent ultra-low energy per operation, high speed, dense integration, negligible loss, and natural spiking responses. In addition, they have a relatively straight-forward micro/nano fabrication, which shows promise for implementation of an enormous number of lossless interconnections that are required to realize complex neuromorphic systems. We simulate QPSJ-only, as well as hybrid QPSJ + JJ circuits for application in neuromorphic circuits including artificial synapses and neurons, as well as fan-in and fan-out circuits. We also design and simulate learning circuits, where a simplified spike timing dependent plasticity rule is realized to provide potential learning mechanisms. We also take an alternative approach, which shows potential to overcome some of the expected challenges of QPSJ-based neuromorphic circuits, via QPSJ-based charge islands coupled together to generate non-linear charge dynamics that result in a large number of programmable weights or non-volatile memory states. Notably, we show that these weights are a function of the timing and frequency of the input spiking signals and can be programmed using a small number of DC voltage bias signals, therefore exhibiting spike-timing and rate dependent plasticity, which are mechanisms to realize learning in neuromorphic circuits.

Glucocorticoid modulation of synaptic plasticity in the human temporal cortex of epilepsy patients: Does chronic stress contribute to memory impairment?

OBJECTIVE

Memory impairment is common in patients with temporal lobe epilepsy and seriously affects life quality. Chronic stress is a recognized cofactor in epilepsy and can also impair memory function. Furthermore, increased cortisol levels have been reported in epilepsy patients. Animal models have suggested that aggravating effects of stress on memory and synaptic plasticity were mediated via glucocorticoids. The aim of this study was, therefore, to investigate the effect of glucocorticoid receptor (GR) modulation on synaptic plasticity in the human cortex of epilepsy patients.

METHODS

We performed field potential recordings in acute slices from the temporal neocortex of patients who underwent surgery for drug-resistant temporal lobe epilepsy. Synaptic plasticity was investigated by a theta-burst stimulation (TBS) protocol for induction of long-term potentiation (LTP) in the presence of GR modulators.

RESULTS

LTP was impaired in temporal cortex from epilepsy patients. Pretreatment of the slices with the GR antagonist mifepristone (RU486) improved LTP induction, suggesting that LTP impairment was due to baseline GR activation in the human cortex. The highly potent GR agonist dexamethasone additionally weakened synaptic strength in an activity-dependent manner when applied after TBS.

SIGNIFICANCE

Our results show a direct negative glucocorticoid effect on synaptic potentiation in the human cortex and imply chronic activation of GRs. Chronic stress may therefore contribute to memory impairment in patients with temporal lobe epilepsy. Furthermore, the activity-dependent acute inhibitory effect of dexamethasone suggests a mechanism of synaptic downscaling by which postictally increased cortisol levels may prevent pathologic plasticity upon seizures.