Spatiotemporal firing patterns in the frontal cortex of behaving monkeys

Neuronal activation sequences in lateral prefrontal cortex encode visuospatial working memory during virtual navigation

Working memory (WM) is the ability to maintain and manipulate information 'in mind'. The neural codes underlying WM have been a matter of debate. We simultaneously recorded the activity of hundreds of neurons in the lateral prefrontal cortex of male macaque monkeys during a visuospatial WM task that required navigation in a virtual 3D environment. Here, we demonstrate distinct neuronal activation sequences (NASs) that encode remembered target locations in the virtual environment. This NAS code outperformed the persistent firing code for remembered locations during the virtual reality task, but not during a classical WM task using stationary stimuli and constraining eye movements. Finally, blocking NMDA receptors using low doses of ketamine deteriorated the NAS code and behavioral performance selectively during the WM task. These results reveal the versatility and adaptability of neural codes supporting working memory function in the primate lateral prefrontal cortex.

Brain orchestra under spontaneous conditions: Identifying communication modules from the functional architecture of area V1

We used two-photon imaging to record from granular and supragranular layers in mouse primary visual cortex (V1) under spontaneous conditions and applied an extension of the spike time tiling coefficient (STTC; introduced by Cutts and Eglen) to map functional connectivity architecture within and across layers. We made several observations: Approximately, 19-34% of neuronal pairs within 300 μm of each other exhibit statistically significant functional connections, compared to ~10% at distances of 1mm or more. As expected, neuronal pairs with similar tuning functions exhibit a significant, though relatively small, increase in the fraction of functional inter-neuronal correlations. In contrast, internal state as reflected by pupillary diameter or aggregate neuronal activity appears to play a much stronger role in determining inter-neuronal correlation distributions and topography. Overall, inter-neuronal correlations appear to be slightly more prominent in L4. The first-order functionally connected (i.e., direct) neighbors of neurons determine the hub structure of the V1 microcircuit. L4 exhibits a nearly flat degree of connectivity distribution, extending to higher values than seen in supragranular layers, whose distribution drops exponentially. In all layers, functional connectivity exhibits small-world characteristics and network robustness. The probability of firing of L2/3 pyramidal neurons can be predicted as a function of the aggregate activity in their first-order functionally connected partners within L4, which represent their putative input group. The functional form of this prediction conforms well to a ReLU function, reaching up to firing probability one in some neurons. Interestingly, the properties of L2/3 pyramidal neurons differ based on the size of their L4 functional connectivity group. Specifically, L2/3 neurons with small layer-4 degrees of connectivity appear to be more sensitive to the firing of their L4 functional connectivity partners, suggesting they may be more effective at transmitting synchronous activity downstream from L4. They also appear to fire largely independently from each other, compared to neurons with high layer-4 degrees of connectivity, and are less modulated by changes in pupil size and aggregate population dynamics. Information transmission is best viewed as occurring from neuronal ensembles in L4 to neuronal ensembles in L2/3. Under spontaneous conditions, we were able to identify such candidate neuronal ensembles, which exhibit high sensitivity, precision, and specificity for L4 to L2/3 information transmission. In sum, functional connectivity analysis under spontaneous activity conditions reveals a modular neuronal ensemble architecture within and across granular and supragranular layers of mouse primary visual cortex. Furthermore, modules with different degrees of connectivity appear to obey different rules of engagement and communication across the V1 columnar circuit.

Neuronal ensembles: Building blocks of neural circuits

Neuronal ensembles, defined as groups of neurons displaying recurring patterns of coordinated activity, represent an intermediate functional level between individual neurons and brain areas. Novel methods to measure and optically manipulate the activity of neuronal populations have provided evidence of ensembles in the neocortex and hippocampus. Ensembles can be activated intrinsically or in response to sensory stimuli and play a causal role in perception and behavior. Here we review ensemble phenomenology, developmental origin, biophysical and synaptic mechanisms, and potential functional roles across different brain areas and species, including humans. As modular units of neural circuits, ensembles could provide a mechanistic underpinning of fundamental brain processes, including neural coding, motor planning, decision-making, learning, and adaptability.

Connectivity Matrix Seriation via Relaxation

Volume electron microscopy together with computer-based image analysis are yielding neural circuit diagrams of ever larger regions of the brain. These datasets are usually represented in a cell-to-cell connectivity matrix and contain important information about prevalent circuit motifs allowing to directly test various theories on the computation in that brain structure. Of particular interest are the detection of cell assemblies and the quantification of feedback, which can profoundly change circuit properties. While the ordering of cells along the rows and columns doesn't change the connectivity, it can make special connectivity patterns recognizable. For example, ordering the cells along the flow of information, feedback and feedforward connections are segregated above and below the main matrix diagonal, respectively. Different algorithms are used to renumber matrices such as to minimize a given cost function, but either their performance becomes unsatisfying at a given size of the circuit or the CPU time needed to compute them scales in an unfavorable way with increasing number of neurons. Based on previous ideas, I describe an algorithm which is effective in matrix reordering with respect to both its performance as well as to its scaling in computing time. Rather than trying to reorder the matrix in discrete steps, the algorithm transiently relaxes the integer program by assigning a real-valued parameter to each cell describing its location on a continuous axis ('smooth-index') and finds the parameter set that minimizes the cost. I find that the smooth-index algorithm outperforms all algorithms I compared it to, including those based on topological sorting.

Joint encoding of stimulus and decision in monkey primary visual cortex

We investigated whether neurons in monkey primary visual cortex (V1) exhibit mixed selectivity for sensory input and behavioral choice. Parallel multisite spiking activity was recorded from area V1 of awake monkeys performing a delayed match-to-sample task. The monkeys had to make a forced choice decision of whether the test stimulus matched the preceding sample stimulus. The population responses evoked by the test stimulus contained information about both the identity of the stimulus and with some delay but before the onset of the motor response the forthcoming choice. The results of subspace identification analysis indicate that stimulus-specific and decision-related information coexists in separate subspaces of the high-dimensional population activity, and latency considerations suggest that the decision-related information is conveyed by top-down projections.

Dynamical constraints on neural population activity

The manner in which neural activity unfolds over time is thought to be central to sensory, motor, and cognitive functions in the brain. Network models have long posited that the brain's computations involve time courses of activity that are shaped by the underlying network. A prediction from this view is that the activity time courses should be difficult to violate. We leveraged a brain-computer interface (BCI) to challenge monkeys to violate the naturally-occurring time courses of neural population activity that we observed in motor cortex. This included challenging animals to traverse the natural time course of neural activity in a time-reversed manner. Animals were unable to violate the natural time courses of neural activity when directly challenged to do so. These results provide empirical support for the view that activity time courses observed in the brain indeed reflect the underlying network-level computational mechanisms that they are believed to implement.

Exact solutions for signal propagation along an excitable transmission line

A simple transmission line composed of pulse-coupled units is presented. The model captures the basic properties of excitable media with, in particular, the robust transmission of information via traveling wave solutions. For rectified linear units with a cut-off threshold, the model is exactly solvable and analytical results on propagation are presented. The ability to convey a nontrivial message is studied in detail.

Inter-areal transmission of multiple neural signals through frequency-division-multiplexing communication

Inter-areal information transmission in the brain cortex relates to cognitive functions. Researches used to pay attention to activity pattern transmission, signals gating, or routing in neuronal networks. However, the underlying mechanism of simultaneous transmission of multiple neural signals in the same channel across networks remains unclear. In this work, we construct a two-layer feedforward neuronal network (sender-receiver) with each layer's intrinsic rhythms consisting of slow- (low-frequency) and fast- gamma rhythms (high-frequency), investigating how to realize simultaneous transmission of multiple signals in neuronal systems. With the aid of resonance and frequency analysis, it is shown that low- and high-frequency signals can be transmitted simultaneously in such a feedforward network through frequency division multiplexing (FDM) communication. The transmission performance is related to the local resonance, connectivity, as well as background noise. Moreover, low- and high-frequency signals can also be gated or selected with appropriate adjustments of recurrent connection strength and delay, and background noise. Our model might provide a novel insight into the underlying mechanism of complex signals communication between different cortex areas.

Single spikes drive sequential propagation and routing of activity in a cortical network

Single spikes can trigger repeatable firing sequences in cortical networks. The mechanisms that support reliable propagation of activity from such small events and their functional consequences remain unclear. By constraining a recurrent network model with experimental statistics from turtle cortex, we generate reliable and temporally precise sequences from single spike triggers. We find that rare strong connections support sequence propagation, while dense weak connections modulate propagation reliability. We identify sections of sequences corresponding to divergent branches of strongly connected neurons which can be selectively gated. Applying external inputs to specific neurons in the sparse backbone of strong connections can effectively control propagation and route activity within the network. Finally, we demonstrate that concurrent sequences interact reliably, generating a highly combinatorial space of sequence activations. Our results reveal the impact of individual spikes in cortical circuits, detailing how repeatable sequences of activity can be triggered, sustained, and controlled during cortical computations.

Developmental depression-to-facilitation shift controls excitation-inhibition balance

Changes in the short-term dynamics of excitatory synapses over development have been observed throughout cortex, but their purpose and consequences remain unclear. Here, we propose that developmental changes in synaptic dynamics buffer the effect of slow inhibitory long-term plasticity, allowing for continuously stable neural activity. Using computational modeling we demonstrate that early in development excitatory short-term depression quickly stabilises neural activity, even in the face of strong, unbalanced excitation. We introduce a model of the commonly observed developmental shift from depression to facilitation and show that neural activity remains stable throughout development, while inhibitory synaptic plasticity slowly balances excitation, consistent with experimental observations. Our model predicts changes in the input responses from phasic to phasic-and-tonic and more precise spike timings. We also observe a gradual emergence of short-lasting memory traces governed by short-term plasticity development. We conclude that the developmental depression-to-facilitation shift may control excitation-inhibition balance throughout development with important functional consequences.

Using computational modelling this study proposes that the commonly observed depression-to-facilitation shift across development controls excitation-inhibition balance in the brain.

Neural circuit mechanisms of hierarchical sequence learning tested on large-scale recording data

The brain performs various cognitive functions by learning the spatiotemporal salient features of the environment. This learning requires unsupervised segmentation of hierarchically organized spike sequences, but the underlying neural mechanism is only poorly understood. Here, we show that a recurrent gated network of neurons with dendrites can efficiently solve difficult segmentation tasks. In this model, multiplicative recurrent connections learn a context-dependent gating of dendro-somatic information transfers to minimize error in the prediction of somatic responses by the dendrites. Consequently, these connections filter the redundant input features represented by the dendrites but unnecessary in the given context. The model was tested on both synthetic and real neural data. In particular, the model was successful for segmenting multiple cell assemblies repeating in large-scale calcium imaging data containing thousands of cortical neurons. Our results suggest that recurrent gating of dendro-somatic signal transfers is crucial for cortical learning of context-dependent segmentation tasks.

The brain learns about the environment from continuous streams of information to generate adequate behavior. This is not easy when sensory and motor sequences are hierarchically organized. Some cortical regions jointly represent multiple levels of sequence hierarchy, but how local cortical circuits learn hierarchical sequences remains largely unknown. Evidence shows that the dendrites of cortical neurons learn redundant representations of sensory information compared to the soma, suggesting a filtering process within a neuron. Our model proposes that recurrent synaptic inputs multiplicatively regulate this intracellular process by gating dendrite-to-soma information transfers depending on the context of sequence learning. Furthermore, our model provides a powerful tool to analyze the spatiotemporal patterns of neural activity in large-scale recording data.

Time Is of the Essence: Neural Codes, Synchronies, Oscillations, Architectures

Time is of the essence in how neural codes, synchronies, and oscillations might function in encoding, representation, transmission, integration, storage, and retrieval of information in brains. This Hypothesis and Theory article examines observed and possible relations between codes, synchronies, oscillations, and types of neural networks they require. Toward reverse-engineering informational functions in brains, prospective, alternative neural architectures incorporating principles from radio modulation and demodulation, active reverberant circuits, distributed content-addressable memory, signal-signal time-domain correlation and convolution operations, spike-correlation-based holography, and self-organizing, autoencoding anticipatory systems are outlined. Synchronies and oscillations are thought to subserve many possible functions: sensation, perception, action, cognition, motivation, affect, memory, attention, anticipation, and imagination. These include direct involvement in coding attributes of events and objects through phase-locking as well as characteristic patterns of spike latency and oscillatory response. They are thought to be involved in segmentation and binding, working memory, attention, gating and routing of signals, temporal reset mechanisms, inter-regional coordination, time discretization, time-warping transformations, and support for temporal wave-interference based operations. A high level, partial taxonomy of neural codes consists of channel, temporal pattern, and spike latency codes. The functional roles of synchronies and oscillations in candidate neural codes, including oscillatory phase-offset codes, are outlined. Various forms of multiplexing neural signals are considered: time-division, frequency-division, code-division, oscillatory-phase, synchronized channels, oscillatory hierarchies, polychronous ensembles. An expandable, annotative neural spike train framework for encoding low- and high-level attributes of events and objects is proposed. Coding schemes require appropriate neural architectures for their interpretation. Time-delay, oscillatory, wave-interference, synfire chain, polychronous, and neural timing networks are discussed. Some novel concepts for formulating an alternative, more time-centric theory of brain function are discussed. As in radio communication systems, brains can be regarded as networks of dynamic, adaptive transceivers that broadcast and selectively receive multiplexed temporally-patterned pulse signals. These signals enable complex signal interactions that select, reinforce, and bind common subpatterns and create emergent lower dimensional signals that propagate through spreading activation interference networks. If memory traces share the same kind of temporal pattern forms as do active neuronal representations, then distributed, holograph-like content-addressable memories are made possible via temporal pattern resonances.

Neural kernels for recursive support vector regression as a model for episodic memory

Retrieval of episodic memories requires intrinsic reactivation of neuronal activity patterns. The content of the memories is thereby assumed to be stored in synaptic connections. This paper proposes a theory in which these are the synaptic connections that specifically convey the temporal order information contained in the sequences of a neuronal reservoir to the sensory-motor cortical areas that give rise to the subjective impression of retrieval of sensory motor events. The theory is based on a novel recursive version of support vector regression that allows for efficient continuous learning that is only limited by the representational capacity of the reservoir. The paper argues that hippocampal theta sequences are a potential neural substrate underlying this reservoir. The theory is consistent with confabulations and post hoc alterations of existing memories.

Visual acuity increase in meridional amblyopia by exercises with moving gratings as compared to stationary gratings

The aim of the present work was to investigate the effect of a novel therapy based on pleoptic exercises combined with standard occlusion in patients with meridional amblyopia. The exercising system itself, termed focal ambient visual acuity stimulation (FAVAS), consists of sinusoidally modulated circular gratings, which were implemented as a background pattern in computer games binding the children's attention. For the assessment of therapeutic effects, we tested for the development of best-corrected visual acuity (BCVA) in patients trained with a gaming field background of moving gratings (Moving) compared to patients treated with stationary gratings (Stationary). Patients with amblyopia (caused by strabismus, refraction, or both) and astigmatism were randomly allocated to two groups, all of whom received a standard occlusion regimen. In combination with occlusion, using a crossover design, the first group (Moving-Stationary group) was alternately exercised for 10 days with a series of Moving followed by 10 days with Stationary and the second group (Stationary-Moving group) vice versa. The treatment-dependent training effect on BCVA was measured with respect to the alignment of the least vs. the most ametropic meridian in both groups. BCVA was examined using a meridionally direction-sensitive visual test inventory, and we estimated the monocular BCVA in all patients along four meridians: 0°, 45°, 90°, and 135° before and after Moving as compared to Stationary treatments. The Moving-Stationary group consisted of 17 children (34 eyes) aged 10 to 13 (average 11.6 ± 0.3) years. The Stationary-Moving group consisted of 20 children (40 eyes) aged 9 to 14 (average 12.5 ± 0.4). In both groups, visual acuity increased significantly only with Moving combined with occlusion. Thereby, the visual acuity (logMAR) along different meridians showed a statistically significant improvement induced by Moving if testing was coincident with alignment of the directional optical characters close to the most ametropic meridian in the Moving-Stationary group (0.73 ± 0.32 to 0.41 ± 0.22, p < 0.01) and also in the Stationary-Moving group (0.48 ± 0.27 to 0.33 ± 0.18, p < 0.01). Significant improvement was also induced by Moving if tested in alignment with the perpendicular orientation close to the least ametropic meridian, although with a smaller amount, in the Moving-Stationary group (0.49 ± 0.23 to 0.37 ± 0.21, p < 0.01) as well as in the Stationary-Moving group (0.33 ± 0.18 to 0.28 ± 0.16, p < 0.01). After Stationary combined with occlusion, however, there was no statistically significant improvement, regardless of the meridian. Visual training of patients with meridional amblyopia by a series of online exercises using attention-binding computer games which contained moving gratings as a background stimulus (Moving) resulted in a statistically significant improvement in visual acuity in the most refractive meridian, and to a lesser extent, in the least refractive meridian. No statistically significant improvement was achieved after the respective exercising series in the sham condition with stationary gratings (Stationary).

Closed-loop neuromodulation for studying spontaneous activity and causality

Having established that spontaneous brain activity follows meaningful coactivation patterns and correlates with behavior, researchers have turned their attention to understanding its function and behavioral significance. We suggest closed-loop neuromodulation as a neural perturbation tool uniquely well suited for this task. Closed-loop neuromodulation has primarily been viewed as an interventionist tool to teach subjects to directly control their own brain activity. We examine an alternative operant conditioning model of closed-loop neuromodulation which, through implicit feedback, can manipulate spontaneous activity at the network level, without violating the spontaneous or endogenous nature of the signal, thereby providing a direct test of network causality.

To deconvolve, or not to deconvolve: Inferences of neuronal activities using calcium imaging data

BACKGROUND

With the increasing popularity of calcium imaging in neuroscience research, choosing the right methods to analyze calcium imaging data is critical to address various scientific questions. Unlike spike trains measured using electrodes, fluorescence intensity traces provide an indirect and noisy measurement of the underlying neuronal activities. The observed calcium traces are either analyzed directly or deconvolved to spike trains to infer neuronal activities. When both approaches are applicable, it is unclear whether deconvolving calcium traces is a necessary step.

METHODS

In this article, we compare the performance of using calcium traces or their deconvolved spike trains for three common analyses: clustering, principal component analysis (PCA), and population decoding.

RESULTS

We found that (1) the two approaches lead to diverging results; (2) estimated spike trains, when smoothed or binned appropriately, usually lead to satisfactory performances, such as more accurate estimation of cluster membership; (3) although estimate spike train produce results more similar to true spike data than trace data, we found that the PCA results from trace data might better reflect the underlying neuronal ensembles (clusters); and (4) for both approaches, decobability can be improved by using denoising or smoothing methods.

COMPARISON WITH EXISTING METHODS

Our simulations and applications to real data suggest that estimated spike data outperform trace data in cluster analysis and give comparable results for population decoding. In addition, the decobability of estimated spike data can be slightly better than that of calcium trace data with appropriate filtering / smoothing methods.

CONCLUSION

We conclude that spike detection might be a useful pre-processing step for certain problems such as clustering; however, the continuous nature of calcium imaging data provides a natural smoothness that might be helpful for problems such as dimensional reduction.

Neural Coding of Cognitive Control: The Representational Similarity Analysis Approach

Cognitive control relies on distributed and potentially high-dimensional frontoparietal task representations. Yet, the classical cognitive neuroscience approach in this domain has focused on aggregating and contrasting neural measures - either via univariate or multivariate methods - along highly abstracted, 1D factors (e.g., Stroop congruency). Here, we present representational similarity analysis (RSA) as a complementary approach that can powerfully inform representational components of cognitive control theories. We review several exemplary uses of RSA in this regard. We further show that most classical paradigms, given their factorial structure, can be optimized for RSA with minimal modification. Our aim is to illustrate how RSA can be incorporated into cognitive control investigations to shed new light on old questions.

Emerging Materials for Neuromorphic Devices and Systems

Neuromorphic devices and systems have attracted attention as next-generation computing due to their high efficiency in processing complex data. So far, they have been demonstrated using both machine-learning software and complementary metal-oxide-semiconductor-based hardware. However, these approaches have drawbacks in power consumption and learning speed. An energy-efficient neuromorphic computing system requires hardware that can mimic the functions of a brain. Therefore, various materials have been introduced for the development of neuromorphic devices. Here, recent advances in neuromorphic devices are reviewed. First, the functions of biological synapses and neurons are discussed. Also, deep neural networks and spiking neural networks are described. Then, the operation mechanism and the neuromorphic functions of emerging devices are reviewed. Finally, the challenges and prospects for developing neuromorphic devices that use emerging materials are discussed.

Spike-phase coupling as an order parameter in a leaky integrate-and-fire model

It is known that the leaky integrate-and-fire neural model shows a transition from irregular to synchronous firing by increasing the coupling between the neurons. However, a quantitative characterization of this order-disorder transition, that is, the determination of the order of transition and also the critical exponents in the case of continuous transition, is not entirely known. In this work, we consider a network of N excitatory neurons with local connections, residing on a square lattice with periodic boundary conditions. The cooperation between neurons K plays the role of the control parameter that generates criticality when the critical cooperation strength K_{c} is adopted. We introduce the population-averaged voltage (PAV) as a representative value of the network's cooperative activity. Then, we show that the coupling between the timing of spikes and the phase of temporal fluctuations of PAV defined as m resorts to identify a Kuramoto order parameter. By increasing K, we find a continuous transition from irregular spiking to a phase-locked state at the critical point K_{c}. We deploy the finite-size scaling analysis to calculate the critical exponents of this transition. To explore the formal indicator of criticality, we study the neuronal avalanches profile at this critical point and find a scaling behavior with the exponents in a fair agreement with the experimental values both in vivo and in vitro.

Activity in Primary Motor Cortex Related to Visual Feedback

Neural modulation in primate motor cortex exhibits complex patterns. We found that modulation during reaching could be separated into discrete temporal epochs. To determine if these epochs are driven by behavioral events, monkeys performed variations of a center-out reaching task. Monkeys viewed a computer cursor matched to hand position and a radial target at 1 of 16 locations. In some trials, they performed a visuomotor rotation (the cursor moved at an angle to the hand). After adaptation, encoding changes for single units are temporally structured: adaptation could affect one temporal component of a unit's response but not another. In half the normal and perturbed trials, we removed visual feedback before movement. Adaptation-sensitive firing components toward the end of movement are often weak or absent during reaches without feedback. These results show that temporal structure in motor cortical activity is driven by behavior, with a discrete component related to visual feedback.

Distinct subtypes of inhibitory interneurons differentially promote the propagation of rate and temporal codes in the feedforward neural network

Sensory information is believed to be encoded in neuronal spikes using two different neural codes, the rate code (spike firing rate) and the temporal code (precisely-timed spikes). Since the sensory cortex has a highly hierarchical feedforward structure, sensory information-carrying neural codes should reliably propagate across the feedforward network (FFN) of the cortex. Experimental evidence suggests that inhibitory interneurons, such as the parvalbumin-positive (PV) and somatostatin-positive (SST) interneurons, that have distinctively different electrophysiological and synaptic properties, modulate the neural codes during sensory information processing in the cortex. However, how PV and SST interneurons impact on the neural code propagation in the cortical FFN is unknown. We address this question by building a five-layer FFN model consisting of a physiologically realistic Hodgkin-Huxley-type models of excitatory neurons and PV/SST interneurons at different ratios. In response to different firing rate inputs (20-80 Hz), a higher ratio of PV over SST interneurons promoted a reliable propagation of all ranges of firing rate inputs. In contrast, in response to a range of precisely-timed spikes in the form of pulse-packets [with a different number of spikes (α, 40-400 spikes) and degree of dispersion (σ, 0-20 ms)], a higher ratio of SST over PV interneurons promoted a reliable propagation of pulse-packets. Our simulation results show that PV and SST interneurons differentially promote a reliable propagation of the rate and temporal codes, respectively, indicating that the dynamic recruitment of PV and SST interneurons may play critical roles in a reliable propagation of sensory information-carrying neural codes in the cortical FFN.

Understanding the Effects of General Anesthetics on Cortical Network Activity Using Ex Vivo Preparations

General anesthetics have been used to ablate consciousness during surgery for more than 150 yr. Despite significant advances in our understanding of their molecular-level pharmacologic effects, comparatively little is known about how anesthetics alter brain dynamics to cause unconsciousness. Consequently, while anesthesia practice is now routine and safe, there are many vagaries that remain unexplained. In this paper, the authors review the evidence that cortical network activity is particularly sensitive to general anesthetics, and suggest that disruption to communication in, and/or among, cortical brain regions is a common mechanism of anesthesia that ultimately produces loss of consciousness. The authors review data from acute brain slices and organotypic cultures showing that anesthetics with differing molecular mechanisms of action share in common the ability to impair neurophysiologic communication. While many questions remain, together, ex vivo and in vivo investigations suggest that a unified understanding of both clinical anesthesia and the neural basis of consciousness is attainable.

Oscillatory recurrent gated neural integrator circuits (ORGaNICs), a unifying theoretical framework for neural dynamics

Working memory is an example of a cognitive and neural process that is not static but evolves dynamically with changing sensory inputs; another example is motor preparation and execution. We introduce a theoretical framework for neural dynamics, based on oscillatory recurrent gated neural integrator circuits (ORGaNICs), and apply it to simulate key phenomena of working memory and motor control. The model circuits simulate neural activity with complex dynamics, including sequential activity and traveling waves of activity, that manipulate (as well as maintain) information during working memory. The same circuits convert spatial patterns of premotor activity to temporal profiles of motor control activity and manipulate (e.g., time warp) the dynamics. Derivative-like recurrent connectivity, in particular, serves to manipulate and update internal models, an essential feature of working memory and motor execution. In addition, these circuits incorporate recurrent normalization, to ensure stability over time and robustness with respect to perturbations of synaptic weights.

Spiking Neural Networks and online learning: An overview and perspectives

Applications that generate huge amounts of data in the form of fast streams are becoming increasingly prevalent, being therefore necessary to learn in an online manner. These conditions usually impose memory and processing time restrictions, and they often turn into evolving environments where a change may affect the input data distribution. Such a change causes that predictive models trained over these stream data become obsolete and do not adapt suitably to new distributions. Specially in these non-stationary scenarios, there is a pressing need for new algorithms that adapt to these changes as fast as possible, while maintaining good performance scores. Unfortunately, most off-the-shelf classification models need to be retrained if they are used in changing environments, and fail to scale properly. Spiking Neural Networks have revealed themselves as one of the most successful approaches to model the behavior and learning potential of the brain, and exploit them to undertake practical online learning tasks. Besides, some specific flavors of Spiking Neural Networks can overcome the necessity of retraining after a drift occurs. This work intends to merge both fields by serving as a comprehensive overview, motivating further developments that embrace Spiking Neural Networks for online learning scenarios, and being a friendly entry point for non-experts.

Cellular and Network Mechanisms for Temporal Signal Propagation in a Cortical Network Model

The mechanisms underlying an effective propagation of high intensity information over a background of irregular firing and response latency in cognitive processes remain unclear. Here we propose a SSCCPI circuit to address this issue. We hypothesize that when a high-intensity thalamic input triggers synchronous spike events (SSEs), dense spikes are scattered to many receiving neurons within a cortical column in layer IV, many sparse spike trains are propagated in parallel along minicolumns at a substantially high speed and finally integrated into an output spike train toward or in layer Va. We derive the sufficient conditions for an effective (fast, reliable, and precise) SSCCPI circuit: (i) SSEs are asynchronous (near synchronous); (ii) cortical columns prevent both repeatedly triggering SSEs and incorrectly synaptic connections between adjacent columns; and (iii) the propagator in interneurons is temporally complete fidelity and reliable. We encode the membrane potential responses to stimuli using the non-linear autoregressive integrated process derived by applying Newton's second law to stochastic resilience systems. We introduce a multithreshold decoder to correct encoding errors. Evidence supporting an effective SSCCPI circuit includes that for the condition, (i) time delay enhances SSEs, suggesting that response latency induces SSEs in high-intensity stimuli; irregular firing causes asynchronous SSEs; asynchronous SSEs relate to healthy neurons; and rigorous SSEs relate to brain disorders. For the condition (ii) neurons within a given minicolumn are stereotypically interconnected in the vertical dimension, which prevents repeated triggering SSEs and ensures signal parallel propagation; columnar segregation avoids incorrect synaptic connections between adjacent columns; and signal propagation across layers overwhelmingly prefers columnar direction. For the condition (iii), accumulating experimental evidence supports temporal transfer precision with millisecond fidelity and reliability in interneurons; homeostasis supports a stable fixed-point encoder by regulating changes to synaptic size, synaptic strength, and ion channel function in the membrane; together all-or-none modulation, active backpropagation, additive effects of graded potentials, and response variability functionally support the multithreshold decoder; our simulations demonstrate that the encoder-decoder is temporally complete fidelity and reliable in special intervals contained within the stable fixed-point range. Hence, the SSCCPI circuit provides a possible mechanism of effective signal propagation in cortical networks.

Reliable Sequential Activation of Neural Assemblies by Single Pyramidal Cells in a Three-Layered Cortex

Recent studies reveal the occasional impact of single neurons on surround firing statistics and even simple behaviors. Exploiting the advantages of a simple cortex, we examined the influence of single pyramidal neurons on surrounding cortical circuits. Brief activation of single neurons triggered reliable sequences of firing in tens of other excitatory and inhibitory cortical neurons, reflecting cascading activity through local networks, as indicated by delayed yet precisely timed polysynaptic subthreshold potentials. The evoked patterns were specific to the pyramidal cell of origin, extended over hundreds of micrometers from their source, and unfolded over up to 200 ms. Simultaneous activation of pyramidal cell pairs indicated balanced control of population activity, preventing paroxysmal amplification. Single cortical pyramidal neurons can thus trigger reliable postsynaptic activity that can propagate in a reliable fashion through cortex, generating rapidly evolving and non-random firing sequences reminiscent of those observed in mammalian hippocampus during "replay" and in avian song circuits.

Complex temporal patterns processing by a neural mass model of a cortical column

It is well known that neuronal networks are capable of transmitting complex spatiotemporal information in the form of precise sequences of neuronal discharges characterized by recurrent patterns. At the same time, the synchronized activity of large ensembles produces local field potentials that propagate through highly dynamic oscillatory waves, such that, at the whole brain scale, complex spatiotemporal dynamics of electroencephalographic (EEG) signals may be associated to sensorimotor decision making processes. Despite these experimental evidences, the link between highly temporally organized input patterns and EEG waves has not been studied in detail. Here, we use a neural mass model to investigate to what extent precise temporal information, carried by deterministic nonlinear attractor mappings, is filtered and transformed into fluctuations in phase, frequency and amplitude of oscillatory brain activity. The phase shift that we observe, when we drive the neural mass model with specific chaotic inputs, shows that the local field potential amplitude peak appears in less than one full cycle, thus allowing traveling waves to encode temporal information. After converting phase and amplitude changes obtained into point processes, we quantify input-output similarity following a threshold-filtering algorithm onto the amplitude wave peaks. Our analysis shows that the neural mass model has the capacity for gating the input signal and propagate selected temporal features of that signal. Finally, we discuss the effect of local excitatory/inhibitory balance on these results and how excitability in cortical columns, controlled by neuromodulatory innervation of the cerebral cortex, may contribute to set a fine tuning and gating of the information fed to the cortex.

Ensemble inhibition and excitation in the human cortex: An Ising-model analysis with uncertainties

The pairwise maximum entropy model, also known as the Ising model, has been widely used to analyze the collective activity of neurons. However, controversy persists in the literature about seemingly inconsistent findings, whose significance is unclear due to lack of reliable error estimates. We therefore develop a method for accurately estimating parameter uncertainty based on random walks in parameter space using adaptive Markov-chain Monte Carlo after the convergence of the main optimization algorithm. We apply our method to the activity patterns of excitatory and inhibitory neurons recorded with multielectrode arrays in the human temporal cortex during the wake-sleep cycle. Our analysis shows that the Ising model captures neuronal collective behavior much better than the independent model during wakefulness, light sleep, and deep sleep when both excitatory (E) and inhibitory (I) neurons are modeled; ignoring the inhibitory effects of I neurons dramatically overestimates synchrony among E neurons. Furthermore, information-theoretic measures reveal that the Ising model explains about 80-95% of the correlations, depending on sleep state and neuron type. Thermodynamic measures show signatures of criticality, although we take this with a grain of salt as it may be merely a reflection of long-range neural correlations.

Unsupervised Detection of Cell-Assembly Sequences by Similarity-Based Clustering

Neurons which fire in a fixed temporal pattern (i.e., "cell assemblies") are hypothesized to be a fundamental unit of neural information processing. Several methods are available for the detection of cell assemblies without a time structure. However, the systematic detection of cell assemblies with time structure has been challenging, especially in large datasets, due to the lack of efficient methods for handling the time structure. Here, we show a method to detect a variety of cell-assembly activity patterns, recurring in noisy neural population activities at multiple timescales. The key innovation is the use of a computer science method to comparing strings ("edit similarity"), to group spikes into assemblies. We validated the method using artificial data and experimental data, which were previously recorded from the hippocampus of male Long-Evans rats and the prefrontal cortex of male Brown Norway/Fisher hybrid rats. From the hippocampus, we could simultaneously extract place-cell sequences occurring on different timescales during navigation and awake replay. From the prefrontal cortex, we could discover multiple spike sequences of neurons encoding different segments of a goal-directed task. Unlike conventional event-driven statistical approaches, our method detects cell assemblies without creating event-locked averages. Thus, the method offers a novel analytical tool for deciphering the neural code during arbitrary behavioral and mental processes.

PV+ Cells Enhance Temporal Population Codes but not Stimulus-Related Timing in Auditory Cortex

Spatio-temporal cortical activity patterns relative to both peripheral input and local network activity carry information about stimulus identity and context. GABAergic interneurons are reported to regulate spiking at millisecond precision in response to sensory stimulation and during gamma oscillations; their role in regulating spike timing during induced network bursts is unclear. We investigated this issue in murine auditory thalamo-cortical (TC) brain slices, in which TC afferents induced network bursts similar to previous reports in vivo. Spike timing relative to TC afferent stimulation during bursts was poor in pyramidal cells and SOM+ interneurons. It was more precise in PV+ interneurons, consistent with their reported contribution to spiking precision in pyramidal cells. Optogenetic suppression of PV+ cells unexpectedly improved afferent-locked spike timing in pyramidal cells. In contrast, our evidence suggests that PV+ cells do regulate the spatio-temporal spike pattern of pyramidal cells during network bursts, whose organization is suited to ensemble coding of stimulus information. Simulations showed that suppressing PV+ cells reduces the capacity of pyramidal cell networks to produce discriminable spike patterns. By dissociating temporal precision with respect to a stimulus versus internal cortical activity, we identified a novel role for GABAergic cells in regulating information processing in cortical networks.

Information Theory in Neuroscience

This is the Editorial article summarizing the scope and contents of the Special Issue, Information Theory in Neuroscience.

Parallel and functionally segregated processing of task phase and conscious content in the prefrontal cortex

The role of lateral prefrontal cortex (LPFC) in mediating conscious perception has been recently questioned due to potential confounds resulting from the parallel operation of task related processes. We have previously demonstrated encoding of contents of visual consciousness in LPFC neurons during a no-report task involving perceptual suppression. Here, we report a separate LPFC population that exhibits task-phase related activity during the same task. The activity profile of these neurons could be captured as canonical response patterns (CRPs), with their peak amplitudes sequentially distributed across different task phases. Perceptually suppressed visual input had a negligible impact on sequential firing and functional connectivity structure. Importantly, task-phase related neurons were functionally segregated from the neuronal population, which encoded conscious perception. These results suggest that neurons exhibiting task-phase related activity operate in the LPFC concurrently with, but segregated from neurons representing conscious content during a no-report task involving perceptual suppression.

Vishal Kapoor et al. identify a population of cells in the lateral prefrontal cortex that exhibits task phase-related activity during a no-report task. This cell population is functionally segregated from the population encoding conscious perception, although the two operate in parallel.

Attractor dynamics of a Boolean model of a brain circuit controlled by multiple parameters

Studies of Boolean recurrent neural networks are briefly introduced with an emphasis on the attractor dynamics determined by the sequence of distinct attractors observed in the limit cycles. We apply this framework to a simplified model of the basal ganglia-thalamocortical circuit where each brain area is represented by a "neuronal" node in a directed graph. Control parameters ranging from neuronal excitability that affects all cells to targeted local connections modified by a new adaptive plasticity rule, and the regulation of the interactive feedback affecting the external input stream of information, allow the network dynamics to switch between stable domains delimited by highly discontinuous boundaries and reach very high levels of complexity with specific configurations. The significance of this approach with regard to brain circuit studies is briefly discussed.

A new approach to solving the feature-binding problem in primate vision

We discuss a recently proposed approach to solve the classic feature-binding problem in primate vision that uses neural dynamics known to be present within the visual cortex. Broadly, the feature-binding problem in the visual context concerns not only how a hierarchy of features such as edges and objects within a scene are represented, but also the hierarchical relationships between these features at every spatial scale across the visual field. This is necessary for the visual brain to be able to make sense of its visuospatial world. Solving this problem is an important step towards the development of artificial general intelligence. In neural network simulation studies, it has been found that neurons encoding the binding relations between visual features, known as binding neurons, emerge during visual training when key properties of the visual cortex are incorporated into the models. These biological network properties include (i) bottom-up, lateral and top-down synaptic connections, (ii) spiking neuronal dynamics, (iii) spike timing-dependent plasticity, and (iv) a random distribution of axonal transmission delays (of the order of several milliseconds) in the propagation of spikes between neurons. After training the network on a set of visual stimuli, modelling studies have reported observing the gradual emergence of polychronization through successive layers of the network, in which subpopulations of neurons have learned to emit their spikes in regularly repeating spatio-temporal patterns in response to specific visual stimuli. Such a subpopulation of neurons is known as a polychronous neuronal group (PNG). Some neurons embedded within these PNGs receive convergent inputs from neurons representing lower- and higher-level visual features, and thus appear to encode the hierarchical binding relationship between features. Neural activity with this kind of spatio-temporal structure robustly emerges in the higher network layers even when neurons in the input layer represent visual stimuli with spike timings that are randomized according to a Poisson distribution. The resulting hierarchical representation of visual scenes in such models, including the representation of hierarchical binding relations between lower- and higher-level visual features, is consistent with the hierarchical phenomenology or subjective experience of primate vision and is distinct from approaches interested in segmenting a visual scene into a finite set of objects.

Long Synfire Chains Emerge by Spike-Timing Dependent Plasticity Modulated by Population Activity

Sequences of precisely timed neuronal activity are observed in many brain areas in various species. Synfire chains are a well-established model that can explain such sequences. However, it is unknown under which conditions synfire chains can develop in initially unstructured networks by self-organization. This work shows that with spike-timing dependent plasticity (STDP), modulated by global population activity, long synfire chains emerge in sparse random networks. The learning rule fosters neurons to participate multiple times in the chain or in multiple chains. Such reuse of neurons has been experimentally observed and is necessary for high capacity. Sparse networks prevent the chains from being short and cyclic and show that the formation of specific synapses is not essential for chain formation. Analysis of the learning rule in a simple network of binary threshold neurons reveals the asymptotically optimal length of the emerging chains. The theoretical results generalize to simulated networks of conductance-based leaky integrate-and-fire (LIF) neurons. As an application of the emerged chain, we propose a one-shot memory for sequences of precisely timed neuronal activity.

Efficient Training of Supervised Spiking Neural Network via Accurate Synaptic-Efficiency Adjustment Method

The spiking neural network (SNN) is the third generation of neural networks and performs remarkably well in cognitive tasks, such as pattern recognition. The temporal neural encode mechanism found in biological hippocampus enables SNN to possess more powerful computation capability than networks with other encoding schemes. However, this temporal encoding approach requires neurons to process information serially on time, which reduces learning efficiency significantly. To keep the powerful computation capability of the temporal encoding mechanism and to overcome its low efficiency in the training of SNNs, a new training algorithm, the accurate synaptic-efficiency adjustment method is proposed in this paper. Inspired by the selective attention mechanism of the primate visual system, our algorithm selects only the target spike time as attention areas, and ignores voltage states of the untarget ones, resulting in a significant reduction of training time. Besides, our algorithm employs a cost function based on the voltage difference between the potential of the output neuron and the firing threshold of the SNN, instead of the traditional precise firing time distance. A normalized spike-timing-dependent-plasticity learning window is applied to assigning this error to different synapses for instructing their training. Comprehensive simulations are conducted to investigate the learning properties of our algorithm, with input neurons emitting both single spike and multiple spikes. Simulation results indicate that our algorithm possesses higher learning performance than the existing other methods and achieves the state-of-the-art efficiency in the training of SNN.

Channel noise effects on first spike latency of a stochastic Hodgkin-Huxley neuron

While it is widely accepted that information is encoded in neurons via action potentials or spikes, it is far less understood what specific features of spiking contain encoded information. Experimental evidence has suggested that the timing of the first spike may be an energy-efficient coding mechanism that contains more neural information than subsequent spikes. Therefore, the biophysical features of neurons that underlie response latency are of considerable interest. Here we examine the effects of channel noise on the first spike latency of a Hodgkin-Huxley neuron receiving random input from many other neurons. Because the principal feature of a Hodgkin-Huxley neuron is the stochastic opening and closing of channels, the fluctuations in the number of open channels lead to fluctuations in the membrane voltage and modify the timing of the first spike. Our results show that when a neuron has a larger number of channels, (i) the occurrence of the first spike is delayed and (ii) the variation in the first spike timing is greater. We also show that the mean, median, and interquartile range of first spike latency can be accurately predicted from a simple linear regression by knowing only the number of channels in the neuron and the rate at which presynaptic neurons fire, but the standard deviation (i.e., neuronal jitter) cannot be predicted using only this information. We then compare our results to another commonly used stochastic Hodgkin-Huxley model and show that the more commonly used model overstates the first spike latency but can predict the standard deviation of first spike latencies accurately. We end by suggesting a more suitable definition for the neuronal jitter based upon our simulations and comparison of the two models.

Pattern reverberation in networks of excitable systems with connection delays

We consider the recurrent pulse-coupled networks of excitable elements with delayed connections, which are inspired by the biological neural networks. If the delays are tuned appropriately, the network can either stay in the steady resting state, or alternatively, exhibit a desired spiking pattern. It is shown that such a network can be used as a pattern-recognition system. More specifically, the application of the correct pattern as an external input to the network leads to a self-sustained reverberation of the encoded pattern. In terms of the coupling structure, the tolerance and the refractory time of the individual systems, we determine the conditions for the uniqueness of the sustained activity, i.e., for the functionality of the network as an unambiguous pattern detector. We point out the relation of the considered systems with cyclic polychronous groups and show how the assumed delay configurations may arise in a self-organized manner when a spike-time dependent plasticity of the connection delays is assumed. As excitable elements, we employ the simplistic coincidence detector models as well as the Hodgkin-Huxley neuron models. Moreover, the system is implemented experimentally on a Field-Programmable Gate Array.

Long-range synchrony and emergence of neural reentry

Neural synchronization across long distances is a functionally important phenomenon in health and disease. In order to access the basis of different modes of long-range synchrony, we monitor spiking activities over centimetre scale in cortical networks and show that the mode of synchrony depends upon a length scale, λ, which is the minimal path that activity should propagate through to find its point of origin ready for reactivation. When λ is larger than the physical dimension of the network, distant neuronal populations operate synchronously, giving rise to irregularly occurring network-wide events that last hundreds of milliseconds to several seconds. In contrast, when λ approaches the dimension of the network, a continuous self-sustained reentry propagation emerges, a regular seizure-like mode that is marked by precise spatiotemporal patterns ('synfire chains') and may last many minutes. Termination of a reentry phase is preceded by a decrease of propagation speed to a halt. Stimulation decreases both propagation speed and λ values, which modifies the synchrony mode respectively. The results contribute to the understanding of the origin and termination of different modes of neural synchrony as well as their long-range spatial patterns, while hopefully catering to manipulation of the phenomena in pathological conditions.

Disruption of Network Synchrony and Cognitive Dysfunction After Traumatic Brain Injury

Traumatic brain injury (TBI) is a heterogeneous disorder with many factors contributing to a spectrum of severity, leading to cognitive dysfunction that may last for many years after injury. Injury to axons in the white matter, which are preferentially vulnerable to biomechanical forces, is prevalent in many TBIs. Unlike focal injury to a discrete brain region, axonal injury is fundamentally an injury to the substrate by which networks of the brain communicate with one another. The brain is envisioned as a series of dynamic, interconnected networks that communicate via long axonal conduits termed the "connectome". Ensembles of neurons communicate via these pathways and encode information within and between brain regions in ways that are timing dependent. Our central hypothesis is that traumatic injury to axons may disrupt the exquisite timing of neuronal communication within and between brain networks, and that this may underlie aspects of post-TBI cognitive dysfunction. With a better understanding of how highly interconnected networks of neurons communicate with one another in important cognitive regions such as the limbic system, and how disruption of this communication occurs during injury, we can identify new therapeutic targets to restore lost function. This requires the tools of systems neuroscience, including electrophysiological analysis of ensemble neuronal activity and circuitry changes in awake animals after TBI, as well as computational modeling of the effects of TBI on these networks. As more is revealed about how inter-regional neuronal interactions are disrupted, treatments directly targeting these dysfunctional pathways using neuromodulation can be developed.

Feed-Forward Propagation of Temporal and Rate Information between Cortical Populations during Coherent Activation in Engineered In Vitro Networks

Transient propagation of information across neuronal assembles is thought to underlie many cognitive processes. However, the nature of the neural code that is embedded within these transmissions remains uncertain. Much of our understanding of how information is transmitted among these assemblies has been derived from computational models. While these models have been instrumental in understanding these processes they often make simplifying assumptions about the biophysical properties of neurons that may influence the nature and properties expressed. To address this issue we created an in vitro analog of a feed-forward network composed of two small populations (also referred to as assemblies or layers) of living dissociated rat cortical neurons. The populations were separated by, and communicated through, a microelectromechanical systems (MEMS) device containing a strip of microscale tunnels. Delayed culturing of one population in the first layer followed by the second a few days later induced the unidirectional growth of axons through the microtunnels resulting in a primarily feed-forward communication between these two small neural populations. In this study we systematically manipulated the number of tunnels that connected each layer and hence, the number of axons providing communication between those populations. We then assess the effect of reducing the number of tunnels has upon the properties of between-layer communication capacity and fidelity of neural transmission among spike trains transmitted across and within layers. We show evidence based on Victor-Purpura's and van Rossum's spike train similarity metrics supporting the presence of both rate and temporal information embedded within these transmissions whose fidelity increased during communication both between and within layers when the number of tunnels are increased. We also provide evidence reinforcing the role of synchronized activity upon transmission fidelity during the spontaneous synchronized network burst events that propagated between layers and highlight the potential applications of these MEMs devices as a tool for further investigation of structure and functional dynamics among neural populations.

An Asynchronous Recurrent Network of Cellular Automaton-Based Neurons and Its Reproduction of Spiking Neural Network Activities

Modeling and implementation approaches for the reproduction of input-output relationships in biological nervous tissues contribute to the development of engineering and clinical applications. However, because of high nonlinearity, the traditional modeling and implementation approaches encounter difficulties in terms of generalization ability (i.e., performance when reproducing an unknown data set) and computational resources (i.e., computation time and circuit elements). To overcome these difficulties, asynchronous cellular automaton-based neuron (ACAN) models, which are described as special kinds of cellular automata that can be implemented as small asynchronous sequential logic circuits have been proposed. This paper presents a novel type of such ACAN and a theoretical analysis of its excitability. This paper also presents a novel network of such neurons, which can mimic input-output relationships of biological and nonlinear ordinary differential equation model neural networks. Numerical analyses confirm that the presented network has a higher generalization ability than other major modeling and implementation approaches. In addition, Field-Programmable Gate Array-implementations confirm that the presented network requires lower computational resources.

Repertoires of Spike Avalanches Are Modulated by Behavior and Novelty

Neuronal avalanches measured as consecutive bouts of thresholded field potentials represent a statistical signature that the brain operates near a critical point. In theory, criticality optimizes stimulus sensitivity, information transmission, computational capability and mnemonic repertoires size. Field potential avalanches recorded via multielectrode arrays from cortical slice cultures are repeatable spatiotemporal activity patterns. It remains unclear whether avalanches of action potentials observed in forebrain regions of freely-behaving rats also form recursive repertoires, and whether these have any behavioral relevance. Here, we show that spike avalanches, recorded from hippocampus (HP) and sensory neocortex of freely-behaving rats, constitute distinct families of recursive spatiotemporal patterns. A significant number of those patterns were specific to a behavioral state. Although avalanches produced during sleep were mostly similar to others that occurred during waking, the repertoire of patterns recruited during sleep differed significantly from that of waking. More importantly, exposure to novel objects increased the rate at which new patterns arose, also leading to changes in post-exposure repertoires, which were significantly different from those before the exposure. A significant number of families occurred exclusively during periods of whisker contact with objects, but few were associated with specific objects. Altogether, the results provide original evidence linking behavior and criticality at the spike level: spike avalanches form repertoires that emerge in waking, recur during sleep, are diversified by novelty and contribute to object representation.

Correlations between prefrontal neurons form a small-world network that optimizes the generation of multineuron sequences of activity

Sequential patterns of prefrontal activity are believed to mediate important behaviors, e.g., working memory, but it remains unclear exactly how they are generated. In accordance with previous studies of cortical circuits, we found that prefrontal microcircuits in young adult mice spontaneously generate many more stereotyped sequences of activity than expected by chance. However, the key question of whether these sequences depend on a specific functional organization within the cortical microcircuit, or emerge simply as a by-product of random interactions between neurons, remains unanswered. We observed that correlations between prefrontal neurons do follow a specific functional organization-they have a small-world topology. However, until now it has not been possible to directly link small-world topologies to specific circuit functions, e.g., sequence generation. Therefore, we developed a novel analysis to address this issue. Specifically, we constructed surrogate data sets that have identical levels of network activity at every point in time but nevertheless represent various network topologies. We call this method shuffling activity to rearrange correlations (SHARC). We found that only surrogate data sets based on the actual small-world functional organization of prefrontal microcircuits were able to reproduce the levels of sequences observed in actual data. As expected, small-world data sets contained many more sequences than surrogate data sets with randomly arranged correlations. Surprisingly, small-world data sets also outperformed data sets in which correlations were maximally clustered. Thus the small-world functional organization of cortical microcircuits, which effectively balances the random and maximally clustered regimes, is optimal for producing stereotyped sequential patterns of activity.

Hippocampal sharp wave-ripple: A cognitive biomarker for episodic memory and planning

Sharp wave ripples (SPW-Rs) represent the most synchronous population pattern in the mammalian brain. Their excitatory output affects a wide area of the cortex and several subcortical nuclei. SPW-Rs occur during "off-line" states of the brain, associated with consummatory behaviors and non-REM sleep, and are influenced by numerous neurotransmitters and neuromodulators. They arise from the excitatory recurrent system of the CA3 region and the SPW-induced excitation brings about a fast network oscillation (ripple) in CA1. The spike content of SPW-Rs is temporally and spatially coordinated by a consortium of interneurons to replay fragments of waking neuronal sequences in a compressed format. SPW-Rs assist in transferring this compressed hippocampal representation to distributed circuits to support memory consolidation; selective disruption of SPW-Rs interferes with memory. Recently acquired and pre-existing information are combined during SPW-R replay to influence decisions, plan actions and, potentially, allow for creative thoughts. In addition to the widely studied contribution to memory, SPW-Rs may also affect endocrine function via activation of hypothalamic circuits. Alteration of the physiological mechanisms supporting SPW-Rs leads to their pathological conversion, "p-ripples," which are a marker of epileptogenic tissue and can be observed in rodent models of schizophrenia and Alzheimer's Disease. Mechanisms for SPW-R genesis and function are discussed in this review.

Endogenous sequential cortical activity evoked by visual stimuli

Although the functional properties of individual neurons in primary visual cortex have been studied intensely, little is known about how neuronal groups could encode changing visual stimuli using temporal activity patterns. To explore this, we used in vivo two-photon calcium imaging to record the activity of neuronal populations in primary visual cortex of awake mice in the presence and absence of visual stimulation. Multidimensional analysis of the network activity allowed us to identify neuronal ensembles defined as groups of cells firing in synchrony. These synchronous groups of neurons were themselves activated in sequential temporal patterns, which repeated at much higher proportions than chance and were triggered by specific visual stimuli such as natural visual scenes. Interestingly, sequential patterns were also present in recordings of spontaneous activity without any sensory stimulation and were accompanied by precise firing sequences at the single-cell level. Moreover, intrinsic dynamics could be used to predict the occurrence of future neuronal ensembles. Our data demonstrate that visual stimuli recruit similar sequential patterns to the ones observed spontaneously, consistent with the hypothesis that already existing Hebbian cell assemblies firing in predefined temporal sequences could be the microcircuit substrate that encodes visual percepts changing in time.

From the neuron doctrine to neural networks

For over a century, the neuron doctrine--which states that the neuron is the structural and functional unit of the nervous system--has provided a conceptual foundation for neuroscience. This viewpoint reflects its origins in a time when the use of single-neuron anatomical and physiological techniques was prominent. However, newer multineuronal recording methods have revealed that ensembles of neurons, rather than individual cells, can form physiological units and generate emergent functional properties and states. As a new paradigm for neuroscience, neural network models have the potential to incorporate knowledge acquired with single-neuron approaches to help us understand how emergent functional states generate behaviour, cognition and mental disease.

Self-organization of synchronous activity propagation in neuronal networks driven by local excitation

Many experimental and theoretical studies have suggested that the reliable propagation of synchronous neural activity is crucial for neural information processing. The propagation of synchronous firing activity in so-called synfire chains has been studied extensively in feed-forward networks of spiking neurons. However, it remains unclear how such neural activity could emerge in recurrent neuronal networks through synaptic plasticity. In this study, we investigate whether local excitation, i.e., neurons that fire at a higher frequency than the other, spontaneously active neurons in the network, can shape a network to allow for synchronous activity propagation. We use two-dimensional, locally connected and heterogeneous neuronal networks with spike-timing dependent plasticity (STDP). We find that, in our model, local excitation drives profound network changes within seconds. In the emergent network, neural activity propagates synchronously through the network. This activity originates from the site of the local excitation and propagates through the network. The synchronous activity propagation persists, even when the local excitation is removed, since it derives from the synaptic weight matrix. Importantly, once this connectivity is established it remains stable even in the presence of spontaneous activity. Our results suggest that synfire-chain-like activity can emerge in a relatively simple way in realistic neural networks by locally exciting the desired origin of the neuronal sequence.