Synchrony dynamics in monkey V1 predict success in visual detection

From Shorter to Longer Timescales: Converging Integrated Information Theory (IIT) with the Temporo-Spatial Theory of Consciousness (TTC)

Time is a key element of consciousness as it includes multiple timescales from shorter to longer ones. This is reflected in our experience of various short-term phenomenal contents at discrete points in time as part of an ongoing, more continuous, and long-term ‘stream of consciousness.’ Can Integrated Information Theory (IIT) account for this multitude of timescales of consciousness? According to the theory, the relevant spatiotemporal scale for consciousness is the one in which the system reaches the maximum cause-effect power; IIT currently predicts that experience occurs on the order of short timescales, namely, between 100 and 300 ms (theta and alpha frequency range). This can well account for the integration of single inputs into a particular phenomenal content. However, such short timescales leave open the temporal relation of specific phenomenal contents to others during the course of the ongoing time, that is, the stream of consciousness. For that purpose, we converge the IIT with the Temporo-spatial Theory of Consciousness (TTC), which, assuming a multitude of different timescales, can take into view the temporal integration of specific phenomenal contents with other phenomenal contents over time. On the neuronal side, this is detailed by considering those neuronal mechanisms driving the non-additive interaction of pre-stimulus activity with the input resulting in stimulus-related activity. Due to their non-additive interaction, the single input is not only integrated with others in the short-term timescales of 100–300 ms (alpha and theta frequencies) (as predicted by IIT) but, at the same time, also virtually expanded in its temporal (and spatial) features; this is related to the longer timescales (delta and slower frequencies) that are carried over from pre-stimulus to stimulus-related activity. Such a non-additive pre-stimulus-input interaction amounts to temporo-spatial expansion as a key mechanism of TTC for the constitution of phenomenal contents including their embedding or nesting within the ongoing temporal dynamic, i.e., the stream of consciousness. In conclusion, we propose converging the short-term integration of inputs postulated in IIT (100–300 ms as in the alpha and theta frequency range) with the longer timescales (in delta and slower frequencies) of temporo-spatial expansion in TTC.

Spiking model of fixational eye movements and figure-ground segmentation

We present a model connecting eye movements and cortical state. Its structure includes simulated retinal images, motion detection, feature detectors and layers of spiking neurons. The designed scheme shows how the effect of micro-saccadic scale eye movements can lead to successful figure segregation in a figure-ground paradigm, by inducing changes in the neural dynamics through the time evolution of the inhibition range.

Neural signs and mechanisms of consciousness: Is there a potential convergence of theories of consciousness in sight?

Various theories for the neural basis of consciousness have been proposed, suggesting a diversity of neural signs and mechanisms. We ask to what extent this diversity is real, or whether many theories share the same basic ideas with a potential for convergence towards a more unified theory of the neural basis of consciousness. For that purpose, we review and compare the various neural signs, measures, and mechanisms proposed in the different theories. We demonstrate that different theories focus on neural signs and measures of distinct aspects of neural activity including stimulus-related, prestimulus, and resting state activity as well as on distinct features of consciousness. Therefore, the various mechanisms proposed in the different theories may, in part, complement each other. Together, we provide insight into the shared basis and convergences (and, in part, discrepancies) of the different theories of consciousness. We conclude that the different theories concern distinct aspects of both neural activity and consciousness which, as we suppose, may be integrated and nested within the brain's overall temporo-spatial dynamics.

Altered intra- and inter-regional functional connectivity of the visual cortex in individuals with peripheral vision loss due to retinitis pigmentosa

This study investigated changes in intra- and inter-regional functional connectivity (FC) in individuals with retinitis pigmentosa (RP) by using regional homogeneity (ReHo) and FC methods. Sixteen RP individuals and 14 healthy controls (HCs) underwent resting-state functional magnetic resonance imaging scans (fMRI). A combined ReHo and FC method was conducted to evaluate synchronization of brain activity. Compared with HCs, RP individuals had significantly lower ReHo values in the bilateral lingual gyrus/cerebellum posterior lobe (LGG/CPL). In FC analysis, the RP group showed decreased positive FC relative to the HC group, from bilateral LGG/CPL to bilateral LGG/cuneus (CUN) and to left postcentral gyrus (PosCG). In contrast, the RP group showed increased negative FC relative to the HC group, from bilateral LGG/CPL to bilateral thalamus, and decreased negative FC from bilateral LGG/CPL to right middle frontal gyrus (MFG), and to left inferior parietal lobule (IPL). Moreover, ReHo values of the bilateral LGG/CPL showed negative correlations with the duration of RP. FC values of the bilateral LGG/CPL-left IPL showed negative correlations with best-corrected visual acuity (BCVA) of the right eye and left eye in RP individuals. Our results reveal reduced synchronicity of neural activity changes in the primary visual area in RP individuals. Moreover, RP individuals showed intrinsic visual network disconnection and reorganization of the retino-thalamocortical pathway and dorsal visual stream, suggesting impaired visuospatial and stereoscopic vision.

Eye vergence responses to novel and familiar stimuli in young children

Eye vergence is the slow movement of both eyes in opposite directions enabling binocular vision. Recently, it was suggested that vergence could be involved in orienting visual attention and memory having a role in cognitive processing of sensory information. In the present study, we assessed whether such vergence responses are observed in early childhood. We measured eye vergence responses in 43 children (12-37 months of age) while looking at novel and repeated object images. Based on previous research, we hypothesized that visual attention and Visual Short-Term Memory (VSMT) would be evidenced by differential vergence responses for both experimental conditions, i.e. repeated (familiar) vs. novel items. The results show that attention related vergence is present in early childhood and that responses to repeated images differ from the ones to novel items. Our current findings suggest that vergence mechanisms could be linking visual attention with short-term memory recognition.

Sensory Processing Across Conscious and Nonconscious Brain States: From Single Neurons to Distributed Networks for Inferential Representation

Neuronal activity is markedly different across brain states: it varies from desynchronized activity during wakefulness to the synchronous alternation between active and silent states characteristic of deep sleep. Surprisingly, limited attention has been paid to investigating how brain states affect sensory processing. While it was long assumed that the brain was mostly disconnected from external stimuli during sleep, an increasing number of studies indicates that sensory stimuli continue to be processed across all brain states-albeit differently. In this review article, we first discuss what constitutes a brain state. We argue that-next to global, behavioral states such as wakefulness and sleep-there is a concomitant need to distinguish bouts of oscillatory dynamics with specific global/local activity patterns and lasting for a few hundreds of milliseconds, as these can lead to the same sensory stimulus being either perceived or not. We define these short-lasting bouts as micro-states. We proceed to characterize how sensory-evoked neural responses vary between conscious and nonconscious states. We focus on two complementary aspects: neuronal ensembles and inter-areal communication. First, we review which features of ensemble activity are conducive to perception, and how these features vary across brain states. Properties such as heterogeneity, sparsity and synchronicity in neuronal ensembles will especially be considered as essential correlates of conscious processing. Second, we discuss how inter-areal communication varies across brain states and how this may affect brain operations and sensory processing. Finally, we discuss predictive coding (PC) and the concept of multi-level representations as a key framework for understanding conscious sensory processing. In this framework the brain implements conscious representations as inferences about world states across multiple representational levels. In this representational hierarchy, low-level inference may be carried out nonconsciously, whereas high levels integrate across different sensory modalities and larger spatial scales, correlating with conscious processing. This inferential framework is used to interpret several cellular and population-level findings in the context of brain states, and we briefly compare its implications to two other theories of consciousness. In conclusion, this review article, provides foundations to guide future studies aiming to uncover the mechanisms of sensory processing and perception across brain states.

Visual Stimulus Detection Correlates with the Consistency of Temporal Sequences within Stereotyped Events of V1 Neuronal Population Activity

Sensory information about the world is translated into rate codes, such that modulations in mean spiking activity of neurons relate to differences in stimulus features. More recently, it has been proposed that also temporal properties of activity, such as assembly formation and sequential population activation, are important for understanding the relation between neuronal activity and behavioral output. These phenomena appear to be robust properties of neural circuits, but their relevance for perceptual judgments, such as the behavioral detection of stimuli, remains to be tested. Studying neuronal activity with two-photon calcium imaging in primary visual cortex of mice performing a go/no-go visual detection task, we found that assemblies (i.e., configurations of neuronal group activity) reliably recur, as defined using Ward-method clustering. However, population activation events with a recurring configuration of core neurons did not appear to serve a particular function in the coding of orientation or the detection of stimuli. Instead, we found that, regardless of whether the population event showed a recurring or nonrecurring configuration of neurons, the sequence of cluster activation was correlated with the detection of stimuli. Moreover, each neuron showed a preferred temporal position of activation within population events, which was robust despite varying neuronal participation. Furthermore, the timing of neuronal activity within such a sequence was more consistent when a stimulus was detected (hits) than when it remained unreported (misses). Our data indicate that neural processing of information related to visual detection behavior depends on the temporal positioning of individual and group-wise cell activity.

SIGNIFICANCE STATEMENT

Temporally coactive neurons have been hypothesized to form functional assemblies that might subserve different functions in the brain, but many of these proposed functions have not yet been experimentally tested. We used two-photon calcium imaging in V1 of mice performing a stimulus detection task to study the relation of assembly activity to the behavioral detection of visual stimuli. We found that the presence of recurring assemblies per se was not correlated with behavior, and these assemblies did not appear to serve a function in the coding of stimulus orientation. Instead, we found that activity in V1 is characterized by population events of varying membership, within which the consistency of the temporal sequence of neuronal activation is correlated with stimulus detection.

Attentional Selection Accompanied by Eye Vergence as Revealed by Event-Related Brain Potentials

Neural mechanisms of attention allow selective sensory information processing. Top-down deployment of visual-spatial attention is conveyed by cortical feedback connections from frontal regions to lower sensory areas modulating late stimulus responses. A recent study reported the occurrence of small eye vergence during orienting top-down attention. Here we assessed a possible link between vergence and attention by comparing visual event related potentials (vERPs) to a cue stimulus that induced attention to shift towards the target location to the vERPs to a no-cue stimulus that did not trigger orienting attention. The results replicate the findings of eye vergence responses during orienting attention and show that the strength and time of eye vergence coincide with the onset and strength of the vERPs when subjects oriented attention. Our findings therefore support the idea that eye vergence relates to and possibly has a role in attentional selection.

Feature-Based Attention by Lateral Spike Synchronization

We introduce a neural model capable of feature selectiveness by spike-mediated synchronization through lateral synaptic couplings. For a stimulus containing two features, the attended one elicits a higher response. In the case of sequential single-feature stimuli, repetition of the attended feature also results in an enhanced response, exhibited by greater synchrony and higher spiking rates.

Attention-Related Eye Vergence Measured in Children with Attention Deficit Hyperactivity Disorder

Recent evidence shows a novel role for eye vergence in orienting attention in adult subjects. Here we investigated whether such modulation in eye vergence by attention is present in children and whether it is altered in children with ADHD compared to control subjects. We therefore measured the angle of eye vergence in children previously diagnosed with ADHD while performing a cue task and compared the results to those from age-matched controls. We observed a strong modulation in the angle of vergence in the control group and a weak modulation in the ADHD group. In addition, in the control group the modulation in eye vergence was different between the informative cue and uninformative cue condition. This difference was less noticeable in the ADHD group. Our study supports the observation of deficient binocular vision in ADHD children. We argue that the observed disruption in vergence modulation in ADHD children is manifest of altered cognitive processing of sensory information. Our work may provide new insights into attention disorders, like ADHD.

Mouse V1 population correlates of visual detection rely on heterogeneity within neuronal response patterns

Previous studies have demonstrated the importance of the primary sensory cortex for the detection, discrimination, and awareness of visual stimuli, but it is unknown how neuronal populations in this area process detected and undetected stimuli differently. Critical differences may reside in the mean strength of responses to visual stimuli, as reflected in bulk signals detectable in functional magnetic resonance imaging, electro-encephalogram, or magnetoencephalography studies, or may be more subtly composed of differentiated activity of individual sensory neurons. Quantifying single-cell Ca²⁺ responses to visual stimuli recorded with in vivo two-photon imaging, we found that visual detection correlates more strongly with population response heterogeneity rather than overall response strength. Moreover, neuronal populations showed consistencies in activation patterns across temporally spaced trials in association with hit responses, but not during nondetections. Contrary to models relying on temporally stable networks or bulk signaling, these results suggest that detection depends on transient differentiation in neuronal activity within cortical populations.

DOI:http://dx.doi.org/10.7554/eLife.10163.001

Seeing is not the same as perceiving, where an object is recognized and information about it is interpreted by the brain. Things might be in your field of view, but not actively perceived; for example, when daydreaming with your eyes open. Many researchers have investigated how the brain responds differently to a perceived object compared with something that is seen but not perceived. However, using relatively coarse techniques, only small differences in brain activity have been found.

Many of the techniques used to investigate brain activity only look at the average activity of a group of neurons – the cells in the brain that process information. This raises the possibility that the perception of an object relies on more subtle or complex interactions in brain activity. To investigate this, Montijn et al. trained mice to lick a reward spout that gave out sugar water when they perceived a particular image. A technique called two-photon calcium imaging was then used to simultaneously record the activity of tens to hundreds of neurons in part of the brain called the visual cortex as the mice performed the perception task.

This revealed that the average activation of a group of neurons was only weakly related to whether a mouse had perceived the image. However, differences in the strength of the responses of the individual neurons in the group reflected perception more strongly: when a mouse perceived the image and licked in response, a heterogeneous (non-uniform) set of neuronal responses occurred. The diversity of the neuronal responses could also be used to predict how quickly a mouse would respond to an image. These activity differences would not be picked up by techniques that detect the average activity of many neurons, explaining why these effects had not previously been seen.

These findings shed light on which patterns of activity in the visual region of the brain lead to objects being perceived or not. Whether similar mechanisms operate in different regions of the brain remains to be investigated.

DOI:http://dx.doi.org/10.7554/eLife.10163.002

Electrophysiological and firing properties of neurons: Categorizing soloists and choristers in primary visual cortex

Visual processing in the cortex involves various aspects of neuronal properties such as morphological, electrophysiological and molecular. In particular, the neural firing pattern is an important indicator of dynamic circuitry within a neuronal population. Indeed, in microcircuits, neurons act as soloists or choristers wherein the characteristical activity of a 'soloist' differs from the firing pattern of a 'chorister'. Both cell types correlate their respective firing rate with the global populational activity in a unique way. In the present study, we sought to examine the relationship between the spike shape (thin spike neurons and broad spike neurons) of cortical neurons recorded from V1, their firing levels and their propensity to act as soloists or choristers. We found that thin spike neurons, which exhibited higher levels of firing, generally correlate their activity with the neuronal population (choristers). On the other hand, broad spike neurons showed lower levels of firing and demonstrated weak correlations with the assembly (soloists). A major consequence of the present study is: estimating the correlation of neural spike trains with their neighboring population is a predictive indicator of spike waveforms and firing level. Indeed, we found a continuum distribution of coupling strength ranging from weak correlation-strength (attributed to low-firing neurons) to high correlation-strength (attributed to high-firing neurons). The tendency to exhibit high- or low-firing is conducive to the spike shape of neurons. Our results offer new insights into visual processing by showing how high-firing rate neurons (mostly thin spike neurons) could modulate the neuronal responses within cell-assemblies.

Approximate emergent synchrony in spatially coupled spiking neurons with discrete interaction

Models for perceptual grouping and contour integration are presented. Connection weights depend on distances and angle differences, while neurons evolve following a spiking dynamics (Izhikevich's model in most of the considered cases). Although the studied synapses depend on discrete three-valued functions, simulations display the emergence of approximate synchrony, making these cognitive tasks possible. Noise effects are examined, and the possibility of achieving similar results with a different neuron model is discussed.

Perception of successive brief objects as a function of stimulus onset asynchrony: model experiments based on two-stage synchronization of neuronal oscillators

Recently we introduced a new version of the perceptual retouch model incorporating two interactive binding operations-binding features for objects and binding the bound feature-objects with a large scale oscillatory system that acts as a mediary for the perceptual information to reach consciousness-level representation. The relative level of synchronized firing of the neurons representing the features of an object obtained after the second-stage synchronizing modulation is used as the equivalent of conscious perception of the corresponding object. Here, this model is used for simulating interaction of two successive featured objects as a function of stimulus onset asynchrony (SOA). Model output reproduces typical results of mutual masking-with shortest and longest SOAs first and second object correct perception rate is comparable while with intermediate SOAs second object dominates over the first one. Additionally, with shortest SOAs misbinding of features to form illusory objects is simulated by the model.

Two stages of programming eye gaze shifts in 3-D space

Accurate saccadic and vergence eye movements towards selected visual targets are fundamental to perceive the 3-D environment. Despite this importance, shifts in eye gaze are not always perfect given that they are frequently followed by small corrective eye movements. The oculomotor system receives distinct information from various visual cues that may cause incongruity in the planning of a gaze shift. To test this idea, we analyzed eye movements in humans performing a saccade task in a 3-D setting. We show that saccades and vergence movements towards peripheral targets are guided by monocular (perceptual) cues. Approximately 200ms after the start of fixation at the perceived target, a fixational saccade corrected the eye positions to the physical target location. Our findings suggest that shifts in eye gaze occur in two phases; a large eye movement toward the perceived target location followed by a corrective saccade that directs the eyes to the physical target location.

Trial-by-trial reliability of responses in the primary visual cortex on binocular disparity depends on stimulus order

An association of the detrimental effect of monocular deprivation on binocular vision with reduced reliability of neuronal responses in the primary visual cortex has been shown on randomly presented binocular stimuli [V. Vorobyov et al. (2007) Eur J Neurosci. 26(12), 3553-3563]. To examine this effect on biologically relevant signals, binocular gratings of varying relative phase disparity were presented in sequential order, simulating motion, to 55 cats with various types of daily visual experience. During sequential stimulation, the proportions of 'unstable' cells (with phase differences exceeding 22.5 ° between peak binocular responses in two consecutive trials) were similar in cats with exclusively binocular experience and with short periods of daily monocular vision (≤ 3.25 h), in mixed binocular-monocular conditions. In contrast, random stimulation was characterized by a significantly enlarged population of 'unstable' cells in the latter. After a longer period of monocular vision (6.5 h) or exclusively discordant binocular experience (strabismus), sequential stimulation was accompanied by a significant increase of this population, whereas during randomized stimulation it was very similar to that in cats with short periods of daily monocular vision. Finally, there were no differences in populations of 'unstable' cells in cats with long monocular or strabismic vision and those with exclusive monocular experience during sequential stimulation, in contrast with a significant increase in the latter during randomized stimulation. I propose that the detrimental effect of abnormal binocular experience on binocular processing in the primary visual cortex is associated with a disruption of the mechanisms involved in both discrimination of binocular disparity signals and evaluation of their temporal profiles.

The importance of being relevant

This review aims at an understanding of the binding process by synthesizing the extant perspectives regarding binding. It begins with a consideration of the biological explanations of binding, viz., conjunctive coding, synchrony, and reentrant mechanisms. Thereafter binding is reviewed as a psychological process guided by top-down signals. The stages and types of binding proposed by various researchers are discussed in this section. The next section introduces Working Memory (WM) as the executive directing the top-down signals. After that it is described how WM works by selecting relevant sensory input, followed by a detailed consideration of the debate regarding objects vs. features with the conclusion that relevance is the key factor determining what is processed. The next section considers other factors affecting the selection of relevant input. Then, we shift focus to describe what happens to irrelevant input - whether it is discarded at the outset or is gradually inhibited, and whether inhibition is a perceptual or post-perceptual process. The concluding section describes the process of binding as currently understood on the basis of the literature included in the review. To summarize, it appears that initially the "object" is conceptualized as an instantaneous bundle of all features. However, only relevant features of stimuli are gradually integrated to form a stable representation of the object. Concomitantly, irrelevant features are removed from the object representations. Empirical evidence suggests that the inhibition of irrelevant features occurs over time and is presumably a process within WM.

The principle of coherence in multi-level brain information processing

Synchronisation has become one of the major scientific tools to explain biological order at many levels of organisation. In systems neuroscience, synchronised subthreshold and suprathreshold oscillatory neuronal activity within and between distributed neuronal assemblies is acknowledged as a fundamental mode of neuronal information processing. Coherent neuronal oscillations correlate with all basic cognitive functions, mediate local and long-range neuronal communication and affect synaptic plasticity. However, it remains unclear how the very fast and complex changes of functional neuronal connectivity necessary for cognition, as mediated by dynamic patterns of neuronal synchrony, could be explained exclusively based on the well-established synaptic mechanisms. A growing body of research indicates that the intraneuronal matrix, composed of cytoskeletal elements and their binding proteins, structurally and functionally connects the synapses within a neuron, modulates neurotransmission and memory consolidation, and is hypothesised to be involved in signal integration via electric signalling due to its charged surface. Theoretical modelling, as well as emerging experimental evidence indicate that neuronal cytoskeleton supports highly cooperative energy transport and information processing based on molecular coherence. We suggest that long-range coherent dynamics within the intra- and extracellular filamentous matrices could establish dynamic ordered states, capable of rapid modulations of functional neuronal connectivity via their interactions with neuronal membranes and synapses. Coherence may thus represent a common denominator of neurophysiological and biophysical approaches to brain information processing, operating at multiple levels of neuronal organisation, from which cognition may emerge as its cardinal manifestation.

Noise destroys feedback enhanced figure-ground segmentation but not feedforward figure-ground segmentation

Figure-ground (FG) segmentation is the separation of visual information into background and foreground objects. In the visual cortex, FG responses are observed in the late stimulus response period, when neurons fire in tonic mode, and are accompanied by a switch in cortical state. When such a switch does not occur, FG segmentation fails. Currently, it is not known what happens in the brain on such occasions. A biologically plausible feedforward spiking neuron model was previously devised that performed FG segmentation successfully. After incorporating feedback the FG signal was enhanced, which was accompanied by a change in spiking regime. In a feedforward model neurons respond in a bursting mode whereas in the feedback model neurons fired in tonic mode. It is known that bursts can overcome noise, while tonic firing appears to be much more sensitive to noise. In the present study, we try to elucidate how the presence of noise can impair FG segmentation, and to what extent the feedforward and feedback pathways can overcome noise. We show that noise specifically destroys the feedback enhanced FG segmentation and leaves the feedforward FG segmentation largely intact. Our results predict that noise produces failure in FG perception.

Cognitive architecture of perceptual organization: from neurons to gnosons

What, if anything, is cognitive architecture and how is it implemented in neural architecture? Focusing on perceptual organization, this question is addressed by way of a pluralist approach which, supported by metatheoretical considerations, combines complementary insights from representational, connectionist, and dynamic systems approaches to cognition. This pluralist approach starts from a representationally inspired model which implements the intertwined but functionally distinguishable subprocesses of feedforward feature encoding, horizontal feature binding, and recurrent feature selection. As sustained by a review of neuroscientific evidence, these are the subprocesses that are believed to take place in the visual hierarchy in the brain. Furthermore, the model employs a special form of processing, called transparallel processing, whose neural signature is proposed to be gamma-band synchronization in transient horizontal neural assemblies. In neuroscience, such assemblies are believed to mediate binding of similar features. Their formal counterparts in the model are special input-dependent distributed representations, called hyperstrings, which allow many similar features to be processed in a transparallel fashion, that is, simultaneously as if only one feature were concerned. This form of processing does justice to both the high combinatorial capacity and the high speed of the perceptual organization process. A naturally following proposal is that those temporarily synchronized neural assemblies are "gnosons", that is, constituents of flexible self-organizing cognitive architecture in between the relatively rigid level of neurons and the still elusive level of consciousness.

Feedback enhances feedforward figure-ground segmentation by changing firing mode

In the visual cortex, feedback projections are conjectured to be crucial in figure-ground segregation. However, the precise function of feedback herein is unclear. Here we tested a hypothetical model of reentrant feedback. We used a previous developed 2-layered feedforwardspiking network that is able to segregate figure from ground and included feedback connections. Our computer model data show that without feedback, neurons respond with regular low-frequency (∼9 Hz) bursting to a figure-ground stimulus. After including feedback the firing pattern changed into a regular (tonic) spiking pattern. In this state, we found an extra enhancement of figure responses and a further suppression of background responses resulting in a stronger figure-ground signal. Such push-pull effect was confirmed by comparing the figure-ground responses withthe responses to a homogenous texture. We propose that feedback controlsfigure-ground segregation by influencing the neural firing patterns of feedforward projecting neurons.

Timescale-dependent shaping of correlation by olfactory bulb lateral inhibition

Neurons respond to sensory stimuli by altering the rate and temporal pattern of action potentials. These spike trains both encode and propagate information that guides behavior. Local inhibitory networks can affect the information encoded and propagated by neurons by altering correlations between different spike trains. Correlations introduce redundancy that can reduce encoding but also facilitate propagation of activity to downstream targets. Given this trade-off, how can networks maximize both encoding and propagation efficacy? Here, we examine this problem by measuring the effects of olfactory bulb inhibition on the pairwise statistics of mitral cell spiking. We evoked spiking activity in the olfactory bulb in vitro and measured how lateral inhibition shapes correlations across timescales. We show that inhibitory circuits simultaneously increase fast correlation (i.e., synchrony increases) and decrease slow correlation (i.e., firing rates become less similar). Further, we use computational models to show the benefits of fast correlation/slow decorrelation in the context of odor coding. Olfactory bulb inhibition enhances population-level discrimination of similar inputs, while improving propagation of mitral cell activity to cortex. Our findings represent a targeted strategy by which a network can optimize the correlation structure of its output in a dynamic, activity-dependent manner. This trade-off is not specific to the olfactory system, but rather our work highlights mechanisms by which neurons can simultaneously accomplish multiple, and sometimes competing, aspects of sensory processing.

The role of oscillatory brain activity in object processing and figure-ground segmentation in human vision

The perception of an object as a single entity within a visual scene requires that its features are bound together and segregated from the background and/or other objects. Here, we used magnetoencephalography (MEG) to assess the hypothesis that coherent percepts may arise from the synchronized high frequency (gamma) activity between neurons that code features of the same object. We also assessed the role of low frequency (alpha, beta) activity in object processing. The target stimulus (i.e. object) was a small patch of a concentric grating of 3c/°, viewed eccentrically. The background stimulus was either a blank field or a concentric grating of 3c/° periodicity, viewed centrally. With patterned backgrounds, the target stimulus emerged--through rotation about its own centre--as a circular subsection of the background. Data were acquired using a 275-channel whole-head MEG system and analyzed using Synthetic Aperture Magnetometry (SAM), which allows one to generate images of task-related cortical oscillatory power changes within specific frequency bands. Significant oscillatory activity across a broad range of frequencies was evident at the V1/V2 border, and subsequent analyses were based on a virtual electrode at this location. When the target was presented in isolation, we observed that: (i) contralateral stimulation yielded a sustained power increase in gamma activity; and (ii) both contra- and ipsilateral stimulation yielded near identical transient power changes in alpha (and beta) activity. When the target was presented against a patterned background, we observed that: (i) contralateral stimulation yielded an increase in high-gamma (>55 Hz) power together with a decrease in low-gamma (40-55 Hz) power; and (ii) both contra- and ipsilateral stimulation yielded a transient decrease in alpha (and beta) activity, though the reduction tended to be greatest for contralateral stimulation. The opposing power changes across different regions of the gamma spectrum with 'figure/ground' stimulation suggest a possible dual role for gamma rhythms in visual object coding, and provide general support of the binding-by-synchronization hypothesis. As the power changes in alpha and beta activity were largely independent of the spatial location of the target, however, we conclude that their role in object processing may relate principally to changes in visual attention.

Predictive feedback can account for biphasic responses in the lateral geniculate nucleus

Biphasic neural response properties, where the optimal stimulus for driving a neural response changes from one stimulus pattern to the opposite stimulus pattern over short periods of time, have been described in several visual areas, including lateral geniculate nucleus (LGN), primary visual cortex (V1), and middle temporal area (MT). We describe a hierarchical model of predictive coding and simulations that capture these temporal variations in neuronal response properties. We focus on the LGN-V1 circuit and find that after training on natural images the model exhibits the brain's LGN-V1 connectivity structure, in which the structure of V1 receptive fields is linked to the spatial alignment and properties of center-surround cells in the LGN. In addition, the spatio-temporal response profile of LGN model neurons is biphasic in structure, resembling the biphasic response structure of neurons in cat LGN. Moreover, the model displays a specific pattern of influence of feedback, where LGN receptive fields that are aligned over a simple cell receptive field zone of the same polarity decrease their responses while neurons of opposite polarity increase their responses with feedback. This phase-reversed pattern of influence was recently observed in neurophysiology. These results corroborate the idea that predictive feedback is a general coding strategy in the brain.

For many neurons in the early visual brain the optimal stimulation for driving a response changes from one stimulus pattern to the opposite stimulus pattern over short periods of time. For example, many neurons in the lateral geniculate nucleus (LGN) respond to a bright stimulus initially but prefer a dark stimulus only 20 milliseconds later in time, and similar changes in response preference have been found for neurons in other areas. What would be the computational reason for these biphasic response dynamics? We describe a hierarchical model of predictive coding that explains these response properties. In the model, higher-level neurons attempt to predict their lower-level input, while lower-level neurons signal the difference between actual input and the higher-level predictions. In our simulations we focus on the LGN and area V1 and find that after training on natural images the layout of model connections resembles the brain's LGN-V1 connectivity structure. In addition, the responses of model LGN neurons are biphasic in time, resembling biphasic responses as found in neurophysiology. Moreover, the model displays a specific pattern of influence of feedback from higher-level areas that was recently observed in neurophysiology. These results corroborate the idea that predictive feedback is a general coding strategy in the brain.

Spatial and temporal scales of neuronal correlation in primary visual cortex

The spiking activity of cortical neurons is correlated. For instance, trial-to-trial fluctuations in response strength are shared between neurons, and spikes often occur synchronously. Understanding the properties and mechanisms that generate these forms of correlation is critical for determining their role in cortical processing. We therefore investigated the spatial extent and functional specificity of correlated spontaneous and evoked activity. Because feedforward, recurrent, and feedback pathways have distinct extents and specificity, we reasoned that these measurements could elucidate the contribution of each type of input. We recorded single unit activity with microelectrode arrays which allowed us to measure correlation in many hundreds of pairings, across a large range of spatial scales. Our data show that correlated evoked activity is generated by two mechanisms that link neurons with similar orientation preferences on different spatial scales: one with high temporal precision and a limited spatial extent (approximately 3 mm), and a second that gives rise to correlation on a slow time scale and extends as far as we were able to measure (10 mm). The former is consistent with common input provided by horizontal connections; the latter likely involves feedback from extrastriate cortex. Spontaneous activity was correlated over a similar spatial extent, but approximately twice as strongly as evoked activity. Visual stimuli thus caused a substantial decrease in correlation, particularly at response onset. These properties and the circuit mechanism they imply provide new constraints on the functional role that correlation may play in visual processing.

Interaction of attention and temporal object priming

Within a 3 x 3 matrix of 90 degrees corner junctions, detection of a Kanizsa-type square is facilitated when the target display is preceded by a 40-Hz flickering premask of 3 x 3 crosses, with four crosses synchronously oscillating at the subsequent target location. To examine whether this 'synchrony-priming' effect is influenced by, or dependent on, visuo-spatial attention, a spatial-cueing manipulation was introduced. Observers were presented with a visual or acoustic cue which indicated the likely target quadrant. The main finding was that synchrony priming was larger for invalidly, compared with validly, cued locations, and that the priming effect was figural, rather than spatial, in nature (i.e., confined to points associated with the completed boundary, rather than extending to the inner region, defined by the synchronous premask elements). This pattern of effects argues that target processing is expedited not by attracting spatial attention to the primed location, but by the prime expediting (figure-specific) target encoding, as a result of which the target position gains a processing and selection advantage relative to non-primed locations.

Pre-emptive perception

How can an action to a target be selected without yet knowing what it is? Pre-emptive perception (PEP) is a framework which orders neuronal mechanisms in association with voluntary actions before an action is started and until it is completed. It is assumed that PEP serves the purpose of perception, but a conscious, perceptual identification of the goal is not obligatorily completed during the time period of PEP itself. The concept of PEP is that the brain pre-emptively optimizes an action plan to maximize eventual perception, even before being sure what the goal is. Experimental studies of voluntary saccadic eye movements are considered as prototypic activity within the framework of PEP. The core concept of pre-emption is that a particular saccade is selected while a large number of other possible actions are deselected. Pre-emptive computations include mechanisms associated with internal context and reward. Neurophysiological studies which show anatomically and functionally separate cortical and some subcortical neuronal groups in computing saccades are summarized. There is a potential relationship of PEP as a neurobiological framework and some philosophical concepts. Terms for processes between planning and action, such as intention, anticipation, and attention, are often incongruent in everyday language and in epistemology. It is proposed here that a scrutiny of these terms can be rigorously approached by temporal subdivision of PEP and conversely, clear definitions of these terms can lead to organized experimental designs of cognitive neurobiology. The temporal subdivision of PEP allows a critique of The Will in the definition of Schopenhauer and distinguishes it from the 'free will'.

A computational model that recovers the 3D shape of an object from a single 2D retinal representation

Human beings perceive 3D shapes veridically, but the underlying mechanisms remain unknown. The problem of producing veridical shape percepts is computationally difficult because the 3D shapes have to be recovered from 2D retinal images. This paper describes a new model, based on a regularization approach, that does this very well. It uses a new simplicity principle composed of four shape constraints: viz., symmetry, planarity, maximum compactness and minimum surface. Maximum compactness and minimum surface have never been used before. The model was tested with random symmetrical polyhedra. It recovered their 3D shapes from a single randomly-chosen 2D image. Neither learning, nor depth perception, was required. The effectiveness of the maximum compactness and the minimum surface constraints were measured by how well the aspect ratio of the 3D shapes was recovered. These constraints were effective; they recovered the aspect ratio of the 3D shapes very well. Aspect ratios recovered by the model were compared to aspect ratios adjusted by four human observers. They also adjusted aspect ratios very well. In those rare cases, in which the human observers showed large errors in adjusted aspect ratios, their errors were very similar to the errors made by the model.

Biased competition through variations in amplitude of gamma-oscillations

Experiments in visual cortex have shown that the firing rate of a neuron in response to the simultaneous presentation of a preferred and non-preferred stimulus within the receptive field is intermediate between that for the two stimuli alone (stimulus competition). Attention directed to one of the stimuli drives the response towards the response induced by the attended stimulus alone (selective attention). This study shows that a simple feedforward model with fixed synaptic conductance values can reproduce these two phenomena using synchronization in the gamma-frequency range to increase the effective synaptic gain for the responses to the attended stimulus. The performance of the model is robust to changes in the parameter values. The model predicts that the phase locking between presynaptic input and output spikes increases with attention.

Perisaccadic Parietal and Occipital Gamma Power in Light and in Complete Darkness

Our objective was to determine perisaccadic gamma range oscillations in the EEG during voluntary saccades in humans. We evaluated occipital perisaccadic gamma activity both in the presence and absence of visual input, when the observer was blindfolded. We quantified gamma power in the time periods before, during, and after horizontal saccades. The corresponding EEG was evaluated for individual saccades and the wavelet transformed EEG averaged for each time window, without averaging the EEG first. We found that, in both dark and light, parietal and occipital gamma power increased during the saccade and peaked prior to reaching new fixation. We show that this is not the result of muscle activity and not the result of visual input during saccades. Saccade direction affects the laterality of gamma power over posterior electrodes. Gamma power recorded over the posterior scalp increases during a saccade. The phasic modulation of gamma by saccades in darkness—when occipital activity is decoupled from visual input—provides electrophysiological evidence that voluntary saccades affect ongoing EEG. We suggest that saccade-phasic gamma modulation may contribute to short-term plasticity required to realign the visual space to the intended fixation point of a saccade and provides a mechanism for neuronal assembly formation prior to achieving the intended saccadic goal. The wavelet-transformed perisaccadic EEG could provide an electrophysiological tool applicable in humans for the purpose of fine analysis and potential separation of stages of ‘planning’ and ‘action’.

Spontaneous fluctuations in posterior alpha-band EEG activity reflect variability in excitability of human visual areas

Neural activity fluctuates dynamically with time, and these changes have been reported to be of behavioral significance, despite occurring spontaneously. Through electroencephalography (EEG), fluctuations in alpha-band (8-14 Hz) activity have been identified over posterior sites that covary on a trial-by-trial basis with whether an upcoming visual stimulus will be detected or not. These fluctuations are thought to index the momentary state of visual cortex excitability. Here, we tested this hypothesis by directly exciting human visual cortex via transcranial magnetic stimulation (TMS) to induce illusory visual percepts (phosphenes) in blindfolded participants, while simultaneously recording EEG. We found that identical TMS-stimuli evoked a percept (P-yes) or not (P-no) depending on prestimulus alpha-activity. Low prestimulus alpha-band power resulted in TMS reliably inducing phosphenes (P-yes trials), whereas high prestimulus alpha-values led the same TMS-stimuli failing to evoke a visual percept (P-no trials). Additional analyses indicated that the perceptually relevant fluctuations in alpha-activity/visual cortex excitability were spatially specific and occurred on a subsecond time scale in a recurrent pattern. Our data directly link momentary levels of posterior alpha-band activity to distinct states of visual cortex excitability, and suggest that their spontaneous fluctuation constitutes a visual operation mode that is activated automatically even without retinal input.

Temporal dynamics of access to consciousness in the attentional blink

Presentation of two targets in close temporal succession often results in an impairment of conscious perception for the second stimulus. Previous studies have identified several electrophysiological correlates for this so-called 'attentional blink'. Components of the event-related potential (ERP) such as the N2 and the P3, but also oscillatory brain signals have been shown to distinguish between detected and missed stimuli, and thus, conscious perception. Here we investigate oscillatory responses that specifically relate to conscious stimulus processing together with potential ERP predictors. Our results show that successful target detection is associated with enhanced coherence in the low beta frequency range, but a decrease in alpha coherence before and during target presentation. In addition, we find an inverse relation between the P3 amplitudes associated with the first and second target. We conclude that the resources allocated to first and second target processing are directly mirrored by the P3 component and, moreover, that brain states before and during stimulus presentation, as reflected by oscillatory brain activity, strongly determine the access to consciousness. Thus, becoming aware of a stimulus seems to depend on the dynamic interaction between a number of widely distributed neural processes, rather than on the modulation of one single process or component.

Neural networks a century after Cajal

At the time of Golgi and Cajal's reception of the Nobel Prize in 1906 most scientists had accepted the notion that neurons are independent units. Although neuroscientists today still believe that neurons are independent anatomical units, functionally, it is thought that some sort of population coding occurs. Throughout this essay, we provide evidence that suggests that populations of neurons can code information through the synchronization of their responses. This synchronization occurs at several levels in the brain. Whereas spike synchrony refers to the correlation between spikes of different neurons' spike trains, oscillatory synchrony refers to the synchronization of oscillatory responses, generally among large groups of neurons. In the first section of this essay we describe the dependence of the brain's developmental processes on synchronous firing and how these processes form a brain that supports and is sensitive to synchronous spikes. Data are then presented that suggest that spike and oscillatory synchrony may serve as useful neural codes. Examples from sensory (auditory, olfactory and somatosensory), motor and higher cognitive (attention, memory) systems are then presented to illustrate potential roles for these synchronous codes in normal brain function. Results from these studies collectively suggest that spike synchrony in sensory and motor systems may provide detail information not available from changes in firing rate. Oscillatory synchrony, on the other hand, may be globally involved in the coordination of long-distance neuronal communication during higher cognitive processes. These concepts represent a dramatic shift in direction since the times of Golgi and Cajal.

Altered figure-ground perception in monkeys with an extra-striate lesion

The visual system binds and segments the elements of an image into coherent objects and their surroundings. Recent findings demonstrate that primary visual cortex is involved in this process of figure-ground organization. In the primary visual cortex the late part of a neural response to a stimulus correlates with figure-ground segregation and perception. Such a late onset indicates an involvement of feedback projections from higher visual areas. To investigate the possible role of feedback in figure-ground perception we removed dorsal extra-striate areas of the monkey visual cortex. The findings show that figure-ground perception is reduced when the figure is presented in the lesioned hemifield and perception is normal when the figure appeared in the intact hemifield. In conclusion, our observations show the importance for recurrent processing in visual perception.

Figure-ground activity in V1 and guidance of saccadic eye movements

Every day we shift our gaze about 150.000 times mostly without noticing it. The direction of these gaze shifts are not random but directed by sensory information and internal factors. After each movement the eyes hold still for a brief moment so that visual information at the center of our gaze can be processed in detail. This means that visual information at the saccade target location is sufficient to accurately guide the gaze shift but yet is not sufficiently processed to be fully perceived. In this paper I will discuss the possible role of activity in the primary visual cortex (V1), in particular figure-ground activity, in oculo-motor behavior. Figure-ground activity occurs during the late response period of V1 neurons and correlates with perception. The strength of figure-ground responses predicts the direction and moment of saccadic eye movements. The superior colliculus, a gaze control center that integrates visual and motor signals, receives direct anatomical connections from V1. These projections may convey the perceptual information that is required for appropriate gaze shifts. In conclusion, figure-ground activity in V1 may act as an intermediate component linking visual and motor signals.

A Synchronization-Desynchronization Code for Natural Communication Signals

Synchronous spiking of neural populations is hypothesized to play important computational roles in forming neural assemblies and solving the binding problem. Although the opposite phenomenon of desynchronization is well known from EEG studies, it is largely neglected on the neuronal level. We here provide an example of in vivo recordings from weakly electric fish demonstrating that, depending on the social context, different types of natural communication signals elicit transient desynchronization as well as synchronization of the electroreceptor population without changing the mean firing rate. We conclude that, in general, both positive and negative changes in the degree of synchrony can be the relevant signals for neural information processing.

Stimulus-dependent auditory tuning results in synchronous population coding of vocalizations in the songbird midbrain

Physiological studies in vocal animals such as songbirds indicate that vocalizations drive auditory neurons particularly well. But the neural mechanisms whereby vocalizations are encoded differently from other sounds in the auditory system are unknown. We used spectrotemporal receptive fields (STRFs) to study the neural encoding of song versus the encoding of a generic sound, modulation-limited noise, by single neurons and the neuronal population in the zebra finch auditory midbrain. The noise was designed to match song in frequency, spectrotemporal modulation boundaries, and power. STRF calculations were balanced between the two stimulus types by forcing a common stimulus subspace. We found that 91% of midbrain neurons showed significant differences in spectral and temporal tuning properties when birds heard song and when birds heard modulation-limited noise. During the processing of noise, spectrotemporal tuning was highly variable across cells. During song processing, the tuning of individual cells became more similar; frequency tuning bandwidth increased, best temporal modulation frequency increased, and spike timing became more precise. The outcome was a population response to song that encoded rapidly changing sounds with power and precision, resulting in a faithful neural representation of the temporal pattern of a song. Modeling responses to song using the tuning to modulation-limited noise showed that the population response would not encode song as precisely or robustly. We conclude that stimulus-dependent changes in auditory tuning during song processing facilitate the high-fidelity encoding of the temporal pattern of a song.

Approaches to Information-Theoretic Analysis of Neural Activity

Understanding how neurons represent, process, and manipulate information is one of the main goals of neuroscience. These issues are fundamentally abstract, and information theory plays a key role in formalizing and addressing them. However, application of information theory to experimental data is fraught with many challenges. Meeting these challenges has led to a variety of innovative analytical techniques, with complementary domains of applicability, assumptions, and goals.

Interregional long-range and short-range synchrony: a basis for complex sensorimotor processing

Communication of distant brain areas provides the basis for integration of complex information in order to adapt to changes in the environment, to process this information, and to generate appropriate behavioral responses necessary for successful behavior in daily life. How is interregional communication realized in the brain? Perceptions and actions are likely to be represented in the brain by large numbers of distributed neurons firing in synchrony. This synchronous activity of distributed neuronal networks can be noninvasively evaluated by multichannel surface electroencephalography (EEG) and the event-related analysis of synchronous EEG signals in the frequency domain. In this chapter we will discuss the role of interregional synchronous activity and its relevance as a mechanism for implementation of successful human complex behavior exemplified within studies of complex finger movements, context-dependent control of complex motor behavior, bimanual motor tasks, visuo-tactile integration, and recovery of motor functions after stroke. These studies provide evidence that synchronous interregional neuronal activity, determined by event-related synchronization (ERS) and desynchronization (ERD), task-related power increases (TRPI) and decreases (TRPD), and event- and task-related coherence (ERCoh, TRCoh) analysis, is one important mechanism for cortical implementation of successful human complex behavior and adaptation to changes in daily life. These results are discussed in the light of recent findings in animal models, substantiating the view of the relevance of interregional synchronous activity for information coding and control of behavior.