Visual cortex responses reflect temporal structure of continuous quasi-rhythmic sensory stimulation

On natural attunement: Shared rhythms between the brain and the environment

Rhythms exist both in the embodied brain and the built environment. Becoming attuned to the rhythms of the environment, such as repetitive columns, can greatly affect perception. Here, we explore how the built environment affects human cognition and behavior through the concept of natural attunement, often resulting from the coordination of a person's sensory and motor systems with the rhythmic elements of the environment. We argue that the built environment should not be reduced to mere states, representations, and single variables but instead be considered a bundle of highly related continuous signals with which we can resonate. Resonance and entrainment are dynamic processes observed when intrinsic frequencies of the oscillatory brain are influenced by the oscillations of an external signal. This allows visual rhythmic stimulations of the environment to affect the brain and body through neural entrainment, cross-frequency coupling, and phase resetting. We review how real-world architectural settings can affect neural dynamics, cognitive processes, and behavior in people, suggesting the crucial role of everyday rhythms in the brain-body-environment relationship.

Sustained responses and neural synchronization to amplitude and frequency modulation in sound change with age

Perception of speech requires sensitivity to features, such as amplitude and frequency modulations, that are often temporally regular. Previous work suggests age-related changes in neural responses to temporally regular features, but little work has focused on age differences for different types of modulations. We recorded magnetoencephalography in younger (21-33 years) and older adults (53-73 years) to investigate age differences in neural responses to slow (2-6 Hz sinusoidal and non-sinusoidal) modulations in amplitude, frequency, or combined amplitude and frequency. Audiometric pure-tone average thresholds were elevated in older compared to younger adults, indicating subclinical hearing impairment in the recruited older-adult sample. Neural responses to sound onset (independent of temporal modulations) were increased in magnitude in older compared to younger adults, suggesting hyperresponsivity and a loss of inhibition in the aged auditory system. Analyses of neural activity to modulations revealed greater neural synchronization with amplitude, frequency, and combined amplitude-frequency modulations for older compared to younger adults. This potentiated response generalized across different degrees of temporal regularity (sinusoidal and non-sinusoidal), although neural synchronization was generally lower for non-sinusoidal modulation. Despite greater synchronization, sustained neural activity was reduced in older compared to younger adults for sounds modulated both sinusoidally and non-sinusoidally in frequency. Our results suggest age differences in the sensitivity of the auditory system to features present in speech and other natural sounds.

Visual cortex encodes timing information in humans and mice

Despite the importance of timing in our daily lives, our understanding of how the human brain mediates second-scale time perception is limited. Here, we combined intracranial stereoelectroencephalography (SEEG) recordings in epileptic patients and circuit dissection in mice to show that visual cortex (VC) encodes timing information. We first asked human participants to perform an interval-timing task and found VC to be a key timing brain area. We then conducted optogenetic experiments in mice and showed that VC plays an important role in the interval-timing behavior. We further found that VC neurons fired in a time-keeping sequential manner and exhibited increased excitability in a timed manner. Finally, we used a computational model to illustrate a self-correcting learning process that generates interval-timed activities with scalar-timing property. Our work reveals how localized oscillations in VC occurring in the seconds to deca-seconds range relate timing information from the external world to guide behavior.

The influence of temporal unpredictability on the electrophysiological mechanisms of neural entrainment

Neural entrainment, or the synchronization of endogenous oscillations to exogenous rhythmic events, has been postulated as a powerful mechanism underlying stimulus prediction. Nevertheless, studies that have explored the benefits of neural entrainment on attention, perception, and other cognitive functions have received criticism, which could compromise their theoretical and clinical value. Therefore, the aim of the present study was [1] to confirm the presence of entrainment using a set of pre-established criteria and [2] to establish whether the reported behavioral benefits of entrainment remain when temporal predictability related to target appearance is reduced. To address these points, we adapted a previous neural entrainment paradigm to include: a variable entrainer length and increased target-absent trials, and instructing participants to respond only if they had detected a target, to avoid guessing. Thirty-six right-handed women took part in this study. Our results indicated a significant alignment of neural activity to the external periodicity as well as a persistence of phase alignment beyond the offset of the driving signal. This would appear to indicate that neural entrainment triggers preexisting endogenous oscillations, which cannot simply be explained as a succession of event-related potentials associated with the stimuli, expectation and/or motor response. However, we found no behavioral benefit for targets in-phase with entrainers, which would suggest that the effect of neural entrainment on overt behavior may be more limited than expected. These results help to clarify the mechanistic processes underlying neural entrainment and provide new insights on its applications.

Distinct interacting cortical networks for stimulus-response and repetition-suppression

Non-invasive studies consider the initial neural stimulus response (SR) and repetition suppression (RS) - the decreased response to repeated sensory stimuli - as engaging the same neurons. That is, RS is a suppression of the SR. We challenge this conjecture using electrocorticographic (ECoG) recordings with high spatial resolution in ten patients listening to task-irrelevant trains of auditory stimuli. SR and RS were indexed by high-frequency activity (HFA) across temporal, parietal, and frontal cortices. HFASR and HFARS were temporally and spatially distinct, with HFARS emerging later than HFASR and showing only a limited spatial intersection with HFASR: most HFASR sites did not demonstrate HFARS, and HFARS was found where no HFASR could be recorded. β activity was enhanced in HFARS compared to HFASR cortical sites. θ activity was enhanced in HFASR compared to HFARS sites. Furthermore, HFASR sites propagated information to HFARS sites via transient θ:β phase-phase coupling. In contrast to predictive coding (PC) accounts our results indicate that HFASR and HFARS are functionally linked but have minimal spatial overlap. HFASR might enable stable and rapid perception of environmental stimuli across extended temporal intervals. In contrast HFARS might support efficient generation of an internal model based on stimulus history.

Effects of temporally regular versus irregular distractors on goal-directed cognition and behavior

Human environments comprise plenty of task-irrelevant sensory inputs, which are potentially distracting. Auditory distractors often possess an inherent temporal structure. However, it is largely unknown whether and how the temporal regularity of distractors interferes with goal-directed cognitive processes, such as working memory. Here, we tested a total sample of N = 90 participants across four working memory tasks with sequences of temporally regular versus irregular distractors. Temporal irregularity was operationalized by a final tone onset time that violated an otherwise regular tone sequence (Experiment 1), by a sequence of tones with irregular onset-to-onset delays (Experiment 2), and by sequences of speech items with irregular onset-to-onset delays (Experiments 3 and 4). Across all experiments, temporal regularity of distractors did not modulate participants’ primary performance metric, that is, accuracy in recalling items from working memory. Instead, temporal regularity of distractors modulated secondary performance metrics: for regular versus irregular distractors, recall of the first item from memory was faster (Experiment 3) and the response bias was more conservative (Experiment 4). Taken together, the present results provide evidence that the temporal regularity of task-irrelevant input does not inevitably affect the precision of memory representations (reflected in the primary performance metric accuracy) but rather the response behavior (reflected in secondary performance metrics like response speed and bias). Our findings emphasize that a comprehensive understanding of auditory distraction requires that existing models of attention include often-neglected secondary performance metrics to understand how different features of auditory distraction reach awareness and impact cognition and behavior.

Ongoing Brain Activity and Its Role in Cognition: Dual versus Baseline Models

What is the role of the brain's ongoing activity for cognition? The predominant perspectives associate ongoing brain activity with resting state, the default-mode network (DMN), and internally oriented mentation. This triad is often contrasted with task states, non-DMN brain networks, and externally oriented mentation, together comprising a "dual model" of brain and cognition. In opposition to this duality, however, we propose that ongoing brain activity serves as a neuronal baseline; this builds upon Raichle's original search for the default mode of brain function that extended beyond the canonical default-mode brain regions. That entails what we refer to as the "baseline model." Akin to an internal biological clock for the rest of the organism, the ongoing brain activity may serve as an internal point of reference or standard by providing a shared neural code for the brain's rest as well as task states, including their associated cognition. Such shared neural code is manifest in the spatiotemporal organization of the brain's ongoing activity, including its global signal topography and dynamics like intrinsic neural timescales. We conclude that recent empirical evidence supports a baseline model over the dual model; the ongoing activity provides a global shared neural code that allows integrating the brain's rest and task states, its DMN and non-DMN, and internally and externally oriented cognition.

Multisensory correlation computations in the human brain identified by a time-resolved encoding model

Neural mechanisms that arbitrate between integrating and segregating multisensory information are essential for complex scene analysis and for the resolution of the multisensory correspondence problem. However, these mechanisms and their dynamics remain largely unknown, partly because classical models of multisensory integration are static. Here, we used the Multisensory Correlation Detector, a model that provides a good explanatory power for human behavior while incorporating dynamic computations. Participants judged whether sequences of auditory and visual signals originated from the same source (causal inference) or whether one modality was leading the other (temporal order), while being recorded with magnetoencephalography. First, we confirm that the Multisensory Correlation Detector explains causal inference and temporal order behavioral judgments well. Second, we found strong fits of brain activity to the two outputs of the Multisensory Correlation Detector in temporo-parietal cortices. Finally, we report an asymmetry in the goodness of the fits, which were more reliable during the causal inference task than during the temporal order judgment task. Overall, our results suggest the existence of multisensory correlation detectors in the human brain, which explain why and how causal inference is strongly driven by the temporal correlation of multisensory signals.

Alpha fluctuations regulate the accrual of visual information to awareness

Endogenous brain processes play a paramount role in shaping up perceptual phenomenology. This is illustrated by the alternations experienced by humans (and other animals) when watching perceptually ambiguous, static images. We hypothesised that endogenous alpha fluctuations in the visual cortex pace the accumulation of sensory information leading to perceptual outcomes. Here, we addressed this hypothesis using binocular rivalry combined with visual entrainment and electroencephalography in humans (64 female, 53 male). The results revealed a correlation between the individual frequency of alpha oscillations in the occipital cortex and perceptual alternation rates experienced during binocular rivalry. In subsequent experiments we show that regulating endogenous brain activity via rhythmic entrainment produced corresponding changes in perceptual alternation rate. These changes were observed only in the alpha range but not at lower entrainment frequencies, and were much reduced when using arrhythmic stimulation. Additionally, entraining at frequencies above the alpha range did not result in speeding up perceptual alternation rates. Overall, these findings support the notion that visual information is accumulated via alpha cycles to promote the emergence of conscious perceptual representations. We suggest that models of binocular rivalry incorporating posterior alpha as a pacemaker can provide an important advance in the comprehension of the dynamics of visual awareness.

Oscillatory entrainment mechanisms and anticipatory predictive processes in children with autism spectrum disorder

Anticipating near-future events is fundamental to adaptive behavior, whereby neural processing of predictable stimuli is significantly facilitated relative to nonpredictable events. Neural oscillations appear to be a key anticipatory mechanism by which processing of upcoming stimuli is modified, and they often entrain to rhythmic environmental sequences. Clinical and anecdotal observations have led to the hypothesis that people with autism spectrum disorder (ASD) may have deficits in generating predictions, and as such, a candidate neural mechanism may be failure to adequately entrain neural activity to repetitive environmental patterns, to facilitate temporal predictions. We tested this hypothesis by interrogating temporal predictions and rhythmic entrainment using behavioral and electrophysiological approaches. We recorded high-density electroencephalography in children with ASD and typically developing (TD) age- and IQ-matched controls, while they reacted to an auditory target as quickly as possible. This auditory event was either preceded by predictive rhythmic visual cues or was not preceded by any cue. Both ASD and control groups presented comparable behavioral facilitation in response to the Cue versus No-Cue condition, challenging the hypothesis that children with ASD have deficits in generating temporal predictions. Analyses of the electrophysiological data, in contrast, revealed significantly reduced neural entrainment to the visual cues and altered anticipatory processes in the ASD group. This was the case despite intact stimulus-evoked visual responses. These results support intact behavioral temporal prediction in response to a cue in ASD, in the face of altered neural entrainment and anticipatory processes.NEW & NOTEWORTHY We examined behavioral and EEG indices of predictive processing in children with ASD to rhythmically predictable stimuli. Although behavioral measures of predictive processing and evoked neural responses were intact in the ASD group, neurophysiological measures of preparatory activity and entrainment were impaired. When sensory events are presented in a predictable temporal pattern, performance and neuronal responses in ASD may be governed more by the occurrence of the events themselves and less by their anticipated timing.

Computational exploration of dynamic mechanisms of steady state visual evoked potentials at the whole brain level

Periodic visual stimulation can induce stable steady-state visual evoked potentials (SSVEPs) distributed in multiple brain regions and has potential applications in both neural engineering and cognitive neuroscience. However, the underlying dynamic mechanisms of SSVEPs at the whole-brain level are still not completely understood. Here, we addressed this issue by simulating the rich dynamics of SSVEPs with a large-scale brain model designed with constraints of neuroimaging data acquired from the human brain. By eliciting activity of the occipital areas using an external periodic stimulus, our model was capable of replicating both the spatial distributions and response features of SSVEPs that were observed in experiments. In particular, we confirmed that alpha-band (8-12 Hz) stimulation could evoke stronger SSVEP responses; this frequency sensitivity was due to nonlinear entrainment and resonance, and could be modulated by endogenous factors in the brain. Interestingly, the stimulus-evoked brain networks also exhibited significant superiority in topological properties near this frequency-sensitivity range, and stronger SSVEP responses were demonstrated to be supported by more efficient functional connectivity at the neural activity level. These findings not only provide insights into the mechanistic understanding of SSVEPs at the whole-brain level but also indicate a bright future for large-scale brain modeling in characterizing the complicated dynamics and functions of the brain.

Is Neuromorphic MNIST Neuromorphic? Analyzing the Discriminative Power of Neuromorphic Datasets in the Time Domain

A major characteristic of spiking neural networks (SNNs) over conventional artificial neural networks (ANNs) is their ability to spike, enabling them to use spike timing for coding and efficient computing. In this paper, we assess if neuromorphic datasets recorded from static images are able to evaluate the ability of SNNs to use spike timings in their calculations. We have analyzed N-MNIST, N-Caltech101 and DvsGesture along these lines, but focus our study on N-MNIST. First we evaluate if additional information is encoded in the time domain in a neuromorphic dataset. We show that an ANN trained with backpropagation on frame-based versions of N-MNIST and N-Caltech101 images achieve 99.23 and 78.01% accuracy. These are comparable to the state of the art-showing that an algorithm that purely works on spatial data can classify these datasets. Second we compare N-MNIST and DvsGesture on two STDP algorithms, RD-STDP, that can classify only spatial data, and STDP-tempotron that classifies spatiotemporal data. We demonstrate that RD-STDP performs very well on N-MNIST, while STDP-tempotron performs better on DvsGesture. Since DvsGesture has a temporal dimension, it requires STDP-tempotron, while N-MNIST can be adequately classified by an algorithm that works on spatial data alone. This shows that precise spike timings are not important in N-MNIST. N-MNIST does not, therefore, highlight the ability of SNNs to classify temporal data. The conclusions of this paper open the question-what dataset can evaluate SNN ability to classify temporal data?

Toward New Modalities in VEP-Based BCI Applications Using Dynamical Stimuli: Introducing Quasi-Periodic and Chaotic VEP-Based BCI

Visual evoked potentials (VEPs) to periodic stimuli are commonly used in brain computer interfaces for their favorable properties such as high target identification accuracy, less training time, and low surrounding target interference. Conventional periodic stimuli can lead to subjective visual fatigue due to continuous and high contrast stimulation. In this study, we compared quasi-periodic and chaotic complex stimuli to common periodic stimuli for use with VEP-based brain computer interfaces (BCIs). Canonical correlation analysis (CCA) and coherence methods were used to evaluate the performance of the three stimulus groups. Subjective fatigue caused by the presented stimuli was evaluated by the Visual Analogue Scale (VAS). Using CCA with the M2 template approach, target identification accuracy was highest for the chaotic stimuli (M = 86.8, SE = 1.8) compared to the quasi-periodic (M = 78.1, SE = 2.6, p = 0.008) and periodic (M = 64.3, SE = 1.9, p = 0.0001) stimulus groups. The evaluation of fatigue rates revealed that the chaotic stimuli caused less fatigue compared to the quasi-periodic (p = 0.001) and periodic (p = 0.0001) stimulus groups. In addition, the quasi-periodic stimuli led to lower fatigue rates compared to the periodic stimuli (p = 0.011). We conclude that the target identification results were better for the chaotic group compared to the other two stimulus groups with CCA. In addition, the chaotic stimuli led to a less subjective visual fatigue compared to the periodic and quasi-periodic stimuli and can be suitable for designing new comfortable VEP-based BCIs.

Spontaneous Beta Band Rhythms in the Predictive Coding of Natural Stimuli

The regularity of the physical world and the biomechanics of the human body movements generate distributions of highly probable states that are internalized by the brain in the course of a lifetime. In Bayesian terms, the brain exploits prior knowledge, especially under conditions when sensory input is unavailable or uncertain, to predictively anticipate the most likely outcome of upcoming stimuli and movements. These internal models, formed during development, yet still malleable in adults, continuously adapt through the learning of novel stimuli and movements.

Traditionally, neural beta (β) oscillations are considered essential for maintaining sensorimotor and cognitive representations, and for temporal coding of expectations. However, recent findings show that fluctuations of β band power in the resting state strongly correlate between cortical association regions. Moreover, central (hub) regions form strong interactions over time with different brain regions/networks (dynamic core). β band centrality fluctuations of regions of the dynamic core predict global efficiency peaks suggesting a mechanism for network integration. Furthermore, this temporal architecture is surprisingly stable, both in topology and dynamics, during the observation of ecological natural visual scenes, whereas synthetic temporally scrambled stimuli modify it. We propose that spontaneous β rhythms may function as a long-term “prior” of frequent environmental stimuli and behaviors.

Genuine cross-frequency coupling networks in human resting-state electrophysiological recordings

Phase synchronization of neuronal oscillations in specific frequency bands coordinates anatomically distributed neuronal processing and communication. Typically, oscillations and synchronization take place concurrently in many distinct frequencies, which serve separate computational roles in cognitive functions. While within-frequency phase synchronization has been studied extensively, less is known about the mechanisms that govern neuronal processing distributed across frequencies and brain regions. Such integration of processing between frequencies could be achieved via cross-frequency coupling (CFC), either by phase–amplitude coupling (PAC) or by n:m-cross–frequency phase synchrony (CFS). So far, studies have mostly focused on local CFC in individual brain regions, whereas the presence and functional organization of CFC between brain areas have remained largely unknown. We posit that interareal CFC may be essential for large-scale coordination of neuronal activity and investigate here whether genuine CFC networks are present in human resting-state (RS) brain activity. To assess the functional organization of CFC networks, we identified brain-wide CFC networks at mesoscale resolution from stereoelectroencephalography (SEEG) and at macroscale resolution from source-reconstructed magnetoencephalography (MEG) data. We developed a novel, to our knowledge, graph-theoretical method to distinguish genuine CFC from spurious CFC that may arise from nonsinusoidal signals ubiquitous in neuronal activity. We show that genuine interareal CFC is present in human RS activity in both SEEG and MEG data. Both CFS and PAC networks coupled theta and alpha oscillations with higher frequencies in large-scale networks connecting anterior and posterior brain regions. CFS and PAC networks had distinct spectral patterns and opposing distribution of low- and high-frequency network hubs, implying that they constitute distinct CFC mechanisms. The strength of CFS networks was also predictive of cognitive performance in a separate neuropsychological assessment. In conclusion, these results provide evidence for interareal CFS and PAC being 2 distinct mechanisms for coupling oscillations across frequencies in large-scale brain networks.

Genuine interareal cross-frequency coupling (CFC) can be identified from human resting state activity using magnetoencephalography, stereoelectroencephalography, and novel network approaches. CFC couples slow theta and alpha oscillations to faster oscillations across brain regions.

Spatial attention enhances cortical tracking of quasi-rhythmic visual stimuli

Successfully interpreting and navigating our natural visual environment requires us to track its dynamics constantly. Additionally, we focus our attention on behaviorally relevant stimuli to enhance their neural processing. Little is known, however, about how sustained attention affects the ongoing tracking of stimuli with rich natural temporal dynamics. Here, we used MRI-informed source reconstructions of magnetoencephalography (MEG) data to map to what extent various cortical areas track concurrent continuous quasi-rhythmic visual stimulation. Further, we tested how top-down visuo-spatial attention influences this tracking process. Our bilaterally presented quasi-rhythmic stimuli covered a dynamic range of 4-20 ​Hz, subdivided into three distinct bands. As an experimental control, we also included strictly rhythmic stimulation (10 vs 12 ​Hz). Using a spectral measure of brain-stimulus coupling, we were able to track the neural processing of left vs. right stimuli independently, even while fluctuating within the same frequency range. The fidelity of neural tracking depended on the stimulation frequencies, decreasing for higher frequency bands. Both attended and non-attended stimuli were tracked beyond early visual cortices, in ventral and dorsal streams depending on the stimulus frequency. In general, tracking improved with the deployment of visuo-spatial attention to the stimulus location. Our results provide new insights into how human visual cortices process concurrent dynamic stimuli and provide a potential mechanism - namely increasing the temporal precision of tracking - for boosting the neural representation of attended input.

How to test for phasic modulation of neural and behavioural responses

Research on whether perception or other processes depend on the phase of neural oscillations is rapidly gaining popularity. However, it is unknown which methods are optimally suited to evaluate the hypothesized phase effect. Using a simulation approach, we here test the ability of different methods to detect such an effect on dichotomous (e.g., "hit" vs "miss") and continuous (e.g., scalp potentials) response variables. We manipulated parameters that characterise the phase effect or define the experimental approach to test for this effect. For each parameter combination and response variable, we identified an optimal method. We found that methods regressing single-trial responses on circular (sine and cosine) predictors perform best for all of the simulated parameters, regardless of the nature of the response variable (dichotomous or continuous). In sum, our study lays a foundation for optimized experimental designs and analyses in future studies investigating the role of phase for neural and behavioural responses. We provide MATLAB code for the statistical methods tested.

Sleepless and desynchronized: Impaired inter trial phase coherence of steady-state potentials following sleep deprivation

Sleep loss has detrimental effects on cognitive and emotional functioning. These impairments have been associated with alterations in EEG measures of power spectrum and event-related potentials, however the impact of sleep loss on inter trial phase coherence (ITPC), a measure of phase consistency over experimental trials, remains mostly unknown. ITPC is thought to reflect the ability of the neural response to temporally synchronize with relevant events, thus optimizing information processing. In the current study we investigated the effects of sleep deprivation on information processing by evaluating the phase consistency of steady-state visual evoked potentials (ssVEPs) as well as amplitude-based measures of ssVEPs, obtained from a group of 18 healthy individuals following 24 h of total sleep deprivation and after a night of habitual sleep. An ssVEP task was utilized, which included the presentation of dots flickering at 7.5 Hz, along with a cognitive-emotional task. Our results show that ITPC is significantly reduced under sleep deprivation relative to habitual sleep. Interestingly, decreased ITPC under sleep deprivation was associated with decreased behavioral performance in the psychomotor vigilance task (PVT), a validated measure of reduced vigilance following a lack of sleep. The results suggest that the capability of the brain to synchronize with rhythmic stimuli is disrupted without sleep. Thus, decreased ITPC may represent an objective and mechanistic measure of sleep loss, allowing future work to study the relation between brain-world synchrony and the specific functional impairments associated with sleep deprivation.

Attention differentially modulates the amplitude of resonance frequencies in the visual cortex

Rhythmic visual stimuli (flicker) elicit rhythmic brain responses at the frequency of the stimulus, and attention generally enhances these oscillatory brain responses (steady state visual evoked potentials, SSVEPs). Although SSVEP responses have been tested for flicker frequencies up to 100 Hz [Herrmann, 2001], effects of attention on SSVEP amplitude have only been reported for lower frequencies (up to ~30 Hz), with no systematic comparison across a wide, finely sampled frequency range. Does attention modulate SSVEP amplitude at higher flicker frequencies (gamma band, 30-80 Hz), and is attentional modulation constant across frequencies? By isolating SSVEP responses from the broadband EEG signal using a multivariate spatiotemporal source separation method, we demonstrate that flicker in the alpha and gamma bands elicit strongest and maximally phase stable brain responses (resonance), on which the effect of attention is opposite: positive for gamma and negative for alpha. Finding subject-specific gamma resonance frequency and a positive attentional modulation of gamma-band SSVEPs points to the untapped potential of flicker as a non-invasive tool for studying the causal effects of interactions between visual gamma-band rhythmic stimuli and endogenous gamma oscillations on perception and attention.

Temporal predictions provided by musical rhythm influence visual memory encoding

Selective attention plays a key role in determining what aspects of our environment are encoded into long-term memory. Auditory rhythms with a regular beat provide temporal expectations that entrain attention and facilitate perception of visual stimuli aligned with the beat. The current study investigated whether entrainment to background auditory rhythms also facilitates higher-level cognitive functions such as episodic memory. In a series of experiments, we manipulated temporal attention through the use of rhythmic, instrumental music. In Experiment 1A and 1B, we found that background musical rhythm influenced the encoding of visual targets into memory, evident in enhanced subsequent memory for targets that appeared in-synchrony compared to out-of-synchrony with the background beat. Response times at encoding did not differ for in-synchrony compared to out-of-synchrony stimuli, suggesting that the rhythmic modulation of memory does not simply reflect rhythmic effects on perception and action. Experiment 2 investigated whether rhythmic effects on response times emerge when task procedures more closely match prior studies that have demonstrated significant auditory entrainment effects. Responses were faster for in-synchrony compared to out-of-synchrony stimuli when participants performed a more perceptually-oriented task that did not contain intervening recognition memory tests, suggesting that rhythmic effects on perception and action depend on the nature of the task demands. Together, these results support the hypothesis that rhythmic temporal regularities provided by background music can entrain attention and influence the encoding of visual stimuli into memory.

Cross-frequency coupling of alpha oscillatory power to the entrainment rhythm of a spatially attended input stream

Neural entrainment and alpha oscillatory power (8-14 Hz) are mechanisms of selective attention. The extent to which these two mechanisms interact, especially in the context of visuospatial attention, is unclear. Here, we show that spatial attention to a delta-frequency, rhythmic visual stimulus in one hemifield results in phase-amplitude coupling between the delta-phase of an entrained frontal source and alpha power generated by ipsilateral visuocortical regions. The driving of ipsilateral alpha power by frontal delta also correlates with task performance. Our analyses suggest that neural entrainment may serve a previously underappreciated role in coordinating macroscale brain networks and that inhibition of processing by alpha power can be coupled to an attended temporal structure. Finally, we note that the observed coupling bolsters one dominant hypothesis of modern cognitive neuroscience, that macroscale brain networks and distributed neural computation are coordinated by oscillatory synchrony and cross-frequency interactions.

Electrophysiological Brain Connectivity: Theory and Implementation

We review the theory and algorithms of electrophysiological brain connectivity analysis. This tutorial is aimed at providing an introduction to brain functional connectivity from electrophysiological signals, including electroencephalography (EEG), magnetoencephalography (MEG), electrocorticography (ECoG), stereoelectroencephalography (SEEG). Various connectivity estimators are discussed, and algorithms introduced. Important issues for estimating and mapping brain functional connectivity with electrophysiology are discussed.

Stimulus-Driven Brain Rhythms within the Alpha Band: The Attentional-Modulation Conundrum

Two largely independent research lines use rhythmic sensory stimulation to study visual processing. Despite the use of strikingly similar experimental paradigms, they differ crucially in their notion of the stimulus-driven periodic brain responses: one regards them mostly as synchronized (entrained) intrinsic brain rhythms; the other assumes they are predominantly evoked responses [classically termed steady-state responses (SSRs)] that add to the ongoing brain activity. This conceptual difference can produce contradictory predictions about, and interpretations of, experimental outcomes. The effect of spatial attention on brain rhythms in the alpha band (8-13 Hz) is one such instance: alpha-range SSRs have typically been found to increase in power when participants focus their spatial attention on laterally presented stimuli, in line with a gain control of the visual evoked response. In nearly identical experiments, retinotopic decreases in entrained alpha-band power have been reported, in line with the inhibitory function of intrinsic alpha. Here we reconcile these contradictory findings by showing that they result from a small but far-reaching difference between two common approaches to EEG spectral decomposition. In a new analysis of previously published human EEG data, recorded during bilateral rhythmic visual stimulation, we find the typical SSR gain effect when emphasizing stimulus-locked neural activity and the typical retinotopic alpha suppression when focusing on ongoing rhythms. These opposite but parallel effects suggest that spatial attention may bias the neural processing of dynamic visual stimulation via two complementary neural mechanisms.SIGNIFICANCE STATEMENT Attending to a visual stimulus strengthens its representation in visual cortex and leads to a retinotopic suppression of spontaneous alpha rhythms. To further investigate this process, researchers often attempt to phase lock, or entrain, alpha through rhythmic visual stimulation under the assumption that this entrained alpha retains the characteristics of spontaneous alpha. Instead, we show that the part of the brain response that is phase locked to the visual stimulation increased with attention (as do steady-state evoked potentials), while the typical suppression was only present in non-stimulus-locked alpha activity. The opposite signs of these effects suggest that attentional modulation of dynamic visual stimulation relies on two parallel cortical mechanisms-retinotopic alpha suppression and increased temporal tracking.

Lower Beta: A Central Coordinator of Temporal Prediction in Multimodal Speech

How the brain decomposes and integrates information in multimodal speech perception is linked to oscillatory dynamics. However, how speech takes advantage of redundancy between different sensory modalities, and how this translates into specific oscillatory patterns remains unclear. We address the role of lower beta activity (~20 Hz), generally associated with motor functions, as an amodal central coordinator that receives bottom-up delta-theta copies from specific sensory areas and generate top-down temporal predictions for auditory entrainment. Dissociating temporal prediction from entrainment may explain how and why visual input benefits speech processing rather than adding cognitive load in multimodal speech perception. On the one hand, body movements convey prosodic and syllabic features at delta and theta rates (i.e., 1–3 Hz and 4–7 Hz). On the other hand, the natural precedence of visual input before auditory onsets may prepare the brain to anticipate and facilitate the integration of auditory delta-theta copies of the prosodic-syllabic structure. Here, we identify three fundamental criteria based on recent evidence and hypotheses, which support the notion that lower motor beta frequency may play a central and generic role in temporal prediction during speech perception. First, beta activity must respond to rhythmic stimulation across modalities. Second, beta power must respond to biological motion and speech-related movements conveying temporal information in multimodal speech processing. Third, temporal prediction may recruit a communication loop between motor and primary auditory cortices (PACs) via delta-to-beta cross-frequency coupling. We discuss evidence related to each criterion and extend these concepts to a beta-motivated framework of multimodal speech processing.

No changes in parieto-occipital alpha during neural phase locking to visual quasi-periodic theta-, alpha-, and beta-band stimulation

Recent studies have probed the role of the parieto-occipital alpha rhythm (8-12 Hz) in human visual perception through attempts to drive its neural generators. To that end, paradigms have used high-intensity strictly-periodic visual stimulation that created strong predictions about future stimulus occurrences and repeatedly demonstrated perceptual consequences in line with an entrainment of parieto-occipital alpha. Our study, in turn, examined the case of alpha entrainment by non-predictive low-intensity quasi-periodic visual stimulation within theta- (4-7 Hz), alpha- (8-13 Hz), and beta (14-20 Hz) frequency bands, i.e., a class of stimuli that resemble the temporal characteristics of naturally occurring visual input more closely. We have previously reported substantial neural phase-locking in EEG recording during all three stimulation conditions. Here, we studied to what extent this phase-locking reflected an entrainment of intrinsic alpha rhythms in the same dataset. Specifically, we tested whether quasi-periodic visual stimulation affected several properties of parieto-occipital alpha generators. Speaking against an entrainment of intrinsic alpha rhythms by non-predictive low-intensity quasi-periodic visual stimulation, we found none of these properties to show differences between stimulation frequency bands. In particular, alpha band generators did not show increased sensitivity to alpha band stimulation and Bayesian inference corroborated evidence against an influence of stimulation frequency. Our results set boundary conditions for when and how to expect effects of entrainment of alpha generators and suggest that the parieto-occipital alpha rhythm may be more inert to external influences than previously thought.

Perceptually relevant speech tracking in auditory and motor cortex reflects distinct linguistic features

During online speech processing, our brain tracks the acoustic fluctuations in speech at different timescales. Previous research has focused on generic timescales (for example, delta or theta bands) that are assumed to map onto linguistic features such as prosody or syllables. However, given the high intersubject variability in speaking patterns, such a generic association between the timescales of brain activity and speech properties can be ambiguous. Here, we analyse speech tracking in source-localised magnetoencephalographic data by directly focusing on timescales extracted from statistical regularities in our speech material. This revealed widespread significant tracking at the timescales of phrases (0.6–1.3 Hz), words (1.8–3 Hz), syllables (2.8–4.8 Hz), and phonemes (8–12.4 Hz). Importantly, when examining its perceptual relevance, we found stronger tracking for correctly comprehended trials in the left premotor (PM) cortex at the phrasal scale as well as in left middle temporal cortex at the word scale. Control analyses using generic bands confirmed that these effects were specific to the speech regularities in our stimuli. Furthermore, we found that the phase at the phrasal timescale coupled to power at beta frequency (13–30 Hz) in motor areas. This cross-frequency coupling presumably reflects top-down temporal prediction in ongoing speech perception. Together, our results reveal specific functional and perceptually relevant roles of distinct tracking and cross-frequency processes along the auditory–motor pathway.

How we comprehend speech—and how the brain encodes information from a continuous speech stream—is of interest for neuroscience, linguistics, and research on language disorders. Previous work that examined dynamic brain activity has addressed the issue of comprehension only indirectly, by contrasting intelligible speech with unintelligible speech or baseline activity. Recent work, however, suggests that brain areas can show similar stimulus-driven activity but differently contribute to perception or comprehension. To directly address the perceptual relevance of dynamic brain activity for speech encoding, we used a straightforward, single-trial comprehension measure. Furthermore, previous work has been vague regarding the analysed timescales. We therefore base our analysis directly on the timescales of phrases, words, syllables, and phonemes of our speech stimuli. By incorporating these two conceptual innovations, we demonstrate that different areas of the brain track acoustic information at the time-scales of words and phrases. Moreover, our results suggest that the motor cortex uses a cross-frequency coupling mechanism to predict the timing of phrases in ongoing speech. Our findings suggest spatially and temporally distinct brain mechanisms that directly shape our comprehension.

The Involvement of Endogenous Neural Oscillations in the Processing of Rhythmic Input: More Than a Regular Repetition of Evoked Neural Responses

It is undisputed that presenting a rhythmic stimulus leads to a measurable brain response that follows the rhythmic structure of this stimulus. What is still debated, however, is the question whether this brain response exclusively reflects a regular repetition of evoked responses, or whether it also includes entrained oscillatory activity. Here we systematically present evidence in favor of an involvement of entrained neural oscillations in the processing of rhythmic input while critically pointing out which questions still need to be addressed before this evidence could be considered conclusive. In this context, we also explicitly discuss the potential functional role of such entrained oscillations, suggesting that these stimulus-aligned oscillations reflect, and serve as, predictive processes, an idea often only implicitly assumed in the literature.

A new approach to detect the coding rule of the cortical spiking model in the information transmission

Investigation of the role of the local field potential (LFP) fluctuations in encoding the received sensory information by the nervous system remains largely unknown. On the other hand, transmission of these translation rules in information transmission between the structure of sensory stimuli and the cortical oscillations to the bio-inspired artificial neural networks operating at the efficiency of the nervous system is still a vague puzzle. In order to move towards this important goal, computational neuroscience tools can be useful so, we simulated a large-scale network of excitatory and inhibitory spiking neurons with synaptic connections consisting of AMPA and GABA currents as a model of cortical populations. Spiking network was equipped with spike-based unsupervised weight optimization based on the dynamical behavior of the excitatory (AMPA) and inhibitory (GABA) synapses using Spike Timing Dependent Plasticity (STDP) on the MNIST benchmark and we specified how the generated LFP by the network contained information about input patterns. The main result of this article is that the calculated coefficients of Prolate spheroidal wave functions (PSWF) from the input pattern with mean square error (MSE) criterion and power spectrum of LFP with maximum correntropy criterion (MCC) are equal. The more important result is that 82.3% of PSWF coefficients are the same as the connecting weights of the cortical neurons to the classifying neurons after the completion of the training process. Higher compliance percentage of coefficients with synaptic weights (82.3%) gives the expectance us that this coding rule will be able to extend to biological systems. Eventually, we introduced the cortical spiking network as an information channel, which transmits the information of the input pattern in the form of PSWF coefficients to the power spectrum of the output generated LFP.

Rhythmic facilitation of sensory processing: A critical review

Here we review the role of brain oscillations in sensory processing. We examine the idea that neural entrainment of intrinsic oscillations underlies the processing of rhythmic stimuli in the context of simple isochronous rhythms as well as in music and speech. This has been a topic of growing interest over recent years; however, many issues remain highly controversial: how do fluctuations of intrinsic neural oscillations-both spontaneous and entrained to external stimuli-affect perception, and does this occur automatically or can it be actively controlled by top-down factors? Some of the controversy in the literature stems from confounding use of terminology. Moreover, it is not straightforward how theories and findings regarding isochronous rhythms generalize to more complex, naturalistic stimuli, such as speech and music. Here we aim to clarify terminology, and distinguish between different phenomena that are often lumped together as reflecting "neural entrainment" but may actually vary in their mechanistic underpinnings. Furthermore, we discuss specific caveats and confounds related to making inferences about oscillatory mechanisms from human electrophysiological data.

Individual Alpha Peak Frequency Predicts 10 Hz Flicker Effects on Selective Attention

Rhythmic visual stimulation ("flicker") is primarily used to "tag" processing of low-level visual and high-level cognitive phenomena. However, preliminary evidence suggests that flicker may also entrain endogenous brain oscillations, thereby modulating cognitive processes supported by those brain rhythms. Here we tested the interaction between 10 Hz flicker and endogenous alpha-band (∼10 Hz) oscillations during a selective visuospatial attention task. We recorded EEG from human participants (both genders) while they performed a modified Eriksen flanker task in which distractors and targets flickered within (10 Hz) or outside (7.5 or 15 Hz) the alpha band. By using a combination of EEG source separation, time-frequency, and single-trial linear mixed-effects modeling, we demonstrate that 10 Hz flicker interfered with stimulus processing more on incongruent than congruent trials (high vs low selective attention demands). Crucially, the effect of 10 Hz flicker on task performance was predicted by the distance between 10 Hz and individual alpha peak frequency (estimated during the task). Finally, the flicker effect on task performance was more strongly predicted by EEG flicker responses during stimulus processing than during preparation for the upcoming stimulus, suggesting that 10 Hz flicker interfered more with reactive than proactive selective attention. These findings are consistent with our hypothesis that visual flicker entrained endogenous alpha-band networks, which in turn impaired task performance. Our findings also provide novel evidence for frequency-dependent exogenous modulation of cognition that is determined by the correspondence between the exogenous flicker frequency and the endogenous brain rhythms.SIGNIFICANCE STATEMENT Here we provide novel evidence that the interaction between exogenous rhythmic visual stimulation and endogenous brain rhythms can have frequency-specific behavioral effects. We show that alpha-band (10 Hz) flicker impairs stimulus processing in a selective attention task when the stimulus flicker rate matches individual alpha peak frequency. The effect of sensory flicker on task performance was stronger when selective attention demands were high, and was stronger during stimulus processing and response selection compared with the prestimulus anticipatory period. These findings provide novel evidence that frequency-specific sensory flicker affects online attentional processing, and also demonstrate that the correspondence between exogenous and endogenous rhythms is an overlooked prerequisite when testing for frequency-specific cognitive effects of flicker.

Trial-by-trial co-variation of pre-stimulus EEG alpha power and visuospatial bias reflects a mixture of stochastic and deterministic effects

Human perception of perithreshold stimuli critically depends on oscillatory EEG activity prior to stimulus onset. However, it remains unclear exactly which aspects of perception are shaped by this pre‐stimulus activity and what role stochastic (trial‐by‐trial) variability plays in driving these relationships. We employed a novel jackknife approach to link single‐trial variability in oscillatory activity to psychometric measures from a task that requires judgement of the relative length of two line segments (the landmark task). The results provide evidence that pre‐stimulus alpha fluctuations influence perceptual bias. Importantly, a mediation analysis showed that this relationship is partially driven by long‐term (deterministic) alpha changes over time, highlighting the need to account for sources of trial‐by‐trial variability when interpreting EEG predictors of perception. These results provide fundamental insight into the nature of the effects of ongoing oscillatory activity on perception. The jackknife approach we implemented may serve to identify and investigate neural signatures of perceptual relevance in more detail.

Entrainment of visual steady-state responses is modulated by global spatial statistics

The rhythmic delivery of visual stimuli evokes large-scale neuronal entrainment in the form of steady-state oscillatory field potentials. The spatiotemporal properties of stimulus drive appear to constrain the relative degrees of neuronal entrainment. Specific frequency ranges, for example, are uniquely suited for enhancing the strength of stimulus-driven brain oscillations. When it comes to the nature of the visual stimulus itself, studies have used a plethora of inputs ranging from spatially unstructured empty fields to simple contrast patterns (checkerboards, gratings, stripes) and complex arrays (human faces, houses, natural scenes). At present, little is known about how the global spatial statistics of the input stimulus influence entrainment of scalp-recorded electrophysiological signals. In this study, we used rhythmic entrainment source separation of scalp EEG to compare stimulus-driven phase alignment for distinct classes of visual inputs, including broadband spatial noise ensembles with varying second-order statistics, natural scenes, and narrowband sine-wave gratings delivered at a constant flicker frequency. The relative magnitude of visual entrainment was modulated by the global properties of the driving stimulus. Entrainment was strongest for pseudo-naturalistic broadband visual noise patterns in which luminance contrast is greatest at low spatial frequencies (a power spectrum slope characterized by 1/ƒ-2).NEW & NOTEWORTHY Rhythmically modulated visual stimuli entrain the activity of neuronal populations, but the effect of global stimulus statistics on this entrainment is unknown. We assessed entrainment evoked by 1) visual noise ensembles with different spectral slopes, 2) complex natural scenes, and 3) narrowband sinusoidal gratings. Entrainment was most effective for broadband noise with naturalistic luminance contrast. This reveals some global properties shaping stimulus-driven brain oscillations in the human visual system.