EEG patterns during 'cognitive' tasks. I. Methodology and analysis of complex behaviors

Let's do it: Response times in Mental Paper Folding and its execution

Action imagery is the ability to mentally simulate the execution of an action without physically performing it. Action imagery is assumed to rely at least partly on similar mechanisms as action execution. Therefore, we expected that imagery and execution durations would be constrained by the number of folds in a Paper Folding Task. Analogously, individual differences in execution durations were expected to be reflected in imagery durations. Twenty-eight participants performed two imagery conditions (computer vs. paper) and one execution condition (paper) where two-dimensional grids of a three-dimensional cube were (mentally) folded to determine whether two selected edges overlapped or not. As expected, imagery performance and execution performance were strongly correlated and decreased with the number of folds. Further, the number of folds influenced imagery durations even more than execution durations. This may be due to the additional cognitive load in imagery that emerges when tracking the folds to follow up with the next ones. The results indicate that Mental Paper Folding predominantly involves dynamic visual representations that are not functionally associated with one's own movements as in action imagery.

Mental Paper Folding Revisited: The Involvement of Visual Action Imagery

Action imagery describes a mental representation of an action and its consequences. Although it is widely recognized that people differ in their ability to imagine actions, objective validated tests to measure such differences are scarce. In search of an objective testing method for action imagery ability, the present study investigated whether solving mental paper-folding tasks involves action imagery. The stimuli were two-dimensional grids of six squares. A total of 99 participants mentally folded each grid into a three-dimensional cube to judge whether two highlighted lines in the grid overlapped in the imagined cube. This was done in two sessions of 214 judgements each, where the grids differed in overlaps, the least number of imagined folds, and the least number of imagined directional changes. Error rates and reaction times increased with the number of imagined folds and with the number of directional changes. Furthermore, more errors were committed with overlapping lines than with no overlaps. This was not reflected in the reaction times. Hence, the reaction times increased when the stepwise folding process was enlarged, but not when the final selection was more difficult. We concluded that the participants predominantly used action imagery as a task-solving strategy rather than for abstract problem-solving.

Executive Function-Related Improvements on a Commercial CBT-Based Weight Management Intervention: Pilot Randomized Controlled Trial

Executive functioning is a key component involved in many of the processes necessary for effective weight management behavior change (e.g., setting goals). Cognitive behavioral therapy (CBT) and third-wave CBT (e.g., mindfulness) are considered first-line treatments for obesity, but it is unknown to what extent they can improve or sustain executive functioning in a generalized weight management intervention. This pilot randomized controlled trial examined if a CBT-based generalized weight management intervention would affect executive functioning and executive function-related brain activity in individuals with obesity or overweight. Participants were randomized to an intervention condition (N = 24) that received the Noom Weight program or to a control group (N = 26) receiving weekly educational newsletters. EEG measurements were taken during Flanker, Stroop, and N-back tasks at baseline and months 1 through 4. After 4 months, the intervention condition evidenced greater accuracy over time on the Flanker and Stroop tasks and, to a lesser extent, neural markers of executive function compared to the control group. The intervention condition also lost more weight than controls (−7.1 pounds vs. +1.0 pounds). Given mixed evidence on whether weight management interventions, particularly CBT-based weight management interventions, are associated with changes in markers of executive function, this pilot study contributes preliminary evidence that a multicomponent CBT-based weight management intervention (i.e., that which provides both support for weight management and is based on CBT) can help individuals sustain executive function over 4 months compared to controls.

Biosensor Real-Time Affective Analytics in Virtual and Mixed Reality Medical Education Serious Games: Cohort Study

Background

The role of emotion is crucial to the learning process, as it is linked to motivation, interest, and attention. Affective states are expressed in the brain and in overall biological activity. Biosignals, like heart rate (HR), electrodermal activity (EDA), and electroencephalography (EEG) are physiological expressions affected by emotional state. Analyzing these biosignal recordings can point to a person’s emotional state. Contemporary medical education has progressed extensively towards diverse learning resources using virtual reality (VR) and mixed reality (MR) applications.

Objective

This paper aims to study the efficacy of wearable biosensors for affect detection in a learning process involving a serious game in the Microsoft HoloLens VR/MR platform.

Methods

A wearable array of sensors recording HR, EDA, and EEG signals was deployed during 2 educational activities conducted by 11 participants of diverse educational level (undergraduate, postgraduate, and specialist neurosurgeon doctors). The first scenario was a conventional virtual patient case used for establishing the personal biosignal baselines for the participant. The second was a case in a VR/MR environment regarding neuroanatomy. The affective measures that we recorded were EEG (theta/beta ratio and alpha rhythm), HR, and EDA.

Results

Results were recorded and aggregated across all 3 groups. Average EEG ratios of the virtual patient (VP) versus the MR serious game cases were recorded at 3.49 (SD 0.82) versus 3.23 (SD 0.94) for students, 2.59 (SD 0.96) versus 2.90 (SD 1.78) for neurosurgeons, and 2.33 (SD 0.26) versus 2.56 (SD 0.62) for postgraduate medical students. Average alpha rhythm of the VP versus the MR serious game cases were recorded at 7.77 (SD 1.62) μV versus 8.42 (SD 2.56) μV for students, 7.03 (SD 2.19) μV versus 7.15 (SD 1.86) μV for neurosurgeons, and 11.84 (SD 6.15) μV versus 9.55 (SD 3.12) μV for postgraduate medical students. Average HR of the VP versus the MR serious game cases were recorded at 87 (SD 13) versus 86 (SD 12) bpm for students, 81 (SD 7) versus 83 (SD 7) bpm for neurosurgeons, and 81 (SD 7) versus 77 (SD 6) bpm for postgraduate medical students. Average EDA of the VP versus the MR serious game cases were recorded at 1.198 (SD 1.467) μS versus 4.097 (SD 2.79) μS for students, 1.890 (SD 2.269) μS versus 5.407 (SD 5.391) μS for neurosurgeons, and 0.739 (SD 0.509) μS versus 2.498 (SD 1.72) μS for postgraduate medical students. The variations of these metrics have been correlated with existing theoretical interpretations regarding educationally relevant affective analytics, such as engagement and educational focus.

Conclusions

These results demonstrate that this novel sensor configuration can lead to credible affective state detection and can be used in platforms like intelligent tutoring systems for providing real-time, evidence-based, affective learning analytics using VR/MR-deployed medical education resources.

The Decision Decoding ToolBOX (DDTBOX) - A Multivariate Pattern Analysis Toolbox for Event-Related Potentials

In recent years, neuroimaging research in cognitive neuroscience has increasingly used multivariate pattern analysis (MVPA) to investigate higher cognitive functions. Here we present DDTBOX, an open-source MVPA toolbox for electroencephalography (EEG) data. DDTBOX runs under MATLAB and is well integrated with the EEGLAB/ERPLAB and Fieldtrip toolboxes (Delorme and Makeig 2004; Lopez-Calderon and Luck 2014; Oostenveld et al. 2011). It trains support vector machines (SVMs) on patterns of event-related potential (ERP) amplitude data, following or preceding an event of interest, for classification or regression of experimental variables. These amplitude patterns can be extracted across space/electrodes (spatial decoding), time (temporal decoding), or both (spatiotemporal decoding). DDTBOX can also extract SVM feature weights, generate empirical chance distributions based on shuffled-labels decoding for group-level statistical testing, provide estimates of the prevalence of decodable information in the population, and perform a variety of corrections for multiple comparisons. It also includes plotting functions for single subject and group results. DDTBOX complements conventional analyses of ERP components, as subtle multivariate patterns can be detected that would be overlooked in standard analyses. It further allows for a more explorative search for information when no ERP component is known to be specifically linked to a cognitive process of interest. In summary, DDTBOX is an easy-to-use and open-source toolbox that allows for characterising the time-course of information related to various perceptual and cognitive processes. It can be applied to data from a large number of experimental paradigms and could therefore be a valuable tool for the neuroimaging community.

Effects of neurofeedback and working memory-combined training on executive functions in healthy young adults

Given the interest in improving executive functions, the present study examines a promising combination of two training techniques: neurofeedback training (NFT) and working memory training (WMT). NFT targeted increasing the amplitude of individual's upper Alpha frequency band at the parietal midline scalp location (Pz), and WMT consisted of an established computerized protocol with working memory updating and set-shifting components. Healthy participants (n = 140) were randomly allocated to five combinations of training, including visual search training used as an active control training for the WMT; all five groups were compared to a sixth silent control group receiving no training. All groups were evaluated before and after training for resting-state electroencephalogram (EEG) and behavioral executive function measures. The participants in the silent control group were unaware of this procedure, and received one of the training protocols only after study has ended. Results demonstrated significant improvement in the practice tasks in all training groups including non-specific influence of NFT on resting-state EEG spectral topography. There was only a near transfer effect (improvement in working memory task) for WMT, which remained significant in the delayed post-test (after 1 month), in comparison to silent control group but not in comparison to active control training group. The NFT + WMT combined group showed improved mental rotation ability both in the post-training and in the follow-up evaluations. This improvement, however, did not differ significantly from that in the silent control group. We conclude that the current training protocols, including their combination, have very limited influence on the executive functions that were assessed in this study.

EEG spatiospectral patterns and their link to fMRI BOLD signal via variable hemodynamic response functions

BACKGROUND

Spatial and temporal resolution of brain network activity can be improved by combining different modalities. Functional Magnetic Resonance Imaging (fMRI) provides full brain coverage with limited temporal resolution, while electroencephalography (EEG), estimates cortical activity with high temporal resolution. Combining them may provide improved network characterization.

NEW METHOD

We examined relationships between EEG spatiospectral pattern timecourses and concurrent fMRI BOLD signals using canonical hemodynamic response function (HRF) with its 1^st and 2^nd temporal derivatives in voxel-wise general linear models (GLM). HRF shapes were derived from EEG-fMRI time courses during "resting-state", visual oddball and semantic decision paradigms.

RESULTS

The resulting GLM F-maps self-organized into several different large-scale brain networks (LSBNs) often with different timing between EEG and fMRI revealed through differences in GLM-derived HRF shapes (e.g., with a lower time to peak than the canonical HRF). We demonstrate that some EEG spatiospectral patterns (related to concurrent fMRI) are weakly task-modulated.

COMPARISON WITH EXISTING METHOD(S)

Previously, we demonstrated 14 independent EEG spatiospectral patterns within this EEG dataset, stable across the resting-state, visual oddball and semantic decision paradigms. Here, we demonstrate that their time courses are significantly correlated with fMRI dynamics organized into LSBN structures. EEG-fMRI derived HRF peak appears earlier than the canonical HRF peak, which suggests limitations when assuming a canonical HRF shape in EEG-fMRI.

CONCLUSIONS

This is the first study examining EEG-fMRI relationships among independent EEG spatiospectral patterns over different paradigms. The findings highlight the importance of considering different HRF shapes when spatiotemporally characterizing brain networks using EEG and fMRI.

Controlling Working Memory Operations by Selective Gating: The Roles of Oscillations and Synchrony

Working memory (WM) is a primary cognitive function that corresponds to the ability to update, stably maintain, and manipulate short-term memory (ST M) rapidly to perform ongoing cognitive tasks. A prevalent neural substrate of WM coding is persistent neural activity, the property of neurons to remain active after having been activated by a transient sensory stimulus. This persistent activity allows for online maintenance of memory as well as its active manipulation necessary for task performance. WM is tightly capacity limited. Therefore, selective gating of sensory and internally generated information is crucial for WM function. While the exact neural substrate of selective gating remains unclear, increasing evidence suggests that it might be controlled by modulating ongoing oscillatory brain activity. Here, we review experiments and models that linked selective gating, persistent activity, and brain oscillations, putting them in the more general mechanistic context of WM. We do so by defining several operations necessary for successful WM function and then discussing how such operations may be carried out by mechanisms suggested by computational models. We specifically show how oscillatory mechanisms may provide a rapid and flexible active gating mechanism for WM operations.

Frontal EEG alpha band asymmetry as a predictor of reasoning deficiency in depressed people

Cognitive deficits in depression are mostly apparent in executive functions, especially when integration of information and reasoning is required. In parallel, there are also numerous studies pointing to the frontal alpha band asymmetry as a psychophysiological marker of depression. In this study, we explored the role of frontal alpha asymmetry as a potential factor explaining the cognitive problems accompanying depression. Twenty-six depressed and 26 control participants completed a reasoning task and underwent 5 minutes of electroencephalography recording. In line with the previous studies, depressed people showed difficulties with reasoning but we did not observe the relationship between frontal asymmetry in the alpha band and depression. However, we found that in the depressed group the frontal alpha asymmetry index was characterised by larger variance than in the control group, and it was also a strong predictor of cognitive functioning exclusively in the depressed group. Our results point to the disruption of a psychophysiological balance, reflected in changed frontal alpha asymmetry (into more left-sided frontal asymmetry in the alpha band, reflecting more right-sided cortical activity) as a possible brain correlate of cognitive disturbances present in depressive disorders.

A cognitive and neurophysiological test of change from an individual's baseline

OBJECTIVE

An automated cognitive neurophysiological test is presented that characterizes how an individual was affected by a drug or treatment. The test calculates sub-scores for working memory task performance, cortical activation, and alertness, and combines the sub-scores into an overall score.

METHODS

The test was applied in a double-blind, placebo-controlled study of alcohol, caffeine, diphenhydramine, and sleep deprivation in 16 healthy adults.

RESULTS

The between- and within-day variability of the sub-scores and overall scores for placebo were all near zero, suggesting that the scores are stable. All treatments affected the overall score, while differential effects on sub-scores highlighted the added value of EEG measures.

CONCLUSIONS

The test is sensitive to relatively mild alterations in cognitive function. Its automation makes it suitable for use in large-scale clinical trials.

SIGNIFICANCE

By combining task performance with EEG brain function measures, the test may prove to have better sensitivity and specificity in detecting changes due to drugs or other treatments than comparable neuropsychological test batteries that do not directly measure brain function signals.

Individualized alpha activity and frontal asymmetry in major depression

Lateralized differences in frontal alpha power in individuals with major depressive disorder (MDD) are thought to reflect an aberrant affective processing style. However research into anterior alpha asymmetry and MDD has often produced conflicting results. The current study aimed to investigate whether individualized alpha bandwidths provide a more sensitive measure of anterior alpha asymmetry in MDD than the traditional fixed 8-13 Hz alpha band. Resting EEG was recorded from 34 right-handed female participants (18 controls, 16 MDD). Each participant's Individual Alpha Frequency was used to delineate a broad individualized alpha band and three individualized narrow alpha sub-bands: lower alpha1, lower alpha 2 and upper alpha. Activity within the broad and narrow individualized bandwidths and within the traditional fixed alpha band were used to compare a) controls and acutely depressed individuals and b) medicated and unmedicated MDD participants. Individualizing and subdividing the alpha bandwidth did not add appreciably to the sensitivity of anterior alpha asymmetry in MDD as no significant differences in lateralized alpha power between controls and MDD participants were observed in any alpha bandwidth. This finding was consistent under two reference schemes and across multiple scalp locations. Within the MDD group, antidepressant use was associated with significantly greater right than left hemispheric power in the lower alpha 1 band. The relevance of this finding is discussed in relation to the electrophysiological correlates of antidepressant medication use, lateralized differences in affective processing and treatment resistant MDD.

Neurocognitive effects of brivaracetam, levetiracetam, and lorazepam

PURPOSE

Brivaracetam (BRV) is a new anticonvulsant under development. Although BRV is an analog of levetiracetam (LEV), in addition to being an SV2A ligand, it also inhibits sodium channels in a voltage-dependent manner. The cognitive effects of BRV are uncertain.

METHODS

A randomized, double-blind, placebo-controlled, four-way cross-over design was employed in 16 healthy volunteers comparing acute dosing (i.e., two doses) of BRV 10 mg, LEV 500 mg, lorazepam (LZP) 2 mg, and placebo. The primary outcome was the summary score from the cognitive neurophysiologic test (CNT), which combines electrophysiologic and performance measures. Secondary outcomes included CNT cognitive and electrophysiologic subscores, traditional neuropsychological measures, and treatment-emergent adverse events (TEAEs).

RESULTS

Compared to BRV, LEV, and placebo, LZP adversely affected the CNT summary score and the majority of CNT subscores and neuropsychological measures. In contrast, BRV did not differ from placebo or LEV on any measure. More TEAEs occurred with LZP compared to each of the other treatment conditions.

DISCUSSION

The differential pattern of drug effects was consistent across multiple electrophysiologic, cognitive, and subjective measures. The profile of cognitive, subjective, and electrophysiologic effects for BRV was similar to the analog compound LEV and to placebo. The findings suggest that BRV should be tolerated well from a neuropsychological perspective, but additional studies are needed.

Relationship between regional hemodynamic activity and simultaneously recorded EEG-theta associated with mental arithmetic-induced workload

Theta increases with workload and is associated with numerous processes including working memory, problem solving, encoding, or self monitoring. These processes, in turn, involve numerous structures of the brain. However, the relationship between regional brain activity and the occurrence of theta remains unclear. In the present study, simultaneous EEG-fMRI recordings were used to investigate the functional topography of theta. EEG-theta was enhanced by mental arithmetic-induced workload. For the EEG-constrained fMRI analysis, theta-reference time-series were extracted from the EEG, reflecting the strength of theta occurrence during the time course of the experiment. Theta occurrence was mainly associated with activation of the insular cortex, hippocampus, superior temporal areas, cingulate cortex, superior parietal, and frontal areas. Though observation of temporal and insular activation is in accord with the theory that theta specifically reflects encoding processes, the involvement of several other brain regions implies that surface-recorded theta represents comprehensive functional brain states rather than specific processes in the brain. The results provide further evidence for the concept that emergent theta band oscillations represent dynamic functional binding of widely distributed cortical assemblies, essential for cognitive processing. This binding process may form the source of surface-recorded EEG theta.

Relationship of working memory and EEG to academic performance: a study among high school students

Some biological and behavioral elements which could explain differences between high and low academic attainment (HA/LA) students were identified. The qEEG of subjects under the 10-20 derivation system was recorded at rest and while completing a 3-back working memory (WM) task. While completing the task LA students showed more theta and total absolute potency at rest, and HA individuals showed more energy in delta and theta frequencies in frontal regions; LA students made a higher number of mistakes while executing the WM task with no differences in reaction time between groups. We conclude that a diminished WM capacity is present in LA students.

Frontal midline theta rhythm is correlated with cardiac autonomic activities during the performance of an attention demanding meditation procedure

Frontal midline theta rhythm (Fm theta), recognized as distinct theta activity on EEG in the frontal midline area, reflects mental concentration as well as meditative state or relief from anxiety. Attentional network in anterior frontal lobes including anterior cingulate cortex is suspected to be the generator of this activity, and the regulative function of the frontal neural network over autonomic nervous system (ANS) during cognitive process is suggested. However no studies have examined peripheral autonomic activities during Fm theta induction, and interaction of central and peripheral mechanism associated with Fm theta remains unclear. In the present study, a standard procedure of Zen meditation requiring sustained attention and breath control was employed as the task to provoke Fm theta, and simultaneous EEG and ECG recordings were performed. For the subjects in which Fm theta activities were provoked (six men, six women, 48% of the total subjects), peripheral autonomic activities were evaluated during the appearance of Fm theta as well as during control periods. Successive inter-beat intervals were measured from the ECG, and a recently developed method of analysis by Toichi et al. (J. Auton. Nerv. Syst. 62 (1997) 79-84) based on heart rate variability was used to assess cardiac sympathetic and parasympathetic functions separately. Both sympathetic and parasympathetic indices were increased during the appearance of Fm theta compared with control periods. Theta band activities in the frontal area were correlated negatively with sympathetic activation. The results suggest a close relationship between cardiac autonomic function and activity of medial frontal neural circuitry.

Monitoring task loading with multivariate EEG measures during complex forms of human-computer interaction

Electroencephalographic (EEG) recordings were made while 16 participants performed versions of a personal-computer-based flight simulation task of low, moderate, or high difficulty. As task difficulty increased, frontal midline theta EEG activity increased and alpha band activity decreased. A participant-specific function that combined multiple EEG features to create a single load index was derived from a sample of each participant's data and then applied to new test data from that participant. Index values were computed for every 4 s of task data. Across participants, mean task load index values increased systematically with increasing task difficulty and differed significantly between the different task versions. Actual or potential applications of this research include the use of multivariate EEG-based methods to monitor task loading during naturalistic computer-based work.

Mental effort-related EEG modulation during video-game play: comparison between juvenile subjects with epilepsy and normal control subjects

PURPOSE

This study investigated the effects of mental effort exerted during video-game play on features of the EEG in juvenile subjects diagnosed with seizure disorders and in age-matched clinically healthy subjects.

METHODS

EEG was recorded from 14 children (9-15 years old) as they played a video game, watched another person playing a video-game, and sat quietly with their eyes open. Seven of the subjects had been clinically diagnosed with seizure disorders, three of whom had also exhibited photosensitivity.

RESULTS

Three spectral components of the EEG showed cognitive load-related modulation. The amplitude of a frontal midline theta (6-7 Hz) signal increased with video-game play relative to the watching and eyes open resting conditions. A posterior alpha band (9-12 Hz) signal was attenuated during the playing and the watching conditions relative to the resting condition. A central mu (10-13 Hz) rhythm was attenuated during the game-playing condition. No significant differences were found between the patient and control groups for any of these features. Incidence of epileptiform events did not discriminate test conditions in the children with epilepsy.

CONCLUSIONS

The results from this small sample suggest that video-game play tends to produce similar responses from children with epilepsy and in healthy control subjects. These responses in the juvenile population are similar to responses elicited by increased mental load in normal adult populations.

Neurophysiological indices of strategy development and skill acquisition

In order to examine neurophysiological changes associated with the development of cognitive and visuomotor strategies and skills, spectral features of the EEG were measured as participants learned to perform new tasks. In one experiment eight individuals practiced working memory tasks that required development of either spatial or verbal rehearsal and updating strategies. In a second experiment six individuals practiced a video game with a difficult visuomotor tracking component. The alpha rhythm, which is attenuated by functional cortical activation, was affected by task practice. In both experiments, a lower-frequency, centrally distributed alpha component increased between practice sessions in a task-independent fashion, reflecting an overall decrease in the extent of cortical activation after practice. A second, higher-frequency, posterior component of the alpha rhythm displayed task-specific practice effects. Practice in the verbal working memory task resulted in an increase of this signal over right posterior regions, an effect not seen after practice with the spatial working memory task or with the video game. This between-task difference presumably reflects a continued involvement of the posterior region of the right hemisphere in tasks that invoke visuospatial processes. This finding thus provides neurophysiological evidence for the formation of a task-specific neurocognitive strategy. In the second experiment a third component of the alpha rhythm, localized over somatomotor cortex, was enhanced in conjunction with acquisition of tracking skill. These alpha band results suggest that cortical regions not necessary for task performance become less active as skills develop. In both experiments the frontal midline (Fm) theta rhythm also displayed increases over the course of test sessions. This signal is associated with states of focused concentration, and its enhancement might reflect the conscious control over attention associated with maintenance of a task-appropriate mental set. Overall, the results suggest that the EEG can be used to monitor practice-related changes in the patterns of cortical activity that are associated with task processing. Additionally, these results highlight the importance of ensuring that subjects have developed stable strategies for performance before drawing inferences about the functional architecture underlying specific cognitive processes.

Alcohol and disinhibition

This review investigates research evaluating the disinhibition hypothesis. This hypothesis postulates that in a sober state behavior is inhibited. When people are influenced by alcohol the inhibitions are supposed to be weakened and the motivating drives are postulated to become disinhibited and potent to influence behavior. This report reviews the effect of alcohol on nerve functions, on human sexuality, aggression, eating behavior, psychological conflicts, fluency in talk, social anxiety, violent crimes and the interaction of alcohol and social norms. It has been shown that individual subjective experiences sometimes indicate disinhibition (reduction of the forces holding back impulses) and objective behavior in some respects was different when the subject was intoxicated, but the mechanism that mediates behavior is not clear. It seems to be difficult to measure independently the forces restraining (inhibiting) the driving forces (uncontrolled impulses) at the same time as measuring these driving forces. The review concludes that there is no unambiguous support of the disinhibition hypothesis. An alternative hypothesis that seems to explain many behaviors in an inebriated individual is the 'time out' hypothesis which states that drunken behavior is influenced more by norms about what it should be than by the pharmacological effect of alcohol.

Monitoring working memory load during computer-based tasks with EEG pattern recognition methods

We assessed working memory load during computer use with neural network pattern recognition applied to EEG spectral features. Eight participants performed high-, moderate-, and low-load working memory tasks. Frontal theta EEG activity increased and alpha activity decreased with increasing load. These changes probably reflect task difficulty-related increases in mental effort and the proportion of cortical resources allocated to task performance. In network analyses, test data segments from high and low load levels were discriminated with better than 95% accuracy. More than 80% of test data segments associated with a moderate load could be discriminated from high- or low-load data segments. Statistically significant classification was also achieved when applying networks trained with data from one day to data from another day, when applying networks trained with data from one task to data from another task, and when applying networks trained with data from a group of participants to data from new participants. These results support the feasibility of using EEG-based methods for monitoring cognitive load during human-computer interaction.

Transcranial magnetic stimulation during positron emission tomography: a new method for studying connectivity of the human cerebral cortex

We describe a new technique permitting the mapping of neural connections in the living human brain. The method combines two well established tools of brain research: transcranial magnetic stimulation (TMS) and positron emission tomography (PET). We use TMS to stimulate directly a selected cortical area while simultaneously measuring changes in brain activity, indexed by cerebral blood flow (CBF), with PET. The exact location of the stimulation site is achieved by means of frameless stereotaxy. In the first study using this technique, we found significant positive correlations between CBF and the number of TMS pulse trains at the stimulation site, namely the left frontal eye field (FEF) and, most importantly, in the visual cortex of the superior parietal and medial parieto-occipital regions. The pattern of these distal effects was consistent with the known anatomic connectivity of the monkey FEF. We suggest that the combined TMS/PET technique offers an objective tool for assessing the state of functional connectivity without requiring the subject to engage in any specific behavior.

Localization of word and face recognition memory using topographical EEG

The aim of this study was to explore the ability of epoch-averaged electroencephalogram (EEG) to localize cognitive functions. The EEG was recorded in healthy individuals performing a task where, on the basis of evidence from other functional brain imaging techniques, there was a high expectation of where functional changes would be expected. Topographical EEG was recorded while individuals performed recognition memory tasks for words and faces. Comparison of the acquisition and recognition phases of the experiment showed significant attenuation of alpha, beta 1, and beta 2 in the right temporoparietal region for the faces but no significant changes for words. Left temporoparietal changes for the word task were only seen among the women. The results confirmed the validity of EEG for use in the localization of cognitive function for faces for men and women but in the case of words for the women only.

Working-memory load and dimensional complexity of the EEG

This investigation shows that a working-memory load induced by a memory scanning task has an effect on nonlinear descriptors of the EEG dynamics. The effect was locally specific above the fronto-temporal (right) cortex and it may be described as a reduction in the dimensional complexity of cortical brain activity. The meaning of the effects seems to differ from that of EEG spectral power, which varied with time during the experiment and not with changes in the working-memory load conditions. Behaviorally controlled over- and underload led to increased variance of the dimensional complexity, thus indicating that dimensional complexity correlates more closely with actual performance than with more general descriptions of brain states. Habitual response speed had an effect at the parietal lead, thus indicating that fast responders reduced their dimensional complexity as the task demand increased. In contrast, the slower responders showed no such definite trend.

Cerebral laterality in affect and affective illness: a review

It is generally claimed that affect processing is a right hemisphere function. It is also claimed that right hemisphere dysfunction is characteristic of depressive illness. These claims are not accepted without controversy, and it has been found that the relationship between affect processing and affective illness in terms of intra- and interhemispheric role is not straightforward. Two types of studies were reviewed in this context: behavioral and electrophysiological. Potential confounding effects are discussed.

EEG after prolonged mental activity

The goal of the present study was to investigate the EEG spectral power changes caused by prolonged (6 hours) intensive mental loading consisted of calculation and choice-reaction tasks. The EEGs were analysed both during the tasks performance and in rest periods at the beginning of the work (after subjects had already mastered the tasks) and at the end. The significant increase both of slow (delta, theta) and fast (beta) activities was shown at the end of the work. The observed EEG spectral power changes with time on task were similar during the different tasks performance as well as in the rest conditions indicating the general character of the observed phenomena. These results are interpreted as reflecting the deterioration of general brain state activity caused by prolonged mental work and the simultaneous additional brain activation to provide sufficient vigilance level and successful tasks performance (the subjects being highly motivated).

Spatio-temporal correlations in human gamma band electrocorticograms

Animal electrocorticogram (ECoG) studies have shown that spatial patterns in the gamma band (>20 Hz) reflect perceptual categorization. Spatio-temporal correlations were investigated in the 20-50 Hz range in search for similar phenomena in human ECoG. ECoGs were recorded in a somatosensory discrimination task from 64-electrode subdural grid arrays, with inter-electrode spacing of 1 cm, overlying somatosensory, motor and superior temporal cortices in 2 patients with intractable epilepsy. Bootstrap techniques were devised to analyze the spatial and temporal characteristics of the correlations. Despite an extensive search, no evidence was found for globally correlated activity related to behavior either in narrow (1.e., 35-45 Hz) or broad (i.e., 20-50 Hz) bands. Spatial patterns, extracted using principal component analysis, could not be classified with respect to stimulus type in any time interval. Instead, spatially and temporally intermittent synchronization was observed between pairs of electrodes in 1 cm X 1 cm regions with high variability within and across trials. The distribution of correlation coefficients differed substantially from background levels at inter-electrode distances of 1 cm and 1.4 cm but not 2 cm or more. The minimum duration of correlation, the decorrelation time, of the ECoG was about 50 msec; the average correlation duration at 1 cm inter-electrode distance was about 150 msec; and the recurrence rate of significant correlation peaks was about 1.3/sec. The findings suggest that the surface diameters of domains of spatially correlated activity underlying perceptual categorization in human gamma band ECoG are limited to less than 2 cm and that the intermittent synchronization observed across separations of 1 cm and 1.4 cm is not solely due to volume conduction. Thus, if such gamma band spatial patterns exist in the human brain, no existing technology would be capable of measuring them at the scalp, and subdural electrode arrays for cortical surface recording would have to have spacings under 5 mm.

Towards measurement of brain function in operational environments

In operational environments that demand sustained vigilance or that involve multiple tasks competing for limited attentional resources, continuous monitoring of the mental state of the operator could decrease the potential for serious errors and provide valuable information concerning the ergonomics of the tasks being performed. There is widespread discussion and appreciation of the basic feasibility of utilizing neurophysiological measurements to derive accurate, reliable, rapid and unobtrusive assessments of mental state. However, progress in transitioning this idea into practical applications has been impeded by the fact that at present no convenient, inexpensive and effective means exists to derive a meaningful index of brain activity outside of laboratory settings. In this paper, we review some recent advances in recording technology and signal processing methods that will help overcome this limitation. For example, rapid progress is being made in the engineering of recording systems that are small, rugged, portable and easy-to-use, and thus suitable for deployment in operational environments. Progress is also being made in the development of signal processing algorithms for detecting and correcting recording artifacts and for increasing the amount of useful information that can be derived from brain signals. Finally, results from basic research studies suggest that accurate and reliable inferences about the mental load and alertness of an individual can be derived from neurophysiological measures in a practical fashion. These research and engineering successes suggest that it is reasonable to expect that in the near term a basic enabling technology will be deployed that will permit routine measurement of brain function in operational environments.

Toward a psychophysiological assessment of dynamic changes in mental workload

The main goal of the present study was to examine the feasibility of employing event-related brain potentials to measure dynamic changes in mental workload. Subjects performed two tasks, monitoring and mental arithmetic, both separately and together. Following an analysis of the performance, subjective workload ratings, and average ERP data in the single- and dual-task conditions, two different conditions from each of the tasks were selected for further analysis. A bootstrapping approach was employed to determine the amount of ERP data required to discriminate between these conditions. The results of these analyses indicated that (a) 90% correct discrimination could be achieved with from 1 to 11 s of ERP data, (b) the best ERP measures varied across tasks and subjects, and (c) the inclusion of temporal and spatial aspects of the ERP data improved the ability to discriminate among workload levels. The data is discussed with respect to real-time assessment of mental workload.

Gender differences in the EEG during cognitive activity

EEG activity of 16 adult volunteers. 8 male and 8 females was monopolarly recorded at P3 and P4 at rest and during solution of three series of tasks: one analytic, one spatial and one mixed demanding both kinds of processing. The following main effects were observed: Men showed significantly higher beta relative power than women, while women showed significantly higher alpha relative power than men during all conditions. Alpha relative power decreased, while theta relative power increased during tasks solution in both sexes. Beta relative power was significantly higher at the left parietal only in men. Interparietal correlation was significantly higher in women than in men during all conditions and bands. For the theta band it increased from baseline values during tasks solution in men, while in women it decreased during the analytic task.

EEG activity during cognitive performance in women

EEG activity of 20 female volunteers was monopolarly recorded at P3, P4, C3 and C4 during four resting periods and three series of cognitive tasks: one analytic, one spatial and one demanding analytical and spatial processing or mixed task. Relative power and inter and intrahemispheric correlations were analysed. Beta relative power was significantly higher during the resting periods at the right parietal and the same pattern of asymmetry was maintained during the three series of tasks. Alpha relative power decreased and theta increased during the three series of tasks regardless of their cognitive nature as compared to baseline. Interhemispheric correlation for theta frequencies, and intrahemispheric correlation for the full band were significantly different during task solution. There were no significant differences between left and right intrahemispheric correlations.

Changes in spontaneous EEG activity indicate a special kind of information processing in concept learning

Some findings in the literature suggest that a high amount of spectral power in spontaneous EEG alpha 1 band (7.5-10.0 Hz) may be associated with tasks demanding extensive monitoring of stimulus information and combining features for a match with internal concepts ("exploration"). EEG recordings were obtained from 9 subjects involved in a concept-learning task. They had to match visually presented objects with a concept built up by hypothesis and to respond by pressing a "yes" or "no" key. Epochs of EEG data were analyzed with epoch center-times at 500 and 250 ms before response execution. In the case of "yes" responses, when subjects could match their hypothesis positively with combined features of the presented object increased alpha 1 spectral power was found. Also alpha 1 power was larger immediately after disconfirming feedback than after confirming feedback. Additionally, alpha 2 spectral power (10.5-12.5 Hz) was found to be larger 250 ms after confirming feedback than after disconfirming feedback. It is argued that alpha 1 power seems to reflect those mental processes which are involving in combining features and matching them to a concept in mind. The increase in alpha 2 power after confirming feedback is interpreted in terms of general processing demands imposed during task performance.

Event-related covariances during a bimanual visuomotor task. I. Methods and analysis of stimulus- and response-locked data

A new method that measures between-channel, event-related covariances (ERCs) from scalp-recorded brain signals has been developed. The method was applied to recordings of 26 EEG channels from 7 right-handed men performing a bimanual visuomotor judgment task that required fine motor control. Covariance and time-delay measures were derived from pairs of filtered, laplacian-derived, averaged wave forms, which were enhanced by rejection of outlying trials, in intervals spanning event-related potential components. Stimulus- and response-locked ERC patterns were consistent with functional neuroanatomical models of visual stimulus processing and response execution. In early post-stimulus intervals, ERC patterns differed according to the physical properties of the stimulus; in later intervals, the patterns differed according to the subjective interpretation of the stimulus. The response-locked ERC patterns suggested 4 major cortical generators for the voluntary fine motor control required by the task: motor, somesthetic, premotor and/or supplementary motor, and prefrontal. This new method may thus be an advancement toward characterizing, both spatially and temporally, functional cortical networks in the human brain responsible for perception and action.

Dynamic functional topography of cognitive tasks

Improved neuroelectric recording and analysis tools are yielding increasingly specific information about the spatial and temporal features of neurocognitive processes. Such tools include recordings with up to 125 channels, digital signal processing techniques, and correlation of neuroelectric measures with anatomical information from magnetic resonance images. These tools, and their application to the study of cognitive functions, are presented in this paper.

EEG activity during performance of cognitive tasks demanding verbal and/or spatial processing

EEG activity of 8 male volunteers was monopolarly recorded at P3 and P4 during four resting periods and during the performance of three series of cognitive tasks: one verbal, one spatial and one demanding verbal and spatial processing or "mixed" task. Beta, alpha and theta relative power were compared between successful and unsuccessful trials, between start and end of performance interval and among resting periods and tasks. There were no significant differences between successful and unsuccessful trials, nor between start and ending of performance period. The effect of tasks and hemispheres on relative power showed different results for each band: beta was responsive to hemispheres while alpha and theta were sensitive to tasks; beta relative power was significantly higher in the left parietal and the same pattern of asymmetry was maintained during the three series of tasks; alpha relative power decreased and theta increased significantly during the three series of tasks regardless of their cognitive nature as compared to baseline.

Improved event-related potential estimation using statistical pattern classification

A new method of ERP estimation with minimal statistical assumptions is presented. A mathematical pattern classification procedure is used to select trials with discriminable event-related signals in a time interval of interest. A method of forming a reference 'baseline' is also presented. Stimulus-registered and response-registered 'enhanced' ERP averages computed from selected trials of a visuo-motor experiment show substantial enhancement of event-related signals, especially for channels with weak signals, while rejected trials have minimal event-related signals.

Filtering and aliasing of muscle activity in EEG frequency analysis

Muscle artifact contains activity at frequencies more than half the usual data acquisition rates for spectral EEG that may contribute power at conventional EEG frequencies by aliasing. In spectral analysis work, excessive EMG activity is usually rejected by visual inspection, but significant amounts may still remain and special steep low-pass filters are usually used to inhibit aliasing. A 24 dB/octave variable filter was used in various combinations with conventional EEG amplifier filters to study aliasing of EMG activity. Aliased EMG activity entered as noise across all frequencies. With the usual amount of EMG activity that is present in EEG undergoing frequency analysis, a 6 dB/octave 35 Hz low-pass filter is equivalent to the 24 dB/octave 35 Hz low-pass filter in preventing aliasing using a sampling rate at least 128 Hz.

On-going EEG in depression: a topographic spectral analytical pilot study

Spontaneous EEG activities recorded with 19 electrodes (10-20 system) on the scalp were quantified by spectral analytical methods (power and coherence spectra) to reveal changes of power and coherence during different conditions (eyes closed/relaxed, eyes opened/relaxed, flicker stimulation, reading, listening to a story). Control subjects and depressive patients were compared. Power as well as coherence changes were found in all frequency bands. Changes in the organization of the EEG were found in different areas of both hemispheres. The EEG organization was different in control subjects and depressive patients, indicating different levels of vigilance and/or different cognitive strategies in verbal tasks in the two groups.

Attention to television: intrastimulus effects of movement and scene changes on alpha variation over time

Central and occipital EEG alpha were used as an on-line measure of momentary changes in covert attention during television viewing. Alpha was recorded during nine 30-second commercials shown embedded in a half-hour situation comedy. Two time series were constructed for data analysis. A stimulus series consisted of codes representing the presence or absence of scene changes or person and object movement for each half-second interval of the commercials. The alpha series consisted of median alpha scores for each half-second interval, aggregated across 26 subjects. The alpha series was regressed on the movement and scene change series, both of which produced significant increments in R, even after autocorrelational effects inherent in the alpha series were removed. As a validity check on the attentional interpretation of alpha, it was shown that mean alpha for each commercial was significantly (negatively) correlated with recall and recognition of commercial contents. The results are discussed in terms of their implications for further use of continuously-recorded alpha in research on factors that influence attention to television.