Effects of Visual Scene Complexity on Neural Signatures of Spatial Attention

Attentional demands in the visual field modulate audiovisual interactions in the temporal domain

Attention and crossmodal interactions are closely linked through a complex interplay at different stages of sensory processing. Within the context of motion perception, previous research revealed that attentional demands alter audiovisual interactions in the temporal domain. In the present study, we aimed to understand the neurophysiological correlates of these attentional modulations. We utilized an audiovisual motion paradigm that elicits auditory time interval effects on perceived visual speed. The audiovisual interactions in the temporal domain were quantified by changes in perceived visual speed across different auditory time intervals. We manipulated attentional demands in the visual field by having a secondary task on a stationary object (i.e., single- vs. dual-task conditions). When the attentional demands were high (i.e., dual-task condition), there was a significant decrease in the effects of auditory time interval on perceived visual speed, suggesting a reduction in audiovisual interactions. Moreover, we found significant differences in both early and late neural activities elicited by visual stimuli across task conditions (single vs. dual), reflecting an overall increase in attentional demands in the visual field. Consistent with the changes in perceived visual speed, the audiovisual interactions in neural signals declined in the late positive component range. Compared with the findings from previous studies using different paradigms, our findings support the view that attentional modulations of crossmodal interactions are not unitary and depend on task-specific components. They also have important implications for motion processing and speed estimation in daily life situations where sensory relevance and attentional demands constantly change.

Blink-related EEG activity measures cognitive load during proactive and reactive driving

Assessing drivers' cognitive load is crucial for driving safety in challenging situations. This research employed the occurrence of drivers' natural eye blinks as cues in continuously recorded EEG data to assess the cognitive workload while reactive or proactive driving. Twenty-eight participants performed either a lane-keeping task with varying levels of crosswind (reactive) or curve road (proactive). The blink event-related potentials (bERPs) and spectral perturbations (bERSPs) were analyzed to assess cognitive load variations. The study found that task load during reactive driving did not significantly impact bERPs or bERSPs, possibly due to enduring alertness for vehicle control. The proactive driving revealed significant differences in the occipital N1 component with task load, indicating the necessity to adapt the attentional resources allocation based on road demands. Also, increased steering complexity led to decreased frontal N2, parietal P3, occipital P2 amplitudes, and alpha power, requiring more cognitive resources for processing relevant information. Interestingly, the proactive and reactive driving scenarios demonstrated a significant interaction at the parietal P2 and occipital N1 for three difficulty levels. The study reveals that EEG measures related to natural eye blink behavior provide insights into the effect of cognitive load on different driving tasks, with implications for driver safety.

Denoising task-correlated head motion from motor-task fMRI data with multi-echo ICA

Motor-task functional magnetic resonance imaging (fMRI) is crucial in the study of several clinical conditions, including stroke and Parkinson's disease. However, motor-task fMRI is complicated by task-correlated head motion, which can be magnified in clinical populations and confounds motor activation results. One method that may mitigate this issue is multi-echo independent component analysis (ME-ICA), which has been shown to separate the effects of head motion from the desired BOLD signal but has not been tested in motor-task datasets with high amounts of motion. In this study, we collected an fMRI dataset from a healthy population who performed a hand grasp task with and without task-correlated amplified head motion to simulate a motor-impaired population. We analyzed these data using three models: single-echo (SE), multi-echo optimally combined (ME-OC), and ME-ICA. We compared the models' performance in mitigating the effects of head motion on the subject level and group level. On the subject level, ME-ICA better dissociated the effects of head motion from the BOLD signal and reduced noise. Both ME models led to increased t-statistics in brain motor regions. In scans with high levels of motion, ME-ICA additionally mitigated artifacts and increased stability of beta coefficient estimates, compared to SE. On the group level, all three models produced activation clusters in expected motor areas in scans with both low and high motion, indicating that group-level averaging may also sufficiently resolve motion artifacts that vary by subject. These findings demonstrate that ME-ICA is a useful tool for subject-level analysis of motor-task data with high levels of task-correlated head motion. The improvements afforded by ME-ICA are critical to improve reliability of subject-level activation maps for clinical populations in which group-level analysis may not be feasible or appropriate, for example in a chronic stroke cohort with varying stroke location and degree of tissue damage.

Spatiotemporal characteristics of cortical activities of REM sleep behavior disorder revealed by explainable machine learning using 3D convolutional neural network

Isolated rapid eye movement sleep behavior disorder (iRBD) is a sleep disorder characterized by dream enactment behavior without any neurological disease and is frequently accompanied by cognitive dysfunction. The purpose of this study was to reveal the spatiotemporal characteristics of abnormal cortical activities underlying cognitive dysfunction in patients with iRBD based on an explainable machine learning approach. A convolutional neural network (CNN) was trained to discriminate the cortical activities of patients with iRBD and normal controls based on three-dimensional input data representing spatiotemporal cortical activities during an attention task. The input nodes critical for classification were determined to reveal the spatiotemporal characteristics of the cortical activities that were most relevant to cognitive impairment in iRBD. The trained classifiers showed high classification accuracy, while the identified critical input nodes were in line with preliminary knowledge of cortical dysfunction associated with iRBD in terms of both spatial location and temporal epoch for relevant cortical information processing for visuospatial attention tasks.

Operator State in a Workplace Simulation Modulates Eye-Blink Related EEG Activity

Evaluating and understanding the cognitive demands of natural activities has been difficult using neurocognitive approaches like mobile EEG. While task-unrelated stimuli are commonly added to a workplace simulation to estimate event-related cognitive processes, using eyeblink activity poses an alternative as it is inherent to human behavior. This study aimed to investigate the eye blink event-related EEG activity of fourteen subjects while working in a power-plant operator simulation - actively operating (active condition) or observing (passive condition) a real-world steam engine. The changes in event-related potentials, event-related spectral perturbations, and functional connectivity under both conditions were analyzed. Our results indicated several cognitive changes in relation to task manipulation. Posterior N1 and P3 amplitudes revealed alterations associated with task complexity, with increased N1 and P3 amplitudes for the active condition, indicating greater cognitive effort than the passive condition. Increased frontal theta power and suppressed parietal alpha power were observed during the active condition reflecting high cognitive engagement. Additionally, higher theta connectivity was seen in fronto-parieto-centro-temporo-occipital regions as task demands increased, showing increased communication between brain regions. All of these results suggest using eye blink-related EEG activity to acquire a comprehensive understanding of neuro-cognitive processing while working in realistic environments.

On the Quantification of Visual Texture Complexity

Complexity is one of the major attributes of the visual perception of texture. However, very little is known about how humans visually interpret texture complexity. A psychophysical experiment was conducted to visually quantify the seven texture attributes of a series of textile fabrics: complexity, color variation, randomness, strongness, regularity, repetitiveness, and homogeneity. It was found that the observers could discriminate between the textures with low and high complexity using some high-level visual cues such as randomness, color variation, strongness, etc. The results of principal component analysis (PCA) on the visual scores of the above attributes suggest that complexity and homogeneity could be essentially the underlying attributes of the same visual texture dimension, with complexity at the negative extreme and homogeneity at the positive extreme of this dimension. We chose to call this dimension visual texture complexity. Several texture measures including the first-order image statistics, co-occurrence matrix, local binary pattern, and Gabor features were computed for images of the textiles in sRGB, and four luminance-chrominance color spaces (i.e., HSV, YC_bC_r, Ohta’s I₁I₂I₃, and CIELAB). The relationships between the visually quantified texture complexity of the textiles and the corresponding texture measures of the images were investigated. Analyzing the relationships showed that simple standard deviation of the image luminance channel had a strong correlation with the corresponding visual ratings of texture complexity in all five color spaces. Standard deviation of the energy of the image after convolving with an appropriate Gabor filter and entropy of the co-occurrence matrix, both computed for the image luminance channel, also showed high correlations with the visual data. In this comparison, sRGB, YC_bC_r, and HSV always outperformed the I₁I₂I₃ and CIELAB color spaces. The highest correlations between the visual data and the corresponding image texture features in the luminance-chrominance color spaces were always obtained for the luminance channel of the images, and one of the two chrominance channels always performed better than the other. This result indicates that the arrangement of the image texture elements that impacts the observer’s perception of visual texture complexity cannot be represented properly by the chrominance channels. This must be carefully considered when choosing an image channel to quantify the visual texture complexity. Additionally, the good performance of the luminance channel in the five studied color spaces proves that variations in the luminance of the texture, or as one could call the luminance contrast, plays a crucial role in creating visual texture complexity.

Visual Demands of Walking Are Reflected in Eye-Blink-Evoked EEG-Activity

Blinking is a natural user-induced response which paces visual information processing. This study investigates whether blinks are viable for segmenting continuous electroencephalography (EEG) activity, for inferring cognitive demands in ecologically valid work environments. We report the blink-related EEG measures of participants who performed auditory tasks either standing, walking on grass, or whilst completing an obstacle course. Blink-related EEG activity discriminated between different levels of cognitive demand during walking. Both behavioral parameters (e.g., blink duration or head motion) and blink-related EEG activity varied with walking conditions. Larger occipital N1 was observed during walking, relative to standing and traversing an obstacle course, which reflects differences in bottom-up visual perception. In contrast, the amplitudes of top-down components (N2, P3) significantly decreased with increasing walking demands, which reflected narrowing attention. This is consistent with blink-related EEG, specifically in Theta and Alpha power that, respectively, increased and decreased with increasing demands of the walking task. This work presents a novel and robust analytical approach to evaluate the cognitive demands experienced in natural work settings, which precludes the use of artificial task manipulations for data segmentation.