Recent developments in a computational theory of visual attention (TVA)

Phasic alerting in visual search tasks

Many tasks require one to search for and find important objects in the visual environment. Visual search is strongly supported by cues indicating target objects to mechanisms of selective attention, which enable one to prioritise targets and ignore distractor objects. Besides selective attention, a major influence on performance across cognitive tasks is phasic alertness, a temporary increase of arousal induced by warning stimuli (alerting cues). Alerting cues provide no specific information on whose basis selective attention could be deployed, but have nevertheless been found to speed up perception and simple actions. It is still unclear, however, how alerting affects visual search. Therefore, in the present study, participants performed a visual search task with and without preceding visual alerting cues. Participants had to report the orientation of a target among several distractors. The target saliency was low in Experiment 1 and high in Experiment 2. In both experiments, we found that visual search was faster when a visual alerting cue was presented before the target display. Performance benefits occurred irrespective of how many distractors had been presented along with the target. Taken together, the findings reveal that visual alerting supports visual search independently of the complexity of the search process and the demands for selective attention.

Higher handgrip strength is linked to higher salience ventral attention functional network segregation in older adults

Converging evidence suggests that handgrip strength is linked to cognition in older adults, and this may be subserved by shared age-related changes in brain function and structure. However, the interplay among handgrip strength, brain functional connectivity, and cognitive function remains poorly elucidated. Hence, our study sought to examine these relationships in 148 community-dwelling older adults. Specifically, we examined functional segregation, a measure of functional brain organization sensitive to ageing and cognitive decline, and its associations with handgrip strength and cognitive function. We showed that higher handgrip strength was related to better processing speed, attention, and global cognition. Further, higher handgrip strength was associated with higher segregation of the salience/ventral attention network, driven particularly by higher salience/ventral attention intra-network functional connectivity of the right anterior insula to the left posterior insula/frontal operculum and right midcingulate/medial parietal cortex. Importantly, these handgrip strength-related inter-individual differences in salience/ventral attention network functional connectivity were linked to cognitive function, as revealed by functional decoding and brain-cognition association analyses. Our findings thus highlight the importance of the salience/ventral attention network in handgrip strength and cognition, and suggest that inter-individual differences in salience/ventral attention network segregation and intra-network connectivity could underpin the handgrip strength-cognition relationship in older adults.

Exploring the carry-over of top-down attentional settings in dynamic conditions

A top-down attentional set can persist from a relevant task to an irrelevant task, influencing allocation of attentional resources, visual search, and performance. While this "carry-over" effect has been found across numerous experiments, past studies have utilised paradigms that present similar tasks to the same spatial location. The present research explored whether attentional settings persist in more dynamic situations. In Experiment 1, participants played a computer game that encouraged a horizontal, vertical, or random spread of search. After 10 or 30 s, they moved 90° to their right and monitored a driving video for hazards. Eye movements to the videos were not affected by the characteristics of the preceding game, revealing no carry-over of attentional settings. One possible explanation for this was the visuospatial shift between the tasks. To explore this further, Experiment 2 adopted a similar paradigm to previous research; participants searched horizontal, vertical, or random letter strings before completing an image search. In one block the tasks were presented to the same screen, and in one block the tasks were presented to different screens (incorporating a 90° visuospatial shift mid-trial). Carry-over was found in the one-screen block, with a significantly wider horizontal search and a narrower vertical search in the pictures after a horizontal letter search. However, there was no carry-over from the letter to the picture task in the two-screen block. This indicates the flexibility of attentional control in dynamic situations, and it is suggested that persistence of attentional settings will be most costly under stable conditions.

A hypoarousal model of neurological post-COVID syndrome: the relation between mental fatigue, the level of central nervous activation and cognitive processing speed

BACKGROUND

Knowledge on the nature of post-COVID neurological sequelae often manifesting as cognitive dysfunction and fatigue is still unsatisfactory.

OBJECTIVES

We assumed that cognitive dysfunction and fatigue in post-COVID syndrome are critically linked via hypoarousal of the brain. Thus, we assessed whether tonic alertness as a neurocognitive index of arousal is reduced in these patients and how this relates to the level of central nervous activation and subjective mental fatigue as further indices of arousal.

METHODS

40 post-COVID patients with subjective cognitive dysfunction and 40 matched healthy controls underwent a whole-report paradigm of briefly presented letter arrays. Based on report performance and computational modelling according to the theory of visual attention, the parameter visual processing speed (VPS) was quantified as a proxy of tonic alertness. Pupillary unrest was assessed as a measure of central nervous activation. The Fatigue Assessment Scale was applied to assess subjective mental fatigue using the corresponding subscale.

RESULTS

VPS was reduced in post-COVID patients compared to controls (p = 0.005). In these patients, pupillary unrest (p = 0.029) and mental fatigue (p = 0.001) predicted VPS, explaining 34% of the variance and yielding a large effect with f2 = 0.51.

CONCLUSION

In post-COVID patients with subjective cognitive dysfunction, hypoarousal of the brain is reflected in decreased processing speed which is explained by a reduced level of central nervous activation and a higher level of mental fatigue. In turn, reduced processing speed objectifies mental fatigue as a core subjective clinical complaint in post-COVID patients.

Warning signals only support the first action in a sequence

Acting upon target stimuli from the environment becomes faster when the targets are preceded by a warning (alerting) cue. Accordingly, alerting is often used to support action in safety-critical contexts (e.g., honking to alert others of a traffic situation). Crucially, however, the benefits of alerting for action have been established using laboratory tasks assessing only simple choice reactions. Real-world actions are considerably more complex and mainly consist of sensorimotor sequences of several sub-actions. Therefore, it is still unknown if the benefits of alerting for action transfer from simple choice reactions to such sensorimotor sequences. Here, we investigated how alerting affected performance in a sequential action task derived from the Trail-Making-Test, a well-established neuropsychological test of cognitive action control (Experiment 1). In addition to this task, participants performed a classic alerting paradigm including a simple choice reaction task (Experiment 2). Results showed that alerting sped up responding in both tasks, but in the sequential action task, this benefit was restricted to the first action of a sequence. This was the case, even when multiple actions were performed within a short time (Experiment 3), ruling out that the restriction of alerting to the first action was due to its short-lived nature. Taken together, these findings reveal the existence of an interface between phasic alertness and action control that supports the next action.

Emotional Attention: From Eye Tracking to Computational Modeling

Attending selectively to emotion-eliciting stimuli is intrinsic to human vision. In this research, we investigate how emotion-elicitation features of images relate to human selective attention. We create the EMOtional attention dataset (EMOd). It is a set of diverse emotion-eliciting images, each with (1) eye-tracking data from 16 subjects, (2) image context labels at both object- and scene-level. Based on analyses of human perceptions of EMOd, we report an emotion prioritization effect: emotion-eliciting content draws stronger and earlier human attention than neutral content, but this advantage diminishes dramatically after initial fixation. We find that human attention is more focused on awe eliciting and aesthetic vehicle and animal scenes in EMOd. Aiming to model the above human attention behavior computationally, we design a deep neural network (CASNet II), which includes a channel weighting subnetwork that prioritizes emotion-eliciting objects, and an Atrous Spatial Pyramid Pooling (ASPP) structure that learns the relative importance of image regions at multiple scales. Visualizations and quantitative analyses demonstrate the model's ability to simulate human attention behavior, especially on emotion-eliciting content.

Lower visual processing speed relates to greater subjective cognitive complaints in community-dwelling healthy older adults

Introduction

Subjective cognitive complaints in older age may reflect subtle objective impairments in basic cognitive functions that might foreshadow broader cognitive problems. Such cognitive functions, however, are not captured by standard neuropsychological testing. Visual processing speed is a basic visual attention function that underlies the performance of cognitive tasks relying on visual stimuli. Here, we test the hypothesis that lower visual processing speed correlates with greater subjective cognitive complaints in healthy older adults from the community.

Methods

To do so, we assessed a sample of 30 healthy, cognitively normal older adults (73.07 ± 7.73 years old; range: 60-82; 15 females) with respect to individual subjective cognitive complaints and visual processing speed. We quantified the degree of subjective cognitive complaints with two widely-used questionnaires: the Memory Functioning Questionnaire and the Everyday Cognition. We used verbal report tasks and the theory of visual attention to estimate a visual processing speed parameter independently from motor speed and other visual attention parameters, i.e., visual threshold, visual short-term memory storage capacity, top-down control, and spatial weighting.

Results

We found that lower visual processing speed correlated with greater subjective complaints and that this relationship was not explained by age, education, or depressive symptoms. The association with subjective cognitive complaints was specific to visual processing speed, as it was not observed for other visual attention parameters.

Discussion

These results indicate that subjective cognitive complaints reflect a reduction in visual processing speed in healthy older adults. Together, our results suggest that the combined assessment of subjective cognitive complaints and visual processing speed has the potential to identify individuals at risk for cognitive impairment before the standard tests show any abnormal results.

Theory of visual attention (TVA) applied to rats performing the 5-choice serial reaction time task: differential effects of dopaminergic and noradrenergic manipulations

RATIONALE

Attention is compromised in many psychiatric disorders, including attention-deficit/hyperactivity disorder (ADHD). While dopamine and noradrenaline systems have been implicated in ADHD, their exact role in attentional processing is yet unknown.

OBJECTIVES

We applied the theory of visual attention (TVA) model, adapted from human research, to the rat 5-choice serial reaction time task (5CSRTT) to investigate catecholaminergic modulation of visual attentional processing in healthy subjects of high- and low-attention phenotypes.

METHODS

Rats trained on the standard 5CSRTT and tested with variable stimulus durations were treated systemically with noradrenergic and/or dopaminergic agents (atomoxetine, methylphenidate, amphetamine, phenylephrine and atipamezole). TVA modelling was applied to estimate visual processing speed for correct and incorrect visual perceptual categorisations, independent of motor reaction times, as measures of attentional capacity.

RESULTS

Atomoxetine and phenylephrine decreased response frequencies, including premature responses, increased omissions and slowed responding. In contrast, methylphenidate, amphetamine and atipamezole sped up responding and increased premature responses. Visual processing speed was also affected differentially. Atomoxetine and phenylephrine slowed, whereas methylphenidate and atipamezole sped up, visual processing, both for correct and incorrect categorisations. Amphetamine selectively improved visual processing for correct, though not incorrect, responses in high-attention rats only, possibly reflecting improved attention.

CONCLUSIONS

These data indicate that the application of TVA to the 5CSRTT provides an enhanced sensitivity to capturing attentional effects. Unexpectedly, we found overall slowing effects, including impaired visual processing, following drugs either increasing extracellular noradrenaline (atomoxetine) or activating the α1-adrenoceptor (phenylephrine), while also ameliorating premature responses (impulsivity). In contrast, amphetamine had potential pro-attentional effects by enhancing visual processing, probably due to central dopamine upregulation.

Motion processing impaired by transient spatial attention: Potential implications for the magnocellular pathway

Spatial cues presented prior to the presentation of a static stimulus usually improve its perception. However, previous research has also shown that transient exogenous cues to direct spatial attention to the location of a forthcoming stimulus can lead to reduced performance. In the present study, we investigated the effects of transient exogenous cues on the perception of briefly presented drifting Gabor patches. The spatial and temporal frequencies of the drifting Gabors were chosen to mainly engage the magnocellular pathway. We found better performance in the motion direction discrimination task when neutral cues were presented before the drifting target compared to a valid spatial cue. The behavioral results support the hypothesis that transient attention prolongs the internal response to the attended stimulus, thus reducing the temporal segregation of visual events. These results were complemented by applying a recently developed model for perceptual decisions to rule out a speed-accuracy trade-off and to further assess cueing effects on visual performance. In a model-based assessment, we found that valid cues initially enhanced processing but overall resulted in less efficient processing compared to neutral cues, possibly caused by reduced temporal segregation of visual events.

Involvement of the dorsal and ventral attention networks in visual attention span

Visual attention span (VAS), which refers to the window size of multielement parallel processing in a short time, plays an important role in higher‐level cognition (e.g., reading) as required by encoding large amounts of information input. However, it is still a matter of debate about the underlying neural mechanism of VAS. In the present study, a modified visual 1‐back task was designed by using nonverbal stimuli and nonverbal responses, in which possible influences of target presence and position were considered to identify more pure VAS processing. A task‐driven functional magnetic resonance imaging (fMRI) experiment was then performed, and 30 healthy adults participated in this study. Results of confirmatory and exploratory analyses consistently revealed that both dorsal attention network (DAN) and ventral attention network (VAN) were significantly activated during this visual simultaneous processing. In particular, more significant activation in the left superior parietal lobule (LSPL), as compared to that in the bilateral inferior frontal gyrus (IFGs), suggested a greater involvement of DAN in VAS‐related processing in contrast to VAN. In addition, it was also found that the activation in temporoparietal junctions (TPJs) were suppressed during multielement processing only in the target‐absent condition. The current results suggested the recruitment of LSPL in covert attentional shifts and top‐down control of VAS resources distribution during the rapid visual simultaneous processing, as well as the involvement of bilateral IFGs (especially RIFG) in both VAS processing and inhibitory control. The present findings might bring some enlightenments for diagnosis of the atypicality of attentional disorders and reading difficulties.

A dynamic normalization model of temporal attention

Vision is dynamic, handling a continuously changing stream of input, yet most models of visual attention are static. Here, we develop a dynamic normalization model of visual temporal attention and constrain it with new psychophysical human data. We manipulated temporal attention-the prioritization of visual information at specific points in time-to a sequence of two stimuli separated by a variable time interval. Voluntary temporal attention improved perceptual sensitivity only over a specific interval range. To explain these data, we modelled voluntary and involuntary attentional gain dynamics. Voluntary gain enhancement took the form of a limited resource over short time intervals, which recovered over time. Taken together, our theoretical and experimental results formalize and generalize the idea of limited attentional resources across space at a single moment to limited resources across time at a single location.

The role of visual-spatial attention in reading development: a meta-analysis

The association between visual attention and reading development has been investigated as a possible core causal deficit in dyslexia, in addition to phonological awareness. This study aims to provide a meta-analytic review of the research on attentional processes and their relation to reading development, to examine the possible influence on it of orthographic depth, age, and attentional tasks (interpreted as serial or parallel processing indices). We included studies with participants up to 18 years of age that have considered the visual spatial attention orienting that sustains the serial visual analysis involved in the phonological pathway of decoding, and the visual attention span that supports the multielement parallel processing that is thought to influence lexical decoding. The results confirm a strong association between visual attention and reading development; we evaluate the evidence and discuss the possibility that visual attention processes play a causal role in determining individual differences in reading acquisition.

In vivo biomarkers of structural and functional brain development and aging in humans

Brain aging is a major determinant of aging. Along with the aging population, prevalence of neurodegenerative diseases is increasing, therewith placing economic and social burden on individuals and society. Individual rates of brain aging are shaped by genetics, epigenetics, and prenatal environmental. Biomarkers of biological brain aging are needed to predict individual trajectories of aging and the risk for age-associated neurological impairments for developing early preventive and interventional measures. We review current advances of in vivo biomarkers predicting individual brain age. Telomere length and epigenetic clock, two important biomarkers that are closely related to the mechanistic aging process, have only poor deterministic and predictive accuracy regarding individual brain aging due to their high intra- and interindividual variability. Phenotype-related biomarkers of global cognitive function and brain structure provide a much closer correlation to age at the individual level. During fetal and perinatal life, autonomic activity is a unique functional marker of brain development. The cognitive and structural biomarkers also boast high diagnostic specificity for determining individual risks for neurodegenerative diseases.

TVA in the wild: Applying the theory of visual attention to game-like and less controlled experiments

As a formal theory, Bundesen’s theory of visual attention (TVA) enables the estimation of several theoretically meaningful parameters involved in attentional selection and visual encoding. As of yet, TVA has almost exclusively been used in restricted empirical scenarios such as whole and partial report and with strictly controlled stimulus material. We present a series of experiments in which we test whether the advantages of TVA can be exploited in more realistic scenarios with varying degree of stimulus control. This includes brief experimental sessions conducted on different mobile devices, computer games, and a driving simulator. Overall, six experiments demonstrate that the TVA parameters for processing capacity and attentional weight can be measured with sufficient precision in less controlled scenarios and that the results do not deviate strongly from typical laboratory results, although some systematic differences were found.

The time course of salience: not entirely caused by salience

Visual salience is a key component of attentional selection, the process that guards the scarce resources needed for conscious recognition and perception. In previous works, we proposed a measure of visual salience based on a formal theory of visual selection. However, the strength of visual salience depends on the time course as well as local physical contrasts. Evidence from multiple experimental designs in the literature suggests that the strength of salience rises initially and declines after approximately 150 ms. The present article amends the theory-based salience measure beyond local physical contrasts to the time course of salience. It does so through a first experiment which reveals that—contrary to expectations—salience is not reduced during the first 150 ms after onset. Instead, the overall visual processing capacity is severely reduced, which corresponds to a reduced processing speed of all stimuli in the visual field. A second experiment confirms this conclusion by replicating the result. We argue that the slower stimulus processing may have been overlooked previously because the attentional selection mechanism had not yet been modeled in studies on the time course of salience.

Faster Visual Information Processing in Video Gamers Is Associated With EEG Alpha Amplitude Modulation

Video gaming, specifically action video gaming, seems to improve a range of cognitive functions. The basis for these improvements may be attentional control in conjunction with reward-related learning to amplify the execution of goal-relevant actions while suppressing goal-irrelevant actions. Given that EEG alpha power reflects inhibitory processing, a core component of attentional control, it might represent the electrophysiological substrate of cognitive improvement in video gaming. The aim of this study was to test whether non-video gamers (NVGs), non-action video gamers (NAVGs) and action video gamers (AVGs) exhibit differences in EEG alpha power, and whether this might account for differences in visual information processing as operationalized by the theory of visual attention (TVA). Forty male volunteers performed a visual short-term memory paradigm where they memorized shape stimuli depicted on circular stimulus displays at six different exposure durations while their EEGs were recorded. Accuracy data was analyzed using TVA-algorithms. There was a positive correlation between the extent of post-stimulus EEG alpha power attenuation (10–12 Hz) and speed of information processing across all participants. Moreover, both EEG alpha power attenuation and speed of information processing were modulated by an interaction between group affiliation and time on task, indicating that video gamers showed larger EEG alpha power attenuations and faster information processing over time than NVGs – with AVGs displaying the largest increase. An additional regression analysis affirmed this observation. From this we concluded that EEG alpha power might be a promising neural substrate for explaining cognitive improvement in video gaming.

Attention as a Unitary Concept

In this paper, I discuss attention in terms of selecting visual information and acting on it. Selection has been taken as a bedrock concept in attention research since James (1890). Selective attention guides action by privileging some things at the expense of others. I formalize this notion with models which capture the relationship between input and output under the control of spatial and temporal attention, by attenuating or discarding certain inputs and by weighing energetic costs, speed, and accuracy in meeting pre-chosen goals. Examples are given from everyday visually guided actions, and from modeling data obtained from visual searches through temporal and spatial arrays and related research. The relation between selection, as defined here, and other forms of attention is discussed at the end.

Digital and Technical Developments in the Amblyopia Therapy

The digital media becomes more and more common in our everyday lives. So it is not surprising that technical progress is also leaving its mark on amblyopia therapy. New media and technologies can be used both in the actual amblyopia therapy or therapy monitoring. In particular in this review shutter glasses, therapy monitoring and analysis using microsensors and newer video programs for amblyopia therapy are presented and critically discussed. Currently, these cannot yet replace classic amblyopia therapy. They represent interesting options that will occupy us even more in the future.

Prioritization in visual working memory enhances memory retention and speeds up processing in a comparison task

Visual working memory retains visual information for controlling behavior. We studied how information in visual working memory is prioritized for being used. In two experiments, participants memorized the stimuli of a memory display for a brief interval, followed by a retro-cue. The retro-cue was either valid, indicating which stimulus from the memory display was relevant (i.e., had priority) in the upcoming comparison with a probe, or was neutral (uninformative). Next, the probe was presented, terminated by a mask, and participants reported whether it matched a stimulus from the memory display. The presentation duration of the probe was varied. Assessing performance as a function of presentation duration allowed to disentangle two components of working memory: memory retention and the speed of processing the probe for the memory-based comparison. Compared with neutral retro-cues, valid retro-cues improved retention and at the same time accelerated processing of the probe. These findings show for the first time that prioritization in working memory impacts on distinct mechanisms: retrospectively, it supports memory retention, and prospectively, it enhances perceptual processing in upcoming comparison tasks.

The effects of video gaming on visual selective attention

A growing body of research shows that video games may be used to enhance cognitive skills, with particular reference to attentional abilities. This research study explored the effects of video game playing on visual selective attention in a young adult sample. A secondary research objective explored the possibility that gender acted as a moderating variable with regard to their visual selective attention. This was achieved by means of a quantitative research design, which consisted of a survey research and a quasi-experimental research design. Participants were sampled using purposive sampling ( n = 80), and to test the effects of video game playing and gender on visual selective attention, participants were exposed to a computerised version of the Stroop task. Data were analysed using a two-way between-group analysis of variance (ANOVA) and results indicated a statistically significant difference in visual selective attention abilities between video game players and the non-players. Video gamers thus exhibited more advanced attentional skills than non-players. There were no interaction effects between video game playing and gender, and gender did not have a statistically significant main effect on participants’ visual selective attention.

Attentional competition across saccadic eye movements

Human behavior is guided by visual object recognition. For being recognized, objects compete for limited attentional processing resources. The more objects compete, the lower is performance in recognizing each individual object. Here, we ask whether this competition is confined to eye fixations, periods of relatively stable gaze, or whether it extends from one fixation to the next, across saccadic eye movements. Participants made saccades to a peripheral saccade target. After the saccade, a letter was briefly presented within the saccade target and terminated by a mask. Object recognition of the letter was assessed as participants' report. Critically, either no, two, or four additional non-target objects appeared before the saccade. In Experiment 1, presaccadic non-targets were task-irrelevant and had no effects on postsaccadic object recognition. In Experiment 2, presaccadic non-targets were task-relevant and, here, postsaccadic object recognition deteriorated with increasing number of presaccadic non-targets. As suggested by Experiment 3 and a mathematical model, this effect was due to a slowing down but also a delayed start of visual processing after the saccade. Together, our findings show that objects compete for recognition across saccades, but only if they are task-relevant. This reveals an attentional mechanism of task-driven object recognition that is interlaced with active saccade-mediated vision.

Decreased cingulo-opercular network functional connectivity mediates the impact of aging on visual processing speed

The neural factors that account for the visual processing speed reduction in aging are incompletely understood. Based on previous reports of age-related decreases in the intrinsic functional connectivity (iFC) within the cingulo-opercular network and its relevance for processing speed, we hypothesized that these decreases are associated with age-related reductions in visual processing speed. We used a whole-report task and modeling based on Bundesen's "theory of visual attention" to parameterize visual processing speed in 91 healthy participants aged from 20 to 77 years. iFC was estimated using independent component analysis of resting-state functional magnetic resonance imaging data. From the clusters within the cingulo-opercular network exhibiting age-related decreased iFC, we found a cluster in the left insula to be particularly associated with visual processing speed and to mediate the age effect on visual speed. This mediation was not observed for age-related decreased iFC in other networks or for other attentional parameters. Our results point to the iFC in the cingulo-opercular network, represented by the left insula, as being a relevant marker for visual processing speed changes in aging.

Dual Task Effects on Visual Attention Capacity in Normal Aging

Older adults show higher dual task performance decrements than younger adults. While this is assumed to be related to attentional capacity reductions, the precise affected functions are not specified. Such specification is, however, possible based on the "theory of visual attention" (TVA) which allows for modeling of distinct attentional capacity parameters. Furthermore, it is unclear whether older adults show qualitatively different attentional effects or whether they show the same effects as younger adults experience under more challenging conditions. By varying the complexity of the secondary task, it is possible to address this question. In our study, participants performed a verbal whole report of briefly presented letter arrays. TVA-based fitting of report performance delivered parameters of visual threshold t0, processing speed C, and visual short-term memory (VSTM) storage capacity K. Furthermore, participants performed a concurrent motor task consisting of continuous tapping of a (simple or complex) sequence. Both TVA and tapping tasks were performed under single and dual task conditions. Two groups of 30 younger adults each performed either the simple or complex tapping, and a group of 30 older adults performed the simple tapping condition. In older participants, VSTM storage capacity declined under dual task conditions. While no such effect was found in younger subjects performing the simple tapping sequence under dual task conditions, the younger group performing the complex tapping task under dual task conditions also showed a significant VSTM capacity reduction. Generally, no significant effect on other TVA parameters or on tapping accuracy was found. Comparable goodness-of-fit measures were obtained for the TVA modeling data in single and dual tasks, indicating that tasks were executed in a qualitatively similar, continuous manner, although quantitatively less efficiently under dual- compared to single-task conditions. Taken together, our results show that the age-specific effects of motor-cognitive dual task interference are reflected by a stronger decline of VSTM storage capacity. They support an interpretation of VSTM as central attentional capacity, which is shared across visual uptake and concurrent motor performance. Capacity limits are reached earlier, and already under lower motor task complexity, in older compared to younger adults.

Distinctive Correspondence Between Separable Visual Attention Functions and Intrinsic Brain Networks

Separable visual attention functions are assumed to rely on distinct but interacting neural mechanisms. Bundesen's “theory of visual attention” (TVA) allows the mathematical estimation of independent parameters that characterize individuals' visual attentional capacity (i.e., visual processing speed and visual short-term memory storage capacity) and selectivity functions (i.e., top-down control and spatial laterality). However, it is unclear whether these parameters distinctively map onto different brain networks obtained from intrinsic functional connectivity, which organizes slowly fluctuating ongoing brain activity. In our study, 31 demographically homogeneous healthy young participants performed whole- and partial-report tasks and underwent resting-state functional magnetic resonance imaging (rs-fMRI). Report accuracy was modeled using TVA to estimate, individually, the four TVA parameters. Networks encompassing cortical areas relevant for visual attention were derived from independent component analysis of rs-fMRI data: visual, executive control, right and left frontoparietal, and ventral and dorsal attention networks. Two TVA parameters were mapped on particular functional networks. First, participants with higher (vs. lower) visual processing speed showed lower functional connectivity within the ventral attention network. Second, participants with more (vs. less) efficient top-down control showed higher functional connectivity within the dorsal attention network and lower functional connectivity within the visual network. Additionally, higher performance was associated with higher functional connectivity between networks: specifically, between the ventral attention and right frontoparietal networks for visual processing speed, and between the visual and executive control networks for top-down control. The higher inter-network functional connectivity was related to lower intra-network connectivity. These results demonstrate that separable visual attention parameters that are assumed to constitute relatively stable traits correspond distinctly to the functional connectivity both within and between particular functional networks. This implies that individual differences in basic attention functions are represented by differences in the coherence of slowly fluctuating brain activity.

Motor-cognitive dual-task performance: effects of a concurrent motor task on distinct components of visual processing capacity

Dual tasking, or the simultaneous execution of two continuous tasks, is frequently associated with a performance decline that can be explained within a capacity sharing framework. In this study, we assessed the effects of a concurrent motor task on the efficiency of visual information uptake based on the 'theory of visual attention' (TVA). TVA provides parameter estimates reflecting distinct components of visual processing capacity: perceptual threshold, visual processing speed, and visual short-term memory (VSTM) storage capacity. Moreover, goodness-of-fit values and bootstrapping estimates were derived to test whether the TVA-model is validly applicable also under dual task conditions, and whether the robustness of parameter estimates is comparable in single- and dual-task conditions. 24 subjects of middle to higher age performed a continuous tapping task, and a visual processing task (whole report of briefly presented letter arrays) under both single- and dual-task conditions. Results suggest a decline of both visual processing capacity and VSTM storage capacity under dual-task conditions, while the perceptual threshold remained unaffected by a concurrent motor task. In addition, goodness-of-fit values and bootstrapping estimates support the notion that participants processed the visual task in a qualitatively comparable, although quantitatively less efficient way under dual-task conditions. The results support a capacity sharing account of motor-cognitive dual tasking and suggest that even performing a relatively simple motor task relies on central attentional capacity that is necessary for efficient visual information uptake.

Audio-visual synchrony and spatial attention enhance processing of dynamic visual stimulation independently and in parallel: A frequency-tagging study

The neural processing of a visual stimulus can be facilitated by attending to its position or by a co-occurring auditory tone. Using frequency-tagging, we investigated whether facilitation by spatial attention and audio-visual synchrony rely on similar neural processes. Participants attended to one of two flickering Gabor patches (14.17 and 17 Hz) located in opposite lower visual fields. Gabor patches further "pulsed" (i.e. showed smooth spatial frequency variations) at distinct rates (3.14 and 3.63 Hz). Frequency-modulating an auditory stimulus at the pulse-rate of one of the visual stimuli established audio-visual synchrony. Flicker and pulsed stimulation elicited stimulus-locked rhythmic electrophysiological brain responses that allowed tracking the neural processing of simultaneously presented Gabor patches. These steady-state responses (SSRs) were quantified in the spectral domain to examine visual stimulus processing under conditions of synchronous vs. asynchronous tone presentation and when respective stimulus positions were attended vs. unattended. Strikingly, unique patterns of effects on pulse- and flicker driven SSRs indicated that spatial attention and audiovisual synchrony facilitated early visual processing in parallel and via different cortical processes. We found attention effects to resemble the classical top-down gain effect facilitating both, flicker and pulse-driven SSRs. Audio-visual synchrony, in turn, only amplified synchrony-producing stimulus aspects (i.e. pulse-driven SSRs) possibly highlighting the role of temporally co-occurring sights and sounds in bottom-up multisensory integration.

Collective Activity of Many Bistable Assemblies Reproduces Characteristic Dynamics of Multistable Perception

The timing of perceptual decisions depends on both deterministic and stochastic factors, as the gradual accumulation of sensory evidence (deterministic) is contaminated by sensory and/or internal noise (stochastic). When human observers view multistable visual displays, successive episodes of stochastic accumulation culminate in repeated reversals of visual appearance. Treating reversal timing as a "first-passage time" problem, we ask how the observed timing densities constrain the underlying stochastic accumulation. Importantly, mean reversal times (i.e., deterministic factors) differ enormously between displays/observers/stimulation levels, whereas the variance and skewness of reversal times (i.e., stochastic factors) keep characteristic proportions of the mean. What sort of stochastic process could reproduce this highly consistent "scaling property?" Here we show that the collective activity of a finite population of bistable units (i.e., a generalized Ehrenfest process) quantitatively reproduces all aspects of the scaling property of multistable phenomena, in contrast to other processes under consideration (Poisson, Wiener, or Ornstein-Uhlenbeck process). The postulated units express the spontaneous dynamics of attractor assemblies transitioning between distinct activity states. Plausible candidates are cortical columns, or clusters of columns, as they are preferentially connected and spontaneously explore a restricted repertoire of activity states. Our findings suggests that perceptual representations are granular, probabilistic, and operate far from equilibrium, thereby offering a suitable substrate for statistical inference.

SIGNIFICANCE STATEMENT

Spontaneous reversals of high-level perception, so-called multistable perception, conform to highly consistent and characteristic statistics, constraining plausible neural representations. We show that the observed perceptual dynamics would be reproduced quantitatively by a finite population of distinct neural assemblies, each with locally bistable activity, operating far from the collective equilibrium (generalized Ehrenfest process). Such a representation would be consistent with the intrinsic stochastic dynamics of neocortical activity, which is dominated by preferentially connected assemblies, such as cortical columns or clusters of columns. We predict that local neuron assemblies will express bistable dynamics, with spontaneous active-inactive transitions, whenever they contribute to high-level perception.

Effects of nicotine on response inhibition and interference control

Nicotine is a cholinergic agonist with known pro-cognitive effects in the domains of alerting and orienting attention. However, its effects on attentional top-down functions such as response inhibition and interference control are less well characterised. Here, we investigated the effects of 7 mg transdermal nicotine on performance on a battery of response inhibition and interference control tasks. A sample of N = 44 healthy adult non-smokers performed antisaccade, stop signal, Stroop, go/no-go, flanker, shape matching and Simon tasks, as well as the attentional network test (ANT) and a continuous performance task (CPT). Nicotine was administered in a within-subjects, double-blind, placebo-controlled design, with order of drug administration counterbalanced. Relative to placebo, nicotine led to significantly shorter reaction times on a prosaccade task and on CPT hits but did not significantly improve inhibitory or interference control performance on any task. Instead, nicotine had a negative influence in increasing the interference effect on the Simon task. Nicotine did not alter inter-individual associations between reaction times on congruent trials and error rates on incongruent trials on any task. Finally, there were effects involving order of drug administration, suggesting practice effects but also beneficial nicotine effects when the compound was administered first. Overall, our findings support previous studies showing positive effects of nicotine on basic attentional functions but do not provide direct evidence for an improvement of top-down cognitive control through acute administration of nicotine at this dose in healthy non-smokers.

Peripheral Visual Cues: Their Fate in Processing and Effects on Attention and Temporal-Order Perception

Peripheral visual cues lead to large shifts in psychometric distributions of temporal-order judgments. In one view, such shifts are attributed to attention speeding up processing of the cued stimulus, so-called prior entry. However, sometimes these shifts are so large that it is unlikely that they are caused by attention alone. Here we tested the prevalent alternative explanation that the cue is sometimes confused with the target on a perceptual level, bolstering the shift of the psychometric function. We applied a novel model of cued temporal-order judgments, derived from Bundesen's Theory of Visual Attention. We found that cue-target confusions indeed contribute to shifting psychometric functions. However, cue-induced changes in the processing rates of the target stimuli play an important role, too. At smaller cueing intervals, the cue increased the processing speed of the target. At larger intervals, inhibition of return was predominant. Earlier studies of cued TOJs were insensitive to these effects because in psychometric distributions they are concealed by the conjoint effects of cue-target confusions and processing rate changes.

Fast and Conspicuous? Quantifying Salience With the Theory of Visual Attention

Particular differences between an object and its surrounding cause salience, guide attention, and improve performance in various tasks. While much research has been dedicated to identifying which feature dimensions contribute to salience, much less regard has been paid to the quantitative strength of the salience caused by feature differences. Only a few studies systematically related salience effects to a common salience measure, and they are partly outdated in the light of new findings on the time course of salience effects. We propose Bundesen’s Theory of Visual Attention (TVA) as a theoretical basis for measuring salience and introduce an empirical and modeling approach to link this theory to data retrieved from temporal-order judgments. With this procedure, TVA becomes applicable to a broad range of salience-related stimulus material. Three experiments with orientation pop-out displays demonstrate the feasibility of the method. A 4th experiment substantiates its applicability to the luminance dimension.