A computational theory of visual attention

Visual stimulation by extensive visual media consumption can be beneficial for motor learning

In this randomized controlled intervention trial, we investigated whether intense visual stimulation through television watching can enhance visual information processing and motor learning performance. 74 healthy young adults were trained in a motor skill with visual information processing demands while being accommodated in a controlled environment for five days. The experimental manipulation (n = 37) consisted of prolonged television watching (i.e., 8 h/day, + 62.5% on average) to induce intense exposure to visual stimulation. The control group (n = 37) did not consume visual media. The groups were compared by motor learning performance throughout the study as well as pre/post visual attention parameters and resting-state network connectivity in functional MRI. We found that the intervention group performed significantly better in the motor learning task (+ 8.21% (95%-CI[12.04, 4.31], t(70) = 4.23, p < 0.001) while showing an increased capacity of visual short-term memory (+ 0.254, t(58) = - 3.19, p = 0.002) and increased connectivity between visual and motor-learning associated resting-state networks. Our findings suggest that the human brain might enter a state of accentuated visuomotor integration to support the implementation of motor learning with visual information processing demands if challenged by ample input of visual stimulation. Further investigation is needed to evaluate the persistence of this effect regarding participants exposed to accustomed amounts of visual media consumption.Clinical Trials Registration: This trial was registered in the German Clinical Trials Register/Deutsches Register klinischer Studien (DRKS): DRKS00019955.

Time Courses of Attended and Ignored Object Representations

Selective attention prioritizes information that is relevant to behavioral goals. Previous studies have shown that attended visual information is processed and represented more efficiently, but distracting visual information is not fully suppressed, and may also continue to be represented in the brain. In natural vision, to-be-attended and to-be-ignored objects may be present simultaneously in the scene. Understanding precisely how each is represented in the visual system, and how these neural representations evolve over time, remains a key goal in cognitive neuroscience. In this study, we recorded EEG while participants performed a cued object-based attention task that involved attending to target objects and ignoring simultaneously presented and spatially overlapping distractor objects. We performed support vector machine classification on the stimulus-evoked EEG data to separately track the temporal dynamics of target and distractor representations. We found that (1) both target and distractor objects were decodable during the early phase of object processing (∼100 msec to ∼200 msec after target onset), and (2) the representations of both objects were sustained over time, remaining decodable above chance until ∼1000-msec latency. However, (3) the distractor object information faded significantly beginning after about 300-msec latency. These findings provide information about the fate of attended and ignored visual information in complex scene perception.

Theory of visual attention (TVA) applied to rats performing the 5-choice serial reaction time task: differential effects of dopaminergic and noradrenergic manipulations

RATIONALE

Attention is compromised in many psychiatric disorders, including attention-deficit/hyperactivity disorder (ADHD). While dopamine and noradrenaline systems have been implicated in ADHD, their exact role in attentional processing is yet unknown.

OBJECTIVES

We applied the theory of visual attention (TVA) model, adapted from human research, to the rat 5-choice serial reaction time task (5CSRTT) to investigate catecholaminergic modulation of visual attentional processing in healthy subjects of high- and low-attention phenotypes.

METHODS

Rats trained on the standard 5CSRTT and tested with variable stimulus durations were treated systemically with noradrenergic and/or dopaminergic agents (atomoxetine, methylphenidate, amphetamine, phenylephrine and atipamezole). TVA modelling was applied to estimate visual processing speed for correct and incorrect visual perceptual categorisations, independent of motor reaction times, as measures of attentional capacity.

RESULTS

Atomoxetine and phenylephrine decreased response frequencies, including premature responses, increased omissions and slowed responding. In contrast, methylphenidate, amphetamine and atipamezole sped up responding and increased premature responses. Visual processing speed was also affected differentially. Atomoxetine and phenylephrine slowed, whereas methylphenidate and atipamezole sped up, visual processing, both for correct and incorrect categorisations. Amphetamine selectively improved visual processing for correct, though not incorrect, responses in high-attention rats only, possibly reflecting improved attention.

CONCLUSIONS

These data indicate that the application of TVA to the 5CSRTT provides an enhanced sensitivity to capturing attentional effects. Unexpectedly, we found overall slowing effects, including impaired visual processing, following drugs either increasing extracellular noradrenaline (atomoxetine) or activating the α1-adrenoceptor (phenylephrine), while also ameliorating premature responses (impulsivity). In contrast, amphetamine had potential pro-attentional effects by enhancing visual processing, probably due to central dopamine upregulation.

The time course of salience: not entirely caused by salience

Visual salience is a key component of attentional selection, the process that guards the scarce resources needed for conscious recognition and perception. In previous works, we proposed a measure of visual salience based on a formal theory of visual selection. However, the strength of visual salience depends on the time course as well as local physical contrasts. Evidence from multiple experimental designs in the literature suggests that the strength of salience rises initially and declines after approximately 150 ms. The present article amends the theory-based salience measure beyond local physical contrasts to the time course of salience. It does so through a first experiment which reveals that—contrary to expectations—salience is not reduced during the first 150 ms after onset. Instead, the overall visual processing capacity is severely reduced, which corresponds to a reduced processing speed of all stimuli in the visual field. A second experiment confirms this conclusion by replicating the result. We argue that the slower stimulus processing may have been overlooked previously because the attentional selection mechanism had not yet been modeled in studies on the time course of salience.

Temporal organization of color and shape processing during visual search

The mechanisms guiding visual attention are of great interest within cognitive and perceptual psychology. Many researchers have proposed models of these mechanisms, which serve to both formalize their theories and to guide further empirical investigations. The assumption that a number of basic features are processed in parallel early in the attentional process is common among most models of visual attention and visual search. To date, much of the evidence for parallel processing has been limited to set-size manipulations. Unfortunately, set-size manipulations have been shown to be insufficient evidence for parallel processing. We applied Systems Factorial Technology, a general nonparametric framework, to test this assumption, specifically whether color and shape are processed in parallel or in serial, in three experiments representative of feature search, conjunctive search, and odd-one-out search, respectively. Our results provide strong evidence that color and shape information guides search through parallel processes. Furthermore, we found evidence for facilitation between color and shape when the target was known in advance but performance consistent with unlimited capacity, independent parallel processing in odd-one-out search. These results confirm core assumptions about color and shape feature processing instantiated in most models of visual search and provide more detailed clues about the manner in which color and shape information is combined to guide search.

Attentional selection is biased towards controllable stimuli

While the factors that contribute to individuals feeling a sense agency over a stimulus have been extensively studied, the cognitive effects of a sense of agency over a stimulus are little known. Here, we conducted three experiments examining whether attentional selection is biased towards controllable stimuli. In all three experiments, participants moved four circle stimuli, one of which was under their control. A search target then appeared on one of the stimuli. In Experiment 1, the target was always on the controlled stimulus, but we manipulated the degree of control the participant had. In Experiment 2, the controlled stimulus was the target on 50% of the trials. In Experiment 3, we used a central arrow cue to tell participants which arrow key to press (rather than using a free choice task) and made the controlled stimulus the target on 25% of the trials, making it nonpredictive of the target's location. Across the three experiments we found that visual selection was biased towards controllable stimuli. This attentional bias was larger when participants had full, rather than partial, control over the stimulus, indicating that sense of agency leads one to prioritize objects under their control. The fact that agency influenced attention when the controlled object contained the target in 100%, 50%, and 25% of trials, and occurred even when participants needed to monitor the center of the display in order to know which arrow key to press, suggests that its influence does not depend on task relevance or volitional decision-making.

Developing a Visual Attention Assessment for Children at School Entry

Whereas young children’s visual attention has been explored in a number of previous studies, so far it has not been investigated by an assessment based on Bundesen’s Theory of Visual Attention (TVA). TVA is a prominent visual attention model that has been widely used as foundation in studies targeting older children, adolescents or adults. In this paper we explore the utility of adopting TVA to explore the visual attention of 4- to 5- year olds and present the development of a simplified adapted version of a TVA-based assessment designed for this age group. Key assessment alterations included the substitution of letter stimuli with black and white symbols and the reduction of assessment duration. The suitability of the assessment for the target age group was subsequently tested in two consecutive studies (Study I: N = 43; Study II: N = 24). Study results show that measuring visual attention based on a simplified TVA-based assessment appears feasible in such a young age group, provided that the study design takes into account the capabilities of these young children. The authors argue that by adopting this kind of visual attention assessment the relationship between visual attention development and early learning could be better understood.

Gain control explains the effect of distraction in human perceptual, cognitive, and economic decision making

When making decisions, humans are often distracted by irrelevant information. Distraction has a different impact on perceptual, cognitive, and value-guided choices, giving rise to well-described behavioral phenomena such as the tilt illusion, conflict adaptation, or economic decoy effects. However, a single, unified model that can account for all these phenomena has yet to emerge. Here, we offer one such account, based on adaptive gain control, and additionally show that it successfully predicts a range of counterintuitive new behavioral phenomena on variants of a classic cognitive paradigm, the Eriksen flanker task. We also report that blood oxygen level-dependent signals in a dorsal network prominently including the anterior cingulate cortex index a gain-modulated decision variable predicted by the model. This work unifies the study of distraction across perceptual, cognitive, and economic domains.

The Computational Anatomy of Visual Neglect

Visual neglect is a debilitating neuropsychological phenomenon that has many clinical implications and-in cognitive neuroscience-offers an important lesion deficit model. In this article, we describe a computational model of visual neglect based upon active inference. Our objective is to establish a computational and neurophysiological process theory that can be used to disambiguate among the various causes of this important syndrome; namely, a computational neuropsychology of visual neglect. We introduce a Bayes optimal model based upon Markov decision processes that reproduces the visual searches induced by the line cancellation task (used to characterize visual neglect at the bedside). We then consider 3 distinct ways in which the model could be lesioned to reproduce neuropsychological (visual search) deficits. Crucially, these 3 levels of pathology map nicely onto the neuroanatomy of saccadic eye movements and the systems implicated in visual neglect.

Parieto–Occipital Areas Involved in Efficient Filtering in Search: A Time Course Analysis of Visual Marking using Behavioural and Functional Imaging Procedures

Search for a colour–form conjunction target can be facilitated by presenting one set of distractors prior to the second set of distractors and the target: the preview benefit (Watson & Humphreys, 1997). The early presentation of one set of distractors enables them to be efficiently filtered from search. We report two studies investigating the time course of the preview benefit. In Experiment 1 we use a standard reaction time analysis to show that the benefit has a relatively slow time course; old items need to precede the new set by 600 ms or more in order to be fully filtered from search. Furthermore, the reductions in reaction time across time in the preview condition varied nonlinearly with the display size, suggesting that old items were discounted from search in parallel. In Experiment 2 we examined the neural locus of this filtering effect over time, using positron emission tomography (PET). We show that regions of parieto–occipital cortex are selectively activated in a preview search condition relative to a detection baseline. These regions also increase in activation as the preview interval increases (and search then becomes easier), consistent with them modulating the parallel filtering of distractors from targets in spatial search. Interestingly, the same areas as those activated in preview search were also active in conjunction search relative to its own detection baseline. Thus these regions either modulate parallel filtering in conjunction search too, or they modulate different behavioural functions according to task constraints.

Event-related Electroencephalographic Lateralizations Mark Individual Differences in Spatial and Nonspatial Visual Selection

Selective attention controls the distribution of our visual system's limited processing resources to stimuli in the visual field. Two independent parameters of visual selection can be quantified by modeling an individual's performance in a partial-report task based on the computational theory of visual attention (TVA): (i) top-down control α, the relative attentional weighting of relevant over irrelevant stimuli, and (ii) spatial bias w_λ, the relative attentional weighting of stimuli in the left versus right hemifield. In this study, we found that visual event-related electroencephalographic lateralizations marked interindividual differences in these two functions. First, individuals with better top-down control showed higher amplitudes of the posterior contralateral negativity than individuals with poorer top-down control. Second, differences in spatial bias were reflected in asymmetries in earlier visual event-related lateralizations depending on the hemifield position of targets; specifically, individuals showed a positivity contralateral to targets presented in their prioritized hemifield and a negativity contralateral to targets presented in their nonprioritized hemifield. Thus, our findings demonstrate that two functionally different aspects of attentional weighting quantified in the respective TVA parameters are reflected in two different neurophysiological measures: The observer-dependent spatial bias influences selection by a bottom-up processing advantage of stimuli appearing in the prioritized hemifield. By contrast, task-related target selection governed by top-down control involves active enhancement of target, and/or suppression of distractor, processing. These results confirm basic assumptions of the TVA framework, complement the functional interpretation of event-related lateralization components in selective attention studies, and are of relevance for the development of neurocognitive attentional assessment procedures.

Single-session transcranial direct current stimulation induces enduring enhancement of visual processing speed in patients with major depression

Attentional deficits are considered key cognitive symptoms in major depressive disorder (MDD) arising from abnormal activation patterns within dorsolateral prefrontal cortex (dlPFC) alertness networks. Altering these activity patterns with transcranial direct current stimulation (tDCS) might thus ameliorate alertness-dependent cognitive deficits in MDD patients. In a double-blind, randomized, sham-controlled study, we investigated the effect of a single session of anodal tDCS (2 mA) applied to the left dlPFC on different parameters of visual attention based on Bundesen's theory of visual attention (Psychol Rev 97(4):523-547, 1990) in a group of 20 patients with MDD and a control group of 20 healthy participants. The parametric attention assessment took place before, immediately after and 24 h after tDCS intervention. It revealed a selective impairment in visual processing speed as a primary functional deficit in MDD at baseline assessment. Furthermore, a significant stimulation condition × time point interaction showed that verum tDCS over the left dlPFC resulted in a processing speed enhancement 24 h post-stimulation in MDD patients. In healthy control participants, we did not find similar tDCS-induced effects. Our results suggest that even a single session of tDCS over the dlPFC can induce enduring neurocognitive benefits that indicate an amelioration of cortical under-arousal in MDD patients in a time frame beyond that of immediate, excitability increases that are directly induced by the current.

The influence of the Japanese waving cat on the joint spatial compatibility effect: A replication and extension of Dolk, Hommel, Prinz, and Liepelt (2013)

In a joint go/no-go Simon task, each of two participants is to respond to one of two non-spatial stimulus features by means of a spatially lateralized response. Stimulus position varies horizontally and responses are faster and more accurate when response side and stimulus position match (compatible trial) than when they mismatch (incompatible trial), defining the social Simon effect or joint spatial compatibility effect. This effect was originally explained in terms of action/task co-representation, assuming that the co-actor’s action is automatically co-represented. Recent research by Dolk, Hommel, Prinz, and Liepelt (2013) challenged this account by demonstrating joint spatial compatibility effects in a task-setting in which non-social objects like a Japanese waving cat were present, but no real co-actor. They postulated that every sufficiently salient object induces joint spatial compatibility effects. However, what makes an object sufficiently salient is so far not well defined. To scrutinize this open question, the current study manipulated auditory and/or visual attention-attracting cues of a Japanese waving cat within an auditory (Experiment 1) and a visual joint go/no-go Simon task (Experiment 2). Results revealed that joint spatial compatibility effects only occurred in an auditory Simon task when the cat provided auditory cues while no joint spatial compatibility effects were found in a visual Simon task. This demonstrates that it is not the sufficiently salient object alone that leads to joint spatial compatibility effects but instead, a complex interaction between features of the object and the stimulus material of the joint go/no-go Simon task.

Behavioral and Brain Measures of Phasic Alerting Effects on Visual Attention

In the present study, we investigated effects of phasic alerting on visual attention in a partial report task, in which half of the displays were preceded by an auditory warning cue. Based on the computational Theory of Visual Attention (TVA), we estimated parameters of spatial and non-spatial aspects of visual attention and measured event-related lateralizations (ERLs) over visual processing areas. We found that the TVA parameter sensory effectiveness a, which is thought to reflect visual processing capacity, significantly increased with phasic alerting. By contrast, the distribution of visual processing resources according to task relevance and spatial position, as quantified in parameters top-down control α and spatial bias w_index, was not modulated by phasic alerting. On the electrophysiological level, the latencies of ERLs in response to the task displays were reduced following the warning cue. These results suggest that phasic alerting facilitates visual processing in a general, unselective manner and that this effect originates in early stages of visual information processing.

The price of information: Increased inspection costs reduce the confirmation bias in visual search

In visual search, there is a confirmation bias such that attention is biased towards stimuli that match a target template, which has been attributed to covert costs of updating the templates that guide search [Rajsic, Wilson, & Pratt, 2015. Confirmation bias in visual search. Journal of Experimental Psychology: Human Perception and Performance. Advance online publication. doi:10.1037/xhp0000090]. In order to provide direct evidence for this speculation, the present study increased the cost of inspections in search by using gaze- and mouse-contingent searches, which restrict the manner in which information in search displays can be accrued, and incur additional motor costs (in the case of mouse-contingent searches). In a fourth experiment, we rhythmically mask elements in the search display to induce temporal inspection costs. Our results indicated that confirmation bias is indeed attenuated when inspection costs are increased. We conclude that confirmation bias results from the low-cost strategy of matching information to a single, concrete visual template, and that more sophisticated guidance strategies will be used when sufficiently beneficial. This demonstrates that search guidance itself comes at a cost, and that the form of guidance adopted in a given search depends on a comparison between guidance costs and the expected benefits of their implementation.

What makes icons appealing? The role of processing fluency in predicting icon appeal in different task contexts

Although icons appear on almost all interfaces, there is a paucity of research examining the determinants of icon appeal. The experiments reported here examined the icon characteristics determining appeal and the extent to which processing fluency - the subjective ease with which individuals process information - was used as a heuristic to guide appeal evaluations. Participants searched for, and identified, icons in displays. The initial appeal of icons was held constant while ease of processing was manipulated by systematically varying the complexity and familiarity of the icons presented and the type of task participants were asked to carry out. Processing fluency reliably influenced users' appeal ratings and appeared to be based on users' unconscious awareness of the ease with which they carried out experimental tasks.

Thinking, Walking, Talking: Integratory Motor and Cognitive Brain Function

In this article, we argue that motor and cognitive processes are functionally related and most likely share a similar evolutionary history. This is supported by clinical and neural data showing that some brain regions integrate both motor and cognitive functions. In addition, we also argue that cognitive processes coincide with complex motor output. Further, we also review data that support the converse notion that motor processes can contribute to cognitive function, as found by many rehabilitation and aerobic exercise training programs. Support is provided for motor and cognitive processes possessing dynamic bidirectional influences on each other.

Fast and Conspicuous? Quantifying Salience With the Theory of Visual Attention

Particular differences between an object and its surrounding cause salience, guide attention, and improve performance in various tasks. While much research has been dedicated to identifying which feature dimensions contribute to salience, much less regard has been paid to the quantitative strength of the salience caused by feature differences. Only a few studies systematically related salience effects to a common salience measure, and they are partly outdated in the light of new findings on the time course of salience effects. We propose Bundesen’s Theory of Visual Attention (TVA) as a theoretical basis for measuring salience and introduce an empirical and modeling approach to link this theory to data retrieved from temporal-order judgments. With this procedure, TVA becomes applicable to a broad range of salience-related stimulus material. Three experiments with orientation pop-out displays demonstrate the feasibility of the method. A 4th experiment substantiates its applicability to the luminance dimension.

Investigating attention in complex visual search

How we attend to and search for objects in the real world is influenced by a host of low-level and higher-level factors whose interactions are poorly understood. The vast majority of studies approach this issue by experimentally controlling one or two factors in isolation, often under conditions with limited ecological validity. We present a comprehensive regression framework, together with a matlab-implemented toolbox, which allows concurrent factors influencing saccade targeting to be more clearly distinguished. Based on the idea of gaze selection as a point process, the framework allows each putative factor to be modeled as a covariate in a generalized linear model, and its significance to be evaluated with model-based hypothesis testing. We apply this framework to visual search for faces as an example and demonstrate its power in detecting effects of eccentricity, inversion, task congruency, emotional expression, and serial fixation order on the targeting of gaze. Among other things, we find evidence for multiple goal-related and goal-independent processes that operate with distinct visuotopy and time course.

Structural Variability within Frontoparietal Networks and Individual Differences in Attentional Functions: An Approach Using the Theory of Visual Attention

Visuospatial attention allows us to select and act upon a subset of behaviorally relevant visual stimuli while ignoring distraction. Bundesen's theory of visual attention (TVA) (Bundesen, 1990) offers a quantitative analysis of the different facets of attention within a unitary model and provides a powerful analytic framework for understanding individual differences in attentional functions. Visuospatial attention is contingent upon large networks, distributed across both hemispheres, consisting of several cortical areas interconnected by long-association frontoparietal pathways, including three branches of the superior longitudinal fasciculus (SLF I-III) and the inferior fronto-occipital fasciculus (IFOF). Here we examine whether structural variability within human frontoparietal networks mediates differences in attention abilities as assessed by the TVA. Structural measures were based on spherical deconvolution and tractography-derived indices of tract volume and hindrance-modulated orientational anisotropy (HMOA). Individual differences in visual short-term memory (VSTM) were linked to variability in the microstructure (HMOA) of SLF II, SLF III, and IFOF within the right hemisphere. Moreover, VSTM and speed of information processing were linked to hemispheric lateralization within the IFOF. Differences in spatial bias were mediated by both variability in microstructure and volume of the right SLF II. Our data indicate that the microstructural and macrostrucutral organization of white matter pathways differentially contributes to both the anatomical lateralization of frontoparietal attentional networks and to individual differences in attentional functions. We conclude that individual differences in VSTM capacity, processing speed, and spatial bias, as assessed by TVA, link to variability in structural organization within frontoparietal pathways.

Differential Effects of Lowered Arousal on Covert and Overt Shifts of Attention

Based on previous studies demonstrating detrimental effects of reduced alertness on attentional orienting our study seeks to examine covert and overt attentional orienting in different arousal states. We hypothesized an attentional asymmetry with increasing reaction times to stimuli presented to the left visual field in a state of maximally reduced arousal. Eleven healthy participants underwent sleep deprivation and were examined repeatedly every 4 hr over 28 hr in total with two tasks measuring covert and overt orienting of attention. Contrary to our hypothesis, a reduction of arousal did not induce any asymmetry of overt orienting. Even in participants with profound and significant attentional asymmetries in covert orienting no substantial reaction time differences between left- and right-sided targets in the overt orienting task could be observed. This result is not in agreement with assumptions of a tight coupling of covert and overt attentional processes. In conclusion, we found differential effects of lowered arousal induced by sleep deprivation on covert and overt orienting of attention. This pattern of results points to a neuronal non-overlap of brain structures subserving these functions and a differential influence of the norepinephrine system on these modes of spatial attention.

Population responses in V1 encode different figures by response amplitude

The visual system simultaneously segregates between several objects presented in a visual scene. The neural code for encoding different objects or figures is not well understood. To study this question, we trained two monkeys to discriminate whether two elongated bars are either separate, thus generating two different figures, or connected, thus generating a single figure. Using voltage-sensitive dyes, we imaged at high spatial and temporal resolution V1 population responses evoked by the two bars, while keeping their local attributes similar among the two conditions. In the separate condition, unlike the connected condition, the population response to one bar is enhanced, whereas the response to the other is simultaneously suppressed. The response to the background remained unchanged between the two conditions. This divergent pattern developed ∼200 ms poststimulus onset and could discriminate well between the separate and connected single trials. The stimulus separation saliency and behavioral report were highly correlated with the differential response to the bars. In addition, the proximity and/or the specific location of the connectors seemed to have only a weak effect on this late activity pattern, further supporting the involvement of top-down influences. Additional neural codes were less informative about the separate and connected conditions, with much less consistency and discriminability compared with a response amplitude code. We suggest that V1 is involved in the encoding of each figure by different neuronal response amplitude, which can mediate their segregation and perception.

Task representation in individual and joint settings

This paper outlines a framework for task representation and discusses applications to interference tasks in individual and joint settings. The framework is derived from the Theory of Event Coding (TEC). This theory regards task sets as transient assemblies of event codes in which stimulus and response codes interact and shape each other in particular ways. On the one hand, stimulus and response codes compete with each other within their respective subsets (horizontal interactions). On the other hand, stimulus and response code cooperate with each other (vertical interactions). Code interactions instantiating competition and cooperation apply to two time scales: on-line performance (i.e., doing the task) and off-line implementation (i.e., setting the task). Interference arises when stimulus and response codes overlap in features that are irrelevant for stimulus identification, but relevant for response selection. To resolve this dilemma, the feature profiles of event codes may become restructured in various ways. The framework is applied to three kinds of interference paradigms. Special emphasis is given to joint settings where tasks are shared between two participants. Major conclusions derived from these applications include: (1) Response competition is the chief driver of interference. Likewise, different modes of response competition give rise to different patterns of interference; (2) The type of features in which stimulus and response codes overlap is also a crucial factor. Different types of such features give likewise rise to different patterns of interference; and (3) Task sets for joint settings conflate intraindividual conflicts between responses (what), with interindividual conflicts between responding agents (whom). Features of response codes may, therefore, not only address responses, but also responding agents (both physically and socially).

Non-binding relationship between visual features

The answer as to how visual attributes processed in different brain loci at different speeds are bound together to give us our unitary experience of the visual world remains unknown. In this study we investigated whether bound representations arise, as commonly assumed, through physiological interactions between cells in the visual areas. In a focal attentional task in which correct responses from either bound or unbound representations were possible, participants discriminated the color or orientation of briefly presented single bars. On the assumption that representations of the two attributes are bound, the accuracy of reporting the color and orientation should co-vary. By contrast, if the attributes are not mandatorily bound, the accuracy of reporting the two attributes should be independent. The results of our psychophysical studies reported here supported the latter, non-binding, relationship between visual features, suggesting that binding does not necessarily occur even under focal attention. We propose a task-contingent binding mechanism, postulating that binding occurs at late, post-perceptual (PP), stages through the intervention of memory.

TVA-based assessment of visual attentional functions in developmental dyslexia

There is an ongoing debate whether an impairment of visual attentional functions constitutes an additional or even an isolated deficit of developmental dyslexia (DD). Especially performance in tasks that require the processing of multiple visual elements in parallel has been reported to be impaired in DD. We review studies that used parameter-based assessment for identifying and quantifying impaired aspect(s) of visual attention that underlie this multi-element processing deficit in DD. These studies used the mathematical framework provided by the "theory of visual attention" (Bundesen, 1990) to derive quantitative measures of general attentional resources and attentional weighting aspects on the basis of behavioral performance in whole- and partial-report tasks. Based on parameter estimates in children and adults with DD, the reviewed studies support a slowed perceptual processing speed as an underlying primary deficit in DD. Moreover, a reduction in visual short term memory storage capacity seems to present a modulating component, contributing to difficulties in written language processing. Furthermore, comparing the spatial distributions of attentional weights in children and adults suggests that having limited reading and writing skills might impair the development of a slight leftward bias, that is typical for unimpaired adult readers.

Rethinking volitional control over task choice in multitask environments: use of a stimulus set selection strategy in voluntary task switching

Under conditions of volitional control in multitask environments, subjects may engage in a variety of strategies to guide task selection. The current research examines whether subjects may sometimes use a top-down control strategy of selecting a task-irrelevant stimulus dimension, such as location, to guide task selection. We term this approach a stimulus set selection strategy. Using a voluntary task switching procedure, subjects voluntarily switched between categorizing letter and number stimuli that appeared in two, four, or eight possible target locations. Effects of stimulus availability, manipulated by varying the stimulus onset asynchrony between the two target stimuli, and location repetition were analysed to assess the use of a stimulus set selection strategy. Considered across position condition, Experiment 1 showed effects of both stimulus availability and location repetition on task choice suggesting that only in the 2-position condition, where selection based on location always results in a target at the selected location, subjects may have been using a stimulus set selection strategy on some trials. Experiment 2 replicated and extended these findings in a visually more cluttered environment. These results indicate that, contrary to current models of task selection in voluntary task switching, the top-down control of task selection may occur in the absence of the formation of an intention to perform a particular task.

A biased competition account of attention and memory in Alzheimer's disease

The common view of Alzheimer's disease (AD) is that of an age-related memory disorder, i.e. declarative memory deficits are the first signs of the disease and associated with progressive brain changes in the medial temporal lobes and the default mode network. However, two findings challenge this view. First, new model-based tools of attention research have revealed that impaired selective attention accompanies memory deficits from early pre-dementia AD stages on. Second, very early distributed lesions of lateral parietal networks may cause these attention deficits by disrupting brain mechanisms underlying attentional biased competition. We suggest that memory and attention impairments might indicate disturbances of a common underlying neurocognitive mechanism. We propose a unifying account of impaired neural interactions within and across brain networks involved in attention and memory inspired by the biased competition principle. We specify this account at two levels of analysis: at the computational level, the selective competition of representations during both perception and memory is biased by AD-induced lesions; at the large-scale brain level, integration within and across intrinsic brain networks, which overlap in parietal and temporal lobes, is disrupted. This account integrates a large amount of previously unrelated findings of changed behaviour and brain networks and favours a brain mechanism-centred view on AD.

Superior parietal lobule dysfunction in a homogeneous group of dyslexic children with a visual attention span disorder

A visual attention (VA) span disorder has been reported in dyslexic children as potentially responsible for their poor reading outcome. The purpose of the current paper was to identify the cerebral correlates of this VA span disorder. For this purpose, 12 French dyslexic children with severe reading and VA span disorders and 12 age-matched control children were engaged in a categorisation task under fMRI. Two flanked and isolated conditions were designed which both involved multiple-element simultaneous visual processing but taxed visual attention differently. For skilled readers, flanked stimuli processing activated a large bilateral cortical network comprising the superior and inferior parietal cortex, the inferior temporal cortex, the striate and extrastriate visual cortex, the middle frontal cortex and the anterior cingulate cortex while the less attention-demanding task of isolated stimuli only activated the inferior occipito-temporal cortex bilaterally. With respect to controls, the dyslexic children showed significantly reduced activation within bilateral parietal and temporal areas during flanked processing, but no difference during the isolated condition. The neural correlates of the processes involved in attention-demanding multi-element processing tasks were more specifically addressed by contrasting the flanked and the isolated conditions. This contrast elicited activation of the left precuneus/superior parietal lobule in the controls, but not in the dyslexic children. These findings provide new insights on the role of parietal regions, in particular the left superior parietal lobule, in the visual attention span and in developmental dyslexia.

Interactions between attention and visual short-term memory (VSTM): what can be learnt from individual and developmental differences?

An ever increasing amount of research in the fields of developmental psychology and adult cognitive neuroscience explores attentional control as a driver of visual short-term and working memory capacity limits ("VSTM" and "VWM", respectively). However, these literatures have thus far been disparate: they use different measures or different labels, and the constructs of interest often appear to be quite distinct. In the current review, we attempt to bridge these gaps across disciplines and explore the extent to which these two literatures might support one another. In order to do this, we explore five principal questions of interest to members of both communities: (1) To what extent are measures of VSTM, VWM and attentional control commensurate across the developmental and adult literatures? (2) To what extent do individual differences in attentional control account for why some children, just like some adults, show poorer VSTM and VWM capacity than others? (3) Can developmental improvements in VSTM and VWM capacity also be explained by differences in attentional control? (4) What novel insights can be gained by studying the developmental cognitive neuroscience of attention and VSTM and VWM? (5) Can visual short-term and working memory capacity be modulated by training and, if so, how can training effects inform the relationships between attention and VSTM? Throughout, we evaluate the central thesis that variability in attentional control, both between individuals and over development, is a driver of variability in VSTM and VWM capacity.

A neural theory of visual attention and short-term memory (NTVA)

The neural theory of visual attention and short-term memory (NTVA) proposed by Bundesen, Habekost, and Kyllingsbæk (2005) is reviewed. In NTVA, filtering (selection of objects) changes the number of cortical neurons in which an object is represented so that this number increases with the behavioural importance of the object. Another mechanism of selection, pigeonholing (selection of features), scales the level of activation in neurons coding for a particular feature. By these mechanisms, behaviourally important objects and features are likely to win the competition to become encoded into visual short-term memory (VSTM). The VSTM system is conceived as a feedback mechanism that sustains activity in the neurons that have won the attentional competition. NTVA accounts both for a wide range of attentional effects in human performance (reaction times and error rates) and a wide range of effects observed in firing rates of single cells in the primate visual system.

Reaction time distributions constrain models of visual search

Many experiments have investigated visual search for simple stimuli like colored bars or alphanumeric characters. When eye movements are not a limiting factor, these tasks tend to produce roughly linear functions relating reaction time (RT) to the number of items in the display (set size). The slopes of the RTxset size functions for different searches fall on a continuum from highly efficient (slopes near zero) to inefficient (slopes>25-30ms/item). Many theories of search can produce the correct pattern of mean RTs. Producing the correct RT distributions is more difficult. In order to guide future modeling, we have collected a very large data set (about 112,000 trials) on three tasks: an efficient color feature search, an inefficient search for a 2 among 5s, and an intermediate colorxorientation conjunction search. The RT distributions have interesting properties. For example, target absent distributions overlap target present more than would be expected if the decision to end search were based on a simple elapsed time threshold. Other qualitative properties of the RT distributions falsify some classes of model. For example, normalized RT distributions do not change shape as set size changes as a standard self-terminating model predicts that they should.

Effects of modafinil and methylphenidate on visual attention capacity: a TVA-based study

INTRODUCTION

Theory of visual attention (TVA; Bundesen 1990) whole report tasks allow the independent measurement of visual perceptual processing speed and visual short-term memory (vSTM) storage capacity, unconfounded by motor speed. This study investigates how cognitive enhancing effects of psychostimulants depend on baseline performance and individual plasma levels.

MATERIALS AND METHODS

Eighteen healthy volunteers (aged 20-35 years) received single oral doses of either 40 mg methylphenidate, 400 mg modafinil or placebo in a counterbalanced, double-blind crossover design. A whole report of visually presented letter arrays was performed 2.5-3.5 h after drug administration, and blood samples for plasma level analysis were taken.

RESULTS

Methylphenidate and modafinil both enhanced perceptual processing speed in participants with low baseline (placebo) performance. These improvements correlated with subjective alertness. Furthermore, we observed differential plasma level-dependent effects of methylphenidate in lower and higher performing participants: higher plasma levels led to a greater improvement in low-performing participants and to decreasing improvement in high-performing participants. Modafinil enhanced visual short-term memory storage capacity in low-performing participants.

CONCLUSIONS

This is the first pharmacological investigation demonstrating the usefulness of a TVA task for high-resolution and repeated cognitive parameter estimation after cognitive-enhancing medication. Our results confirm previous findings of attentional capacity improvements in low performers and extend the baseline dependency model to methylphenidate. Plasma level-dependent effects of psychostimulants can be modelled on an inverted U-shaped dose-response relationship, which is highly relevant to predict cognitive enhancing and detrimental effects of psychostimulants in patients with cognitive deficits (e.g., attention deficit hyperactivity disorder) and healthy volunteers (e.g., self-medicating academics).

The precision of visual working memory is set by allocation of a shared resource

The mechanisms underlying visual working memory have recently become controversial. One account proposes a small number of memory "slots," each capable of storing a single visual object with fixed precision. A contrary view holds that working memory is a shared resource, with no upper limit on the number of items stored; instead, the more items that are held in memory, the less precisely each can be recalled. Recent findings from a color report task have been taken as crucial new evidence in favor of the slot model. However, while this task has previously been thought of as a simple test of memory for color, here we show that performance also critically depends on memory for location. When errors in memory are considered for both color and location, performance on this task is in fact well explained by the resource model. These results demonstrate that visual working memory consists of a common resource distributed dynamically across the visual scene, with no need to invoke an upper limit on the number of objects represented.

Attentional and sensory effects of lowered levels of intrinsic alertness

Low levels of intrinsic alertness are associated with lateralized performance in visual tasks, similar to neglect of the left (ipsilesional) visual hemi-field. However, it is unclear whether reduced alertness produces a specific lateralization of spatial-attentional processes in terms of the prioritization of right- over left-side stimuli, or whether it affects more basic functions of visuo-sensory coding, and/or higher function of the top-down control of selection, of stimuli on the left side. To decide between these alternatives, the present study examined the effects of lowered alertness, induced by a 50-min vigilance task, in a partial-report paradigm of briefly presented letter displays. With only one (unilateral) stimulus in display, no specific hemi-field effects were found under low-alertness conditions, indicating that reduced alertness impairs neither sensory effectiveness nor the top-town control of selection. However, with dual, bilateral stimuli, report accuracy was specifically affected for left-side targets (in subjects who showed comparable performance for both sides under normal-alertness conditions). This pattern can be interpreted in terms of a specific bias in spatial-attentional weighting, where prioritization of stimuli on the right leads to (mild) extinction of targets on the left. Moreover, participants who had a lower general level of alertness also showed a more pronounced re-distribution of weights, evidenced by a more severe imbalance in report accuracy, in a low compared to a normal state of alertness. This suggests that a low general level of intrinsic alertness engenders a specific vulnerability to neglect-like performance with a (mild) left-side extinction.

Task-irrelevant stimulus salience affects visual search

The relative contributions of stimulus salience and task-related goals in guiding attention remain an issue of debate. Several studies have demonstrated that top-down factors play an important role, as they often override capture by salient irrelevant objects. However, Yantis and Egeth [Yantis, S., & Egeth, H. E. (1999). On the distinction between visual salience and stimulus-driven attentional capture. Journal of Experimental Psychology: Human Perception and Performance, 25, 661-676.] have made the more radical claim that salience plays no role in visual search unless the observer adopts an attentional set for singletons or "singleton-detection mode". We reexamine their claim while disentangling effects of stimulus salience from effects of attentional set and inter-trial repetition. The results show that stimulus salience guides attention even when salience is task irrelevant.