1
|
Chen S, Töllner T, Müller HJ, Conci M. ERPs and alpha oscillations track the encoding and maintenance of object-based representations in visual working memory. Psychophysiology 2024; 61:e14557. [PMID: 38459638 DOI: 10.1111/psyp.14557] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2023] [Revised: 02/15/2024] [Accepted: 02/16/2024] [Indexed: 03/10/2024]
Abstract
When memorizing an integrated object such as a Kanizsa figure, the completion of parts into a coherent whole is attained by grouping processes which render a whole-object representation in visual working memory (VWM). The present study measured event-related potentials (ERPs) and oscillatory amplitudes to track these processes of encoding and representing multiple features of an object in VWM. To this end, a change detection task was performed, which required observers to memorize both the orientations and colors of six "pacman" items while inducing configurations of the pacmen that systematically varied in terms of their grouping strength. The results revealed an effect of object configuration in VWM despite physically constant visual input: change detection for both orientation and color features was more accurate with increased grouping strength. At the electrophysiological level, the lateralized ERPs and alpha activity mirrored this behavioral pattern. Perception of the orientation features gave rise to the encoding of a grouped object as reflected by the amplitudes of the Ppc. The grouped object structure, in turn, modulated attention to both orientation and color features as indicated by the enhanced N1pc and N2pc. Finally, during item retention, the representation of individual objects and the concurrent allocation of attention to these memorized objects were modulated by grouping, as reflected by variations in the CDA amplitude and a concurrent lateralized alpha suppression, respectively. These results indicate that memorizing multiple features of grouped, to-be-integrated objects involves multiple, sequential stages of processing, providing support for a hierarchical model of object representations in VWM.
Collapse
Affiliation(s)
- Siyi Chen
- Allgemeine und Experimentelle Psychologie, Department Psychologie, Ludwig-Maximilians-Universität München, Munich, Germany
| | - Thomas Töllner
- Allgemeine und Experimentelle Psychologie, Department Psychologie, Ludwig-Maximilians-Universität München, Munich, Germany
| | - Hermann J Müller
- Allgemeine und Experimentelle Psychologie, Department Psychologie, Ludwig-Maximilians-Universität München, Munich, Germany
| | - Markus Conci
- Allgemeine und Experimentelle Psychologie, Department Psychologie, Ludwig-Maximilians-Universität München, Munich, Germany
| |
Collapse
|
2
|
Zinchenko A, Geyer T, Zang X, Shi Z, Müller HJ, Conci M. When experience with scenes foils attentional orienting: ERP evidence against flexible target-context mapping in visual search. Cortex 2024; 175:41-53. [PMID: 38703715 DOI: 10.1016/j.cortex.2024.04.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/16/2023] [Revised: 02/25/2024] [Accepted: 04/01/2024] [Indexed: 05/06/2024]
Abstract
Visual search is speeded when a target is repeatedly presented in an invariant scene context of nontargets (contextual cueing), demonstrating observers' capability for using statistical long-term memory (LTM) to make predictions about upcoming sensory events, thus improving attentional orienting. In the current study, we investigated whether expectations arising from individual, learned environmental structures can encompass multiple target locations. We recorded event-related potentials (ERPs) while participants performed a contextual cueing search task with repeated and non-repeated spatial item configurations. Notably, a given search display could be associated with either a single target location (standard contextual cueing) or two possible target locations. Our result showed that LTM-guided attention was always limited to only one target position in single- but also in the dual-target displays, as evidenced by expedited reaction times (RTs) and enhanced N1pc and N2pc deflections contralateral to one ("dominant") target of up to two repeating target locations. This contrasts with the processing of non-learned ("minor") target positions (in dual-target displays), which revealed slowed RTs alongside an initial N1pc "misguidance" signal that then vanished in the subsequent N2pc. This RT slowing was accompanied by enhanced N200 and N400 waveforms over fronto-central electrodes, suggesting that control mechanisms regulate the competition between dominant and minor targets. Our study thus reveals a dissociation in processing dominant versus minor targets: While LTM templates guide attention to dominant targets, minor targets necessitate control processes to overcome the automatic bias towards previously learned, dominant target locations.
Collapse
Affiliation(s)
- Artyom Zinchenko
- Department Psychologie, Ludwig-Maximilians-Universität München, München, Germany.
| | - Thomas Geyer
- Department Psychologie, Ludwig-Maximilians-Universität München, München, Germany; NICUM - Neuro Imaging Core Unit, LMU Munich, Germany; MCN - Munich Center for Neurosciences - Brain & Mind, LMU Munich, Germany
| | - Xuelian Zang
- Center for Cognition and Brain Disorders, Affiliated Hospital of Hangzhou Normal University, China; Institutes of Psychological Sciences, College of Education, Hangzhou Normal University, China
| | - Zhuanghua Shi
- Department Psychologie, Ludwig-Maximilians-Universität München, München, Germany; NICUM - Neuro Imaging Core Unit, LMU Munich, Germany
| | - Hermann J Müller
- Department Psychologie, Ludwig-Maximilians-Universität München, München, Germany; MCN - Munich Center for Neurosciences - Brain & Mind, LMU Munich, Germany
| | - Markus Conci
- Department Psychologie, Ludwig-Maximilians-Universität München, München, Germany; MCN - Munich Center for Neurosciences - Brain & Mind, LMU Munich, Germany
| |
Collapse
|
3
|
Contralateral delay activity, but not alpha lateralization, indexes prioritization of information for working memory storage. Atten Percept Psychophys 2023; 85:718-733. [PMID: 36917354 PMCID: PMC10066168 DOI: 10.3758/s13414-023-02681-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/14/2023] [Indexed: 03/16/2023]
Abstract
Working memory is inherently limited, which makes it important to select and maintain only task-relevant information and to protect it from distraction. Previous research has suggested the contralateral delay activity (CDA) and lateralized alpha oscillations as neural candidates for such a prioritization process. While most of this work focused on distraction during encoding, we examined the effect of external distraction presented during memory maintenance. Participants memorized the orientations of three lateralized objects. After an initial distraction-free maintenance interval, distractors appeared in the same location as the targets or in the opposite hemifield. This distraction was followed by another distraction-free interval. Our results show that CDA amplitudes were stronger in the interval before compared with the interval after the distraction (i.e., CDA amplitudes were stronger in response to targets compared with distractors). This amplitude reduction in response to distractors was more pronounced in participants with higher memory accuracy, indicating prioritization and maintenance of relevant over irrelevant information. In contrast, alpha lateralization did not change from the interval before distraction compared with the interval after distraction, and we found no correlation between alpha lateralization and memory accuracy. These results suggest that alpha lateralization plays no direct role in either selective maintenance of task-relevant information or inhibition of distractors. Instead, alpha lateralization reflects the current allocation of spatial attention to the most salient information regardless of task-relevance. In contrast, CDA indicates flexible allocation of working memory resources depending on task-relevance.
Collapse
|
4
|
Priming of probabilistic attentional templates. Psychon Bull Rev 2023; 30:22-39. [PMID: 35831678 DOI: 10.3758/s13423-022-02125-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/09/2022] [Indexed: 11/08/2022]
Abstract
Attentional priming has a dominating influence on vision, speeding visual search, releasing items from crowding, reducing masking effects, and during free-choice, primed targets are chosen over unprimed ones. Many accounts postulate that templates stored in working memory control what we attend to and mediate the priming. But what is the nature of these templates (or representations)? Analyses of real-world visual scenes suggest that tuning templates to exact color or luminance values would be impractical since those can vary greatly because of changes in environmental circumstances and perceptual interpretation. Tuning templates to a range of the most probable values would be more efficient. Recent evidence does indeed suggest that the visual system represents such probability, gradually encoding statistical variation in the environment through repeated exposure to input statistics. This is consistent with evidence from neurophysiology and theoretical neuroscience as well as computational evidence of probabilistic representations in visual perception. I argue that such probabilistic representations are the unit of attentional priming and that priming of, say, a repeated single-color value simply involves priming of a distribution with no variance. This "priming of probability" view can be modelled within a Bayesian framework where priming provides contextual priors. Priming can therefore be thought of as learning of the underlying probability density function of the target or distractor sets in a given continuous task.
Collapse
|
5
|
Hansmann-Roth S, Þorsteinsdóttir S, Geng JJ, Kristjánsson Á. Temporal integration of feature probability distributions. PSYCHOLOGICAL RESEARCH 2022; 86:2030-2044. [PMID: 34997327 DOI: 10.1007/s00426-021-01621-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2021] [Accepted: 11/13/2021] [Indexed: 10/19/2022]
Abstract
Humans are surprisingly good at learning the statistical characteristics of their visual environment. Recent studies have revealed that not only can the visual system learn repeated features of visual search distractors, but also their actual probability distributions. Search times were determined by the frequency of distractor features over consecutive search trials. The search displays applied in these studies involved many exemplars of distractors on each trial and while there is clear evidence that feature distributions can be learned from large distractor sets, it is less clear if distributions are well learned for single targets presented on each trial. Here, we investigated potential learning of probability distributions of single targets during visual search. Over blocks of trials, observers searched for an oddly colored target that was drawn from either a Gaussian or a uniform distribution. Search times for the different target colors were clearly influenced by the probability of that feature within trial blocks. The same search targets, coming from the extremes of the two distributions were found significantly slower during the blocks where the targets were drawn from a Gaussian distribution than from a uniform distribution indicating that observers were sensitive to the target probability determined by the distribution shape. In Experiment 2, we replicated the effect using binned distributions and revealed the limitations of encoding complex target distributions. Our results demonstrate detailed internal representations of target feature distributions and that the visual system integrates probability distributions of target colors over surprisingly long trial sequences.
Collapse
Affiliation(s)
- Sabrina Hansmann-Roth
- Icelandic Vision Lab, School of Health Sciences, University of Iceland, Reykjavík, Iceland.
- Université de Lille, CNRS, UMR 9193-SCALab-Sciences Cognitives et Sciences Affectives, 59000, Lille, France.
| | - Sóley Þorsteinsdóttir
- Icelandic Vision Lab, School of Health Sciences, University of Iceland, Reykjavík, Iceland
| | - Joy J Geng
- Center for Mind and Brain, University of California Davis, Davis, CA, USA
- Department of Psychology, University of California Davis, Davis, CA, USA
| | - Árni Kristjánsson
- Icelandic Vision Lab, School of Health Sciences, University of Iceland, Reykjavík, Iceland
- School of Psychology, National Research University Higher School of Economics, Moscow, Russia
| |
Collapse
|
6
|
Wen 文雯 W, Huang 黄志邦 Z, Hou 侯寅 Y, Li 李晟 S. Tracking Neural Markers of Template Formation and Implementation in Attentional Inhibition under Different Distractor Consistency. J Neurosci 2022; 42:4927-4936. [PMID: 35545435 PMCID: PMC9188384 DOI: 10.1523/jneurosci.1705-21.2022] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2021] [Revised: 05/07/2022] [Accepted: 05/08/2022] [Indexed: 11/21/2022] Open
Abstract
Performing visual search tasks requires optimal attention deployment to promote targets and inhibit distractors. Rejection templates based on the feature of the distractor can be built to constrain the search process. We measured electroencephalography (EEG) of human participants of both sexes when they performed a visual search task in conditions where the distractor cues were constant within a block (fixed cueing) or changed on a trial-by-trial basis (varied cueing). In the fixed-cueing condition, sustained decoding of the cued colors could be achieved during the retention interval, and participants with higher decoding accuracy showed larger suppression benefits of the distractor cueing in the search period. In the varied-cueing condition, the cued color could only be transiently decoded after its onset, and higher decoding accuracy was observed from the participants who demonstrated lower suppression benefit. The differential neural representations of the to-be-ignored color in the two cueing conditions as well as their reverse associations with behavioral performance implied that rejection templates were formed in the fixed-cueing condition but not in the varied-cueing condition. Additionally, we observed stronger posterior alpha lateralization and midfrontal theta/beta power during the retention interval of the varied-cueing condition, indicating the cognitive costs in template formation caused by the trialwise change of distractor colors. Together, our findings revealed the neural markers associated with the critical roles of distractor consistency in linking template formation to successful inhibition.SIGNIFICANCE STATEMENT How do we strategically build a rejection template based on distractor features to filter out matched items when performing visual search tasks? Previous studies have suggested that the consistency of the to-be-ignored feature may play a significant role in this process. We recorded scalp EEGs when human participants searched for a target among distractors. Capitalized on multivariate decoding technique and time-frequency analysis, we revealed the neural markers of the rejection template under different distractor consistencies. Being able to track these processes in visual search could help us to understand the connection between template formation and successful distractor inhibition. Our findings may also benefit future EEG-based interventions on individuals with deficits in attentional control.
Collapse
Affiliation(s)
- Wen Wen 文雯
- School of Psychological and Cognitive Sciences, Peking University, Beijing 100871, China
| | - Zhibang Huang 黄志邦
- School of Psychological and Cognitive Sciences, Peking University, Beijing 100871, China
| | - Yin Hou 侯寅
- School of Psychological and Cognitive Sciences, Peking University, Beijing 100871, China
| | - Sheng Li 李晟
- School of Psychological and Cognitive Sciences, Peking University, Beijing 100871, China
- Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing 100101, China
- PKU-IDG/McGovern Institute for Brain Research, Peking University, Beijing 100875, China
- Key Laboratory of Machine Perception, Ministry of Education, Peking University, Beijing 100871, China
| |
Collapse
|
7
|
Contextual cueing in co-active visual search: Joint action allows acquisition of task-irrelevant context. Atten Percept Psychophys 2022; 84:1114-1129. [PMID: 35437702 DOI: 10.3758/s13414-022-02470-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/26/2022] [Indexed: 11/08/2022]
Abstract
Repeatedly presenting a target within a stable search array facilitates visual search, an effect termed contextual cueing. Previous solo-performance studies have shown that successful acquisition of contextual memories requires explicit allocation of attentional resources to the task-relevant repeated contexts. By contrast, repeated but task-irrelevant contexts could not be learned when presented together with repeated task-relevant contexts due to a blocking effect. Here we investigated if such blocking of context learning could be diminished in a social context, when the task-irrelevant context is task-relevant for a co-actor in a joint action search mode. We adopted the contextual cueing paradigm and extended this to the co-active search mode. Participants learned a context-cued subset of the search displays (color-defined) in the training phase, and their search performance was tested in the transfer phase, where previously irrelevant and relevant subsets were swapped. The experiments were conducted either in a solo search mode (Experiments 1 and 3) or in a co-active search mode (Experiment 2). Consistent with the classical contextual cueing studies, contextual cueing was observed in the training phase of all three experiments. Importantly, however, in the "swapped" test session, a significant contextual cueing effect was manifested only in the co-active search mode, not in the solo search mode. Our findings suggest that social context may widen the scope of attention, thus facilitating the acquisition of task-irrelevant contexts.
Collapse
|
8
|
Dodwell G, Liesefeld HR, Conci M, Müller HJ, Töllner T. EEG evidence for enhanced attentional performance during moderate-intensity exercise. Psychophysiology 2021; 58:e13923. [PMID: 34370887 DOI: 10.1111/psyp.13923] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2021] [Revised: 06/22/2021] [Accepted: 07/30/2021] [Indexed: 12/01/2022]
Abstract
Research on attentional control within real-world contexts has become substantially more feasible and thus frequent over the past decade. However, relatively little is known regarding how these processes may be influenced by common naturalistic behaviors such as engaging in physical activity, which is thought to modulate the availability of neurometabolic resources. Here, we used an event-related potential (ERP) approach to determine whether various intensities of aerobic exercise might affect the concurrent performance of attentional control mechanisms. Participants performed an additional-singleton visual search task across three levels of aerobic activity while seated on a stationary bicycle: at rest, during moderate-intensity exercise, and during vigorous-intensity exercise. In addition to behavioral measures, attentional processing was assessed via lateralized ERPs referencing target selection (PCN) and distractor suppression (PD ) mechanisms. Whereas engaging in exercise resulted in speeded response times overall, moderate-intensity exercise was found to uniquely eliminate the expression of distractor interference by the PCN while also giving rise to an unanticipated distractor-elicited Ppc. These findings demonstrate workload-specific and object-selective influences of aerobic exercise on attentional processing, providing insights not only for approaching attention in real-world contexts but also for understanding how attentional resources are used overall.
Collapse
Affiliation(s)
- Gordon Dodwell
- Graduate School of Systemic Neurosciences, Ludwig-Maximilians-Universität München, Planegg, Germany.,Department of Psychology, Ludwig-Maximilians-Universität München, Munich, Germany.,Department of Psychological Sciences, Birkbeck College, University of London, London, United Kingdom
| | - Heinrich R Liesefeld
- Graduate School of Systemic Neurosciences, Ludwig-Maximilians-Universität München, Planegg, Germany.,Department of Psychology, Ludwig-Maximilians-Universität München, Munich, Germany.,Department of Psychology, University of Bremen, Bremen, Germany
| | - Markus Conci
- Graduate School of Systemic Neurosciences, Ludwig-Maximilians-Universität München, Planegg, Germany.,Department of Psychology, Ludwig-Maximilians-Universität München, Munich, Germany
| | - Hermann J Müller
- Graduate School of Systemic Neurosciences, Ludwig-Maximilians-Universität München, Planegg, Germany.,Department of Psychology, Ludwig-Maximilians-Universität München, Munich, Germany
| | - Thomas Töllner
- Graduate School of Systemic Neurosciences, Ludwig-Maximilians-Universität München, Planegg, Germany.,Department of Psychology, Ludwig-Maximilians-Universität München, Munich, Germany
| |
Collapse
|
9
|
Dreneva A, Shvarts A, Chumachenko D, Krichevets A. Extrafoveal Processing in Categorical Search for Geometric Shapes: General Tendencies and Individual Variations. Cogn Sci 2021; 45:e13025. [PMID: 34379345 PMCID: PMC8459262 DOI: 10.1111/cogs.13025] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2020] [Revised: 06/10/2021] [Accepted: 06/27/2021] [Indexed: 11/29/2022]
Abstract
The paper addresses the capabilities and limitations of extrafoveal processing during a categorical visual search. Previous research has established that a target could be identified from the very first or without any saccade, suggesting that extrafoveal perception is necessarily involved. However, the limits in complexity defining the processed information are still not clear. We performed four experiments with a gradual increase of stimuli complexity to determine the role of extrafoveal processing in searching for the categorically defined geometric shape. The series of experiments demonstrated a significant role of extrafoveal processing while searching for simple two-dimensional shapes and its gradual decrease in a condition with more complicated three-dimensional shapes. The factors of objects' spatial orientation and distractor homogeneity significantly influenced both reaction time and the number of saccades required to identify a categorically defined target. An analysis of the individual p-value distributions revealed pronounced individual differences in using extrafoveal analysis and allowed examination of the performance of each particular participant. The condition with the forced prohibition of eye movements enabled us to investigate the efficacy of covert attention in the condition with complicated shapes. Our results indicate that both foveal and extrafoveal processing are simultaneously involved during a categorical search, and the specificity of their interaction is determined by the spatial orientation of objects, type of distractors, the prohibition to use overt attention, and individual characteristics of the participants.
Collapse
Affiliation(s)
- Anna Dreneva
- Faculty of PsychologyLomonosov Moscow State University
| | - Anna Shvarts
- Freudenthal InstituteFaculty of ScienceUtrecht University
| | | | | |
Collapse
|
10
|
Gaze dynamics of feature-based distractor inhibition under prior-knowledge and expectations. Atten Percept Psychophys 2021; 83:2430-2440. [PMID: 33904153 DOI: 10.3758/s13414-021-02308-y] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/16/2021] [Indexed: 11/08/2022]
Abstract
Prior information about distractor facilitates selective attention to task-relevant items and helps the optimization of oculomotor planning. In the present study, we capitalized on gaze-position decoding to examine the dynamics of attentional deployment in a feature-based attentional task that involved two groups of dots (target/distractor dots) moving toward different directions. In Experiment 1, participants were provided with target cues indicating the moving direction of target dots. The results showed that participants were biased toward the cued direction and tracked the target dots throughout the task period. In Experiment 2 and Experiment 3, participants were provided with cues that informed the moving direction of distractor dots. When the distractor cue varied on a trial-by-trial basis (Experiment 2), participants continuously monitored the distractor's direction. However, when the to-be-ignored distractor direction remained constant (Experiment 3), participants would strategically bias their attention to the distractor's direction before the cue onset to reduce the cost of redeployment of attention between trials and reactively suppress further attraction evoked by distractors during the stimulus-on stage. This functional dissociation reflected the distinct influence that expectation produced on ocular control. Taken together, these results suggest that monitoring the distractor's feature is a prerequisite for feature-based attentional inhibition, and this process is facilitated by the predictability of the distractor's feature.
Collapse
|
11
|
Zinchenko A, Conci M, Töllner T, Müller HJ, Geyer T. Automatic Guidance (and Misguidance) of Visuospatial Attention by Acquired Scene Memory: Evidence From an N1pc Polarity Reversal. Psychol Sci 2020; 31:1531-1543. [PMID: 33119432 PMCID: PMC7734553 DOI: 10.1177/0956797620954815] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/04/2022] Open
Abstract
Visual search is facilitated when the target is repeatedly encountered at a fixed position within an invariant (vs. randomly variable) distractor layout—that is, when the layout is learned and guides attention to the target, a phenomenon known as contextual cuing. Subsequently changing the target location within a learned layout abolishes contextual cuing, which is difficult to relearn. Here, we used lateralized event-related electroencephalogram (EEG) potentials to explore memory-based attentional guidance (N = 16). The results revealed reliable contextual cuing during initial learning and an associated EEG-amplitude increase for repeated layouts in attention-related components, starting with an early posterior negativity (N1pc, 80–180 ms). When the target was relocated to the opposite hemifield following learning, contextual cuing was effectively abolished, and the N1pc was reversed in polarity (indicative of persistent misguidance of attention to the original target location). Thus, once learned, repeated layouts trigger attentional-priority signals from memory that proactively interfere with contextual relearning after target relocation.
Collapse
Affiliation(s)
- Artyom Zinchenko
- Artyom Zinchenko, Ludwig-Maximilians-Universität München, Department of Psychology E-mail:
| | | | | | | | | |
Collapse
|
12
|
Hardman A, Töllner T, Martinovic J. Neural differences between chromatic- and luminance-driven attentional salience in visual search. J Vis 2020; 20:5. [PMID: 32196068 PMCID: PMC7408945 DOI: 10.1167/jovi.20.3.5] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2019] [Accepted: 11/28/2019] [Indexed: 12/02/2022] Open
Abstract
Previous electroencephalographic research on attentional salience did not fully capture the complexities of low-level vision, which relies on both cone-opponent chromatic and cone-additive luminance mechanisms. We systematically varied color and luminance contrast using a visual search task for a higher contrast target to assess the degree to which the salience-computing attentional mechanisms are constrained by low-level visual inputs. In our first experiment, stimuli were defined by contrast that isolated chromatic or luminance mechanisms. In our second experiment, targets were defined by contrasts that isolated or combined achromatic and chromatic mechanisms. In both experiments, event-related potential waveforms contralateral and ipsilateral to the target were qualitatively different for chromatic- compared to luminance-defined stimuli. The same was true of the difference waves computed from these waveforms, with isoluminant stimuli eliciting a mid-latency posterior contralateral negativity (PCN) component and achromatic stimuli eliciting a complex of multiple components, including an early posterior contralateral positivity followed by a late-latency PCN. Combining color with luminance resulted in waveform and difference wave patterns equivalent to those of achromatic stimuli. When large levels of chromaticity contrast were added to targets with small levels of luminance contrast, PCN latency was speeded. In conclusion, the mechanisms underlying attentional salience are constrained by the low-level inputs they receive. Furthermore, speeded PCN latencies for stimuli that combine color and luminance signals compared to stimuli that contain luminance alone demonstrate that color and luminance channels are integrated during pre-attentive visual processing, before top-down allocation of attention is triggered.
Collapse
Affiliation(s)
- Amanda Hardman
- School of Psychology, University of Aberdeen, Aberdeen, UK
| | - Thomas Töllner
- Department of Experimental Psychology, Ludwig-Maximilians-University Munich, Munich, Germany
| | | |
Collapse
|
13
|
Conci M, Deichsel C, Müller HJ, Töllner T. Feature guidance by negative attentional templates depends on search difficulty. VISUAL COGNITION 2019. [DOI: 10.1080/13506285.2019.1581316] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
Affiliation(s)
- Markus Conci
- Department Psychologie, Ludwig-Maximilians-Universität München, München, Germany
| | - Cassandra Deichsel
- Department Psychologie, Ludwig-Maximilians-Universität München, München, Germany
| | - Hermann J. Müller
- Department Psychologie, Ludwig-Maximilians-Universität München, München, Germany
- Department of Psychological Sciences, Birkbeck College, University of London, London, UK
| | - Thomas Töllner
- Department Psychologie, Ludwig-Maximilians-Universität München, München, Germany
| |
Collapse
|
14
|
Chen S, Nie QY, Müller HJ, Conci M. Kanizsa-figure object completion gates selection in the attentional blink. Q J Exp Psychol (Hove) 2019; 72:1741-1755. [PMID: 30501573 DOI: 10.1177/1747021818820009] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
Previous work has demonstrated that perceptual grouping modulates the selectivity of attention across space. By contrast, how grouping influences the allocation of attention over time is much less clear. This study investigated this issue, using an attentional blink (AB) paradigm to test how grouping influences the initial selection and the subsequent short-term memory consolidation of a target. On a given trial, two red Kanizsa-type targets (T1 and T2) with varying grouping strength were embedded in a rapid serial visual presentation stream of irrelevant distractors. Our results showed the typical AB finding: impaired identification of T2 when presented close in time following T1. Moreover, the AB was modulated by the T2 grouping-independently of the T1 structure-with stronger grouping leading to a decreased AB and overall higher performance. Conversely, a reversed pattern, namely an increased AB with increasing grouping strength was observed when the Kanizsa figure was not task-relevant. Together, these findings suggest that the grouping benefit emerges at early perceptual stages, automatically drawing attentional resources, thereby leading to either sustained benefits or transient costs-depending on the task-relevance of the grouped object. This indicates that grouping modulates processing of objects in time.
Collapse
Affiliation(s)
- Siyi Chen
- Allgemeine und Experimentelle Psychologie, Department Psychologie, Ludwig-Maximilians-Universität München, Munich, Germany
| | - Qi-Yang Nie
- Allgemeine und Experimentelle Psychologie, Department Psychologie, Ludwig-Maximilians-Universität München, Munich, Germany
| | - Hermann J Müller
- Allgemeine und Experimentelle Psychologie, Department Psychologie, Ludwig-Maximilians-Universität München, Munich, Germany
| | - Markus Conci
- Allgemeine und Experimentelle Psychologie, Department Psychologie, Ludwig-Maximilians-Universität München, Munich, Germany
| |
Collapse
|
15
|
Zhang Q, Liang T, Zhang J, Fu X, Wu J. Electrophysiological evidence for temporal dynamics associated with attentional processing in the zoom lens paradigm. PeerJ 2018; 6:e4538. [PMID: 29632741 PMCID: PMC5888137 DOI: 10.7717/peerj.4538] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2018] [Accepted: 03/06/2018] [Indexed: 11/20/2022] Open
Abstract
Background Visuospatial processing requires wide distribution or narrow focusing of attention to certain regions in space. This mechanism is described by the zoom lens model and predicts an inverse correlation between the efficiency of processing and the size of the attentional scope. Little is known, however, about the exact timing of the effects of attentional scaling on visual searching and whether or not additional processing phases are involved in this process. Method Electroencephalographic recordings were made while participants performed a visual search task under different attentional scaling conditions. Two concentric circles of different sizes, presented to the participants at the center of a screen modulated the attentional scopes, and search arrays were distributed in the space areas indicated by these concentric circles. To ensure consistent eccentricity of the search arrays across different conditions, we limited our studies to the neural responses evoked by the search arrays distributed in the overlapping region of different attentional scopes. Results Consistent with the prediction of the zoom lens model, our behavioral data showed that reaction times for target discrimination of search arrays decreased and the associated error rates also significantly decreased, with narrowing the attentional scope. Results of the event-related potential analysis showed that the target-elicited amplitude of lateral occipital N1, rather than posterior P1, which reflects the earliest visuospatial attentional processing, was sensitive to changes in the scaling of visuospatial attention, indicating that the modulation of the effect of changes in the spatial scale of attention on visual processing occurred after the delay period of P1. The N1 generator exhibited higher activity as the attentional scope narrowed, reflecting more intensive processing resources within the attentional focus. In contrast to N1, the amplitude of N2pc increased with the expansion of the attentional focus, suggesting that observers might further redistribute attentional resources according to the increased task difficulty. Conclusion These findings provide electrophysiological evidence that the neural activity of the N1 generator is the earliest marker of the zoom lens effect of visual spatial attention. Furthermore, evidence from N2pc shows that there is also a redistribution of attentional resources after the action of the zoom lens mechanism, which allows for better perform of the search task in the context of low attentional resolution. On the basis of the timing of P1, N1, and N2pc, our findings provide compelling evidence that visuospatial attention processing in the zoom lens paradigm involves multi-stage dynamic processing.
Collapse
Affiliation(s)
- Qing Zhang
- Department of Radiology, Affiliated Zhongshan Hospital of Dalian University, Dalian, Liaoning Province, China
| | - Tengfei Liang
- Research Center of Brain and Cognitive Neuroscience, Liaoning Normal University, Dalian, Liaoning Province, China
| | - Jiafeng Zhang
- Research Center of Brain and Cognitive Neuroscience, Liaoning Normal University, Dalian, Liaoning Province, China
| | - Xueying Fu
- Research Center of Brain and Cognitive Neuroscience, Liaoning Normal University, Dalian, Liaoning Province, China
| | - Jianlin Wu
- Department of Radiology, Affiliated Zhongshan Hospital of Dalian University, Dalian, Liaoning Province, China
| |
Collapse
|
16
|
Conci M, Groß J, Keller I, Müller HJ, Finke K. Attention as the ‘glue’ for object integration in parietal extinction. Cortex 2018; 101:60-72. [DOI: 10.1016/j.cortex.2017.12.024] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/15/2017] [Revised: 11/17/2017] [Accepted: 12/23/2017] [Indexed: 11/29/2022]
|
17
|
Wiegand I, Napiórkowski N, Töllner T, Petersen A, Habekost T, Müller HJ, Finke K. Event-related Electroencephalographic Lateralizations Mark Individual Differences in Spatial and Nonspatial Visual Selection. J Cogn Neurosci 2017; 30:482-497. [PMID: 29244636 DOI: 10.1162/jocn_a_01221] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Selective attention controls the distribution of our visual system's limited processing resources to stimuli in the visual field. Two independent parameters of visual selection can be quantified by modeling an individual's performance in a partial-report task based on the computational theory of visual attention (TVA): (i) top-down control α, the relative attentional weighting of relevant over irrelevant stimuli, and (ii) spatial bias wλ, the relative attentional weighting of stimuli in the left versus right hemifield. In this study, we found that visual event-related electroencephalographic lateralizations marked interindividual differences in these two functions. First, individuals with better top-down control showed higher amplitudes of the posterior contralateral negativity than individuals with poorer top-down control. Second, differences in spatial bias were reflected in asymmetries in earlier visual event-related lateralizations depending on the hemifield position of targets; specifically, individuals showed a positivity contralateral to targets presented in their prioritized hemifield and a negativity contralateral to targets presented in their nonprioritized hemifield. Thus, our findings demonstrate that two functionally different aspects of attentional weighting quantified in the respective TVA parameters are reflected in two different neurophysiological measures: The observer-dependent spatial bias influences selection by a bottom-up processing advantage of stimuli appearing in the prioritized hemifield. By contrast, task-related target selection governed by top-down control involves active enhancement of target, and/or suppression of distractor, processing. These results confirm basic assumptions of the TVA framework, complement the functional interpretation of event-related lateralization components in selective attention studies, and are of relevance for the development of neurocognitive attentional assessment procedures.
Collapse
Affiliation(s)
- Iris Wiegand
- Max Planck UCL Centre for Computational Psychiatry and Ageing Research.,Max Planck Institute for Human Development.,Brigham and Women's Hospital and Harvard Medical School
| | | | | | | | | | | | | |
Collapse
|
18
|
Non-singleton colors are not attended faster than categories, but they are encoded faster: A combined approach of behavior, modeling and ERPs. Vision Res 2017; 140:106-119. [DOI: 10.1016/j.visres.2017.06.013] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2017] [Revised: 06/05/2017] [Accepted: 06/08/2017] [Indexed: 11/22/2022]
|
19
|
Attending to multiple objects relies on both feature- and dimension-based control mechanisms: Evidence from human electrophysiology. Atten Percept Psychophys 2017; 78:2079-89. [PMID: 27299342 DOI: 10.3758/s13414-016-1152-1] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Numerous everyday search tasks require humans to attentionally select and temporally store more than one object present in the visual environment. Recently, several enumeration studies sought to isolate the mechanisms underlying multiple object processing by means of electrophysiological measures, which led to a more fine-grained picture as to which processing stages are modulated by object numerosity. One critical limitation that most of these studies share is that they used stimulus designs in which multiple targets were exclusively defined by the same feature value. Accordingly, it remains an open issue whether these findings generalize to search scenarios in which multiple targets are physically not identical. To systematically address this issue, we introduced three target context conditions in which multiple targets were defined randomly by (1) the same feature (sF), (2) different features within the same dimension (dFsD), or (3) different features across dimensions (dD). Our findings revealed that participants' ability to enumerate multiple targets was remarkably influenced by inter-target relationships, with fastest responses for sF trials, slowest responses for dD trials, and responses of intermediate speed for dFsD trials. Our electrophysiological analyses disclosed that one source of this response slowing was feature-based and originated from the stage of attentional selection (as indexed by PCN waves), whereas another source was dimension-based and associated with working memory processes (as indexed by P3b waves). Overall, our results point to a significant role of physical inter-target relationships in multiple object processing-a factor that has been largely neglected in most studies on enumeration.
Collapse
|
20
|
Gerlach C. Different Measures of Structural Similarity Tap Different Aspects of Visual Object Processing. Front Psychol 2017; 8:1404. [PMID: 28861027 PMCID: PMC5563126 DOI: 10.3389/fpsyg.2017.01404] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/22/2017] [Accepted: 08/02/2017] [Indexed: 11/25/2022] Open
Abstract
The structural similarity of objects has been an important variable in explaining why some objects are easier to categorize at a superordinate level than to individuate, and also why some patients with brain injury have more difficulties in recognizing natural (structurally similar) objects than artifacts (structurally distinct objects). In spite of its merits as an explanatory variable, structural similarity is not a unitary construct, and it has been operationalized in different ways. Furthermore, even though measures of structural similarity have been successful in explaining task and category-effects, this has been based more on implication than on direct empirical demonstrations. Here, the direct influence of two different measures of structural similarity, contour overlap and within-item structural diversity, on object individuation (object decision) and superordinate categorization performance is examined. Both measures can account for performance differences across objects, but in different conditions. It is argued that this reflects differences between the measures in whether they tap: (i) global or local shape characteristics, and (ii) between- or within-category structural similarity.
Collapse
Affiliation(s)
- Christian Gerlach
- Department of Psychology, University of Southern Denmark OdenseOdense, Denmark
| |
Collapse
|
21
|
Liesefeld HR, Liesefeld AM, Töllner T, Müller HJ. Attentional capture in visual search: Capture and post-capture dynamics revealed by EEG. Neuroimage 2017; 156:166-173. [DOI: 10.1016/j.neuroimage.2017.05.016] [Citation(s) in RCA: 41] [Impact Index Per Article: 5.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/23/2017] [Revised: 04/11/2017] [Accepted: 05/10/2017] [Indexed: 10/19/2022] Open
|
22
|
Abstract
The relationship between visual attentional selection of items in particular spatial locations and selection by nonspatial criteria was investigated in a partial report experiment with report of letters (as many as possible) from brief postmasked exposures of circular arrays of letters and digits. The data were fitted by mathematical models based on Bundesen's (Psychological Review, 97, 523-547, 1990) theory of visual attention (TVA). Both attentional weights of targets (letters) and attentional weights of distractors (digits) showed strong variations across the eight possible target locations, but for each of the ten participants, the ratio of the weight of a distractor at a given location to the weight of a target at the same location was approximately constant. The results were accommodated by revising the weight equation of TVA such that the attentional weight of an object equals a product of a spatial weight component (weight due to being at a particular location) and a nonspatial weight component (weight due to having particular features other than locations), the two components scaling the effects of each other multiplicatively.
Collapse
|
23
|
Item-based selection is in good shape in visual compound search: A view from electrophysiology. Behav Brain Sci 2017; 40:e156. [DOI: 10.1017/s0140525x16000261] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
Abstract
AbstractWe argue that although the framework put forward by Hulleman & Olivers (H&O) can successfully explain much of visual search behaviour, it appears limited to tasks without precise target identification demands. In particular, we contend that the unit of selection may be larger than a single item in standard detection tasks, whereas the unit may mandatorily be item-based in compound tasks.
Collapse
|
24
|
Gögler N, Finke K, Keller I, Müller HJ, Conci M. Object integration requires attention: Visual search for Kanizsa figures in parietal extinction. Neuropsychologia 2016; 92:42-50. [DOI: 10.1016/j.neuropsychologia.2016.06.006] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/12/2015] [Revised: 06/03/2016] [Accepted: 06/07/2016] [Indexed: 11/24/2022]
|
25
|
Marini F, Marzi CA. Gestalt Perceptual Organization of Visual Stimuli Captures Attention Automatically: Electrophysiological Evidence. Front Hum Neurosci 2016; 10:446. [PMID: 27630555 PMCID: PMC5005981 DOI: 10.3389/fnhum.2016.00446] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/08/2016] [Accepted: 08/22/2016] [Indexed: 12/31/2022] Open
Abstract
The visual system leverages organizational regularities of perceptual elements to create meaningful representations of the world. One clear example of such function, which has been formalized in the Gestalt psychology principles, is the perceptual grouping of simple visual elements (e.g., lines and arcs) into unitary objects (e.g., forms and shapes). The present study sought to characterize automatic attentional capture and related cognitive processing of Gestalt-like visual stimuli at the psychophysiological level by using event-related potentials (ERPs). We measured ERPs during a simple visual reaction time task with bilateral presentations of physically matched elements with or without a Gestalt organization. Results showed that Gestalt (vs. non-Gestalt) stimuli are characterized by a larger N2pc together with enhanced ERP amplitudes of non-lateralized components (N1, N2, P3) starting around 150 ms post-stimulus onset. Thus, we conclude that Gestalt stimuli capture attention automatically and entail characteristic psychophysiological signatures at both early and late processing stages. Highlights We studied the neural signatures of the automatic processes of visual attention elicited by Gestalt stimuli. We found that a reliable early correlate of attentional capture turned out to be the N2pc component. Perceptual and cognitive processing of Gestalt stimuli is associated with larger N1, N2, and P3.
Collapse
Affiliation(s)
- Francesco Marini
- Department of Neuroscience, Biomedicine and Movement Sciences, University of VeronaVerona, Italy; Department of Psychology, University of California San Diego, La JollaCA, USA
| | - Carlo A Marzi
- Department of Neuroscience, Biomedicine and Movement Sciences, University of VeronaVerona, Italy; National Institute of NeuroscienceVerona, Italy
| |
Collapse
|
26
|
Nie QY, Maurer M, Müller HJ, Conci M. Inhibition drives configural superiority of illusory Gestalt: Combined behavioral and drift–diffusion model evidence. Cognition 2016; 150:150-62. [DOI: 10.1016/j.cognition.2016.02.007] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2015] [Revised: 02/08/2016] [Accepted: 02/11/2016] [Indexed: 11/29/2022]
|
27
|
The effect of modulating top-down attention deployment on the N2pc/PCN. Biol Psychol 2016; 117:187-193. [PMID: 27079894 DOI: 10.1016/j.biopsycho.2016.04.004] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/13/2015] [Revised: 04/05/2016] [Accepted: 04/08/2016] [Indexed: 11/21/2022]
Abstract
The N2pc (PCN) component of the event-related potential (ERP) waveform provides a useful tool for directly assessing the locus of spatial attention in visual search. It is still unclear whether the amplitude of the N2pc/PCN relates to the deployment of attentional resources. A key issue is the lack of evidence that top-down allocation of attention affects the N2pc/PCN amplitude. Previous findings could be explained if manipulating different expectancy strategies changes participants' search mode, causing them to redefine the target's features. In this study, we explored the relationship between N2pc/PCN amplitude and top-down attention allocation by manipulating the discriminative difficulty (differences in the response-defining feature) but leaving the search difficulty (target's saliency) unchanged. Using the same sets of stimuli, in a blocked condition, participants showed the expected higher amplitude of N2pc/PCN in the hardest condition, compared to easier discrimination conditions. Importantly, there was no difference in the N2pc/PCN when the exact same stimulus sets were presented in a randomly interleaved mixed set. At a behavioral level, in both conditions performance was significantly slower for the hardest condition. This finding indicates that the N2pc/PCN component is modulated by the predictability of discriminative difficulty, which reflects the modulation of top-down attentional deployment.
Collapse
|
28
|
Wiegand I, Finke K, Töllner T, Starman K, Müller HJ, Conci M. Age-related decline in global form suppression. Biol Psychol 2015; 112:116-24. [DOI: 10.1016/j.biopsycho.2015.10.006] [Citation(s) in RCA: 19] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/18/2015] [Revised: 09/30/2015] [Accepted: 10/15/2015] [Indexed: 10/22/2022]
|
29
|
Töllner T, Mink M, Müller HJ. Searching for targets in visual working memory: investigating a dimensional feature bundle (DFB) model. Ann N Y Acad Sci 2015; 1339:32-44. [PMID: 25716303 DOI: 10.1111/nyas.12703] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
Abstract
The human visual working memory (WM) system enables us to store a limited amount of task-relevant visual information temporally in mind. One actively debated issue in cognitive neuroscience centers around the question of how this WM information is maintained. The currently dominant views advocated by prominent WM models hold that the units of memory are configured either as independent feature representations, integrated bound objects, or a combination of both. Here, we approached this issue by measuring lateralized brain electrical activity during a retro-cue paradigm, in order to track people's ability to access WM representations as a function of the dimensional relation between WM items and task settings. Both factors were revealed to selectively influence WM access: whereas cross relative to intradimensional WM targets gave rise to enhanced contralateral delay activity (CDA) amplitudes, localization relative to identification task demands yielded speeded CDA and manual response times. As these dimension-based findings are not reconcilable with contemporary feature- and/or object-based accounts, an alternative view that is based on the hierarchical feature-bundle model is proposed. We argue that WM units may consist of three hierarchically structured levels of representations, with an intermediate dimensionally organized level that mediates between top-level object and lower-level feature representations.
Collapse
Affiliation(s)
- Thomas Töllner
- Department of Experimental Psychology, Ludwig-Maximilians-Universität München, Munich, Germany; Graduate School of Systemic Neurosciences, Ludwig-Maximilians-Universität München, Munich, Germany
| | | | | |
Collapse
|